2024-04-26T10:36:05.658 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T10:36:05.658 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674130 --name teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/centos_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} -- /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674130/orig.config.yaml 2024-04-26T10:36:05.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T10:36:05.770 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674130 branch: reef description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/centos_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7674130' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: reef ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd memory target: 1610612736 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: dc093b5e41f728edab6e0330295fdf9156d31664 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: dc093b5e41f728edab6e0330295fdf9156d31664 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 7d2137f0a666c92a9411c1af5c33e4968be54da6 owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 1136 sha1: dc093b5e41f728edab6e0330295fdf9156d31664 sleep_before_teardown: 0 subset: 0/4 suite: powercycle suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 7d2137f0a666c92a9411c1af5c33e4968be54da6 targets: smithi049.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOJUzKorpIzBh48FyBZ7SBxE2BcZLHjTOQdSWqQAk23XlKpp5RZ1vjE+w2I22jONW/Hg+l/861aI1nUHkoChOxU= smithi060.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNTBBJBdBqzDeJqFT4w+cEANxAj3N41v3fSt2XjtPdbwSssGVQ2U5F//t5DkSn4pe6N+5b4mpfObC19rk5t4E1I= smithi087.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFG/wxjmta13/75JjU46qzEk4mJzw3DkFH/EHsHZjnfzh6PsI9yZ7V45SQhETOZ7glKadC3ocGs8+68hLFJ3+5E= smithi195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMIXc8UXBnDxQI9wTv+D8RLry5RznOHz7oKtY+wC2iXGd88jc7/sIMdwWXX+3ITGJdPnxuKhmkKwdRq255kEVxI= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_22:32:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T10:36:05.771 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa; will attempt to use it 2024-04-26T10:36:05.771 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa/tasks 2024-04-26T10:36:05.771 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T10:36:05.773 INFO:teuthology.task.internal:Checking packages... 2024-04-26T10:36:05.796 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'dc093b5e41f728edab6e0330295fdf9156d31664' 2024-04-26T10:36:05.796 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T10:36:05.796 INFO:teuthology.packaging:ref: None 2024-04-26T10:36:05.796 INFO:teuthology.packaging:tag: None 2024-04-26T10:36:05.796 INFO:teuthology.packaging:branch: reef 2024-04-26T10:36:05.796 INFO:teuthology.packaging:sha1: dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T10:36:05.796 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-04-26T10:36:06.126 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1258.g7d2137f0 2024-04-26T10:36:06.128 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T10:36:06.135 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T10:36:06.135 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T10:36:06.172 INFO:teuthology.task.internal:Saving configuration 2024-04-26T10:36:06.184 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T10:36:06.205 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T10:36:06.225 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674130', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 10:29:16.243893', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOJUzKorpIzBh48FyBZ7SBxE2BcZLHjTOQdSWqQAk23XlKpp5RZ1vjE+w2I22jONW/Hg+l/861aI1nUHkoChOxU='} 2024-04-26T10:36:06.244 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674130', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 10:29:16.241020', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNTBBJBdBqzDeJqFT4w+cEANxAj3N41v3fSt2XjtPdbwSssGVQ2U5F//t5DkSn4pe6N+5b4mpfObC19rk5t4E1I='} 2024-04-26T10:36:06.266 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674130', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 10:29:16.245236', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFG/wxjmta13/75JjU46qzEk4mJzw3DkFH/EHsHZjnfzh6PsI9yZ7V45SQhETOZ7glKadC3ocGs8+68hLFJ3+5E='} 2024-04-26T10:36:06.289 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674130', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 10:29:16.242557', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMIXc8UXBnDxQI9wTv+D8RLry5RznOHz7oKtY+wC2iXGd88jc7/sIMdwWXX+3ITGJdPnxuKhmkKwdRq255kEVxI='} 2024-04-26T10:36:06.289 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T10:36:06.296 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-04-26T10:36:06.296 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['osd.0'] 2024-04-26T10:36:06.296 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['osd.1'] 2024-04-26T10:36:06.296 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['osd.2'] 2024-04-26T10:36:06.296 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T10:36:06.505 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f16eb2af0d0>, signals=[15]) 2024-04-26T10:36:06.505 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T10:36:06.512 INFO:teuthology.task.internal:Opening connections... 2024-04-26T10:36:06.512 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi049.front.sepia.ceph.com 2024-04-26T10:36:06.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:36:06.636 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi060.front.sepia.ceph.com 2024-04-26T10:36:06.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:36:06.713 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi087.front.sepia.ceph.com 2024-04-26T10:36:06.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:36:06.788 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2024-04-26T10:36:06.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:36:06.865 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T10:36:06.873 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2024-04-26T10:36:06.891 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2024-04-26T10:36:06.892 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-04-26T10:36:06.951 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2024-04-26T10:36:06.951 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="9" 2024-04-26T10:36:06.951 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2024-04-26T10:36:06.951 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2024-04-26T10:36:06.952 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="9" 2024-04-26T10:36:06.952 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el9" 2024-04-26T10:36:06.952 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T10:36:06.952 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2024-04-26T10:36:06.952 INFO:teuthology.orchestra.run.smithi049.stdout:LOGO="fedora-logo-icon" 2024-04-26T10:36:06.952 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T10:36:06.952 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2024-04-26T10:36:06.952 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T10:36:06.952 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T10:36:06.953 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T10:36:06.953 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-04-26T10:36:06.974 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2024-04-26T10:36:06.993 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2024-04-26T10:36:06.993 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2024-04-26T10:36:07.051 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream" 2024-04-26T10:36:07.051 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="9" 2024-04-26T10:36:07.051 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos" 2024-04-26T10:36:07.051 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora" 2024-04-26T10:36:07.051 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="9" 2024-04-26T10:36:07.051 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el9" 2024-04-26T10:36:07.051 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T10:36:07.052 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2024-04-26T10:36:07.052 INFO:teuthology.orchestra.run.smithi060.stdout:LOGO="fedora-logo-icon" 2024-04-26T10:36:07.053 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T10:36:07.053 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/" 2024-04-26T10:36:07.053 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T10:36:07.053 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T10:36:07.053 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T10:36:07.053 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2024-04-26T10:36:07.073 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2024-04-26T10:36:07.091 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2024-04-26T10:36:07.091 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-04-26T10:36:07.148 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Stream" 2024-04-26T10:36:07.148 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="9" 2024-04-26T10:36:07.148 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos" 2024-04-26T10:36:07.148 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora" 2024-04-26T10:36:07.149 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="9" 2024-04-26T10:36:07.149 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el9" 2024-04-26T10:36:07.149 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T10:36:07.149 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2024-04-26T10:36:07.149 INFO:teuthology.orchestra.run.smithi087.stdout:LOGO="fedora-logo-icon" 2024-04-26T10:36:07.149 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T10:36:07.149 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/" 2024-04-26T10:36:07.149 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T10:36:07.149 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T10:36:07.149 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T10:36:07.149 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-04-26T10:36:07.173 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2024-04-26T10:36:07.192 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2024-04-26T10:36:07.192 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-04-26T10:36:07.248 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2024-04-26T10:36:07.249 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2024-04-26T10:36:07.249 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2024-04-26T10:36:07.249 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2024-04-26T10:36:07.249 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2024-04-26T10:36:07.249 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2024-04-26T10:36:07.249 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T10:36:07.249 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2024-04-26T10:36:07.249 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2024-04-26T10:36:07.249 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T10:36:07.249 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2024-04-26T10:36:07.249 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T10:36:07.249 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T10:36:07.249 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T10:36:07.250 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-04-26T10:36:07.265 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T10:36:07.274 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T10:36:07.314 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T10:36:07.314 DEBUG:teuthology.orchestra.run.smithi049:> test '!' -e /home/ubuntu/cephtest 2024-04-26T10:36:07.317 DEBUG:teuthology.orchestra.run.smithi060:> test '!' -e /home/ubuntu/cephtest 2024-04-26T10:36:07.319 DEBUG:teuthology.orchestra.run.smithi087:> test '!' -e /home/ubuntu/cephtest 2024-04-26T10:36:07.321 DEBUG:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2024-04-26T10:36:07.337 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T10:36:07.347 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T10:36:07.347 DEBUG:teuthology.orchestra.run.smithi049:> test -z $(ls -A /var/lib/ceph) 2024-04-26T10:36:07.375 DEBUG:teuthology.orchestra.run.smithi060:> test -z $(ls -A /var/lib/ceph) 2024-04-26T10:36:07.377 DEBUG:teuthology.orchestra.run.smithi087:> test -z $(ls -A /var/lib/ceph) 2024-04-26T10:36:07.379 DEBUG:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2024-04-26T10:36:07.494 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T10:36:07.598 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T10:36:07.613 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-26T10:36:07.613 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-26T10:36:07.613 DEBUG:teuthology.orchestra.run.smithi049:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T10:36:07.614 DEBUG:teuthology.orchestra.run.smithi060:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T10:36:07.614 DEBUG:teuthology.orchestra.run.smithi087:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T10:36:07.615 DEBUG:teuthology.orchestra.run.smithi195:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T10:36:07.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:36:07.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:36:07.633 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-04-26T10:36:07.633 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-04-26T10:36:07.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:36:07.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:36:07.635 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2024-04-26T10:36:07.635 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2024-04-26T10:36:07.690 INFO:teuthology.orchestra.run.smithi195.stdout:5.14.0-437.el9.x86_64 2024-04-26T10:36:07.690 INFO:teuthology.task.kernel:Running kernel on smithi195: 5.14.0-437.el9.x86_64 2024-04-26T10:36:07.690 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum install -y kernel 2024-04-26T10:36:07.691 INFO:teuthology.orchestra.run.smithi087.stdout:5.14.0-437.el9.x86_64 2024-04-26T10:36:07.692 INFO:teuthology.task.kernel:Running kernel on smithi087: 5.14.0-437.el9.x86_64 2024-04-26T10:36:07.692 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum install -y kernel 2024-04-26T10:36:07.693 INFO:teuthology.orchestra.run.smithi060.stdout:5.14.0-437.el9.x86_64 2024-04-26T10:36:07.693 INFO:teuthology.task.kernel:Running kernel on smithi060: 5.14.0-437.el9.x86_64 2024-04-26T10:36:07.694 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum install -y kernel 2024-04-26T10:36:07.695 INFO:teuthology.orchestra.run.smithi049.stdout:5.14.0-437.el9.x86_64 2024-04-26T10:36:07.695 INFO:teuthology.task.kernel:Running kernel on smithi049: 5.14.0-437.el9.x86_64 2024-04-26T10:36:07.695 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum install -y kernel 2024-04-26T10:36:10.077 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.0 MB 00:00 2024-04-26T10:36:10.115 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-26T10:36:10.280 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 9.5 MB/s | 8.0 MB 00:00 2024-04-26T10:36:10.623 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - BaseOS 6.0 MB/s | 8.0 MB 00:01 2024-04-26T10:36:12.003 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-26T10:36:12.092 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-04-26T10:36:12.540 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-04-26T10:36:12.765 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 14 MB/s | 19 MB 00:01 2024-04-26T10:36:16.209 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-26T10:36:16.246 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-26T10:36:16.716 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-04-26T10:36:16.949 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-26T10:36:17.810 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 16 kB 00:00 2024-04-26T10:36:18.172 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 16 kB 00:00 2024-04-26T10:36:18.397 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 16 kB 00:00 2024-04-26T10:36:18.591 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 16 kB 00:01 2024-04-26T10:36:19.151 INFO:teuthology.orchestra.run.smithi049.stdout:Extra Packages for Enterprise Linux 24 MB/s | 21 MB 00:00 2024-04-26T10:36:19.818 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-26T10:36:20.106 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 9.6 MB/s | 21 MB 00:02 2024-04-26T10:36:22.417 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 5.7 MB/s | 21 MB 00:03 2024-04-26T10:36:24.459 INFO:teuthology.orchestra.run.smithi049.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-04-26T10:36:25.016 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-04-26T10:36:25.228 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-26T10:36:26.424 INFO:teuthology.orchestra.run.smithi049.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T10:36:26.424 INFO:teuthology.orchestra.run.smithi049.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T10:36:26.508 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-04-26T10:36:26.509 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2024-04-26T10:36:26.509 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-04-26T10:36:26.608 DEBUG:teuthology.orchestra.run.smithi049:> echo no | sudo yum reinstall kernel || true 2024-04-26T10:36:26.963 INFO:teuthology.orchestra.run.smithi060.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T10:36:26.964 INFO:teuthology.orchestra.run.smithi060.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T10:36:27.057 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-26T10:36:27.058 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-04-26T10:36:27.058 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-26T10:36:27.109 INFO:teuthology.orchestra.run.smithi195.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T10:36:27.109 INFO:teuthology.orchestra.run.smithi195.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T10:36:27.129 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 10:36:24 AM UTC. 2024-04-26T10:36:27.174 DEBUG:teuthology.orchestra.run.smithi060:> echo no | sudo yum reinstall kernel || true 2024-04-26T10:36:27.202 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-26T10:36:27.203 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2024-04-26T10:36:27.203 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-26T10:36:27.253 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-04-26T10:36:27.266 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-04-26T10:36:27.266 INFO:teuthology.orchestra.run.smithi049.stdout: Package Architecture Version Repository Size 2024-04-26T10:36:27.266 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-04-26T10:36:27.266 INFO:teuthology.orchestra.run.smithi049.stdout:Reinstalling: 2024-04-26T10:36:27.266 INFO:teuthology.orchestra.run.smithi049.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T10:36:27.266 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:36:27.266 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-04-26T10:36:27.266 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-04-26T10:36:27.266 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:36:27.266 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 255 k 2024-04-26T10:36:27.266 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 0 2024-04-26T10:36:27.267 INFO:teuthology.orchestra.run.smithi049.stderr:Operation aborted. 2024-04-26T10:36:27.317 DEBUG:teuthology.orchestra.run.smithi195:> echo no | sudo yum reinstall kernel || true 2024-04-26T10:36:27.325 INFO:teuthology.orchestra.run.smithi049.stdout:Is this ok [y/N]: 2024-04-26T10:36:27.326 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum reinstall -y kernel || true 2024-04-26T10:36:27.533 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-26T10:36:27.735 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 10:36:24 AM UTC. 2024-04-26T10:36:27.845 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 10:36:24 AM UTC. 2024-04-26T10:36:27.857 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:02 ago on Fri 26 Apr 2024 10:36:25 AM UTC. 2024-04-26T10:36:27.877 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-26T10:36:27.893 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-26T10:36:27.893 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2024-04-26T10:36:27.893 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-26T10:36:27.893 INFO:teuthology.orchestra.run.smithi060.stdout:Reinstalling: 2024-04-26T10:36:27.893 INFO:teuthology.orchestra.run.smithi060.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T10:36:27.894 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:36:27.894 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-04-26T10:36:27.894 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-26T10:36:27.894 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:36:27.894 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 255 k 2024-04-26T10:36:27.895 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 0 2024-04-26T10:36:27.895 INFO:teuthology.orchestra.run.smithi060.stderr:Operation aborted. 2024-04-26T10:36:27.955 INFO:teuthology.orchestra.run.smithi060.stdout:Is this ok [y/N]: 2024-04-26T10:36:27.956 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum reinstall -y kernel || true 2024-04-26T10:36:27.965 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-04-26T10:36:27.966 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-04-26T10:36:27.966 INFO:teuthology.orchestra.run.smithi049.stdout: Package Architecture Version Repository Size 2024-04-26T10:36:27.966 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-04-26T10:36:27.966 INFO:teuthology.orchestra.run.smithi049.stdout:Reinstalling: 2024-04-26T10:36:27.966 INFO:teuthology.orchestra.run.smithi049.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T10:36:27.966 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:36:27.966 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-04-26T10:36:27.967 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-04-26T10:36:27.967 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:36:27.967 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 255 k 2024-04-26T10:36:27.967 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 0 2024-04-26T10:36:27.967 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-04-26T10:36:27.975 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-26T10:36:27.985 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-26T10:36:27.985 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-04-26T10:36:27.985 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-26T10:36:27.985 INFO:teuthology.orchestra.run.smithi195.stdout:Reinstalling: 2024-04-26T10:36:27.985 INFO:teuthology.orchestra.run.smithi195.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T10:36:27.985 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:36:27.986 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-26T10:36:27.986 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-26T10:36:27.986 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:36:27.986 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 255 k 2024-04-26T10:36:27.986 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 0 2024-04-26T10:36:27.987 INFO:teuthology.orchestra.run.smithi195.stderr:Operation aborted. 2024-04-26T10:36:28.044 INFO:teuthology.orchestra.run.smithi195.stdout:Is this ok [y/N]: 2024-04-26T10:36:28.044 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum reinstall -y kernel || true 2024-04-26T10:36:28.194 INFO:teuthology.orchestra.run.smithi049.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.6 MB/s | 255 kB 00:00 2024-04-26T10:36:28.195 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-04-26T10:36:28.195 INFO:teuthology.orchestra.run.smithi049.stdout:Total 1.1 MB/s | 255 kB 00:00 2024-04-26T10:36:28.215 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-04-26T10:36:28.399 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-04-26T10:36:28.399 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-04-26T10:36:28.404 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-04-26T10:36:28.405 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-04-26T10:36:28.469 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:00:04 ago on Fri 26 Apr 2024 10:36:24 AM UTC. 2024-04-26T10:36:28.535 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-04-26T10:36:28.537 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 10:36:25 AM UTC. 2024-04-26T10:36:28.589 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-26T10:36:28.589 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-26T10:36:28.590 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2024-04-26T10:36:28.590 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-26T10:36:28.590 INFO:teuthology.orchestra.run.smithi060.stdout:Reinstalling: 2024-04-26T10:36:28.590 INFO:teuthology.orchestra.run.smithi060.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T10:36:28.590 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:36:28.590 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-04-26T10:36:28.590 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-04-26T10:36:28.590 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:36:28.590 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 255 k 2024-04-26T10:36:28.590 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 0 2024-04-26T10:36:28.590 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-04-26T10:36:28.612 INFO:teuthology.orchestra.run.smithi049.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T10:36:28.612 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T10:36:28.654 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-26T10:36:28.654 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-26T10:36:28.654 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-04-26T10:36:28.655 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-26T10:36:28.655 INFO:teuthology.orchestra.run.smithi195.stdout:Reinstalling: 2024-04-26T10:36:28.655 INFO:teuthology.orchestra.run.smithi195.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T10:36:28.655 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:36:28.655 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-26T10:36:28.655 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-26T10:36:28.655 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:36:28.655 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 255 k 2024-04-26T10:36:28.655 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 0 2024-04-26T10:36:28.655 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-26T10:36:28.972 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-5.14.0-437.el9.x86_64.rpm 998 kB/s | 255 kB 00:00 2024-04-26T10:36:28.972 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-26T10:36:28.972 INFO:teuthology.orchestra.run.smithi195.stdout:Total 803 kB/s | 255 kB 00:00 2024-04-26T10:36:28.990 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-26T10:36:29.017 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.7 MB/s | 255 kB 00:00 2024-04-26T10:36:29.018 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-04-26T10:36:29.018 INFO:teuthology.orchestra.run.smithi060.stdout:Total 595 kB/s | 255 kB 00:00 2024-04-26T10:36:29.041 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-04-26T10:36:29.175 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-26T10:36:29.176 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-26T10:36:29.180 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-26T10:36:29.181 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-26T10:36:29.225 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-04-26T10:36:29.225 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-04-26T10:36:29.230 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-04-26T10:36:29.231 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-04-26T10:36:29.312 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T10:36:29.312 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T10:36:29.324 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-26T10:36:29.377 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-04-26T10:36:29.381 INFO:teuthology.orchestra.run.smithi195.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T10:36:29.381 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T10:36:29.417 INFO:teuthology.orchestra.run.smithi087.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T10:36:29.417 INFO:teuthology.orchestra.run.smithi087.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T10:36:29.452 INFO:teuthology.orchestra.run.smithi060.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T10:36:29.452 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T10:36:29.511 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-04-26T10:36:29.512 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-04-26T10:36:29.512 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-04-26T10:36:29.613 DEBUG:teuthology.orchestra.run.smithi087:> echo no | sudo yum reinstall kernel || true 2024-04-26T10:36:29.989 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T10:36:29.989 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:36:29.989 INFO:teuthology.orchestra.run.smithi049.stdout:Reinstalled: 2024-04-26T10:36:29.989 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T10:36:29.989 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:36:29.989 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-04-26T10:36:30.034 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T10:36:30.034 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T10:36:30.109 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 10:36:27 AM UTC. 2024-04-26T10:36:30.159 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T10:36:30.159 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T10:36:30.202 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T10:36:30.227 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-04-26T10:36:30.240 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-04-26T10:36:30.240 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2024-04-26T10:36:30.240 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-04-26T10:36:30.240 INFO:teuthology.orchestra.run.smithi087.stdout:Reinstalling: 2024-04-26T10:36:30.240 INFO:teuthology.orchestra.run.smithi087.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T10:36:30.240 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:36:30.240 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-04-26T10:36:30.240 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-04-26T10:36:30.240 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:36:30.241 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 255 k 2024-04-26T10:36:30.241 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 0 2024-04-26T10:36:30.241 INFO:teuthology.orchestra.run.smithi087.stderr:Operation aborted. 2024-04-26T10:36:30.249 INFO:teuthology.orchestra.run.smithi049.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T10:36:30.250 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T10:36:30.250 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T10:36:30.250 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T10:36:30.250 DEBUG:teuthology.orchestra.run.smithi049:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T10:36:30.278 INFO:teuthology.orchestra.run.smithi049.stdout:ttyS1 2024-04-26T10:36:30.300 DEBUG:teuthology.parallel:result is None 2024-04-26T10:36:30.302 INFO:teuthology.orchestra.run.smithi087.stdout:Is this ok [y/N]: 2024-04-26T10:36:30.303 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum reinstall -y kernel || true 2024-04-26T10:36:30.764 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T10:36:30.764 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:36:30.764 INFO:teuthology.orchestra.run.smithi195.stdout:Reinstalled: 2024-04-26T10:36:30.764 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T10:36:30.764 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:36:30.764 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-26T10:36:30.795 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 10:36:27 AM UTC. 2024-04-26T10:36:30.835 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T10:36:30.835 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:36:30.835 INFO:teuthology.orchestra.run.smithi060.stdout:Reinstalled: 2024-04-26T10:36:30.835 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T10:36:30.835 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:36:30.835 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-26T10:36:30.910 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-04-26T10:36:30.911 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-04-26T10:36:30.911 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2024-04-26T10:36:30.913 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-04-26T10:36:30.913 INFO:teuthology.orchestra.run.smithi087.stdout:Reinstalling: 2024-04-26T10:36:30.913 INFO:teuthology.orchestra.run.smithi087.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T10:36:30.913 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:36:30.914 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-04-26T10:36:30.914 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-04-26T10:36:30.914 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:36:30.914 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 255 k 2024-04-26T10:36:30.914 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 0 2024-04-26T10:36:30.914 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-04-26T10:36:30.927 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T10:36:30.973 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T10:36:30.974 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T10:36:30.974 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T10:36:30.975 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-04-26T10:36:30.975 DEBUG:teuthology.orchestra.run.smithi195:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T10:36:31.000 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T10:36:31.016 INFO:teuthology.orchestra.run.smithi195.stdout:ttyS1 2024-04-26T10:36:31.037 DEBUG:teuthology.parallel:result is None 2024-04-26T10:36:31.047 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T10:36:31.048 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T10:36:31.048 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T10:36:31.048 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-04-26T10:36:31.048 DEBUG:teuthology.orchestra.run.smithi060:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T10:36:31.081 INFO:teuthology.orchestra.run.smithi060.stdout:ttyS1 2024-04-26T10:36:31.105 DEBUG:teuthology.parallel:result is None 2024-04-26T10:36:31.310 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-5.14.0-437.el9.x86_64.rpm 941 kB/s | 255 kB 00:00 2024-04-26T10:36:31.310 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-04-26T10:36:31.311 INFO:teuthology.orchestra.run.smithi087.stdout:Total 638 kB/s | 255 kB 00:00 2024-04-26T10:36:31.332 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-04-26T10:36:31.515 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-04-26T10:36:31.515 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-04-26T10:36:31.520 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-04-26T10:36:31.521 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-04-26T10:36:31.651 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-04-26T10:36:31.712 INFO:teuthology.orchestra.run.smithi087.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T10:36:31.712 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T10:36:32.313 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T10:36:32.313 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T10:36:32.996 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T10:36:32.996 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:36:32.996 INFO:teuthology.orchestra.run.smithi087.stdout:Reinstalled: 2024-04-26T10:36:32.996 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T10:36:32.996 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:36:32.996 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-04-26T10:36:33.199 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T10:36:33.245 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T10:36:33.246 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T10:36:33.246 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T10:36:33.246 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-04-26T10:36:33.246 DEBUG:teuthology.orchestra.run.smithi087:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T10:36:33.275 INFO:teuthology.orchestra.run.smithi087.stdout:ttyS1 2024-04-26T10:36:33.297 DEBUG:teuthology.parallel:result is None 2024-04-26T10:36:33.297 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T10:36:33.319 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T10:36:33.319 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T10:36:33.322 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T10:36:33.324 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T10:36:33.339 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T10:36:33.358 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T10:36:33.366 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T10:36:33.385 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T10:36:33.385 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T10:36:33.388 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T10:36:33.390 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T10:36:33.394 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T10:36:33.422 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T10:36:33.430 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T10:36:33.430 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T10:36:33.457 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T10:36:33.460 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T10:36:33.462 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T10:36:33.487 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T10:36:33.491 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T10:36:33.491 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T10:36:33.498 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T10:36:33.498 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T10:36:33.500 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T10:36:33.501 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T10:36:33.508 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T10:36:33.510 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T10:36:33.521 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T10:36:33.522 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T10:36:33.542 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T10:36:33.546 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T10:36:33.548 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T10:36:33.576 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T10:36:33.585 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T10:36:33.585 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T10:36:33.613 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T10:36:33.616 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T10:36:33.618 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T10:36:33.634 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T10:36:33.713 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T10:36:33.763 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T10:36:33.849 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T10:36:33.891 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-04-26T10:36:33.891 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T10:36:33.957 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T10:36:34.007 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T10:36:34.057 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T10:36:34.137 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T10:36:34.187 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-26T10:36:34.187 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T10:36:34.255 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T10:36:34.297 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T10:36:34.351 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T10:36:34.434 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T10:36:34.472 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-26T10:36:34.472 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T10:36:34.535 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T10:36:34.580 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T10:36:34.845 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T10:36:34.889 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T10:36:34.931 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T10:36:34.932 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T10:36:34.998 DEBUG:teuthology.orchestra.run.smithi049:> sudo service rsyslog restart 2024-04-26T10:36:35.000 DEBUG:teuthology.orchestra.run.smithi060:> sudo service rsyslog restart 2024-04-26T10:36:35.003 DEBUG:teuthology.orchestra.run.smithi087:> sudo service rsyslog restart 2024-04-26T10:36:35.005 DEBUG:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2024-04-26T10:36:35.035 INFO:teuthology.orchestra.run.smithi049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T10:36:35.041 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T10:36:35.041 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T10:36:35.083 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T10:36:35.547 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T10:36:35.555 INFO:teuthology.task.internal:Starting timer... 2024-04-26T10:36:35.556 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T10:36:35.606 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T10:36:35.630 DEBUG:teuthology.orchestra.run.smithi049:> sudo service auditd rotate 2024-04-26T10:36:35.687 INFO:teuthology.orchestra.run.smithi049.stdout:Rotating logs: 2024-04-26T10:36:35.689 DEBUG:teuthology.orchestra.run.smithi060:> sudo service auditd rotate 2024-04-26T10:36:35.755 INFO:teuthology.orchestra.run.smithi060.stdout:Rotating logs: 2024-04-26T10:36:35.756 DEBUG:teuthology.orchestra.run.smithi087:> sudo service auditd rotate 2024-04-26T10:36:35.824 INFO:teuthology.orchestra.run.smithi087.stdout:Rotating logs: 2024-04-26T10:36:35.824 DEBUG:teuthology.orchestra.run.smithi195:> sudo service auditd rotate 2024-04-26T10:36:35.900 INFO:teuthology.orchestra.run.smithi195.stdout:Rotating logs: 2024-04-26T10:36:35.902 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T10:36:35.902 DEBUG:teuthology.orchestra.run.smithi049:> /usr/sbin/getenforce 2024-04-26T10:36:35.933 INFO:teuthology.orchestra.run.smithi049.stdout:Permissive 2024-04-26T10:36:35.933 DEBUG:teuthology.orchestra.run.smithi060:> /usr/sbin/getenforce 2024-04-26T10:36:35.953 INFO:teuthology.orchestra.run.smithi060.stdout:Permissive 2024-04-26T10:36:35.953 DEBUG:teuthology.orchestra.run.smithi087:> /usr/sbin/getenforce 2024-04-26T10:36:35.984 INFO:teuthology.orchestra.run.smithi087.stdout:Permissive 2024-04-26T10:36:35.985 DEBUG:teuthology.orchestra.run.smithi195:> /usr/sbin/getenforce 2024-04-26T10:36:36.018 INFO:teuthology.orchestra.run.smithi195.stdout:Permissive 2024-04-26T10:36:36.018 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi049.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi060.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi087.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi195.front.sepia.ceph.com': 'permissive'} 2024-04-26T10:36:36.019 DEBUG:teuthology.orchestra.run.smithi049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T10:36:36.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:36:36.044 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T10:36:36.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:36:36.071 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T10:36:36.094 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:36:36.095 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T10:36:36.119 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:36:36.119 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T10:36:36.119 DEBUG:teuthology.orchestra.run.smithi049:> sudo /usr/sbin/setenforce permissive 2024-04-26T10:36:36.151 DEBUG:teuthology.orchestra.run.smithi060:> sudo /usr/sbin/setenforce permissive 2024-04-26T10:36:36.181 DEBUG:teuthology.orchestra.run.smithi087:> sudo /usr/sbin/setenforce permissive 2024-04-26T10:36:36.204 DEBUG:teuthology.orchestra.run.smithi195:> sudo /usr/sbin/setenforce permissive 2024-04-26T10:36:36.230 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T10:36:36.240 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-26T10:36:36.246 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-26T10:36:36.381 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T10:36:36.398 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T10:36:36.400 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi049.front.sepia.ceph.com,smithi060.front.sepia.ceph.com,smithi087.front.sepia.ceph.com,smithi195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T10:40:12.398 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi049.front.sepia.ceph.com'), Remote(name='ubuntu@smithi060.front.sepia.ceph.com'), Remote(name='ubuntu@smithi087.front.sepia.ceph.com'), Remote(name='ubuntu@smithi195.front.sepia.ceph.com')] 2024-04-26T10:40:12.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-04-26T10:40:12.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:40:12.479 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-04-26T10:40:12.563 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-04-26T10:40:12.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-04-26T10:40:12.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:40:12.648 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-04-26T10:40:12.731 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-04-26T10:40:12.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-04-26T10:40:12.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:40:12.805 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-04-26T10:40:12.889 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-04-26T10:40:12.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-26T10:40:12.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:40:12.965 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-04-26T10:40:13.047 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-26T10:40:13.048 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T10:40:13.061 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T10:40:13.061 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T10:40:13.061 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T10:40:13.064 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T10:40:13.064 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T10:40:13.066 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T10:40:13.066 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T10:40:13.068 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T10:40:13.069 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T10:40:13.094 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T10:40:13.095 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T10:40:13.098 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T10:40:13.108 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T10:40:13.111 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T10:40:13.113 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T10:40:13.117 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T10:40:13.130 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: ntpd: command not found 2024-04-26T10:40:13.131 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T10:40:13.137 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: ntpd: command not found 2024-04-26T10:40:13.139 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: ntpd: command not found 2024-04-26T10:40:13.140 INFO:teuthology.orchestra.run.smithi087.stdout:506 Cannot talk to daemon 2024-04-26T10:40:13.148 INFO:teuthology.orchestra.run.smithi049.stdout:506 Cannot talk to daemon 2024-04-26T10:40:13.151 INFO:teuthology.orchestra.run.smithi060.stdout:506 Cannot talk to daemon 2024-04-26T10:40:13.153 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T10:40:13.155 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: ntpd: command not found 2024-04-26T10:40:13.163 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T10:40:13.165 INFO:teuthology.orchestra.run.smithi195.stdout:506 Cannot talk to daemon 2024-04-26T10:40:13.166 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T10:40:13.166 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T10:40:13.178 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T10:40:13.179 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T10:40:13.180 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T10:40:13.192 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T10:40:13.227 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2024-04-26T10:40:13.231 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T10:40:13.231 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-04-26T10:40:13.231 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:40:13.231 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:40:13.231 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:40:13.231 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:40:13.234 INFO:teuthology.orchestra.run.smithi049.stderr:bash: line 1: ntpq: command not found 2024-04-26T10:40:13.236 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-04-26T10:40:13.238 INFO:teuthology.orchestra.run.smithi049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T10:40:13.238 INFO:teuthology.orchestra.run.smithi049.stdout:=============================================================================== 2024-04-26T10:40:13.238 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:40:13.238 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:40:13.238 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:40:13.238 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:40:13.240 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T10:40:13.240 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-04-26T10:40:13.240 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:40:13.240 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:40:13.240 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:40:13.240 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:40:13.245 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: ntpq: command not found 2024-04-26T10:40:13.249 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T10:40:13.250 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-04-26T10:40:13.250 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:40:13.250 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:40:13.250 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:40:13.250 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:40:13.250 INFO:teuthology.run_tasks:Running task install... 2024-04-26T10:40:13.259 DEBUG:teuthology.task.install:project ceph 2024-04-26T10:40:13.259 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}} 2024-04-26T10:40:13.259 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'} 2024-04-26T10:40:13.259 INFO:teuthology.task.install:Using flavor: default 2024-04-26T10:40:13.266 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T10:40:13.266 INFO:teuthology.task.install:extra packages: [] 2024-04-26T10:40:13.266 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T10:40:13.267 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T10:40:13.269 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T10:40:13.269 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T10:40:13.270 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T10:40:13.270 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T10:40:13.271 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T10:40:13.272 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T10:40:13.416 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/ 2024-04-26T10:40:13.416 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T10:40:13.427 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/ 2024-04-26T10:40:13.427 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T10:40:13.506 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/ 2024-04-26T10:40:13.506 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T10:40:13.515 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/ 2024-04-26T10:40:13.515 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T10:40:13.538 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T10:40:13.538 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T10:40:13.538 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T10:40:13.596 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T10:40:13.597 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-04-26T10:40:13.597 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T10:40:13.600 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T10:40:13.600 DEBUG:teuthology.orchestra.run.smithi195:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T10:40:13.624 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T10:40:13.624 DEBUG:teuthology.orchestra.run.smithi049:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T10:40:13.628 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T10:40:13.628 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-26T10:40:13.629 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T10:40:13.656 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T10:40:13.657 DEBUG:teuthology.orchestra.run.smithi060:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T10:40:13.665 DEBUG:teuthology.orchestra.run.smithi195:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T10:40:13.678 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T10:40:13.679 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-26T10:40:13.679 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T10:40:13.692 DEBUG:teuthology.orchestra.run.smithi049:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T10:40:13.703 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T10:40:13.703 DEBUG:teuthology.orchestra.run.smithi087:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T10:40:13.723 DEBUG:teuthology.orchestra.run.smithi060:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T10:40:13.739 DEBUG:teuthology.orchestra.run.smithi195:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T10:40:13.767 DEBUG:teuthology.orchestra.run.smithi087:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T10:40:13.769 DEBUG:teuthology.orchestra.run.smithi049:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T10:40:13.801 DEBUG:teuthology.orchestra.run.smithi060:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T10:40:13.802 INFO:teuthology.orchestra.run.smithi195.stdout:check_obsoletes = 1 2024-04-26T10:40:13.803 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum clean all 2024-04-26T10:40:13.835 INFO:teuthology.orchestra.run.smithi049.stdout:check_obsoletes = 1 2024-04-26T10:40:13.837 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum clean all 2024-04-26T10:40:13.840 DEBUG:teuthology.orchestra.run.smithi087:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T10:40:13.865 INFO:teuthology.orchestra.run.smithi060.stdout:check_obsoletes = 1 2024-04-26T10:40:13.867 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum clean all 2024-04-26T10:40:13.904 INFO:teuthology.orchestra.run.smithi087.stdout:check_obsoletes = 1 2024-04-26T10:40:13.905 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum clean all 2024-04-26T10:40:14.026 INFO:teuthology.orchestra.run.smithi195.stdout:48 files removed 2024-04-26T10:40:14.053 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T10:40:14.074 INFO:teuthology.orchestra.run.smithi049.stdout:48 files removed 2024-04-26T10:40:14.101 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T10:40:14.102 INFO:teuthology.orchestra.run.smithi060.stdout:48 files removed 2024-04-26T10:40:14.130 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T10:40:14.130 INFO:teuthology.orchestra.run.smithi087.stdout:48 files removed 2024-04-26T10:40:14.156 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T10:40:14.667 INFO:teuthology.orchestra.run.smithi195.stdout:ceph packages for x86_64 218 kB/s | 77 kB 00:00 2024-04-26T10:40:14.783 INFO:teuthology.orchestra.run.smithi049.stdout:ceph packages for x86_64 188 kB/s | 77 kB 00:00 2024-04-26T10:40:14.809 INFO:teuthology.orchestra.run.smithi087.stdout:ceph packages for x86_64 196 kB/s | 77 kB 00:00 2024-04-26T10:40:14.883 INFO:teuthology.orchestra.run.smithi060.stdout:ceph packages for x86_64 161 kB/s | 77 kB 00:00 2024-04-26T10:40:15.142 INFO:teuthology.orchestra.run.smithi195.stdout:ceph noarch packages 26 kB/s | 11 kB 00:00 2024-04-26T10:40:15.158 INFO:teuthology.orchestra.run.smithi049.stdout:ceph noarch packages 34 kB/s | 11 kB 00:00 2024-04-26T10:40:15.252 INFO:teuthology.orchestra.run.smithi087.stdout:ceph noarch packages 28 kB/s | 11 kB 00:00 2024-04-26T10:40:15.351 INFO:teuthology.orchestra.run.smithi060.stdout:ceph noarch packages 27 kB/s | 11 kB 00:00 2024-04-26T10:40:15.485 INFO:teuthology.orchestra.run.smithi195.stdout:ceph source packages 6.1 kB/s | 1.9 kB 00:00 2024-04-26T10:40:15.576 INFO:teuthology.orchestra.run.smithi049.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-04-26T10:40:15.603 INFO:teuthology.orchestra.run.smithi087.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2024-04-26T10:40:15.801 INFO:teuthology.orchestra.run.smithi060.stdout:ceph source packages 4.5 kB/s | 1.9 kB 00:00 2024-04-26T10:40:16.187 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-26T10:40:16.329 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - BaseOS 9.9 MB/s | 8.0 MB 00:00 2024-04-26T10:40:16.463 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - BaseOS 9.7 MB/s | 8.0 MB 00:00 2024-04-26T10:40:16.563 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-26T10:40:18.271 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:00 2024-04-26T10:40:18.831 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - AppStream 13 MB/s | 19 MB 00:01 2024-04-26T10:40:18.972 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 15 MB/s | 19 MB 00:01 2024-04-26T10:40:19.598 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - AppStream 9.2 MB/s | 19 MB 00:02 2024-04-26T10:40:22.480 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-26T10:40:23.106 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 6.2 MB 00:00 2024-04-26T10:40:23.381 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 8.5 MB/s | 6.2 MB 00:00 2024-04-26T10:40:23.790 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 6.2 MB 00:00 2024-04-26T10:40:24.104 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 16 kB 00:00 2024-04-26T10:40:24.954 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 16 kB 00:00 2024-04-26T10:40:25.138 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 16 kB 00:00 2024-04-26T10:40:25.555 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 16 kB 00:00 2024-04-26T10:40:25.849 INFO:teuthology.orchestra.run.smithi049.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-26T10:40:26.239 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-04-26T10:40:29.490 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 5.5 MB/s | 21 MB 00:03 2024-04-26T10:40:30.064 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 4.4 MB/s | 21 MB 00:04 2024-04-26T10:40:31.155 INFO:teuthology.orchestra.run.smithi049.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-04-26T10:40:31.523 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-26T10:40:33.356 INFO:teuthology.orchestra.run.smithi049.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T10:40:33.356 INFO:teuthology.orchestra.run.smithi049.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T10:40:33.425 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-04-26T10:40:33.433 INFO:teuthology.orchestra.run.smithi049.stdout:======================================================================================= 2024-04-26T10:40:33.434 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-04-26T10:40:33.434 INFO:teuthology.orchestra.run.smithi049.stdout:======================================================================================= 2024-04-26T10:40:33.434 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-04-26T10:40:33.434 INFO:teuthology.orchestra.run.smithi049.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T10:40:33.434 INFO:teuthology.orchestra.run.smithi049.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 6.5 k 2024-04-26T10:40:33.434 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 5.1 M 2024-04-26T10:40:33.434 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 848 k 2024-04-26T10:40:33.434 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 142 k 2024-04-26T10:40:33.434 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 1.5 M 2024-04-26T10:40:33.434 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 138 k 2024-04-26T10:40:33.434 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 3.5 M 2024-04-26T10:40:33.434 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 7.4 M 2024-04-26T10:40:33.434 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 49 k 2024-04-26T10:40:33.435 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 7.7 M 2024-04-26T10:40:33.435 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 40 M 2024-04-26T10:40:33.435 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 264 k 2024-04-26T10:40:33.435 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 224 k 2024-04-26T10:40:33.435 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T10:40:33.435 INFO:teuthology.orchestra.run.smithi049.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T10:40:33.435 INFO:teuthology.orchestra.run.smithi049.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T10:40:33.435 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 31 k 2024-04-26T10:40:33.435 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 710 k 2024-04-26T10:40:33.435 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 126 k 2024-04-26T10:40:33.435 INFO:teuthology.orchestra.run.smithi049.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T10:40:33.435 INFO:teuthology.orchestra.run.smithi049.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T10:40:33.435 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T10:40:33.436 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 162 k 2024-04-26T10:40:33.436 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 320 k 2024-04-26T10:40:33.436 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 298 k 2024-04-26T10:40:33.436 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 99 k 2024-04-26T10:40:33.436 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 87 k 2024-04-26T10:40:33.436 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T10:40:33.436 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 172 k 2024-04-26T10:40:33.436 INFO:teuthology.orchestra.run.smithi049.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T10:40:33.436 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrading: 2024-04-26T10:40:33.436 INFO:teuthology.orchestra.run.smithi049.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.3 M 2024-04-26T10:40:33.436 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T10:40:33.436 INFO:teuthology.orchestra.run.smithi049.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T10:40:33.436 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T10:40:33.436 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-04-26T10:40:33.437 INFO:teuthology.orchestra.run.smithi049.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T10:40:33.437 INFO:teuthology.orchestra.run.smithi049.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T10:40:33.437 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 18 M 2024-04-26T10:40:33.437 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 24 k 2024-04-26T10:40:33.437 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 2.1 M 2024-04-26T10:40:33.437 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 246 k 2024-04-26T10:40:33.437 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.7 M 2024-04-26T10:40:33.437 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 17 M 2024-04-26T10:40:33.437 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 15 k 2024-04-26T10:40:33.437 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 25 k 2024-04-26T10:40:33.437 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T10:40:33.437 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T10:40:33.437 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T10:40:33.437 INFO:teuthology.orchestra.run.smithi049.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-04-26T10:40:33.438 INFO:teuthology.orchestra.run.smithi049.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T10:40:33.438 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T10:40:33.438 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T10:40:33.438 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T10:40:33.438 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 166 k 2024-04-26T10:40:33.438 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T10:40:33.438 INFO:teuthology.orchestra.run.smithi049.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T10:40:33.438 INFO:teuthology.orchestra.run.smithi049.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T10:40:33.438 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T10:40:33.438 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T10:40:33.438 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 474 k 2024-04-26T10:40:33.438 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T10:40:33.438 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.5 M 2024-04-26T10:40:33.438 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T10:40:33.439 INFO:teuthology.orchestra.run.smithi049.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T10:40:33.439 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T10:40:33.439 INFO:teuthology.orchestra.run.smithi049.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T10:40:33.439 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T10:40:33.439 INFO:teuthology.orchestra.run.smithi049.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T10:40:33.439 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T10:40:33.439 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T10:40:33.439 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T10:40:33.439 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T10:40:33.439 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 45 k 2024-04-26T10:40:33.439 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 129 k 2024-04-26T10:40:33.439 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T10:40:33.439 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T10:40:33.439 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T10:40:33.440 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T10:40:33.440 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T10:40:33.440 INFO:teuthology.orchestra.run.smithi049.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T10:40:33.440 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T10:40:33.440 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T10:40:33.440 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T10:40:33.440 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T10:40:33.440 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T10:40:33.440 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T10:40:33.440 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T10:40:33.440 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T10:40:33.440 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T10:40:33.440 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T10:40:33.440 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T10:40:33.441 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T10:40:33.441 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T10:40:33.441 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T10:40:33.441 INFO:teuthology.orchestra.run.smithi049.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T10:40:33.441 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T10:40:33.441 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T10:40:33.441 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T10:40:33.441 INFO:teuthology.orchestra.run.smithi049.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T10:40:33.441 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T10:40:33.441 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T10:40:33.441 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T10:40:33.441 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T10:40:33.441 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T10:40:33.441 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T10:40:33.442 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T10:40:33.442 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T10:40:33.442 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T10:40:33.442 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T10:40:33.442 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T10:40:33.442 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T10:40:33.442 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T10:40:33.442 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T10:40:33.442 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T10:40:33.442 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T10:40:33.442 INFO:teuthology.orchestra.run.smithi049.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T10:40:33.442 INFO:teuthology.orchestra.run.smithi049.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T10:40:33.442 INFO:teuthology.orchestra.run.smithi049.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T10:40:33.442 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T10:40:33.443 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T10:40:33.443 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T10:40:33.443 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T10:40:33.443 INFO:teuthology.orchestra.run.smithi049.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T10:40:33.443 INFO:teuthology.orchestra.run.smithi049.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T10:40:33.443 INFO:teuthology.orchestra.run.smithi049.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T10:40:33.443 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T10:40:33.443 INFO:teuthology.orchestra.run.smithi049.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T10:40:33.443 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:40:33.443 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-04-26T10:40:33.443 INFO:teuthology.orchestra.run.smithi049.stdout:======================================================================================= 2024-04-26T10:40:33.443 INFO:teuthology.orchestra.run.smithi049.stdout:Install 123 Packages 2024-04-26T10:40:33.443 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrade 4 Packages 2024-04-26T10:40:33.444 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:40:33.444 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 189 M 2024-04-26T10:40:33.444 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-04-26T10:40:33.720 INFO:teuthology.orchestra.run.smithi060.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T10:40:33.721 INFO:teuthology.orchestra.run.smithi060.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T10:40:33.791 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-04-26T10:40:33.799 INFO:teuthology.orchestra.run.smithi060.stdout:======================================================================================= 2024-04-26T10:40:33.799 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-04-26T10:40:33.799 INFO:teuthology.orchestra.run.smithi060.stdout:======================================================================================= 2024-04-26T10:40:33.799 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-04-26T10:40:33.799 INFO:teuthology.orchestra.run.smithi060.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T10:40:33.799 INFO:teuthology.orchestra.run.smithi060.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 6.5 k 2024-04-26T10:40:33.799 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 5.1 M 2024-04-26T10:40:33.799 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 848 k 2024-04-26T10:40:33.799 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 142 k 2024-04-26T10:40:33.800 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 1.5 M 2024-04-26T10:40:33.800 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 138 k 2024-04-26T10:40:33.800 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 3.5 M 2024-04-26T10:40:33.800 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 7.4 M 2024-04-26T10:40:33.800 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 49 k 2024-04-26T10:40:33.800 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 7.7 M 2024-04-26T10:40:33.800 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 40 M 2024-04-26T10:40:33.800 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 264 k 2024-04-26T10:40:33.800 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 224 k 2024-04-26T10:40:33.800 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T10:40:33.800 INFO:teuthology.orchestra.run.smithi060.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T10:40:33.801 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T10:40:33.801 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 31 k 2024-04-26T10:40:33.801 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 710 k 2024-04-26T10:40:33.801 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 126 k 2024-04-26T10:40:33.801 INFO:teuthology.orchestra.run.smithi060.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T10:40:33.801 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T10:40:33.801 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T10:40:33.801 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 162 k 2024-04-26T10:40:33.801 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 320 k 2024-04-26T10:40:33.801 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 298 k 2024-04-26T10:40:33.801 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 99 k 2024-04-26T10:40:33.801 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 87 k 2024-04-26T10:40:33.802 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T10:40:33.802 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 172 k 2024-04-26T10:40:33.802 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T10:40:33.802 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrading: 2024-04-26T10:40:33.802 INFO:teuthology.orchestra.run.smithi060.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.3 M 2024-04-26T10:40:33.802 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T10:40:33.802 INFO:teuthology.orchestra.run.smithi060.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T10:40:33.802 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T10:40:33.802 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-04-26T10:40:33.802 INFO:teuthology.orchestra.run.smithi060.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T10:40:33.802 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T10:40:33.803 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 18 M 2024-04-26T10:40:33.803 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 24 k 2024-04-26T10:40:33.803 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 2.1 M 2024-04-26T10:40:33.803 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 246 k 2024-04-26T10:40:33.803 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.7 M 2024-04-26T10:40:33.803 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 17 M 2024-04-26T10:40:33.803 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 15 k 2024-04-26T10:40:33.803 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 25 k 2024-04-26T10:40:33.803 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T10:40:33.803 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T10:40:33.803 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T10:40:33.803 INFO:teuthology.orchestra.run.smithi060.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-04-26T10:40:33.804 INFO:teuthology.orchestra.run.smithi060.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T10:40:33.804 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T10:40:33.804 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T10:40:33.804 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T10:40:33.804 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 166 k 2024-04-26T10:40:33.804 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T10:40:33.804 INFO:teuthology.orchestra.run.smithi060.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T10:40:33.804 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T10:40:33.804 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T10:40:33.804 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T10:40:33.804 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 474 k 2024-04-26T10:40:33.805 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T10:40:33.805 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.5 M 2024-04-26T10:40:33.805 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T10:40:33.805 INFO:teuthology.orchestra.run.smithi060.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T10:40:33.805 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T10:40:33.805 INFO:teuthology.orchestra.run.smithi060.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T10:40:33.805 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T10:40:33.805 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T10:40:33.805 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T10:40:33.805 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T10:40:33.805 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T10:40:33.805 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T10:40:33.806 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 45 k 2024-04-26T10:40:33.806 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 129 k 2024-04-26T10:40:33.806 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T10:40:33.806 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T10:40:33.806 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T10:40:33.806 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T10:40:33.806 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T10:40:33.806 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T10:40:33.806 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T10:40:33.806 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T10:40:33.806 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T10:40:33.807 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T10:40:33.807 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T10:40:33.807 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T10:40:33.807 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T10:40:33.807 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T10:40:33.807 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T10:40:33.807 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T10:40:33.807 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T10:40:33.808 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T10:40:33.808 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T10:40:33.808 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T10:40:33.808 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T10:40:33.808 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T10:40:33.808 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T10:40:33.808 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T10:40:33.808 INFO:teuthology.orchestra.run.smithi060.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T10:40:33.808 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T10:40:33.808 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T10:40:33.808 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T10:40:33.808 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T10:40:33.808 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T10:40:33.809 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T10:40:33.809 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T10:40:33.809 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T10:40:33.809 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T10:40:33.809 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T10:40:33.809 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T10:40:33.809 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T10:40:33.809 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T10:40:33.809 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T10:40:33.809 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T10:40:33.809 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T10:40:33.810 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T10:40:33.810 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T10:40:33.810 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T10:40:33.810 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T10:40:33.810 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T10:40:33.810 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T10:40:33.810 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T10:40:33.810 INFO:teuthology.orchestra.run.smithi060.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T10:40:33.810 INFO:teuthology.orchestra.run.smithi060.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T10:40:33.810 INFO:teuthology.orchestra.run.smithi060.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T10:40:33.810 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T10:40:33.810 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T10:40:33.811 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:40:33.811 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-04-26T10:40:33.811 INFO:teuthology.orchestra.run.smithi060.stdout:======================================================================================= 2024-04-26T10:40:33.811 INFO:teuthology.orchestra.run.smithi060.stdout:Install 123 Packages 2024-04-26T10:40:33.811 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrade 4 Packages 2024-04-26T10:40:33.811 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:40:33.811 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 189 M 2024-04-26T10:40:33.812 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-04-26T10:40:34.048 INFO:teuthology.orchestra.run.smithi049.stdout:(1/127): ceph-18.2.2-1256.gdc093b5e.el9.x86_64. 34 kB/s | 6.5 kB 00:00 2024-04-26T10:40:34.248 INFO:teuthology.orchestra.run.smithi049.stdout:(2/127): ceph-fuse-18.2.2-1256.gdc093b5e.el9.x8 4.1 MB/s | 848 kB 00:00 2024-04-26T10:40:34.307 INFO:teuthology.orchestra.run.smithi049.stdout:(3/127): ceph-immutable-object-cache-18.2.2-125 2.4 MB/s | 142 kB 00:00 2024-04-26T10:40:34.515 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-26T10:40:34.632 INFO:teuthology.orchestra.run.smithi049.stdout:(4/127): ceph-mds-18.2.2-1256.gdc093b5e.el9.x86 6.4 MB/s | 2.1 MB 00:00 2024-04-26T10:40:34.641 INFO:teuthology.orchestra.run.smithi060.stdout:(1/127): ceph-18.2.2-1256.gdc093b5e.el9.x86_64. 31 kB/s | 6.5 kB 00:00 2024-04-26T10:40:34.699 INFO:teuthology.orchestra.run.smithi049.stdout:(5/127): ceph-base-18.2.2-1256.gdc093b5e.el9.x8 6.0 MB/s | 5.1 MB 00:00 2024-04-26T10:40:34.900 INFO:teuthology.orchestra.run.smithi049.stdout:(6/127): ceph-mgr-18.2.2-1256.gdc093b5e.el9.x86 5.5 MB/s | 1.5 MB 00:00 2024-04-26T10:40:35.139 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-04-26T10:40:35.194 INFO:teuthology.orchestra.run.smithi060.stdout:(2/127): ceph-fuse-18.2.2-1256.gdc093b5e.el9.x8 1.5 MB/s | 848 kB 00:00 2024-04-26T10:40:35.317 INFO:teuthology.orchestra.run.smithi049.stdout:(7/127): ceph-mon-18.2.2-1256.gdc093b5e.el9.x86 7.6 MB/s | 4.7 MB 00:00 2024-04-26T10:40:35.325 INFO:teuthology.orchestra.run.smithi060.stdout:(3/127): ceph-immutable-object-cache-18.2.2-125 1.0 MB/s | 142 kB 00:00 2024-04-26T10:40:36.010 INFO:teuthology.orchestra.run.smithi049.stdout:(8/127): ceph-common-18.2.2-1256.gdc093b5e.el9. 8.5 MB/s | 18 MB 00:02 2024-04-26T10:40:36.059 INFO:teuthology.orchestra.run.smithi049.stdout:(9/127): ceph-selinux-18.2.2-1256.gdc093b5e.el9 505 kB/s | 25 kB 00:00 2024-04-26T10:40:36.258 INFO:teuthology.orchestra.run.smithi060.stdout:(4/127): ceph-mds-18.2.2-1256.gdc093b5e.el9.x86 2.2 MB/s | 2.1 MB 00:00 2024-04-26T10:40:36.467 INFO:teuthology.orchestra.run.smithi049.stdout:(10/127): ceph-radosgw-18.2.2-1256.gdc093b5e.el 6.7 MB/s | 7.7 MB 00:01 2024-04-26T10:40:36.542 INFO:teuthology.orchestra.run.smithi049.stdout:(11/127): libcephfs-devel-18.2.2-1256.gdc093b5e 414 kB/s | 31 kB 00:00 2024-04-26T10:40:36.623 INFO:teuthology.orchestra.run.smithi087.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T10:40:36.623 INFO:teuthology.orchestra.run.smithi087.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T10:40:36.686 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-04-26T10:40:36.694 INFO:teuthology.orchestra.run.smithi087.stdout:======================================================================================= 2024-04-26T10:40:36.694 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-04-26T10:40:36.694 INFO:teuthology.orchestra.run.smithi087.stdout:======================================================================================= 2024-04-26T10:40:36.694 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-04-26T10:40:36.694 INFO:teuthology.orchestra.run.smithi087.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T10:40:36.694 INFO:teuthology.orchestra.run.smithi087.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 6.5 k 2024-04-26T10:40:36.694 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 5.1 M 2024-04-26T10:40:36.694 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 848 k 2024-04-26T10:40:36.695 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 142 k 2024-04-26T10:40:36.695 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 1.5 M 2024-04-26T10:40:36.695 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 138 k 2024-04-26T10:40:36.695 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 3.5 M 2024-04-26T10:40:36.695 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 7.4 M 2024-04-26T10:40:36.695 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 49 k 2024-04-26T10:40:36.695 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 7.7 M 2024-04-26T10:40:36.695 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 40 M 2024-04-26T10:40:36.695 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 264 k 2024-04-26T10:40:36.695 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 224 k 2024-04-26T10:40:36.695 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T10:40:36.695 INFO:teuthology.orchestra.run.smithi087.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T10:40:36.695 INFO:teuthology.orchestra.run.smithi087.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T10:40:36.696 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 31 k 2024-04-26T10:40:36.696 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 710 k 2024-04-26T10:40:36.696 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 126 k 2024-04-26T10:40:36.696 INFO:teuthology.orchestra.run.smithi087.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T10:40:36.696 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T10:40:36.696 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T10:40:36.696 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 162 k 2024-04-26T10:40:36.696 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 320 k 2024-04-26T10:40:36.696 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 298 k 2024-04-26T10:40:36.696 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 99 k 2024-04-26T10:40:36.696 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 87 k 2024-04-26T10:40:36.696 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T10:40:36.697 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 172 k 2024-04-26T10:40:36.697 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T10:40:36.697 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrading: 2024-04-26T10:40:36.697 INFO:teuthology.orchestra.run.smithi087.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.3 M 2024-04-26T10:40:36.697 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T10:40:36.697 INFO:teuthology.orchestra.run.smithi087.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T10:40:36.697 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T10:40:36.697 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-04-26T10:40:36.697 INFO:teuthology.orchestra.run.smithi087.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T10:40:36.697 INFO:teuthology.orchestra.run.smithi087.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T10:40:36.697 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 18 M 2024-04-26T10:40:36.697 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 24 k 2024-04-26T10:40:36.697 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 2.1 M 2024-04-26T10:40:36.697 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 246 k 2024-04-26T10:40:36.698 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.7 M 2024-04-26T10:40:36.698 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 17 M 2024-04-26T10:40:36.698 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 15 k 2024-04-26T10:40:36.698 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 25 k 2024-04-26T10:40:36.698 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T10:40:36.698 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T10:40:36.698 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T10:40:36.698 INFO:teuthology.orchestra.run.smithi087.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-04-26T10:40:36.698 INFO:teuthology.orchestra.run.smithi087.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T10:40:36.698 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T10:40:36.698 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T10:40:36.698 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T10:40:36.699 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 166 k 2024-04-26T10:40:36.699 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T10:40:36.699 INFO:teuthology.orchestra.run.smithi087.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T10:40:36.699 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T10:40:36.699 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T10:40:36.699 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T10:40:36.699 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 474 k 2024-04-26T10:40:36.699 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T10:40:36.699 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.5 M 2024-04-26T10:40:36.699 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T10:40:36.699 INFO:teuthology.orchestra.run.smithi087.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T10:40:36.699 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T10:40:36.699 INFO:teuthology.orchestra.run.smithi087.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T10:40:36.699 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T10:40:36.700 INFO:teuthology.orchestra.run.smithi087.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T10:40:36.700 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T10:40:36.700 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T10:40:36.700 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T10:40:36.700 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T10:40:36.700 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 45 k 2024-04-26T10:40:36.700 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 129 k 2024-04-26T10:40:36.700 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T10:40:36.700 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T10:40:36.700 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T10:40:36.700 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T10:40:36.700 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T10:40:36.700 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T10:40:36.700 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T10:40:36.701 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T10:40:36.701 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T10:40:36.701 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T10:40:36.701 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T10:40:36.701 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T10:40:36.701 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T10:40:36.701 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T10:40:36.701 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T10:40:36.701 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T10:40:36.701 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T10:40:36.701 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T10:40:36.701 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T10:40:36.701 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T10:40:36.702 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T10:40:36.702 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T10:40:36.702 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T10:40:36.702 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T10:40:36.702 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T10:40:36.702 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T10:40:36.702 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T10:40:36.702 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T10:40:36.702 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T10:40:36.702 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T10:40:36.702 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T10:40:36.702 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T10:40:36.703 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T10:40:36.703 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T10:40:36.703 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T10:40:36.703 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T10:40:36.703 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T10:40:36.703 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T10:40:36.703 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T10:40:36.703 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T10:40:36.703 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T10:40:36.703 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T10:40:36.703 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T10:40:36.703 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T10:40:36.703 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T10:40:36.703 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T10:40:36.704 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T10:40:36.704 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T10:40:36.704 INFO:teuthology.orchestra.run.smithi087.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T10:40:36.704 INFO:teuthology.orchestra.run.smithi087.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T10:40:36.704 INFO:teuthology.orchestra.run.smithi087.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T10:40:36.704 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T10:40:36.704 INFO:teuthology.orchestra.run.smithi087.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T10:40:36.704 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:40:36.704 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-04-26T10:40:36.704 INFO:teuthology.orchestra.run.smithi087.stdout:======================================================================================= 2024-04-26T10:40:36.704 INFO:teuthology.orchestra.run.smithi087.stdout:Install 123 Packages 2024-04-26T10:40:36.704 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrade 4 Packages 2024-04-26T10:40:36.704 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:40:36.705 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 189 M 2024-04-26T10:40:36.705 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-04-26T10:40:36.709 INFO:teuthology.orchestra.run.smithi049.stdout:(12/127): libcephfs2-18.2.2-1256.gdc093b5e.el9. 4.2 MB/s | 710 kB 00:00 2024-04-26T10:40:36.801 INFO:teuthology.orchestra.run.smithi049.stdout:(13/127): libcephsqlite-18.2.2-1256.gdc093b5e.e 1.8 MB/s | 166 kB 00:00 2024-04-26T10:40:36.902 INFO:teuthology.orchestra.run.smithi049.stdout:(14/127): librados-devel-18.2.2-1256.gdc093b5e. 1.2 MB/s | 126 kB 00:00 2024-04-26T10:40:36.933 INFO:teuthology.orchestra.run.smithi060.stdout:(5/127): ceph-mgr-18.2.2-1256.gdc093b5e.el9.x86 2.2 MB/s | 1.5 MB 00:00 2024-04-26T10:40:36.993 INFO:teuthology.orchestra.run.smithi049.stdout:(15/127): libradosstriper1-18.2.2-1256.gdc093b5 5.1 MB/s | 474 kB 00:00 2024-04-26T10:40:37.249 INFO:teuthology.orchestra.run.smithi195.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T10:40:37.250 INFO:teuthology.orchestra.run.smithi195.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T10:40:37.286 INFO:teuthology.orchestra.run.smithi049.stdout:(16/127): ceph-osd-18.2.2-1256.gdc093b5e.el9.x8 6.9 MB/s | 17 MB 00:02 2024-04-26T10:40:37.315 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-26T10:40:37.322 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-04-26T10:40:37.322 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-04-26T10:40:37.322 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-04-26T10:40:37.322 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-26T10:40:37.323 INFO:teuthology.orchestra.run.smithi195.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T10:40:37.323 INFO:teuthology.orchestra.run.smithi195.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 6.5 k 2024-04-26T10:40:37.323 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 5.1 M 2024-04-26T10:40:37.323 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 848 k 2024-04-26T10:40:37.323 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 142 k 2024-04-26T10:40:37.323 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 1.5 M 2024-04-26T10:40:37.323 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 138 k 2024-04-26T10:40:37.323 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 3.5 M 2024-04-26T10:40:37.323 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 7.4 M 2024-04-26T10:40:37.323 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 49 k 2024-04-26T10:40:37.323 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 7.7 M 2024-04-26T10:40:37.323 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 40 M 2024-04-26T10:40:37.324 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 264 k 2024-04-26T10:40:37.324 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 224 k 2024-04-26T10:40:37.324 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T10:40:37.324 INFO:teuthology.orchestra.run.smithi195.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T10:40:37.324 INFO:teuthology.orchestra.run.smithi195.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T10:40:37.324 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 31 k 2024-04-26T10:40:37.324 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 710 k 2024-04-26T10:40:37.324 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 126 k 2024-04-26T10:40:37.324 INFO:teuthology.orchestra.run.smithi195.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T10:40:37.324 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T10:40:37.324 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T10:40:37.324 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 162 k 2024-04-26T10:40:37.325 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 320 k 2024-04-26T10:40:37.325 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 298 k 2024-04-26T10:40:37.325 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 99 k 2024-04-26T10:40:37.325 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 87 k 2024-04-26T10:40:37.325 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T10:40:37.325 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 172 k 2024-04-26T10:40:37.325 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T10:40:37.325 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrading: 2024-04-26T10:40:37.325 INFO:teuthology.orchestra.run.smithi195.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.3 M 2024-04-26T10:40:37.325 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 3.0 M 2024-04-26T10:40:37.325 INFO:teuthology.orchestra.run.smithi195.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T10:40:37.325 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T10:40:37.325 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-04-26T10:40:37.326 INFO:teuthology.orchestra.run.smithi195.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T10:40:37.326 INFO:teuthology.orchestra.run.smithi195.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T10:40:37.326 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 18 M 2024-04-26T10:40:37.326 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 24 k 2024-04-26T10:40:37.326 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 2.1 M 2024-04-26T10:40:37.326 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 246 k 2024-04-26T10:40:37.326 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.7 M 2024-04-26T10:40:37.326 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 17 M 2024-04-26T10:40:37.326 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el9 ceph-noarch 15 k 2024-04-26T10:40:37.326 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 25 k 2024-04-26T10:40:37.326 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T10:40:37.327 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T10:40:37.327 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T10:40:37.327 INFO:teuthology.orchestra.run.smithi195.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-04-26T10:40:37.327 INFO:teuthology.orchestra.run.smithi195.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T10:40:37.327 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T10:40:37.327 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T10:40:37.327 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T10:40:37.327 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 166 k 2024-04-26T10:40:37.327 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T10:40:37.327 INFO:teuthology.orchestra.run.smithi195.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T10:40:37.327 INFO:teuthology.orchestra.run.smithi195.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T10:40:37.327 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T10:40:37.328 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T10:40:37.328 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 474 k 2024-04-26T10:40:37.328 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T10:40:37.328 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 4.5 M 2024-04-26T10:40:37.328 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T10:40:37.328 INFO:teuthology.orchestra.run.smithi195.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T10:40:37.328 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T10:40:37.328 INFO:teuthology.orchestra.run.smithi195.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T10:40:37.328 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T10:40:37.328 INFO:teuthology.orchestra.run.smithi195.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T10:40:37.328 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T10:40:37.328 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T10:40:37.328 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T10:40:37.329 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T10:40:37.329 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 45 k 2024-04-26T10:40:37.329 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el9 ceph 129 k 2024-04-26T10:40:37.329 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T10:40:37.329 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T10:40:37.329 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T10:40:37.329 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T10:40:37.329 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T10:40:37.329 INFO:teuthology.orchestra.run.smithi195.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T10:40:37.329 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T10:40:37.329 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T10:40:37.329 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T10:40:37.330 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T10:40:37.330 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T10:40:37.330 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T10:40:37.330 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T10:40:37.330 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T10:40:37.330 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T10:40:37.330 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T10:40:37.330 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T10:40:37.330 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T10:40:37.330 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T10:40:37.330 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T10:40:37.331 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T10:40:37.331 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T10:40:37.331 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T10:40:37.331 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T10:40:37.331 INFO:teuthology.orchestra.run.smithi195.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T10:40:37.331 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T10:40:37.331 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T10:40:37.331 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T10:40:37.331 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T10:40:37.331 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T10:40:37.331 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T10:40:37.331 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T10:40:37.331 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T10:40:37.331 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T10:40:37.332 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T10:40:37.332 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T10:40:37.332 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T10:40:37.332 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T10:40:37.332 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T10:40:37.332 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T10:40:37.332 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T10:40:37.332 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T10:40:37.332 INFO:teuthology.orchestra.run.smithi195.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T10:40:37.332 INFO:teuthology.orchestra.run.smithi195.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T10:40:37.332 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T10:40:37.332 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T10:40:37.332 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T10:40:37.333 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T10:40:37.333 INFO:teuthology.orchestra.run.smithi195.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T10:40:37.333 INFO:teuthology.orchestra.run.smithi195.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T10:40:37.333 INFO:teuthology.orchestra.run.smithi195.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T10:40:37.333 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T10:40:37.333 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T10:40:37.333 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:40:37.333 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-26T10:40:37.333 INFO:teuthology.orchestra.run.smithi195.stdout:======================================================================================= 2024-04-26T10:40:37.333 INFO:teuthology.orchestra.run.smithi195.stdout:Install 123 Packages 2024-04-26T10:40:37.333 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrade 4 Packages 2024-04-26T10:40:37.333 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:40:37.334 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 189 M 2024-04-26T10:40:37.334 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-26T10:40:37.369 INFO:teuthology.orchestra.run.smithi049.stdout:(17/127): python3-ceph-argparse-18.2.2-1256.gdc 541 kB/s | 45 kB 00:00 2024-04-26T10:40:37.450 INFO:teuthology.orchestra.run.smithi060.stdout:(6/127): ceph-base-18.2.2-1256.gdc093b5e.el9.x8 1.7 MB/s | 5.1 MB 00:03 2024-04-26T10:40:37.453 INFO:teuthology.orchestra.run.smithi049.stdout:(18/127): python3-ceph-common-18.2.2-1256.gdc09 1.5 MB/s | 129 kB 00:00 2024-04-26T10:40:37.544 INFO:teuthology.orchestra.run.smithi049.stdout:(19/127): python3-cephfs-18.2.2-1256.gdc093b5e. 1.7 MB/s | 162 kB 00:00 2024-04-26T10:40:37.624 INFO:teuthology.orchestra.run.smithi087.stdout:(1/127): ceph-18.2.2-1256.gdc093b5e.el9.x86_64. 22 kB/s | 6.5 kB 00:00 2024-04-26T10:40:37.636 INFO:teuthology.orchestra.run.smithi049.stdout:(20/127): librgw2-18.2.2-1256.gdc093b5e.el9.x86 6.9 MB/s | 4.5 MB 00:00 2024-04-26T10:40:37.662 INFO:teuthology.orchestra.run.smithi049.stdout:(21/127): python3-rados-18.2.2-1256.gdc093b5e.e 2.7 MB/s | 320 kB 00:00 2024-04-26T10:40:37.712 INFO:teuthology.orchestra.run.smithi049.stdout:(22/127): python3-rbd-18.2.2-1256.gdc093b5e.el9 3.9 MB/s | 298 kB 00:00 2024-04-26T10:40:37.737 INFO:teuthology.orchestra.run.smithi049.stdout:(23/127): python3-rgw-18.2.2-1256.gdc093b5e.el9 1.3 MB/s | 99 kB 00:00 2024-04-26T10:40:37.771 INFO:teuthology.orchestra.run.smithi049.stdout:(24/127): rbd-fuse-18.2.2-1256.gdc093b5e.el9.x8 1.4 MB/s | 87 kB 00:00 2024-04-26T10:40:37.863 INFO:teuthology.orchestra.run.smithi049.stdout:(25/127): rbd-nbd-18.2.2-1256.gdc093b5e.el9.x86 1.8 MB/s | 172 kB 00:00 2024-04-26T10:40:37.955 INFO:teuthology.orchestra.run.smithi049.stdout:(26/127): ceph-grafana-dashboards-18.2.2-1256.g 265 kB/s | 24 kB 00:00 2024-04-26T10:40:38.058 INFO:teuthology.orchestra.run.smithi049.stdout:(27/127): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 1.3 MB/s | 138 kB 00:00 2024-04-26T10:40:38.073 INFO:teuthology.orchestra.run.smithi195.stdout:(1/127): ceph-18.2.2-1256.gdc093b5e.el9.x86_64. 20 kB/s | 6.5 kB 00:00 2024-04-26T10:40:38.372 INFO:teuthology.orchestra.run.smithi049.stdout:(28/127): rbd-mirror-18.2.2-1256.gdc093b5e.el9. 4.7 MB/s | 3.0 MB 00:00 2024-04-26T10:40:38.499 INFO:teuthology.orchestra.run.smithi087.stdout:(2/127): ceph-fuse-18.2.2-1256.gdc093b5e.el9.x8 969 kB/s | 848 kB 00:00 2024-04-26T10:40:38.674 INFO:teuthology.orchestra.run.smithi087.stdout:(3/127): ceph-immutable-object-cache-18.2.2-125 815 kB/s | 142 kB 00:00 2024-04-26T10:40:38.940 INFO:teuthology.orchestra.run.smithi195.stdout:(2/127): ceph-fuse-18.2.2-1256.gdc093b5e.el9.x8 979 kB/s | 848 kB 00:00 2024-04-26T10:40:39.115 INFO:teuthology.orchestra.run.smithi195.stdout:(3/127): ceph-immutable-object-cache-18.2.2-125 815 kB/s | 142 kB 00:00 2024-04-26T10:40:39.139 INFO:teuthology.orchestra.run.smithi049.stdout:(29/127): ceph-mgr-dashboard-18.2.2-1256.gdc093 3.3 MB/s | 3.5 MB 00:01 2024-04-26T10:40:39.306 INFO:teuthology.orchestra.run.smithi049.stdout:(30/127): ceph-mgr-modules-core-18.2.2-1256.gdc 1.4 MB/s | 246 kB 00:00 2024-04-26T10:40:39.398 INFO:teuthology.orchestra.run.smithi049.stdout:(31/127): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 538 kB/s | 49 kB 00:00 2024-04-26T10:40:39.417 INFO:teuthology.orchestra.run.smithi060.stdout:(7/127): ceph-mon-18.2.2-1256.gdc093b5e.el9.x86 1.9 MB/s | 4.7 MB 00:02 2024-04-26T10:40:39.482 INFO:teuthology.orchestra.run.smithi049.stdout:(32/127): ceph-prometheus-alerts-18.2.2-1256.gd 184 kB/s | 15 kB 00:00 2024-04-26T10:40:39.566 INFO:teuthology.orchestra.run.smithi087.stdout:(4/127): ceph-base-18.2.2-1256.gdc093b5e.el9.x8 2.3 MB/s | 5.1 MB 00:02 2024-04-26T10:40:39.624 INFO:teuthology.orchestra.run.smithi049.stdout:(33/127): ceph-volume-18.2.2-1256.gdc093b5e.el9 1.8 MB/s | 264 kB 00:00 2024-04-26T10:40:39.700 INFO:teuthology.orchestra.run.smithi087.stdout:(5/127): ceph-mds-18.2.2-1256.gdc093b5e.el9.x86 2.0 MB/s | 2.1 MB 00:01 2024-04-26T10:40:39.716 INFO:teuthology.orchestra.run.smithi049.stdout:(34/127): cephadm-18.2.2-1256.gdc093b5e.el9.noa 2.4 MB/s | 224 kB 00:00 2024-04-26T10:40:39.858 INFO:teuthology.orchestra.run.smithi087.stdout:(6/127): ceph-mgr-18.2.2-1256.gdc093b5e.el9.x86 5.0 MB/s | 1.5 MB 00:00 2024-04-26T10:40:39.968 INFO:teuthology.orchestra.run.smithi049.stdout:(35/127): fuse-2.9.9-15.el9.x86_64.rpm 319 kB/s | 80 kB 00:00 2024-04-26T10:40:40.057 INFO:teuthology.orchestra.run.smithi195.stdout:(4/127): ceph-mds-18.2.2-1256.gdc093b5e.el9.x86 2.2 MB/s | 2.1 MB 00:00 2024-04-26T10:40:40.108 INFO:teuthology.orchestra.run.smithi049.stdout:(36/127): libgfortran-11.4.1-3.el9.x86_64.rpm 5.6 MB/s | 803 kB 00:00 2024-04-26T10:40:40.150 INFO:teuthology.orchestra.run.smithi049.stdout:(37/127): libquadmath-11.4.1-3.el9.x86_64.rpm 4.6 MB/s | 195 kB 00:00 2024-04-26T10:40:40.192 INFO:teuthology.orchestra.run.smithi049.stdout:(38/127): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.0 MB/s | 253 kB 00:00 2024-04-26T10:40:40.359 INFO:teuthology.orchestra.run.smithi049.stdout:(39/127): ceph-mgr-diskprediction-local-18.2.2- 3.7 MB/s | 7.4 MB 00:01 2024-04-26T10:40:40.393 INFO:teuthology.orchestra.run.smithi049.stdout:(40/127): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-04-26T10:40:40.419 INFO:teuthology.orchestra.run.smithi049.stdout:(41/127): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-04-26T10:40:40.444 INFO:teuthology.orchestra.run.smithi049.stdout:(42/127): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-26T10:40:40.469 INFO:teuthology.orchestra.run.smithi049.stdout:(43/127): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-26T10:40:40.494 INFO:teuthology.orchestra.run.smithi049.stdout:(44/127): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-26T10:40:40.522 INFO:teuthology.orchestra.run.smithi049.stdout:(45/127): automake-1.16.2-8.el9.noarch.rpm 14 MB/s | 689 kB 00:00 2024-04-26T10:40:40.553 INFO:teuthology.orchestra.run.smithi049.stdout:(46/127): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 943 kB 00:00 2024-04-26T10:40:40.558 INFO:teuthology.orchestra.run.smithi195.stdout:(5/127): ceph-mgr-18.2.2-1256.gdc093b5e.el9.x86 2.9 MB/s | 1.5 MB 00:00 2024-04-26T10:40:40.570 INFO:teuthology.orchestra.run.smithi049.stdout:(47/127): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-04-26T10:40:40.596 INFO:teuthology.orchestra.run.smithi049.stdout:(48/127): elfutils-libelf-devel-0.190-2.el9.x86 513 kB/s | 21 kB 00:00 2024-04-26T10:40:40.621 INFO:teuthology.orchestra.run.smithi049.stdout:(49/127): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-04-26T10:40:40.646 INFO:teuthology.orchestra.run.smithi049.stdout:(50/127): flexiblas-3.0.4-8.el9.x86_64.rpm 658 kB/s | 33 kB 00:00 2024-04-26T10:40:40.738 INFO:teuthology.orchestra.run.smithi049.stdout:(51/127): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-04-26T10:40:40.763 INFO:teuthology.orchestra.run.smithi049.stdout:(52/127): flexiblas-openblas-openmp-3.0.4-8.el9 156 kB/s | 18 kB 00:00 2024-04-26T10:40:40.789 INFO:teuthology.orchestra.run.smithi049.stdout:(53/127): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-04-26T10:40:40.856 INFO:teuthology.orchestra.run.smithi049.stdout:(54/127): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-04-26T10:40:40.881 INFO:teuthology.orchestra.run.smithi049.stdout:(55/127): librabbitmq-0.11.0-7.el9.x86_64.rpm 491 kB/s | 45 kB 00:00 2024-04-26T10:40:40.906 INFO:teuthology.orchestra.run.smithi049.stdout:(56/127): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-04-26T10:40:40.932 INFO:teuthology.orchestra.run.smithi049.stdout:(57/127): libtool-2.4.6-45.el9.x86_64.rpm 12 MB/s | 582 kB 00:00 2024-04-26T10:40:40.957 INFO:teuthology.orchestra.run.smithi049.stdout:(58/127): libuuid-devel-2.37.4-18.el9.x86_64.rp 514 kB/s | 25 kB 00:00 2024-04-26T10:40:40.982 INFO:teuthology.orchestra.run.smithi049.stdout:(59/127): libzstd-devel-1.5.1-2.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-04-26T10:40:41.008 INFO:teuthology.orchestra.run.smithi049.stdout:(60/127): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-04-26T10:40:41.033 INFO:teuthology.orchestra.run.smithi049.stdout:(61/127): openblas-0.3.21-2.el9.x86_64.rpm 706 kB/s | 35 kB 00:00 2024-04-26T10:40:41.208 INFO:teuthology.orchestra.run.smithi049.stdout:(62/127): openblas-openmp-0.3.21-2.el9.x86_64.r 24 MB/s | 4.7 MB 00:00 2024-04-26T10:40:41.366 INFO:teuthology.orchestra.run.smithi049.stdout:(63/127): openssl-devel-3.2.1-1.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-04-26T10:40:41.409 INFO:teuthology.orchestra.run.smithi087.stdout:(7/127): ceph-mon-18.2.2-1256.gdc093b5e.el9.x86 2.7 MB/s | 4.7 MB 00:01 2024-04-26T10:40:41.584 INFO:teuthology.orchestra.run.smithi049.stdout:(64/127): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-04-26T10:40:41.609 INFO:teuthology.orchestra.run.smithi049.stdout:(65/127): python3-devel-3.9.18-3.el9.x86_64.rpm 1.0 MB/s | 244 kB 00:00 2024-04-26T10:40:41.634 INFO:teuthology.orchestra.run.smithi049.stdout:(66/127): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-04-26T10:40:41.659 INFO:teuthology.orchestra.run.smithi049.stdout:(67/127): python3-jsonpatch-1.21-16.el9.noarch. 516 kB/s | 26 kB 00:00 2024-04-26T10:40:41.685 INFO:teuthology.orchestra.run.smithi049.stdout:(68/127): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-04-26T10:40:41.710 INFO:teuthology.orchestra.run.smithi049.stdout:(69/127): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-04-26T10:40:41.735 INFO:teuthology.orchestra.run.smithi049.stdout:(70/127): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-04-26T10:40:41.859 INFO:teuthology.orchestra.run.smithi087.stdout:(8/127): ceph-osd-18.2.2-1256.gdc093b5e.el9.x86 8.3 MB/s | 17 MB 00:02 2024-04-26T10:40:41.901 INFO:teuthology.orchestra.run.smithi087.stdout:(9/127): ceph-selinux-18.2.2-1256.gdc093b5e.el9 612 kB/s | 25 kB 00:00 2024-04-26T10:40:41.933 INFO:teuthology.orchestra.run.smithi195.stdout:(6/127): ceph-mon-18.2.2-1256.gdc093b5e.el9.x86 3.4 MB/s | 4.7 MB 00:01 2024-04-26T10:40:42.094 INFO:teuthology.orchestra.run.smithi049.stdout:(71/127): ceph-test-18.2.2-1256.gdc093b5e.el9.x 6.6 MB/s | 40 MB 00:06 2024-04-26T10:40:42.142 INFO:teuthology.orchestra.run.smithi060.stdout:(8/127): ceph-common-18.2.2-1256.gdc093b5e.el9. 2.4 MB/s | 18 MB 00:07 2024-04-26T10:40:42.203 INFO:teuthology.orchestra.run.smithi049.stdout:(72/127): python3-numpy-1.20.1-5.el9.x86_64.rpm 10 MB/s | 5.1 MB 00:00 2024-04-26T10:40:42.228 INFO:teuthology.orchestra.run.smithi049.stdout:(73/127): python3-numpy-f2py-1.20.1-5.el9.x86_6 509 kB/s | 250 kB 00:00 2024-04-26T10:40:42.234 INFO:teuthology.orchestra.run.smithi060.stdout:(9/127): ceph-selinux-18.2.2-1256.gdc093b5e.el9 276 kB/s | 25 kB 00:00 2024-04-26T10:40:42.254 INFO:teuthology.orchestra.run.smithi049.stdout:(74/127): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-04-26T10:40:42.278 INFO:teuthology.orchestra.run.smithi049.stdout:(75/127): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-04-26T10:40:42.303 INFO:teuthology.orchestra.run.smithi049.stdout:(76/127): python3-prettytable-0.7.2-27.el9.noar 847 kB/s | 42 kB 00:00 2024-04-26T10:40:42.329 INFO:teuthology.orchestra.run.smithi049.stdout:(77/127): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-04-26T10:40:42.354 INFO:teuthology.orchestra.run.smithi049.stdout:(78/127): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-04-26T10:40:42.379 INFO:teuthology.orchestra.run.smithi049.stdout:(79/127): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-26T10:40:42.405 INFO:teuthology.orchestra.run.smithi049.stdout:(80/127): python3-requests-oauthlib-1.3.0-12.el 719 kB/s | 54 kB 00:00 2024-04-26T10:40:42.671 INFO:teuthology.orchestra.run.smithi049.stdout:(81/127): python3-toml-0.10.2-6.el9.noarch.rpm 158 kB/s | 42 kB 00:00 2024-04-26T10:40:42.706 INFO:teuthology.orchestra.run.smithi049.stdout:(82/127): socat-1.7.4.1-5.el9.x86_64.rpm 1.0 MB/s | 305 kB 00:00 2024-04-26T10:40:42.901 INFO:teuthology.orchestra.run.smithi060.stdout:(10/127): ceph-radosgw-18.2.2-1256.gdc093b5e.el 2.2 MB/s | 7.7 MB 00:03 2024-04-26T10:40:42.984 INFO:teuthology.orchestra.run.smithi060.stdout:(11/127): libcephfs-devel-18.2.2-1256.gdc093b5e 374 kB/s | 31 kB 00:00 2024-04-26T10:40:42.997 INFO:teuthology.orchestra.run.smithi049.stdout:(83/127): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-04-26T10:40:43.022 INFO:teuthology.orchestra.run.smithi049.stdout:(84/127): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 268 kB/s | 94 kB 00:00 2024-04-26T10:40:43.047 INFO:teuthology.orchestra.run.smithi049.stdout:(85/127): xmlstarlet-1.6.1-20.el9.x86_64.rpm 188 kB/s | 64 kB 00:00 2024-04-26T10:40:43.074 INFO:teuthology.orchestra.run.smithi049.stdout:(86/127): zlib-devel-1.2.11-41.el9.x86_64.rpm 600 kB/s | 45 kB 00:00 2024-04-26T10:40:43.251 INFO:teuthology.orchestra.run.smithi087.stdout:(10/127): ceph-radosgw-18.2.2-1256.gdc093b5e.el 4.2 MB/s | 7.7 MB 00:01 2024-04-26T10:40:43.293 INFO:teuthology.orchestra.run.smithi060.stdout:(12/127): libcephfs2-18.2.2-1256.gdc093b5e.el9. 2.2 MB/s | 710 kB 00:00 2024-04-26T10:40:43.326 INFO:teuthology.orchestra.run.smithi087.stdout:(11/127): libcephfs-devel-18.2.2-1256.gdc093b5e 415 kB/s | 31 kB 00:00 2024-04-26T10:40:43.435 INFO:teuthology.orchestra.run.smithi060.stdout:(13/127): libcephsqlite-18.2.2-1256.gdc093b5e.e 1.1 MB/s | 166 kB 00:00 2024-04-26T10:40:43.518 INFO:teuthology.orchestra.run.smithi060.stdout:(14/127): librados-devel-18.2.2-1256.gdc093b5e. 1.5 MB/s | 126 kB 00:00 2024-04-26T10:40:43.535 INFO:teuthology.orchestra.run.smithi087.stdout:(12/127): libcephfs2-18.2.2-1256.gdc093b5e.el9. 3.3 MB/s | 710 kB 00:00 2024-04-26T10:40:43.627 INFO:teuthology.orchestra.run.smithi087.stdout:(13/127): libcephsqlite-18.2.2-1256.gdc093b5e.e 1.8 MB/s | 166 kB 00:00 2024-04-26T10:40:43.712 INFO:teuthology.orchestra.run.smithi087.stdout:(14/127): librados-devel-18.2.2-1256.gdc093b5e. 1.4 MB/s | 126 kB 00:00 2024-04-26T10:40:43.765 INFO:teuthology.orchestra.run.smithi049.stdout:(87/127): fmt-8.1.1-5.el9.x86_64.rpm 154 kB/s | 111 kB 00:00 2024-04-26T10:40:43.818 INFO:teuthology.orchestra.run.smithi060.stdout:(15/127): libradosstriper1-18.2.2-1256.gdc093b5 1.5 MB/s | 474 kB 00:00 2024-04-26T10:40:43.855 INFO:teuthology.orchestra.run.smithi087.stdout:(15/127): libradosstriper1-18.2.2-1256.gdc093b5 3.3 MB/s | 474 kB 00:00 2024-04-26T10:40:43.898 INFO:teuthology.orchestra.run.smithi049.stdout:(88/127): libarrow-doc-9.0.0-11.el9.noarch.rpm 195 kB/s | 26 kB 00:00 2024-04-26T10:40:43.949 INFO:teuthology.orchestra.run.smithi049.stdout:(89/127): gperftools-libs-2.9.1-2.el9.x86_64.rp 343 kB/s | 309 kB 00:00 2024-04-26T10:40:44.107 INFO:teuthology.orchestra.run.smithi049.stdout:(90/127): libunwind-1.6.2-1.el9.x86_64.rpm 425 kB/s | 67 kB 00:00 2024-04-26T10:40:44.218 INFO:teuthology.orchestra.run.smithi049.stdout:(91/127): liboath-2.6.7-2.el9.x86_64.rpm 153 kB/s | 49 kB 00:00 2024-04-26T10:40:44.499 INFO:teuthology.orchestra.run.smithi049.stdout:(92/127): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.1 MB/s | 839 kB 00:00 2024-04-26T10:40:44.633 INFO:teuthology.orchestra.run.smithi049.stdout:(93/127): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 326 kB/s | 43 kB 00:00 2024-04-26T10:40:44.775 INFO:teuthology.orchestra.run.smithi049.stdout:(94/127): python3-cachetools-4.2.4-1.el9.noarch 227 kB/s | 32 kB 00:00 2024-04-26T10:40:44.800 INFO:teuthology.orchestra.run.smithi049.stdout:(95/127): python3-asyncssh-2.13.2-5.el9.noarch. 938 kB/s | 548 kB 00:00 2024-04-26T10:40:44.867 INFO:teuthology.orchestra.run.smithi049.stdout:(96/127): libarrow-9.0.0-11.el9.x86_64.rpm 2.5 MB/s | 4.4 MB 00:01 2024-04-26T10:40:44.918 INFO:teuthology.orchestra.run.smithi049.stdout:(97/127): python3-certifi-2021.10.8-2.el9.noarc 105 kB/s | 15 kB 00:00 2024-04-26T10:40:44.930 INFO:teuthology.orchestra.run.smithi087.stdout:(16/127): librgw2-18.2.2-1256.gdc093b5e.el9.x86 4.2 MB/s | 4.5 MB 00:01 2024-04-26T10:40:44.984 INFO:teuthology.orchestra.run.smithi049.stdout:(98/127): python3-cheroot-8.6.0-4.el9.noarch.rp 934 kB/s | 172 kB 00:00 2024-04-26T10:40:44.996 INFO:teuthology.orchestra.run.smithi087.stdout:(17/127): python3-ceph-argparse-18.2.2-1256.gdc 679 kB/s | 45 kB 00:00 2024-04-26T10:40:45.084 INFO:teuthology.orchestra.run.smithi049.stdout:(99/127): python3-google-auth-2.29.0-1.el9.noar 1.2 MB/s | 206 kB 00:00 2024-04-26T10:40:45.110 INFO:teuthology.orchestra.run.smithi049.stdout:(100/127): python3-jaraco-8.2.1-3.el9.noarch.rp 85 kB/s | 11 kB 00:00 2024-04-26T10:40:45.135 INFO:teuthology.orchestra.run.smithi049.stdout:(101/127): python3-cherrypy-18.6.1-2.el9.noarch 1.3 MB/s | 358 kB 00:00 2024-04-26T10:40:45.174 INFO:teuthology.orchestra.run.smithi195.stdout:(7/127): ceph-osd-18.2.2-1256.gdc093b5e.el9.x86 5.1 MB/s | 17 MB 00:03 2024-04-26T10:40:45.227 INFO:teuthology.orchestra.run.smithi049.stdout:(102/127): python3-jaraco-classes-3.2.1-5.el9.n 124 kB/s | 18 kB 00:00 2024-04-26T10:40:45.252 INFO:teuthology.orchestra.run.smithi049.stdout:(103/127): python3-jaraco-collections-3.0.0-8.e 163 kB/s | 23 kB 00:00 2024-04-26T10:40:45.253 INFO:teuthology.orchestra.run.smithi060.stdout:(16/127): librgw2-18.2.2-1256.gdc093b5e.el9.x86 3.1 MB/s | 4.5 MB 00:01 2024-04-26T10:40:45.277 INFO:teuthology.orchestra.run.smithi049.stdout:(104/127): python3-jaraco-functools-3.5.0-2.el9 137 kB/s | 19 kB 00:00 2024-04-26T10:40:45.294 INFO:teuthology.orchestra.run.smithi060.stdout:(17/127): python3-ceph-argparse-18.2.2-1256.gdc 1.1 MB/s | 45 kB 00:00 2024-04-26T10:40:45.344 INFO:teuthology.orchestra.run.smithi060.stdout:(18/127): python3-ceph-common-18.2.2-1256.gdc09 2.5 MB/s | 129 kB 00:00 2024-04-26T10:40:45.378 INFO:teuthology.orchestra.run.smithi049.stdout:(105/127): python3-jaraco-text-3.2.0-6.el9.noar 131 kB/s | 20 kB 00:00 2024-04-26T10:40:45.389 INFO:teuthology.orchestra.run.smithi087.stdout:(18/127): ceph-test-18.2.2-1256.gdc093b5e.el9.x 11 MB/s | 40 MB 00:03 2024-04-26T10:40:45.395 INFO:teuthology.orchestra.run.smithi060.stdout:(19/127): python3-cephfs-18.2.2-1256.gdc093b5e. 3.1 MB/s | 162 kB 00:00 2024-04-26T10:40:45.414 INFO:teuthology.orchestra.run.smithi087.stdout:(19/127): python3-ceph-common-18.2.2-1256.gdc09 310 kB/s | 129 kB 00:00 2024-04-26T10:40:45.428 INFO:teuthology.orchestra.run.smithi049.stdout:(106/127): python3-logutils-0.3.5-21.el9.noarch 308 kB/s | 46 kB 00:00 2024-04-26T10:40:45.440 INFO:teuthology.orchestra.run.smithi087.stdout:(20/127): python3-cephfs-18.2.2-1256.gdc093b5e. 3.1 MB/s | 162 kB 00:00 2024-04-26T10:40:45.462 INFO:teuthology.orchestra.run.smithi060.stdout:(20/127): python3-rados-18.2.2-1256.gdc093b5e.e 4.7 MB/s | 320 kB 00:00 2024-04-26T10:40:45.482 INFO:teuthology.orchestra.run.smithi087.stdout:(21/127): python3-rados-18.2.2-1256.gdc093b5e.e 4.6 MB/s | 320 kB 00:00 2024-04-26T10:40:45.515 INFO:teuthology.orchestra.run.smithi087.stdout:(22/127): python3-rbd-18.2.2-1256.gdc093b5e.el9 3.9 MB/s | 298 kB 00:00 2024-04-26T10:40:45.520 INFO:teuthology.orchestra.run.smithi049.stdout:(107/127): python3-kubernetes-26.1.0-2.el9.noar 3.8 MB/s | 1.0 MB 00:00 2024-04-26T10:40:45.539 INFO:teuthology.orchestra.run.smithi060.stdout:(21/127): python3-rbd-18.2.2-1256.gdc093b5e.el9 3.8 MB/s | 298 kB 00:00 2024-04-26T10:40:45.540 INFO:teuthology.orchestra.run.smithi087.stdout:(23/127): python3-rgw-18.2.2-1256.gdc093b5e.el9 1.7 MB/s | 99 kB 00:00 2024-04-26T10:40:45.545 INFO:teuthology.orchestra.run.smithi049.stdout:(108/127): python3-more-itertools-8.12.0-2.el9. 472 kB/s | 79 kB 00:00 2024-04-26T10:40:45.565 INFO:teuthology.orchestra.run.smithi087.stdout:(24/127): rbd-fuse-18.2.2-1256.gdc093b5e.el9.x8 1.7 MB/s | 87 kB 00:00 2024-04-26T10:40:45.570 INFO:teuthology.orchestra.run.smithi049.stdout:(109/127): python3-natsort-7.1.1-5.el9.noarch.r 406 kB/s | 58 kB 00:00 2024-04-26T10:40:45.590 INFO:teuthology.orchestra.run.smithi060.stdout:(22/127): python3-rgw-18.2.2-1256.gdc093b5e.el9 1.9 MB/s | 99 kB 00:00 2024-04-26T10:40:45.624 INFO:teuthology.orchestra.run.smithi087.stdout:(25/127): rbd-nbd-18.2.2-1256.gdc093b5e.el9.x86 2.9 MB/s | 172 kB 00:00 2024-04-26T10:40:45.648 INFO:teuthology.orchestra.run.smithi060.stdout:(23/127): rbd-fuse-18.2.2-1256.gdc093b5e.el9.x8 1.5 MB/s | 87 kB 00:00 2024-04-26T10:40:45.674 INFO:teuthology.orchestra.run.smithi087.stdout:(26/127): ceph-grafana-dashboards-18.2.2-1256.g 489 kB/s | 24 kB 00:00 2024-04-26T10:40:45.696 INFO:teuthology.orchestra.run.smithi049.stdout:(110/127): python3-portend-3.1.0-2.el9.noarch.r 109 kB/s | 16 kB 00:00 2024-04-26T10:40:45.721 INFO:teuthology.orchestra.run.smithi049.stdout:(111/127): python3-pyOpenSSL-21.0.0-1.el9.noarc 597 kB/s | 90 kB 00:00 2024-04-26T10:40:45.747 INFO:teuthology.orchestra.run.smithi049.stdout:(112/127): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-04-26T10:40:45.750 INFO:teuthology.orchestra.run.smithi087.stdout:(27/127): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 1.8 MB/s | 138 kB 00:00 2024-04-26T10:40:45.808 INFO:teuthology.orchestra.run.smithi195.stdout:(8/127): ceph-radosgw-18.2.2-1256.gdc093b5e.el9 12 MB/s | 7.7 MB 00:00 2024-04-26T10:40:45.855 INFO:teuthology.orchestra.run.smithi049.stdout:(113/127): python3-repoze-lru-0.7-16.el9.noarch 193 kB/s | 31 kB 00:00 2024-04-26T10:40:45.881 INFO:teuthology.orchestra.run.smithi049.stdout:(114/127): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-04-26T10:40:45.883 INFO:teuthology.orchestra.run.smithi195.stdout:(9/127): ceph-selinux-18.2.2-1256.gdc093b5e.el9 337 kB/s | 25 kB 00:00 2024-04-26T10:40:45.906 INFO:teuthology.orchestra.run.smithi049.stdout:(115/127): python3-rsa-4.9-2.el9.noarch.rpm 372 kB/s | 59 kB 00:00 2024-04-26T10:40:45.950 INFO:teuthology.orchestra.run.smithi087.stdout:(28/127): rbd-mirror-18.2.2-1256.gdc093b5e.el9. 7.3 MB/s | 3.0 MB 00:00 2024-04-26T10:40:45.989 INFO:teuthology.orchestra.run.smithi049.stdout:(116/127): python3-tempora-5.0.0-2.el9.noarch.r 268 kB/s | 36 kB 00:00 2024-04-26T10:40:46.023 INFO:teuthology.orchestra.run.smithi049.stdout:(117/127): python3-typing-extensions-4.4.0-2.el 359 kB/s | 51 kB 00:00 2024-04-26T10:40:46.033 INFO:teuthology.orchestra.run.smithi087.stdout:(29/127): ceph-mgr-dashboard-18.2.2-1256.gdc093 12 MB/s | 3.5 MB 00:00 2024-04-26T10:40:46.092 INFO:teuthology.orchestra.run.smithi087.stdout:(30/127): ceph-mgr-modules-core-18.2.2-1256.gdc 4.1 MB/s | 246 kB 00:00 2024-04-26T10:40:46.098 INFO:teuthology.orchestra.run.smithi049.stdout:(118/127): python3-webob-1.8.7-6.el9.noarch.rpm 1.2 MB/s | 230 kB 00:00 2024-04-26T10:40:46.123 INFO:teuthology.orchestra.run.smithi049.stdout:(119/127): python3-websocket-client-1.2.3-2.el9 670 kB/s | 90 kB 00:00 2024-04-26T10:40:46.151 INFO:teuthology.orchestra.run.smithi087.stdout:(31/127): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 848 kB/s | 49 kB 00:00 2024-04-26T10:40:46.199 INFO:teuthology.orchestra.run.smithi049.stdout:(120/127): python3-werkzeug-2.0.3-3.el9.1.noarc 2.4 MB/s | 427 kB 00:00 2024-04-26T10:40:46.210 INFO:teuthology.orchestra.run.smithi087.stdout:(32/127): ceph-prometheus-alerts-18.2.2-1256.gd 262 kB/s | 15 kB 00:00 2024-04-26T10:40:46.216 INFO:teuthology.orchestra.run.smithi049.stdout:(121/127): python3-zc-lockfile-2.0-10.el9.noarc 170 kB/s | 20 kB 00:00 2024-04-26T10:40:46.258 INFO:teuthology.orchestra.run.smithi049.stdout:(122/127): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2024-04-26T10:40:46.265 INFO:teuthology.orchestra.run.smithi060.stdout:(24/127): rbd-mirror-18.2.2-1256.gdc093b5e.el9. 4.8 MB/s | 3.0 MB 00:00 2024-04-26T10:40:46.268 INFO:teuthology.orchestra.run.smithi087.stdout:(33/127): ceph-volume-18.2.2-1256.gdc093b5e.el9 4.4 MB/s | 264 kB 00:00 2024-04-26T10:40:46.316 INFO:teuthology.orchestra.run.smithi060.stdout:(25/127): rbd-nbd-18.2.2-1256.gdc093b5e.el9.x86 3.4 MB/s | 172 kB 00:00 2024-04-26T10:40:46.335 INFO:teuthology.orchestra.run.smithi087.stdout:(34/127): cephadm-18.2.2-1256.gdc093b5e.el9.noa 3.3 MB/s | 224 kB 00:00 2024-04-26T10:40:46.374 INFO:teuthology.orchestra.run.smithi060.stdout:(26/127): ceph-grafana-dashboards-18.2.2-1256.g 419 kB/s | 24 kB 00:00 2024-04-26T10:40:46.408 INFO:teuthology.orchestra.run.smithi049.stdout:(123/127): thrift-0.15.0-2.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-04-26T10:40:46.433 INFO:teuthology.orchestra.run.smithi060.stdout:(27/127): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 2.3 MB/s | 138 kB 00:00 2024-04-26T10:40:46.525 INFO:teuthology.orchestra.run.smithi049.stdout:(124/127): openssl-3.2.1-1.el9.x86_64.rpm 12 MB/s | 1.3 MB 00:00 2024-04-26T10:40:46.702 INFO:teuthology.orchestra.run.smithi087.stdout:(35/127): fuse-2.9.9-15.el9.x86_64.rpm 219 kB/s | 80 kB 00:00 2024-04-26T10:40:46.708 INFO:teuthology.orchestra.run.smithi049.stdout:(125/127): openssl-libs-3.2.1-1.el9.x86_64.rpm 13 MB/s | 2.4 MB 00:00 2024-04-26T10:40:46.936 INFO:teuthology.orchestra.run.smithi087.stdout:(36/127): libgfortran-11.4.1-3.el9.x86_64.rpm 3.4 MB/s | 803 kB 00:00 2024-04-26T10:40:47.011 INFO:teuthology.orchestra.run.smithi087.stdout:(37/127): libquadmath-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 195 kB 00:00 2024-04-26T10:40:47.075 INFO:teuthology.orchestra.run.smithi049.stdout:(126/127): librbd1-18.2.2-1256.gdc093b5e.el9.x8 3.7 MB/s | 3.0 MB 00:00 2024-04-26T10:40:47.078 INFO:teuthology.orchestra.run.smithi087.stdout:(38/127): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-04-26T10:40:47.150 INFO:teuthology.orchestra.run.smithi049.stdout:(127/127): librados2-18.2.2-1256.gdc093b5e.el9. 3.5 MB/s | 3.3 MB 00:00 2024-04-26T10:40:47.158 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-04-26T10:40:47.158 INFO:teuthology.orchestra.run.smithi049.stdout:Total 14 MB/s | 189 MB 00:13 2024-04-26T10:40:47.170 INFO:teuthology.orchestra.run.smithi087.stdout:(39/127): ceph-mgr-diskprediction-local-18.2.2- 6.1 MB/s | 7.4 MB 00:01 2024-04-26T10:40:47.203 INFO:teuthology.orchestra.run.smithi087.stdout:(40/127): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-04-26T10:40:47.220 INFO:teuthology.orchestra.run.smithi087.stdout:(41/127): python3-ply-3.11-14.el9.noarch.rpm 2.2 MB/s | 106 kB 00:00 2024-04-26T10:40:47.246 INFO:teuthology.orchestra.run.smithi087.stdout:(42/127): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-04-26T10:40:47.249 INFO:teuthology.orchestra.run.smithi060.stdout:(28/127): ceph-mgr-dashboard-18.2.2-1256.gdc093 4.3 MB/s | 3.5 MB 00:00 2024-04-26T10:40:47.271 INFO:teuthology.orchestra.run.smithi087.stdout:(43/127): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-26T10:40:47.296 INFO:teuthology.orchestra.run.smithi087.stdout:(44/127): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-26T10:40:47.347 INFO:teuthology.orchestra.run.smithi087.stdout:(45/127): automake-1.16.2-8.el9.noarch.rpm 9.0 MB/s | 689 kB 00:00 2024-04-26T10:40:47.380 INFO:teuthology.orchestra.run.smithi087.stdout:(46/127): bison-3.7.4-5.el9.x86_64.rpm 11 MB/s | 943 kB 00:00 2024-04-26T10:40:47.415 INFO:teuthology.orchestra.run.smithi087.stdout:(47/127): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-04-26T10:40:47.448 INFO:teuthology.orchestra.run.smithi087.stdout:(48/127): elfutils-libelf-devel-0.190-2.el9.x86 321 kB/s | 21 kB 00:00 2024-04-26T10:40:47.506 INFO:teuthology.orchestra.run.smithi087.stdout:(49/127): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-04-26T10:40:47.516 INFO:teuthology.orchestra.run.smithi060.stdout:(29/127): ceph-osd-18.2.2-1256.gdc093b5e.el9.x8 1.6 MB/s | 17 MB 00:10 2024-04-26T10:40:47.532 INFO:teuthology.orchestra.run.smithi087.stdout:(50/127): flexiblas-3.0.4-8.el9.x86_64.rpm 390 kB/s | 33 kB 00:00 2024-04-26T10:40:47.632 INFO:teuthology.orchestra.run.smithi087.stdout:(51/127): flexiblas-openblas-openmp-3.0.4-8.el9 182 kB/s | 18 kB 00:00 2024-04-26T10:40:47.690 INFO:teuthology.orchestra.run.smithi087.stdout:(52/127): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-04-26T10:40:47.716 INFO:teuthology.orchestra.run.smithi087.stdout:(53/127): libaio-devel-0.3.111-13.el9.x86_64.rp 134 kB/s | 11 kB 00:00 2024-04-26T10:40:47.741 INFO:teuthology.orchestra.run.smithi087.stdout:(54/127): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-26T10:40:47.750 INFO:teuthology.orchestra.run.smithi060.stdout:(30/127): ceph-mgr-modules-core-18.2.2-1256.gdc 1.0 MB/s | 246 kB 00:00 2024-04-26T10:40:47.766 INFO:teuthology.orchestra.run.smithi087.stdout:(55/127): librabbitmq-0.11.0-7.el9.x86_64.rpm 913 kB/s | 45 kB 00:00 2024-04-26T10:40:47.791 INFO:teuthology.orchestra.run.smithi087.stdout:(56/127): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-04-26T10:40:47.808 INFO:teuthology.orchestra.run.smithi060.stdout:(31/127): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 849 kB/s | 49 kB 00:00 2024-04-26T10:40:47.825 INFO:teuthology.orchestra.run.smithi087.stdout:(57/127): libtool-2.4.6-45.el9.x86_64.rpm 9.9 MB/s | 582 kB 00:00 2024-04-26T10:40:47.850 INFO:teuthology.orchestra.run.smithi087.stdout:(58/127): libuuid-devel-2.37.4-18.el9.x86_64.rp 442 kB/s | 25 kB 00:00 2024-04-26T10:40:47.867 INFO:teuthology.orchestra.run.smithi060.stdout:(32/127): ceph-prometheus-alerts-18.2.2-1256.gd 263 kB/s | 15 kB 00:00 2024-04-26T10:40:47.875 INFO:teuthology.orchestra.run.smithi087.stdout:(59/127): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-04-26T10:40:47.901 INFO:teuthology.orchestra.run.smithi087.stdout:(60/127): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-04-26T10:40:47.926 INFO:teuthology.orchestra.run.smithi087.stdout:(61/127): openblas-0.3.21-2.el9.x86_64.rpm 710 kB/s | 35 kB 00:00 2024-04-26T10:40:48.008 INFO:teuthology.orchestra.run.smithi195.stdout:(10/127): ceph-base-18.2.2-1256.gdc093b5e.el9.x 508 kB/s | 5.1 MB 00:10 2024-04-26T10:40:48.056 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-04-26T10:40:48.108 INFO:teuthology.orchestra.run.smithi195.stdout:(11/127): libcephfs-devel-18.2.2-1256.gdc093b5e 311 kB/s | 31 kB 00:00 2024-04-26T10:40:48.151 INFO:teuthology.orchestra.run.smithi060.stdout:(33/127): ceph-volume-18.2.2-1256.gdc093b5e.el9 931 kB/s | 264 kB 00:00 2024-04-26T10:40:48.202 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-04-26T10:40:48.202 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-04-26T10:40:48.235 INFO:teuthology.orchestra.run.smithi087.stdout:(62/127): openblas-openmp-0.3.21-2.el9.x86_64.r 14 MB/s | 4.7 MB 00:00 2024-04-26T10:40:48.301 INFO:teuthology.orchestra.run.smithi060.stdout:(34/127): ceph-mgr-diskprediction-local-18.2.2- 7.0 MB/s | 7.4 MB 00:01 2024-04-26T10:40:48.302 INFO:teuthology.orchestra.run.smithi087.stdout:(63/127): openssl-devel-3.2.1-1.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-04-26T10:40:48.428 INFO:teuthology.orchestra.run.smithi060.stdout:(35/127): cephadm-18.2.2-1256.gdc093b5e.el9.noa 815 kB/s | 224 kB 00:00 2024-04-26T10:40:48.435 INFO:teuthology.orchestra.run.smithi087.stdout:(64/127): python3-devel-3.9.18-3.el9.x86_64.rpm 1.8 MB/s | 244 kB 00:00 2024-04-26T10:40:48.469 INFO:teuthology.orchestra.run.smithi060.stdout:(36/127): fuse-2.9.9-15.el9.x86_64.rpm 482 kB/s | 80 kB 00:00 2024-04-26T10:40:48.511 INFO:teuthology.orchestra.run.smithi087.stdout:(65/127): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 6.0 MB 00:00 2024-04-26T10:40:48.538 INFO:teuthology.orchestra.run.smithi087.stdout:(66/127): python3-jinja2-2.11.3-5.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-04-26T10:40:48.552 INFO:teuthology.orchestra.run.smithi060.stdout:(37/127): libgfortran-11.4.1-3.el9.x86_64.rpm 6.3 MB/s | 803 kB 00:00 2024-04-26T10:40:48.561 INFO:teuthology.orchestra.run.smithi087.stdout:(67/127): python3-jsonpatch-1.21-16.el9.noarch. 516 kB/s | 26 kB 00:00 2024-04-26T10:40:48.578 INFO:teuthology.orchestra.run.smithi060.stdout:(38/127): libquadmath-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-04-26T10:40:48.586 INFO:teuthology.orchestra.run.smithi087.stdout:(68/127): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-04-26T10:40:48.603 INFO:teuthology.orchestra.run.smithi060.stdout:(39/127): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-04-26T10:40:48.612 INFO:teuthology.orchestra.run.smithi087.stdout:(69/127): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-04-26T10:40:48.616 INFO:teuthology.orchestra.run.smithi195.stdout:(12/127): libcephfs2-18.2.2-1256.gdc093b5e.el9. 1.4 MB/s | 710 kB 00:00 2024-04-26T10:40:48.646 INFO:teuthology.orchestra.run.smithi087.stdout:(70/127): python3-markupsafe-1.1.1-12.el9.x86_6 595 kB/s | 35 kB 00:00 2024-04-26T10:40:48.661 INFO:teuthology.orchestra.run.smithi060.stdout:(40/127): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-04-26T10:40:48.687 INFO:teuthology.orchestra.run.smithi060.stdout:(41/127): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-04-26T10:40:48.737 INFO:teuthology.orchestra.run.smithi060.stdout:(42/127): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-04-26T10:40:48.754 INFO:teuthology.orchestra.run.smithi060.stdout:(43/127): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-04-26T10:40:48.762 INFO:teuthology.orchestra.run.smithi087.stdout:(71/127): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-04-26T10:40:48.804 INFO:teuthology.orchestra.run.smithi060.stdout:(44/127): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 215 kB 00:00 2024-04-26T10:40:48.830 INFO:teuthology.orchestra.run.smithi060.stdout:(45/127): automake-1.16.2-8.el9.noarch.rpm 8.9 MB/s | 689 kB 00:00 2024-04-26T10:40:48.850 INFO:teuthology.orchestra.run.smithi195.stdout:(13/127): libcephsqlite-18.2.2-1256.gdc093b5e.e 713 kB/s | 166 kB 00:00 2024-04-26T10:40:48.888 INFO:teuthology.orchestra.run.smithi087.stdout:(72/127): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-04-26T10:40:48.888 INFO:teuthology.orchestra.run.smithi060.stdout:(46/127): bison-3.7.4-5.el9.x86_64.rpm 11 MB/s | 943 kB 00:00 2024-04-26T10:40:48.913 INFO:teuthology.orchestra.run.smithi087.stdout:(73/127): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-04-26T10:40:48.914 INFO:teuthology.orchestra.run.smithi060.stdout:(47/127): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 107 kB 00:00 2024-04-26T10:40:48.947 INFO:teuthology.orchestra.run.smithi087.stdout:(74/127): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-04-26T10:40:48.947 INFO:teuthology.orchestra.run.smithi060.stdout:(48/127): elfutils-libelf-devel-0.190-2.el9.x86 366 kB/s | 21 kB 00:00 2024-04-26T10:40:48.972 INFO:teuthology.orchestra.run.smithi087.stdout:(75/127): python3-prettytable-0.7.2-27.el9.noar 722 kB/s | 42 kB 00:00 2024-04-26T10:40:48.973 INFO:teuthology.orchestra.run.smithi060.stdout:(49/127): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-04-26T10:40:48.984 INFO:teuthology.orchestra.run.smithi195.stdout:(14/127): librados-devel-18.2.2-1256.gdc093b5e. 951 kB/s | 126 kB 00:00 2024-04-26T10:40:48.989 INFO:teuthology.orchestra.run.smithi087.stdout:(76/127): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.7 MB/s | 159 kB 00:00 2024-04-26T10:40:48.998 INFO:teuthology.orchestra.run.smithi060.stdout:(50/127): flexiblas-3.0.4-8.el9.x86_64.rpm 661 kB/s | 33 kB 00:00 2024-04-26T10:40:49.031 INFO:teuthology.orchestra.run.smithi087.stdout:(77/127): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-04-26T10:40:49.048 INFO:teuthology.orchestra.run.smithi087.stdout:(78/127): python3-pytz-2021.1-5.el9.noarch.rpm 874 kB/s | 51 kB 00:00 2024-04-26T10:40:49.065 INFO:teuthology.orchestra.run.smithi087.stdout:(79/127): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-04-26T10:40:49.090 INFO:teuthology.orchestra.run.smithi060.stdout:(51/127): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-04-26T10:40:49.099 INFO:teuthology.orchestra.run.smithi087.stdout:(80/127): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-04-26T10:40:49.115 INFO:teuthology.orchestra.run.smithi060.stdout:(52/127): flexiblas-openblas-openmp-3.0.4-8.el9 157 kB/s | 18 kB 00:00 2024-04-26T10:40:49.141 INFO:teuthology.orchestra.run.smithi060.stdout:(53/127): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-04-26T10:40:49.166 INFO:teuthology.orchestra.run.smithi060.stdout:(54/127): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-26T10:40:49.191 INFO:teuthology.orchestra.run.smithi060.stdout:(55/127): librabbitmq-0.11.0-7.el9.x86_64.rpm 909 kB/s | 45 kB 00:00 2024-04-26T10:40:49.193 INFO:teuthology.orchestra.run.smithi087.stdout:(81/127): socat-1.7.4.1-5.el9.x86_64.rpm 3.2 MB/s | 305 kB 00:00 2024-04-26T10:40:49.225 INFO:teuthology.orchestra.run.smithi060.stdout:(56/127): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-04-26T10:40:49.258 INFO:teuthology.orchestra.run.smithi060.stdout:(57/127): libtool-2.4.6-45.el9.x86_64.rpm 8.6 MB/s | 582 kB 00:00 2024-04-26T10:40:49.275 INFO:teuthology.orchestra.run.smithi060.stdout:(58/127): libuuid-devel-2.37.4-18.el9.x86_64.rp 517 kB/s | 25 kB 00:00 2024-04-26T10:40:49.317 INFO:teuthology.orchestra.run.smithi060.stdout:(59/127): libzstd-devel-1.5.1-2.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-04-26T10:40:49.324 INFO:teuthology.orchestra.run.smithi087.stdout:(82/127): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 733 kB/s | 94 kB 00:00 2024-04-26T10:40:49.342 INFO:teuthology.orchestra.run.smithi060.stdout:(60/127): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-04-26T10:40:49.359 INFO:teuthology.orchestra.run.smithi060.stdout:(61/127): openblas-0.3.21-2.el9.x86_64.rpm 854 kB/s | 35 kB 00:00 2024-04-26T10:40:49.393 INFO:teuthology.orchestra.run.smithi195.stdout:(15/127): ceph-test-18.2.2-1256.gdc093b5e.el9.x 11 MB/s | 40 MB 00:03 2024-04-26T10:40:49.518 INFO:teuthology.orchestra.run.smithi060.stdout:(62/127): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2024-04-26T10:40:49.566 INFO:teuthology.orchestra.run.smithi087.stdout:(83/127): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-04-26T10:40:49.576 INFO:teuthology.orchestra.run.smithi195.stdout:(16/127): ceph-common-18.2.2-1256.gdc093b5e.el9 1.6 MB/s | 18 MB 00:11 2024-04-26T10:40:49.591 INFO:teuthology.orchestra.run.smithi087.stdout:(84/127): xmlstarlet-1.6.1-20.el9.x86_64.rpm 241 kB/s | 64 kB 00:00 2024-04-26T10:40:49.601 INFO:teuthology.orchestra.run.smithi195.stdout:(17/127): libradosstriper1-18.2.2-1256.gdc093b5 768 kB/s | 474 kB 00:00 2024-04-26T10:40:49.610 INFO:teuthology.orchestra.run.smithi060.stdout:(63/127): openssl-devel-3.2.1-1.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-04-26T10:40:49.616 INFO:teuthology.orchestra.run.smithi087.stdout:(85/127): zlib-devel-1.2.11-41.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-04-26T10:40:49.677 INFO:teuthology.orchestra.run.smithi195.stdout:(18/127): python3-ceph-argparse-18.2.2-1256.gdc 450 kB/s | 45 kB 00:00 2024-04-26T10:40:49.760 INFO:teuthology.orchestra.run.smithi195.stdout:(19/127): python3-ceph-common-18.2.2-1256.gdc09 815 kB/s | 129 kB 00:00 2024-04-26T10:40:49.775 INFO:teuthology.orchestra.run.smithi087.stdout:(86/127): fmt-8.1.1-5.el9.x86_64.rpm 603 kB/s | 111 kB 00:00 2024-04-26T10:40:49.794 INFO:teuthology.orchestra.run.smithi060.stdout:(64/127): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 6.0 MB 00:00 2024-04-26T10:40:49.794 INFO:teuthology.orchestra.run.smithi195.stdout:(20/127): python3-cephfs-18.2.2-1256.gdc093b5e. 1.4 MB/s | 162 kB 00:00 2024-04-26T10:40:49.819 INFO:teuthology.orchestra.run.smithi060.stdout:(65/127): python3-devel-3.9.18-3.el9.x86_64.rpm 1.2 MB/s | 244 kB 00:00 2024-04-26T10:40:49.842 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-04-26T10:40:49.842 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-04-26T10:40:49.844 INFO:teuthology.orchestra.run.smithi060.stdout:(66/127): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-04-26T10:40:49.859 INFO:teuthology.orchestra.run.smithi087.stdout:(87/127): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.2 MB/s | 309 kB 00:00 2024-04-26T10:40:49.861 INFO:teuthology.orchestra.run.smithi060.stdout:(67/127): python3-jsonpatch-1.21-16.el9.noarch. 619 kB/s | 26 kB 00:00 2024-04-26T10:40:49.878 INFO:teuthology.orchestra.run.smithi060.stdout:(68/127): python3-jsonpointer-2.0-4.el9.noarch. 572 kB/s | 19 kB 00:00 2024-04-26T10:40:49.886 INFO:teuthology.orchestra.run.smithi195.stdout:(21/127): librgw2-18.2.2-1256.gdc093b5e.el9.x86 9.1 MB/s | 4.5 MB 00:00 2024-04-26T10:40:49.904 INFO:teuthology.orchestra.run.smithi060.stdout:(69/127): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-04-26T10:40:49.917 INFO:teuthology.orchestra.run.smithi087.stdout:(88/127): libarrow-doc-9.0.0-11.el9.noarch.rpm 447 kB/s | 26 kB 00:00 2024-04-26T10:40:49.929 INFO:teuthology.orchestra.run.smithi060.stdout:(70/127): python3-markupsafe-1.1.1-12.el9.x86_6 697 kB/s | 35 kB 00:00 2024-04-26T10:40:49.936 INFO:teuthology.orchestra.run.smithi195.stdout:(22/127): python3-rgw-18.2.2-1256.gdc093b5e.el9 1.9 MB/s | 99 kB 00:00 2024-04-26T10:40:49.976 INFO:teuthology.orchestra.run.smithi087.stdout:(89/127): liboath-2.6.7-2.el9.x86_64.rpm 832 kB/s | 49 kB 00:00 2024-04-26T10:40:49.986 INFO:teuthology.orchestra.run.smithi195.stdout:(23/127): rbd-fuse-18.2.2-1256.gdc093b5e.el9.x8 1.7 MB/s | 87 kB 00:00 2024-04-26T10:40:50.028 INFO:teuthology.orchestra.run.smithi195.stdout:(24/127): python3-rados-18.2.2-1256.gdc093b5e.e 1.2 MB/s | 320 kB 00:00 2024-04-26T10:40:50.076 INFO:teuthology.orchestra.run.smithi087.stdout:(90/127): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-04-26T10:40:50.078 INFO:teuthology.orchestra.run.smithi195.stdout:(25/127): python3-rbd-18.2.2-1256.gdc093b5e.el9 1.0 MB/s | 298 kB 00:00 2024-04-26T10:40:50.101 INFO:teuthology.orchestra.run.smithi087.stdout:(91/127): libunwind-1.6.2-1.el9.x86_64.rpm 539 kB/s | 67 kB 00:00 2024-04-26T10:40:50.129 INFO:teuthology.orchestra.run.smithi060.stdout:(71/127): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 5.1 MB 00:00 2024-04-26T10:40:50.138 INFO:teuthology.orchestra.run.smithi195.stdout:(26/127): ceph-grafana-dashboards-18.2.2-1256.g 417 kB/s | 24 kB 00:00 2024-04-26T10:40:50.152 INFO:teuthology.orchestra.run.smithi087.stdout:(92/127): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-04-26T10:40:50.154 INFO:teuthology.orchestra.run.smithi060.stdout:(72/127): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 250 kB 00:00 2024-04-26T10:40:50.180 INFO:teuthology.orchestra.run.smithi060.stdout:(73/127): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-04-26T10:40:50.180 INFO:teuthology.orchestra.run.smithi195.stdout:(27/127): rbd-nbd-18.2.2-1256.gdc093b5e.el9.x86 1.1 MB/s | 172 kB 00:00 2024-04-26T10:40:50.205 INFO:teuthology.orchestra.run.smithi060.stdout:(74/127): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-26T10:40:50.230 INFO:teuthology.orchestra.run.smithi060.stdout:(75/127): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-04-26T10:40:50.247 INFO:teuthology.orchestra.run.smithi087.stdout:(93/127): python3-asyncssh-2.13.2-5.el9.noarch. 3.7 MB/s | 548 kB 00:00 2024-04-26T10:40:50.255 INFO:teuthology.orchestra.run.smithi195.stdout:(28/127): rbd-mirror-18.2.2-1256.gdc093b5e.el9. 11 MB/s | 3.0 MB 00:00 2024-04-26T10:40:50.255 INFO:teuthology.orchestra.run.smithi060.stdout:(76/127): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-26T10:40:50.278 INFO:teuthology.orchestra.run.smithi087.stdout:(94/127): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 346 kB/s | 43 kB 00:00 2024-04-26T10:40:50.280 INFO:teuthology.orchestra.run.smithi195.stdout:(29/127): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 972 kB/s | 138 kB 00:00 2024-04-26T10:40:50.289 INFO:teuthology.orchestra.run.smithi060.stdout:(77/127): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-04-26T10:40:50.303 INFO:teuthology.orchestra.run.smithi087.stdout:(95/127): python3-cachetools-4.2.4-1.el9.noarch 584 kB/s | 32 kB 00:00 2024-04-26T10:40:50.315 INFO:teuthology.orchestra.run.smithi060.stdout:(78/127): python3-pytz-2021.1-5.el9.noarch.rpm 875 kB/s | 51 kB 00:00 2024-04-26T10:40:50.328 INFO:teuthology.orchestra.run.smithi087.stdout:(96/127): python3-certifi-2021.10.8-2.el9.noarc 299 kB/s | 15 kB 00:00 2024-04-26T10:40:50.341 INFO:teuthology.orchestra.run.smithi060.stdout:(79/127): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-04-26T10:40:50.361 INFO:teuthology.orchestra.run.smithi087.stdout:(97/127): python3-cheroot-8.6.0-4.el9.noarch.rp 2.9 MB/s | 172 kB 00:00 2024-04-26T10:40:50.395 INFO:teuthology.orchestra.run.smithi087.stdout:(98/127): python3-cherrypy-18.6.1-2.el9.noarch. 5.2 MB/s | 358 kB 00:00 2024-04-26T10:40:50.445 INFO:teuthology.orchestra.run.smithi087.stdout:(99/127): python3-jaraco-8.2.1-3.el9.noarch.rpm 215 kB/s | 11 kB 00:00 2024-04-26T10:40:50.456 INFO:teuthology.orchestra.run.smithi195.stdout:(30/127): ceph-mgr-modules-core-18.2.2-1256.gdc 1.4 MB/s | 246 kB 00:00 2024-04-26T10:40:50.471 INFO:teuthology.orchestra.run.smithi087.stdout:(100/127): python3-google-auth-2.29.0-1.el9.noa 1.8 MB/s | 206 kB 00:00 2024-04-26T10:40:50.496 INFO:teuthology.orchestra.run.smithi087.stdout:(101/127): python3-jaraco-classes-3.2.1-5.el9.n 349 kB/s | 18 kB 00:00 2024-04-26T10:40:50.521 INFO:teuthology.orchestra.run.smithi087.stdout:(102/127): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-04-26T10:40:50.530 INFO:teuthology.orchestra.run.smithi195.stdout:(31/127): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 660 kB/s | 49 kB 00:00 2024-04-26T10:40:50.546 INFO:teuthology.orchestra.run.smithi087.stdout:(103/127): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-04-26T10:40:50.572 INFO:teuthology.orchestra.run.smithi087.stdout:(104/127): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-04-26T10:40:50.614 INFO:teuthology.orchestra.run.smithi087.stdout:(105/127): python3-kubernetes-26.1.0-2.el9.noar 15 MB/s | 1.0 MB 00:00 2024-04-26T10:40:50.615 INFO:teuthology.orchestra.run.smithi195.stdout:(32/127): ceph-prometheus-alerts-18.2.2-1256.gd 184 kB/s | 15 kB 00:00 2024-04-26T10:40:50.631 INFO:teuthology.orchestra.run.smithi087.stdout:(106/127): python3-logutils-0.3.5-21.el9.noarch 791 kB/s | 46 kB 00:00 2024-04-26T10:40:50.656 INFO:teuthology.orchestra.run.smithi087.stdout:(107/127): python3-more-itertools-8.12.0-2.el9. 1.8 MB/s | 79 kB 00:00 2024-04-26T10:40:50.665 INFO:teuthology.orchestra.run.smithi060.stdout:(80/127): python3-toml-0.10.2-6.el9.noarch.rpm 128 kB/s | 42 kB 00:00 2024-04-26T10:40:50.673 INFO:teuthology.orchestra.run.smithi087.stdout:(108/127): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-04-26T10:40:50.715 INFO:teuthology.orchestra.run.smithi087.stdout:(109/127): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-04-26T10:40:50.732 INFO:teuthology.orchestra.run.smithi087.stdout:(110/127): python3-portend-3.1.0-2.el9.noarch.r 279 kB/s | 16 kB 00:00 2024-04-26T10:40:50.765 INFO:teuthology.orchestra.run.smithi087.stdout:(111/127): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-04-26T10:40:50.782 INFO:teuthology.orchestra.run.smithi087.stdout:(112/127): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-04-26T10:40:50.815 INFO:teuthology.orchestra.run.smithi195.stdout:(33/127): ceph-mgr-diskprediction-local-18.2.2- 13 MB/s | 7.4 MB 00:00 2024-04-26T10:40:50.832 INFO:teuthology.orchestra.run.smithi087.stdout:(113/127): python3-routes-2.5.1-5.el9.noarch.rp 2.8 MB/s | 188 kB 00:00 2024-04-26T10:40:50.840 INFO:teuthology.orchestra.run.smithi195.stdout:(34/127): ceph-volume-18.2.2-1256.gdc093b5e.el9 1.1 MB/s | 264 kB 00:00 2024-04-26T10:40:50.849 INFO:teuthology.orchestra.run.smithi087.stdout:(114/127): python3-rsa-4.9-2.el9.noarch.rpm 885 kB/s | 59 kB 00:00 2024-04-26T10:40:50.865 INFO:teuthology.orchestra.run.smithi195.stdout:(35/127): cephadm-18.2.2-1256.gdc093b5e.el9.noa 4.4 MB/s | 224 kB 00:00 2024-04-26T10:40:50.874 INFO:teuthology.orchestra.run.smithi087.stdout:(115/127): python3-tempora-5.0.0-2.el9.noarch.r 856 kB/s | 36 kB 00:00 2024-04-26T10:40:50.916 INFO:teuthology.orchestra.run.smithi060.stdout:(81/127): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-04-26T10:40:50.925 INFO:teuthology.orchestra.run.smithi087.stdout:(116/127): python3-typing-extensions-4.4.0-2.el 677 kB/s | 51 kB 00:00 2024-04-26T10:40:50.941 INFO:teuthology.orchestra.run.smithi060.stdout:(82/127): socat-1.7.4.1-5.el9.x86_64.rpm 1.1 MB/s | 305 kB 00:00 2024-04-26T10:40:50.950 INFO:teuthology.orchestra.run.smithi087.stdout:(117/127): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-26T10:40:50.966 INFO:teuthology.orchestra.run.smithi060.stdout:(83/127): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.9 MB/s | 94 kB 00:00 2024-04-26T10:40:50.975 INFO:teuthology.orchestra.run.smithi087.stdout:(118/127): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-04-26T10:40:50.990 INFO:teuthology.orchestra.run.smithi195.stdout:(36/127): fuse-2.9.9-15.el9.x86_64.rpm 537 kB/s | 80 kB 00:00 2024-04-26T10:40:50.991 INFO:teuthology.orchestra.run.smithi060.stdout:(84/127): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-26T10:40:51.009 INFO:teuthology.orchestra.run.smithi087.stdout:(119/127): python3-werkzeug-2.0.3-3.el9.1.noarc 7.1 MB/s | 427 kB 00:00 2024-04-26T10:40:51.016 INFO:teuthology.orchestra.run.smithi060.stdout:(85/127): zlib-devel-1.2.11-41.el9.x86_64.rpm 900 kB/s | 45 kB 00:00 2024-04-26T10:40:51.034 INFO:teuthology.orchestra.run.smithi087.stdout:(120/127): python3-zc-lockfile-2.0-10.el9.noarc 342 kB/s | 20 kB 00:00 2024-04-26T10:40:51.041 INFO:teuthology.orchestra.run.smithi195.stdout:(37/127): libgfortran-11.4.1-3.el9.x86_64.rpm 5.3 MB/s | 803 kB 00:00 2024-04-26T10:40:51.066 INFO:teuthology.orchestra.run.smithi195.stdout:(38/127): libquadmath-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2024-04-26T10:40:51.076 INFO:teuthology.orchestra.run.smithi087.stdout:(121/127): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-04-26T10:40:51.116 INFO:teuthology.orchestra.run.smithi195.stdout:(39/127): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-04-26T10:40:51.151 INFO:teuthology.orchestra.run.smithi087.stdout:(122/127): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-04-26T10:40:51.183 INFO:teuthology.orchestra.run.smithi195.stdout:(40/127): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-04-26T10:40:51.208 INFO:teuthology.orchestra.run.smithi195.stdout:(41/127): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-04-26T10:40:51.234 INFO:teuthology.orchestra.run.smithi195.stdout:(42/127): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-26T10:40:51.250 INFO:teuthology.orchestra.run.smithi060.stdout:(86/127): fmt-8.1.1-5.el9.x86_64.rpm 429 kB/s | 111 kB 00:00 2024-04-26T10:40:51.259 INFO:teuthology.orchestra.run.smithi195.stdout:(43/127): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-26T10:40:51.284 INFO:teuthology.orchestra.run.smithi195.stdout:(44/127): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-26T10:40:51.317 INFO:teuthology.orchestra.run.smithi060.stdout:(87/127): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.0 MB/s | 309 kB 00:00 2024-04-26T10:40:51.318 INFO:teuthology.orchestra.run.smithi195.stdout:(45/127): automake-1.16.2-8.el9.noarch.rpm 12 MB/s | 689 kB 00:00 2024-04-26T10:40:51.360 INFO:teuthology.orchestra.run.smithi195.stdout:(46/127): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 943 kB 00:00 2024-04-26T10:40:51.377 INFO:teuthology.orchestra.run.smithi195.stdout:(47/127): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-04-26T10:40:51.384 INFO:teuthology.orchestra.run.smithi060.stdout:(88/127): libarrow-doc-9.0.0-11.el9.noarch.rpm 390 kB/s | 26 kB 00:00 2024-04-26T10:40:51.402 INFO:teuthology.orchestra.run.smithi195.stdout:(48/127): elfutils-libelf-devel-0.190-2.el9.x86 515 kB/s | 21 kB 00:00 2024-04-26T10:40:51.427 INFO:teuthology.orchestra.run.smithi195.stdout:(49/127): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-04-26T10:40:51.451 INFO:teuthology.orchestra.run.smithi060.stdout:(89/127): liboath-2.6.7-2.el9.x86_64.rpm 731 kB/s | 49 kB 00:00 2024-04-26T10:40:51.453 INFO:teuthology.orchestra.run.smithi195.stdout:(50/127): flexiblas-3.0.4-8.el9.x86_64.rpm 656 kB/s | 33 kB 00:00 2024-04-26T10:40:51.469 INFO:teuthology.orchestra.run.smithi087.stdout:(123/127): librbd1-18.2.2-1256.gdc093b5e.el9.x8 9.5 MB/s | 3.0 MB 00:00 2024-04-26T10:40:51.518 INFO:teuthology.orchestra.run.smithi060.stdout:(90/127): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-04-26T10:40:51.544 INFO:teuthology.orchestra.run.smithi087.stdout:(124/127): librados2-18.2.2-1256.gdc093b5e.el9. 7.1 MB/s | 3.3 MB 00:00 2024-04-26T10:40:51.553 INFO:teuthology.orchestra.run.smithi195.stdout:(51/127): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-04-26T10:40:51.578 INFO:teuthology.orchestra.run.smithi195.stdout:(52/127): flexiblas-openblas-openmp-3.0.4-8.el9 147 kB/s | 18 kB 00:00 2024-04-26T10:40:51.585 INFO:teuthology.orchestra.run.smithi060.stdout:(91/127): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-04-26T10:40:51.586 INFO:teuthology.orchestra.run.smithi087.stdout:(125/127): openssl-3.2.1-1.el9.x86_64.rpm 12 MB/s | 1.3 MB 00:00 2024-04-26T10:40:51.604 INFO:teuthology.orchestra.run.smithi195.stdout:(53/127): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-04-26T10:40:51.629 INFO:teuthology.orchestra.run.smithi195.stdout:(54/127): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-26T10:40:51.653 INFO:teuthology.orchestra.run.smithi087.stdout:(126/127): openssl-libs-3.2.1-1.el9.x86_64.rpm 23 MB/s | 2.4 MB 00:00 2024-04-26T10:40:51.654 INFO:teuthology.orchestra.run.smithi195.stdout:(55/127): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-04-26T10:40:51.660 INFO:teuthology.orchestra.run.smithi060.stdout:(92/127): python3-asyncssh-2.13.2-5.el9.noarch. 7.1 MB/s | 548 kB 00:00 2024-04-26T10:40:51.679 INFO:teuthology.orchestra.run.smithi195.stdout:(56/127): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-04-26T10:40:51.713 INFO:teuthology.orchestra.run.smithi195.stdout:(57/127): libtool-2.4.6-45.el9.x86_64.rpm 9.9 MB/s | 582 kB 00:00 2024-04-26T10:40:51.727 INFO:teuthology.orchestra.run.smithi060.stdout:(93/127): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 654 kB/s | 43 kB 00:00 2024-04-26T10:40:51.738 INFO:teuthology.orchestra.run.smithi195.stdout:(58/127): libuuid-devel-2.37.4-18.el9.x86_64.rp 441 kB/s | 25 kB 00:00 2024-04-26T10:40:51.755 INFO:teuthology.orchestra.run.smithi195.stdout:(59/127): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-04-26T10:40:51.760 INFO:teuthology.orchestra.run.smithi060.stdout:(94/127): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.4 MB/s | 839 kB 00:00 2024-04-26T10:40:51.781 INFO:teuthology.orchestra.run.smithi195.stdout:(60/127): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.8 MB/s | 292 kB 00:00 2024-04-26T10:40:51.794 INFO:teuthology.orchestra.run.smithi060.stdout:(95/127): python3-cachetools-4.2.4-1.el9.noarch 481 kB/s | 32 kB 00:00 2024-04-26T10:40:51.797 INFO:teuthology.orchestra.run.smithi195.stdout:(61/127): openblas-0.3.21-2.el9.x86_64.rpm 849 kB/s | 35 kB 00:00 2024-04-26T10:40:51.828 INFO:teuthology.orchestra.run.smithi060.stdout:(96/127): python3-certifi-2021.10.8-2.el9.noarc 224 kB/s | 15 kB 00:00 2024-04-26T10:40:51.862 INFO:teuthology.orchestra.run.smithi060.stdout:(97/127): python3-cheroot-8.6.0-4.el9.noarch.rp 2.5 MB/s | 172 kB 00:00 2024-04-26T10:40:51.915 INFO:teuthology.orchestra.run.smithi195.stdout:(62/127): openblas-openmp-0.3.21-2.el9.x86_64.r 35 MB/s | 4.7 MB 00:00 2024-04-26T10:40:51.920 INFO:teuthology.orchestra.run.smithi060.stdout:(98/127): python3-cherrypy-18.6.1-2.el9.noarch. 3.8 MB/s | 358 kB 00:00 2024-04-26T10:40:51.945 INFO:teuthology.orchestra.run.smithi060.stdout:(99/127): python3-google-auth-2.29.0-1.el9.noar 2.4 MB/s | 206 kB 00:00 2024-04-26T10:40:51.979 INFO:teuthology.orchestra.run.smithi060.stdout:(100/127): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-04-26T10:40:51.998 INFO:teuthology.orchestra.run.smithi195.stdout:(63/127): openssl-devel-3.2.1-1.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-04-26T10:40:52.004 INFO:teuthology.orchestra.run.smithi060.stdout:(101/127): python3-jaraco-classes-3.2.1-5.el9.n 302 kB/s | 18 kB 00:00 2024-04-26T10:40:52.038 INFO:teuthology.orchestra.run.smithi060.stdout:(102/127): python3-jaraco-collections-3.0.0-8.e 396 kB/s | 23 kB 00:00 2024-04-26T10:40:52.063 INFO:teuthology.orchestra.run.smithi060.stdout:(103/127): python3-jaraco-functools-3.5.0-2.el9 333 kB/s | 19 kB 00:00 2024-04-26T10:40:52.097 INFO:teuthology.orchestra.run.smithi060.stdout:(104/127): python3-jaraco-text-3.2.0-6.el9.noar 337 kB/s | 20 kB 00:00 2024-04-26T10:40:52.124 INFO:teuthology.orchestra.run.smithi195.stdout:(64/127): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 6.0 MB 00:00 2024-04-26T10:40:52.147 INFO:teuthology.orchestra.run.smithi060.stdout:(105/127): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-04-26T10:40:52.149 INFO:teuthology.orchestra.run.smithi195.stdout:(65/127): python3-devel-3.9.18-3.el9.x86_64.rpm 1.6 MB/s | 244 kB 00:00 2024-04-26T10:40:52.164 INFO:teuthology.orchestra.run.smithi060.stdout:(106/127): python3-logutils-0.3.5-21.el9.noarch 690 kB/s | 46 kB 00:00 2024-04-26T10:40:52.182 INFO:teuthology.orchestra.run.smithi195.stdout:(66/127): python3-jinja2-2.11.3-5.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-04-26T10:40:52.208 INFO:teuthology.orchestra.run.smithi195.stdout:(67/127): python3-jsonpatch-1.21-16.el9.noarch. 440 kB/s | 26 kB 00:00 2024-04-26T10:40:52.214 INFO:teuthology.orchestra.run.smithi060.stdout:(107/127): python3-more-itertools-8.12.0-2.el9. 1.1 MB/s | 79 kB 00:00 2024-04-26T10:40:52.231 INFO:teuthology.orchestra.run.smithi060.stdout:(108/127): python3-natsort-7.1.1-5.el9.noarch.r 863 kB/s | 58 kB 00:00 2024-04-26T10:40:52.233 INFO:teuthology.orchestra.run.smithi195.stdout:(68/127): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-04-26T10:40:52.258 INFO:teuthology.orchestra.run.smithi195.stdout:(69/127): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-04-26T10:40:52.282 INFO:teuthology.orchestra.run.smithi060.stdout:(109/127): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-04-26T10:40:52.283 INFO:teuthology.orchestra.run.smithi195.stdout:(70/127): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-04-26T10:40:52.307 INFO:teuthology.orchestra.run.smithi060.stdout:(110/127): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-04-26T10:40:52.357 INFO:teuthology.orchestra.run.smithi060.stdout:(111/127): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-04-26T10:40:52.359 INFO:teuthology.orchestra.run.smithi195.stdout:(71/127): ceph-mgr-dashboard-18.2.2-1256.gdc093 1.6 MB/s | 3.5 MB 00:02 2024-04-26T10:40:52.383 INFO:teuthology.orchestra.run.smithi060.stdout:(112/127): python3-repoze-lru-0.7-16.el9.noarch 410 kB/s | 31 kB 00:00 2024-04-26T10:40:52.425 INFO:teuthology.orchestra.run.smithi060.stdout:(113/127): python3-routes-2.5.1-5.el9.noarch.rp 2.8 MB/s | 188 kB 00:00 2024-04-26T10:40:52.426 INFO:teuthology.orchestra.run.smithi195.stdout:(72/127): python3-numpy-1.20.1-5.el9.x86_64.rpm 31 MB/s | 5.1 MB 00:00 2024-04-26T10:40:52.450 INFO:teuthology.orchestra.run.smithi060.stdout:(114/127): python3-rsa-4.9-2.el9.noarch.rpm 883 kB/s | 59 kB 00:00 2024-04-26T10:40:52.451 INFO:teuthology.orchestra.run.smithi195.stdout:(73/127): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 250 kB 00:00 2024-04-26T10:40:52.476 INFO:teuthology.orchestra.run.smithi195.stdout:(74/127): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-04-26T10:40:52.491 INFO:teuthology.orchestra.run.smithi060.stdout:(115/127): python3-tempora-5.0.0-2.el9.noarch.r 537 kB/s | 36 kB 00:00 2024-04-26T10:40:52.501 INFO:teuthology.orchestra.run.smithi195.stdout:(75/127): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-26T10:40:52.517 INFO:teuthology.orchestra.run.smithi060.stdout:(116/127): python3-typing-extensions-4.4.0-2.el 764 kB/s | 51 kB 00:00 2024-04-26T10:40:52.527 INFO:teuthology.orchestra.run.smithi195.stdout:(76/127): python3-prettytable-0.7.2-27.el9.noar 564 kB/s | 42 kB 00:00 2024-04-26T10:40:52.552 INFO:teuthology.orchestra.run.smithi195.stdout:(77/127): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-04-26T10:40:52.559 INFO:teuthology.orchestra.run.smithi060.stdout:(117/127): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-04-26T10:40:52.577 INFO:teuthology.orchestra.run.smithi195.stdout:(78/127): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-04-26T10:40:52.584 INFO:teuthology.orchestra.run.smithi060.stdout:(118/127): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-04-26T10:40:52.602 INFO:teuthology.orchestra.run.smithi195.stdout:(79/127): python3-pytz-2021.1-5.el9.noarch.rpm 679 kB/s | 51 kB 00:00 2024-04-26T10:40:52.626 INFO:teuthology.orchestra.run.smithi060.stdout:(119/127): python3-werkzeug-2.0.3-3.el9.1.noarc 6.2 MB/s | 427 kB 00:00 2024-04-26T10:40:52.628 INFO:teuthology.orchestra.run.smithi195.stdout:(80/127): python3-requests-oauthlib-1.3.0-12.el 716 kB/s | 54 kB 00:00 2024-04-26T10:40:52.651 INFO:teuthology.orchestra.run.smithi060.stdout:(120/127): python3-zc-lockfile-2.0-10.el9.noarc 300 kB/s | 20 kB 00:00 2024-04-26T10:40:52.693 INFO:teuthology.orchestra.run.smithi060.stdout:(121/127): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-04-26T10:40:52.703 INFO:teuthology.orchestra.run.smithi195.stdout:(81/127): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-04-26T10:40:52.777 INFO:teuthology.orchestra.run.smithi060.stdout:(122/127): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-04-26T10:40:52.861 INFO:teuthology.orchestra.run.smithi195.stdout:(82/127): socat-1.7.4.1-5.el9.x86_64.rpm 1.3 MB/s | 305 kB 00:00 2024-04-26T10:40:53.108 INFO:teuthology.orchestra.run.smithi195.stdout:(83/127): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-04-26T10:40:53.127 INFO:teuthology.orchestra.run.smithi060.stdout:(123/127): librados2-18.2.2-1256.gdc093b5e.el9. 7.6 MB/s | 3.3 MB 00:00 2024-04-26T10:40:53.137 INFO:teuthology.orchestra.run.smithi195.stdout:(84/127): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 217 kB/s | 94 kB 00:00 2024-04-26T10:40:53.162 INFO:teuthology.orchestra.run.smithi195.stdout:(85/127): xmlstarlet-1.6.1-20.el9.x86_64.rpm 213 kB/s | 64 kB 00:00 2024-04-26T10:40:53.187 INFO:teuthology.orchestra.run.smithi195.stdout:(86/127): zlib-devel-1.2.11-41.el9.x86_64.rpm 568 kB/s | 45 kB 00:00 2024-04-26T10:40:53.294 INFO:teuthology.orchestra.run.smithi060.stdout:(124/127): openssl-3.2.1-1.el9.x86_64.rpm 8.1 MB/s | 1.3 MB 00:00 2024-04-26T10:40:53.463 INFO:teuthology.orchestra.run.smithi195.stdout:(87/127): fmt-8.1.1-5.el9.x86_64.rpm 369 kB/s | 111 kB 00:00 2024-04-26T10:40:53.546 INFO:teuthology.orchestra.run.smithi195.stdout:(88/127): libarrow-doc-9.0.0-11.el9.noarch.rpm 312 kB/s | 26 kB 00:00 2024-04-26T10:40:53.572 INFO:teuthology.orchestra.run.smithi195.stdout:(89/127): gperftools-libs-2.9.1-2.el9.x86_64.rp 755 kB/s | 309 kB 00:00 2024-04-26T10:40:53.586 INFO:teuthology.orchestra.run.smithi060.stdout:(125/127): openssl-libs-3.2.1-1.el9.x86_64.rpm 8.2 MB/s | 2.4 MB 00:00 2024-04-26T10:40:53.614 INFO:teuthology.orchestra.run.smithi195.stdout:(90/127): liboath-2.6.7-2.el9.x86_64.rpm 726 kB/s | 49 kB 00:00 2024-04-26T10:40:53.639 INFO:teuthology.orchestra.run.smithi195.stdout:(91/127): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-04-26T10:40:53.781 INFO:teuthology.orchestra.run.smithi195.stdout:(92/127): libarrow-9.0.0-11.el9.x86_64.rpm 7.4 MB/s | 4.4 MB 00:00 2024-04-26T10:40:53.814 INFO:teuthology.orchestra.run.smithi195.stdout:(93/127): python3-asyncssh-2.13.2-5.el9.noarch. 3.1 MB/s | 548 kB 00:00 2024-04-26T10:40:53.833 INFO:teuthology.orchestra.run.smithi195.stdout:(94/127): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 834 kB/s | 43 kB 00:00 2024-04-26T10:40:53.867 INFO:teuthology.orchestra.run.smithi195.stdout:(95/127): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.2 MB/s | 839 kB 00:00 2024-04-26T10:40:53.884 INFO:teuthology.orchestra.run.smithi195.stdout:(96/127): python3-certifi-2021.10.8-2.el9.noarc 298 kB/s | 15 kB 00:00 2024-04-26T10:40:53.901 INFO:teuthology.orchestra.run.smithi195.stdout:(97/127): python3-cachetools-4.2.4-1.el9.noarch 374 kB/s | 32 kB 00:00 2024-04-26T10:40:53.926 INFO:teuthology.orchestra.run.smithi195.stdout:(98/127): python3-cheroot-8.6.0-4.el9.noarch.rp 2.9 MB/s | 172 kB 00:00 2024-04-26T10:40:53.951 INFO:teuthology.orchestra.run.smithi195.stdout:(99/127): python3-cherrypy-18.6.1-2.el9.noarch. 5.2 MB/s | 358 kB 00:00 2024-04-26T10:40:53.976 INFO:teuthology.orchestra.run.smithi195.stdout:(100/127): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-04-26T10:40:54.002 INFO:teuthology.orchestra.run.smithi195.stdout:(101/127): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-04-26T10:40:54.027 INFO:teuthology.orchestra.run.smithi195.stdout:(102/127): python3-jaraco-classes-3.2.1-5.el9.n 234 kB/s | 18 kB 00:00 2024-04-26T10:40:54.052 INFO:teuthology.orchestra.run.smithi195.stdout:(103/127): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2024-04-26T10:40:54.078 INFO:teuthology.orchestra.run.smithi195.stdout:(104/127): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-04-26T10:40:54.103 INFO:teuthology.orchestra.run.smithi195.stdout:(105/127): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-04-26T10:40:54.136 INFO:teuthology.orchestra.run.smithi195.stdout:(106/127): python3-logutils-0.3.5-21.el9.noarch 791 kB/s | 46 kB 00:00 2024-04-26T10:40:54.162 INFO:teuthology.orchestra.run.smithi195.stdout:(107/127): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-04-26T10:40:54.187 INFO:teuthology.orchestra.run.smithi195.stdout:(108/127): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-04-26T10:40:54.212 INFO:teuthology.orchestra.run.smithi195.stdout:(109/127): python3-natsort-7.1.1-5.el9.noarch.r 765 kB/s | 58 kB 00:00 2024-04-26T10:40:54.238 INFO:teuthology.orchestra.run.smithi195.stdout:(110/127): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-26T10:40:54.263 INFO:teuthology.orchestra.run.smithi195.stdout:(111/127): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-04-26T10:40:54.288 INFO:teuthology.orchestra.run.smithi195.stdout:(112/127): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-04-26T10:40:54.313 INFO:teuthology.orchestra.run.smithi195.stdout:(113/127): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-04-26T10:40:54.339 INFO:teuthology.orchestra.run.smithi195.stdout:(114/127): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-26T10:40:54.364 INFO:teuthology.orchestra.run.smithi195.stdout:(115/127): python3-rsa-4.9-2.el9.noarch.rpm 785 kB/s | 59 kB 00:00 2024-04-26T10:40:54.389 INFO:teuthology.orchestra.run.smithi195.stdout:(116/127): python3-tempora-5.0.0-2.el9.noarch.r 473 kB/s | 36 kB 00:00 2024-04-26T10:40:54.414 INFO:teuthology.orchestra.run.smithi195.stdout:(117/127): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2024-04-26T10:40:54.659 INFO:teuthology.orchestra.run.smithi195.stdout:(118/127): python3-webob-1.8.7-6.el9.noarch.rpm 780 kB/s | 230 kB 00:00 2024-04-26T10:40:54.682 INFO:teuthology.orchestra.run.smithi195.stdout:(119/127): python3-websocket-client-1.2.3-2.el9 307 kB/s | 90 kB 00:00 2024-04-26T10:40:54.708 INFO:teuthology.orchestra.run.smithi195.stdout:(120/127): python3-werkzeug-2.0.3-3.el9.1.noarc 1.4 MB/s | 427 kB 00:00 2024-04-26T10:40:54.732 INFO:teuthology.orchestra.run.smithi195.stdout:(121/127): python3-zc-lockfile-2.0-10.el9.noarc 272 kB/s | 20 kB 00:00 2024-04-26T10:40:54.757 INFO:teuthology.orchestra.run.smithi195.stdout:(122/127): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-04-26T10:40:54.799 INFO:teuthology.orchestra.run.smithi195.stdout:(123/127): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-04-26T10:40:54.867 INFO:teuthology.orchestra.run.smithi195.stdout:(124/127): openssl-3.2.1-1.el9.x86_64.rpm 20 MB/s | 1.3 MB 00:00 2024-04-26T10:40:54.958 INFO:teuthology.orchestra.run.smithi195.stdout:(125/127): openssl-libs-3.2.1-1.el9.x86_64.rpm 26 MB/s | 2.4 MB 00:00 2024-04-26T10:40:54.977 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-04-26T10:40:55.086 INFO:teuthology.orchestra.run.smithi060.stdout:(126/127): librbd1-18.2.2-1256.gdc093b5e.el9.x8 1.3 MB/s | 3.0 MB 00:02 2024-04-26T10:40:55.104 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/131 2024-04-26T10:40:55.109 INFO:teuthology.orchestra.run.smithi195.stdout:(126/127): librados2-18.2.2-1256.gdc093b5e.el9. 8.8 MB/s | 3.3 MB 00:00 2024-04-26T10:40:55.294 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/131 2024-04-26T10:40:55.348 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/131 2024-04-26T10:40:55.389 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/131 2024-04-26T10:40:55.414 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/131 2024-04-26T10:40:55.458 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/131 2024-04-26T10:40:55.711 INFO:teuthology.orchestra.run.smithi087.stdout:(127/127): ceph-common-18.2.2-1256.gdc093b5e.el 1.0 MB/s | 18 MB 00:18 2024-04-26T10:40:55.715 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-04-26T10:40:55.716 INFO:teuthology.orchestra.run.smithi087.stdout:Total 9.9 MB/s | 189 MB 00:19 2024-04-26T10:40:55.793 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/131 2024-04-26T10:40:55.898 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T10:40:56.020 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T10:40:56.050 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T10:40:56.117 INFO:teuthology.orchestra.run.smithi195.stdout:(127/127): librbd1-18.2.2-1256.gdc093b5e.el9.x8 2.2 MB/s | 3.0 MB 00:01 2024-04-26T10:40:56.123 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-26T10:40:56.123 INFO:teuthology.orchestra.run.smithi195.stdout:Total 10 MB/s | 189 MB 00:18 2024-04-26T10:40:56.142 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T10:40:56.182 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T10:40:56.209 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T10:40:56.314 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T10:40:56.335 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T10:40:56.465 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T10:40:56.508 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 13/131 2024-04-26T10:40:56.544 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : liboath-2.6.7-2.el9.x86_64 14/131 2024-04-26T10:40:56.590 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-04-26T10:40:56.619 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/131 2024-04-26T10:40:56.659 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 16/131 2024-04-26T10:40:56.687 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 17/131 2024-04-26T10:40:56.723 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-04-26T10:40:56.723 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-04-26T10:40:56.759 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/131 2024-04-26T10:40:56.810 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 19/131 2024-04-26T10:40:56.839 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/131 2024-04-26T10:40:56.875 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 21/131 2024-04-26T10:40:56.954 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 22/131 2024-04-26T10:40:56.974 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-26T10:40:56.986 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 23/131 2024-04-26T10:40:57.029 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 24/131 2024-04-26T10:40:57.104 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-26T10:40:57.105 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-26T10:40:57.108 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 25/131 2024-04-26T10:40:57.254 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/131 2024-04-26T10:40:57.308 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 27/131 2024-04-26T10:40:57.863 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rsa-4.9-2.el9.noarch 28/131 2024-04-26T10:40:57.954 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 29/131 2024-04-26T10:40:57.998 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 30/131 2024-04-26T10:40:58.037 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 31/131 2024-04-26T10:40:58.078 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 32/131 2024-04-26T10:40:58.259 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 33/131 2024-04-26T10:40:58.307 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-04-26T10:40:58.307 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-04-26T10:40:58.320 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 34/131 2024-04-26T10:40:58.431 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : re2-1:20211101-3.el9.x86_64 35/131 2024-04-26T10:40:58.466 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 36/131 2024-04-26T10:40:58.522 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 37/131 2024-04-26T10:40:58.596 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 38/131 2024-04-26T10:40:58.633 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 39/131 2024-04-26T10:40:58.669 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 40/131 2024-04-26T10:40:58.717 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 41/131 2024-04-26T10:40:58.762 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 42/131 2024-04-26T10:40:58.804 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 43/131 2024-04-26T10:40:58.900 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-26T10:40:58.901 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-26T10:40:58.949 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 44/131 2024-04-26T10:40:58.989 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 45/131 2024-04-26T10:40:59.030 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 46/131 2024-04-26T10:40:59.130 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 47/131 2024-04-26T10:40:59.172 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 48/131 2024-04-26T10:40:59.213 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 49/131 2024-04-26T10:40:59.237 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 50/131 2024-04-26T10:40:59.264 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 51/131 2024-04-26T10:40:59.298 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : fmt-8.1.1-5.el9.x86_64 52/131 2024-04-26T10:40:59.326 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 53/131 2024-04-26T10:40:59.363 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 54/131 2024-04-26T10:40:59.393 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 55/131 2024-04-26T10:40:59.427 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 56/131 2024-04-26T10:40:59.461 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 57/131 2024-04-26T10:40:59.503 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 58/131 2024-04-26T10:40:59.537 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 59/131 2024-04-26T10:40:59.565 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 60/131 2024-04-26T10:40:59.612 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 61/131 2024-04-26T10:40:59.724 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-packaging-20.9-5.el9.noarch 62/131 2024-04-26T10:40:59.775 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 63/131 2024-04-26T10:41:00.534 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 64/131 2024-04-26T10:41:00.536 INFO:teuthology.orchestra.run.smithi060.stdout:(127/127): ceph-test-18.2.2-1256.gdc093b5e.el9. 2.2 MB/s | 40 MB 00:18 2024-04-26T10:41:00.541 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-04-26T10:41:00.541 INFO:teuthology.orchestra.run.smithi060.stdout:Total 7.1 MB/s | 189 MB 00:26 2024-04-26T10:41:00.629 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 65/131 2024-04-26T10:41:00.663 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 66/131 2024-04-26T10:41:00.766 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 67/131 2024-04-26T10:41:00.805 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 68/131 2024-04-26T10:41:00.990 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-0.3.21-2.el9.x86_64 69/131 2024-04-26T10:41:01.019 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 70/131 2024-04-26T10:41:01.100 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 71/131 2024-04-26T10:41:01.442 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-04-26T10:41:01.588 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-04-26T10:41:01.589 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-04-26T10:41:01.794 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 72/131 2024-04-26T10:41:01.913 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T10:41:03.206 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/131 2024-04-26T10:41:03.214 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-04-26T10:41:03.214 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-04-26T10:41:03.291 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 75/131 2024-04-26T10:41:03.319 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 76/131 2024-04-26T10:41:03.351 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 77/131 2024-04-26T10:41:03.438 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-04-26T10:41:03.531 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/131 2024-04-26T10:41:03.570 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/131 2024-04-26T10:41:03.624 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/131 2024-04-26T10:41:03.657 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/131 2024-04-26T10:41:03.665 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 78/131 2024-04-26T10:41:03.683 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/131 2024-04-26T10:41:03.706 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T10:41:03.725 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/131 2024-04-26T10:41:03.789 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T10:41:03.819 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 80/131 2024-04-26T10:41:03.855 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 81/131 2024-04-26T10:41:03.949 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-26T10:41:04.037 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/131 2024-04-26T10:41:04.037 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/131 2024-04-26T10:41:04.142 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T10:41:04.162 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/131 2024-04-26T10:41:04.261 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T10:41:04.278 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 82/131 2024-04-26T10:41:04.288 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/131 2024-04-26T10:41:04.293 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T10:41:04.301 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T10:41:04.322 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/131 2024-04-26T10:41:04.347 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/131 2024-04-26T10:41:04.372 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T10:41:04.384 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T10:41:04.390 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/131 2024-04-26T10:41:04.402 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 84/131 2024-04-26T10:41:04.433 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T10:41:04.461 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T10:41:04.563 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T10:41:04.587 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T10:41:04.697 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T10:41:04.708 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/131 2024-04-26T10:41:04.725 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 13/131 2024-04-26T10:41:04.760 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : liboath-2.6.7-2.el9.x86_64 14/131 2024-04-26T10:41:04.806 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T10:41:04.834 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/131 2024-04-26T10:41:04.867 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 16/131 2024-04-26T10:41:04.903 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 17/131 2024-04-26T10:41:04.934 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T10:41:04.958 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T10:41:04.973 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/131 2024-04-26T10:41:05.025 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 19/131 2024-04-26T10:41:05.049 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T10:41:05.056 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/131 2024-04-26T10:41:05.089 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T10:41:05.100 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 21/131 2024-04-26T10:41:05.117 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T10:41:05.176 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 22/131 2024-04-26T10:41:05.211 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 23/131 2024-04-26T10:41:05.218 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T10:41:05.243 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T10:41:05.254 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 24/131 2024-04-26T10:41:05.328 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 25/131 2024-04-26T10:41:05.369 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T10:41:05.406 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 13/131 2024-04-26T10:41:05.440 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : liboath-2.6.7-2.el9.x86_64 14/131 2024-04-26T10:41:05.461 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/131 2024-04-26T10:41:05.505 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/131 2024-04-26T10:41:05.523 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 27/131 2024-04-26T10:41:05.539 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 16/131 2024-04-26T10:41:05.567 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 17/131 2024-04-26T10:41:05.635 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/131 2024-04-26T10:41:05.697 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 19/131 2024-04-26T10:41:05.728 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/131 2024-04-26T10:41:05.764 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 21/131 2024-04-26T10:41:05.839 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 22/131 2024-04-26T10:41:05.875 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 23/131 2024-04-26T10:41:05.909 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 24/131 2024-04-26T10:41:05.982 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 25/131 2024-04-26T10:41:06.047 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rsa-4.9-2.el9.noarch 28/131 2024-04-26T10:41:06.114 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/131 2024-04-26T10:41:06.133 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 29/131 2024-04-26T10:41:06.169 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 27/131 2024-04-26T10:41:06.172 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 30/131 2024-04-26T10:41:06.210 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 31/131 2024-04-26T10:41:06.251 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 32/131 2024-04-26T10:41:06.402 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 33/131 2024-04-26T10:41:06.452 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 34/131 2024-04-26T10:41:06.559 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : re2-1:20211101-3.el9.x86_64 35/131 2024-04-26T10:41:06.565 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T10:41:06.589 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 36/131 2024-04-26T10:41:06.616 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T10:41:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 37/131 2024-04-26T10:41:06.683 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rsa-4.9-2.el9.noarch 28/131 2024-04-26T10:41:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 38/131 2024-04-26T10:41:06.740 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 39/131 2024-04-26T10:41:06.765 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 29/131 2024-04-26T10:41:06.776 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 40/131 2024-04-26T10:41:06.804 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 30/131 2024-04-26T10:41:06.822 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 41/131 2024-04-26T10:41:06.841 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 31/131 2024-04-26T10:41:06.868 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 42/131 2024-04-26T10:41:06.883 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 32/131 2024-04-26T10:41:06.910 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 43/131 2024-04-26T10:41:07.043 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 44/131 2024-04-26T10:41:07.046 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 33/131 2024-04-26T10:41:07.087 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 45/131 2024-04-26T10:41:07.109 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 34/131 2024-04-26T10:41:07.128 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 46/131 2024-04-26T10:41:07.163 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T10:41:07.203 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T10:41:07.215 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : re2-1:20211101-3.el9.x86_64 35/131 2024-04-26T10:41:07.221 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 47/131 2024-04-26T10:41:07.254 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 36/131 2024-04-26T10:41:07.262 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 48/131 2024-04-26T10:41:07.300 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T10:41:07.300 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T10:41:07.300 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T10:41:07.300 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:07.301 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 49/131 2024-04-26T10:41:07.308 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 37/131 2024-04-26T10:41:07.327 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 50/131 2024-04-26T10:41:07.330 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T10:41:07.354 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 51/131 2024-04-26T10:41:07.379 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : fmt-8.1.1-5.el9.x86_64 52/131 2024-04-26T10:41:07.380 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 38/131 2024-04-26T10:41:07.407 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 53/131 2024-04-26T10:41:07.413 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 39/131 2024-04-26T10:41:07.444 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 54/131 2024-04-26T10:41:07.449 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 40/131 2024-04-26T10:41:07.474 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 55/131 2024-04-26T10:41:07.496 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 41/131 2024-04-26T10:41:07.508 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 56/131 2024-04-26T10:41:07.541 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 42/131 2024-04-26T10:41:07.542 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 57/131 2024-04-26T10:41:07.575 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 58/131 2024-04-26T10:41:07.583 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 43/131 2024-04-26T10:41:07.610 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 59/131 2024-04-26T10:41:07.645 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 60/131 2024-04-26T10:41:07.692 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 61/131 2024-04-26T10:41:07.719 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 44/131 2024-04-26T10:41:07.760 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 45/131 2024-04-26T10:41:07.788 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-packaging-20.9-5.el9.noarch 62/131 2024-04-26T10:41:07.801 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 46/131 2024-04-26T10:41:07.837 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 63/131 2024-04-26T10:41:07.894 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 47/131 2024-04-26T10:41:07.935 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 48/131 2024-04-26T10:41:07.966 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 49/131 2024-04-26T10:41:07.992 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 50/131 2024-04-26T10:41:08.019 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 51/131 2024-04-26T10:41:08.053 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : fmt-8.1.1-5.el9.x86_64 52/131 2024-04-26T10:41:08.081 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 53/131 2024-04-26T10:41:08.118 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 54/131 2024-04-26T10:41:08.148 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 55/131 2024-04-26T10:41:08.182 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 56/131 2024-04-26T10:41:08.216 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 57/131 2024-04-26T10:41:08.257 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 58/131 2024-04-26T10:41:08.292 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 59/131 2024-04-26T10:41:08.326 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 60/131 2024-04-26T10:41:08.373 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 61/131 2024-04-26T10:41:08.479 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-packaging-20.9-5.el9.noarch 62/131 2024-04-26T10:41:08.528 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 63/131 2024-04-26T10:41:08.547 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 64/131 2024-04-26T10:41:08.593 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 65/131 2024-04-26T10:41:08.677 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 66/131 2024-04-26T10:41:08.754 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-04-26T10:41:08.824 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/131 2024-04-26T10:41:08.863 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/131 2024-04-26T10:41:08.892 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 67/131 2024-04-26T10:41:08.916 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/131 2024-04-26T10:41:08.936 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 68/131 2024-04-26T10:41:08.950 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/131 2024-04-26T10:41:08.975 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/131 2024-04-26T10:41:09.019 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/131 2024-04-26T10:41:09.121 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-0.3.21-2.el9.x86_64 69/131 2024-04-26T10:41:09.150 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 70/131 2024-04-26T10:41:09.227 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 71/131 2024-04-26T10:41:09.244 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 64/131 2024-04-26T10:41:09.334 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 65/131 2024-04-26T10:41:09.396 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/131 2024-04-26T10:41:09.409 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 66/131 2024-04-26T10:41:09.508 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 67/131 2024-04-26T10:41:09.518 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T10:41:09.551 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 68/131 2024-04-26T10:41:09.639 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T10:41:09.668 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T10:41:09.729 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-0.3.21-2.el9.x86_64 69/131 2024-04-26T10:41:09.758 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 70/131 2024-04-26T10:41:09.761 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T10:41:09.801 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T10:41:09.828 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T10:41:09.834 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 71/131 2024-04-26T10:41:09.862 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 72/131 2024-04-26T10:41:09.931 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T10:41:09.954 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T10:41:09.981 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T10:41:10.084 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 12/131 2024-04-26T10:41:10.117 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 13/131 2024-04-26T10:41:10.153 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : liboath-2.6.7-2.el9.x86_64 14/131 2024-04-26T10:41:10.228 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/131 2024-04-26T10:41:10.269 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 16/131 2024-04-26T10:41:10.295 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 17/131 2024-04-26T10:41:10.366 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/131 2024-04-26T10:41:10.428 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 19/131 2024-04-26T10:41:10.456 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/131 2024-04-26T10:41:10.469 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 72/131 2024-04-26T10:41:10.500 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 21/131 2024-04-26T10:41:10.577 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 22/131 2024-04-26T10:41:10.581 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T10:41:10.611 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 23/131 2024-04-26T10:41:10.654 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 24/131 2024-04-26T10:41:10.731 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 25/131 2024-04-26T10:41:10.877 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/131 2024-04-26T10:41:10.933 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 27/131 2024-04-26T10:41:11.199 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/131 2024-04-26T10:41:11.271 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 75/131 2024-04-26T10:41:11.299 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 76/131 2024-04-26T10:41:11.332 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 77/131 2024-04-26T10:41:11.487 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rsa-4.9-2.el9.noarch 28/131 2024-04-26T10:41:11.571 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 29/131 2024-04-26T10:41:11.623 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 30/131 2024-04-26T10:41:11.632 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 78/131 2024-04-26T10:41:11.662 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 31/131 2024-04-26T10:41:11.678 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T10:41:11.704 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 32/131 2024-04-26T10:41:11.791 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/131 2024-04-26T10:41:11.870 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 33/131 2024-04-26T10:41:11.878 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 75/131 2024-04-26T10:41:11.929 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 34/131 2024-04-26T10:41:11.935 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 76/131 2024-04-26T10:41:11.981 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 77/131 2024-04-26T10:41:12.020 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T10:41:12.040 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : re2-1:20211101-3.el9.x86_64 35/131 2024-04-26T10:41:12.050 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 80/131 2024-04-26T10:41:12.074 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 36/131 2024-04-26T10:41:12.086 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 81/131 2024-04-26T10:41:12.130 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 37/131 2024-04-26T10:41:12.205 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 38/131 2024-04-26T10:41:12.250 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 39/131 2024-04-26T10:41:12.281 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 78/131 2024-04-26T10:41:12.287 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 40/131 2024-04-26T10:41:12.327 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T10:41:12.343 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 41/131 2024-04-26T10:41:12.388 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 42/131 2024-04-26T10:41:12.402 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T10:41:12.429 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 43/131 2024-04-26T10:41:12.441 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 80/131 2024-04-26T10:41:12.477 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 81/131 2024-04-26T10:41:12.488 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 82/131 2024-04-26T10:41:12.523 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T10:41:12.575 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 44/131 2024-04-26T10:41:12.594 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T10:41:12.616 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 45/131 2024-04-26T10:41:12.616 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 84/131 2024-04-26T10:41:12.658 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 46/131 2024-04-26T10:41:12.773 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 47/131 2024-04-26T10:41:12.815 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 48/131 2024-04-26T10:41:12.855 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 49/131 2024-04-26T10:41:12.880 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 50/131 2024-04-26T10:41:12.898 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 82/131 2024-04-26T10:41:12.908 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 51/131 2024-04-26T10:41:12.931 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T10:41:12.941 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : fmt-8.1.1-5.el9.x86_64 52/131 2024-04-26T10:41:12.969 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 53/131 2024-04-26T10:41:13.003 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T10:41:13.007 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 54/131 2024-04-26T10:41:13.033 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 84/131 2024-04-26T10:41:13.046 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 55/131 2024-04-26T10:41:13.079 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 56/131 2024-04-26T10:41:13.113 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 57/131 2024-04-26T10:41:13.163 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 58/131 2024-04-26T10:41:13.197 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 59/131 2024-04-26T10:41:13.232 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 60/131 2024-04-26T10:41:13.280 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 61/131 2024-04-26T10:41:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-packaging-20.9-5.el9.noarch 62/131 2024-04-26T10:41:13.444 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 63/131 2024-04-26T10:41:14.203 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 64/131 2024-04-26T10:41:14.248 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 65/131 2024-04-26T10:41:14.282 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 66/131 2024-04-26T10:41:14.386 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 67/131 2024-04-26T10:41:14.424 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 68/131 2024-04-26T10:41:14.609 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-0.3.21-2.el9.x86_64 69/131 2024-04-26T10:41:14.647 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 70/131 2024-04-26T10:41:14.704 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T10:41:14.726 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 71/131 2024-04-26T10:41:14.746 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T10:41:15.056 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T10:41:15.088 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T10:41:15.268 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T10:41:15.316 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T10:41:15.415 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T10:41:15.415 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T10:41:15.415 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T10:41:15.415 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:15.417 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 72/131 2024-04-26T10:41:15.450 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T10:41:15.533 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T10:41:15.606 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T10:41:15.642 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T10:41:15.721 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T10:41:15.721 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T10:41:15.721 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T10:41:15.721 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:15.751 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T10:41:16.842 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/131 2024-04-26T10:41:16.926 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 75/131 2024-04-26T10:41:16.955 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 76/131 2024-04-26T10:41:16.988 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 77/131 2024-04-26T10:41:17.302 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 78/131 2024-04-26T10:41:17.350 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T10:41:17.433 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 79/131 2024-04-26T10:41:17.464 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 80/131 2024-04-26T10:41:17.491 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 81/131 2024-04-26T10:41:17.914 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 82/131 2024-04-26T10:41:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T10:41:18.024 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 83/131 2024-04-26T10:41:18.055 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 84/131 2024-04-26T10:41:18.874 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T10:41:18.875 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /sys 2024-04-26T10:41:18.875 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /proc 2024-04-26T10:41:18.875 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /mnt 2024-04-26T10:41:18.875 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /var/tmp 2024-04-26T10:41:18.875 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /home 2024-04-26T10:41:18.876 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /root 2024-04-26T10:41:18.876 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /tmp 2024-04-26T10:41:18.876 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:19.049 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T10:41:19.065 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T10:41:19.065 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:19.065 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T10:41:19.065 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:20.206 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T10:41:20.243 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T10:41:20.552 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T10:41:20.579 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T10:41:20.579 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:20.579 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T10:41:20.579 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T10:41:20.579 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T10:41:20.579 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:20.786 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T10:41:20.792 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 85/131 2024-04-26T10:41:20.809 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T10:41:20.810 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:20.810 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T10:41:20.810 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T10:41:20.810 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T10:41:20.810 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:20.830 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T10:41:20.936 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 86/131 2024-04-26T10:41:20.936 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T10:41:20.936 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T10:41:20.936 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:20.964 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T10:41:21.269 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T10:41:21.293 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T10:41:21.293 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:21.293 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T10:41:21.293 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T10:41:21.293 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T10:41:21.293 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:21.409 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : automake-1.16.2-8.el9.noarch 92/131 2024-04-26T10:41:21.467 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ply-3.11-14.el9.noarch 93/131 2024-04-26T10:41:21.531 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 94/131 2024-04-26T10:41:21.725 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 95/131 2024-04-26T10:41:21.780 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 96/131 2024-04-26T10:41:21.860 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 97/131 2024-04-26T10:41:21.959 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T10:41:22.102 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T10:41:22.146 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 100/131 2024-04-26T10:41:22.187 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/131 2024-04-26T10:41:22.214 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : fuse-2.9.9-15.el9.x86_64 102/131 2024-04-26T10:41:22.561 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T10:41:22.587 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T10:41:22.616 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 104/131 2024-04-26T10:41:22.682 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 105/131 2024-04-26T10:41:22.720 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T10:41:23.812 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T10:41:23.845 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T10:41:24.860 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T10:41:24.888 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T10:41:24.996 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T10:41:25.184 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 109/131 2024-04-26T10:41:25.215 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T10:41:25.239 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T10:41:25.239 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:25.239 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T10:41:25.239 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T10:41:25.240 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T10:41:25.240 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:25.291 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T10:41:25.302 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T10:41:25.400 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 112/131 2024-04-26T10:41:25.490 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 113/131 2024-04-26T10:41:26.232 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libtool-2.4.6-45.el9.x86_64 114/131 2024-04-26T10:41:26.261 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T10:41:26.284 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T10:41:26.284 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:26.284 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T10:41:26.284 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T10:41:26.284 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T10:41:26.285 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:26.327 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T10:41:26.351 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T10:41:26.351 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:26.351 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T10:41:26.351 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:26.358 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T10:41:26.358 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /sys 2024-04-26T10:41:26.358 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /proc 2024-04-26T10:41:26.358 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /mnt 2024-04-26T10:41:26.359 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /var/tmp 2024-04-26T10:41:26.359 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /home 2024-04-26T10:41:26.359 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /root 2024-04-26T10:41:26.359 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /tmp 2024-04-26T10:41:26.359 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:26.519 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T10:41:26.534 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T10:41:26.535 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:26.535 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T10:41:26.535 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:26.653 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T10:41:26.676 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T10:41:26.676 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:26.677 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T10:41:26.677 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T10:41:26.677 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T10:41:26.677 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:26.774 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T10:41:26.775 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /sys 2024-04-26T10:41:26.775 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /proc 2024-04-26T10:41:26.775 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /mnt 2024-04-26T10:41:26.775 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /var/tmp 2024-04-26T10:41:26.775 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /home 2024-04-26T10:41:26.775 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /root 2024-04-26T10:41:26.775 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /tmp 2024-04-26T10:41:26.775 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:26.927 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T10:41:26.942 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T10:41:26.942 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:26.942 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T10:41:26.942 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:27.989 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T10:41:28.014 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T10:41:28.014 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:28.014 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T10:41:28.014 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T10:41:28.014 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T10:41:28.015 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:28.214 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T10:41:28.237 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T10:41:28.237 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:28.237 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T10:41:28.237 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T10:41:28.237 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T10:41:28.237 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:28.389 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T10:41:28.414 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T10:41:28.414 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:28.414 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T10:41:28.414 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T10:41:28.414 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T10:41:28.414 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:28.614 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T10:41:28.636 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T10:41:28.637 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:28.637 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T10:41:28.637 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T10:41:28.637 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T10:41:28.637 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:28.674 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T10:41:28.696 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T10:41:28.696 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:28.696 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T10:41:28.696 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T10:41:28.697 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T10:41:28.697 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:28.795 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : automake-1.16.2-8.el9.noarch 92/131 2024-04-26T10:41:28.844 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ply-3.11-14.el9.noarch 93/131 2024-04-26T10:41:28.898 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 94/131 2024-04-26T10:41:29.073 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T10:41:29.080 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 95/131 2024-04-26T10:41:29.095 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T10:41:29.095 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:29.095 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T10:41:29.096 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T10:41:29.096 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T10:41:29.096 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:29.125 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 96/131 2024-04-26T10:41:29.196 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : automake-1.16.2-8.el9.noarch 92/131 2024-04-26T10:41:29.200 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 97/131 2024-04-26T10:41:29.243 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ply-3.11-14.el9.noarch 93/131 2024-04-26T10:41:29.289 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T10:41:29.306 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 94/131 2024-04-26T10:41:29.437 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T10:41:29.482 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 100/131 2024-04-26T10:41:29.492 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 95/131 2024-04-26T10:41:29.523 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/131 2024-04-26T10:41:29.549 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 96/131 2024-04-26T10:41:29.550 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : fuse-2.9.9-15.el9.x86_64 102/131 2024-04-26T10:41:29.627 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 97/131 2024-04-26T10:41:29.723 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T10:41:29.859 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T10:41:29.907 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 100/131 2024-04-26T10:41:29.940 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/131 2024-04-26T10:41:29.967 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : fuse-2.9.9-15.el9.x86_64 102/131 2024-04-26T10:41:29.971 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T10:41:30.007 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T10:41:30.036 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 104/131 2024-04-26T10:41:30.100 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 105/131 2024-04-26T10:41:30.122 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T10:41:30.407 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T10:41:30.432 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T10:41:30.455 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 104/131 2024-04-26T10:41:30.509 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 105/131 2024-04-26T10:41:30.532 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 118/131 2024-04-26T10:41:30.538 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T10:41:30.573 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 119/131 2024-04-26T10:41:30.614 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 120/131 2024-04-26T10:41:30.646 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 121/131 2024-04-26T10:41:30.672 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 122/131 2024-04-26T10:41:31.155 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T10:41:31.191 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T10:41:31.574 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T10:41:31.587 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 123/131 2024-04-26T10:41:31.615 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T10:41:31.681 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 124/131 2024-04-26T10:41:31.724 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 125/131 2024-04-26T10:41:31.823 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flex-2.6.4-9.el9.x86_64 126/131 2024-04-26T10:41:31.860 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : bison-3.7.4-5.el9.x86_64 127/131 2024-04-26T10:41:31.860 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T10:41:31.936 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T10:41:31.960 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T10:41:31.960 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T10:41:32.055 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T10:41:32.127 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T10:41:32.158 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T10:41:32.183 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T10:41:32.283 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T10:41:32.431 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 109/131 2024-04-26T10:41:32.476 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T10:41:32.499 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T10:41:32.499 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:32.500 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T10:41:32.500 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T10:41:32.500 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T10:41:32.500 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:32.544 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T10:41:32.555 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T10:41:32.578 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T10:41:32.607 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T10:41:32.634 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 87/131 2024-04-26T10:41:32.635 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /sys 2024-04-26T10:41:32.635 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /proc 2024-04-26T10:41:32.635 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /mnt 2024-04-26T10:41:32.635 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /var/tmp 2024-04-26T10:41:32.635 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /home 2024-04-26T10:41:32.635 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /root 2024-04-26T10:41:32.635 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /tmp 2024-04-26T10:41:32.635 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:32.649 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 112/131 2024-04-26T10:41:32.700 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 113/131 2024-04-26T10:41:32.707 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T10:41:32.818 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T10:41:32.834 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 88/131 2024-04-26T10:41:32.834 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:32.834 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T10:41:32.834 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:32.857 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 109/131 2024-04-26T10:41:32.889 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T10:41:32.911 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T10:41:32.912 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:32.912 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T10:41:32.912 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T10:41:32.912 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T10:41:32.912 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:32.960 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T10:41:32.971 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T10:41:33.065 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 112/131 2024-04-26T10:41:33.108 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 113/131 2024-04-26T10:41:33.404 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libtool-2.4.6-45.el9.x86_64 114/131 2024-04-26T10:41:33.438 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T10:41:33.461 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T10:41:33.461 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:33.461 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T10:41:33.461 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T10:41:33.461 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T10:41:33.461 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:33.505 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T10:41:33.527 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T10:41:33.527 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:33.527 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T10:41:33.527 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:33.814 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T10:41:33.817 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libtool-2.4.6-45.el9.x86_64 114/131 2024-04-26T10:41:33.836 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T10:41:33.836 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:33.836 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T10:41:33.836 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T10:41:33.836 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T10:41:33.837 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:33.846 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T10:41:33.869 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T10:41:33.869 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:33.869 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T10:41:33.869 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T10:41:33.869 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T10:41:33.869 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:33.929 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T10:41:33.950 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T10:41:33.951 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:33.951 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T10:41:33.951 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:34.239 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T10:41:34.261 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T10:41:34.261 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:34.261 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T10:41:34.261 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T10:41:34.261 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T10:41:34.262 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:34.346 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T10:41:34.373 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 89/131 2024-04-26T10:41:34.373 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:34.374 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T10:41:34.374 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T10:41:34.374 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T10:41:34.374 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:34.589 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T10:41:34.613 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 90/131 2024-04-26T10:41:34.613 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:34.613 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T10:41:34.613 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T10:41:34.613 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T10:41:34.613 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:35.081 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T10:41:35.105 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 91/131 2024-04-26T10:41:35.105 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:35.105 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T10:41:35.105 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T10:41:35.105 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T10:41:35.105 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:35.212 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : automake-1.16.2-8.el9.noarch 92/131 2024-04-26T10:41:35.270 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ply-3.11-14.el9.noarch 93/131 2024-04-26T10:41:35.334 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 94/131 2024-04-26T10:41:35.529 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 95/131 2024-04-26T10:41:35.582 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 96/131 2024-04-26T10:41:35.665 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 97/131 2024-04-26T10:41:35.762 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T10:41:35.905 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T10:41:35.949 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 100/131 2024-04-26T10:41:35.989 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/131 2024-04-26T10:41:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : fuse-2.9.9-15.el9.x86_64 102/131 2024-04-26T10:41:36.458 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T10:41:36.492 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 103/131 2024-04-26T10:41:36.520 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 104/131 2024-04-26T10:41:36.586 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 105/131 2024-04-26T10:41:36.614 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T10:41:37.101 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T10:41:37.101 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 1/131 2024-04-26T10:41:37.101 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2/131 2024-04-26T10:41:37.101 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 3/131 2024-04-26T10:41:37.101 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 4/131 2024-04-26T10:41:37.101 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/131 2024-04-26T10:41:37.101 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 6/131 2024-04-26T10:41:37.101 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 7/131 2024-04-26T10:41:37.101 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T10:41:37.102 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T10:41:37.102 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T10:41:37.102 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T10:41:37.102 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 12/131 2024-04-26T10:41:37.102 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 13/131 2024-04-26T10:41:37.102 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 14/131 2024-04-26T10:41:37.102 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 15/131 2024-04-26T10:41:37.102 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 16/131 2024-04-26T10:41:37.102 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 17/131 2024-04-26T10:41:37.102 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 18/131 2024-04-26T10:41:37.102 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/131 2024-04-26T10:41:37.102 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 20/131 2024-04-26T10:41:37.102 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 21/131 2024-04-26T10:41:37.103 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 22/131 2024-04-26T10:41:37.103 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 23/131 2024-04-26T10:41:37.103 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 24/131 2024-04-26T10:41:37.103 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 25/131 2024-04-26T10:41:37.103 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 26/131 2024-04-26T10:41:37.103 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 27/131 2024-04-26T10:41:37.103 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/131 2024-04-26T10:41:37.103 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 29/131 2024-04-26T10:41:37.103 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 30/131 2024-04-26T10:41:37.103 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/131 2024-04-26T10:41:37.103 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/131 2024-04-26T10:41:37.103 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 33/131 2024-04-26T10:41:37.103 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/131 2024-04-26T10:41:37.103 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 35/131 2024-04-26T10:41:37.104 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 36/131 2024-04-26T10:41:37.104 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/131 2024-04-26T10:41:37.104 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/131 2024-04-26T10:41:37.104 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/131 2024-04-26T10:41:37.104 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/131 2024-04-26T10:41:37.104 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/131 2024-04-26T10:41:37.104 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/131 2024-04-26T10:41:37.104 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/131 2024-04-26T10:41:37.104 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/131 2024-04-26T10:41:37.104 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/131 2024-04-26T10:41:37.104 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/131 2024-04-26T10:41:37.104 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/131 2024-04-26T10:41:37.104 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/131 2024-04-26T10:41:37.104 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 49/131 2024-04-26T10:41:37.105 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/131 2024-04-26T10:41:37.105 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/131 2024-04-26T10:41:37.105 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/131 2024-04-26T10:41:37.105 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/131 2024-04-26T10:41:37.105 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/131 2024-04-26T10:41:37.105 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/131 2024-04-26T10:41:37.105 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/131 2024-04-26T10:41:37.105 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/131 2024-04-26T10:41:37.105 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/131 2024-04-26T10:41:37.105 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/131 2024-04-26T10:41:37.105 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/131 2024-04-26T10:41:37.105 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/131 2024-04-26T10:41:37.105 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 62/131 2024-04-26T10:41:37.106 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 63/131 2024-04-26T10:41:37.106 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 64/131 2024-04-26T10:41:37.106 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/131 2024-04-26T10:41:37.106 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 66/131 2024-04-26T10:41:37.106 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/131 2024-04-26T10:41:37.106 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/131 2024-04-26T10:41:37.106 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/131 2024-04-26T10:41:37.106 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/131 2024-04-26T10:41:37.106 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/131 2024-04-26T10:41:37.106 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/131 2024-04-26T10:41:37.106 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T10:41:37.106 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/131 2024-04-26T10:41:37.106 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/131 2024-04-26T10:41:37.107 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/131 2024-04-26T10:41:37.107 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 77/131 2024-04-26T10:41:37.110 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 78/131 2024-04-26T10:41:37.111 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 79/131 2024-04-26T10:41:37.111 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/131 2024-04-26T10:41:37.111 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 81/131 2024-04-26T10:41:37.111 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 82/131 2024-04-26T10:41:37.111 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 83/131 2024-04-26T10:41:37.111 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 84/131 2024-04-26T10:41:37.111 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/131 2024-04-26T10:41:37.111 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 86/131 2024-04-26T10:41:37.112 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 87/131 2024-04-26T10:41:37.112 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/131 2024-04-26T10:41:37.112 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 89/131 2024-04-26T10:41:37.112 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 90/131 2024-04-26T10:41:37.112 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 91/131 2024-04-26T10:41:37.112 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 92/131 2024-04-26T10:41:37.112 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 93/131 2024-04-26T10:41:37.112 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 94/131 2024-04-26T10:41:37.112 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 95/131 2024-04-26T10:41:37.112 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 96/131 2024-04-26T10:41:37.112 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 97/131 2024-04-26T10:41:37.112 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T10:41:37.112 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T10:41:37.112 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 100/131 2024-04-26T10:41:37.113 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 101/131 2024-04-26T10:41:37.113 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 102/131 2024-04-26T10:41:37.113 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 103/131 2024-04-26T10:41:37.113 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 104/131 2024-04-26T10:41:37.113 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 105/131 2024-04-26T10:41:37.113 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 106/131 2024-04-26T10:41:37.113 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 107/131 2024-04-26T10:41:37.113 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 108/131 2024-04-26T10:41:37.113 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 109/131 2024-04-26T10:41:37.113 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 110/131 2024-04-26T10:41:37.113 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 111/131 2024-04-26T10:41:37.113 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 112/131 2024-04-26T10:41:37.113 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 113/131 2024-04-26T10:41:37.114 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 114/131 2024-04-26T10:41:37.114 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 115/131 2024-04-26T10:41:37.114 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 116/131 2024-04-26T10:41:37.114 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 117/131 2024-04-26T10:41:37.114 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 118/131 2024-04-26T10:41:37.114 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 119/131 2024-04-26T10:41:37.114 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 120/131 2024-04-26T10:41:37.114 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 121/131 2024-04-26T10:41:37.114 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : re2-1:20211101-3.el9.x86_64 122/131 2024-04-26T10:41:37.114 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 123/131 2024-04-26T10:41:37.114 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 124/131 2024-04-26T10:41:37.114 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 125/131 2024-04-26T10:41:37.114 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 126/131 2024-04-26T10:41:37.114 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 127/131 2024-04-26T10:41:37.115 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 128/131 2024-04-26T10:41:37.115 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T10:41:37.115 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 130/131 2024-04-26T10:41:37.484 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 118/131 2024-04-26T10:41:37.525 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 119/131 2024-04-26T10:41:37.566 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 120/131 2024-04-26T10:41:37.598 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 121/131 2024-04-26T10:41:37.625 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 122/131 2024-04-26T10:41:37.708 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 106/131 2024-04-26T10:41:37.749 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T10:41:37.909 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 118/131 2024-04-26T10:41:37.951 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 119/131 2024-04-26T10:41:37.990 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 120/131 2024-04-26T10:41:38.015 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 121/131 2024-04-26T10:41:38.041 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 122/131 2024-04-26T10:41:38.447 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 123/131 2024-04-26T10:41:38.542 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 124/131 2024-04-26T10:41:38.582 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 125/131 2024-04-26T10:41:38.663 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flex-2.6.4-9.el9.x86_64 126/131 2024-04-26T10:41:38.695 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : bison-3.7.4-5.el9.x86_64 127/131 2024-04-26T10:41:38.696 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T10:41:38.763 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T10:41:38.765 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 107/131 2024-04-26T10:41:38.788 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T10:41:38.788 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T10:41:38.799 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T10:41:38.861 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 123/131 2024-04-26T10:41:38.877 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T10:41:38.906 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 108/131 2024-04-26T10:41:38.942 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 124/131 2024-04-26T10:41:38.947 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T10:41:38.974 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 125/131 2024-04-26T10:41:39.071 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 109/131 2024-04-26T10:41:39.073 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flex-2.6.4-9.el9.x86_64 126/131 2024-04-26T10:41:39.101 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T10:41:39.102 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T10:41:39.102 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:39.102 INFO:teuthology.orchestra.run.smithi049.stdout:Upgraded: 2024-04-26T10:41:39.102 INFO:teuthology.orchestra.run.smithi049.stdout: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.102 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.102 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T10:41:39.102 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T10:41:39.102 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-04-26T10:41:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T10:41:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T10:41:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T10:41:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:39.103 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T10:41:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T10:41:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T10:41:39.104 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T10:41:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T10:41:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: fmt-8.1.1-5.el9.x86_64 2024-04-26T10:41:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T10:41:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T10:41:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T10:41:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T10:41:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T10:41:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T10:41:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T10:41:39.105 INFO:teuthology.orchestra.run.smithi049.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T10:41:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T10:41:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T10:41:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T10:41:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T10:41:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T10:41:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T10:41:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T10:41:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T10:41:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T10:41:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T10:41:39.106 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T10:41:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T10:41:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T10:41:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T10:41:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T10:41:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T10:41:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T10:41:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T10:41:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T10:41:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T10:41:39.107 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T10:41:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T10:41:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T10:41:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T10:41:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T10:41:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T10:41:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T10:41:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T10:41:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T10:41:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T10:41:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T10:41:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T10:41:39.109 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T10:41:39.109 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T10:41:39.109 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T10:41:39.109 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T10:41:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T10:41:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T10:41:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T10:41:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T10:41:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T10:41:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T10:41:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T10:41:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T10:41:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T10:41:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T10:41:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T10:41:39.110 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T10:41:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T10:41:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T10:41:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T10:41:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T10:41:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T10:41:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T10:41:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T10:41:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T10:41:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T10:41:39.111 INFO:teuthology.orchestra.run.smithi049.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T10:41:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T10:41:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T10:41:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T10:41:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T10:41:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T10:41:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T10:41:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T10:41:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T10:41:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T10:41:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T10:41:39.112 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T10:41:39.113 INFO:teuthology.orchestra.run.smithi049.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T10:41:39.113 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:39.113 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-04-26T10:41:39.114 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : bison-3.7.4-5.el9.x86_64 127/131 2024-04-26T10:41:39.114 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T10:41:39.126 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 110/131 2024-04-26T10:41:39.126 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:39.126 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T10:41:39.126 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T10:41:39.126 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T10:41:39.126 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:39.177 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T10:41:39.188 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 111/131 2024-04-26T10:41:39.196 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T10:41:39.221 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T10:41:39.221 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T10:41:39.286 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 112/131 2024-04-26T10:41:39.322 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T10:41:39.335 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 113/131 2024-04-26T10:41:39.384 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T10:41:39.457 DEBUG:teuthology.parallel:result is None 2024-04-26T10:41:40.078 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libtool-2.4.6-45.el9.x86_64 114/131 2024-04-26T10:41:40.105 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T10:41:40.128 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 115/131 2024-04-26T10:41:40.129 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:40.129 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T10:41:40.129 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T10:41:40.129 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T10:41:40.129 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:40.172 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T10:41:40.195 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 116/131 2024-04-26T10:41:40.196 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:40.196 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T10:41:40.196 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:40.498 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T10:41:40.521 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 117/131 2024-04-26T10:41:40.521 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T10:41:40.521 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T10:41:40.521 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T10:41:40.521 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T10:41:40.521 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:43.825 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T10:41:43.826 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 1/131 2024-04-26T10:41:43.826 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2/131 2024-04-26T10:41:43.826 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 3/131 2024-04-26T10:41:43.826 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 4/131 2024-04-26T10:41:43.826 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/131 2024-04-26T10:41:43.826 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 6/131 2024-04-26T10:41:43.826 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 7/131 2024-04-26T10:41:43.826 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T10:41:43.826 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T10:41:43.826 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T10:41:43.826 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T10:41:43.827 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 12/131 2024-04-26T10:41:43.827 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 13/131 2024-04-26T10:41:43.827 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 14/131 2024-04-26T10:41:43.827 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 15/131 2024-04-26T10:41:43.827 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 16/131 2024-04-26T10:41:43.827 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 17/131 2024-04-26T10:41:43.827 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 18/131 2024-04-26T10:41:43.827 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/131 2024-04-26T10:41:43.827 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 20/131 2024-04-26T10:41:43.827 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 21/131 2024-04-26T10:41:43.827 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 22/131 2024-04-26T10:41:43.827 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 23/131 2024-04-26T10:41:43.827 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 24/131 2024-04-26T10:41:43.828 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 25/131 2024-04-26T10:41:43.828 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 26/131 2024-04-26T10:41:43.828 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 27/131 2024-04-26T10:41:43.828 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/131 2024-04-26T10:41:43.828 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 29/131 2024-04-26T10:41:43.828 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 30/131 2024-04-26T10:41:43.837 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/131 2024-04-26T10:41:43.837 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/131 2024-04-26T10:41:43.838 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 33/131 2024-04-26T10:41:43.838 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/131 2024-04-26T10:41:43.838 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 35/131 2024-04-26T10:41:43.838 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 36/131 2024-04-26T10:41:43.838 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/131 2024-04-26T10:41:43.838 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/131 2024-04-26T10:41:43.838 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/131 2024-04-26T10:41:43.838 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/131 2024-04-26T10:41:43.838 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/131 2024-04-26T10:41:43.838 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/131 2024-04-26T10:41:43.838 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/131 2024-04-26T10:41:43.838 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/131 2024-04-26T10:41:43.838 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/131 2024-04-26T10:41:43.839 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/131 2024-04-26T10:41:43.839 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/131 2024-04-26T10:41:43.839 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/131 2024-04-26T10:41:43.839 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 49/131 2024-04-26T10:41:43.839 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/131 2024-04-26T10:41:43.839 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/131 2024-04-26T10:41:43.839 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/131 2024-04-26T10:41:43.839 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/131 2024-04-26T10:41:43.839 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/131 2024-04-26T10:41:43.839 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/131 2024-04-26T10:41:43.840 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/131 2024-04-26T10:41:43.840 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/131 2024-04-26T10:41:43.840 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/131 2024-04-26T10:41:43.840 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/131 2024-04-26T10:41:43.840 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/131 2024-04-26T10:41:43.840 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/131 2024-04-26T10:41:43.840 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 62/131 2024-04-26T10:41:43.840 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 63/131 2024-04-26T10:41:43.840 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 64/131 2024-04-26T10:41:43.840 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/131 2024-04-26T10:41:43.840 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 66/131 2024-04-26T10:41:43.840 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/131 2024-04-26T10:41:43.840 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/131 2024-04-26T10:41:43.841 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/131 2024-04-26T10:41:43.841 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/131 2024-04-26T10:41:43.841 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/131 2024-04-26T10:41:43.841 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/131 2024-04-26T10:41:43.841 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T10:41:43.841 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/131 2024-04-26T10:41:43.842 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/131 2024-04-26T10:41:43.842 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/131 2024-04-26T10:41:43.842 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 77/131 2024-04-26T10:41:43.842 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 78/131 2024-04-26T10:41:43.842 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 79/131 2024-04-26T10:41:43.842 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/131 2024-04-26T10:41:43.842 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 81/131 2024-04-26T10:41:43.843 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 82/131 2024-04-26T10:41:43.843 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 83/131 2024-04-26T10:41:43.843 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 84/131 2024-04-26T10:41:43.843 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/131 2024-04-26T10:41:43.843 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 86/131 2024-04-26T10:41:43.843 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 87/131 2024-04-26T10:41:43.843 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/131 2024-04-26T10:41:43.843 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 89/131 2024-04-26T10:41:43.843 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 90/131 2024-04-26T10:41:43.843 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 91/131 2024-04-26T10:41:43.843 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 92/131 2024-04-26T10:41:43.843 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 93/131 2024-04-26T10:41:43.843 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 94/131 2024-04-26T10:41:43.843 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 95/131 2024-04-26T10:41:43.844 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 96/131 2024-04-26T10:41:43.844 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 97/131 2024-04-26T10:41:43.844 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T10:41:43.844 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T10:41:43.844 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 100/131 2024-04-26T10:41:43.844 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 101/131 2024-04-26T10:41:43.844 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 102/131 2024-04-26T10:41:43.844 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 103/131 2024-04-26T10:41:43.844 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 104/131 2024-04-26T10:41:43.844 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 105/131 2024-04-26T10:41:43.844 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 106/131 2024-04-26T10:41:43.844 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 107/131 2024-04-26T10:41:43.844 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 108/131 2024-04-26T10:41:43.844 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 109/131 2024-04-26T10:41:43.845 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 110/131 2024-04-26T10:41:43.845 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 111/131 2024-04-26T10:41:43.845 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 112/131 2024-04-26T10:41:43.845 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 113/131 2024-04-26T10:41:43.845 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 114/131 2024-04-26T10:41:43.845 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 115/131 2024-04-26T10:41:43.845 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 116/131 2024-04-26T10:41:43.845 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 117/131 2024-04-26T10:41:43.845 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 118/131 2024-04-26T10:41:43.845 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 119/131 2024-04-26T10:41:43.845 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 120/131 2024-04-26T10:41:43.845 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 121/131 2024-04-26T10:41:43.845 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : re2-1:20211101-3.el9.x86_64 122/131 2024-04-26T10:41:43.845 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 123/131 2024-04-26T10:41:43.846 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 124/131 2024-04-26T10:41:43.846 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 125/131 2024-04-26T10:41:43.846 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 126/131 2024-04-26T10:41:43.846 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 127/131 2024-04-26T10:41:43.846 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 128/131 2024-04-26T10:41:43.846 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T10:41:43.846 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 130/131 2024-04-26T10:41:44.393 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 118/131 2024-04-26T10:41:44.435 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 119/131 2024-04-26T10:41:44.493 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 120/131 2024-04-26T10:41:44.524 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 121/131 2024-04-26T10:41:44.550 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 122/131 2024-04-26T10:41:44.583 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T10:41:44.583 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 1/131 2024-04-26T10:41:44.584 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2/131 2024-04-26T10:41:44.584 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 3/131 2024-04-26T10:41:44.584 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 4/131 2024-04-26T10:41:44.584 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/131 2024-04-26T10:41:44.584 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 6/131 2024-04-26T10:41:44.584 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 7/131 2024-04-26T10:41:44.584 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T10:41:44.584 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T10:41:44.584 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T10:41:44.584 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T10:41:44.584 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 12/131 2024-04-26T10:41:44.584 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 13/131 2024-04-26T10:41:44.584 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 14/131 2024-04-26T10:41:44.584 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 15/131 2024-04-26T10:41:44.585 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 16/131 2024-04-26T10:41:44.585 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 17/131 2024-04-26T10:41:44.585 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 18/131 2024-04-26T10:41:44.585 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/131 2024-04-26T10:41:44.585 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 20/131 2024-04-26T10:41:44.585 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 21/131 2024-04-26T10:41:44.585 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 22/131 2024-04-26T10:41:44.585 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 23/131 2024-04-26T10:41:44.585 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 24/131 2024-04-26T10:41:44.585 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 25/131 2024-04-26T10:41:44.585 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 26/131 2024-04-26T10:41:44.585 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 27/131 2024-04-26T10:41:44.599 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/131 2024-04-26T10:41:44.599 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 29/131 2024-04-26T10:41:44.600 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 30/131 2024-04-26T10:41:44.600 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/131 2024-04-26T10:41:44.600 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/131 2024-04-26T10:41:44.600 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 33/131 2024-04-26T10:41:44.600 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/131 2024-04-26T10:41:44.600 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 35/131 2024-04-26T10:41:44.600 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 36/131 2024-04-26T10:41:44.600 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/131 2024-04-26T10:41:44.600 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/131 2024-04-26T10:41:44.600 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/131 2024-04-26T10:41:44.600 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/131 2024-04-26T10:41:44.600 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/131 2024-04-26T10:41:44.600 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/131 2024-04-26T10:41:44.601 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/131 2024-04-26T10:41:44.601 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/131 2024-04-26T10:41:44.601 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/131 2024-04-26T10:41:44.601 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/131 2024-04-26T10:41:44.601 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/131 2024-04-26T10:41:44.601 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/131 2024-04-26T10:41:44.601 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 49/131 2024-04-26T10:41:44.601 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/131 2024-04-26T10:41:44.601 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/131 2024-04-26T10:41:44.601 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/131 2024-04-26T10:41:44.601 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/131 2024-04-26T10:41:44.601 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/131 2024-04-26T10:41:44.601 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/131 2024-04-26T10:41:44.601 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/131 2024-04-26T10:41:44.602 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/131 2024-04-26T10:41:44.602 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/131 2024-04-26T10:41:44.602 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/131 2024-04-26T10:41:44.602 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/131 2024-04-26T10:41:44.602 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/131 2024-04-26T10:41:44.602 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 62/131 2024-04-26T10:41:44.602 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 63/131 2024-04-26T10:41:44.602 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 64/131 2024-04-26T10:41:44.602 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/131 2024-04-26T10:41:44.602 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 66/131 2024-04-26T10:41:44.602 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/131 2024-04-26T10:41:44.602 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/131 2024-04-26T10:41:44.602 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/131 2024-04-26T10:41:44.603 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/131 2024-04-26T10:41:44.603 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/131 2024-04-26T10:41:44.603 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/131 2024-04-26T10:41:44.603 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T10:41:44.603 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/131 2024-04-26T10:41:44.603 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/131 2024-04-26T10:41:44.603 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/131 2024-04-26T10:41:44.603 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 77/131 2024-04-26T10:41:44.603 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 78/131 2024-04-26T10:41:44.603 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 79/131 2024-04-26T10:41:44.603 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/131 2024-04-26T10:41:44.603 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 81/131 2024-04-26T10:41:44.604 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 82/131 2024-04-26T10:41:44.604 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 83/131 2024-04-26T10:41:44.604 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 84/131 2024-04-26T10:41:44.604 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/131 2024-04-26T10:41:44.604 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 86/131 2024-04-26T10:41:44.604 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 87/131 2024-04-26T10:41:44.604 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/131 2024-04-26T10:41:44.604 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 89/131 2024-04-26T10:41:44.604 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 90/131 2024-04-26T10:41:44.604 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 91/131 2024-04-26T10:41:44.604 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 92/131 2024-04-26T10:41:44.604 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 93/131 2024-04-26T10:41:44.604 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 94/131 2024-04-26T10:41:44.605 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 95/131 2024-04-26T10:41:44.605 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 96/131 2024-04-26T10:41:44.605 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 97/131 2024-04-26T10:41:44.605 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T10:41:44.605 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T10:41:44.605 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 100/131 2024-04-26T10:41:44.605 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 101/131 2024-04-26T10:41:44.605 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 102/131 2024-04-26T10:41:44.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 103/131 2024-04-26T10:41:44.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 104/131 2024-04-26T10:41:44.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 105/131 2024-04-26T10:41:44.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 106/131 2024-04-26T10:41:44.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 107/131 2024-04-26T10:41:44.606 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 108/131 2024-04-26T10:41:44.607 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 109/131 2024-04-26T10:41:44.607 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 110/131 2024-04-26T10:41:44.607 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 111/131 2024-04-26T10:41:44.607 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 112/131 2024-04-26T10:41:44.607 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 113/131 2024-04-26T10:41:44.607 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 114/131 2024-04-26T10:41:44.608 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 115/131 2024-04-26T10:41:44.608 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 116/131 2024-04-26T10:41:44.608 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 117/131 2024-04-26T10:41:44.608 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 118/131 2024-04-26T10:41:44.608 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 119/131 2024-04-26T10:41:44.608 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 120/131 2024-04-26T10:41:44.608 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 121/131 2024-04-26T10:41:44.609 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : re2-1:20211101-3.el9.x86_64 122/131 2024-04-26T10:41:44.609 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 123/131 2024-04-26T10:41:44.609 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 124/131 2024-04-26T10:41:44.609 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 125/131 2024-04-26T10:41:44.609 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 126/131 2024-04-26T10:41:44.609 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 127/131 2024-04-26T10:41:44.610 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 128/131 2024-04-26T10:41:44.610 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T10:41:44.610 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 130/131 2024-04-26T10:41:45.466 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 123/131 2024-04-26T10:41:45.568 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 124/131 2024-04-26T10:41:45.610 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 125/131 2024-04-26T10:41:45.693 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flex-2.6.4-9.el9.x86_64 126/131 2024-04-26T10:41:45.722 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : bison-3.7.4-5.el9.x86_64 127/131 2024-04-26T10:41:45.722 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T10:41:45.771 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T10:41:45.771 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:45.771 INFO:teuthology.orchestra.run.smithi087.stdout:Upgraded: 2024-04-26T10:41:45.771 INFO:teuthology.orchestra.run.smithi087.stdout: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.771 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.771 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T10:41:45.771 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T10:41:45.771 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-04-26T10:41:45.771 INFO:teuthology.orchestra.run.smithi087.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T10:41:45.771 INFO:teuthology.orchestra.run.smithi087.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T10:41:45.772 INFO:teuthology.orchestra.run.smithi087.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T10:41:45.772 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.772 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.772 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.772 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.772 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:45.772 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.772 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.772 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.772 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:45.772 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:45.773 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:45.773 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:45.773 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:45.773 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.773 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.773 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:45.773 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.773 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.773 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.773 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:45.773 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:45.773 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T10:41:45.773 INFO:teuthology.orchestra.run.smithi087.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T10:41:45.774 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T10:41:45.774 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T10:41:45.774 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T10:41:45.774 INFO:teuthology.orchestra.run.smithi087.stdout: fmt-8.1.1-5.el9.x86_64 2024-04-26T10:41:45.774 INFO:teuthology.orchestra.run.smithi087.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T10:41:45.774 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T10:41:45.774 INFO:teuthology.orchestra.run.smithi087.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T10:41:45.774 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T10:41:45.774 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T10:41:45.774 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.774 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.774 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.774 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T10:41:45.774 INFO:teuthology.orchestra.run.smithi087.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T10:41:45.775 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T10:41:45.775 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T10:41:45.775 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T10:41:45.775 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.775 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.775 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T10:41:45.775 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.775 INFO:teuthology.orchestra.run.smithi087.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T10:41:45.775 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T10:41:45.775 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T10:41:45.776 INFO:teuthology.orchestra.run.smithi087.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T10:41:45.776 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T10:41:45.776 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T10:41:45.776 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T10:41:45.776 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T10:41:45.776 INFO:teuthology.orchestra.run.smithi087.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T10:41:45.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T10:41:45.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T10:41:45.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T10:41:45.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T10:41:45.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.776 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.777 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.777 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T10:41:45.777 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T10:41:45.777 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T10:41:45.777 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T10:41:45.777 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T10:41:45.777 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T10:41:45.777 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T10:41:45.777 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T10:41:45.777 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T10:41:45.777 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T10:41:45.777 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T10:41:45.778 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T10:41:45.778 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T10:41:45.778 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T10:41:45.778 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T10:41:45.778 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T10:41:45.778 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T10:41:45.778 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T10:41:45.778 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T10:41:45.778 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T10:41:45.778 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T10:41:45.778 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T10:41:45.778 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T10:41:45.778 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T10:41:45.779 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T10:41:45.779 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T10:41:45.779 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T10:41:45.779 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T10:41:45.779 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T10:41:45.779 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T10:41:45.779 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T10:41:45.779 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T10:41:45.779 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T10:41:45.780 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T10:41:45.780 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.780 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.780 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T10:41:45.780 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T10:41:45.780 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T10:41:45.780 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.780 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T10:41:45.780 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T10:41:45.780 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T10:41:45.780 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T10:41:45.780 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T10:41:45.780 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T10:41:45.780 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T10:41:45.781 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T10:41:45.781 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T10:41:45.781 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T10:41:45.781 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T10:41:45.781 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.781 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.781 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:45.781 INFO:teuthology.orchestra.run.smithi087.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T10:41:45.781 INFO:teuthology.orchestra.run.smithi087.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T10:41:45.781 INFO:teuthology.orchestra.run.smithi087.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T10:41:45.781 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T10:41:45.781 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T10:41:45.781 INFO:teuthology.orchestra.run.smithi087.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T10:41:45.781 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:45.782 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-04-26T10:41:45.806 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 128/131 2024-04-26T10:41:45.839 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T10:41:45.839 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T10:41:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 130/131 2024-04-26T10:41:46.014 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T10:41:46.156 DEBUG:teuthology.parallel:result is None 2024-04-26T10:41:46.488 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T10:41:46.488 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:46.488 INFO:teuthology.orchestra.run.smithi195.stdout:Upgraded: 2024-04-26T10:41:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T10:41:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T10:41:46.489 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-26T10:41:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T10:41:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T10:41:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T10:41:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.490 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.490 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:46.490 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.490 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.490 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.490 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:46.490 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:46.490 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T10:41:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T10:41:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T10:41:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T10:41:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T10:41:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: fmt-8.1.1-5.el9.x86_64 2024-04-26T10:41:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T10:41:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T10:41:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T10:41:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T10:41:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T10:41:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T10:41:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T10:41:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T10:41:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T10:41:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T10:41:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T10:41:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T10:41:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T10:41:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T10:41:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T10:41:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T10:41:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T10:41:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T10:41:46.495 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T10:41:46.495 INFO:teuthology.orchestra.run.smithi195.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T10:41:46.495 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T10:41:46.495 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T10:41:46.495 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T10:41:46.495 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T10:41:46.495 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.495 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.496 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.496 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T10:41:46.496 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T10:41:46.496 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T10:41:46.496 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T10:41:46.496 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T10:41:46.496 INFO:teuthology.orchestra.run.smithi195.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T10:41:46.496 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T10:41:46.497 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T10:41:46.497 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T10:41:46.497 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T10:41:46.497 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T10:41:46.497 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T10:41:46.497 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T10:41:46.497 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T10:41:46.498 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T10:41:46.498 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T10:41:46.498 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T10:41:46.498 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T10:41:46.498 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T10:41:46.498 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T10:41:46.499 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T10:41:46.499 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T10:41:46.499 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T10:41:46.499 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T10:41:46.499 INFO:teuthology.orchestra.run.smithi195.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T10:41:46.499 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T10:41:46.499 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T10:41:46.500 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T10:41:46.500 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T10:41:46.500 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T10:41:46.500 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T10:41:46.500 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T10:41:46.500 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T10:41:46.501 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T10:41:46.501 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.501 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.501 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T10:41:46.501 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T10:41:46.501 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T10:41:46.501 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.501 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T10:41:46.502 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T10:41:46.502 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T10:41:46.502 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T10:41:46.502 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T10:41:46.502 INFO:teuthology.orchestra.run.smithi195.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T10:41:46.502 INFO:teuthology.orchestra.run.smithi195.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T10:41:46.502 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T10:41:46.503 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T10:41:46.503 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T10:41:46.503 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T10:41:46.503 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.503 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.503 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:46.504 INFO:teuthology.orchestra.run.smithi195.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T10:41:46.504 INFO:teuthology.orchestra.run.smithi195.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T10:41:46.504 INFO:teuthology.orchestra.run.smithi195.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T10:41:46.504 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T10:41:46.504 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T10:41:46.505 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T10:41:46.505 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:46.505 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-26T10:41:46.862 DEBUG:teuthology.parallel:result is None 2024-04-26T10:41:50.982 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T10:41:50.982 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 1/131 2024-04-26T10:41:50.982 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2/131 2024-04-26T10:41:50.982 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 3/131 2024-04-26T10:41:50.982 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 4/131 2024-04-26T10:41:50.982 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/131 2024-04-26T10:41:50.982 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 6/131 2024-04-26T10:41:50.982 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 7/131 2024-04-26T10:41:50.982 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 8/131 2024-04-26T10:41:50.983 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 9/131 2024-04-26T10:41:50.983 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 10/131 2024-04-26T10:41:50.983 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 11/131 2024-04-26T10:41:50.983 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 12/131 2024-04-26T10:41:50.983 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_ 13/131 2024-04-26T10:41:50.983 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 14/131 2024-04-26T10:41:50.983 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 15/131 2024-04-26T10:41:50.983 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_6 16/131 2024-04-26T10:41:50.983 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86 17/131 2024-04-26T10:41:50.983 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 18/131 2024-04-26T10:41:50.983 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/131 2024-04-26T10:41:50.983 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9. 20/131 2024-04-26T10:41:50.984 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_6 21/131 2024-04-26T10:41:50.984 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 22/131 2024-04-26T10:41:50.984 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 23/131 2024-04-26T10:41:50.984 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 24/131 2024-04-26T10:41:50.984 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 25/131 2024-04-26T10:41:50.984 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 26/131 2024-04-26T10:41:50.984 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 27/131 2024-04-26T10:41:50.984 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/131 2024-04-26T10:41:50.984 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noa 29/131 2024-04-26T10:41:50.984 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.n 30/131 2024-04-26T10:41:50.984 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/131 2024-04-26T10:41:50.984 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/131 2024-04-26T10:41:50.984 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 33/131 2024-04-26T10:41:50.984 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/131 2024-04-26T10:41:50.985 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 35/131 2024-04-26T10:41:50.985 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 36/131 2024-04-26T10:41:50.985 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/131 2024-04-26T10:41:50.985 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 38/131 2024-04-26T10:41:50.985 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 39/131 2024-04-26T10:41:50.985 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/131 2024-04-26T10:41:50.985 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/131 2024-04-26T10:41:50.985 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/131 2024-04-26T10:41:50.985 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/131 2024-04-26T10:41:50.986 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 44/131 2024-04-26T10:41:50.986 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 45/131 2024-04-26T10:41:50.986 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : automake-1.16.2-8.el9.noarch 46/131 2024-04-26T10:41:50.986 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : bison-3.7.4-5.el9.x86_64 47/131 2024-04-26T10:41:50.986 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 48/131 2024-04-26T10:41:50.987 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 49/131 2024-04-26T10:41:50.987 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flex-2.6.4-9.el9.x86_64 50/131 2024-04-26T10:41:50.987 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 51/131 2024-04-26T10:41:50.987 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 52/131 2024-04-26T10:41:50.987 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 53/131 2024-04-26T10:41:50.987 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 54/131 2024-04-26T10:41:50.987 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 55/131 2024-04-26T10:41:50.987 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 56/131 2024-04-26T10:41:50.987 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 57/131 2024-04-26T10:41:50.987 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 58/131 2024-04-26T10:41:50.987 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 59/131 2024-04-26T10:41:50.987 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 60/131 2024-04-26T10:41:50.988 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 61/131 2024-04-26T10:41:50.988 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 62/131 2024-04-26T10:41:50.988 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 63/131 2024-04-26T10:41:50.988 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 64/131 2024-04-26T10:41:50.988 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/131 2024-04-26T10:41:50.988 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 66/131 2024-04-26T10:41:50.988 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/131 2024-04-26T10:41:50.988 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/131 2024-04-26T10:41:50.988 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/131 2024-04-26T10:41:50.988 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/131 2024-04-26T10:41:50.988 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/131 2024-04-26T10:41:50.988 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/131 2024-04-26T10:41:50.988 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/131 2024-04-26T10:41:50.989 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/131 2024-04-26T10:41:50.989 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/131 2024-04-26T10:41:50.989 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/131 2024-04-26T10:41:50.989 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 77/131 2024-04-26T10:41:50.989 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 78/131 2024-04-26T10:41:50.989 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 79/131 2024-04-26T10:41:50.989 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/131 2024-04-26T10:41:50.989 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 81/131 2024-04-26T10:41:50.989 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 82/131 2024-04-26T10:41:50.989 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 83/131 2024-04-26T10:41:50.989 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 84/131 2024-04-26T10:41:50.989 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/131 2024-04-26T10:41:50.989 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 86/131 2024-04-26T10:41:50.990 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 87/131 2024-04-26T10:41:50.990 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/131 2024-04-26T10:41:50.990 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 89/131 2024-04-26T10:41:50.990 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 90/131 2024-04-26T10:41:50.990 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 91/131 2024-04-26T10:41:50.990 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 92/131 2024-04-26T10:41:50.990 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 93/131 2024-04-26T10:41:50.990 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 94/131 2024-04-26T10:41:50.990 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 95/131 2024-04-26T10:41:50.990 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 96/131 2024-04-26T10:41:50.990 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 97/131 2024-04-26T10:41:50.990 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 98/131 2024-04-26T10:41:50.990 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 99/131 2024-04-26T10:41:50.991 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 100/131 2024-04-26T10:41:50.991 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 101/131 2024-04-26T10:41:50.991 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 102/131 2024-04-26T10:41:50.991 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 103/131 2024-04-26T10:41:50.991 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 104/131 2024-04-26T10:41:50.991 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 105/131 2024-04-26T10:41:50.991 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 106/131 2024-04-26T10:41:50.991 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 107/131 2024-04-26T10:41:50.991 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 108/131 2024-04-26T10:41:50.991 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 109/131 2024-04-26T10:41:50.991 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 110/131 2024-04-26T10:41:50.991 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 111/131 2024-04-26T10:41:50.991 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 112/131 2024-04-26T10:41:50.991 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 113/131 2024-04-26T10:41:50.991 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 114/131 2024-04-26T10:41:50.992 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 115/131 2024-04-26T10:41:50.992 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 116/131 2024-04-26T10:41:50.992 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 117/131 2024-04-26T10:41:50.992 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 118/131 2024-04-26T10:41:50.992 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 119/131 2024-04-26T10:41:50.992 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 120/131 2024-04-26T10:41:50.992 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 121/131 2024-04-26T10:41:50.992 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : re2-1:20211101-3.el9.x86_64 122/131 2024-04-26T10:41:50.992 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 123/131 2024-04-26T10:41:50.992 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 124/131 2024-04-26T10:41:50.992 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 125/131 2024-04-26T10:41:50.992 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 126/131 2024-04-26T10:41:50.992 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 127/131 2024-04-26T10:41:50.992 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 128/131 2024-04-26T10:41:50.993 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 129/131 2024-04-26T10:41:50.993 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 130/131 2024-04-26T10:41:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 131/131 2024-04-26T10:41:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:52.861 INFO:teuthology.orchestra.run.smithi060.stdout:Upgraded: 2024-04-26T10:41:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: librados2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T10:41:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T10:41:52.862 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-04-26T10:41:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T10:41:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T10:41:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T10:41:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el9.noarch 2024-04-26T10:41:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T10:41:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T10:41:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T10:41:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T10:41:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T10:41:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: fmt-8.1.1-5.el9.x86_64 2024-04-26T10:41:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T10:41:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T10:41:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T10:41:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T10:41:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T10:41:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T10:41:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T10:41:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T10:41:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T10:41:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T10:41:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T10:41:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T10:41:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T10:41:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T10:41:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T10:41:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T10:41:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T10:41:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T10:41:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T10:41:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T10:41:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T10:41:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T10:41:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T10:41:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T10:41:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.867 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T10:41:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T10:41:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T10:41:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T10:41:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T10:41:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T10:41:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T10:41:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T10:41:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T10:41:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T10:41:52.868 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T10:41:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T10:41:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T10:41:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T10:41:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T10:41:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T10:41:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T10:41:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T10:41:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T10:41:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T10:41:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T10:41:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T10:41:52.869 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T10:41:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T10:41:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T10:41:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T10:41:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T10:41:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T10:41:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T10:41:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T10:41:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T10:41:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T10:41:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T10:41:52.870 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T10:41:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T10:41:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T10:41:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T10:41:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T10:41:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T10:41:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T10:41:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T10:41:52.871 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T10:41:52.872 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T10:41:52.872 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T10:41:52.872 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T10:41:52.872 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T10:41:52.872 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T10:41:52.872 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T10:41:52.872 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.872 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.872 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el9.x86_64 2024-04-26T10:41:52.872 INFO:teuthology.orchestra.run.smithi060.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T10:41:52.872 INFO:teuthology.orchestra.run.smithi060.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T10:41:52.873 INFO:teuthology.orchestra.run.smithi060.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T10:41:52.873 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T10:41:52.873 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T10:41:52.873 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T10:41:52.873 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:52.873 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-04-26T10:41:53.257 DEBUG:teuthology.parallel:result is None 2024-04-26T10:41:53.258 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T10:41:53.475 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T10:41:53.502 INFO:teuthology.orchestra.run.smithi049.stdout:18.2.2-1256.gdc093b5e.el9 2024-04-26T10:41:53.503 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el9 2024-04-26T10:41:53.503 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T10:41:53.504 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T10:41:53.717 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T10:41:53.739 INFO:teuthology.orchestra.run.smithi060.stdout:18.2.2-1256.gdc093b5e.el9 2024-04-26T10:41:53.740 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el9 2024-04-26T10:41:53.740 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T10:41:53.742 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T10:41:53.880 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T10:41:53.905 INFO:teuthology.orchestra.run.smithi087.stdout:18.2.2-1256.gdc093b5e.el9 2024-04-26T10:41:53.906 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el9 2024-04-26T10:41:53.906 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T10:41:53.908 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T10:41:54.123 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T10:41:54.150 INFO:teuthology.orchestra.run.smithi195.stdout:18.2.2-1256.gdc093b5e.el9 2024-04-26T10:41:54.150 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el9 2024-04-26T10:41:54.150 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T10:41:54.152 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T10:41:54.152 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-04-26T10:41:54.152 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T10:41:54.185 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-26T10:41:54.185 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T10:41:54.211 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-26T10:41:54.212 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T10:41:54.242 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T10:41:54.242 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T10:41:54.272 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T10:41:54.273 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-04-26T10:41:54.273 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T10:41:54.302 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T10:41:54.370 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-26T10:41:54.370 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T10:41:54.395 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T10:41:54.460 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-26T10:41:54.460 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T10:41:54.488 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T10:41:54.556 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T10:41:54.557 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T10:41:54.585 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T10:41:54.653 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T10:41:54.653 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-04-26T10:41:54.653 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T10:41:54.683 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T10:41:54.751 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-26T10:41:54.751 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T10:41:54.776 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T10:41:54.840 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-26T10:41:54.841 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T10:41:54.868 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T10:41:54.936 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T10:41:54.936 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T10:41:54.964 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T10:41:55.032 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T10:41:55.032 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-04-26T10:41:55.032 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T10:41:55.062 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T10:41:55.132 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-26T10:41:55.133 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T10:41:55.157 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T10:41:55.223 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-26T10:41:55.223 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T10:41:55.251 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T10:41:55.319 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T10:41:55.319 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T10:41:55.348 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T10:41:55.415 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T10:41:55.514 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T10:41:55.514 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 777 /var/log/ceph 2024-04-26T10:41:55.517 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 777 /var/log/ceph 2024-04-26T10:41:55.519 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 777 /var/log/ceph 2024-04-26T10:41:55.523 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 777 /var/log/ceph 2024-04-26T10:41:55.550 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T10:41:55.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T10:41:55.586 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T10:41:55.589 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T10:41:55.592 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T10:41:55.620 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T10:41:55.620 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T10:41:55.655 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T10:41:55.659 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T10:41:55.661 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T10:41:55.700 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T10:41:55.700 INFO:tasks.ceph:config {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T10:41:55.701 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674130', 'branch': 'reef', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/centos_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7674130', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 1136, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'sleep_before_teardown': 0, 'subset': '0/4', 'suite': 'powercycle', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6', 'targets': {'smithi049.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOJUzKorpIzBh48FyBZ7SBxE2BcZLHjTOQdSWqQAk23XlKpp5RZ1vjE+w2I22jONW/Hg+l/861aI1nUHkoChOxU=', 'smithi060.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNTBBJBdBqzDeJqFT4w+cEANxAj3N41v3fSt2XjtPdbwSssGVQ2U5F//t5DkSn4pe6N+5b4mpfObC19rk5t4E1I=', 'smithi087.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFG/wxjmta13/75JjU46qzEk4mJzw3DkFH/EHsHZjnfzh6PsI9yZ7V45SQhETOZ7glKadC3ocGs8+68hLFJ3+5E=', 'smithi195.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMIXc8UXBnDxQI9wTv+D8RLry5RznOHz7oKtY+wC2iXGd88jc7/sIMdwWXX+3ITGJdPnxuKhmkKwdRq255kEVxI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_22:32:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T10:41:55.701 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T10:41:55.725 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T10:41:55.728 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T10:41:55.730 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T10:41:55.747 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T10:41:55.784 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T10:41:55.786 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T10:41:55.789 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T10:41:55.816 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-26T10:41:55.816 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T10:41:55.865 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T10:41:55.865 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_1 2024-04-26T10:41:55.920 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T10:41:55.921 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:41:55.921 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-04-26T10:41:55.921 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:41:55.921 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:41:55.921 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-04-26 10:41:46.400639758 +0000 2024-04-26T10:41:55.921 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-04-26 10:39:52.791031184 +0000 2024-04-26T10:41:55.922 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-04-26 10:39:52.791031184 +0000 2024-04-26T10:41:55.922 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-04-26 10:39:52.791031184 +0000 2024-04-26T10:41:55.922 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T10:41:55.983 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-04-26T10:41:55.983 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-04-26T10:41:55.983 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 9.9877e-05 s, 5.1 MB/s 2024-04-26T10:41:55.984 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T10:41:56.041 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_2 2024-04-26T10:41:56.097 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T10:41:56.097 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:41:56.097 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-26T10:41:56.097 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:41:56.097 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:41:56.097 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-04-26 10:41:46.400639758 +0000 2024-04-26T10:41:56.097 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-04-26 10:39:53.140027832 +0000 2024-04-26T10:41:56.097 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-04-26 10:39:53.140027832 +0000 2024-04-26T10:41:56.098 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-04-26 10:39:53.140027832 +0000 2024-04-26T10:41:56.098 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T10:41:56.160 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-04-26T10:41:56.161 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-04-26T10:41:56.161 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 8.9772e-05 s, 5.7 MB/s 2024-04-26T10:41:56.163 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T10:41:56.219 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_3 2024-04-26T10:41:56.274 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T10:41:56.274 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:41:56.275 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-26T10:41:56.275 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:41:56.275 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:41:56.275 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-04-26 10:41:46.401639748 +0000 2024-04-26T10:41:56.275 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-04-26 10:39:53.469024672 +0000 2024-04-26T10:41:56.275 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-04-26 10:39:53.469024672 +0000 2024-04-26T10:41:56.275 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-04-26 10:39:53.469024672 +0000 2024-04-26T10:41:56.275 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T10:41:56.337 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-04-26T10:41:56.338 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-04-26T10:41:56.338 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 9.4569e-05 s, 5.4 MB/s 2024-04-26T10:41:56.339 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T10:41:56.395 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_4 2024-04-26T10:41:56.450 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T10:41:56.450 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:41:56.450 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-04-26T10:41:56.450 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:41:56.450 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:41:56.450 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-04-26 10:41:46.401639748 +0000 2024-04-26T10:41:56.450 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-04-26 10:39:53.809021408 +0000 2024-04-26T10:41:56.450 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-04-26 10:39:53.809021408 +0000 2024-04-26T10:41:56.450 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-04-26 10:39:53.809021408 +0000 2024-04-26T10:41:56.450 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T10:41:56.513 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-04-26T10:41:56.513 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-04-26T10:41:56.513 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 8.911e-05 s, 5.7 MB/s 2024-04-26T10:41:56.514 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T10:41:56.571 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T10:41:56.571 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-26T10:41:56.571 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T10:41:56.590 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T10:41:56.590 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_1 2024-04-26T10:41:56.647 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T10:41:56.648 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:41:56.648 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-26T10:41:56.648 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:41:56.648 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:41:56.648 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-04-26 10:41:39.300321363 +0000 2024-04-26T10:41:56.648 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-04-26 10:39:50.172319885 +0000 2024-04-26T10:41:56.648 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-04-26 10:39:50.172319885 +0000 2024-04-26T10:41:56.648 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-04-26 10:39:50.172319885 +0000 2024-04-26T10:41:56.649 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T10:41:56.713 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-04-26T10:41:56.714 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-04-26T10:41:56.714 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000269137 s, 1.9 MB/s 2024-04-26T10:41:56.715 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T10:41:56.773 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_2 2024-04-26T10:41:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T10:41:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:41:56.830 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-26T10:41:56.830 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:41:56.830 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:41:56.830 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-04-26 10:41:39.300321363 +0000 2024-04-26T10:41:56.830 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-04-26 10:39:50.516311879 +0000 2024-04-26T10:41:56.830 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-04-26 10:39:50.516311879 +0000 2024-04-26T10:41:56.830 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-04-26 10:39:50.516311879 +0000 2024-04-26T10:41:56.831 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T10:41:56.895 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-04-26T10:41:56.895 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-04-26T10:41:56.895 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000206414 s, 2.5 MB/s 2024-04-26T10:41:56.897 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T10:41:56.954 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_3 2024-04-26T10:41:57.010 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T10:41:57.011 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:41:57.011 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-26T10:41:57.011 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:41:57.011 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:41:57.011 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-04-26 10:41:39.300321363 +0000 2024-04-26T10:41:57.011 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-04-26 10:39:50.866303733 +0000 2024-04-26T10:41:57.011 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-04-26 10:39:50.866303733 +0000 2024-04-26T10:41:57.011 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-04-26 10:39:50.866303733 +0000 2024-04-26T10:41:57.011 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T10:41:57.075 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-04-26T10:41:57.075 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-04-26T10:41:57.075 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.00022125 s, 2.3 MB/s 2024-04-26T10:41:57.079 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T10:41:57.137 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_4 2024-04-26T10:41:57.194 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T10:41:57.194 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:41:57.194 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-26T10:41:57.195 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:41:57.195 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:41:57.195 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-04-26 10:41:39.301321340 +0000 2024-04-26T10:41:57.195 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-04-26 10:39:51.204295867 +0000 2024-04-26T10:41:57.195 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-04-26 10:39:51.204295867 +0000 2024-04-26T10:41:57.195 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-04-26 10:39:51.204295867 +0000 2024-04-26T10:41:57.195 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T10:41:57.259 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-04-26T10:41:57.259 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-04-26T10:41:57.259 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000200828 s, 2.5 MB/s 2024-04-26T10:41:57.261 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T10:41:57.318 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-26T10:41:57.318 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T10:41:57.318 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T10:41:57.337 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T10:41:57.337 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_1 2024-04-26T10:41:57.396 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T10:41:57.396 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:41:57.396 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-26T10:41:57.396 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:41:57.396 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:41:57.396 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-26 10:41:39.757121109 +0000 2024-04-26T10:41:57.396 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-26 10:39:50.141618770 +0000 2024-04-26T10:41:57.396 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-26 10:39:50.141618770 +0000 2024-04-26T10:41:57.396 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-26 10:39:50.141618770 +0000 2024-04-26T10:41:57.397 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T10:41:57.462 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-26T10:41:57.462 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-26T10:41:57.462 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.00011614 s, 4.4 MB/s 2024-04-26T10:41:57.463 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T10:41:57.521 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_2 2024-04-26T10:41:57.578 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T10:41:57.578 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:41:57.578 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-26T10:41:57.578 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:41:57.578 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:41:57.578 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-26 10:41:39.758121090 +0000 2024-04-26T10:41:57.578 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-26 10:39:50.475612452 +0000 2024-04-26T10:41:57.578 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-26 10:39:50.475612452 +0000 2024-04-26T10:41:57.578 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-26 10:39:50.475612452 +0000 2024-04-26T10:41:57.579 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T10:41:57.642 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-26T10:41:57.642 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-26T10:41:57.642 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000109217 s, 4.7 MB/s 2024-04-26T10:41:57.643 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T10:41:57.702 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_3 2024-04-26T10:41:57.758 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T10:41:57.758 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:41:57.758 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-26T10:41:57.758 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:41:57.758 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:41:57.758 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-26 10:41:39.758121090 +0000 2024-04-26T10:41:57.758 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-26 10:39:50.810606116 +0000 2024-04-26T10:41:57.758 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-26 10:39:50.810606116 +0000 2024-04-26T10:41:57.758 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-26 10:39:50.810606116 +0000 2024-04-26T10:41:57.759 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T10:41:57.823 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-26T10:41:57.823 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-26T10:41:57.823 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 8.8344e-05 s, 5.8 MB/s 2024-04-26T10:41:57.825 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T10:41:57.880 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_4 2024-04-26T10:41:57.936 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T10:41:57.936 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:41:57.936 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-04-26T10:41:57.936 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:41:57.936 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:41:57.936 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-26 10:41:39.758121090 +0000 2024-04-26T10:41:57.936 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-26 10:39:51.145599779 +0000 2024-04-26T10:41:57.936 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-26 10:39:51.145599779 +0000 2024-04-26T10:41:57.936 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-26 10:39:51.145599779 +0000 2024-04-26T10:41:57.937 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T10:41:57.999 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-26T10:41:57.999 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-26T10:41:57.999 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000105565 s, 4.9 MB/s 2024-04-26T10:41:58.000 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T10:41:58.056 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-26T10:41:58.056 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi060.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi195.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-26T10:41:58.056 INFO:tasks.ceph:Generating config... 2024-04-26T10:41:58.057 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T10:41:58.057 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T10:41:58.057 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T10:41:58.057 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T10:41:58.057 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T10:41:58.057 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-26T10:41:58.057 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-26T10:41:58.058 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T10:41:58.058 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T10:41:58.058 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T10:41:58.058 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T10:41:58.058 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T10:41:58.058 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T10:41:58.058 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T10:41:58.058 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T10:41:58.058 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T10:41:58.058 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T10:41:58.059 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-26T10:41:58.059 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T10:41:58.059 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-26T10:41:58.059 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2024-04-26T10:41:58.059 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T10:41:58.059 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T10:41:58.059 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T10:41:58.114 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T10:41:58.117 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T10:41:58.163 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T10:41:58.190 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.49'), ('mon.b', '[v2:172.21.15.49:3301,v1:172.21.15.49:6790]'), ('mon.c', '[v2:172.21.15.49:3302,v1:172.21.15.49:6791]')] 2024-04-26T10:41:58.194 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.49,[v2:172.21.15.49:3301,v1:172.21.15.49:6790],[v2:172.21.15.49:3302,v1:172.21.15.49:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2024-04-26T10:41:58.196 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-04-26T10:41:58.196 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T10:41:58.246 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.49 --addv b '[v2:172.21.15.49:3301,v1:172.21.15.49:6790]' --addv c '[v2:172.21.15.49:3302,v1:172.21.15.49:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:41:58.333 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:41:58.333 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: generated fsid 9837de44-a9e8-4979-adc4-611f3ddc44ce 2024-04-26T10:41:58.334 INFO:teuthology.orchestra.run.smithi049.stdout:setting min_mon_release = pacific 2024-04-26T10:41:58.334 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 0 2024-04-26T10:41:58.334 INFO:teuthology.orchestra.run.smithi049.stdout:fsid 9837de44-a9e8-4979-adc4-611f3ddc44ce 2024-04-26T10:41:58.334 INFO:teuthology.orchestra.run.smithi049.stdout:last_changed 2024-04-26T10:41:58.333349+0000 2024-04-26T10:41:58.334 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-04-26T10:41:58.333349+0000 2024-04-26T10:41:58.334 INFO:teuthology.orchestra.run.smithi049.stdout:min_mon_release 16 (pacific) 2024-04-26T10:41:58.334 INFO:teuthology.orchestra.run.smithi049.stdout:election_strategy: 1 2024-04-26T10:41:58.334 INFO:teuthology.orchestra.run.smithi049.stdout:0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.a 2024-04-26T10:41:58.334 INFO:teuthology.orchestra.run.smithi049.stdout:1: [v2:172.21.15.49:3301/0,v1:172.21.15.49:6790/0] mon.b 2024-04-26T10:41:58.334 INFO:teuthology.orchestra.run.smithi049.stdout:2: [v2:172.21.15.49:3302/0,v1:172.21.15.49:6791/0] mon.c 2024-04-26T10:41:58.334 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T10:41:58.336 DEBUG:teuthology.orchestra.run.smithi049:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T10:41:58.351 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9837de44-a9e8-4979-adc4-611f3ddc44ce... 2024-04-26T10:41:58.351 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T10:41:58.393 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T10:41:58.395 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T10:41:58.400 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T10:41:58.432 INFO:teuthology.orchestra.run.smithi049.stdout:[global] 2024-04-26T10:41:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: chdir = "" 2024-04-26T10:41:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T10:41:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: auth supported = cephx 2024-04-26T10:41:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: filestore xattr use omap = true 2024-04-26T10:41:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: mon clock drift allowed = 1.000 2024-04-26T10:41:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: osd crush chooseleaf type = 0 2024-04-26T10:41:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: auth debug = true 2024-04-26T10:41:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on old message = true 2024-04-26T10:41:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: ms die on bug = true 2024-04-26T10:41:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T10:41:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: mon pg warn max object skew = 0 2024-04-26T10:41:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T10:41:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T10:41:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default size = 2 2024-04-26T10:41:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow primary affinity = true 2024-04-26T10:41:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd allow pg remap = true 2024-04-26T10:41:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on legacy crush tunables = false 2024-04-26T10:41:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on crush straw calc version zero = false 2024-04-26T10:41:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on no sortbitwise = false 2024-04-26T10:41:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on osd down out interval zero = false 2024-04-26T10:41:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: mon warn on too few osds = false 2024-04-26T10:41:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T10:41:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T10:41:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: mon_allow_pool_size_one = true 2024-04-26T10:41:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T10:41:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: osd default data pool replay window = 5 2024-04-26T10:41:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: mon allow pool delete = true 2024-04-26T10:41:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: mon cluster log file level = debug 2024-04-26T10:41:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: debug asserts on shutdown = true 2024-04-26T10:41:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: mon health detail to clog = false 2024-04-26T10:41:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: mon host = "172.21.15.49,[v2:172.21.15.49:3301,v1:172.21.15.49:6790],[v2:172.21.15.49:3302,v1:172.21.15.49:6791]" 2024-04-26T10:41:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: fsid = 9837de44-a9e8-4979-adc4-611f3ddc44ce 2024-04-26T10:41:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.436 INFO:teuthology.orchestra.run.smithi049.stdout:[osd] 2024-04-26T10:41:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: osd journal size = 100 2024-04-26T10:41:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub load threshold = 5.0 2024-04-26T10:41:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: osd scrub max interval = 600 2024-04-26T10:41:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: osd mclock profile = high_recovery_ops 2024-04-26T10:41:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: osd recover clone overlap = true 2024-04-26T10:41:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: osd recovery max chunk = 1048576 2024-04-26T10:41:58.437 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.437 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug shutdown = true 2024-04-26T10:41:58.437 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug op order = true 2024-04-26T10:41:58.437 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug verify stray on activate = true 2024-04-26T10:41:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: osd open classes on start = true 2024-04-26T10:41:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug pg log writeout = true 2024-04-26T10:41:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: osd deep scrub update digest min age = 30 2024-04-26T10:41:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: osd map max advance = 10 2024-04-26T10:41:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: journal zero on create = true 2024-04-26T10:41:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: filestore ondisk finisher threads = 3 2024-04-26T10:41:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: filestore apply finisher threads = 3 2024-04-26T10:41:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: bdev debug aio = true 2024-04-26T10:41:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: osd debug misdirected ops = true 2024-04-26T10:41:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: bdev async discard = True 2024-04-26T10:41:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: bdev enable discard = True 2024-04-26T10:41:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore block size = 96636764160 2024-04-26T10:41:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: bluestore fsck on mount = True 2024-04-26T10:41:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluefs = 1/20 2024-04-26T10:41:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: debug bluestore = 1/20 2024-04-26T10:41:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-04-26T10:41:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: debug osd = 20 2024-04-26T10:41:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: debug rocksdb = 4/10 2024-04-26T10:41:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T10:41:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd full ratio = 0.9 2024-04-26T10:41:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd nearfull ratio = 0.8 2024-04-26T10:41:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: osd blocked scrub grace period = 3600 2024-04-26T10:41:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: osd failsafe full ratio = 0.95 2024-04-26T10:41:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: osd max markdown count = 1000 2024-04-26T10:41:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: osd memory target = 1610612736 2024-04-26T10:41:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: osd objectstore = bluestore 2024-04-26T10:41:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.440 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr] 2024-04-26T10:41:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-04-26T10:41:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: debug mgr = 20 2024-04-26T10:41:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2024-04-26T10:41:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2024-04-26T10:41:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:41:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:41:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: mgr/telemetry/nag = false 2024-04-26T10:41:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.441 INFO:teuthology.orchestra.run.smithi049.stdout:[mon] 2024-04-26T10:41:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: debug ms = 1 2024-04-26T10:41:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: debug mon = 20 2024-04-26T10:41:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: debug paxos = 20 2024-04-26T10:41:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: debug auth = 20 2024-04-26T10:41:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: mon data avail warn = 5 2024-04-26T10:41:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: mon mgr mkfs grace = 240 2024-04-26T10:41:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:41:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd reporter subtree level = osd 2024-04-26T10:41:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: mon osd prime pg temp = true 2024-04-26T10:41:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:41:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T10:41:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T10:41:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T10:41:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T10:41:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T10:41:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T10:41:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: # 1m isn't quite enough 2024-04-26T10:41:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: mon_down_mkfs_grace = 2m 2024-04-26T10:41:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: mon_warn_on_filestore_osds = false 2024-04-26T10:41:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:41:58.443 INFO:teuthology.orchestra.run.smithi049.stdout:[client] 2024-04-26T10:41:58.443 INFO:teuthology.orchestra.run.smithi049.stdout: rgw cache enabled = true 2024-04-26T10:41:58.443 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable ops log = true 2024-04-26T10:41:58.443 INFO:teuthology.orchestra.run.smithi049.stdout: rgw enable usage log = true 2024-04-26T10:41:58.443 INFO:teuthology.orchestra.run.smithi049.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T10:41:58.443 INFO:teuthology.orchestra.run.smithi049.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T10:41:58.443 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.a] 2024-04-26T10:41:58.443 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.b] 2024-04-26T10:41:58.443 INFO:teuthology.orchestra.run.smithi049.stdout:[mon.c] 2024-04-26T10:41:58.443 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2024-04-26T10:41:58.444 INFO:teuthology.orchestra.run.smithi060.stdout:[global] 2024-04-26T10:41:58.444 INFO:teuthology.orchestra.run.smithi060.stdout: chdir = "" 2024-04-26T10:41:58.444 INFO:teuthology.orchestra.run.smithi060.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T10:41:58.444 INFO:teuthology.orchestra.run.smithi060.stdout: auth supported = cephx 2024-04-26T10:41:58.444 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.445 INFO:teuthology.orchestra.run.smithi060.stdout: filestore xattr use omap = true 2024-04-26T10:41:58.445 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.446 INFO:teuthology.orchestra.run.smithi060.stdout: mon clock drift allowed = 1.000 2024-04-26T10:41:58.446 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.446 INFO:teuthology.orchestra.run.smithi060.stdout: osd crush chooseleaf type = 0 2024-04-26T10:41:58.446 INFO:teuthology.orchestra.run.smithi060.stdout: auth debug = true 2024-04-26T10:41:58.446 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.446 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on old message = true 2024-04-26T10:41:58.446 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on bug = true 2024-04-26T10:41:58.446 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.446 INFO:teuthology.orchestra.run.smithi060.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T10:41:58.447 INFO:teuthology.orchestra.run.smithi060.stdout: mon pg warn max object skew = 0 2024-04-26T10:41:58.447 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.447 INFO:teuthology.orchestra.run.smithi060.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T10:41:58.447 INFO:teuthology.orchestra.run.smithi060.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T10:41:58.447 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.447 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default size = 2 2024-04-26T10:41:58.447 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.447 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow primary affinity = true 2024-04-26T10:41:58.447 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow pg remap = true 2024-04-26T10:41:58.447 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on legacy crush tunables = false 2024-04-26T10:41:58.447 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on crush straw calc version zero = false 2024-04-26T10:41:58.447 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on no sortbitwise = false 2024-04-26T10:41:58.448 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on osd down out interval zero = false 2024-04-26T10:41:58.448 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on too few osds = false 2024-04-26T10:41:58.448 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T10:41:58.448 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T10:41:58.448 INFO:teuthology.orchestra.run.smithi060.stdout: mon_allow_pool_size_one = true 2024-04-26T10:41:58.448 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.448 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T10:41:58.448 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.448 INFO:teuthology.orchestra.run.smithi060.stdout: osd default data pool replay window = 5 2024-04-26T10:41:58.448 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.449 INFO:teuthology.orchestra.run.smithi060.stdout: mon allow pool delete = true 2024-04-26T10:41:58.449 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.449 INFO:teuthology.orchestra.run.smithi060.stdout: mon cluster log file level = debug 2024-04-26T10:41:58.449 INFO:teuthology.orchestra.run.smithi060.stdout: debug asserts on shutdown = true 2024-04-26T10:41:58.449 INFO:teuthology.orchestra.run.smithi060.stdout: mon health detail to clog = false 2024-04-26T10:41:58.449 INFO:teuthology.orchestra.run.smithi060.stdout: mon host = "172.21.15.49,[v2:172.21.15.49:3301,v1:172.21.15.49:6790],[v2:172.21.15.49:3302,v1:172.21.15.49:6791]" 2024-04-26T10:41:58.449 INFO:teuthology.orchestra.run.smithi060.stdout: fsid = 9837de44-a9e8-4979-adc4-611f3ddc44ce 2024-04-26T10:41:58.449 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.449 INFO:teuthology.orchestra.run.smithi060.stdout:[osd] 2024-04-26T10:41:58.449 INFO:teuthology.orchestra.run.smithi060.stdout: osd journal size = 100 2024-04-26T10:41:58.450 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.450 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub load threshold = 5.0 2024-04-26T10:41:58.450 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub max interval = 600 2024-04-26T10:41:58.450 INFO:teuthology.orchestra.run.smithi060.stdout: osd mclock profile = high_recovery_ops 2024-04-26T10:41:58.450 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.450 INFO:teuthology.orchestra.run.smithi060.stdout: osd recover clone overlap = true 2024-04-26T10:41:58.450 INFO:teuthology.orchestra.run.smithi060.stdout: osd recovery max chunk = 1048576 2024-04-26T10:41:58.450 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.450 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug shutdown = true 2024-04-26T10:41:58.450 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug op order = true 2024-04-26T10:41:58.450 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug verify stray on activate = true 2024-04-26T10:41:58.451 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.451 INFO:teuthology.orchestra.run.smithi060.stdout: osd open classes on start = true 2024-04-26T10:41:58.451 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug pg log writeout = true 2024-04-26T10:41:58.452 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.452 INFO:teuthology.orchestra.run.smithi060.stdout: osd deep scrub update digest min age = 30 2024-04-26T10:41:58.452 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.452 INFO:teuthology.orchestra.run.smithi060.stdout: osd map max advance = 10 2024-04-26T10:41:58.452 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.452 INFO:teuthology.orchestra.run.smithi060.stdout: journal zero on create = true 2024-04-26T10:41:58.452 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.453 INFO:teuthology.orchestra.run.smithi060.stdout: filestore ondisk finisher threads = 3 2024-04-26T10:41:58.453 INFO:teuthology.orchestra.run.smithi060.stdout: filestore apply finisher threads = 3 2024-04-26T10:41:58.453 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.453 INFO:teuthology.orchestra.run.smithi060.stdout: bdev debug aio = true 2024-04-26T10:41:58.453 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug misdirected ops = true 2024-04-26T10:41:58.453 INFO:teuthology.orchestra.run.smithi060.stdout: bdev async discard = True 2024-04-26T10:41:58.453 INFO:teuthology.orchestra.run.smithi060.stdout: bdev enable discard = True 2024-04-26T10:41:58.453 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore block size = 96636764160 2024-04-26T10:41:58.453 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore fsck on mount = True 2024-04-26T10:41:58.453 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluefs = 1/20 2024-04-26T10:41:58.453 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluestore = 1/20 2024-04-26T10:41:58.453 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2024-04-26T10:41:58.454 INFO:teuthology.orchestra.run.smithi060.stdout: debug osd = 20 2024-04-26T10:41:58.454 INFO:teuthology.orchestra.run.smithi060.stdout: debug rocksdb = 4/10 2024-04-26T10:41:58.454 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T10:41:58.454 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd full ratio = 0.9 2024-04-26T10:41:58.454 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd nearfull ratio = 0.8 2024-04-26T10:41:58.454 INFO:teuthology.orchestra.run.smithi060.stdout: osd blocked scrub grace period = 3600 2024-04-26T10:41:58.454 INFO:teuthology.orchestra.run.smithi060.stdout: osd failsafe full ratio = 0.95 2024-04-26T10:41:58.454 INFO:teuthology.orchestra.run.smithi060.stdout: osd max markdown count = 1000 2024-04-26T10:41:58.454 INFO:teuthology.orchestra.run.smithi060.stdout: osd memory target = 1610612736 2024-04-26T10:41:58.454 INFO:teuthology.orchestra.run.smithi060.stdout: osd objectstore = bluestore 2024-04-26T10:41:58.454 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.455 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr] 2024-04-26T10:41:58.455 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2024-04-26T10:41:58.455 INFO:teuthology.orchestra.run.smithi060.stdout: debug mgr = 20 2024-04-26T10:41:58.455 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2024-04-26T10:41:58.455 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2024-04-26T10:41:58.455 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:41:58.455 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:41:58.456 INFO:teuthology.orchestra.run.smithi060.stdout: mgr/telemetry/nag = false 2024-04-26T10:41:58.456 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.456 INFO:teuthology.orchestra.run.smithi060.stdout:[mon] 2024-04-26T10:41:58.456 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2024-04-26T10:41:58.456 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2024-04-26T10:41:58.456 INFO:teuthology.orchestra.run.smithi060.stdout: debug paxos = 20 2024-04-26T10:41:58.456 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2024-04-26T10:41:58.457 INFO:teuthology.orchestra.run.smithi060.stdout: mon data avail warn = 5 2024-04-26T10:41:58.457 INFO:teuthology.orchestra.run.smithi060.stdout: mon mgr mkfs grace = 240 2024-04-26T10:41:58.457 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:41:58.457 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd reporter subtree level = osd 2024-04-26T10:41:58.457 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd prime pg temp = true 2024-04-26T10:41:58.457 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:41:58.457 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.457 INFO:teuthology.orchestra.run.smithi060.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T10:41:58.457 INFO:teuthology.orchestra.run.smithi060.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T10:41:58.457 INFO:teuthology.orchestra.run.smithi060.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T10:41:58.457 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.457 INFO:teuthology.orchestra.run.smithi060.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T10:41:58.458 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T10:41:58.458 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T10:41:58.458 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.458 INFO:teuthology.orchestra.run.smithi060.stdout: # 1m isn't quite enough 2024-04-26T10:41:58.458 INFO:teuthology.orchestra.run.smithi060.stdout: mon_down_mkfs_grace = 2m 2024-04-26T10:41:58.458 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.459 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_filestore_osds = false 2024-04-26T10:41:58.459 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-04-26T10:41:58.459 INFO:teuthology.orchestra.run.smithi060.stdout:[client] 2024-04-26T10:41:58.459 INFO:teuthology.orchestra.run.smithi060.stdout: rgw cache enabled = true 2024-04-26T10:41:58.459 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable ops log = true 2024-04-26T10:41:58.459 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable usage log = true 2024-04-26T10:41:58.459 INFO:teuthology.orchestra.run.smithi060.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T10:41:58.459 INFO:teuthology.orchestra.run.smithi060.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T10:41:58.459 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.a] 2024-04-26T10:41:58.459 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.b] 2024-04-26T10:41:58.459 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.c] 2024-04-26T10:41:58.459 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.a] 2024-04-26T10:41:58.460 INFO:teuthology.orchestra.run.smithi195.stdout:[global] 2024-04-26T10:41:58.460 INFO:teuthology.orchestra.run.smithi195.stdout: chdir = "" 2024-04-26T10:41:58.460 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T10:41:58.460 INFO:teuthology.orchestra.run.smithi195.stdout: auth supported = cephx 2024-04-26T10:41:58.460 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.460 INFO:teuthology.orchestra.run.smithi195.stdout: filestore xattr use omap = true 2024-04-26T10:41:58.460 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.460 INFO:teuthology.orchestra.run.smithi195.stdout: mon clock drift allowed = 1.000 2024-04-26T10:41:58.460 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.461 INFO:teuthology.orchestra.run.smithi195.stdout: osd crush chooseleaf type = 0 2024-04-26T10:41:58.461 INFO:teuthology.orchestra.run.smithi195.stdout: auth debug = true 2024-04-26T10:41:58.461 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.461 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on old message = true 2024-04-26T10:41:58.461 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on bug = true 2024-04-26T10:41:58.463 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.463 INFO:teuthology.orchestra.run.smithi195.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T10:41:58.463 INFO:teuthology.orchestra.run.smithi195.stdout: mon pg warn max object skew = 0 2024-04-26T10:41:58.463 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.463 INFO:teuthology.orchestra.run.smithi195.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T10:41:58.463 INFO:teuthology.orchestra.run.smithi195.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T10:41:58.463 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.463 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default size = 2 2024-04-26T10:41:58.464 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.464 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow primary affinity = true 2024-04-26T10:41:58.464 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow pg remap = true 2024-04-26T10:41:58.464 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on legacy crush tunables = false 2024-04-26T10:41:58.464 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on crush straw calc version zero = false 2024-04-26T10:41:58.464 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on no sortbitwise = false 2024-04-26T10:41:58.464 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on osd down out interval zero = false 2024-04-26T10:41:58.464 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on too few osds = false 2024-04-26T10:41:58.464 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T10:41:58.464 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T10:41:58.464 INFO:teuthology.orchestra.run.smithi195.stdout: mon_allow_pool_size_one = true 2024-04-26T10:41:58.464 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.464 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T10:41:58.464 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.464 INFO:teuthology.orchestra.run.smithi195.stdout: osd default data pool replay window = 5 2024-04-26T10:41:58.465 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.465 INFO:teuthology.orchestra.run.smithi195.stdout: mon allow pool delete = true 2024-04-26T10:41:58.465 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.465 INFO:teuthology.orchestra.run.smithi195.stdout: mon cluster log file level = debug 2024-04-26T10:41:58.465 INFO:teuthology.orchestra.run.smithi195.stdout: debug asserts on shutdown = true 2024-04-26T10:41:58.465 INFO:teuthology.orchestra.run.smithi195.stdout: mon health detail to clog = false 2024-04-26T10:41:58.465 INFO:teuthology.orchestra.run.smithi195.stdout: mon host = "172.21.15.49,[v2:172.21.15.49:3301,v1:172.21.15.49:6790],[v2:172.21.15.49:3302,v1:172.21.15.49:6791]" 2024-04-26T10:41:58.465 INFO:teuthology.orchestra.run.smithi195.stdout: fsid = 9837de44-a9e8-4979-adc4-611f3ddc44ce 2024-04-26T10:41:58.465 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.465 INFO:teuthology.orchestra.run.smithi195.stdout:[osd] 2024-04-26T10:41:58.465 INFO:teuthology.orchestra.run.smithi195.stdout: osd journal size = 100 2024-04-26T10:41:58.465 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.465 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub load threshold = 5.0 2024-04-26T10:41:58.465 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub max interval = 600 2024-04-26T10:41:58.465 INFO:teuthology.orchestra.run.smithi195.stdout: osd mclock profile = high_recovery_ops 2024-04-26T10:41:58.466 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.466 INFO:teuthology.orchestra.run.smithi195.stdout: osd recover clone overlap = true 2024-04-26T10:41:58.466 INFO:teuthology.orchestra.run.smithi195.stdout: osd recovery max chunk = 1048576 2024-04-26T10:41:58.466 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.466 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug shutdown = true 2024-04-26T10:41:58.466 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug op order = true 2024-04-26T10:41:58.466 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug verify stray on activate = true 2024-04-26T10:41:58.466 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.466 INFO:teuthology.orchestra.run.smithi195.stdout: osd open classes on start = true 2024-04-26T10:41:58.466 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug pg log writeout = true 2024-04-26T10:41:58.466 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.466 INFO:teuthology.orchestra.run.smithi195.stdout: osd deep scrub update digest min age = 30 2024-04-26T10:41:58.466 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.466 INFO:teuthology.orchestra.run.smithi195.stdout: osd map max advance = 10 2024-04-26T10:41:58.467 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.467 INFO:teuthology.orchestra.run.smithi195.stdout: journal zero on create = true 2024-04-26T10:41:58.467 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.467 INFO:teuthology.orchestra.run.smithi195.stdout: filestore ondisk finisher threads = 3 2024-04-26T10:41:58.467 INFO:teuthology.orchestra.run.smithi195.stdout: filestore apply finisher threads = 3 2024-04-26T10:41:58.467 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.467 INFO:teuthology.orchestra.run.smithi195.stdout: bdev debug aio = true 2024-04-26T10:41:58.467 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug misdirected ops = true 2024-04-26T10:41:58.467 INFO:teuthology.orchestra.run.smithi195.stdout: bdev async discard = True 2024-04-26T10:41:58.467 INFO:teuthology.orchestra.run.smithi195.stdout: bdev enable discard = True 2024-04-26T10:41:58.467 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore block size = 96636764160 2024-04-26T10:41:58.467 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore fsck on mount = True 2024-04-26T10:41:58.467 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluefs = 1/20 2024-04-26T10:41:58.468 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluestore = 1/20 2024-04-26T10:41:58.468 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-26T10:41:58.468 INFO:teuthology.orchestra.run.smithi195.stdout: debug osd = 20 2024-04-26T10:41:58.468 INFO:teuthology.orchestra.run.smithi195.stdout: debug rocksdb = 4/10 2024-04-26T10:41:58.468 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T10:41:58.468 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd full ratio = 0.9 2024-04-26T10:41:58.468 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd nearfull ratio = 0.8 2024-04-26T10:41:58.468 INFO:teuthology.orchestra.run.smithi195.stdout: osd blocked scrub grace period = 3600 2024-04-26T10:41:58.468 INFO:teuthology.orchestra.run.smithi195.stdout: osd failsafe full ratio = 0.95 2024-04-26T10:41:58.468 INFO:teuthology.orchestra.run.smithi195.stdout: osd max markdown count = 1000 2024-04-26T10:41:58.468 INFO:teuthology.orchestra.run.smithi195.stdout: osd memory target = 1610612736 2024-04-26T10:41:58.468 INFO:teuthology.orchestra.run.smithi195.stdout: osd objectstore = bluestore 2024-04-26T10:41:58.468 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.468 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr] 2024-04-26T10:41:58.469 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-26T10:41:58.469 INFO:teuthology.orchestra.run.smithi195.stdout: debug mgr = 20 2024-04-26T10:41:58.469 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-04-26T10:41:58.469 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-04-26T10:41:58.469 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:41:58.470 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:41:58.470 INFO:teuthology.orchestra.run.smithi195.stdout: mgr/telemetry/nag = false 2024-04-26T10:41:58.470 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.470 INFO:teuthology.orchestra.run.smithi195.stdout:[mon] 2024-04-26T10:41:58.470 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-26T10:41:58.470 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-04-26T10:41:58.470 INFO:teuthology.orchestra.run.smithi195.stdout: debug paxos = 20 2024-04-26T10:41:58.470 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-04-26T10:41:58.470 INFO:teuthology.orchestra.run.smithi195.stdout: mon data avail warn = 5 2024-04-26T10:41:58.471 INFO:teuthology.orchestra.run.smithi195.stdout: mon mgr mkfs grace = 240 2024-04-26T10:41:58.471 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:41:58.471 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd reporter subtree level = osd 2024-04-26T10:41:58.471 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd prime pg temp = true 2024-04-26T10:41:58.471 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:41:58.471 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.471 INFO:teuthology.orchestra.run.smithi195.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T10:41:58.471 INFO:teuthology.orchestra.run.smithi195.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T10:41:58.471 INFO:teuthology.orchestra.run.smithi195.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T10:41:58.471 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.471 INFO:teuthology.orchestra.run.smithi195.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T10:41:58.471 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T10:41:58.471 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T10:41:58.471 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.471 INFO:teuthology.orchestra.run.smithi195.stdout: # 1m isn't quite enough 2024-04-26T10:41:58.472 INFO:teuthology.orchestra.run.smithi195.stdout: mon_down_mkfs_grace = 2m 2024-04-26T10:41:58.472 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.472 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_filestore_osds = false 2024-04-26T10:41:58.472 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-26T10:41:58.472 INFO:teuthology.orchestra.run.smithi195.stdout:[client] 2024-04-26T10:41:58.472 INFO:teuthology.orchestra.run.smithi195.stdout: rgw cache enabled = true 2024-04-26T10:41:58.472 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable ops log = true 2024-04-26T10:41:58.472 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable usage log = true 2024-04-26T10:41:58.472 INFO:teuthology.orchestra.run.smithi195.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T10:41:58.472 INFO:teuthology.orchestra.run.smithi195.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T10:41:58.472 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.a] 2024-04-26T10:41:58.473 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.b] 2024-04-26T10:41:58.473 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.c] 2024-04-26T10:41:58.473 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.a] 2024-04-26T10:41:58.477 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2024-04-26T10:41:58.477 INFO:teuthology.orchestra.run.smithi087.stdout: chdir = "" 2024-04-26T10:41:58.477 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T10:41:58.478 INFO:teuthology.orchestra.run.smithi087.stdout: auth supported = cephx 2024-04-26T10:41:58.478 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.478 INFO:teuthology.orchestra.run.smithi087.stdout: filestore xattr use omap = true 2024-04-26T10:41:58.478 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.478 INFO:teuthology.orchestra.run.smithi087.stdout: mon clock drift allowed = 1.000 2024-04-26T10:41:58.478 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.479 INFO:teuthology.orchestra.run.smithi087.stdout: osd crush chooseleaf type = 0 2024-04-26T10:41:58.479 INFO:teuthology.orchestra.run.smithi087.stdout: auth debug = true 2024-04-26T10:41:58.479 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.479 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on old message = true 2024-04-26T10:41:58.480 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on bug = true 2024-04-26T10:41:58.480 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.480 INFO:teuthology.orchestra.run.smithi087.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T10:41:58.480 INFO:teuthology.orchestra.run.smithi087.stdout: mon pg warn max object skew = 0 2024-04-26T10:41:58.481 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.481 INFO:teuthology.orchestra.run.smithi087.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T10:41:58.481 INFO:teuthology.orchestra.run.smithi087.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T10:41:58.481 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.481 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default size = 2 2024-04-26T10:41:58.481 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.482 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow primary affinity = true 2024-04-26T10:41:58.482 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow pg remap = true 2024-04-26T10:41:58.482 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on legacy crush tunables = false 2024-04-26T10:41:58.482 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on crush straw calc version zero = false 2024-04-26T10:41:58.482 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on no sortbitwise = false 2024-04-26T10:41:58.482 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on osd down out interval zero = false 2024-04-26T10:41:58.483 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on too few osds = false 2024-04-26T10:41:58.483 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T10:41:58.483 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T10:41:58.484 INFO:teuthology.orchestra.run.smithi087.stdout: mon_allow_pool_size_one = true 2024-04-26T10:41:58.484 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.484 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T10:41:58.484 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.484 INFO:teuthology.orchestra.run.smithi087.stdout: osd default data pool replay window = 5 2024-04-26T10:41:58.485 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.485 INFO:teuthology.orchestra.run.smithi087.stdout: mon allow pool delete = true 2024-04-26T10:41:58.485 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.485 INFO:teuthology.orchestra.run.smithi087.stdout: mon cluster log file level = debug 2024-04-26T10:41:58.485 INFO:teuthology.orchestra.run.smithi087.stdout: debug asserts on shutdown = true 2024-04-26T10:41:58.485 INFO:teuthology.orchestra.run.smithi087.stdout: mon health detail to clog = false 2024-04-26T10:41:58.486 INFO:teuthology.orchestra.run.smithi087.stdout: mon host = "172.21.15.49,[v2:172.21.15.49:3301,v1:172.21.15.49:6790],[v2:172.21.15.49:3302,v1:172.21.15.49:6791]" 2024-04-26T10:41:58.486 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = 9837de44-a9e8-4979-adc4-611f3ddc44ce 2024-04-26T10:41:58.486 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.486 INFO:teuthology.orchestra.run.smithi087.stdout:[osd] 2024-04-26T10:41:58.486 INFO:teuthology.orchestra.run.smithi087.stdout: osd journal size = 100 2024-04-26T10:41:58.486 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.487 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub load threshold = 5.0 2024-04-26T10:41:58.487 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub max interval = 600 2024-04-26T10:41:58.487 INFO:teuthology.orchestra.run.smithi087.stdout: osd mclock profile = high_recovery_ops 2024-04-26T10:41:58.487 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.487 INFO:teuthology.orchestra.run.smithi087.stdout: osd recover clone overlap = true 2024-04-26T10:41:58.487 INFO:teuthology.orchestra.run.smithi087.stdout: osd recovery max chunk = 1048576 2024-04-26T10:41:58.488 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.488 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug shutdown = true 2024-04-26T10:41:58.488 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug op order = true 2024-04-26T10:41:58.488 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug verify stray on activate = true 2024-04-26T10:41:58.488 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.488 INFO:teuthology.orchestra.run.smithi087.stdout: osd open classes on start = true 2024-04-26T10:41:58.489 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug pg log writeout = true 2024-04-26T10:41:58.489 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.489 INFO:teuthology.orchestra.run.smithi087.stdout: osd deep scrub update digest min age = 30 2024-04-26T10:41:58.489 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.489 INFO:teuthology.orchestra.run.smithi087.stdout: osd map max advance = 10 2024-04-26T10:41:58.489 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.489 INFO:teuthology.orchestra.run.smithi087.stdout: journal zero on create = true 2024-04-26T10:41:58.490 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.490 INFO:teuthology.orchestra.run.smithi087.stdout: filestore ondisk finisher threads = 3 2024-04-26T10:41:58.491 INFO:teuthology.orchestra.run.smithi087.stdout: filestore apply finisher threads = 3 2024-04-26T10:41:58.491 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.491 INFO:teuthology.orchestra.run.smithi087.stdout: bdev debug aio = true 2024-04-26T10:41:58.491 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug misdirected ops = true 2024-04-26T10:41:58.491 INFO:teuthology.orchestra.run.smithi087.stdout: bdev async discard = True 2024-04-26T10:41:58.491 INFO:teuthology.orchestra.run.smithi087.stdout: bdev enable discard = True 2024-04-26T10:41:58.492 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore block size = 96636764160 2024-04-26T10:41:58.492 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore fsck on mount = True 2024-04-26T10:41:58.492 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluefs = 1/20 2024-04-26T10:41:58.492 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluestore = 1/20 2024-04-26T10:41:58.492 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-04-26T10:41:58.493 INFO:teuthology.orchestra.run.smithi087.stdout: debug osd = 20 2024-04-26T10:41:58.493 INFO:teuthology.orchestra.run.smithi087.stdout: debug rocksdb = 4/10 2024-04-26T10:41:58.493 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T10:41:58.493 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd full ratio = 0.9 2024-04-26T10:41:58.493 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd nearfull ratio = 0.8 2024-04-26T10:41:58.493 INFO:teuthology.orchestra.run.smithi087.stdout: osd blocked scrub grace period = 3600 2024-04-26T10:41:58.494 INFO:teuthology.orchestra.run.smithi087.stdout: osd failsafe full ratio = 0.95 2024-04-26T10:41:58.494 INFO:teuthology.orchestra.run.smithi087.stdout: osd max markdown count = 1000 2024-04-26T10:41:58.494 INFO:teuthology.orchestra.run.smithi087.stdout: osd memory target = 1610612736 2024-04-26T10:41:58.494 INFO:teuthology.orchestra.run.smithi087.stdout: osd objectstore = bluestore 2024-04-26T10:41:58.494 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.495 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr] 2024-04-26T10:41:58.495 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-04-26T10:41:58.495 INFO:teuthology.orchestra.run.smithi087.stdout: debug mgr = 20 2024-04-26T10:41:58.495 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-04-26T10:41:58.495 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-04-26T10:41:58.495 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:41:58.496 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:41:58.496 INFO:teuthology.orchestra.run.smithi087.stdout: mgr/telemetry/nag = false 2024-04-26T10:41:58.496 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.496 INFO:teuthology.orchestra.run.smithi087.stdout:[mon] 2024-04-26T10:41:58.496 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-04-26T10:41:58.496 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-04-26T10:41:58.496 INFO:teuthology.orchestra.run.smithi087.stdout: debug paxos = 20 2024-04-26T10:41:58.497 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-04-26T10:41:58.497 INFO:teuthology.orchestra.run.smithi087.stdout: mon data avail warn = 5 2024-04-26T10:41:58.497 INFO:teuthology.orchestra.run.smithi087.stdout: mon mgr mkfs grace = 240 2024-04-26T10:41:58.497 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:41:58.497 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd reporter subtree level = osd 2024-04-26T10:41:58.498 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd prime pg temp = true 2024-04-26T10:41:58.498 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:41:58.498 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.498 INFO:teuthology.orchestra.run.smithi087.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T10:41:58.498 INFO:teuthology.orchestra.run.smithi087.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T10:41:58.498 INFO:teuthology.orchestra.run.smithi087.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T10:41:58.498 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.498 INFO:teuthology.orchestra.run.smithi087.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T10:41:58.498 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T10:41:58.499 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T10:41:58.499 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.499 INFO:teuthology.orchestra.run.smithi087.stdout: # 1m isn't quite enough 2024-04-26T10:41:58.499 INFO:teuthology.orchestra.run.smithi087.stdout: mon_down_mkfs_grace = 2m 2024-04-26T10:41:58.499 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.499 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_filestore_osds = false 2024-04-26T10:41:58.499 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-04-26T10:41:58.499 INFO:teuthology.orchestra.run.smithi087.stdout:[client] 2024-04-26T10:41:58.499 INFO:teuthology.orchestra.run.smithi087.stdout: rgw cache enabled = true 2024-04-26T10:41:58.500 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable ops log = true 2024-04-26T10:41:58.500 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable usage log = true 2024-04-26T10:41:58.500 INFO:teuthology.orchestra.run.smithi087.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T10:41:58.500 INFO:teuthology.orchestra.run.smithi087.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T10:41:58.500 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.a] 2024-04-26T10:41:58.500 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.b] 2024-04-26T10:41:58.500 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.c] 2024-04-26T10:41:58.500 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2024-04-26T10:41:58.501 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T10:41:58.502 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T10:41:58.568 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T10:41:58.569 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-04-26T10:41:58.569 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T10:41:58.584 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-04-26T10:41:58.584 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T10:41:58.639 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi049.front.sepia.ceph.com 2024-04-26T10:41:58.640 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-04-26T10:41:58.640 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T10:41:58.640 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T10:41:58.713 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-04-26T10:41:58.713 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:41:58.768 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi060.front.sepia.ceph.com 2024-04-26T10:41:58.769 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-26T10:41:58.769 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T10:41:58.769 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T10:41:58.811 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-26T10:41:58.811 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:41:58.870 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi087.front.sepia.ceph.com 2024-04-26T10:41:58.870 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-26T10:41:58.870 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T10:41:58.870 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T10:41:58.909 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-26T10:41:58.909 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:41:58.967 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi195.front.sepia.ceph.com 2024-04-26T10:41:58.967 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T10:41:58.967 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T10:41:58.967 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T10:41:59.000 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T10:41:59.000 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:41:59.055 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T10:41:59.055 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T10:41:59.055 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T10:41:59.106 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T10:41:59.108 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T10:41:59.157 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T10:41:59.160 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T10:41:59.160 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T10:41:59.210 INFO:teuthology.orchestra.run.smithi049.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T10:41:59.212 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T10:41:59.237 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T10:41:59.237 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T10:41:59.318 INFO:teuthology.orchestra.run.smithi049.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T10:41:59.331 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T10:41:59.331 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi060.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi195.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-26T10:41:59.331 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T10:41:59.360 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T10:41:59.361 INFO:tasks.ceph:role: osd.0 2024-04-26T10:41:59.361 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi060.front.sepia.ceph.com 2024-04-26T10:41:59.361 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T10:41:59.429 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T10:41:59.429 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T10:41:59.429 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T10:41:59.429 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T10:41:59.429 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T10:41:59.430 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2024-04-26T10:41:59.430 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T10:41:59.430 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T10:41:59.430 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T10:41:59.430 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T10:41:59.461 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2024-04-26T10:41:59.463 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2024-04-26T10:41:59.463 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T10:41:59.534 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T10:41:59.606 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:41:59.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-26T10:41:59.716+0000 7f2f0be14640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T10:41:59.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-26T10:41:59.716+0000 7f2f0be14640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T10:41:59.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-26T10:41:59.716+0000 7f2f0be14640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T10:41:59.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-26T10:41:59.716+0000 7f2f0be14640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T10:41:59.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-26T10:41:59.716+0000 7f2f0be14640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T10:41:59.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-04-26T10:41:59.716+0000 7f2f0be14640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T10:42:02.563 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T10:42:02.592 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T10:42:02.620 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-26T10:42:02.620 INFO:tasks.ceph:role: osd.1 2024-04-26T10:42:02.620 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com 2024-04-26T10:42:02.621 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T10:42:02.695 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T10:42:02.695 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T10:42:02.695 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T10:42:02.695 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T10:42:02.695 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T10:42:02.695 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-04-26T10:42:02.695 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T10:42:02.695 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T10:42:02.695 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T10:42:02.696 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T10:42:03.222 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-04-26T10:42:03.224 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-04-26T10:42:03.225 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-26T10:42:03.331 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T10:42:03.363 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:42:03.476 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-26T10:42:03.475+0000 7f5f05825640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T10:42:03.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-26T10:42:03.477+0000 7f5f05825640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T10:42:03.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-26T10:42:03.477+0000 7f5f05825640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T10:42:03.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-26T10:42:03.477+0000 7f5f05825640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T10:42:03.478 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-26T10:42:03.477+0000 7f5f05825640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T10:42:03.485 INFO:teuthology.orchestra.run.smithi087.stderr:2024-04-26T10:42:03.484+0000 7f5f05825640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T10:42:06.341 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T10:42:06.370 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T10:42:06.399 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-26T10:42:06.399 INFO:tasks.ceph:role: osd.2 2024-04-26T10:42:06.399 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-26T10:42:06.399 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T10:42:06.467 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T10:42:06.467 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T10:42:06.467 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T10:42:06.468 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T10:42:06.468 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T10:42:06.468 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-04-26T10:42:06.468 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T10:42:06.468 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T10:42:06.468 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T10:42:06.468 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T10:42:06.503 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-04-26T10:42:06.505 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-04-26T10:42:06.505 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-26T10:42:06.575 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T10:42:06.644 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:42:06.743 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T10:42:06.741+0000 7f854821d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T10:42:06.743 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T10:42:06.741+0000 7f854821d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T10:42:06.743 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T10:42:06.741+0000 7f854821d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T10:42:06.743 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T10:42:06.741+0000 7f854821d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T10:42:06.743 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T10:42:06.741+0000 7f854821d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T10:42:06.743 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-26T10:42:06.742+0000 7f854821d640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T10:42:09.610 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T10:42:09.643 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T10:42:09.644 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-04-26T10:42:09.644 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T10:42:09.675 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-04-26T10:42:09.675 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T10:42:09.744 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-04-26T10:42:09.745 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T10:42:09.811 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-26T10:42:09.811 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T10:42:09.840 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-26T10:42:09.841 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T10:42:09.870 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T10:42:09.870 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T10:42:09.898 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-04-26T10:42:09.899 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T10:42:09.915 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T10:42:09.915 DEBUG:teuthology.orchestra.run.smithi049:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T10:42:09.979 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr.x] 2024-04-26T10:42:09.979 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQD3hCtmc5NUBhAAO9iT4t3t8KxL5NSXplJwWQ== 2024-04-26T10:42:09.979 INFO:teuthology.orchestra.run.smithi049.stdout:[mgr.y] 2024-04-26T10:42:09.979 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQD3hCtmA8dnCRAANPfyXPiMLX25L5PGbXv/AQ== 2024-04-26T10:42:09.979 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a] 2024-04-26T10:42:09.980 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQD3hCtmx0aHDBAAYA6G23V/ejIn9vbUA/7P/Q== 2024-04-26T10:42:09.980 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.0] 2024-04-26T10:42:09.980 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQD3hCtmxN+4KhAAhvSx1okIKoCr33QWW8h/SA== 2024-04-26T10:42:09.980 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.1] 2024-04-26T10:42:09.980 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQD7hCtm5PhoHBAAOsgNkcWtDH6NHu+jLWFpyA== 2024-04-26T10:42:09.980 INFO:teuthology.orchestra.run.smithi049.stdout:[osd.2] 2024-04-26T10:42:09.980 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQD+hCtmw4FELBAALUMHwyVzx2xuN/C7bGFKQg== 2024-04-26T10:42:09.980 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2024-04-26T10:42:09.980 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQD3hCtm8TP8EhAAxTqaQwPeev388/2rzWiHAw== 2024-04-26T10:42:09.981 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T10:42:10.074 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T10:42:10.124 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T10:42:10.184 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T10:42:10.235 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T10:42:10.286 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T10:42:10.338 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T10:42:10.392 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T10:42:10.393 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T10:42:10.417 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T10:42:10.523 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T10:42:10.548 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T10:42:10.615 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T10:42:10.711 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T10:42:10.736 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T10:42:10.801 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T10:42:10.898 DEBUG:teuthology.orchestra.run.smithi049:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T10:42:10.923 DEBUG:teuthology.orchestra.run.smithi049:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:42:10.979 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T10:42:10.979 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T10:42:10.979 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T10:42:11.022 INFO:tasks.ceph.mon.a:Started 2024-04-26T10:42:11.022 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T10:42:11.022 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T10:42:11.024 INFO:tasks.ceph.mon.b:Started 2024-04-26T10:42:11.024 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T10:42:11.024 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T10:42:11.026 INFO:tasks.ceph.mon.c:Started 2024-04-26T10:42:11.026 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T10:42:11.027 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T10:42:11.027 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T10:42:11.028 INFO:tasks.ceph.mgr.x:Started 2024-04-26T10:42:11.029 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T10:42:11.029 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T10:42:11.031 INFO:tasks.ceph.mgr.y:Started 2024-04-26T10:42:11.031 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T10:42:11.032 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T10:42:11.437 INFO:teuthology.orchestra.run.smithi049.stderr:adjusted tunables profile to default 2024-04-26T10:42:11.439 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T10:42:11.439 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T10:42:11.439 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-04-26T10:42:11.439 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T10:42:11.473 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-04-26T10:42:11.473 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T10:42:11.481 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:11.479+0000 7fe1b6619040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T10:42:11.481 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:11.479+0000 7fb685612040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T10:42:11.508 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-26T10:42:11.508 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T10:42:11.536 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new eabed31c-c043-43de-a756-e217d5287116 0 2024-04-26T10:42:11.640 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:11.637+0000 7fb685612040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T10:42:11.640 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:11.637+0000 7fe1b6619040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T10:42:11.696 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:11.694+0000 7fb685612040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T10:42:11.696 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:11.694+0000 7fe1b6619040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T10:42:11.759 INFO:teuthology.orchestra.run.smithi195.stdout:0 2024-04-26T10:42:11.771 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 7013621f-db09-4096-bc24-428bb170edd1 1 2024-04-26T10:42:11.945 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:11.945+0000 7fb685612040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T10:42:11.946 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:11.945+0000 7fe1b6619040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T10:42:11.952 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-04-26T10:42:11.964 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new a1efeadd-cf55-4ed5-9918-36607fd62229 2 2024-04-26T10:42:11.994 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:11.993+0000 7fe1b6619040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T10:42:11.994 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:11.993+0000 7fb685612040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T10:42:12.139 INFO:teuthology.orchestra.run.smithi195.stdout:2 2024-04-26T10:42:12.150 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T10:42:12.151 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T10:42:12.153 INFO:tasks.ceph.osd.0:Started 2024-04-26T10:42:12.153 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T10:42:12.154 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T10:42:12.156 INFO:tasks.ceph.osd.1:Started 2024-04-26T10:42:12.156 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T10:42:12.156 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T10:42:12.158 INFO:tasks.ceph.osd.2:Started 2024-04-26T10:42:12.159 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:42:12.331 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:12.332 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":5,"fsid":"9837de44-a9e8-4979-adc4-611f3ddc44ce","created":"2024-04-26T10:42:11.337159+0000","modified":"2024-04-26T10:42:12.136647+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T10:42:12.136647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"eabed31c-c043-43de-a756-e217d5287116","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7013621f-db09-4096-bc24-428bb170edd1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a1efeadd-cf55-4ed5-9918-36607fd62229","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:42:12.345 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T10:42:12.346 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T10:42:12.649 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T10:42:12.747 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:12.741+0000 7f9ab1211640 -1 Falling back to public interface 2024-04-26T10:42:12.751 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:12.751+0000 7fb685612040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T10:42:12.752 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:12.750+0000 7f53d2e0d640 -1 Falling back to public interface 2024-04-26T10:42:12.752 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:12.751+0000 7fe1b6619040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T10:42:12.756 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:12.755+0000 7fd9d7355640 -1 Falling back to public interface 2024-04-26T10:42:12.825 INFO:teuthology.misc.health.smithi049.stdout: 2024-04-26T10:42:12.825 INFO:teuthology.misc.health.smithi049.stdout:{"epoch":5,"fsid":"9837de44-a9e8-4979-adc4-611f3ddc44ce","created":"2024-04-26T10:42:11.337159+0000","modified":"2024-04-26T10:42:12.136647+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T10:42:12.136647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"eabed31c-c043-43de-a756-e217d5287116","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7013621f-db09-4096-bc24-428bb170edd1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a1efeadd-cf55-4ed5-9918-36607fd62229","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:42:12.836 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-26T10:42:12.845 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:12.844+0000 7fb685612040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T10:42:12.849 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:12.849+0000 7fe1b6619040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T10:42:12.890 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:12.889+0000 7fb685612040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T10:42:12.893 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:12.893+0000 7fe1b6619040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T10:42:13.064 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:13.063+0000 7fb685612040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T10:42:13.064 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:13.063+0000 7fe1b6619040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T10:42:13.114 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:13.113+0000 7fb685612040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T10:42:13.114 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:13.113+0000 7fe1b6619040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T10:42:13.169 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:13.168+0000 7fb685612040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T10:42:13.169 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:13.168+0000 7fe1b6619040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T10:42:13.287 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:13.286+0000 7fe1b6619040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T10:42:13.287 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:13.286+0000 7fb685612040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T10:42:13.696 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:13.693+0000 7fb685612040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T10:42:13.696 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:13.693+0000 7fe1b6619040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T10:42:13.966 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:13.965+0000 7fe1b6619040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T10:42:13.966 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:13.965+0000 7fb685612040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T10:42:14.021 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:14.020+0000 7fb685612040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T10:42:14.021 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:14.020+0000 7fe1b6619040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T10:42:14.142 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:14.142+0000 7fe1b6619040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T10:42:14.143 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:14.142+0000 7fb685612040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T10:42:14.431 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:14.431+0000 7fe1b6619040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T10:42:14.432 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:14.432+0000 7fb685612040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T10:42:14.481 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:14.481+0000 7fe1b6619040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T10:42:14.482 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:14.482+0000 7fb685612040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T10:42:14.646 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:14.646+0000 7fe1b6619040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T10:42:14.647 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:14.646+0000 7fb685612040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T10:42:14.791 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:14.790+0000 7fe1b6619040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T10:42:14.791 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:14.790+0000 7fb685612040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T10:42:14.843 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:14.842+0000 7fb685612040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T10:42:14.844 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:14.843+0000 7fe1b6619040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T10:42:14.917 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:14.917+0000 7fb685612040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T10:42:14.918 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:14.917+0000 7fe1b6619040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T10:42:14.965 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:14.964+0000 7fb685612040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T10:42:14.965 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:14.964+0000 7fe1b6619040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T10:42:15.464 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:15.464+0000 7fb685612040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T10:42:15.465 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:15.464+0000 7fe1b6619040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T10:42:15.585 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:15.584+0000 7fe1b6619040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T10:42:15.585 INFO:tasks.ceph.mgr.y.smithi049.stderr:2024-04-26T10:42:15.585+0000 7fb685612040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T10:42:16.170 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:16.169+0000 7f9ab1211640 -1 osd.2 0 log_to_monitors true 2024-04-26T10:42:16.177 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:16.177+0000 7f53d2e0d640 -1 osd.0 0 log_to_monitors true 2024-04-26T10:42:16.184 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:16.183+0000 7fd9d7355640 -1 osd.1 0 log_to_monitors true 2024-04-26T10:42:16.600 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:16.600+0000 7fe156ef9640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T10:42:16.601 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:42:16.601+0000 7fe156ef9640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T10:42:18.396 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:18.395+0000 7f9aac36c640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T10:42:18.407 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:18.406+0000 7f9aa499f640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T10:42:18.431 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:18.430+0000 7f53cde71640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T10:42:18.445 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:18.444+0000 7f53c64a4640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T10:42:18.548 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:18.547+0000 7fd9d42fa640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T10:42:18.562 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:18.561+0000 7fd9cb0f2640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T10:42:19.139 DEBUG:teuthology.orchestra.run.smithi049:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T10:42:19.438 INFO:teuthology.misc.health.smithi049.stdout: 2024-04-26T10:42:19.439 INFO:teuthology.misc.health.smithi049.stdout:{"epoch":8,"fsid":"9837de44-a9e8-4979-adc4-611f3ddc44ce","created":"2024-04-26T10:42:11.337159+0000","modified":"2024-04-26T10:42:19.397933+0000","last_up_change":"2024-04-26T10:42:19.397933+0000","last_in_change":"2024-04-26T10:42:12.136647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"eabed31c-c043-43de-a756-e217d5287116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":28839},{"type":"v1","addr":"172.21.15.60:6801","nonce":28839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":28839},{"type":"v1","addr":"172.21.15.60:6803","nonce":28839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":28839},{"type":"v1","addr":"172.21.15.60:6807","nonce":28839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":28839},{"type":"v1","addr":"172.21.15.60:6805","nonce":28839}]},"public_addr":"172.21.15.60:6801/28839","cluster_addr":"172.21.15.60:6803/28839","heartbeat_back_addr":"172.21.15.60:6807/28839","heartbeat_front_addr":"172.21.15.60:6805/28839","state":["exists","up"]},{"osd":1,"uuid":"7013621f-db09-4096-bc24-428bb170edd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":28598},{"type":"v1","addr":"172.21.15.87:6801","nonce":28598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":28598},{"type":"v1","addr":"172.21.15.87:6803","nonce":28598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":28598},{"type":"v1","addr":"172.21.15.87:6807","nonce":28598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":28598},{"type":"v1","addr":"172.21.15.87:6805","nonce":28598}]},"public_addr":"172.21.15.87:6801/28598","cluster_addr":"172.21.15.87:6803/28598","heartbeat_back_addr":"172.21.15.87:6807/28598","heartbeat_front_addr":"172.21.15.87:6805/28598","state":["exists","up"]},{"osd":2,"uuid":"a1efeadd-cf55-4ed5-9918-36607fd62229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":28733},{"type":"v1","addr":"172.21.15.195:6801","nonce":28733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":28733},{"type":"v1","addr":"172.21.15.195:6803","nonce":28733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":28733},{"type":"v1","addr":"172.21.15.195:6807","nonce":28733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":28733},{"type":"v1","addr":"172.21.15.195:6805","nonce":28733}]},"public_addr":"172.21.15.195:6801/28733","cluster_addr":"172.21.15.195:6803/28733","heartbeat_back_addr":"172.21.15.195:6807/28733","heartbeat_front_addr":"172.21.15.195:6805/28733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:42:19.450 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-04-26T10:42:19.450 INFO:tasks.ceph:Creating RBD pool 2024-04-26T10:42:19.450 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-26T10:42:20.403 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'rbd' created 2024-04-26T10:42:20.420 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-26T10:42:21.403 INFO:teuthology.orchestra.run.smithi049.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-26T10:42:21.418 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T10:42:21.418 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T10:42:21.419 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T10:42:21.421 INFO:tasks.ceph.mds.a:Started 2024-04-26T10:42:21.421 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T10:42:21.421 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:42:21.496 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-04-26T10:42:21.727 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:21.728 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":10,"fsid":"9837de44-a9e8-4979-adc4-611f3ddc44ce","created":"2024-04-26T10:42:11.337159+0000","modified":"2024-04-26T10:42:21.400113+0000","last_up_change":"2024-04-26T10:42:19.397933+0000","last_in_change":"2024-04-26T10:42:12.136647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:42:19.632084+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:42:19.779089+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eabed31c-c043-43de-a756-e217d5287116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":28839},{"type":"v1","addr":"172.21.15.60:6801","nonce":28839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":28839},{"type":"v1","addr":"172.21.15.60:6803","nonce":28839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":28839},{"type":"v1","addr":"172.21.15.60:6807","nonce":28839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":28839},{"type":"v1","addr":"172.21.15.60:6805","nonce":28839}]},"public_addr":"172.21.15.60:6801/28839","cluster_addr":"172.21.15.60:6803/28839","heartbeat_back_addr":"172.21.15.60:6807/28839","heartbeat_front_addr":"172.21.15.60:6805/28839","state":["exists","up"]},{"osd":1,"uuid":"7013621f-db09-4096-bc24-428bb170edd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":28598},{"type":"v1","addr":"172.21.15.87:6801","nonce":28598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":28598},{"type":"v1","addr":"172.21.15.87:6803","nonce":28598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":28598},{"type":"v1","addr":"172.21.15.87:6807","nonce":28598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":28598},{"type":"v1","addr":"172.21.15.87:6805","nonce":28598}]},"public_addr":"172.21.15.87:6801/28598","cluster_addr":"172.21.15.87:6803/28598","heartbeat_back_addr":"172.21.15.87:6807/28598","heartbeat_front_addr":"172.21.15.87:6805/28598","state":["exists","up"]},{"osd":2,"uuid":"a1efeadd-cf55-4ed5-9918-36607fd62229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":28733},{"type":"v1","addr":"172.21.15.195:6801","nonce":28733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":28733},{"type":"v1","addr":"172.21.15.195:6803","nonce":28733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":28733},{"type":"v1","addr":"172.21.15.195:6807","nonce":28733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":28733},{"type":"v1","addr":"172.21.15.195:6805","nonce":28733}]},"public_addr":"172.21.15.195:6801/28733","cluster_addr":"172.21.15.195:6803/28733","heartbeat_back_addr":"172.21.15.195:6807/28733","heartbeat_front_addr":"172.21.15.195:6805/28733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.152046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.177399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.123066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:42:21.740 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T10:42:19.632084+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T10:42:19.779089+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T10:42:21.741 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T10:42:22.042 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-04-26T10:42:22.057 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T10:42:22.354 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-04-26T10:42:22.365 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T10:42:22.704 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:22.705 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4218,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6803/4129035646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":4129035646},{"type":"v1","addr":"172.21.15.49:6803","nonce":4129035646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-04-26T10:42:22.705 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 2 2024-04-26T10:42:22.718 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:42:23.008 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:23.009 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":11,"fsid":"9837de44-a9e8-4979-adc4-611f3ddc44ce","created":"2024-04-26T10:42:11.337159+0000","modified":"2024-04-26T10:42:22.401139+0000","last_up_change":"2024-04-26T10:42:19.397933+0000","last_in_change":"2024-04-26T10:42:12.136647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:42:19.632084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:42:19.779089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eabed31c-c043-43de-a756-e217d5287116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":28839},{"type":"v1","addr":"172.21.15.60:6801","nonce":28839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":28839},{"type":"v1","addr":"172.21.15.60:6803","nonce":28839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":28839},{"type":"v1","addr":"172.21.15.60:6807","nonce":28839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":28839},{"type":"v1","addr":"172.21.15.60:6805","nonce":28839}]},"public_addr":"172.21.15.60:6801/28839","cluster_addr":"172.21.15.60:6803/28839","heartbeat_back_addr":"172.21.15.60:6807/28839","heartbeat_front_addr":"172.21.15.60:6805/28839","state":["exists","up"]},{"osd":1,"uuid":"7013621f-db09-4096-bc24-428bb170edd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":28598},{"type":"v1","addr":"172.21.15.87:6801","nonce":28598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":28598},{"type":"v1","addr":"172.21.15.87:6803","nonce":28598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":28598},{"type":"v1","addr":"172.21.15.87:6807","nonce":28598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":28598},{"type":"v1","addr":"172.21.15.87:6805","nonce":28598}]},"public_addr":"172.21.15.87:6801/28598","cluster_addr":"172.21.15.87:6803/28598","heartbeat_back_addr":"172.21.15.87:6807/28598","heartbeat_front_addr":"172.21.15.87:6805/28598","state":["exists","up"]},{"osd":2,"uuid":"a1efeadd-cf55-4ed5-9918-36607fd62229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":28733},{"type":"v1","addr":"172.21.15.195:6801","nonce":28733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":28733},{"type":"v1","addr":"172.21.15.195:6803","nonce":28733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":28733},{"type":"v1","addr":"172.21.15.195:6807","nonce":28733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":28733},{"type":"v1","addr":"172.21.15.195:6805","nonce":28733}]},"public_addr":"172.21.15.195:6801/28733","cluster_addr":"172.21.15.195:6803/28733","heartbeat_back_addr":"172.21.15.195:6807/28733","heartbeat_front_addr":"172.21.15.195:6805/28733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.152046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.177399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.123066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:42:23.022 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T10:42:19.632084+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T10:42:19.779089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T10:42:23.022 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T10:42:23.315 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-04-26T10:42:23.328 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T10:42:23.621 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-04-26T10:42:23.634 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T10:42:23.929 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:23.929 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-04-26T10:42:23.929 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:42:23.929 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-04-26T10:42:23.929 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2024-04-26T10:42:23.929 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:42:23.930 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:42:23.930 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 2, 2024-04-26T10:42:23.930 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": "rbd" 2024-04-26T10:42:23.930 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:42:23.930 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-04-26T10:42:23.941 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T10:42:23.942 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T10:42:24.670 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-04-26T10:42:24.685 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T10:42:25.677 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-04-26T10:42:25.693 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T10:42:26.033 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 3 and data pool 4 2024-04-26T10:42:26.047 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:42:26.345 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:26.345 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":14,"fsid":"9837de44-a9e8-4979-adc4-611f3ddc44ce","created":"2024-04-26T10:42:11.337159+0000","modified":"2024-04-26T10:42:26.027921+0000","last_up_change":"2024-04-26T10:42:19.397933+0000","last_in_change":"2024-04-26T10:42:12.136647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:42:19.632084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:42:19.779089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:42:24.266614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:42:25.014684+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eabed31c-c043-43de-a756-e217d5287116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":28839},{"type":"v1","addr":"172.21.15.60:6801","nonce":28839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":28839},{"type":"v1","addr":"172.21.15.60:6803","nonce":28839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":28839},{"type":"v1","addr":"172.21.15.60:6807","nonce":28839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":28839},{"type":"v1","addr":"172.21.15.60:6805","nonce":28839}]},"public_addr":"172.21.15.60:6801/28839","cluster_addr":"172.21.15.60:6803/28839","heartbeat_back_addr":"172.21.15.60:6807/28839","heartbeat_front_addr":"172.21.15.60:6805/28839","state":["exists","up"]},{"osd":1,"uuid":"7013621f-db09-4096-bc24-428bb170edd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":28598},{"type":"v1","addr":"172.21.15.87:6801","nonce":28598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":28598},{"type":"v1","addr":"172.21.15.87:6803","nonce":28598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":28598},{"type":"v1","addr":"172.21.15.87:6807","nonce":28598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":28598},{"type":"v1","addr":"172.21.15.87:6805","nonce":28598}]},"public_addr":"172.21.15.87:6801/28598","cluster_addr":"172.21.15.87:6803/28598","heartbeat_back_addr":"172.21.15.87:6807/28598","heartbeat_front_addr":"172.21.15.87:6805/28598","state":["exists","up"]},{"osd":2,"uuid":"a1efeadd-cf55-4ed5-9918-36607fd62229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":28733},{"type":"v1","addr":"172.21.15.195:6801","nonce":28733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":28733},{"type":"v1","addr":"172.21.15.195:6803","nonce":28733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":28733},{"type":"v1","addr":"172.21.15.195:6807","nonce":28733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":28733},{"type":"v1","addr":"172.21.15.195:6805","nonce":28733}]},"public_addr":"172.21.15.195:6801/28733","cluster_addr":"172.21.15.195:6803/28733","heartbeat_back_addr":"172.21.15.195:6807/28733","heartbeat_front_addr":"172.21.15.195:6805/28733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.152046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.177399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.123066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:42:26.358 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:42:26.651 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:26.651 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":14,"fsid":"9837de44-a9e8-4979-adc4-611f3ddc44ce","created":"2024-04-26T10:42:11.337159+0000","modified":"2024-04-26T10:42:26.027921+0000","last_up_change":"2024-04-26T10:42:19.397933+0000","last_in_change":"2024-04-26T10:42:12.136647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:42:19.632084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:42:19.779089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:42:24.266614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:42:25.014684+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eabed31c-c043-43de-a756-e217d5287116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":28839},{"type":"v1","addr":"172.21.15.60:6801","nonce":28839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":28839},{"type":"v1","addr":"172.21.15.60:6803","nonce":28839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":28839},{"type":"v1","addr":"172.21.15.60:6807","nonce":28839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":28839},{"type":"v1","addr":"172.21.15.60:6805","nonce":28839}]},"public_addr":"172.21.15.60:6801/28839","cluster_addr":"172.21.15.60:6803/28839","heartbeat_back_addr":"172.21.15.60:6807/28839","heartbeat_front_addr":"172.21.15.60:6805/28839","state":["exists","up"]},{"osd":1,"uuid":"7013621f-db09-4096-bc24-428bb170edd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":28598},{"type":"v1","addr":"172.21.15.87:6801","nonce":28598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":28598},{"type":"v1","addr":"172.21.15.87:6803","nonce":28598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":28598},{"type":"v1","addr":"172.21.15.87:6807","nonce":28598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":28598},{"type":"v1","addr":"172.21.15.87:6805","nonce":28598}]},"public_addr":"172.21.15.87:6801/28598","cluster_addr":"172.21.15.87:6803/28598","heartbeat_back_addr":"172.21.15.87:6807/28598","heartbeat_front_addr":"172.21.15.87:6805/28598","state":["exists","up"]},{"osd":2,"uuid":"a1efeadd-cf55-4ed5-9918-36607fd62229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":28733},{"type":"v1","addr":"172.21.15.195:6801","nonce":28733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":28733},{"type":"v1","addr":"172.21.15.195:6803","nonce":28733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":28733},{"type":"v1","addr":"172.21.15.195:6807","nonce":28733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":28733},{"type":"v1","addr":"172.21.15.195:6805","nonce":28733}]},"public_addr":"172.21.15.195:6801/28733","cluster_addr":"172.21.15.195:6803/28733","heartbeat_back_addr":"172.21.15.195:6807/28733","heartbeat_front_addr":"172.21.15.195:6805/28733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.152046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.177399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.123066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:42:26.664 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T10:42:27.048 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T10:42:27.048 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T10:42:28.055 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T10:42:28.055 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T10:42:28.390 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:28.390 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T10:42:26.028204+0000","modified":"2024-04-26T10:42:28.033502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4218":{"gid":4218,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6803/4129035646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":4129035646},{"type":"v1","addr":"172.21.15.49:6803","nonce":4129035646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T10:42:28.390 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 5 2024-04-26T10:42:28.403 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:42:28.695 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:28.695 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":15,"fsid":"9837de44-a9e8-4979-adc4-611f3ddc44ce","created":"2024-04-26T10:42:11.337159+0000","modified":"2024-04-26T10:42:27.029243+0000","last_up_change":"2024-04-26T10:42:19.397933+0000","last_in_change":"2024-04-26T10:42:12.136647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:42:19.632084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:42:19.779089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:42:24.266614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:42:25.014684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eabed31c-c043-43de-a756-e217d5287116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":28839},{"type":"v1","addr":"172.21.15.60:6801","nonce":28839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":28839},{"type":"v1","addr":"172.21.15.60:6803","nonce":28839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":28839},{"type":"v1","addr":"172.21.15.60:6807","nonce":28839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":28839},{"type":"v1","addr":"172.21.15.60:6805","nonce":28839}]},"public_addr":"172.21.15.60:6801/28839","cluster_addr":"172.21.15.60:6803/28839","heartbeat_back_addr":"172.21.15.60:6807/28839","heartbeat_front_addr":"172.21.15.60:6805/28839","state":["exists","up"]},{"osd":1,"uuid":"7013621f-db09-4096-bc24-428bb170edd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":28598},{"type":"v1","addr":"172.21.15.87:6801","nonce":28598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":28598},{"type":"v1","addr":"172.21.15.87:6803","nonce":28598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":28598},{"type":"v1","addr":"172.21.15.87:6807","nonce":28598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":28598},{"type":"v1","addr":"172.21.15.87:6805","nonce":28598}]},"public_addr":"172.21.15.87:6801/28598","cluster_addr":"172.21.15.87:6803/28598","heartbeat_back_addr":"172.21.15.87:6807/28598","heartbeat_front_addr":"172.21.15.87:6805/28598","state":["exists","up"]},{"osd":2,"uuid":"a1efeadd-cf55-4ed5-9918-36607fd62229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":28733},{"type":"v1","addr":"172.21.15.195:6801","nonce":28733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":28733},{"type":"v1","addr":"172.21.15.195:6803","nonce":28733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":28733},{"type":"v1","addr":"172.21.15.195:6807","nonce":28733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":28733},{"type":"v1","addr":"172.21.15.195:6805","nonce":28733}]},"public_addr":"172.21.15.195:6801/28733","cluster_addr":"172.21.15.195:6803/28733","heartbeat_back_addr":"172.21.15.195:6807/28733","heartbeat_front_addr":"172.21.15.195:6805/28733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.152046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.177399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.123066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:42:28.708 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T10:42:28.708 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:42:29.004 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:29.006 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:42:29.015 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-04-26T10:42:27.592877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95612,"kb_used_data":1448,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283019908,"statfs":{"total":289910292480,"available":289812385792,"internally_reserved":0,"allocated":1482752,"data_stored":1263980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.924175"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":206,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.406857+0000","last_change":"2024-04-26T10:42:21.406599+0000","last_active":"2024-04-26T10:42:22.406857+0000","last_peered":"2024-04-26T10:42:22.406857+0000","last_clean":"2024-04-26T10:42:22.406857+0000","last_became_active":"2024-04-26T10:42:21.405587+0000","last_became_peered":"2024-04-26T10:42:21.405587+0000","last_unstale":"2024-04-26T10:42:22.406857+0000","last_undegraded":"2024-04-26T10:42:22.406857+0000","last_fullsized":"2024-04-26T10:42:22.406857+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:44.561530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.406913+0000","last_change":"2024-04-26T10:42:21.405305+0000","last_active":"2024-04-26T10:42:22.406913+0000","last_peered":"2024-04-26T10:42:22.406913+0000","last_clean":"2024-04-26T10:42:22.406913+0000","last_became_active":"2024-04-26T10:42:21.405032+0000","last_became_peered":"2024-04-26T10:42:21.405032+0000","last_unstale":"2024-04-26T10:42:22.406913+0000","last_undegraded":"2024-04-26T10:42:22.406913+0000","last_fullsized":"2024-04-26T10:42:22.406913+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.406849+0000","last_change":"2024-04-26T10:42:21.406881+0000","last_active":"2024-04-26T10:42:22.406849+0000","last_peered":"2024-04-26T10:42:22.406849+0000","last_clean":"2024-04-26T10:42:22.406849+0000","last_became_active":"2024-04-26T10:42:21.406634+0000","last_became_peered":"2024-04-26T10:42:21.406634+0000","last_unstale":"2024-04-26T10:42:22.406849+0000","last_undegraded":"2024-04-26T10:42:22.406849+0000","last_fullsized":"2024-04-26T10:42:22.406849+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:45.892841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.404410+0000","last_change":"2024-04-26T10:42:21.405597+0000","last_active":"2024-04-26T10:42:22.404410+0000","last_peered":"2024-04-26T10:42:22.404410+0000","last_clean":"2024-04-26T10:42:22.404410+0000","last_became_active":"2024-04-26T10:42:21.405117+0000","last_became_peered":"2024-04-26T10:42:21.405117+0000","last_unstale":"2024-04-26T10:42:22.404410+0000","last_undegraded":"2024-04-26T10:42:22.404410+0000","last_fullsized":"2024-04-26T10:42:22.404410+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.406858+0000","last_change":"2024-04-26T10:42:21.405298+0000","last_active":"2024-04-26T10:42:22.406858+0000","last_peered":"2024-04-26T10:42:22.406858+0000","last_clean":"2024-04-26T10:42:22.406858+0000","last_became_active":"2024-04-26T10:42:21.405011+0000","last_became_peered":"2024-04-26T10:42:21.405011+0000","last_unstale":"2024-04-26T10:42:22.406858+0000","last_undegraded":"2024-04-26T10:42:22.406858+0000","last_fullsized":"2024-04-26T10:42:22.406858+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:47.789961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.404399+0000","last_change":"2024-04-26T10:42:21.405754+0000","last_active":"2024-04-26T10:42:22.404399+0000","last_peered":"2024-04-26T10:42:22.404399+0000","last_clean":"2024-04-26T10:42:22.404399+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:42:22.404399+0000","last_undegraded":"2024-04-26T10:42:22.404399+0000","last_fullsized":"2024-04-26T10:42:22.404399+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:47.123256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.404165+0000","last_change":"2024-04-26T10:42:21.405356+0000","last_active":"2024-04-26T10:42:22.404165+0000","last_peered":"2024-04-26T10:42:22.404165+0000","last_clean":"2024-04-26T10:42:22.404165+0000","last_became_active":"2024-04-26T10:42:21.405006+0000","last_became_peered":"2024-04-26T10:42:21.405006+0000","last_unstale":"2024-04-26T10:42:22.404165+0000","last_undegraded":"2024-04-26T10:42:22.404165+0000","last_fullsized":"2024-04-26T10:42:22.404165+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:55.043967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.404449+0000","last_change":"2024-04-26T10:42:21.405615+0000","last_active":"2024-04-26T10:42:22.404449+0000","last_peered":"2024-04-26T10:42:22.404449+0000","last_clean":"2024-04-26T10:42:22.404449+0000","last_became_active":"2024-04-26T10:42:21.405184+0000","last_became_peered":"2024-04-26T10:42:21.405184+0000","last_unstale":"2024-04-26T10:42:22.404449+0000","last_undegraded":"2024-04-26T10:42:22.404449+0000","last_fullsized":"2024-04-26T10:42:22.404449+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:52.378909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.406866+0000","last_change":"2024-04-26T10:42:21.405863+0000","last_active":"2024-04-26T10:42:22.406866+0000","last_peered":"2024-04-26T10:42:22.406866+0000","last_clean":"2024-04-26T10:42:22.406866+0000","last_became_active":"2024-04-26T10:42:21.405555+0000","last_became_peered":"2024-04-26T10:42:21.405555+0000","last_unstale":"2024-04-26T10:42:22.406866+0000","last_undegraded":"2024-04-26T10:42:22.406866+0000","last_fullsized":"2024-04-26T10:42:22.406866+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:39.259618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31216,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340624,"statfs":{"total":96636764160,"available":96604798976,"internally_reserved":0,"allocated":98304,"data_stored":27748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:42:29.022 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:42:29.351 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:29.353 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:42:29.363 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-04-26T10:42:27.592877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95612,"kb_used_data":1448,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283019908,"statfs":{"total":289910292480,"available":289812385792,"internally_reserved":0,"allocated":1482752,"data_stored":1263980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.924175"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":206,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.406857+0000","last_change":"2024-04-26T10:42:21.406599+0000","last_active":"2024-04-26T10:42:22.406857+0000","last_peered":"2024-04-26T10:42:22.406857+0000","last_clean":"2024-04-26T10:42:22.406857+0000","last_became_active":"2024-04-26T10:42:21.405587+0000","last_became_peered":"2024-04-26T10:42:21.405587+0000","last_unstale":"2024-04-26T10:42:22.406857+0000","last_undegraded":"2024-04-26T10:42:22.406857+0000","last_fullsized":"2024-04-26T10:42:22.406857+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:44.561530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.406913+0000","last_change":"2024-04-26T10:42:21.405305+0000","last_active":"2024-04-26T10:42:22.406913+0000","last_peered":"2024-04-26T10:42:22.406913+0000","last_clean":"2024-04-26T10:42:22.406913+0000","last_became_active":"2024-04-26T10:42:21.405032+0000","last_became_peered":"2024-04-26T10:42:21.405032+0000","last_unstale":"2024-04-26T10:42:22.406913+0000","last_undegraded":"2024-04-26T10:42:22.406913+0000","last_fullsized":"2024-04-26T10:42:22.406913+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.406849+0000","last_change":"2024-04-26T10:42:21.406881+0000","last_active":"2024-04-26T10:42:22.406849+0000","last_peered":"2024-04-26T10:42:22.406849+0000","last_clean":"2024-04-26T10:42:22.406849+0000","last_became_active":"2024-04-26T10:42:21.406634+0000","last_became_peered":"2024-04-26T10:42:21.406634+0000","last_unstale":"2024-04-26T10:42:22.406849+0000","last_undegraded":"2024-04-26T10:42:22.406849+0000","last_fullsized":"2024-04-26T10:42:22.406849+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:45.892841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.404410+0000","last_change":"2024-04-26T10:42:21.405597+0000","last_active":"2024-04-26T10:42:22.404410+0000","last_peered":"2024-04-26T10:42:22.404410+0000","last_clean":"2024-04-26T10:42:22.404410+0000","last_became_active":"2024-04-26T10:42:21.405117+0000","last_became_peered":"2024-04-26T10:42:21.405117+0000","last_unstale":"2024-04-26T10:42:22.404410+0000","last_undegraded":"2024-04-26T10:42:22.404410+0000","last_fullsized":"2024-04-26T10:42:22.404410+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.406858+0000","last_change":"2024-04-26T10:42:21.405298+0000","last_active":"2024-04-26T10:42:22.406858+0000","last_peered":"2024-04-26T10:42:22.406858+0000","last_clean":"2024-04-26T10:42:22.406858+0000","last_became_active":"2024-04-26T10:42:21.405011+0000","last_became_peered":"2024-04-26T10:42:21.405011+0000","last_unstale":"2024-04-26T10:42:22.406858+0000","last_undegraded":"2024-04-26T10:42:22.406858+0000","last_fullsized":"2024-04-26T10:42:22.406858+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:47.789961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.404399+0000","last_change":"2024-04-26T10:42:21.405754+0000","last_active":"2024-04-26T10:42:22.404399+0000","last_peered":"2024-04-26T10:42:22.404399+0000","last_clean":"2024-04-26T10:42:22.404399+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:42:22.404399+0000","last_undegraded":"2024-04-26T10:42:22.404399+0000","last_fullsized":"2024-04-26T10:42:22.404399+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:47.123256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.404165+0000","last_change":"2024-04-26T10:42:21.405356+0000","last_active":"2024-04-26T10:42:22.404165+0000","last_peered":"2024-04-26T10:42:22.404165+0000","last_clean":"2024-04-26T10:42:22.404165+0000","last_became_active":"2024-04-26T10:42:21.405006+0000","last_became_peered":"2024-04-26T10:42:21.405006+0000","last_unstale":"2024-04-26T10:42:22.404165+0000","last_undegraded":"2024-04-26T10:42:22.404165+0000","last_fullsized":"2024-04-26T10:42:22.404165+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:55.043967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.404449+0000","last_change":"2024-04-26T10:42:21.405615+0000","last_active":"2024-04-26T10:42:22.404449+0000","last_peered":"2024-04-26T10:42:22.404449+0000","last_clean":"2024-04-26T10:42:22.404449+0000","last_became_active":"2024-04-26T10:42:21.405184+0000","last_became_peered":"2024-04-26T10:42:21.405184+0000","last_unstale":"2024-04-26T10:42:22.404449+0000","last_undegraded":"2024-04-26T10:42:22.404449+0000","last_fullsized":"2024-04-26T10:42:22.404449+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:52.378909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.406866+0000","last_change":"2024-04-26T10:42:21.405863+0000","last_active":"2024-04-26T10:42:22.406866+0000","last_peered":"2024-04-26T10:42:22.406866+0000","last_clean":"2024-04-26T10:42:22.406866+0000","last_became_active":"2024-04-26T10:42:21.405555+0000","last_became_peered":"2024-04-26T10:42:21.405555+0000","last_unstale":"2024-04-26T10:42:22.406866+0000","last_undegraded":"2024-04-26T10:42:22.406866+0000","last_fullsized":"2024-04-26T10:42:22.406866+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:39.259618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31216,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340624,"statfs":{"total":96636764160,"available":96604798976,"internally_reserved":0,"allocated":98304,"data_stored":27748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:42:29.367 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:42:29.702 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:29.703 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:42:29.713 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-26T10:42:29.593127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95612,"kb_used_data":1448,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283019908,"statfs":{"total":289910292480,"available":289812385792,"internally_reserved":0,"allocated":1482752,"data_stored":1263980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.924425"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":206,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.406857+0000","last_change":"2024-04-26T10:42:21.406599+0000","last_active":"2024-04-26T10:42:22.406857+0000","last_peered":"2024-04-26T10:42:22.406857+0000","last_clean":"2024-04-26T10:42:22.406857+0000","last_became_active":"2024-04-26T10:42:21.405587+0000","last_became_peered":"2024-04-26T10:42:21.405587+0000","last_unstale":"2024-04-26T10:42:22.406857+0000","last_undegraded":"2024-04-26T10:42:22.406857+0000","last_fullsized":"2024-04-26T10:42:22.406857+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:44.561530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.406913+0000","last_change":"2024-04-26T10:42:21.405305+0000","last_active":"2024-04-26T10:42:22.406913+0000","last_peered":"2024-04-26T10:42:22.406913+0000","last_clean":"2024-04-26T10:42:22.406913+0000","last_became_active":"2024-04-26T10:42:21.405032+0000","last_became_peered":"2024-04-26T10:42:21.405032+0000","last_unstale":"2024-04-26T10:42:22.406913+0000","last_undegraded":"2024-04-26T10:42:22.406913+0000","last_fullsized":"2024-04-26T10:42:22.406913+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.406849+0000","last_change":"2024-04-26T10:42:21.406881+0000","last_active":"2024-04-26T10:42:22.406849+0000","last_peered":"2024-04-26T10:42:22.406849+0000","last_clean":"2024-04-26T10:42:22.406849+0000","last_became_active":"2024-04-26T10:42:21.406634+0000","last_became_peered":"2024-04-26T10:42:21.406634+0000","last_unstale":"2024-04-26T10:42:22.406849+0000","last_undegraded":"2024-04-26T10:42:22.406849+0000","last_fullsized":"2024-04-26T10:42:22.406849+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:45.892841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.404410+0000","last_change":"2024-04-26T10:42:21.405597+0000","last_active":"2024-04-26T10:42:22.404410+0000","last_peered":"2024-04-26T10:42:22.404410+0000","last_clean":"2024-04-26T10:42:22.404410+0000","last_became_active":"2024-04-26T10:42:21.405117+0000","last_became_peered":"2024-04-26T10:42:21.405117+0000","last_unstale":"2024-04-26T10:42:22.404410+0000","last_undegraded":"2024-04-26T10:42:22.404410+0000","last_fullsized":"2024-04-26T10:42:22.404410+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.406858+0000","last_change":"2024-04-26T10:42:21.405298+0000","last_active":"2024-04-26T10:42:22.406858+0000","last_peered":"2024-04-26T10:42:22.406858+0000","last_clean":"2024-04-26T10:42:22.406858+0000","last_became_active":"2024-04-26T10:42:21.405011+0000","last_became_peered":"2024-04-26T10:42:21.405011+0000","last_unstale":"2024-04-26T10:42:22.406858+0000","last_undegraded":"2024-04-26T10:42:22.406858+0000","last_fullsized":"2024-04-26T10:42:22.406858+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:47.789961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.404399+0000","last_change":"2024-04-26T10:42:21.405754+0000","last_active":"2024-04-26T10:42:22.404399+0000","last_peered":"2024-04-26T10:42:22.404399+0000","last_clean":"2024-04-26T10:42:22.404399+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:42:22.404399+0000","last_undegraded":"2024-04-26T10:42:22.404399+0000","last_fullsized":"2024-04-26T10:42:22.404399+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:47.123256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.404165+0000","last_change":"2024-04-26T10:42:21.405356+0000","last_active":"2024-04-26T10:42:22.404165+0000","last_peered":"2024-04-26T10:42:22.404165+0000","last_clean":"2024-04-26T10:42:22.404165+0000","last_became_active":"2024-04-26T10:42:21.405006+0000","last_became_peered":"2024-04-26T10:42:21.405006+0000","last_unstale":"2024-04-26T10:42:22.404165+0000","last_undegraded":"2024-04-26T10:42:22.404165+0000","last_fullsized":"2024-04-26T10:42:22.404165+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:55.043967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.404449+0000","last_change":"2024-04-26T10:42:21.405615+0000","last_active":"2024-04-26T10:42:22.404449+0000","last_peered":"2024-04-26T10:42:22.404449+0000","last_clean":"2024-04-26T10:42:22.404449+0000","last_became_active":"2024-04-26T10:42:21.405184+0000","last_became_peered":"2024-04-26T10:42:21.405184+0000","last_unstale":"2024-04-26T10:42:22.404449+0000","last_undegraded":"2024-04-26T10:42:22.404449+0000","last_fullsized":"2024-04-26T10:42:22.404449+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:52.378909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.406866+0000","last_change":"2024-04-26T10:42:21.405863+0000","last_active":"2024-04-26T10:42:22.406866+0000","last_peered":"2024-04-26T10:42:22.406866+0000","last_clean":"2024-04-26T10:42:22.406866+0000","last_became_active":"2024-04-26T10:42:21.405555+0000","last_became_peered":"2024-04-26T10:42:21.405555+0000","last_unstale":"2024-04-26T10:42:22.406866+0000","last_undegraded":"2024-04-26T10:42:22.406866+0000","last_fullsized":"2024-04-26T10:42:22.406866+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:39.259618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31216,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340624,"statfs":{"total":96636764160,"available":96604798976,"internally_reserved":0,"allocated":98304,"data_stored":27748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:42:29.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2024-04-26T10:42:29.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2024-04-26T10:42:29.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2024-04-26T10:42:29.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2024-04-26T10:42:29.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2024-04-26T10:42:29.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2024-04-26T10:42:29.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2024-04-26T10:42:29.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2024-04-26T10:42:29.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2024-04-26T10:42:29.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2024-04-26T10:42:29.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2024-04-26T10:42:29.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2024-04-26T10:42:29.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2024-04-26T10:42:29.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2024-04-26T10:42:29.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2024-04-26T10:42:29.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2024-04-26T10:42:29.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2024-04-26T10:42:29.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2024-04-26T10:42:29.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2024-04-26T10:42:29.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2024-04-26T10:42:29.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2024-04-26T10:42:29.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2024-04-26T10:42:29.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2024-04-26T10:42:29.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2024-04-26T10:42:29.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2024-04-26T10:42:29.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2024-04-26T10:42:29.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2024-04-26T10:42:29.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2024-04-26T10:42:29.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2024-04-26T10:42:29.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2024-04-26T10:42:29.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2024-04-26T10:42:29.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2024-04-26T10:42:29.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-04-26T10:42:29.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-04-26T10:42:29.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-04-26T10:42:29.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-04-26T10:42:29.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-04-26T10:42:29.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-04-26T10:42:29.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-04-26T10:42:29.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-04-26T10:42:29.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-04-26T10:42:29.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-04-26T10:42:29.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-04-26T10:42:29.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-04-26T10:42:29.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-04-26T10:42:29.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-04-26T10:42:29.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-04-26T10:42:29.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.728 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-04-26T10:42:29.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.728 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-04-26T10:42:29.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.728 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-04-26T10:42:29.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.728 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-04-26T10:42:29.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.728 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-04-26T10:42:29.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-04-26T10:42:29.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-04-26T10:42:29.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-04-26T10:42:29.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-04-26T10:42:29.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-04-26T10:42:29.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.730 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-04-26T10:42:29.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.730 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-04-26T10:42:29.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.730 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-04-26T10:42:29.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.730 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-04-26T10:42:29.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.730 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-04-26T10:42:29.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-04-26T10:42:29.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-04-26T10:42:29.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-04-26T10:42:29.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-04-26T10:42:29.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-04-26T10:42:29.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-04-26T10:42:29.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-04-26T10:42:29.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-04-26T10:42:29.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-04-26T10:42:29.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-04-26T10:42:29.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-04-26T10:42:29.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-04-26T10:42:29.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-04-26T10:42:29.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-04-26T10:42:29.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-04-26T10:42:29.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-04-26T10:42:29.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-04-26T10:42:29.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-04-26T10:42:29.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-04-26T10:42:29.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-04-26T10:42:29.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-04-26T10:42:29.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-04-26T10:42:29.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-04-26T10:42:29.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-04-26T10:42:29.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-04-26T10:42:29.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-04-26T10:42:29.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-04-26T10:42:29.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-04-26T10:42:29.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-04-26T10:42:29.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-04-26T10:42:29.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-04-26T10:42:29.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-04-26T10:42:29.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-04-26T10:42:29.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:25.668802+0000', 'last_change': '2024-04-26T10:42:25.668802+0000', 'last_active': '2024-04-26T10:42:25.668802+0000', 'last_peered': '2024-04-26T10:42:25.668802+0000', 'last_clean': '2024-04-26T10:42:25.668802+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:25.668802+0000', 'last_undegraded': '2024-04-26T10:42:25.668802+0000', 'last_fullsized': '2024-04-26T10:42:25.668802+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:25.668802+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-04-26T10:42:29.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:42:24.664396+0000', 'last_change': '2024-04-26T10:42:24.664396+0000', 'last_active': '2024-04-26T10:42:24.664396+0000', 'last_peered': '2024-04-26T10:42:24.664396+0000', 'last_clean': '2024-04-26T10:42:24.664396+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:42:24.664396+0000', 'last_undegraded': '2024-04-26T10:42:24.664396+0000', 'last_fullsized': '2024-04-26T10:42:24.664396+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'last_clean_scrub_stamp': '2024-04-26T10:42:24.664396+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:42:29.737 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T10:42:30.119 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:30.119 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"9837de44-a9e8-4979-adc4-611f3ddc44ce","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":18,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":15,"num_osds":3,"num_up_osds":3,"osd_up_since":1714128139,"num_in_osds":3,"osd_in_since":1714128132,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":97906688,"bytes_avail":289812385792,"bytes_total":289910292480,"unknown_pgs_ratio":0.91428571939468384},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4218}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-26T10:42:11.337949+0000","services":{}},"progress_events":{}} 2024-04-26T10:42:30.132 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-26T10:42:30.133 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:42:30.428 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:30.429 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:42:30.439 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-26T10:42:29.593127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95612,"kb_used_data":1448,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283019908,"statfs":{"total":289910292480,"available":289812385792,"internally_reserved":0,"allocated":1482752,"data_stored":1263980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.924425"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":206,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.406857+0000","last_change":"2024-04-26T10:42:21.406599+0000","last_active":"2024-04-26T10:42:22.406857+0000","last_peered":"2024-04-26T10:42:22.406857+0000","last_clean":"2024-04-26T10:42:22.406857+0000","last_became_active":"2024-04-26T10:42:21.405587+0000","last_became_peered":"2024-04-26T10:42:21.405587+0000","last_unstale":"2024-04-26T10:42:22.406857+0000","last_undegraded":"2024-04-26T10:42:22.406857+0000","last_fullsized":"2024-04-26T10:42:22.406857+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:44.561530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.406913+0000","last_change":"2024-04-26T10:42:21.405305+0000","last_active":"2024-04-26T10:42:22.406913+0000","last_peered":"2024-04-26T10:42:22.406913+0000","last_clean":"2024-04-26T10:42:22.406913+0000","last_became_active":"2024-04-26T10:42:21.405032+0000","last_became_peered":"2024-04-26T10:42:21.405032+0000","last_unstale":"2024-04-26T10:42:22.406913+0000","last_undegraded":"2024-04-26T10:42:22.406913+0000","last_fullsized":"2024-04-26T10:42:22.406913+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.406849+0000","last_change":"2024-04-26T10:42:21.406881+0000","last_active":"2024-04-26T10:42:22.406849+0000","last_peered":"2024-04-26T10:42:22.406849+0000","last_clean":"2024-04-26T10:42:22.406849+0000","last_became_active":"2024-04-26T10:42:21.406634+0000","last_became_peered":"2024-04-26T10:42:21.406634+0000","last_unstale":"2024-04-26T10:42:22.406849+0000","last_undegraded":"2024-04-26T10:42:22.406849+0000","last_fullsized":"2024-04-26T10:42:22.406849+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:45.892841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.404410+0000","last_change":"2024-04-26T10:42:21.405597+0000","last_active":"2024-04-26T10:42:22.404410+0000","last_peered":"2024-04-26T10:42:22.404410+0000","last_clean":"2024-04-26T10:42:22.404410+0000","last_became_active":"2024-04-26T10:42:21.405117+0000","last_became_peered":"2024-04-26T10:42:21.405117+0000","last_unstale":"2024-04-26T10:42:22.404410+0000","last_undegraded":"2024-04-26T10:42:22.404410+0000","last_fullsized":"2024-04-26T10:42:22.404410+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.406858+0000","last_change":"2024-04-26T10:42:21.405298+0000","last_active":"2024-04-26T10:42:22.406858+0000","last_peered":"2024-04-26T10:42:22.406858+0000","last_clean":"2024-04-26T10:42:22.406858+0000","last_became_active":"2024-04-26T10:42:21.405011+0000","last_became_peered":"2024-04-26T10:42:21.405011+0000","last_unstale":"2024-04-26T10:42:22.406858+0000","last_undegraded":"2024-04-26T10:42:22.406858+0000","last_fullsized":"2024-04-26T10:42:22.406858+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:47.789961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.404399+0000","last_change":"2024-04-26T10:42:21.405754+0000","last_active":"2024-04-26T10:42:22.404399+0000","last_peered":"2024-04-26T10:42:22.404399+0000","last_clean":"2024-04-26T10:42:22.404399+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:42:22.404399+0000","last_undegraded":"2024-04-26T10:42:22.404399+0000","last_fullsized":"2024-04-26T10:42:22.404399+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:47.123256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.404165+0000","last_change":"2024-04-26T10:42:21.405356+0000","last_active":"2024-04-26T10:42:22.404165+0000","last_peered":"2024-04-26T10:42:22.404165+0000","last_clean":"2024-04-26T10:42:22.404165+0000","last_became_active":"2024-04-26T10:42:21.405006+0000","last_became_peered":"2024-04-26T10:42:21.405006+0000","last_unstale":"2024-04-26T10:42:22.404165+0000","last_undegraded":"2024-04-26T10:42:22.404165+0000","last_fullsized":"2024-04-26T10:42:22.404165+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:55.043967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.404449+0000","last_change":"2024-04-26T10:42:21.405615+0000","last_active":"2024-04-26T10:42:22.404449+0000","last_peered":"2024-04-26T10:42:22.404449+0000","last_clean":"2024-04-26T10:42:22.404449+0000","last_became_active":"2024-04-26T10:42:21.405184+0000","last_became_peered":"2024-04-26T10:42:21.405184+0000","last_unstale":"2024-04-26T10:42:22.404449+0000","last_undegraded":"2024-04-26T10:42:22.404449+0000","last_fullsized":"2024-04-26T10:42:22.404449+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:52.378909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:42:22.406866+0000","last_change":"2024-04-26T10:42:21.405863+0000","last_active":"2024-04-26T10:42:22.406866+0000","last_peered":"2024-04-26T10:42:22.406866+0000","last_clean":"2024-04-26T10:42:22.406866+0000","last_became_active":"2024-04-26T10:42:21.405555+0000","last_became_peered":"2024-04-26T10:42:21.405555+0000","last_unstale":"2024-04-26T10:42:22.406866+0000","last_undegraded":"2024-04-26T10:42:22.406866+0000","last_fullsized":"2024-04-26T10:42:22.406866+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:39.259618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:25.668802+0000","last_change":"2024-04-26T10:42:25.668802+0000","last_active":"2024-04-26T10:42:25.668802+0000","last_peered":"2024-04-26T10:42:25.668802+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:25.668802+0000","last_undegraded":"2024-04-26T10:42:25.668802+0000","last_fullsized":"2024-04-26T10:42:25.668802+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:42:24.664396+0000","last_change":"2024-04-26T10:42:24.664396+0000","last_active":"2024-04-26T10:42:24.664396+0000","last_peered":"2024-04-26T10:42:24.664396+0000","last_clean":"2024-04-26T10:42:24.664396+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:42:24.664396+0000","last_undegraded":"2024-04-26T10:42:24.664396+0000","last_fullsized":"2024-04-26T10:42:24.664396+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31216,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340624,"statfs":{"total":96636764160,"available":96604798976,"internally_reserved":0,"allocated":98304,"data_stored":27748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:42:31.505 INFO:tasks.ceph.mds.a.smithi049.stderr:2024-04-26T10:42:31.504+0000 7f603efd9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T10:42:33.445 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:42:33.757 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:33.760 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:42:33.768 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-26T10:42:33.593918+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94984,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283020536,"statfs":{"total":289910292480,"available":289813028864,"internally_reserved":0,"allocated":1646592,"data_stored":1323601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.920590"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033761+0000","last_change":"2024-04-26T10:42:26.045527+0000","last_active":"2024-04-26T10:42:27.033761+0000","last_peered":"2024-04-26T10:42:27.033761+0000","last_clean":"2024-04-26T10:42:27.033761+0000","last_became_active":"2024-04-26T10:42:26.044597+0000","last_became_peered":"2024-04-26T10:42:26.044597+0000","last_unstale":"2024-04-26T10:42:27.033761+0000","last_undegraded":"2024-04-26T10:42:27.033761+0000","last_fullsized":"2024-04-26T10:42:27.033761+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033531+0000","last_change":"2024-04-26T10:42:26.043815+0000","last_active":"2024-04-26T10:42:27.033531+0000","last_peered":"2024-04-26T10:42:27.033531+0000","last_clean":"2024-04-26T10:42:27.033531+0000","last_became_active":"2024-04-26T10:42:26.042757+0000","last_became_peered":"2024-04-26T10:42:26.042757+0000","last_unstale":"2024-04-26T10:42:27.033531+0000","last_undegraded":"2024-04-26T10:42:27.033531+0000","last_fullsized":"2024-04-26T10:42:27.033531+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:27.752674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033378+0000","last_change":"2024-04-26T10:42:26.041030+0000","last_active":"2024-04-26T10:42:27.033378+0000","last_peered":"2024-04-26T10:42:27.033378+0000","last_clean":"2024-04-26T10:42:27.033378+0000","last_became_active":"2024-04-26T10:42:26.039762+0000","last_became_peered":"2024-04-26T10:42:26.039762+0000","last_unstale":"2024-04-26T10:42:27.033378+0000","last_undegraded":"2024-04-26T10:42:27.033378+0000","last_fullsized":"2024-04-26T10:42:27.033378+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033311+0000","last_change":"2024-04-26T10:42:26.044004+0000","last_active":"2024-04-26T10:42:27.033311+0000","last_peered":"2024-04-26T10:42:27.033311+0000","last_clean":"2024-04-26T10:42:27.033311+0000","last_became_active":"2024-04-26T10:42:26.042953+0000","last_became_peered":"2024-04-26T10:42:26.042953+0000","last_unstale":"2024-04-26T10:42:27.033311+0000","last_undegraded":"2024-04-26T10:42:27.033311+0000","last_fullsized":"2024-04-26T10:42:27.033311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.895922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033277+0000","last_change":"2024-04-26T10:42:26.041191+0000","last_active":"2024-04-26T10:42:27.033277+0000","last_peered":"2024-04-26T10:42:27.033277+0000","last_clean":"2024-04-26T10:42:27.033277+0000","last_became_active":"2024-04-26T10:42:26.040487+0000","last_became_peered":"2024-04-26T10:42:26.040487+0000","last_unstale":"2024-04-26T10:42:27.033277+0000","last_undegraded":"2024-04-26T10:42:27.033277+0000","last_fullsized":"2024-04-26T10:42:27.033277+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032976+0000","last_change":"2024-04-26T10:42:26.043542+0000","last_active":"2024-04-26T10:42:27.032976+0000","last_peered":"2024-04-26T10:42:27.032976+0000","last_clean":"2024-04-26T10:42:27.032976+0000","last_became_active":"2024-04-26T10:42:26.042631+0000","last_became_peered":"2024-04-26T10:42:26.042631+0000","last_unstale":"2024-04-26T10:42:27.032976+0000","last_undegraded":"2024-04-26T10:42:27.032976+0000","last_fullsized":"2024-04-26T10:42:27.032976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:38.272126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033024+0000","last_change":"2024-04-26T10:42:26.042698+0000","last_active":"2024-04-26T10:42:27.033024+0000","last_peered":"2024-04-26T10:42:27.033024+0000","last_clean":"2024-04-26T10:42:27.033024+0000","last_became_active":"2024-04-26T10:42:26.041631+0000","last_became_peered":"2024-04-26T10:42:26.041631+0000","last_unstale":"2024-04-26T10:42:27.033024+0000","last_undegraded":"2024-04-26T10:42:27.033024+0000","last_fullsized":"2024-04-26T10:42:27.033024+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:27.752674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032694+0000","last_change":"2024-04-26T10:42:26.045497+0000","last_active":"2024-04-26T10:42:27.032694+0000","last_peered":"2024-04-26T10:42:27.032694+0000","last_clean":"2024-04-26T10:42:27.032694+0000","last_became_active":"2024-04-26T10:42:26.044865+0000","last_became_peered":"2024-04-26T10:42:26.044865+0000","last_unstale":"2024-04-26T10:42:27.032694+0000","last_undegraded":"2024-04-26T10:42:27.032694+0000","last_fullsized":"2024-04-26T10:42:27.032694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:59:04.853293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033544+0000","last_change":"2024-04-26T10:42:26.045893+0000","last_active":"2024-04-26T10:42:27.033544+0000","last_peered":"2024-04-26T10:42:27.033544+0000","last_clean":"2024-04-26T10:42:27.033544+0000","last_became_active":"2024-04-26T10:42:26.045177+0000","last_became_peered":"2024-04-26T10:42:26.045177+0000","last_unstale":"2024-04-26T10:42:27.033544+0000","last_undegraded":"2024-04-26T10:42:27.033544+0000","last_fullsized":"2024-04-26T10:42:27.033544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033494+0000","last_change":"2024-04-26T10:42:26.044101+0000","last_active":"2024-04-26T10:42:27.033494+0000","last_peered":"2024-04-26T10:42:27.033494+0000","last_clean":"2024-04-26T10:42:27.033494+0000","last_became_active":"2024-04-26T10:42:26.042047+0000","last_became_peered":"2024-04-26T10:42:26.042047+0000","last_unstale":"2024-04-26T10:42:27.033494+0000","last_undegraded":"2024-04-26T10:42:27.033494+0000","last_fullsized":"2024-04-26T10:42:27.033494+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:46.975947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033560+0000","last_change":"2024-04-26T10:42:26.043530+0000","last_active":"2024-04-26T10:42:27.033560+0000","last_peered":"2024-04-26T10:42:27.033560+0000","last_clean":"2024-04-26T10:42:27.033560+0000","last_became_active":"2024-04-26T10:42:26.042301+0000","last_became_peered":"2024-04-26T10:42:26.042301+0000","last_unstale":"2024-04-26T10:42:27.033560+0000","last_undegraded":"2024-04-26T10:42:27.033560+0000","last_fullsized":"2024-04-26T10:42:27.033560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:48.440963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033166+0000","last_change":"2024-04-26T10:42:26.047073+0000","last_active":"2024-04-26T10:42:27.033166+0000","last_peered":"2024-04-26T10:42:27.033166+0000","last_clean":"2024-04-26T10:42:27.033166+0000","last_became_active":"2024-04-26T10:42:26.046384+0000","last_became_peered":"2024-04-26T10:42:26.046384+0000","last_unstale":"2024-04-26T10:42:27.033166+0000","last_undegraded":"2024-04-26T10:42:27.033166+0000","last_fullsized":"2024-04-26T10:42:27.033166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:23.079349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032981+0000","last_change":"2024-04-26T10:42:26.042607+0000","last_active":"2024-04-26T10:42:27.032981+0000","last_peered":"2024-04-26T10:42:27.032981+0000","last_clean":"2024-04-26T10:42:27.032981+0000","last_became_active":"2024-04-26T10:42:26.041617+0000","last_became_peered":"2024-04-26T10:42:26.041617+0000","last_unstale":"2024-04-26T10:42:27.032981+0000","last_undegraded":"2024-04-26T10:42:27.032981+0000","last_fullsized":"2024-04-26T10:42:27.032981+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033143+0000","last_change":"2024-04-26T10:42:26.040433+0000","last_active":"2024-04-26T10:42:27.033143+0000","last_peered":"2024-04-26T10:42:27.033143+0000","last_clean":"2024-04-26T10:42:27.033143+0000","last_became_active":"2024-04-26T10:42:26.039631+0000","last_became_peered":"2024-04-26T10:42:26.039631+0000","last_unstale":"2024-04-26T10:42:27.033143+0000","last_undegraded":"2024-04-26T10:42:27.033143+0000","last_fullsized":"2024-04-26T10:42:27.033143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033116+0000","last_change":"2024-04-26T10:42:26.040182+0000","last_active":"2024-04-26T10:42:27.033116+0000","last_peered":"2024-04-26T10:42:27.033116+0000","last_clean":"2024-04-26T10:42:27.033116+0000","last_became_active":"2024-04-26T10:42:26.038614+0000","last_became_peered":"2024-04-26T10:42:26.038614+0000","last_unstale":"2024-04-26T10:42:27.033116+0000","last_undegraded":"2024-04-26T10:42:27.033116+0000","last_fullsized":"2024-04-26T10:42:27.033116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032762+0000","last_change":"2024-04-26T10:42:26.045551+0000","last_active":"2024-04-26T10:42:27.032762+0000","last_peered":"2024-04-26T10:42:27.032762+0000","last_clean":"2024-04-26T10:42:27.032762+0000","last_became_active":"2024-04-26T10:42:26.044944+0000","last_became_peered":"2024-04-26T10:42:26.044944+0000","last_unstale":"2024-04-26T10:42:27.032762+0000","last_undegraded":"2024-04-26T10:42:27.032762+0000","last_fullsized":"2024-04-26T10:42:27.032762+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:02.194279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033885+0000","last_change":"2024-04-26T10:42:26.049338+0000","last_active":"2024-04-26T10:42:27.033885+0000","last_peered":"2024-04-26T10:42:27.033885+0000","last_clean":"2024-04-26T10:42:27.033885+0000","last_became_active":"2024-04-26T10:42:26.049014+0000","last_became_peered":"2024-04-26T10:42:26.049014+0000","last_unstale":"2024-04-26T10:42:27.033885+0000","last_undegraded":"2024-04-26T10:42:27.033885+0000","last_fullsized":"2024-04-26T10:42:27.033885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033767+0000","last_change":"2024-04-26T10:42:26.043604+0000","last_active":"2024-04-26T10:42:27.033767+0000","last_peered":"2024-04-26T10:42:27.033767+0000","last_clean":"2024-04-26T10:42:27.033767+0000","last_became_active":"2024-04-26T10:42:26.041224+0000","last_became_peered":"2024-04-26T10:42:26.041224+0000","last_unstale":"2024-04-26T10:42:27.033767+0000","last_undegraded":"2024-04-26T10:42:27.033767+0000","last_fullsized":"2024-04-26T10:42:27.033767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033328+0000","last_change":"2024-04-26T10:42:26.045031+0000","last_active":"2024-04-26T10:42:27.033328+0000","last_peered":"2024-04-26T10:42:27.033328+0000","last_clean":"2024-04-26T10:42:27.033328+0000","last_became_active":"2024-04-26T10:42:26.044604+0000","last_became_peered":"2024-04-26T10:42:26.044604+0000","last_unstale":"2024-04-26T10:42:27.033328+0000","last_undegraded":"2024-04-26T10:42:27.033328+0000","last_fullsized":"2024-04-26T10:42:27.033328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033728+0000","last_change":"2024-04-26T10:42:26.043762+0000","last_active":"2024-04-26T10:42:27.033728+0000","last_peered":"2024-04-26T10:42:27.033728+0000","last_clean":"2024-04-26T10:42:27.033728+0000","last_became_active":"2024-04-26T10:42:26.042117+0000","last_became_peered":"2024-04-26T10:42:26.042117+0000","last_unstale":"2024-04-26T10:42:27.033728+0000","last_undegraded":"2024-04-26T10:42:27.033728+0000","last_fullsized":"2024-04-26T10:42:27.033728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:35.276961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033416+0000","last_change":"2024-04-26T10:42:26.044062+0000","last_active":"2024-04-26T10:42:27.033416+0000","last_peered":"2024-04-26T10:42:27.033416+0000","last_clean":"2024-04-26T10:42:27.033416+0000","last_became_active":"2024-04-26T10:42:26.042378+0000","last_became_peered":"2024-04-26T10:42:26.042378+0000","last_unstale":"2024-04-26T10:42:27.033416+0000","last_undegraded":"2024-04-26T10:42:27.033416+0000","last_fullsized":"2024-04-26T10:42:27.033416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:24.255706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032809+0000","last_change":"2024-04-26T10:42:26.046353+0000","last_active":"2024-04-26T10:42:27.032809+0000","last_peered":"2024-04-26T10:42:27.032809+0000","last_clean":"2024-04-26T10:42:27.032809+0000","last_became_active":"2024-04-26T10:42:26.045614+0000","last_became_peered":"2024-04-26T10:42:26.045614+0000","last_unstale":"2024-04-26T10:42:27.032809+0000","last_undegraded":"2024-04-26T10:42:27.032809+0000","last_fullsized":"2024-04-26T10:42:27.032809+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:19.601720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032687+0000","last_change":"2024-04-26T10:42:26.045311+0000","last_active":"2024-04-26T10:42:27.032687+0000","last_peered":"2024-04-26T10:42:27.032687+0000","last_clean":"2024-04-26T10:42:27.032687+0000","last_became_active":"2024-04-26T10:42:26.044614+0000","last_became_peered":"2024-04-26T10:42:26.044614+0000","last_unstale":"2024-04-26T10:42:27.032687+0000","last_undegraded":"2024-04-26T10:42:27.032687+0000","last_fullsized":"2024-04-26T10:42:27.032687+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032624+0000","last_change":"2024-04-26T10:42:26.043614+0000","last_active":"2024-04-26T10:42:27.032624+0000","last_peered":"2024-04-26T10:42:27.032624+0000","last_clean":"2024-04-26T10:42:27.032624+0000","last_became_active":"2024-04-26T10:42:26.042629+0000","last_became_peered":"2024-04-26T10:42:26.042629+0000","last_unstale":"2024-04-26T10:42:27.032624+0000","last_undegraded":"2024-04-26T10:42:27.032624+0000","last_fullsized":"2024-04-26T10:42:27.032624+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033909+0000","last_change":"2024-04-26T10:42:26.046876+0000","last_active":"2024-04-26T10:42:27.033909+0000","last_peered":"2024-04-26T10:42:27.033909+0000","last_clean":"2024-04-26T10:42:27.033909+0000","last_became_active":"2024-04-26T10:42:26.046177+0000","last_became_peered":"2024-04-26T10:42:26.046177+0000","last_unstale":"2024-04-26T10:42:27.033909+0000","last_undegraded":"2024-04-26T10:42:27.033909+0000","last_fullsized":"2024-04-26T10:42:27.033909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:51.567162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033546+0000","last_change":"2024-04-26T10:42:26.044190+0000","last_active":"2024-04-26T10:42:27.033546+0000","last_peered":"2024-04-26T10:42:27.033546+0000","last_clean":"2024-04-26T10:42:27.033546+0000","last_became_active":"2024-04-26T10:42:26.043736+0000","last_became_peered":"2024-04-26T10:42:26.043736+0000","last_unstale":"2024-04-26T10:42:27.033546+0000","last_undegraded":"2024-04-26T10:42:27.033546+0000","last_fullsized":"2024-04-26T10:42:27.033546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033729+0000","last_change":"2024-04-26T10:42:26.041008+0000","last_active":"2024-04-26T10:42:27.033729+0000","last_peered":"2024-04-26T10:42:27.033729+0000","last_clean":"2024-04-26T10:42:27.033729+0000","last_became_active":"2024-04-26T10:42:26.039620+0000","last_became_peered":"2024-04-26T10:42:26.039620+0000","last_unstale":"2024-04-26T10:42:27.033729+0000","last_undegraded":"2024-04-26T10:42:27.033729+0000","last_fullsized":"2024-04-26T10:42:27.033729+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033575+0000","last_change":"2024-04-26T10:42:26.046392+0000","last_active":"2024-04-26T10:42:27.033575+0000","last_peered":"2024-04-26T10:42:27.033575+0000","last_clean":"2024-04-26T10:42:27.033575+0000","last_became_active":"2024-04-26T10:42:26.045806+0000","last_became_peered":"2024-04-26T10:42:26.045806+0000","last_unstale":"2024-04-26T10:42:27.033575+0000","last_undegraded":"2024-04-26T10:42:27.033575+0000","last_fullsized":"2024-04-26T10:42:27.033575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:15:59.087635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033383+0000","last_change":"2024-04-26T10:42:26.045205+0000","last_active":"2024-04-26T10:42:27.033383+0000","last_peered":"2024-04-26T10:42:27.033383+0000","last_clean":"2024-04-26T10:42:27.033383+0000","last_became_active":"2024-04-26T10:42:26.044762+0000","last_became_peered":"2024-04-26T10:42:26.044762+0000","last_unstale":"2024-04-26T10:42:27.033383+0000","last_undegraded":"2024-04-26T10:42:27.033383+0000","last_fullsized":"2024-04-26T10:42:27.033383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033051+0000","last_change":"2024-04-26T10:42:26.046020+0000","last_active":"2024-04-26T10:42:27.033051+0000","last_peered":"2024-04-26T10:42:27.033051+0000","last_clean":"2024-04-26T10:42:27.033051+0000","last_became_active":"2024-04-26T10:42:26.045567+0000","last_became_peered":"2024-04-26T10:42:26.045567+0000","last_unstale":"2024-04-26T10:42:27.033051+0000","last_undegraded":"2024-04-26T10:42:27.033051+0000","last_fullsized":"2024-04-26T10:42:27.033051+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:53.380329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032770+0000","last_change":"2024-04-26T10:42:26.046584+0000","last_active":"2024-04-26T10:42:27.032770+0000","last_peered":"2024-04-26T10:42:27.032770+0000","last_clean":"2024-04-26T10:42:27.032770+0000","last_became_active":"2024-04-26T10:42:26.046231+0000","last_became_peered":"2024-04-26T10:42:26.046231+0000","last_unstale":"2024-04-26T10:42:27.032770+0000","last_undegraded":"2024-04-26T10:42:27.032770+0000","last_fullsized":"2024-04-26T10:42:27.032770+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032953+0000","last_change":"2024-04-26T10:42:26.045270+0000","last_active":"2024-04-26T10:42:27.032953+0000","last_peered":"2024-04-26T10:42:27.032953+0000","last_clean":"2024-04-26T10:42:27.032953+0000","last_became_active":"2024-04-26T10:42:26.044341+0000","last_became_peered":"2024-04-26T10:42:26.044341+0000","last_unstale":"2024-04-26T10:42:27.032953+0000","last_undegraded":"2024-04-26T10:42:27.032953+0000","last_fullsized":"2024-04-26T10:42:27.032953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:46.975947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033573+0000","last_change":"2024-04-26T10:42:26.041757+0000","last_active":"2024-04-26T10:42:27.033573+0000","last_peered":"2024-04-26T10:42:27.033573+0000","last_clean":"2024-04-26T10:42:27.033573+0000","last_became_active":"2024-04-26T10:42:26.040920+0000","last_became_peered":"2024-04-26T10:42:26.040920+0000","last_unstale":"2024-04-26T10:42:27.033573+0000","last_undegraded":"2024-04-26T10:42:27.033573+0000","last_fullsized":"2024-04-26T10:42:27.033573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033905+0000","last_change":"2024-04-26T10:42:25.687138+0000","last_active":"2024-04-26T10:42:27.033905+0000","last_peered":"2024-04-26T10:42:27.033905+0000","last_clean":"2024-04-26T10:42:27.033905+0000","last_became_active":"2024-04-26T10:42:25.686488+0000","last_became_peered":"2024-04-26T10:42:25.686488+0000","last_unstale":"2024-04-26T10:42:27.033905+0000","last_undegraded":"2024-04-26T10:42:27.033905+0000","last_fullsized":"2024-04-26T10:42:27.033905+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:43.969731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033779+0000","last_change":"2024-04-26T10:42:26.041850+0000","last_active":"2024-04-26T10:42:27.033779+0000","last_peered":"2024-04-26T10:42:27.033779+0000","last_clean":"2024-04-26T10:42:27.033779+0000","last_became_active":"2024-04-26T10:42:26.040464+0000","last_became_peered":"2024-04-26T10:42:26.040464+0000","last_unstale":"2024-04-26T10:42:27.033779+0000","last_undegraded":"2024-04-26T10:42:27.033779+0000","last_fullsized":"2024-04-26T10:42:27.033779+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033039+0000","last_change":"2024-04-26T10:42:25.685525+0000","last_active":"2024-04-26T10:42:27.033039+0000","last_peered":"2024-04-26T10:42:27.033039+0000","last_clean":"2024-04-26T10:42:27.033039+0000","last_became_active":"2024-04-26T10:42:25.684855+0000","last_became_peered":"2024-04-26T10:42:25.684855+0000","last_unstale":"2024-04-26T10:42:27.033039+0000","last_undegraded":"2024-04-26T10:42:27.033039+0000","last_fullsized":"2024-04-26T10:42:27.033039+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:16.723401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033789+0000","last_change":"2024-04-26T10:42:26.046616+0000","last_active":"2024-04-26T10:42:27.033789+0000","last_peered":"2024-04-26T10:42:27.033789+0000","last_clean":"2024-04-26T10:42:27.033789+0000","last_became_active":"2024-04-26T10:42:26.046010+0000","last_became_peered":"2024-04-26T10:42:26.046010+0000","last_unstale":"2024-04-26T10:42:27.033789+0000","last_undegraded":"2024-04-26T10:42:27.033789+0000","last_fullsized":"2024-04-26T10:42:27.033789+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:19.601720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032884+0000","last_change":"2024-04-26T10:42:25.688905+0000","last_active":"2024-04-26T10:42:27.032884+0000","last_peered":"2024-04-26T10:42:27.032884+0000","last_clean":"2024-04-26T10:42:27.032884+0000","last_became_active":"2024-04-26T10:42:25.688504+0000","last_became_peered":"2024-04-26T10:42:25.688504+0000","last_unstale":"2024-04-26T10:42:27.032884+0000","last_undegraded":"2024-04-26T10:42:27.032884+0000","last_fullsized":"2024-04-26T10:42:27.032884+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.930441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033655+0000","last_change":"2024-04-26T10:42:26.046158+0000","last_active":"2024-04-26T10:42:27.033655+0000","last_peered":"2024-04-26T10:42:27.033655+0000","last_clean":"2024-04-26T10:42:27.033655+0000","last_became_active":"2024-04-26T10:42:26.045797+0000","last_became_peered":"2024-04-26T10:42:26.045797+0000","last_unstale":"2024-04-26T10:42:27.033655+0000","last_undegraded":"2024-04-26T10:42:27.033655+0000","last_fullsized":"2024-04-26T10:42:27.033655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:23.079349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032889+0000","last_change":"2024-04-26T10:42:25.687207+0000","last_active":"2024-04-26T10:42:27.032889+0000","last_peered":"2024-04-26T10:42:27.032889+0000","last_clean":"2024-04-26T10:42:27.032889+0000","last_became_active":"2024-04-26T10:42:25.686549+0000","last_became_peered":"2024-04-26T10:42:25.686549+0000","last_unstale":"2024-04-26T10:42:27.032889+0000","last_undegraded":"2024-04-26T10:42:27.032889+0000","last_fullsized":"2024-04-26T10:42:27.032889+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:42.125386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033731+0000","last_change":"2024-04-26T10:42:25.684462+0000","last_active":"2024-04-26T10:42:27.033731+0000","last_peered":"2024-04-26T10:42:27.033731+0000","last_clean":"2024-04-26T10:42:27.033731+0000","last_became_active":"2024-04-26T10:42:25.684162+0000","last_became_peered":"2024-04-26T10:42:25.684162+0000","last_unstale":"2024-04-26T10:42:27.033731+0000","last_undegraded":"2024-04-26T10:42:27.033731+0000","last_fullsized":"2024-04-26T10:42:27.033731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.850118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032640+0000","last_change":"2024-04-26T10:42:26.048114+0000","last_active":"2024-04-26T10:42:27.032640+0000","last_peered":"2024-04-26T10:42:27.032640+0000","last_clean":"2024-04-26T10:42:27.032640+0000","last_became_active":"2024-04-26T10:42:26.046641+0000","last_became_peered":"2024-04-26T10:42:26.046641+0000","last_unstale":"2024-04-26T10:42:27.032640+0000","last_undegraded":"2024-04-26T10:42:27.032640+0000","last_fullsized":"2024-04-26T10:42:27.032640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:01.056945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033763+0000","last_change":"2024-04-26T10:42:25.688889+0000","last_active":"2024-04-26T10:42:27.033763+0000","last_peered":"2024-04-26T10:42:27.033763+0000","last_clean":"2024-04-26T10:42:27.033763+0000","last_became_active":"2024-04-26T10:42:25.688372+0000","last_became_peered":"2024-04-26T10:42:25.688372+0000","last_unstale":"2024-04-26T10:42:27.033763+0000","last_undegraded":"2024-04-26T10:42:27.033763+0000","last_fullsized":"2024-04-26T10:42:27.033763+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:13.799290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032734+0000","last_change":"2024-04-26T10:42:26.041968+0000","last_active":"2024-04-26T10:42:27.032734+0000","last_peered":"2024-04-26T10:42:27.032734+0000","last_clean":"2024-04-26T10:42:27.032734+0000","last_became_active":"2024-04-26T10:42:26.041070+0000","last_became_peered":"2024-04-26T10:42:26.041070+0000","last_unstale":"2024-04-26T10:42:27.032734+0000","last_undegraded":"2024-04-26T10:42:27.032734+0000","last_fullsized":"2024-04-26T10:42:27.032734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033901+0000","last_change":"2024-04-26T10:42:25.684653+0000","last_active":"2024-04-26T10:42:27.033901+0000","last_peered":"2024-04-26T10:42:27.033901+0000","last_clean":"2024-04-26T10:42:27.033901+0000","last_became_active":"2024-04-26T10:42:25.684338+0000","last_became_peered":"2024-04-26T10:42:25.684338+0000","last_unstale":"2024-04-26T10:42:27.033901+0000","last_undegraded":"2024-04-26T10:42:27.033901+0000","last_fullsized":"2024-04-26T10:42:27.033901+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:10.694039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033371+0000","last_change":"2024-04-26T10:42:26.042182+0000","last_active":"2024-04-26T10:42:27.033371+0000","last_peered":"2024-04-26T10:42:27.033371+0000","last_clean":"2024-04-26T10:42:27.033371+0000","last_became_active":"2024-04-26T10:42:26.041689+0000","last_became_peered":"2024-04-26T10:42:26.041689+0000","last_unstale":"2024-04-26T10:42:27.033371+0000","last_undegraded":"2024-04-26T10:42:27.033371+0000","last_fullsized":"2024-04-26T10:42:27.033371+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:32:19.618648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033908+0000","last_change":"2024-04-26T10:42:25.686677+0000","last_active":"2024-04-26T10:42:27.033908+0000","last_peered":"2024-04-26T10:42:27.033908+0000","last_clean":"2024-04-26T10:42:27.033908+0000","last_became_active":"2024-04-26T10:42:25.685939+0000","last_became_peered":"2024-04-26T10:42:25.685939+0000","last_unstale":"2024-04-26T10:42:27.033908+0000","last_undegraded":"2024-04-26T10:42:27.033908+0000","last_fullsized":"2024-04-26T10:42:27.033908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:30.225098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033381+0000","last_change":"2024-04-26T10:42:26.045829+0000","last_active":"2024-04-26T10:42:27.033381+0000","last_peered":"2024-04-26T10:42:27.033381+0000","last_clean":"2024-04-26T10:42:27.033381+0000","last_became_active":"2024-04-26T10:42:26.045499+0000","last_became_peered":"2024-04-26T10:42:26.045499+0000","last_unstale":"2024-04-26T10:42:27.033381+0000","last_undegraded":"2024-04-26T10:42:27.033381+0000","last_fullsized":"2024-04-26T10:42:27.033381+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:14.041039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033624+0000","last_change":"2024-04-26T10:42:25.687934+0000","last_active":"2024-04-26T10:42:27.033624+0000","last_peered":"2024-04-26T10:42:27.033624+0000","last_clean":"2024-04-26T10:42:27.033624+0000","last_became_active":"2024-04-26T10:42:25.687447+0000","last_became_peered":"2024-04-26T10:42:25.687447+0000","last_unstale":"2024-04-26T10:42:27.033624+0000","last_undegraded":"2024-04-26T10:42:27.033624+0000","last_fullsized":"2024-04-26T10:42:27.033624+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.930441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033660+0000","last_change":"2024-04-26T10:42:26.043638+0000","last_active":"2024-04-26T10:42:27.033660+0000","last_peered":"2024-04-26T10:42:27.033660+0000","last_clean":"2024-04-26T10:42:27.033660+0000","last_became_active":"2024-04-26T10:42:26.042692+0000","last_became_peered":"2024-04-26T10:42:26.042692+0000","last_unstale":"2024-04-26T10:42:27.033660+0000","last_undegraded":"2024-04-26T10:42:27.033660+0000","last_fullsized":"2024-04-26T10:42:27.033660+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033803+0000","last_change":"2024-04-26T10:42:25.687283+0000","last_active":"2024-04-26T10:42:27.033803+0000","last_peered":"2024-04-26T10:42:27.033803+0000","last_clean":"2024-04-26T10:42:27.033803+0000","last_became_active":"2024-04-26T10:42:25.686251+0000","last_became_peered":"2024-04-26T10:42:25.686251+0000","last_unstale":"2024-04-26T10:42:27.033803+0000","last_undegraded":"2024-04-26T10:42:27.033803+0000","last_fullsized":"2024-04-26T10:42:27.033803+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:16.723401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033798+0000","last_change":"2024-04-26T10:42:26.040688+0000","last_active":"2024-04-26T10:42:27.033798+0000","last_peered":"2024-04-26T10:42:27.033798+0000","last_clean":"2024-04-26T10:42:27.033798+0000","last_became_active":"2024-04-26T10:42:26.039133+0000","last_became_peered":"2024-04-26T10:42:26.039133+0000","last_unstale":"2024-04-26T10:42:27.033798+0000","last_undegraded":"2024-04-26T10:42:27.033798+0000","last_fullsized":"2024-04-26T10:42:27.033798+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032938+0000","last_change":"2024-04-26T10:42:25.688837+0000","last_active":"2024-04-26T10:42:27.032938+0000","last_peered":"2024-04-26T10:42:27.032938+0000","last_clean":"2024-04-26T10:42:27.032938+0000","last_became_active":"2024-04-26T10:42:25.688450+0000","last_became_peered":"2024-04-26T10:42:25.688450+0000","last_unstale":"2024-04-26T10:42:27.032938+0000","last_undegraded":"2024-04-26T10:42:27.032938+0000","last_fullsized":"2024-04-26T10:42:27.032938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:26.788267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033564+0000","last_change":"2024-04-26T10:42:26.039661+0000","last_active":"2024-04-26T10:42:27.033564+0000","last_peered":"2024-04-26T10:42:27.033564+0000","last_clean":"2024-04-26T10:42:27.033564+0000","last_became_active":"2024-04-26T10:42:26.038664+0000","last_became_peered":"2024-04-26T10:42:26.038664+0000","last_unstale":"2024-04-26T10:42:27.033564+0000","last_undegraded":"2024-04-26T10:42:27.033564+0000","last_fullsized":"2024-04-26T10:42:27.033564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032757+0000","last_change":"2024-04-26T10:42:25.687082+0000","last_active":"2024-04-26T10:42:27.032757+0000","last_peered":"2024-04-26T10:42:27.032757+0000","last_clean":"2024-04-26T10:42:27.032757+0000","last_became_active":"2024-04-26T10:42:25.686779+0000","last_became_peered":"2024-04-26T10:42:25.686779+0000","last_unstale":"2024-04-26T10:42:27.032757+0000","last_undegraded":"2024-04-26T10:42:27.032757+0000","last_fullsized":"2024-04-26T10:42:27.032757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:12.284219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033692+0000","last_change":"2024-04-26T10:42:26.047130+0000","last_active":"2024-04-26T10:42:27.033692+0000","last_peered":"2024-04-26T10:42:27.033692+0000","last_clean":"2024-04-26T10:42:27.033692+0000","last_became_active":"2024-04-26T10:42:26.046884+0000","last_became_peered":"2024-04-26T10:42:26.046884+0000","last_unstale":"2024-04-26T10:42:27.033692+0000","last_undegraded":"2024-04-26T10:42:27.033692+0000","last_fullsized":"2024-04-26T10:42:27.033692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:31.020364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.035198+0000","last_change":"2024-04-26T10:42:21.406599+0000","last_active":"2024-04-26T10:42:26.035198+0000","last_peered":"2024-04-26T10:42:26.035198+0000","last_clean":"2024-04-26T10:42:26.035198+0000","last_became_active":"2024-04-26T10:42:21.405587+0000","last_became_peered":"2024-04-26T10:42:21.405587+0000","last_unstale":"2024-04-26T10:42:26.035198+0000","last_undegraded":"2024-04-26T10:42:26.035198+0000","last_fullsized":"2024-04-26T10:42:26.035198+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:44.561530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.035065+0000","last_change":"2024-04-26T10:42:21.405305+0000","last_active":"2024-04-26T10:42:26.035065+0000","last_peered":"2024-04-26T10:42:26.035065+0000","last_clean":"2024-04-26T10:42:26.035065+0000","last_became_active":"2024-04-26T10:42:21.405032+0000","last_became_peered":"2024-04-26T10:42:21.405032+0000","last_unstale":"2024-04-26T10:42:26.035065+0000","last_undegraded":"2024-04-26T10:42:26.035065+0000","last_fullsized":"2024-04-26T10:42:26.035065+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033157+0000","last_change":"2024-04-26T10:42:25.686765+0000","last_active":"2024-04-26T10:42:27.033157+0000","last_peered":"2024-04-26T10:42:27.033157+0000","last_clean":"2024-04-26T10:42:27.033157+0000","last_became_active":"2024-04-26T10:42:25.686009+0000","last_became_peered":"2024-04-26T10:42:25.686009+0000","last_unstale":"2024-04-26T10:42:27.033157+0000","last_undegraded":"2024-04-26T10:42:27.033157+0000","last_fullsized":"2024-04-26T10:42:27.033157+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:54.627815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033875+0000","last_change":"2024-04-26T10:42:26.040215+0000","last_active":"2024-04-26T10:42:27.033875+0000","last_peered":"2024-04-26T10:42:27.033875+0000","last_clean":"2024-04-26T10:42:27.033875+0000","last_became_active":"2024-04-26T10:42:26.039129+0000","last_became_peered":"2024-04-26T10:42:26.039129+0000","last_unstale":"2024-04-26T10:42:27.033875+0000","last_undegraded":"2024-04-26T10:42:27.033875+0000","last_fullsized":"2024-04-26T10:42:27.033875+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.035134+0000","last_change":"2024-04-26T10:42:21.406881+0000","last_active":"2024-04-26T10:42:26.035134+0000","last_peered":"2024-04-26T10:42:26.035134+0000","last_clean":"2024-04-26T10:42:26.035134+0000","last_became_active":"2024-04-26T10:42:21.406634+0000","last_became_peered":"2024-04-26T10:42:21.406634+0000","last_unstale":"2024-04-26T10:42:26.035134+0000","last_undegraded":"2024-04-26T10:42:26.035134+0000","last_fullsized":"2024-04-26T10:42:26.035134+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:45.892841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033120+0000","last_change":"2024-04-26T10:42:25.687986+0000","last_active":"2024-04-26T10:42:27.033120+0000","last_peered":"2024-04-26T10:42:27.033120+0000","last_clean":"2024-04-26T10:42:27.033120+0000","last_became_active":"2024-04-26T10:42:25.687201+0000","last_became_peered":"2024-04-26T10:42:25.687201+0000","last_unstale":"2024-04-26T10:42:27.033120+0000","last_undegraded":"2024-04-26T10:42:27.033120+0000","last_fullsized":"2024-04-26T10:42:27.033120+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:35.867262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033630+0000","last_change":"2024-04-26T10:42:26.043723+0000","last_active":"2024-04-26T10:42:27.033630+0000","last_peered":"2024-04-26T10:42:27.033630+0000","last_clean":"2024-04-26T10:42:27.033630+0000","last_became_active":"2024-04-26T10:42:26.041814+0000","last_became_peered":"2024-04-26T10:42:26.041814+0000","last_unstale":"2024-04-26T10:42:27.033630+0000","last_undegraded":"2024-04-26T10:42:27.033630+0000","last_fullsized":"2024-04-26T10:42:27.033630+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.032836+0000","last_change":"2024-04-26T10:42:21.405597+0000","last_active":"2024-04-26T10:42:26.032836+0000","last_peered":"2024-04-26T10:42:26.032836+0000","last_clean":"2024-04-26T10:42:26.032836+0000","last_became_active":"2024-04-26T10:42:21.405117+0000","last_became_peered":"2024-04-26T10:42:21.405117+0000","last_unstale":"2024-04-26T10:42:26.032836+0000","last_undegraded":"2024-04-26T10:42:26.032836+0000","last_fullsized":"2024-04-26T10:42:26.032836+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033005+0000","last_change":"2024-04-26T10:42:25.688955+0000","last_active":"2024-04-26T10:42:27.033005+0000","last_peered":"2024-04-26T10:42:27.033005+0000","last_clean":"2024-04-26T10:42:27.033005+0000","last_became_active":"2024-04-26T10:42:25.688552+0000","last_became_peered":"2024-04-26T10:42:25.688552+0000","last_unstale":"2024-04-26T10:42:27.033005+0000","last_undegraded":"2024-04-26T10:42:27.033005+0000","last_fullsized":"2024-04-26T10:42:27.033005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:04.963775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033758+0000","last_change":"2024-04-26T10:42:26.049311+0000","last_active":"2024-04-26T10:42:27.033758+0000","last_peered":"2024-04-26T10:42:27.033758+0000","last_clean":"2024-04-26T10:42:27.033758+0000","last_became_active":"2024-04-26T10:42:26.048915+0000","last_became_peered":"2024-04-26T10:42:26.048915+0000","last_unstale":"2024-04-26T10:42:27.033758+0000","last_undegraded":"2024-04-26T10:42:27.033758+0000","last_fullsized":"2024-04-26T10:42:27.033758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:01.056945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.034656+0000","last_change":"2024-04-26T10:42:21.405298+0000","last_active":"2024-04-26T10:42:26.034656+0000","last_peered":"2024-04-26T10:42:26.034656+0000","last_clean":"2024-04-26T10:42:26.034656+0000","last_became_active":"2024-04-26T10:42:21.405011+0000","last_became_peered":"2024-04-26T10:42:21.405011+0000","last_unstale":"2024-04-26T10:42:26.034656+0000","last_undegraded":"2024-04-26T10:42:26.034656+0000","last_fullsized":"2024-04-26T10:42:26.034656+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:47.789961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033960+0000","last_change":"2024-04-26T10:42:25.686177+0000","last_active":"2024-04-26T10:42:27.033960+0000","last_peered":"2024-04-26T10:42:27.033960+0000","last_clean":"2024-04-26T10:42:27.033960+0000","last_became_active":"2024-04-26T10:42:25.685121+0000","last_became_peered":"2024-04-26T10:42:25.685121+0000","last_unstale":"2024-04-26T10:42:27.033960+0000","last_undegraded":"2024-04-26T10:42:27.033960+0000","last_fullsized":"2024-04-26T10:42:27.033960+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:34.398138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033614+0000","last_change":"2024-04-26T10:42:26.045312+0000","last_active":"2024-04-26T10:42:27.033614+0000","last_peered":"2024-04-26T10:42:27.033614+0000","last_clean":"2024-04-26T10:42:27.033614+0000","last_became_active":"2024-04-26T10:42:26.044619+0000","last_became_peered":"2024-04-26T10:42:26.044619+0000","last_unstale":"2024-04-26T10:42:27.033614+0000","last_undegraded":"2024-04-26T10:42:27.033614+0000","last_fullsized":"2024-04-26T10:42:27.033614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:50.646374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033966+0000","last_change":"2024-04-26T10:42:25.686310+0000","last_active":"2024-04-26T10:42:27.033966+0000","last_peered":"2024-04-26T10:42:27.033966+0000","last_clean":"2024-04-26T10:42:27.033966+0000","last_became_active":"2024-04-26T10:42:25.685767+0000","last_became_peered":"2024-04-26T10:42:25.685767+0000","last_unstale":"2024-04-26T10:42:27.033966+0000","last_undegraded":"2024-04-26T10:42:27.033966+0000","last_fullsized":"2024-04-26T10:42:27.033966+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:02.874807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.032839+0000","last_change":"2024-04-26T10:42:21.405754+0000","last_active":"2024-04-26T10:42:26.032839+0000","last_peered":"2024-04-26T10:42:26.032839+0000","last_clean":"2024-04-26T10:42:26.032839+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:42:26.032839+0000","last_undegraded":"2024-04-26T10:42:26.032839+0000","last_fullsized":"2024-04-26T10:42:26.032839+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:47.123256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032872+0000","last_change":"2024-04-26T10:42:26.043764+0000","last_active":"2024-04-26T10:42:27.032872+0000","last_peered":"2024-04-26T10:42:27.032872+0000","last_clean":"2024-04-26T10:42:27.032872+0000","last_became_active":"2024-04-26T10:42:26.043388+0000","last_became_peered":"2024-04-26T10:42:26.043388+0000","last_unstale":"2024-04-26T10:42:27.032872+0000","last_undegraded":"2024-04-26T10:42:27.032872+0000","last_fullsized":"2024-04-26T10:42:27.032872+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:31.020364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033601+0000","last_change":"2024-04-26T10:42:25.685368+0000","last_active":"2024-04-26T10:42:27.033601+0000","last_peered":"2024-04-26T10:42:27.033601+0000","last_clean":"2024-04-26T10:42:27.033601+0000","last_became_active":"2024-04-26T10:42:25.684379+0000","last_became_peered":"2024-04-26T10:42:25.684379+0000","last_unstale":"2024-04-26T10:42:27.033601+0000","last_undegraded":"2024-04-26T10:42:27.033601+0000","last_fullsized":"2024-04-26T10:42:27.033601+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:34.398138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.037776+0000","last_change":"2024-04-26T10:42:21.405356+0000","last_active":"2024-04-26T10:42:26.037776+0000","last_peered":"2024-04-26T10:42:26.037776+0000","last_clean":"2024-04-26T10:42:26.037776+0000","last_became_active":"2024-04-26T10:42:21.405006+0000","last_became_peered":"2024-04-26T10:42:21.405006+0000","last_unstale":"2024-04-26T10:42:26.037776+0000","last_undegraded":"2024-04-26T10:42:26.037776+0000","last_fullsized":"2024-04-26T10:42:26.037776+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:55.043967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033128+0000","last_change":"2024-04-26T10:42:26.042954+0000","last_active":"2024-04-26T10:42:27.033128+0000","last_peered":"2024-04-26T10:42:27.033128+0000","last_clean":"2024-04-26T10:42:27.033128+0000","last_became_active":"2024-04-26T10:42:26.042544+0000","last_became_peered":"2024-04-26T10:42:26.042544+0000","last_unstale":"2024-04-26T10:42:27.033128+0000","last_undegraded":"2024-04-26T10:42:27.033128+0000","last_fullsized":"2024-04-26T10:42:27.033128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:14.041039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033915+0000","last_change":"2024-04-26T10:42:25.687201+0000","last_active":"2024-04-26T10:42:27.033915+0000","last_peered":"2024-04-26T10:42:27.033915+0000","last_clean":"2024-04-26T10:42:27.033915+0000","last_became_active":"2024-04-26T10:42:25.686641+0000","last_became_peered":"2024-04-26T10:42:25.686641+0000","last_unstale":"2024-04-26T10:42:27.033915+0000","last_undegraded":"2024-04-26T10:42:27.033915+0000","last_fullsized":"2024-04-26T10:42:27.033915+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:30.225098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.033642+0000","last_change":"2024-04-26T10:42:21.405615+0000","last_active":"2024-04-26T10:42:26.033642+0000","last_peered":"2024-04-26T10:42:26.033642+0000","last_clean":"2024-04-26T10:42:26.033642+0000","last_became_active":"2024-04-26T10:42:21.405184+0000","last_became_peered":"2024-04-26T10:42:21.405184+0000","last_unstale":"2024-04-26T10:42:26.033642+0000","last_undegraded":"2024-04-26T10:42:26.033642+0000","last_fullsized":"2024-04-26T10:42:26.033642+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:52.378909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032862+0000","last_change":"2024-04-26T10:42:26.046832+0000","last_active":"2024-04-26T10:42:27.032862+0000","last_peered":"2024-04-26T10:42:27.032862+0000","last_clean":"2024-04-26T10:42:27.032862+0000","last_became_active":"2024-04-26T10:42:26.046484+0000","last_became_peered":"2024-04-26T10:42:26.046484+0000","last_unstale":"2024-04-26T10:42:27.032862+0000","last_undegraded":"2024-04-26T10:42:27.032862+0000","last_fullsized":"2024-04-26T10:42:27.032862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:28.856785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033878+0000","last_change":"2024-04-26T10:42:25.686262+0000","last_active":"2024-04-26T10:42:27.033878+0000","last_peered":"2024-04-26T10:42:27.033878+0000","last_clean":"2024-04-26T10:42:27.033878+0000","last_became_active":"2024-04-26T10:42:25.685528+0000","last_became_peered":"2024-04-26T10:42:25.685528+0000","last_unstale":"2024-04-26T10:42:27.033878+0000","last_undegraded":"2024-04-26T10:42:27.033878+0000","last_fullsized":"2024-04-26T10:42:27.033878+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:47.138273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.035316+0000","last_change":"2024-04-26T10:42:21.405863+0000","last_active":"2024-04-26T10:42:26.035316+0000","last_peered":"2024-04-26T10:42:26.035316+0000","last_clean":"2024-04-26T10:42:26.035316+0000","last_became_active":"2024-04-26T10:42:21.405555+0000","last_became_peered":"2024-04-26T10:42:21.405555+0000","last_unstale":"2024-04-26T10:42:26.035316+0000","last_undegraded":"2024-04-26T10:42:26.035316+0000","last_fullsized":"2024-04-26T10:42:26.035316+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:39.259618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032766+0000","last_change":"2024-04-26T10:42:26.044818+0000","last_active":"2024-04-26T10:42:27.032766+0000","last_peered":"2024-04-26T10:42:27.032766+0000","last_clean":"2024-04-26T10:42:27.032766+0000","last_became_active":"2024-04-26T10:42:26.043969+0000","last_became_peered":"2024-04-26T10:42:26.043969+0000","last_unstale":"2024-04-26T10:42:27.032766+0000","last_undegraded":"2024-04-26T10:42:27.032766+0000","last_fullsized":"2024-04-26T10:42:27.032766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:50.646374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033819+0000","last_change":"2024-04-26T10:42:26.040224+0000","last_active":"2024-04-26T10:42:27.033819+0000","last_peered":"2024-04-26T10:42:27.033819+0000","last_clean":"2024-04-26T10:42:27.033819+0000","last_became_active":"2024-04-26T10:42:26.038590+0000","last_became_peered":"2024-04-26T10:42:26.038590+0000","last_unstale":"2024-04-26T10:42:27.033819+0000","last_undegraded":"2024-04-26T10:42:27.033819+0000","last_fullsized":"2024-04-26T10:42:27.033819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033865+0000","last_change":"2024-04-26T10:42:25.684447+0000","last_active":"2024-04-26T10:42:27.033865+0000","last_peered":"2024-04-26T10:42:27.033865+0000","last_clean":"2024-04-26T10:42:27.033865+0000","last_became_active":"2024-04-26T10:42:25.684147+0000","last_became_peered":"2024-04-26T10:42:25.684147+0000","last_unstale":"2024-04-26T10:42:27.033865+0000","last_undegraded":"2024-04-26T10:42:27.033865+0000","last_fullsized":"2024-04-26T10:42:27.033865+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:38.873282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032960+0000","last_change":"2024-04-26T10:42:26.045459+0000","last_active":"2024-04-26T10:42:27.032960+0000","last_peered":"2024-04-26T10:42:27.032960+0000","last_clean":"2024-04-26T10:42:27.032960+0000","last_became_active":"2024-04-26T10:42:26.044972+0000","last_became_peered":"2024-04-26T10:42:26.044972+0000","last_unstale":"2024-04-26T10:42:27.032960+0000","last_undegraded":"2024-04-26T10:42:27.032960+0000","last_fullsized":"2024-04-26T10:42:27.032960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033920+0000","last_change":"2024-04-26T10:42:25.687956+0000","last_active":"2024-04-26T10:42:27.033920+0000","last_peered":"2024-04-26T10:42:27.033920+0000","last_clean":"2024-04-26T10:42:27.033920+0000","last_became_active":"2024-04-26T10:42:25.687533+0000","last_became_peered":"2024-04-26T10:42:25.687533+0000","last_unstale":"2024-04-26T10:42:27.033920+0000","last_undegraded":"2024-04-26T10:42:27.033920+0000","last_fullsized":"2024-04-26T10:42:27.033920+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:28.506897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033679+0000","last_change":"2024-04-26T10:42:25.685829+0000","last_active":"2024-04-26T10:42:27.033679+0000","last_peered":"2024-04-26T10:42:27.033679+0000","last_clean":"2024-04-26T10:42:27.033679+0000","last_became_active":"2024-04-26T10:42:25.685307+0000","last_became_peered":"2024-04-26T10:42:25.685307+0000","last_unstale":"2024-04-26T10:42:27.033679+0000","last_undegraded":"2024-04-26T10:42:27.033679+0000","last_fullsized":"2024-04-26T10:42:27.033679+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032933+0000","last_change":"2024-04-26T10:42:26.046196+0000","last_active":"2024-04-26T10:42:27.032933+0000","last_peered":"2024-04-26T10:42:27.032933+0000","last_clean":"2024-04-26T10:42:27.032933+0000","last_became_active":"2024-04-26T10:42:26.045762+0000","last_became_peered":"2024-04-26T10:42:26.045762+0000","last_unstale":"2024-04-26T10:42:27.032933+0000","last_undegraded":"2024-04-26T10:42:27.032933+0000","last_fullsized":"2024-04-26T10:42:27.032933+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033848+0000","last_change":"2024-04-26T10:42:25.685990+0000","last_active":"2024-04-26T10:42:27.033848+0000","last_peered":"2024-04-26T10:42:27.033848+0000","last_clean":"2024-04-26T10:42:27.033848+0000","last_became_active":"2024-04-26T10:42:25.684604+0000","last_became_peered":"2024-04-26T10:42:25.684604+0000","last_unstale":"2024-04-26T10:42:27.033848+0000","last_undegraded":"2024-04-26T10:42:27.033848+0000","last_fullsized":"2024-04-26T10:42:27.033848+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:02.874807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032830+0000","last_change":"2024-04-26T10:42:26.038545+0000","last_active":"2024-04-26T10:42:27.032830+0000","last_peered":"2024-04-26T10:42:27.032830+0000","last_clean":"2024-04-26T10:42:27.032830+0000","last_became_active":"2024-04-26T10:42:26.038099+0000","last_became_peered":"2024-04-26T10:42:26.038099+0000","last_unstale":"2024-04-26T10:42:27.032830+0000","last_undegraded":"2024-04-26T10:42:27.032830+0000","last_fullsized":"2024-04-26T10:42:27.032830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033882+0000","last_change":"2024-04-26T10:42:26.046506+0000","last_active":"2024-04-26T10:42:27.033882+0000","last_peered":"2024-04-26T10:42:27.033882+0000","last_clean":"2024-04-26T10:42:27.033882+0000","last_became_active":"2024-04-26T10:42:26.045904+0000","last_became_peered":"2024-04-26T10:42:26.045904+0000","last_unstale":"2024-04-26T10:42:27.033882+0000","last_undegraded":"2024-04-26T10:42:27.033882+0000","last_fullsized":"2024-04-26T10:42:27.033882+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:49.854080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032971+0000","last_change":"2024-04-26T10:42:25.683890+0000","last_active":"2024-04-26T10:42:27.032971+0000","last_peered":"2024-04-26T10:42:27.032971+0000","last_clean":"2024-04-26T10:42:27.032971+0000","last_became_active":"2024-04-26T10:42:25.683467+0000","last_became_peered":"2024-04-26T10:42:25.683467+0000","last_unstale":"2024-04-26T10:42:27.032971+0000","last_undegraded":"2024-04-26T10:42:27.032971+0000","last_fullsized":"2024-04-26T10:42:27.032971+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033657+0000","last_change":"2024-04-26T10:42:26.046384+0000","last_active":"2024-04-26T10:42:27.033657+0000","last_peered":"2024-04-26T10:42:27.033657+0000","last_clean":"2024-04-26T10:42:27.033657+0000","last_became_active":"2024-04-26T10:42:26.045860+0000","last_became_peered":"2024-04-26T10:42:26.045860+0000","last_unstale":"2024-04-26T10:42:27.033657+0000","last_undegraded":"2024-04-26T10:42:27.033657+0000","last_fullsized":"2024-04-26T10:42:27.033657+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033002+0000","last_change":"2024-04-26T10:42:25.686972+0000","last_active":"2024-04-26T10:42:27.033002+0000","last_peered":"2024-04-26T10:42:27.033002+0000","last_clean":"2024-04-26T10:42:27.033002+0000","last_became_active":"2024-04-26T10:42:25.685903+0000","last_became_peered":"2024-04-26T10:42:25.685903+0000","last_unstale":"2024-04-26T10:42:27.033002+0000","last_undegraded":"2024-04-26T10:42:27.033002+0000","last_fullsized":"2024-04-26T10:42:27.033002+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:43.969731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033703+0000","last_change":"2024-04-26T10:42:26.046515+0000","last_active":"2024-04-26T10:42:27.033703+0000","last_peered":"2024-04-26T10:42:27.033703+0000","last_clean":"2024-04-26T10:42:27.033703+0000","last_became_active":"2024-04-26T10:42:26.045798+0000","last_became_peered":"2024-04-26T10:42:26.045798+0000","last_unstale":"2024-04-26T10:42:27.033703+0000","last_undegraded":"2024-04-26T10:42:27.033703+0000","last_fullsized":"2024-04-26T10:42:27.033703+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:28.856785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033066+0000","last_change":"2024-04-26T10:42:25.688221+0000","last_active":"2024-04-26T10:42:27.033066+0000","last_peered":"2024-04-26T10:42:27.033066+0000","last_clean":"2024-04-26T10:42:27.033066+0000","last_became_active":"2024-04-26T10:42:25.687829+0000","last_became_peered":"2024-04-26T10:42:25.687829+0000","last_unstale":"2024-04-26T10:42:27.033066+0000","last_undegraded":"2024-04-26T10:42:27.033066+0000","last_fullsized":"2024-04-26T10:42:27.033066+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:05.939715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033363+0000","last_change":"2024-04-26T10:42:26.042723+0000","last_active":"2024-04-26T10:42:27.033363+0000","last_peered":"2024-04-26T10:42:27.033363+0000","last_clean":"2024-04-26T10:42:27.033363+0000","last_became_active":"2024-04-26T10:42:26.041852+0000","last_became_peered":"2024-04-26T10:42:26.041852+0000","last_unstale":"2024-04-26T10:42:27.033363+0000","last_undegraded":"2024-04-26T10:42:27.033363+0000","last_fullsized":"2024-04-26T10:42:27.033363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033492+0000","last_change":"2024-04-26T10:42:25.688815+0000","last_active":"2024-04-26T10:42:27.033492+0000","last_peered":"2024-04-26T10:42:27.033492+0000","last_clean":"2024-04-26T10:42:27.033492+0000","last_became_active":"2024-04-26T10:42:25.688451+0000","last_became_peered":"2024-04-26T10:42:25.688451+0000","last_unstale":"2024-04-26T10:42:27.033492+0000","last_undegraded":"2024-04-26T10:42:27.033492+0000","last_fullsized":"2024-04-26T10:42:27.033492+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:17.143923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033256+0000","last_change":"2024-04-26T10:42:26.044040+0000","last_active":"2024-04-26T10:42:27.033256+0000","last_peered":"2024-04-26T10:42:27.033256+0000","last_clean":"2024-04-26T10:42:27.033256+0000","last_became_active":"2024-04-26T10:42:26.042629+0000","last_became_peered":"2024-04-26T10:42:26.042629+0000","last_unstale":"2024-04-26T10:42:27.033256+0000","last_undegraded":"2024-04-26T10:42:27.033256+0000","last_fullsized":"2024-04-26T10:42:27.033256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:23:05.308070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033778+0000","last_change":"2024-04-26T10:42:25.686442+0000","last_active":"2024-04-26T10:42:27.033778+0000","last_peered":"2024-04-26T10:42:27.033778+0000","last_clean":"2024-04-26T10:42:27.033778+0000","last_became_active":"2024-04-26T10:42:25.686029+0000","last_became_peered":"2024-04-26T10:42:25.686029+0000","last_unstale":"2024-04-26T10:42:27.033778+0000","last_undegraded":"2024-04-26T10:42:27.033778+0000","last_fullsized":"2024-04-26T10:42:27.033778+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:04.241132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033516+0000","last_change":"2024-04-26T10:42:26.042561+0000","last_active":"2024-04-26T10:42:27.033516+0000","last_peered":"2024-04-26T10:42:27.033516+0000","last_clean":"2024-04-26T10:42:27.033516+0000","last_became_active":"2024-04-26T10:42:26.041751+0000","last_became_peered":"2024-04-26T10:42:26.041751+0000","last_unstale":"2024-04-26T10:42:27.033516+0000","last_undegraded":"2024-04-26T10:42:27.033516+0000","last_fullsized":"2024-04-26T10:42:27.033516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033819+0000","last_change":"2024-04-26T10:42:25.687977+0000","last_active":"2024-04-26T10:42:27.033819+0000","last_peered":"2024-04-26T10:42:27.033819+0000","last_clean":"2024-04-26T10:42:27.033819+0000","last_became_active":"2024-04-26T10:42:25.687402+0000","last_became_peered":"2024-04-26T10:42:25.687402+0000","last_unstale":"2024-04-26T10:42:27.033819+0000","last_undegraded":"2024-04-26T10:42:27.033819+0000","last_fullsized":"2024-04-26T10:42:27.033819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:35.867262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033076+0000","last_change":"2024-04-26T10:42:26.041729+0000","last_active":"2024-04-26T10:42:27.033076+0000","last_peered":"2024-04-26T10:42:27.033076+0000","last_clean":"2024-04-26T10:42:27.033076+0000","last_became_active":"2024-04-26T10:42:26.040504+0000","last_became_peered":"2024-04-26T10:42:26.040504+0000","last_unstale":"2024-04-26T10:42:27.033076+0000","last_undegraded":"2024-04-26T10:42:27.033076+0000","last_fullsized":"2024-04-26T10:42:27.033076+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033769+0000","last_change":"2024-04-26T10:42:25.686861+0000","last_active":"2024-04-26T10:42:27.033769+0000","last_peered":"2024-04-26T10:42:27.033769+0000","last_clean":"2024-04-26T10:42:27.033769+0000","last_became_active":"2024-04-26T10:42:25.686149+0000","last_became_peered":"2024-04-26T10:42:25.686149+0000","last_unstale":"2024-04-26T10:42:27.033769+0000","last_undegraded":"2024-04-26T10:42:27.033769+0000","last_fullsized":"2024-04-26T10:42:27.033769+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:42.125386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033053+0000","last_change":"2024-04-26T10:42:26.045324+0000","last_active":"2024-04-26T10:42:27.033053+0000","last_peered":"2024-04-26T10:42:27.033053+0000","last_clean":"2024-04-26T10:42:27.033053+0000","last_became_active":"2024-04-26T10:42:26.044454+0000","last_became_peered":"2024-04-26T10:42:26.044454+0000","last_unstale":"2024-04-26T10:42:27.033053+0000","last_undegraded":"2024-04-26T10:42:27.033053+0000","last_fullsized":"2024-04-26T10:42:27.033053+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033768+0000","last_change":"2024-04-26T10:42:25.685528+0000","last_active":"2024-04-26T10:42:27.033768+0000","last_peered":"2024-04-26T10:42:27.033768+0000","last_clean":"2024-04-26T10:42:27.033768+0000","last_became_active":"2024-04-26T10:42:25.684508+0000","last_became_peered":"2024-04-26T10:42:25.684508+0000","last_unstale":"2024-04-26T10:42:27.033768+0000","last_undegraded":"2024-04-26T10:42:27.033768+0000","last_fullsized":"2024-04-26T10:42:27.033768+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.850118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31264,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340576,"statfs":{"total":96636764160,"available":96604749824,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35952,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335888,"statfs":{"total":96636764160,"available":96599949312,"internally_reserved":0,"allocated":749568,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:42:33.780 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T10:42:33.780 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T10:42:33.780 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T10:42:33.781 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T10:42:33.781 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T10:42:34.153 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:34.163 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":27942},{"type":"v1","addr":"172.21.15.49:6801","nonce":27942}]},"active_addr":"172.21.15.49:6801/27942","active_change":"2024-04-26T10:42:15.586566+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4105,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":4215345762}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":1223504837}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":2172219252}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":4034487058}]}]} 2024-04-26T10:42:34.167 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T10:42:34.167 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T10:42:34.167 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:42:34.466 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:34.467 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":15,"fsid":"9837de44-a9e8-4979-adc4-611f3ddc44ce","created":"2024-04-26T10:42:11.337159+0000","modified":"2024-04-26T10:42:27.029243+0000","last_up_change":"2024-04-26T10:42:19.397933+0000","last_in_change":"2024-04-26T10:42:12.136647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:42:19.632084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:42:19.779089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:42:24.266614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:42:25.014684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eabed31c-c043-43de-a756-e217d5287116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":28839},{"type":"v1","addr":"172.21.15.60:6801","nonce":28839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":28839},{"type":"v1","addr":"172.21.15.60:6803","nonce":28839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":28839},{"type":"v1","addr":"172.21.15.60:6807","nonce":28839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":28839},{"type":"v1","addr":"172.21.15.60:6805","nonce":28839}]},"public_addr":"172.21.15.60:6801/28839","cluster_addr":"172.21.15.60:6803/28839","heartbeat_back_addr":"172.21.15.60:6807/28839","heartbeat_front_addr":"172.21.15.60:6805/28839","state":["exists","up"]},{"osd":1,"uuid":"7013621f-db09-4096-bc24-428bb170edd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":28598},{"type":"v1","addr":"172.21.15.87:6801","nonce":28598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":28598},{"type":"v1","addr":"172.21.15.87:6803","nonce":28598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":28598},{"type":"v1","addr":"172.21.15.87:6807","nonce":28598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":28598},{"type":"v1","addr":"172.21.15.87:6805","nonce":28598}]},"public_addr":"172.21.15.87:6801/28598","cluster_addr":"172.21.15.87:6803/28598","heartbeat_back_addr":"172.21.15.87:6807/28598","heartbeat_front_addr":"172.21.15.87:6805/28598","state":["exists","up"]},{"osd":2,"uuid":"a1efeadd-cf55-4ed5-9918-36607fd62229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":28733},{"type":"v1","addr":"172.21.15.195:6801","nonce":28733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":28733},{"type":"v1","addr":"172.21.15.195:6803","nonce":28733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":28733},{"type":"v1","addr":"172.21.15.195:6807","nonce":28733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":28733},{"type":"v1","addr":"172.21.15.195:6805","nonce":28733}]},"public_addr":"172.21.15.195:6801/28733","cluster_addr":"172.21.15.195:6803/28733","heartbeat_back_addr":"172.21.15.195:6807/28733","heartbeat_front_addr":"172.21.15.195:6805/28733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.152046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.177399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.123066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:42:34.480 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T10:42:34.480 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:42:34.775 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:34.775 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":15,"fsid":"9837de44-a9e8-4979-adc4-611f3ddc44ce","created":"2024-04-26T10:42:11.337159+0000","modified":"2024-04-26T10:42:27.029243+0000","last_up_change":"2024-04-26T10:42:19.397933+0000","last_in_change":"2024-04-26T10:42:12.136647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:42:19.632084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:42:19.779089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:42:24.266614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:42:25.014684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eabed31c-c043-43de-a756-e217d5287116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":28839},{"type":"v1","addr":"172.21.15.60:6801","nonce":28839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":28839},{"type":"v1","addr":"172.21.15.60:6803","nonce":28839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":28839},{"type":"v1","addr":"172.21.15.60:6807","nonce":28839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":28839},{"type":"v1","addr":"172.21.15.60:6805","nonce":28839}]},"public_addr":"172.21.15.60:6801/28839","cluster_addr":"172.21.15.60:6803/28839","heartbeat_back_addr":"172.21.15.60:6807/28839","heartbeat_front_addr":"172.21.15.60:6805/28839","state":["exists","up"]},{"osd":1,"uuid":"7013621f-db09-4096-bc24-428bb170edd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":28598},{"type":"v1","addr":"172.21.15.87:6801","nonce":28598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":28598},{"type":"v1","addr":"172.21.15.87:6803","nonce":28598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":28598},{"type":"v1","addr":"172.21.15.87:6807","nonce":28598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":28598},{"type":"v1","addr":"172.21.15.87:6805","nonce":28598}]},"public_addr":"172.21.15.87:6801/28598","cluster_addr":"172.21.15.87:6803/28598","heartbeat_back_addr":"172.21.15.87:6807/28598","heartbeat_front_addr":"172.21.15.87:6805/28598","state":["exists","up"]},{"osd":2,"uuid":"a1efeadd-cf55-4ed5-9918-36607fd62229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":28733},{"type":"v1","addr":"172.21.15.195:6801","nonce":28733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":28733},{"type":"v1","addr":"172.21.15.195:6803","nonce":28733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":28733},{"type":"v1","addr":"172.21.15.195:6807","nonce":28733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":28733},{"type":"v1","addr":"172.21.15.195:6805","nonce":28733}]},"public_addr":"172.21.15.195:6801/28733","cluster_addr":"172.21.15.195:6803/28733","heartbeat_back_addr":"172.21.15.195:6807/28733","heartbeat_front_addr":"172.21.15.195:6805/28733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.152046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.177399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.123066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:42:34.788 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T10:42:34.789 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T10:42:34.789 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T10:42:34.930 INFO:teuthology.orchestra.run.smithi049.stdout:34359738374 2024-04-26T10:42:34.931 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T10:42:34.950 INFO:teuthology.orchestra.run.smithi049.stdout:34359738374 2024-04-26T10:42:34.951 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T10:42:34.951 INFO:teuthology.orchestra.run.smithi049.stdout:34359738375 2024-04-26T10:42:34.952 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T10:42:35.234 INFO:teuthology.orchestra.run.smithi049.stdout:34359738372 2024-04-26T10:42:35.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738372 for osd.2 2024-04-26T10:42:35.322 INFO:teuthology.orchestra.run.smithi049.stdout:34359738372 2024-04-26T10:42:35.323 INFO:teuthology.orchestra.run.smithi049.stdout:34359738373 2024-04-26T10:42:35.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738373 for osd.0 2024-04-26T10:42:35.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738372 for osd.1 2024-04-26T10:42:36.248 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T10:42:36.337 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T10:42:36.338 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T10:42:36.566 INFO:teuthology.orchestra.run.smithi049.stdout:34359738374 2024-04-26T10:42:36.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.2 2024-04-26T10:42:36.583 DEBUG:teuthology.parallel:result is None 2024-04-26T10:42:36.645 INFO:teuthology.orchestra.run.smithi049.stdout:34359738374 2024-04-26T10:42:36.651 INFO:teuthology.orchestra.run.smithi049.stdout:34359738375 2024-04-26T10:42:36.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.1 2024-04-26T10:42:36.659 DEBUG:teuthology.parallel:result is None 2024-04-26T10:42:36.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.0 2024-04-26T10:42:36.664 DEBUG:teuthology.parallel:result is None 2024-04-26T10:42:36.664 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T10:42:36.664 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:42:37.000 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:37.001 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:42:37.010 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-26T10:42:35.594250+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94984,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283020536,"statfs":{"total":289910292480,"available":289813028864,"internally_reserved":0,"allocated":1646592,"data_stored":1323601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.564503"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033761+0000","last_change":"2024-04-26T10:42:26.045527+0000","last_active":"2024-04-26T10:42:27.033761+0000","last_peered":"2024-04-26T10:42:27.033761+0000","last_clean":"2024-04-26T10:42:27.033761+0000","last_became_active":"2024-04-26T10:42:26.044597+0000","last_became_peered":"2024-04-26T10:42:26.044597+0000","last_unstale":"2024-04-26T10:42:27.033761+0000","last_undegraded":"2024-04-26T10:42:27.033761+0000","last_fullsized":"2024-04-26T10:42:27.033761+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033531+0000","last_change":"2024-04-26T10:42:26.043815+0000","last_active":"2024-04-26T10:42:27.033531+0000","last_peered":"2024-04-26T10:42:27.033531+0000","last_clean":"2024-04-26T10:42:27.033531+0000","last_became_active":"2024-04-26T10:42:26.042757+0000","last_became_peered":"2024-04-26T10:42:26.042757+0000","last_unstale":"2024-04-26T10:42:27.033531+0000","last_undegraded":"2024-04-26T10:42:27.033531+0000","last_fullsized":"2024-04-26T10:42:27.033531+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:27.752674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033378+0000","last_change":"2024-04-26T10:42:26.041030+0000","last_active":"2024-04-26T10:42:27.033378+0000","last_peered":"2024-04-26T10:42:27.033378+0000","last_clean":"2024-04-26T10:42:27.033378+0000","last_became_active":"2024-04-26T10:42:26.039762+0000","last_became_peered":"2024-04-26T10:42:26.039762+0000","last_unstale":"2024-04-26T10:42:27.033378+0000","last_undegraded":"2024-04-26T10:42:27.033378+0000","last_fullsized":"2024-04-26T10:42:27.033378+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033311+0000","last_change":"2024-04-26T10:42:26.044004+0000","last_active":"2024-04-26T10:42:27.033311+0000","last_peered":"2024-04-26T10:42:27.033311+0000","last_clean":"2024-04-26T10:42:27.033311+0000","last_became_active":"2024-04-26T10:42:26.042953+0000","last_became_peered":"2024-04-26T10:42:26.042953+0000","last_unstale":"2024-04-26T10:42:27.033311+0000","last_undegraded":"2024-04-26T10:42:27.033311+0000","last_fullsized":"2024-04-26T10:42:27.033311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.895922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033277+0000","last_change":"2024-04-26T10:42:26.041191+0000","last_active":"2024-04-26T10:42:27.033277+0000","last_peered":"2024-04-26T10:42:27.033277+0000","last_clean":"2024-04-26T10:42:27.033277+0000","last_became_active":"2024-04-26T10:42:26.040487+0000","last_became_peered":"2024-04-26T10:42:26.040487+0000","last_unstale":"2024-04-26T10:42:27.033277+0000","last_undegraded":"2024-04-26T10:42:27.033277+0000","last_fullsized":"2024-04-26T10:42:27.033277+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032976+0000","last_change":"2024-04-26T10:42:26.043542+0000","last_active":"2024-04-26T10:42:27.032976+0000","last_peered":"2024-04-26T10:42:27.032976+0000","last_clean":"2024-04-26T10:42:27.032976+0000","last_became_active":"2024-04-26T10:42:26.042631+0000","last_became_peered":"2024-04-26T10:42:26.042631+0000","last_unstale":"2024-04-26T10:42:27.032976+0000","last_undegraded":"2024-04-26T10:42:27.032976+0000","last_fullsized":"2024-04-26T10:42:27.032976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:38.272126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033024+0000","last_change":"2024-04-26T10:42:26.042698+0000","last_active":"2024-04-26T10:42:27.033024+0000","last_peered":"2024-04-26T10:42:27.033024+0000","last_clean":"2024-04-26T10:42:27.033024+0000","last_became_active":"2024-04-26T10:42:26.041631+0000","last_became_peered":"2024-04-26T10:42:26.041631+0000","last_unstale":"2024-04-26T10:42:27.033024+0000","last_undegraded":"2024-04-26T10:42:27.033024+0000","last_fullsized":"2024-04-26T10:42:27.033024+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:27.752674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032694+0000","last_change":"2024-04-26T10:42:26.045497+0000","last_active":"2024-04-26T10:42:27.032694+0000","last_peered":"2024-04-26T10:42:27.032694+0000","last_clean":"2024-04-26T10:42:27.032694+0000","last_became_active":"2024-04-26T10:42:26.044865+0000","last_became_peered":"2024-04-26T10:42:26.044865+0000","last_unstale":"2024-04-26T10:42:27.032694+0000","last_undegraded":"2024-04-26T10:42:27.032694+0000","last_fullsized":"2024-04-26T10:42:27.032694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:59:04.853293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033544+0000","last_change":"2024-04-26T10:42:26.045893+0000","last_active":"2024-04-26T10:42:27.033544+0000","last_peered":"2024-04-26T10:42:27.033544+0000","last_clean":"2024-04-26T10:42:27.033544+0000","last_became_active":"2024-04-26T10:42:26.045177+0000","last_became_peered":"2024-04-26T10:42:26.045177+0000","last_unstale":"2024-04-26T10:42:27.033544+0000","last_undegraded":"2024-04-26T10:42:27.033544+0000","last_fullsized":"2024-04-26T10:42:27.033544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033494+0000","last_change":"2024-04-26T10:42:26.044101+0000","last_active":"2024-04-26T10:42:27.033494+0000","last_peered":"2024-04-26T10:42:27.033494+0000","last_clean":"2024-04-26T10:42:27.033494+0000","last_became_active":"2024-04-26T10:42:26.042047+0000","last_became_peered":"2024-04-26T10:42:26.042047+0000","last_unstale":"2024-04-26T10:42:27.033494+0000","last_undegraded":"2024-04-26T10:42:27.033494+0000","last_fullsized":"2024-04-26T10:42:27.033494+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:46.975947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033560+0000","last_change":"2024-04-26T10:42:26.043530+0000","last_active":"2024-04-26T10:42:27.033560+0000","last_peered":"2024-04-26T10:42:27.033560+0000","last_clean":"2024-04-26T10:42:27.033560+0000","last_became_active":"2024-04-26T10:42:26.042301+0000","last_became_peered":"2024-04-26T10:42:26.042301+0000","last_unstale":"2024-04-26T10:42:27.033560+0000","last_undegraded":"2024-04-26T10:42:27.033560+0000","last_fullsized":"2024-04-26T10:42:27.033560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:48.440963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033166+0000","last_change":"2024-04-26T10:42:26.047073+0000","last_active":"2024-04-26T10:42:27.033166+0000","last_peered":"2024-04-26T10:42:27.033166+0000","last_clean":"2024-04-26T10:42:27.033166+0000","last_became_active":"2024-04-26T10:42:26.046384+0000","last_became_peered":"2024-04-26T10:42:26.046384+0000","last_unstale":"2024-04-26T10:42:27.033166+0000","last_undegraded":"2024-04-26T10:42:27.033166+0000","last_fullsized":"2024-04-26T10:42:27.033166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:23.079349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032981+0000","last_change":"2024-04-26T10:42:26.042607+0000","last_active":"2024-04-26T10:42:27.032981+0000","last_peered":"2024-04-26T10:42:27.032981+0000","last_clean":"2024-04-26T10:42:27.032981+0000","last_became_active":"2024-04-26T10:42:26.041617+0000","last_became_peered":"2024-04-26T10:42:26.041617+0000","last_unstale":"2024-04-26T10:42:27.032981+0000","last_undegraded":"2024-04-26T10:42:27.032981+0000","last_fullsized":"2024-04-26T10:42:27.032981+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033143+0000","last_change":"2024-04-26T10:42:26.040433+0000","last_active":"2024-04-26T10:42:27.033143+0000","last_peered":"2024-04-26T10:42:27.033143+0000","last_clean":"2024-04-26T10:42:27.033143+0000","last_became_active":"2024-04-26T10:42:26.039631+0000","last_became_peered":"2024-04-26T10:42:26.039631+0000","last_unstale":"2024-04-26T10:42:27.033143+0000","last_undegraded":"2024-04-26T10:42:27.033143+0000","last_fullsized":"2024-04-26T10:42:27.033143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033116+0000","last_change":"2024-04-26T10:42:26.040182+0000","last_active":"2024-04-26T10:42:27.033116+0000","last_peered":"2024-04-26T10:42:27.033116+0000","last_clean":"2024-04-26T10:42:27.033116+0000","last_became_active":"2024-04-26T10:42:26.038614+0000","last_became_peered":"2024-04-26T10:42:26.038614+0000","last_unstale":"2024-04-26T10:42:27.033116+0000","last_undegraded":"2024-04-26T10:42:27.033116+0000","last_fullsized":"2024-04-26T10:42:27.033116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032762+0000","last_change":"2024-04-26T10:42:26.045551+0000","last_active":"2024-04-26T10:42:27.032762+0000","last_peered":"2024-04-26T10:42:27.032762+0000","last_clean":"2024-04-26T10:42:27.032762+0000","last_became_active":"2024-04-26T10:42:26.044944+0000","last_became_peered":"2024-04-26T10:42:26.044944+0000","last_unstale":"2024-04-26T10:42:27.032762+0000","last_undegraded":"2024-04-26T10:42:27.032762+0000","last_fullsized":"2024-04-26T10:42:27.032762+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:02.194279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033885+0000","last_change":"2024-04-26T10:42:26.049338+0000","last_active":"2024-04-26T10:42:27.033885+0000","last_peered":"2024-04-26T10:42:27.033885+0000","last_clean":"2024-04-26T10:42:27.033885+0000","last_became_active":"2024-04-26T10:42:26.049014+0000","last_became_peered":"2024-04-26T10:42:26.049014+0000","last_unstale":"2024-04-26T10:42:27.033885+0000","last_undegraded":"2024-04-26T10:42:27.033885+0000","last_fullsized":"2024-04-26T10:42:27.033885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033767+0000","last_change":"2024-04-26T10:42:26.043604+0000","last_active":"2024-04-26T10:42:27.033767+0000","last_peered":"2024-04-26T10:42:27.033767+0000","last_clean":"2024-04-26T10:42:27.033767+0000","last_became_active":"2024-04-26T10:42:26.041224+0000","last_became_peered":"2024-04-26T10:42:26.041224+0000","last_unstale":"2024-04-26T10:42:27.033767+0000","last_undegraded":"2024-04-26T10:42:27.033767+0000","last_fullsized":"2024-04-26T10:42:27.033767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033328+0000","last_change":"2024-04-26T10:42:26.045031+0000","last_active":"2024-04-26T10:42:27.033328+0000","last_peered":"2024-04-26T10:42:27.033328+0000","last_clean":"2024-04-26T10:42:27.033328+0000","last_became_active":"2024-04-26T10:42:26.044604+0000","last_became_peered":"2024-04-26T10:42:26.044604+0000","last_unstale":"2024-04-26T10:42:27.033328+0000","last_undegraded":"2024-04-26T10:42:27.033328+0000","last_fullsized":"2024-04-26T10:42:27.033328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033728+0000","last_change":"2024-04-26T10:42:26.043762+0000","last_active":"2024-04-26T10:42:27.033728+0000","last_peered":"2024-04-26T10:42:27.033728+0000","last_clean":"2024-04-26T10:42:27.033728+0000","last_became_active":"2024-04-26T10:42:26.042117+0000","last_became_peered":"2024-04-26T10:42:26.042117+0000","last_unstale":"2024-04-26T10:42:27.033728+0000","last_undegraded":"2024-04-26T10:42:27.033728+0000","last_fullsized":"2024-04-26T10:42:27.033728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:35.276961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033416+0000","last_change":"2024-04-26T10:42:26.044062+0000","last_active":"2024-04-26T10:42:27.033416+0000","last_peered":"2024-04-26T10:42:27.033416+0000","last_clean":"2024-04-26T10:42:27.033416+0000","last_became_active":"2024-04-26T10:42:26.042378+0000","last_became_peered":"2024-04-26T10:42:26.042378+0000","last_unstale":"2024-04-26T10:42:27.033416+0000","last_undegraded":"2024-04-26T10:42:27.033416+0000","last_fullsized":"2024-04-26T10:42:27.033416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:24.255706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032809+0000","last_change":"2024-04-26T10:42:26.046353+0000","last_active":"2024-04-26T10:42:27.032809+0000","last_peered":"2024-04-26T10:42:27.032809+0000","last_clean":"2024-04-26T10:42:27.032809+0000","last_became_active":"2024-04-26T10:42:26.045614+0000","last_became_peered":"2024-04-26T10:42:26.045614+0000","last_unstale":"2024-04-26T10:42:27.032809+0000","last_undegraded":"2024-04-26T10:42:27.032809+0000","last_fullsized":"2024-04-26T10:42:27.032809+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:19.601720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032687+0000","last_change":"2024-04-26T10:42:26.045311+0000","last_active":"2024-04-26T10:42:27.032687+0000","last_peered":"2024-04-26T10:42:27.032687+0000","last_clean":"2024-04-26T10:42:27.032687+0000","last_became_active":"2024-04-26T10:42:26.044614+0000","last_became_peered":"2024-04-26T10:42:26.044614+0000","last_unstale":"2024-04-26T10:42:27.032687+0000","last_undegraded":"2024-04-26T10:42:27.032687+0000","last_fullsized":"2024-04-26T10:42:27.032687+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032624+0000","last_change":"2024-04-26T10:42:26.043614+0000","last_active":"2024-04-26T10:42:27.032624+0000","last_peered":"2024-04-26T10:42:27.032624+0000","last_clean":"2024-04-26T10:42:27.032624+0000","last_became_active":"2024-04-26T10:42:26.042629+0000","last_became_peered":"2024-04-26T10:42:26.042629+0000","last_unstale":"2024-04-26T10:42:27.032624+0000","last_undegraded":"2024-04-26T10:42:27.032624+0000","last_fullsized":"2024-04-26T10:42:27.032624+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033909+0000","last_change":"2024-04-26T10:42:26.046876+0000","last_active":"2024-04-26T10:42:27.033909+0000","last_peered":"2024-04-26T10:42:27.033909+0000","last_clean":"2024-04-26T10:42:27.033909+0000","last_became_active":"2024-04-26T10:42:26.046177+0000","last_became_peered":"2024-04-26T10:42:26.046177+0000","last_unstale":"2024-04-26T10:42:27.033909+0000","last_undegraded":"2024-04-26T10:42:27.033909+0000","last_fullsized":"2024-04-26T10:42:27.033909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:51.567162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033546+0000","last_change":"2024-04-26T10:42:26.044190+0000","last_active":"2024-04-26T10:42:27.033546+0000","last_peered":"2024-04-26T10:42:27.033546+0000","last_clean":"2024-04-26T10:42:27.033546+0000","last_became_active":"2024-04-26T10:42:26.043736+0000","last_became_peered":"2024-04-26T10:42:26.043736+0000","last_unstale":"2024-04-26T10:42:27.033546+0000","last_undegraded":"2024-04-26T10:42:27.033546+0000","last_fullsized":"2024-04-26T10:42:27.033546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033729+0000","last_change":"2024-04-26T10:42:26.041008+0000","last_active":"2024-04-26T10:42:27.033729+0000","last_peered":"2024-04-26T10:42:27.033729+0000","last_clean":"2024-04-26T10:42:27.033729+0000","last_became_active":"2024-04-26T10:42:26.039620+0000","last_became_peered":"2024-04-26T10:42:26.039620+0000","last_unstale":"2024-04-26T10:42:27.033729+0000","last_undegraded":"2024-04-26T10:42:27.033729+0000","last_fullsized":"2024-04-26T10:42:27.033729+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033575+0000","last_change":"2024-04-26T10:42:26.046392+0000","last_active":"2024-04-26T10:42:27.033575+0000","last_peered":"2024-04-26T10:42:27.033575+0000","last_clean":"2024-04-26T10:42:27.033575+0000","last_became_active":"2024-04-26T10:42:26.045806+0000","last_became_peered":"2024-04-26T10:42:26.045806+0000","last_unstale":"2024-04-26T10:42:27.033575+0000","last_undegraded":"2024-04-26T10:42:27.033575+0000","last_fullsized":"2024-04-26T10:42:27.033575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:15:59.087635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033383+0000","last_change":"2024-04-26T10:42:26.045205+0000","last_active":"2024-04-26T10:42:27.033383+0000","last_peered":"2024-04-26T10:42:27.033383+0000","last_clean":"2024-04-26T10:42:27.033383+0000","last_became_active":"2024-04-26T10:42:26.044762+0000","last_became_peered":"2024-04-26T10:42:26.044762+0000","last_unstale":"2024-04-26T10:42:27.033383+0000","last_undegraded":"2024-04-26T10:42:27.033383+0000","last_fullsized":"2024-04-26T10:42:27.033383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033051+0000","last_change":"2024-04-26T10:42:26.046020+0000","last_active":"2024-04-26T10:42:27.033051+0000","last_peered":"2024-04-26T10:42:27.033051+0000","last_clean":"2024-04-26T10:42:27.033051+0000","last_became_active":"2024-04-26T10:42:26.045567+0000","last_became_peered":"2024-04-26T10:42:26.045567+0000","last_unstale":"2024-04-26T10:42:27.033051+0000","last_undegraded":"2024-04-26T10:42:27.033051+0000","last_fullsized":"2024-04-26T10:42:27.033051+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:53.380329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032770+0000","last_change":"2024-04-26T10:42:26.046584+0000","last_active":"2024-04-26T10:42:27.032770+0000","last_peered":"2024-04-26T10:42:27.032770+0000","last_clean":"2024-04-26T10:42:27.032770+0000","last_became_active":"2024-04-26T10:42:26.046231+0000","last_became_peered":"2024-04-26T10:42:26.046231+0000","last_unstale":"2024-04-26T10:42:27.032770+0000","last_undegraded":"2024-04-26T10:42:27.032770+0000","last_fullsized":"2024-04-26T10:42:27.032770+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032953+0000","last_change":"2024-04-26T10:42:26.045270+0000","last_active":"2024-04-26T10:42:27.032953+0000","last_peered":"2024-04-26T10:42:27.032953+0000","last_clean":"2024-04-26T10:42:27.032953+0000","last_became_active":"2024-04-26T10:42:26.044341+0000","last_became_peered":"2024-04-26T10:42:26.044341+0000","last_unstale":"2024-04-26T10:42:27.032953+0000","last_undegraded":"2024-04-26T10:42:27.032953+0000","last_fullsized":"2024-04-26T10:42:27.032953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:46.975947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033573+0000","last_change":"2024-04-26T10:42:26.041757+0000","last_active":"2024-04-26T10:42:27.033573+0000","last_peered":"2024-04-26T10:42:27.033573+0000","last_clean":"2024-04-26T10:42:27.033573+0000","last_became_active":"2024-04-26T10:42:26.040920+0000","last_became_peered":"2024-04-26T10:42:26.040920+0000","last_unstale":"2024-04-26T10:42:27.033573+0000","last_undegraded":"2024-04-26T10:42:27.033573+0000","last_fullsized":"2024-04-26T10:42:27.033573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033905+0000","last_change":"2024-04-26T10:42:25.687138+0000","last_active":"2024-04-26T10:42:27.033905+0000","last_peered":"2024-04-26T10:42:27.033905+0000","last_clean":"2024-04-26T10:42:27.033905+0000","last_became_active":"2024-04-26T10:42:25.686488+0000","last_became_peered":"2024-04-26T10:42:25.686488+0000","last_unstale":"2024-04-26T10:42:27.033905+0000","last_undegraded":"2024-04-26T10:42:27.033905+0000","last_fullsized":"2024-04-26T10:42:27.033905+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:43.969731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033779+0000","last_change":"2024-04-26T10:42:26.041850+0000","last_active":"2024-04-26T10:42:27.033779+0000","last_peered":"2024-04-26T10:42:27.033779+0000","last_clean":"2024-04-26T10:42:27.033779+0000","last_became_active":"2024-04-26T10:42:26.040464+0000","last_became_peered":"2024-04-26T10:42:26.040464+0000","last_unstale":"2024-04-26T10:42:27.033779+0000","last_undegraded":"2024-04-26T10:42:27.033779+0000","last_fullsized":"2024-04-26T10:42:27.033779+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033039+0000","last_change":"2024-04-26T10:42:25.685525+0000","last_active":"2024-04-26T10:42:27.033039+0000","last_peered":"2024-04-26T10:42:27.033039+0000","last_clean":"2024-04-26T10:42:27.033039+0000","last_became_active":"2024-04-26T10:42:25.684855+0000","last_became_peered":"2024-04-26T10:42:25.684855+0000","last_unstale":"2024-04-26T10:42:27.033039+0000","last_undegraded":"2024-04-26T10:42:27.033039+0000","last_fullsized":"2024-04-26T10:42:27.033039+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:16.723401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033789+0000","last_change":"2024-04-26T10:42:26.046616+0000","last_active":"2024-04-26T10:42:27.033789+0000","last_peered":"2024-04-26T10:42:27.033789+0000","last_clean":"2024-04-26T10:42:27.033789+0000","last_became_active":"2024-04-26T10:42:26.046010+0000","last_became_peered":"2024-04-26T10:42:26.046010+0000","last_unstale":"2024-04-26T10:42:27.033789+0000","last_undegraded":"2024-04-26T10:42:27.033789+0000","last_fullsized":"2024-04-26T10:42:27.033789+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:19.601720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032884+0000","last_change":"2024-04-26T10:42:25.688905+0000","last_active":"2024-04-26T10:42:27.032884+0000","last_peered":"2024-04-26T10:42:27.032884+0000","last_clean":"2024-04-26T10:42:27.032884+0000","last_became_active":"2024-04-26T10:42:25.688504+0000","last_became_peered":"2024-04-26T10:42:25.688504+0000","last_unstale":"2024-04-26T10:42:27.032884+0000","last_undegraded":"2024-04-26T10:42:27.032884+0000","last_fullsized":"2024-04-26T10:42:27.032884+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.930441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033655+0000","last_change":"2024-04-26T10:42:26.046158+0000","last_active":"2024-04-26T10:42:27.033655+0000","last_peered":"2024-04-26T10:42:27.033655+0000","last_clean":"2024-04-26T10:42:27.033655+0000","last_became_active":"2024-04-26T10:42:26.045797+0000","last_became_peered":"2024-04-26T10:42:26.045797+0000","last_unstale":"2024-04-26T10:42:27.033655+0000","last_undegraded":"2024-04-26T10:42:27.033655+0000","last_fullsized":"2024-04-26T10:42:27.033655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:23.079349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032889+0000","last_change":"2024-04-26T10:42:25.687207+0000","last_active":"2024-04-26T10:42:27.032889+0000","last_peered":"2024-04-26T10:42:27.032889+0000","last_clean":"2024-04-26T10:42:27.032889+0000","last_became_active":"2024-04-26T10:42:25.686549+0000","last_became_peered":"2024-04-26T10:42:25.686549+0000","last_unstale":"2024-04-26T10:42:27.032889+0000","last_undegraded":"2024-04-26T10:42:27.032889+0000","last_fullsized":"2024-04-26T10:42:27.032889+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:42.125386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033731+0000","last_change":"2024-04-26T10:42:25.684462+0000","last_active":"2024-04-26T10:42:27.033731+0000","last_peered":"2024-04-26T10:42:27.033731+0000","last_clean":"2024-04-26T10:42:27.033731+0000","last_became_active":"2024-04-26T10:42:25.684162+0000","last_became_peered":"2024-04-26T10:42:25.684162+0000","last_unstale":"2024-04-26T10:42:27.033731+0000","last_undegraded":"2024-04-26T10:42:27.033731+0000","last_fullsized":"2024-04-26T10:42:27.033731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.850118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032640+0000","last_change":"2024-04-26T10:42:26.048114+0000","last_active":"2024-04-26T10:42:27.032640+0000","last_peered":"2024-04-26T10:42:27.032640+0000","last_clean":"2024-04-26T10:42:27.032640+0000","last_became_active":"2024-04-26T10:42:26.046641+0000","last_became_peered":"2024-04-26T10:42:26.046641+0000","last_unstale":"2024-04-26T10:42:27.032640+0000","last_undegraded":"2024-04-26T10:42:27.032640+0000","last_fullsized":"2024-04-26T10:42:27.032640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:01.056945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033763+0000","last_change":"2024-04-26T10:42:25.688889+0000","last_active":"2024-04-26T10:42:27.033763+0000","last_peered":"2024-04-26T10:42:27.033763+0000","last_clean":"2024-04-26T10:42:27.033763+0000","last_became_active":"2024-04-26T10:42:25.688372+0000","last_became_peered":"2024-04-26T10:42:25.688372+0000","last_unstale":"2024-04-26T10:42:27.033763+0000","last_undegraded":"2024-04-26T10:42:27.033763+0000","last_fullsized":"2024-04-26T10:42:27.033763+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:13.799290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032734+0000","last_change":"2024-04-26T10:42:26.041968+0000","last_active":"2024-04-26T10:42:27.032734+0000","last_peered":"2024-04-26T10:42:27.032734+0000","last_clean":"2024-04-26T10:42:27.032734+0000","last_became_active":"2024-04-26T10:42:26.041070+0000","last_became_peered":"2024-04-26T10:42:26.041070+0000","last_unstale":"2024-04-26T10:42:27.032734+0000","last_undegraded":"2024-04-26T10:42:27.032734+0000","last_fullsized":"2024-04-26T10:42:27.032734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033901+0000","last_change":"2024-04-26T10:42:25.684653+0000","last_active":"2024-04-26T10:42:27.033901+0000","last_peered":"2024-04-26T10:42:27.033901+0000","last_clean":"2024-04-26T10:42:27.033901+0000","last_became_active":"2024-04-26T10:42:25.684338+0000","last_became_peered":"2024-04-26T10:42:25.684338+0000","last_unstale":"2024-04-26T10:42:27.033901+0000","last_undegraded":"2024-04-26T10:42:27.033901+0000","last_fullsized":"2024-04-26T10:42:27.033901+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:10.694039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033371+0000","last_change":"2024-04-26T10:42:26.042182+0000","last_active":"2024-04-26T10:42:27.033371+0000","last_peered":"2024-04-26T10:42:27.033371+0000","last_clean":"2024-04-26T10:42:27.033371+0000","last_became_active":"2024-04-26T10:42:26.041689+0000","last_became_peered":"2024-04-26T10:42:26.041689+0000","last_unstale":"2024-04-26T10:42:27.033371+0000","last_undegraded":"2024-04-26T10:42:27.033371+0000","last_fullsized":"2024-04-26T10:42:27.033371+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:32:19.618648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033908+0000","last_change":"2024-04-26T10:42:25.686677+0000","last_active":"2024-04-26T10:42:27.033908+0000","last_peered":"2024-04-26T10:42:27.033908+0000","last_clean":"2024-04-26T10:42:27.033908+0000","last_became_active":"2024-04-26T10:42:25.685939+0000","last_became_peered":"2024-04-26T10:42:25.685939+0000","last_unstale":"2024-04-26T10:42:27.033908+0000","last_undegraded":"2024-04-26T10:42:27.033908+0000","last_fullsized":"2024-04-26T10:42:27.033908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:30.225098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033381+0000","last_change":"2024-04-26T10:42:26.045829+0000","last_active":"2024-04-26T10:42:27.033381+0000","last_peered":"2024-04-26T10:42:27.033381+0000","last_clean":"2024-04-26T10:42:27.033381+0000","last_became_active":"2024-04-26T10:42:26.045499+0000","last_became_peered":"2024-04-26T10:42:26.045499+0000","last_unstale":"2024-04-26T10:42:27.033381+0000","last_undegraded":"2024-04-26T10:42:27.033381+0000","last_fullsized":"2024-04-26T10:42:27.033381+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:14.041039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033624+0000","last_change":"2024-04-26T10:42:25.687934+0000","last_active":"2024-04-26T10:42:27.033624+0000","last_peered":"2024-04-26T10:42:27.033624+0000","last_clean":"2024-04-26T10:42:27.033624+0000","last_became_active":"2024-04-26T10:42:25.687447+0000","last_became_peered":"2024-04-26T10:42:25.687447+0000","last_unstale":"2024-04-26T10:42:27.033624+0000","last_undegraded":"2024-04-26T10:42:27.033624+0000","last_fullsized":"2024-04-26T10:42:27.033624+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.930441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033660+0000","last_change":"2024-04-26T10:42:26.043638+0000","last_active":"2024-04-26T10:42:27.033660+0000","last_peered":"2024-04-26T10:42:27.033660+0000","last_clean":"2024-04-26T10:42:27.033660+0000","last_became_active":"2024-04-26T10:42:26.042692+0000","last_became_peered":"2024-04-26T10:42:26.042692+0000","last_unstale":"2024-04-26T10:42:27.033660+0000","last_undegraded":"2024-04-26T10:42:27.033660+0000","last_fullsized":"2024-04-26T10:42:27.033660+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033803+0000","last_change":"2024-04-26T10:42:25.687283+0000","last_active":"2024-04-26T10:42:27.033803+0000","last_peered":"2024-04-26T10:42:27.033803+0000","last_clean":"2024-04-26T10:42:27.033803+0000","last_became_active":"2024-04-26T10:42:25.686251+0000","last_became_peered":"2024-04-26T10:42:25.686251+0000","last_unstale":"2024-04-26T10:42:27.033803+0000","last_undegraded":"2024-04-26T10:42:27.033803+0000","last_fullsized":"2024-04-26T10:42:27.033803+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:16.723401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033798+0000","last_change":"2024-04-26T10:42:26.040688+0000","last_active":"2024-04-26T10:42:27.033798+0000","last_peered":"2024-04-26T10:42:27.033798+0000","last_clean":"2024-04-26T10:42:27.033798+0000","last_became_active":"2024-04-26T10:42:26.039133+0000","last_became_peered":"2024-04-26T10:42:26.039133+0000","last_unstale":"2024-04-26T10:42:27.033798+0000","last_undegraded":"2024-04-26T10:42:27.033798+0000","last_fullsized":"2024-04-26T10:42:27.033798+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032938+0000","last_change":"2024-04-26T10:42:25.688837+0000","last_active":"2024-04-26T10:42:27.032938+0000","last_peered":"2024-04-26T10:42:27.032938+0000","last_clean":"2024-04-26T10:42:27.032938+0000","last_became_active":"2024-04-26T10:42:25.688450+0000","last_became_peered":"2024-04-26T10:42:25.688450+0000","last_unstale":"2024-04-26T10:42:27.032938+0000","last_undegraded":"2024-04-26T10:42:27.032938+0000","last_fullsized":"2024-04-26T10:42:27.032938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:26.788267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033564+0000","last_change":"2024-04-26T10:42:26.039661+0000","last_active":"2024-04-26T10:42:27.033564+0000","last_peered":"2024-04-26T10:42:27.033564+0000","last_clean":"2024-04-26T10:42:27.033564+0000","last_became_active":"2024-04-26T10:42:26.038664+0000","last_became_peered":"2024-04-26T10:42:26.038664+0000","last_unstale":"2024-04-26T10:42:27.033564+0000","last_undegraded":"2024-04-26T10:42:27.033564+0000","last_fullsized":"2024-04-26T10:42:27.033564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032757+0000","last_change":"2024-04-26T10:42:25.687082+0000","last_active":"2024-04-26T10:42:27.032757+0000","last_peered":"2024-04-26T10:42:27.032757+0000","last_clean":"2024-04-26T10:42:27.032757+0000","last_became_active":"2024-04-26T10:42:25.686779+0000","last_became_peered":"2024-04-26T10:42:25.686779+0000","last_unstale":"2024-04-26T10:42:27.032757+0000","last_undegraded":"2024-04-26T10:42:27.032757+0000","last_fullsized":"2024-04-26T10:42:27.032757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:12.284219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033692+0000","last_change":"2024-04-26T10:42:26.047130+0000","last_active":"2024-04-26T10:42:27.033692+0000","last_peered":"2024-04-26T10:42:27.033692+0000","last_clean":"2024-04-26T10:42:27.033692+0000","last_became_active":"2024-04-26T10:42:26.046884+0000","last_became_peered":"2024-04-26T10:42:26.046884+0000","last_unstale":"2024-04-26T10:42:27.033692+0000","last_undegraded":"2024-04-26T10:42:27.033692+0000","last_fullsized":"2024-04-26T10:42:27.033692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:31.020364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.035198+0000","last_change":"2024-04-26T10:42:21.406599+0000","last_active":"2024-04-26T10:42:26.035198+0000","last_peered":"2024-04-26T10:42:26.035198+0000","last_clean":"2024-04-26T10:42:26.035198+0000","last_became_active":"2024-04-26T10:42:21.405587+0000","last_became_peered":"2024-04-26T10:42:21.405587+0000","last_unstale":"2024-04-26T10:42:26.035198+0000","last_undegraded":"2024-04-26T10:42:26.035198+0000","last_fullsized":"2024-04-26T10:42:26.035198+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:44.561530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.035065+0000","last_change":"2024-04-26T10:42:21.405305+0000","last_active":"2024-04-26T10:42:26.035065+0000","last_peered":"2024-04-26T10:42:26.035065+0000","last_clean":"2024-04-26T10:42:26.035065+0000","last_became_active":"2024-04-26T10:42:21.405032+0000","last_became_peered":"2024-04-26T10:42:21.405032+0000","last_unstale":"2024-04-26T10:42:26.035065+0000","last_undegraded":"2024-04-26T10:42:26.035065+0000","last_fullsized":"2024-04-26T10:42:26.035065+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033157+0000","last_change":"2024-04-26T10:42:25.686765+0000","last_active":"2024-04-26T10:42:27.033157+0000","last_peered":"2024-04-26T10:42:27.033157+0000","last_clean":"2024-04-26T10:42:27.033157+0000","last_became_active":"2024-04-26T10:42:25.686009+0000","last_became_peered":"2024-04-26T10:42:25.686009+0000","last_unstale":"2024-04-26T10:42:27.033157+0000","last_undegraded":"2024-04-26T10:42:27.033157+0000","last_fullsized":"2024-04-26T10:42:27.033157+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:54.627815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033875+0000","last_change":"2024-04-26T10:42:26.040215+0000","last_active":"2024-04-26T10:42:27.033875+0000","last_peered":"2024-04-26T10:42:27.033875+0000","last_clean":"2024-04-26T10:42:27.033875+0000","last_became_active":"2024-04-26T10:42:26.039129+0000","last_became_peered":"2024-04-26T10:42:26.039129+0000","last_unstale":"2024-04-26T10:42:27.033875+0000","last_undegraded":"2024-04-26T10:42:27.033875+0000","last_fullsized":"2024-04-26T10:42:27.033875+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.035134+0000","last_change":"2024-04-26T10:42:21.406881+0000","last_active":"2024-04-26T10:42:26.035134+0000","last_peered":"2024-04-26T10:42:26.035134+0000","last_clean":"2024-04-26T10:42:26.035134+0000","last_became_active":"2024-04-26T10:42:21.406634+0000","last_became_peered":"2024-04-26T10:42:21.406634+0000","last_unstale":"2024-04-26T10:42:26.035134+0000","last_undegraded":"2024-04-26T10:42:26.035134+0000","last_fullsized":"2024-04-26T10:42:26.035134+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:45.892841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033120+0000","last_change":"2024-04-26T10:42:25.687986+0000","last_active":"2024-04-26T10:42:27.033120+0000","last_peered":"2024-04-26T10:42:27.033120+0000","last_clean":"2024-04-26T10:42:27.033120+0000","last_became_active":"2024-04-26T10:42:25.687201+0000","last_became_peered":"2024-04-26T10:42:25.687201+0000","last_unstale":"2024-04-26T10:42:27.033120+0000","last_undegraded":"2024-04-26T10:42:27.033120+0000","last_fullsized":"2024-04-26T10:42:27.033120+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:35.867262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033630+0000","last_change":"2024-04-26T10:42:26.043723+0000","last_active":"2024-04-26T10:42:27.033630+0000","last_peered":"2024-04-26T10:42:27.033630+0000","last_clean":"2024-04-26T10:42:27.033630+0000","last_became_active":"2024-04-26T10:42:26.041814+0000","last_became_peered":"2024-04-26T10:42:26.041814+0000","last_unstale":"2024-04-26T10:42:27.033630+0000","last_undegraded":"2024-04-26T10:42:27.033630+0000","last_fullsized":"2024-04-26T10:42:27.033630+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.032836+0000","last_change":"2024-04-26T10:42:21.405597+0000","last_active":"2024-04-26T10:42:26.032836+0000","last_peered":"2024-04-26T10:42:26.032836+0000","last_clean":"2024-04-26T10:42:26.032836+0000","last_became_active":"2024-04-26T10:42:21.405117+0000","last_became_peered":"2024-04-26T10:42:21.405117+0000","last_unstale":"2024-04-26T10:42:26.032836+0000","last_undegraded":"2024-04-26T10:42:26.032836+0000","last_fullsized":"2024-04-26T10:42:26.032836+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033005+0000","last_change":"2024-04-26T10:42:25.688955+0000","last_active":"2024-04-26T10:42:27.033005+0000","last_peered":"2024-04-26T10:42:27.033005+0000","last_clean":"2024-04-26T10:42:27.033005+0000","last_became_active":"2024-04-26T10:42:25.688552+0000","last_became_peered":"2024-04-26T10:42:25.688552+0000","last_unstale":"2024-04-26T10:42:27.033005+0000","last_undegraded":"2024-04-26T10:42:27.033005+0000","last_fullsized":"2024-04-26T10:42:27.033005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:04.963775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033758+0000","last_change":"2024-04-26T10:42:26.049311+0000","last_active":"2024-04-26T10:42:27.033758+0000","last_peered":"2024-04-26T10:42:27.033758+0000","last_clean":"2024-04-26T10:42:27.033758+0000","last_became_active":"2024-04-26T10:42:26.048915+0000","last_became_peered":"2024-04-26T10:42:26.048915+0000","last_unstale":"2024-04-26T10:42:27.033758+0000","last_undegraded":"2024-04-26T10:42:27.033758+0000","last_fullsized":"2024-04-26T10:42:27.033758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:01.056945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.034656+0000","last_change":"2024-04-26T10:42:21.405298+0000","last_active":"2024-04-26T10:42:26.034656+0000","last_peered":"2024-04-26T10:42:26.034656+0000","last_clean":"2024-04-26T10:42:26.034656+0000","last_became_active":"2024-04-26T10:42:21.405011+0000","last_became_peered":"2024-04-26T10:42:21.405011+0000","last_unstale":"2024-04-26T10:42:26.034656+0000","last_undegraded":"2024-04-26T10:42:26.034656+0000","last_fullsized":"2024-04-26T10:42:26.034656+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:47.789961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033960+0000","last_change":"2024-04-26T10:42:25.686177+0000","last_active":"2024-04-26T10:42:27.033960+0000","last_peered":"2024-04-26T10:42:27.033960+0000","last_clean":"2024-04-26T10:42:27.033960+0000","last_became_active":"2024-04-26T10:42:25.685121+0000","last_became_peered":"2024-04-26T10:42:25.685121+0000","last_unstale":"2024-04-26T10:42:27.033960+0000","last_undegraded":"2024-04-26T10:42:27.033960+0000","last_fullsized":"2024-04-26T10:42:27.033960+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:34.398138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033614+0000","last_change":"2024-04-26T10:42:26.045312+0000","last_active":"2024-04-26T10:42:27.033614+0000","last_peered":"2024-04-26T10:42:27.033614+0000","last_clean":"2024-04-26T10:42:27.033614+0000","last_became_active":"2024-04-26T10:42:26.044619+0000","last_became_peered":"2024-04-26T10:42:26.044619+0000","last_unstale":"2024-04-26T10:42:27.033614+0000","last_undegraded":"2024-04-26T10:42:27.033614+0000","last_fullsized":"2024-04-26T10:42:27.033614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:50.646374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033966+0000","last_change":"2024-04-26T10:42:25.686310+0000","last_active":"2024-04-26T10:42:27.033966+0000","last_peered":"2024-04-26T10:42:27.033966+0000","last_clean":"2024-04-26T10:42:27.033966+0000","last_became_active":"2024-04-26T10:42:25.685767+0000","last_became_peered":"2024-04-26T10:42:25.685767+0000","last_unstale":"2024-04-26T10:42:27.033966+0000","last_undegraded":"2024-04-26T10:42:27.033966+0000","last_fullsized":"2024-04-26T10:42:27.033966+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:02.874807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.032839+0000","last_change":"2024-04-26T10:42:21.405754+0000","last_active":"2024-04-26T10:42:26.032839+0000","last_peered":"2024-04-26T10:42:26.032839+0000","last_clean":"2024-04-26T10:42:26.032839+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:42:26.032839+0000","last_undegraded":"2024-04-26T10:42:26.032839+0000","last_fullsized":"2024-04-26T10:42:26.032839+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:47.123256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032872+0000","last_change":"2024-04-26T10:42:26.043764+0000","last_active":"2024-04-26T10:42:27.032872+0000","last_peered":"2024-04-26T10:42:27.032872+0000","last_clean":"2024-04-26T10:42:27.032872+0000","last_became_active":"2024-04-26T10:42:26.043388+0000","last_became_peered":"2024-04-26T10:42:26.043388+0000","last_unstale":"2024-04-26T10:42:27.032872+0000","last_undegraded":"2024-04-26T10:42:27.032872+0000","last_fullsized":"2024-04-26T10:42:27.032872+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:31.020364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033601+0000","last_change":"2024-04-26T10:42:25.685368+0000","last_active":"2024-04-26T10:42:27.033601+0000","last_peered":"2024-04-26T10:42:27.033601+0000","last_clean":"2024-04-26T10:42:27.033601+0000","last_became_active":"2024-04-26T10:42:25.684379+0000","last_became_peered":"2024-04-26T10:42:25.684379+0000","last_unstale":"2024-04-26T10:42:27.033601+0000","last_undegraded":"2024-04-26T10:42:27.033601+0000","last_fullsized":"2024-04-26T10:42:27.033601+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:34.398138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.037776+0000","last_change":"2024-04-26T10:42:21.405356+0000","last_active":"2024-04-26T10:42:26.037776+0000","last_peered":"2024-04-26T10:42:26.037776+0000","last_clean":"2024-04-26T10:42:26.037776+0000","last_became_active":"2024-04-26T10:42:21.405006+0000","last_became_peered":"2024-04-26T10:42:21.405006+0000","last_unstale":"2024-04-26T10:42:26.037776+0000","last_undegraded":"2024-04-26T10:42:26.037776+0000","last_fullsized":"2024-04-26T10:42:26.037776+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:55.043967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033128+0000","last_change":"2024-04-26T10:42:26.042954+0000","last_active":"2024-04-26T10:42:27.033128+0000","last_peered":"2024-04-26T10:42:27.033128+0000","last_clean":"2024-04-26T10:42:27.033128+0000","last_became_active":"2024-04-26T10:42:26.042544+0000","last_became_peered":"2024-04-26T10:42:26.042544+0000","last_unstale":"2024-04-26T10:42:27.033128+0000","last_undegraded":"2024-04-26T10:42:27.033128+0000","last_fullsized":"2024-04-26T10:42:27.033128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:14.041039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033915+0000","last_change":"2024-04-26T10:42:25.687201+0000","last_active":"2024-04-26T10:42:27.033915+0000","last_peered":"2024-04-26T10:42:27.033915+0000","last_clean":"2024-04-26T10:42:27.033915+0000","last_became_active":"2024-04-26T10:42:25.686641+0000","last_became_peered":"2024-04-26T10:42:25.686641+0000","last_unstale":"2024-04-26T10:42:27.033915+0000","last_undegraded":"2024-04-26T10:42:27.033915+0000","last_fullsized":"2024-04-26T10:42:27.033915+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:30.225098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.033642+0000","last_change":"2024-04-26T10:42:21.405615+0000","last_active":"2024-04-26T10:42:26.033642+0000","last_peered":"2024-04-26T10:42:26.033642+0000","last_clean":"2024-04-26T10:42:26.033642+0000","last_became_active":"2024-04-26T10:42:21.405184+0000","last_became_peered":"2024-04-26T10:42:21.405184+0000","last_unstale":"2024-04-26T10:42:26.033642+0000","last_undegraded":"2024-04-26T10:42:26.033642+0000","last_fullsized":"2024-04-26T10:42:26.033642+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:52.378909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032862+0000","last_change":"2024-04-26T10:42:26.046832+0000","last_active":"2024-04-26T10:42:27.032862+0000","last_peered":"2024-04-26T10:42:27.032862+0000","last_clean":"2024-04-26T10:42:27.032862+0000","last_became_active":"2024-04-26T10:42:26.046484+0000","last_became_peered":"2024-04-26T10:42:26.046484+0000","last_unstale":"2024-04-26T10:42:27.032862+0000","last_undegraded":"2024-04-26T10:42:27.032862+0000","last_fullsized":"2024-04-26T10:42:27.032862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:28.856785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652287+0000","last_change":"2024-04-26T10:42:25.686262+0000","last_active":"2024-04-26T10:42:29.652287+0000","last_peered":"2024-04-26T10:42:29.652287+0000","last_clean":"2024-04-26T10:42:29.652287+0000","last_became_active":"2024-04-26T10:42:25.685528+0000","last_became_peered":"2024-04-26T10:42:25.685528+0000","last_unstale":"2024-04-26T10:42:29.652287+0000","last_undegraded":"2024-04-26T10:42:29.652287+0000","last_fullsized":"2024-04-26T10:42:29.652287+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:47.138273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.035316+0000","last_change":"2024-04-26T10:42:21.405863+0000","last_active":"2024-04-26T10:42:26.035316+0000","last_peered":"2024-04-26T10:42:26.035316+0000","last_clean":"2024-04-26T10:42:26.035316+0000","last_became_active":"2024-04-26T10:42:21.405555+0000","last_became_peered":"2024-04-26T10:42:21.405555+0000","last_unstale":"2024-04-26T10:42:26.035316+0000","last_undegraded":"2024-04-26T10:42:26.035316+0000","last_fullsized":"2024-04-26T10:42:26.035316+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:39.259618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032766+0000","last_change":"2024-04-26T10:42:26.044818+0000","last_active":"2024-04-26T10:42:27.032766+0000","last_peered":"2024-04-26T10:42:27.032766+0000","last_clean":"2024-04-26T10:42:27.032766+0000","last_became_active":"2024-04-26T10:42:26.043969+0000","last_became_peered":"2024-04-26T10:42:26.043969+0000","last_unstale":"2024-04-26T10:42:27.032766+0000","last_undegraded":"2024-04-26T10:42:27.032766+0000","last_fullsized":"2024-04-26T10:42:27.032766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:50.646374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033819+0000","last_change":"2024-04-26T10:42:26.040224+0000","last_active":"2024-04-26T10:42:27.033819+0000","last_peered":"2024-04-26T10:42:27.033819+0000","last_clean":"2024-04-26T10:42:27.033819+0000","last_became_active":"2024-04-26T10:42:26.038590+0000","last_became_peered":"2024-04-26T10:42:26.038590+0000","last_unstale":"2024-04-26T10:42:27.033819+0000","last_undegraded":"2024-04-26T10:42:27.033819+0000","last_fullsized":"2024-04-26T10:42:27.033819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033865+0000","last_change":"2024-04-26T10:42:25.684447+0000","last_active":"2024-04-26T10:42:27.033865+0000","last_peered":"2024-04-26T10:42:27.033865+0000","last_clean":"2024-04-26T10:42:27.033865+0000","last_became_active":"2024-04-26T10:42:25.684147+0000","last_became_peered":"2024-04-26T10:42:25.684147+0000","last_unstale":"2024-04-26T10:42:27.033865+0000","last_undegraded":"2024-04-26T10:42:27.033865+0000","last_fullsized":"2024-04-26T10:42:27.033865+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:38.873282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032960+0000","last_change":"2024-04-26T10:42:26.045459+0000","last_active":"2024-04-26T10:42:27.032960+0000","last_peered":"2024-04-26T10:42:27.032960+0000","last_clean":"2024-04-26T10:42:27.032960+0000","last_became_active":"2024-04-26T10:42:26.044972+0000","last_became_peered":"2024-04-26T10:42:26.044972+0000","last_unstale":"2024-04-26T10:42:27.032960+0000","last_undegraded":"2024-04-26T10:42:27.032960+0000","last_fullsized":"2024-04-26T10:42:27.032960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033920+0000","last_change":"2024-04-26T10:42:25.687956+0000","last_active":"2024-04-26T10:42:27.033920+0000","last_peered":"2024-04-26T10:42:27.033920+0000","last_clean":"2024-04-26T10:42:27.033920+0000","last_became_active":"2024-04-26T10:42:25.687533+0000","last_became_peered":"2024-04-26T10:42:25.687533+0000","last_unstale":"2024-04-26T10:42:27.033920+0000","last_undegraded":"2024-04-26T10:42:27.033920+0000","last_fullsized":"2024-04-26T10:42:27.033920+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:28.506897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033679+0000","last_change":"2024-04-26T10:42:25.685829+0000","last_active":"2024-04-26T10:42:27.033679+0000","last_peered":"2024-04-26T10:42:27.033679+0000","last_clean":"2024-04-26T10:42:27.033679+0000","last_became_active":"2024-04-26T10:42:25.685307+0000","last_became_peered":"2024-04-26T10:42:25.685307+0000","last_unstale":"2024-04-26T10:42:27.033679+0000","last_undegraded":"2024-04-26T10:42:27.033679+0000","last_fullsized":"2024-04-26T10:42:27.033679+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032933+0000","last_change":"2024-04-26T10:42:26.046196+0000","last_active":"2024-04-26T10:42:27.032933+0000","last_peered":"2024-04-26T10:42:27.032933+0000","last_clean":"2024-04-26T10:42:27.032933+0000","last_became_active":"2024-04-26T10:42:26.045762+0000","last_became_peered":"2024-04-26T10:42:26.045762+0000","last_unstale":"2024-04-26T10:42:27.032933+0000","last_undegraded":"2024-04-26T10:42:27.032933+0000","last_fullsized":"2024-04-26T10:42:27.032933+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033848+0000","last_change":"2024-04-26T10:42:25.685990+0000","last_active":"2024-04-26T10:42:27.033848+0000","last_peered":"2024-04-26T10:42:27.033848+0000","last_clean":"2024-04-26T10:42:27.033848+0000","last_became_active":"2024-04-26T10:42:25.684604+0000","last_became_peered":"2024-04-26T10:42:25.684604+0000","last_unstale":"2024-04-26T10:42:27.033848+0000","last_undegraded":"2024-04-26T10:42:27.033848+0000","last_fullsized":"2024-04-26T10:42:27.033848+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:02.874807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032830+0000","last_change":"2024-04-26T10:42:26.038545+0000","last_active":"2024-04-26T10:42:27.032830+0000","last_peered":"2024-04-26T10:42:27.032830+0000","last_clean":"2024-04-26T10:42:27.032830+0000","last_became_active":"2024-04-26T10:42:26.038099+0000","last_became_peered":"2024-04-26T10:42:26.038099+0000","last_unstale":"2024-04-26T10:42:27.032830+0000","last_undegraded":"2024-04-26T10:42:27.032830+0000","last_fullsized":"2024-04-26T10:42:27.032830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033882+0000","last_change":"2024-04-26T10:42:26.046506+0000","last_active":"2024-04-26T10:42:27.033882+0000","last_peered":"2024-04-26T10:42:27.033882+0000","last_clean":"2024-04-26T10:42:27.033882+0000","last_became_active":"2024-04-26T10:42:26.045904+0000","last_became_peered":"2024-04-26T10:42:26.045904+0000","last_unstale":"2024-04-26T10:42:27.033882+0000","last_undegraded":"2024-04-26T10:42:27.033882+0000","last_fullsized":"2024-04-26T10:42:27.033882+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:49.854080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032971+0000","last_change":"2024-04-26T10:42:25.683890+0000","last_active":"2024-04-26T10:42:27.032971+0000","last_peered":"2024-04-26T10:42:27.032971+0000","last_clean":"2024-04-26T10:42:27.032971+0000","last_became_active":"2024-04-26T10:42:25.683467+0000","last_became_peered":"2024-04-26T10:42:25.683467+0000","last_unstale":"2024-04-26T10:42:27.032971+0000","last_undegraded":"2024-04-26T10:42:27.032971+0000","last_fullsized":"2024-04-26T10:42:27.032971+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033657+0000","last_change":"2024-04-26T10:42:26.046384+0000","last_active":"2024-04-26T10:42:27.033657+0000","last_peered":"2024-04-26T10:42:27.033657+0000","last_clean":"2024-04-26T10:42:27.033657+0000","last_became_active":"2024-04-26T10:42:26.045860+0000","last_became_peered":"2024-04-26T10:42:26.045860+0000","last_unstale":"2024-04-26T10:42:27.033657+0000","last_undegraded":"2024-04-26T10:42:27.033657+0000","last_fullsized":"2024-04-26T10:42:27.033657+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033002+0000","last_change":"2024-04-26T10:42:25.686972+0000","last_active":"2024-04-26T10:42:27.033002+0000","last_peered":"2024-04-26T10:42:27.033002+0000","last_clean":"2024-04-26T10:42:27.033002+0000","last_became_active":"2024-04-26T10:42:25.685903+0000","last_became_peered":"2024-04-26T10:42:25.685903+0000","last_unstale":"2024-04-26T10:42:27.033002+0000","last_undegraded":"2024-04-26T10:42:27.033002+0000","last_fullsized":"2024-04-26T10:42:27.033002+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:43.969731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033703+0000","last_change":"2024-04-26T10:42:26.046515+0000","last_active":"2024-04-26T10:42:27.033703+0000","last_peered":"2024-04-26T10:42:27.033703+0000","last_clean":"2024-04-26T10:42:27.033703+0000","last_became_active":"2024-04-26T10:42:26.045798+0000","last_became_peered":"2024-04-26T10:42:26.045798+0000","last_unstale":"2024-04-26T10:42:27.033703+0000","last_undegraded":"2024-04-26T10:42:27.033703+0000","last_fullsized":"2024-04-26T10:42:27.033703+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:28.856785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033066+0000","last_change":"2024-04-26T10:42:25.688221+0000","last_active":"2024-04-26T10:42:27.033066+0000","last_peered":"2024-04-26T10:42:27.033066+0000","last_clean":"2024-04-26T10:42:27.033066+0000","last_became_active":"2024-04-26T10:42:25.687829+0000","last_became_peered":"2024-04-26T10:42:25.687829+0000","last_unstale":"2024-04-26T10:42:27.033066+0000","last_undegraded":"2024-04-26T10:42:27.033066+0000","last_fullsized":"2024-04-26T10:42:27.033066+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:05.939715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033363+0000","last_change":"2024-04-26T10:42:26.042723+0000","last_active":"2024-04-26T10:42:27.033363+0000","last_peered":"2024-04-26T10:42:27.033363+0000","last_clean":"2024-04-26T10:42:27.033363+0000","last_became_active":"2024-04-26T10:42:26.041852+0000","last_became_peered":"2024-04-26T10:42:26.041852+0000","last_unstale":"2024-04-26T10:42:27.033363+0000","last_undegraded":"2024-04-26T10:42:27.033363+0000","last_fullsized":"2024-04-26T10:42:27.033363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033492+0000","last_change":"2024-04-26T10:42:25.688815+0000","last_active":"2024-04-26T10:42:27.033492+0000","last_peered":"2024-04-26T10:42:27.033492+0000","last_clean":"2024-04-26T10:42:27.033492+0000","last_became_active":"2024-04-26T10:42:25.688451+0000","last_became_peered":"2024-04-26T10:42:25.688451+0000","last_unstale":"2024-04-26T10:42:27.033492+0000","last_undegraded":"2024-04-26T10:42:27.033492+0000","last_fullsized":"2024-04-26T10:42:27.033492+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:17.143923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033256+0000","last_change":"2024-04-26T10:42:26.044040+0000","last_active":"2024-04-26T10:42:27.033256+0000","last_peered":"2024-04-26T10:42:27.033256+0000","last_clean":"2024-04-26T10:42:27.033256+0000","last_became_active":"2024-04-26T10:42:26.042629+0000","last_became_peered":"2024-04-26T10:42:26.042629+0000","last_unstale":"2024-04-26T10:42:27.033256+0000","last_undegraded":"2024-04-26T10:42:27.033256+0000","last_fullsized":"2024-04-26T10:42:27.033256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:23:05.308070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033778+0000","last_change":"2024-04-26T10:42:25.686442+0000","last_active":"2024-04-26T10:42:27.033778+0000","last_peered":"2024-04-26T10:42:27.033778+0000","last_clean":"2024-04-26T10:42:27.033778+0000","last_became_active":"2024-04-26T10:42:25.686029+0000","last_became_peered":"2024-04-26T10:42:25.686029+0000","last_unstale":"2024-04-26T10:42:27.033778+0000","last_undegraded":"2024-04-26T10:42:27.033778+0000","last_fullsized":"2024-04-26T10:42:27.033778+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:04.241132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033516+0000","last_change":"2024-04-26T10:42:26.042561+0000","last_active":"2024-04-26T10:42:27.033516+0000","last_peered":"2024-04-26T10:42:27.033516+0000","last_clean":"2024-04-26T10:42:27.033516+0000","last_became_active":"2024-04-26T10:42:26.041751+0000","last_became_peered":"2024-04-26T10:42:26.041751+0000","last_unstale":"2024-04-26T10:42:27.033516+0000","last_undegraded":"2024-04-26T10:42:27.033516+0000","last_fullsized":"2024-04-26T10:42:27.033516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033819+0000","last_change":"2024-04-26T10:42:25.687977+0000","last_active":"2024-04-26T10:42:27.033819+0000","last_peered":"2024-04-26T10:42:27.033819+0000","last_clean":"2024-04-26T10:42:27.033819+0000","last_became_active":"2024-04-26T10:42:25.687402+0000","last_became_peered":"2024-04-26T10:42:25.687402+0000","last_unstale":"2024-04-26T10:42:27.033819+0000","last_undegraded":"2024-04-26T10:42:27.033819+0000","last_fullsized":"2024-04-26T10:42:27.033819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:35.867262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033076+0000","last_change":"2024-04-26T10:42:26.041729+0000","last_active":"2024-04-26T10:42:27.033076+0000","last_peered":"2024-04-26T10:42:27.033076+0000","last_clean":"2024-04-26T10:42:27.033076+0000","last_became_active":"2024-04-26T10:42:26.040504+0000","last_became_peered":"2024-04-26T10:42:26.040504+0000","last_unstale":"2024-04-26T10:42:27.033076+0000","last_undegraded":"2024-04-26T10:42:27.033076+0000","last_fullsized":"2024-04-26T10:42:27.033076+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033769+0000","last_change":"2024-04-26T10:42:25.686861+0000","last_active":"2024-04-26T10:42:27.033769+0000","last_peered":"2024-04-26T10:42:27.033769+0000","last_clean":"2024-04-26T10:42:27.033769+0000","last_became_active":"2024-04-26T10:42:25.686149+0000","last_became_peered":"2024-04-26T10:42:25.686149+0000","last_unstale":"2024-04-26T10:42:27.033769+0000","last_undegraded":"2024-04-26T10:42:27.033769+0000","last_fullsized":"2024-04-26T10:42:27.033769+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:42.125386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033053+0000","last_change":"2024-04-26T10:42:26.045324+0000","last_active":"2024-04-26T10:42:27.033053+0000","last_peered":"2024-04-26T10:42:27.033053+0000","last_clean":"2024-04-26T10:42:27.033053+0000","last_became_active":"2024-04-26T10:42:26.044454+0000","last_became_peered":"2024-04-26T10:42:26.044454+0000","last_unstale":"2024-04-26T10:42:27.033053+0000","last_undegraded":"2024-04-26T10:42:27.033053+0000","last_fullsized":"2024-04-26T10:42:27.033053+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033768+0000","last_change":"2024-04-26T10:42:25.685528+0000","last_active":"2024-04-26T10:42:27.033768+0000","last_peered":"2024-04-26T10:42:27.033768+0000","last_clean":"2024-04-26T10:42:27.033768+0000","last_became_active":"2024-04-26T10:42:25.684508+0000","last_became_peered":"2024-04-26T10:42:25.684508+0000","last_unstale":"2024-04-26T10:42:27.033768+0000","last_undegraded":"2024-04-26T10:42:27.033768+0000","last_fullsized":"2024-04-26T10:42:27.033768+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.850118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31264,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340576,"statfs":{"total":96636764160,"available":96604749824,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35952,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335888,"statfs":{"total":96636764160,"available":96599949312,"internally_reserved":0,"allocated":749568,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:42:37.015 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:42:37.346 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:37.348 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:42:37.357 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-26T10:42:35.594250+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94984,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283020536,"statfs":{"total":289910292480,"available":289813028864,"internally_reserved":0,"allocated":1646592,"data_stored":1323601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.564503"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033761+0000","last_change":"2024-04-26T10:42:26.045527+0000","last_active":"2024-04-26T10:42:27.033761+0000","last_peered":"2024-04-26T10:42:27.033761+0000","last_clean":"2024-04-26T10:42:27.033761+0000","last_became_active":"2024-04-26T10:42:26.044597+0000","last_became_peered":"2024-04-26T10:42:26.044597+0000","last_unstale":"2024-04-26T10:42:27.033761+0000","last_undegraded":"2024-04-26T10:42:27.033761+0000","last_fullsized":"2024-04-26T10:42:27.033761+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033531+0000","last_change":"2024-04-26T10:42:26.043815+0000","last_active":"2024-04-26T10:42:27.033531+0000","last_peered":"2024-04-26T10:42:27.033531+0000","last_clean":"2024-04-26T10:42:27.033531+0000","last_became_active":"2024-04-26T10:42:26.042757+0000","last_became_peered":"2024-04-26T10:42:26.042757+0000","last_unstale":"2024-04-26T10:42:27.033531+0000","last_undegraded":"2024-04-26T10:42:27.033531+0000","last_fullsized":"2024-04-26T10:42:27.033531+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:27.752674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033378+0000","last_change":"2024-04-26T10:42:26.041030+0000","last_active":"2024-04-26T10:42:27.033378+0000","last_peered":"2024-04-26T10:42:27.033378+0000","last_clean":"2024-04-26T10:42:27.033378+0000","last_became_active":"2024-04-26T10:42:26.039762+0000","last_became_peered":"2024-04-26T10:42:26.039762+0000","last_unstale":"2024-04-26T10:42:27.033378+0000","last_undegraded":"2024-04-26T10:42:27.033378+0000","last_fullsized":"2024-04-26T10:42:27.033378+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033311+0000","last_change":"2024-04-26T10:42:26.044004+0000","last_active":"2024-04-26T10:42:27.033311+0000","last_peered":"2024-04-26T10:42:27.033311+0000","last_clean":"2024-04-26T10:42:27.033311+0000","last_became_active":"2024-04-26T10:42:26.042953+0000","last_became_peered":"2024-04-26T10:42:26.042953+0000","last_unstale":"2024-04-26T10:42:27.033311+0000","last_undegraded":"2024-04-26T10:42:27.033311+0000","last_fullsized":"2024-04-26T10:42:27.033311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.895922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033277+0000","last_change":"2024-04-26T10:42:26.041191+0000","last_active":"2024-04-26T10:42:27.033277+0000","last_peered":"2024-04-26T10:42:27.033277+0000","last_clean":"2024-04-26T10:42:27.033277+0000","last_became_active":"2024-04-26T10:42:26.040487+0000","last_became_peered":"2024-04-26T10:42:26.040487+0000","last_unstale":"2024-04-26T10:42:27.033277+0000","last_undegraded":"2024-04-26T10:42:27.033277+0000","last_fullsized":"2024-04-26T10:42:27.033277+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032976+0000","last_change":"2024-04-26T10:42:26.043542+0000","last_active":"2024-04-26T10:42:27.032976+0000","last_peered":"2024-04-26T10:42:27.032976+0000","last_clean":"2024-04-26T10:42:27.032976+0000","last_became_active":"2024-04-26T10:42:26.042631+0000","last_became_peered":"2024-04-26T10:42:26.042631+0000","last_unstale":"2024-04-26T10:42:27.032976+0000","last_undegraded":"2024-04-26T10:42:27.032976+0000","last_fullsized":"2024-04-26T10:42:27.032976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:38.272126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033024+0000","last_change":"2024-04-26T10:42:26.042698+0000","last_active":"2024-04-26T10:42:27.033024+0000","last_peered":"2024-04-26T10:42:27.033024+0000","last_clean":"2024-04-26T10:42:27.033024+0000","last_became_active":"2024-04-26T10:42:26.041631+0000","last_became_peered":"2024-04-26T10:42:26.041631+0000","last_unstale":"2024-04-26T10:42:27.033024+0000","last_undegraded":"2024-04-26T10:42:27.033024+0000","last_fullsized":"2024-04-26T10:42:27.033024+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:27.752674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032694+0000","last_change":"2024-04-26T10:42:26.045497+0000","last_active":"2024-04-26T10:42:27.032694+0000","last_peered":"2024-04-26T10:42:27.032694+0000","last_clean":"2024-04-26T10:42:27.032694+0000","last_became_active":"2024-04-26T10:42:26.044865+0000","last_became_peered":"2024-04-26T10:42:26.044865+0000","last_unstale":"2024-04-26T10:42:27.032694+0000","last_undegraded":"2024-04-26T10:42:27.032694+0000","last_fullsized":"2024-04-26T10:42:27.032694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:59:04.853293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033544+0000","last_change":"2024-04-26T10:42:26.045893+0000","last_active":"2024-04-26T10:42:27.033544+0000","last_peered":"2024-04-26T10:42:27.033544+0000","last_clean":"2024-04-26T10:42:27.033544+0000","last_became_active":"2024-04-26T10:42:26.045177+0000","last_became_peered":"2024-04-26T10:42:26.045177+0000","last_unstale":"2024-04-26T10:42:27.033544+0000","last_undegraded":"2024-04-26T10:42:27.033544+0000","last_fullsized":"2024-04-26T10:42:27.033544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033494+0000","last_change":"2024-04-26T10:42:26.044101+0000","last_active":"2024-04-26T10:42:27.033494+0000","last_peered":"2024-04-26T10:42:27.033494+0000","last_clean":"2024-04-26T10:42:27.033494+0000","last_became_active":"2024-04-26T10:42:26.042047+0000","last_became_peered":"2024-04-26T10:42:26.042047+0000","last_unstale":"2024-04-26T10:42:27.033494+0000","last_undegraded":"2024-04-26T10:42:27.033494+0000","last_fullsized":"2024-04-26T10:42:27.033494+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:46.975947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033560+0000","last_change":"2024-04-26T10:42:26.043530+0000","last_active":"2024-04-26T10:42:27.033560+0000","last_peered":"2024-04-26T10:42:27.033560+0000","last_clean":"2024-04-26T10:42:27.033560+0000","last_became_active":"2024-04-26T10:42:26.042301+0000","last_became_peered":"2024-04-26T10:42:26.042301+0000","last_unstale":"2024-04-26T10:42:27.033560+0000","last_undegraded":"2024-04-26T10:42:27.033560+0000","last_fullsized":"2024-04-26T10:42:27.033560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:48.440963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033166+0000","last_change":"2024-04-26T10:42:26.047073+0000","last_active":"2024-04-26T10:42:27.033166+0000","last_peered":"2024-04-26T10:42:27.033166+0000","last_clean":"2024-04-26T10:42:27.033166+0000","last_became_active":"2024-04-26T10:42:26.046384+0000","last_became_peered":"2024-04-26T10:42:26.046384+0000","last_unstale":"2024-04-26T10:42:27.033166+0000","last_undegraded":"2024-04-26T10:42:27.033166+0000","last_fullsized":"2024-04-26T10:42:27.033166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:23.079349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032981+0000","last_change":"2024-04-26T10:42:26.042607+0000","last_active":"2024-04-26T10:42:27.032981+0000","last_peered":"2024-04-26T10:42:27.032981+0000","last_clean":"2024-04-26T10:42:27.032981+0000","last_became_active":"2024-04-26T10:42:26.041617+0000","last_became_peered":"2024-04-26T10:42:26.041617+0000","last_unstale":"2024-04-26T10:42:27.032981+0000","last_undegraded":"2024-04-26T10:42:27.032981+0000","last_fullsized":"2024-04-26T10:42:27.032981+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033143+0000","last_change":"2024-04-26T10:42:26.040433+0000","last_active":"2024-04-26T10:42:27.033143+0000","last_peered":"2024-04-26T10:42:27.033143+0000","last_clean":"2024-04-26T10:42:27.033143+0000","last_became_active":"2024-04-26T10:42:26.039631+0000","last_became_peered":"2024-04-26T10:42:26.039631+0000","last_unstale":"2024-04-26T10:42:27.033143+0000","last_undegraded":"2024-04-26T10:42:27.033143+0000","last_fullsized":"2024-04-26T10:42:27.033143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033116+0000","last_change":"2024-04-26T10:42:26.040182+0000","last_active":"2024-04-26T10:42:27.033116+0000","last_peered":"2024-04-26T10:42:27.033116+0000","last_clean":"2024-04-26T10:42:27.033116+0000","last_became_active":"2024-04-26T10:42:26.038614+0000","last_became_peered":"2024-04-26T10:42:26.038614+0000","last_unstale":"2024-04-26T10:42:27.033116+0000","last_undegraded":"2024-04-26T10:42:27.033116+0000","last_fullsized":"2024-04-26T10:42:27.033116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032762+0000","last_change":"2024-04-26T10:42:26.045551+0000","last_active":"2024-04-26T10:42:27.032762+0000","last_peered":"2024-04-26T10:42:27.032762+0000","last_clean":"2024-04-26T10:42:27.032762+0000","last_became_active":"2024-04-26T10:42:26.044944+0000","last_became_peered":"2024-04-26T10:42:26.044944+0000","last_unstale":"2024-04-26T10:42:27.032762+0000","last_undegraded":"2024-04-26T10:42:27.032762+0000","last_fullsized":"2024-04-26T10:42:27.032762+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:02.194279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033885+0000","last_change":"2024-04-26T10:42:26.049338+0000","last_active":"2024-04-26T10:42:27.033885+0000","last_peered":"2024-04-26T10:42:27.033885+0000","last_clean":"2024-04-26T10:42:27.033885+0000","last_became_active":"2024-04-26T10:42:26.049014+0000","last_became_peered":"2024-04-26T10:42:26.049014+0000","last_unstale":"2024-04-26T10:42:27.033885+0000","last_undegraded":"2024-04-26T10:42:27.033885+0000","last_fullsized":"2024-04-26T10:42:27.033885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033767+0000","last_change":"2024-04-26T10:42:26.043604+0000","last_active":"2024-04-26T10:42:27.033767+0000","last_peered":"2024-04-26T10:42:27.033767+0000","last_clean":"2024-04-26T10:42:27.033767+0000","last_became_active":"2024-04-26T10:42:26.041224+0000","last_became_peered":"2024-04-26T10:42:26.041224+0000","last_unstale":"2024-04-26T10:42:27.033767+0000","last_undegraded":"2024-04-26T10:42:27.033767+0000","last_fullsized":"2024-04-26T10:42:27.033767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033328+0000","last_change":"2024-04-26T10:42:26.045031+0000","last_active":"2024-04-26T10:42:27.033328+0000","last_peered":"2024-04-26T10:42:27.033328+0000","last_clean":"2024-04-26T10:42:27.033328+0000","last_became_active":"2024-04-26T10:42:26.044604+0000","last_became_peered":"2024-04-26T10:42:26.044604+0000","last_unstale":"2024-04-26T10:42:27.033328+0000","last_undegraded":"2024-04-26T10:42:27.033328+0000","last_fullsized":"2024-04-26T10:42:27.033328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033728+0000","last_change":"2024-04-26T10:42:26.043762+0000","last_active":"2024-04-26T10:42:27.033728+0000","last_peered":"2024-04-26T10:42:27.033728+0000","last_clean":"2024-04-26T10:42:27.033728+0000","last_became_active":"2024-04-26T10:42:26.042117+0000","last_became_peered":"2024-04-26T10:42:26.042117+0000","last_unstale":"2024-04-26T10:42:27.033728+0000","last_undegraded":"2024-04-26T10:42:27.033728+0000","last_fullsized":"2024-04-26T10:42:27.033728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:35.276961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033416+0000","last_change":"2024-04-26T10:42:26.044062+0000","last_active":"2024-04-26T10:42:27.033416+0000","last_peered":"2024-04-26T10:42:27.033416+0000","last_clean":"2024-04-26T10:42:27.033416+0000","last_became_active":"2024-04-26T10:42:26.042378+0000","last_became_peered":"2024-04-26T10:42:26.042378+0000","last_unstale":"2024-04-26T10:42:27.033416+0000","last_undegraded":"2024-04-26T10:42:27.033416+0000","last_fullsized":"2024-04-26T10:42:27.033416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:24.255706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032809+0000","last_change":"2024-04-26T10:42:26.046353+0000","last_active":"2024-04-26T10:42:27.032809+0000","last_peered":"2024-04-26T10:42:27.032809+0000","last_clean":"2024-04-26T10:42:27.032809+0000","last_became_active":"2024-04-26T10:42:26.045614+0000","last_became_peered":"2024-04-26T10:42:26.045614+0000","last_unstale":"2024-04-26T10:42:27.032809+0000","last_undegraded":"2024-04-26T10:42:27.032809+0000","last_fullsized":"2024-04-26T10:42:27.032809+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:19.601720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032687+0000","last_change":"2024-04-26T10:42:26.045311+0000","last_active":"2024-04-26T10:42:27.032687+0000","last_peered":"2024-04-26T10:42:27.032687+0000","last_clean":"2024-04-26T10:42:27.032687+0000","last_became_active":"2024-04-26T10:42:26.044614+0000","last_became_peered":"2024-04-26T10:42:26.044614+0000","last_unstale":"2024-04-26T10:42:27.032687+0000","last_undegraded":"2024-04-26T10:42:27.032687+0000","last_fullsized":"2024-04-26T10:42:27.032687+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032624+0000","last_change":"2024-04-26T10:42:26.043614+0000","last_active":"2024-04-26T10:42:27.032624+0000","last_peered":"2024-04-26T10:42:27.032624+0000","last_clean":"2024-04-26T10:42:27.032624+0000","last_became_active":"2024-04-26T10:42:26.042629+0000","last_became_peered":"2024-04-26T10:42:26.042629+0000","last_unstale":"2024-04-26T10:42:27.032624+0000","last_undegraded":"2024-04-26T10:42:27.032624+0000","last_fullsized":"2024-04-26T10:42:27.032624+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033909+0000","last_change":"2024-04-26T10:42:26.046876+0000","last_active":"2024-04-26T10:42:27.033909+0000","last_peered":"2024-04-26T10:42:27.033909+0000","last_clean":"2024-04-26T10:42:27.033909+0000","last_became_active":"2024-04-26T10:42:26.046177+0000","last_became_peered":"2024-04-26T10:42:26.046177+0000","last_unstale":"2024-04-26T10:42:27.033909+0000","last_undegraded":"2024-04-26T10:42:27.033909+0000","last_fullsized":"2024-04-26T10:42:27.033909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:51.567162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033546+0000","last_change":"2024-04-26T10:42:26.044190+0000","last_active":"2024-04-26T10:42:27.033546+0000","last_peered":"2024-04-26T10:42:27.033546+0000","last_clean":"2024-04-26T10:42:27.033546+0000","last_became_active":"2024-04-26T10:42:26.043736+0000","last_became_peered":"2024-04-26T10:42:26.043736+0000","last_unstale":"2024-04-26T10:42:27.033546+0000","last_undegraded":"2024-04-26T10:42:27.033546+0000","last_fullsized":"2024-04-26T10:42:27.033546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033729+0000","last_change":"2024-04-26T10:42:26.041008+0000","last_active":"2024-04-26T10:42:27.033729+0000","last_peered":"2024-04-26T10:42:27.033729+0000","last_clean":"2024-04-26T10:42:27.033729+0000","last_became_active":"2024-04-26T10:42:26.039620+0000","last_became_peered":"2024-04-26T10:42:26.039620+0000","last_unstale":"2024-04-26T10:42:27.033729+0000","last_undegraded":"2024-04-26T10:42:27.033729+0000","last_fullsized":"2024-04-26T10:42:27.033729+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033575+0000","last_change":"2024-04-26T10:42:26.046392+0000","last_active":"2024-04-26T10:42:27.033575+0000","last_peered":"2024-04-26T10:42:27.033575+0000","last_clean":"2024-04-26T10:42:27.033575+0000","last_became_active":"2024-04-26T10:42:26.045806+0000","last_became_peered":"2024-04-26T10:42:26.045806+0000","last_unstale":"2024-04-26T10:42:27.033575+0000","last_undegraded":"2024-04-26T10:42:27.033575+0000","last_fullsized":"2024-04-26T10:42:27.033575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:15:59.087635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033383+0000","last_change":"2024-04-26T10:42:26.045205+0000","last_active":"2024-04-26T10:42:27.033383+0000","last_peered":"2024-04-26T10:42:27.033383+0000","last_clean":"2024-04-26T10:42:27.033383+0000","last_became_active":"2024-04-26T10:42:26.044762+0000","last_became_peered":"2024-04-26T10:42:26.044762+0000","last_unstale":"2024-04-26T10:42:27.033383+0000","last_undegraded":"2024-04-26T10:42:27.033383+0000","last_fullsized":"2024-04-26T10:42:27.033383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033051+0000","last_change":"2024-04-26T10:42:26.046020+0000","last_active":"2024-04-26T10:42:27.033051+0000","last_peered":"2024-04-26T10:42:27.033051+0000","last_clean":"2024-04-26T10:42:27.033051+0000","last_became_active":"2024-04-26T10:42:26.045567+0000","last_became_peered":"2024-04-26T10:42:26.045567+0000","last_unstale":"2024-04-26T10:42:27.033051+0000","last_undegraded":"2024-04-26T10:42:27.033051+0000","last_fullsized":"2024-04-26T10:42:27.033051+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:53.380329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032770+0000","last_change":"2024-04-26T10:42:26.046584+0000","last_active":"2024-04-26T10:42:27.032770+0000","last_peered":"2024-04-26T10:42:27.032770+0000","last_clean":"2024-04-26T10:42:27.032770+0000","last_became_active":"2024-04-26T10:42:26.046231+0000","last_became_peered":"2024-04-26T10:42:26.046231+0000","last_unstale":"2024-04-26T10:42:27.032770+0000","last_undegraded":"2024-04-26T10:42:27.032770+0000","last_fullsized":"2024-04-26T10:42:27.032770+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032953+0000","last_change":"2024-04-26T10:42:26.045270+0000","last_active":"2024-04-26T10:42:27.032953+0000","last_peered":"2024-04-26T10:42:27.032953+0000","last_clean":"2024-04-26T10:42:27.032953+0000","last_became_active":"2024-04-26T10:42:26.044341+0000","last_became_peered":"2024-04-26T10:42:26.044341+0000","last_unstale":"2024-04-26T10:42:27.032953+0000","last_undegraded":"2024-04-26T10:42:27.032953+0000","last_fullsized":"2024-04-26T10:42:27.032953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:46.975947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033573+0000","last_change":"2024-04-26T10:42:26.041757+0000","last_active":"2024-04-26T10:42:27.033573+0000","last_peered":"2024-04-26T10:42:27.033573+0000","last_clean":"2024-04-26T10:42:27.033573+0000","last_became_active":"2024-04-26T10:42:26.040920+0000","last_became_peered":"2024-04-26T10:42:26.040920+0000","last_unstale":"2024-04-26T10:42:27.033573+0000","last_undegraded":"2024-04-26T10:42:27.033573+0000","last_fullsized":"2024-04-26T10:42:27.033573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033905+0000","last_change":"2024-04-26T10:42:25.687138+0000","last_active":"2024-04-26T10:42:27.033905+0000","last_peered":"2024-04-26T10:42:27.033905+0000","last_clean":"2024-04-26T10:42:27.033905+0000","last_became_active":"2024-04-26T10:42:25.686488+0000","last_became_peered":"2024-04-26T10:42:25.686488+0000","last_unstale":"2024-04-26T10:42:27.033905+0000","last_undegraded":"2024-04-26T10:42:27.033905+0000","last_fullsized":"2024-04-26T10:42:27.033905+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:43.969731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033779+0000","last_change":"2024-04-26T10:42:26.041850+0000","last_active":"2024-04-26T10:42:27.033779+0000","last_peered":"2024-04-26T10:42:27.033779+0000","last_clean":"2024-04-26T10:42:27.033779+0000","last_became_active":"2024-04-26T10:42:26.040464+0000","last_became_peered":"2024-04-26T10:42:26.040464+0000","last_unstale":"2024-04-26T10:42:27.033779+0000","last_undegraded":"2024-04-26T10:42:27.033779+0000","last_fullsized":"2024-04-26T10:42:27.033779+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033039+0000","last_change":"2024-04-26T10:42:25.685525+0000","last_active":"2024-04-26T10:42:27.033039+0000","last_peered":"2024-04-26T10:42:27.033039+0000","last_clean":"2024-04-26T10:42:27.033039+0000","last_became_active":"2024-04-26T10:42:25.684855+0000","last_became_peered":"2024-04-26T10:42:25.684855+0000","last_unstale":"2024-04-26T10:42:27.033039+0000","last_undegraded":"2024-04-26T10:42:27.033039+0000","last_fullsized":"2024-04-26T10:42:27.033039+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:16.723401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033789+0000","last_change":"2024-04-26T10:42:26.046616+0000","last_active":"2024-04-26T10:42:27.033789+0000","last_peered":"2024-04-26T10:42:27.033789+0000","last_clean":"2024-04-26T10:42:27.033789+0000","last_became_active":"2024-04-26T10:42:26.046010+0000","last_became_peered":"2024-04-26T10:42:26.046010+0000","last_unstale":"2024-04-26T10:42:27.033789+0000","last_undegraded":"2024-04-26T10:42:27.033789+0000","last_fullsized":"2024-04-26T10:42:27.033789+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:19.601720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032884+0000","last_change":"2024-04-26T10:42:25.688905+0000","last_active":"2024-04-26T10:42:27.032884+0000","last_peered":"2024-04-26T10:42:27.032884+0000","last_clean":"2024-04-26T10:42:27.032884+0000","last_became_active":"2024-04-26T10:42:25.688504+0000","last_became_peered":"2024-04-26T10:42:25.688504+0000","last_unstale":"2024-04-26T10:42:27.032884+0000","last_undegraded":"2024-04-26T10:42:27.032884+0000","last_fullsized":"2024-04-26T10:42:27.032884+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.930441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033655+0000","last_change":"2024-04-26T10:42:26.046158+0000","last_active":"2024-04-26T10:42:27.033655+0000","last_peered":"2024-04-26T10:42:27.033655+0000","last_clean":"2024-04-26T10:42:27.033655+0000","last_became_active":"2024-04-26T10:42:26.045797+0000","last_became_peered":"2024-04-26T10:42:26.045797+0000","last_unstale":"2024-04-26T10:42:27.033655+0000","last_undegraded":"2024-04-26T10:42:27.033655+0000","last_fullsized":"2024-04-26T10:42:27.033655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:23.079349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032889+0000","last_change":"2024-04-26T10:42:25.687207+0000","last_active":"2024-04-26T10:42:27.032889+0000","last_peered":"2024-04-26T10:42:27.032889+0000","last_clean":"2024-04-26T10:42:27.032889+0000","last_became_active":"2024-04-26T10:42:25.686549+0000","last_became_peered":"2024-04-26T10:42:25.686549+0000","last_unstale":"2024-04-26T10:42:27.032889+0000","last_undegraded":"2024-04-26T10:42:27.032889+0000","last_fullsized":"2024-04-26T10:42:27.032889+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:42.125386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033731+0000","last_change":"2024-04-26T10:42:25.684462+0000","last_active":"2024-04-26T10:42:27.033731+0000","last_peered":"2024-04-26T10:42:27.033731+0000","last_clean":"2024-04-26T10:42:27.033731+0000","last_became_active":"2024-04-26T10:42:25.684162+0000","last_became_peered":"2024-04-26T10:42:25.684162+0000","last_unstale":"2024-04-26T10:42:27.033731+0000","last_undegraded":"2024-04-26T10:42:27.033731+0000","last_fullsized":"2024-04-26T10:42:27.033731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.850118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032640+0000","last_change":"2024-04-26T10:42:26.048114+0000","last_active":"2024-04-26T10:42:27.032640+0000","last_peered":"2024-04-26T10:42:27.032640+0000","last_clean":"2024-04-26T10:42:27.032640+0000","last_became_active":"2024-04-26T10:42:26.046641+0000","last_became_peered":"2024-04-26T10:42:26.046641+0000","last_unstale":"2024-04-26T10:42:27.032640+0000","last_undegraded":"2024-04-26T10:42:27.032640+0000","last_fullsized":"2024-04-26T10:42:27.032640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:01.056945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033763+0000","last_change":"2024-04-26T10:42:25.688889+0000","last_active":"2024-04-26T10:42:27.033763+0000","last_peered":"2024-04-26T10:42:27.033763+0000","last_clean":"2024-04-26T10:42:27.033763+0000","last_became_active":"2024-04-26T10:42:25.688372+0000","last_became_peered":"2024-04-26T10:42:25.688372+0000","last_unstale":"2024-04-26T10:42:27.033763+0000","last_undegraded":"2024-04-26T10:42:27.033763+0000","last_fullsized":"2024-04-26T10:42:27.033763+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:13.799290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032734+0000","last_change":"2024-04-26T10:42:26.041968+0000","last_active":"2024-04-26T10:42:27.032734+0000","last_peered":"2024-04-26T10:42:27.032734+0000","last_clean":"2024-04-26T10:42:27.032734+0000","last_became_active":"2024-04-26T10:42:26.041070+0000","last_became_peered":"2024-04-26T10:42:26.041070+0000","last_unstale":"2024-04-26T10:42:27.032734+0000","last_undegraded":"2024-04-26T10:42:27.032734+0000","last_fullsized":"2024-04-26T10:42:27.032734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033901+0000","last_change":"2024-04-26T10:42:25.684653+0000","last_active":"2024-04-26T10:42:27.033901+0000","last_peered":"2024-04-26T10:42:27.033901+0000","last_clean":"2024-04-26T10:42:27.033901+0000","last_became_active":"2024-04-26T10:42:25.684338+0000","last_became_peered":"2024-04-26T10:42:25.684338+0000","last_unstale":"2024-04-26T10:42:27.033901+0000","last_undegraded":"2024-04-26T10:42:27.033901+0000","last_fullsized":"2024-04-26T10:42:27.033901+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:10.694039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033371+0000","last_change":"2024-04-26T10:42:26.042182+0000","last_active":"2024-04-26T10:42:27.033371+0000","last_peered":"2024-04-26T10:42:27.033371+0000","last_clean":"2024-04-26T10:42:27.033371+0000","last_became_active":"2024-04-26T10:42:26.041689+0000","last_became_peered":"2024-04-26T10:42:26.041689+0000","last_unstale":"2024-04-26T10:42:27.033371+0000","last_undegraded":"2024-04-26T10:42:27.033371+0000","last_fullsized":"2024-04-26T10:42:27.033371+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:32:19.618648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033908+0000","last_change":"2024-04-26T10:42:25.686677+0000","last_active":"2024-04-26T10:42:27.033908+0000","last_peered":"2024-04-26T10:42:27.033908+0000","last_clean":"2024-04-26T10:42:27.033908+0000","last_became_active":"2024-04-26T10:42:25.685939+0000","last_became_peered":"2024-04-26T10:42:25.685939+0000","last_unstale":"2024-04-26T10:42:27.033908+0000","last_undegraded":"2024-04-26T10:42:27.033908+0000","last_fullsized":"2024-04-26T10:42:27.033908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:30.225098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033381+0000","last_change":"2024-04-26T10:42:26.045829+0000","last_active":"2024-04-26T10:42:27.033381+0000","last_peered":"2024-04-26T10:42:27.033381+0000","last_clean":"2024-04-26T10:42:27.033381+0000","last_became_active":"2024-04-26T10:42:26.045499+0000","last_became_peered":"2024-04-26T10:42:26.045499+0000","last_unstale":"2024-04-26T10:42:27.033381+0000","last_undegraded":"2024-04-26T10:42:27.033381+0000","last_fullsized":"2024-04-26T10:42:27.033381+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:14.041039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033624+0000","last_change":"2024-04-26T10:42:25.687934+0000","last_active":"2024-04-26T10:42:27.033624+0000","last_peered":"2024-04-26T10:42:27.033624+0000","last_clean":"2024-04-26T10:42:27.033624+0000","last_became_active":"2024-04-26T10:42:25.687447+0000","last_became_peered":"2024-04-26T10:42:25.687447+0000","last_unstale":"2024-04-26T10:42:27.033624+0000","last_undegraded":"2024-04-26T10:42:27.033624+0000","last_fullsized":"2024-04-26T10:42:27.033624+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.930441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033660+0000","last_change":"2024-04-26T10:42:26.043638+0000","last_active":"2024-04-26T10:42:27.033660+0000","last_peered":"2024-04-26T10:42:27.033660+0000","last_clean":"2024-04-26T10:42:27.033660+0000","last_became_active":"2024-04-26T10:42:26.042692+0000","last_became_peered":"2024-04-26T10:42:26.042692+0000","last_unstale":"2024-04-26T10:42:27.033660+0000","last_undegraded":"2024-04-26T10:42:27.033660+0000","last_fullsized":"2024-04-26T10:42:27.033660+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033803+0000","last_change":"2024-04-26T10:42:25.687283+0000","last_active":"2024-04-26T10:42:27.033803+0000","last_peered":"2024-04-26T10:42:27.033803+0000","last_clean":"2024-04-26T10:42:27.033803+0000","last_became_active":"2024-04-26T10:42:25.686251+0000","last_became_peered":"2024-04-26T10:42:25.686251+0000","last_unstale":"2024-04-26T10:42:27.033803+0000","last_undegraded":"2024-04-26T10:42:27.033803+0000","last_fullsized":"2024-04-26T10:42:27.033803+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:16.723401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033798+0000","last_change":"2024-04-26T10:42:26.040688+0000","last_active":"2024-04-26T10:42:27.033798+0000","last_peered":"2024-04-26T10:42:27.033798+0000","last_clean":"2024-04-26T10:42:27.033798+0000","last_became_active":"2024-04-26T10:42:26.039133+0000","last_became_peered":"2024-04-26T10:42:26.039133+0000","last_unstale":"2024-04-26T10:42:27.033798+0000","last_undegraded":"2024-04-26T10:42:27.033798+0000","last_fullsized":"2024-04-26T10:42:27.033798+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032938+0000","last_change":"2024-04-26T10:42:25.688837+0000","last_active":"2024-04-26T10:42:27.032938+0000","last_peered":"2024-04-26T10:42:27.032938+0000","last_clean":"2024-04-26T10:42:27.032938+0000","last_became_active":"2024-04-26T10:42:25.688450+0000","last_became_peered":"2024-04-26T10:42:25.688450+0000","last_unstale":"2024-04-26T10:42:27.032938+0000","last_undegraded":"2024-04-26T10:42:27.032938+0000","last_fullsized":"2024-04-26T10:42:27.032938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:26.788267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033564+0000","last_change":"2024-04-26T10:42:26.039661+0000","last_active":"2024-04-26T10:42:27.033564+0000","last_peered":"2024-04-26T10:42:27.033564+0000","last_clean":"2024-04-26T10:42:27.033564+0000","last_became_active":"2024-04-26T10:42:26.038664+0000","last_became_peered":"2024-04-26T10:42:26.038664+0000","last_unstale":"2024-04-26T10:42:27.033564+0000","last_undegraded":"2024-04-26T10:42:27.033564+0000","last_fullsized":"2024-04-26T10:42:27.033564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032757+0000","last_change":"2024-04-26T10:42:25.687082+0000","last_active":"2024-04-26T10:42:27.032757+0000","last_peered":"2024-04-26T10:42:27.032757+0000","last_clean":"2024-04-26T10:42:27.032757+0000","last_became_active":"2024-04-26T10:42:25.686779+0000","last_became_peered":"2024-04-26T10:42:25.686779+0000","last_unstale":"2024-04-26T10:42:27.032757+0000","last_undegraded":"2024-04-26T10:42:27.032757+0000","last_fullsized":"2024-04-26T10:42:27.032757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:12.284219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033692+0000","last_change":"2024-04-26T10:42:26.047130+0000","last_active":"2024-04-26T10:42:27.033692+0000","last_peered":"2024-04-26T10:42:27.033692+0000","last_clean":"2024-04-26T10:42:27.033692+0000","last_became_active":"2024-04-26T10:42:26.046884+0000","last_became_peered":"2024-04-26T10:42:26.046884+0000","last_unstale":"2024-04-26T10:42:27.033692+0000","last_undegraded":"2024-04-26T10:42:27.033692+0000","last_fullsized":"2024-04-26T10:42:27.033692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:31.020364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.035198+0000","last_change":"2024-04-26T10:42:21.406599+0000","last_active":"2024-04-26T10:42:26.035198+0000","last_peered":"2024-04-26T10:42:26.035198+0000","last_clean":"2024-04-26T10:42:26.035198+0000","last_became_active":"2024-04-26T10:42:21.405587+0000","last_became_peered":"2024-04-26T10:42:21.405587+0000","last_unstale":"2024-04-26T10:42:26.035198+0000","last_undegraded":"2024-04-26T10:42:26.035198+0000","last_fullsized":"2024-04-26T10:42:26.035198+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:44.561530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.035065+0000","last_change":"2024-04-26T10:42:21.405305+0000","last_active":"2024-04-26T10:42:26.035065+0000","last_peered":"2024-04-26T10:42:26.035065+0000","last_clean":"2024-04-26T10:42:26.035065+0000","last_became_active":"2024-04-26T10:42:21.405032+0000","last_became_peered":"2024-04-26T10:42:21.405032+0000","last_unstale":"2024-04-26T10:42:26.035065+0000","last_undegraded":"2024-04-26T10:42:26.035065+0000","last_fullsized":"2024-04-26T10:42:26.035065+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033157+0000","last_change":"2024-04-26T10:42:25.686765+0000","last_active":"2024-04-26T10:42:27.033157+0000","last_peered":"2024-04-26T10:42:27.033157+0000","last_clean":"2024-04-26T10:42:27.033157+0000","last_became_active":"2024-04-26T10:42:25.686009+0000","last_became_peered":"2024-04-26T10:42:25.686009+0000","last_unstale":"2024-04-26T10:42:27.033157+0000","last_undegraded":"2024-04-26T10:42:27.033157+0000","last_fullsized":"2024-04-26T10:42:27.033157+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:54.627815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033875+0000","last_change":"2024-04-26T10:42:26.040215+0000","last_active":"2024-04-26T10:42:27.033875+0000","last_peered":"2024-04-26T10:42:27.033875+0000","last_clean":"2024-04-26T10:42:27.033875+0000","last_became_active":"2024-04-26T10:42:26.039129+0000","last_became_peered":"2024-04-26T10:42:26.039129+0000","last_unstale":"2024-04-26T10:42:27.033875+0000","last_undegraded":"2024-04-26T10:42:27.033875+0000","last_fullsized":"2024-04-26T10:42:27.033875+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.035134+0000","last_change":"2024-04-26T10:42:21.406881+0000","last_active":"2024-04-26T10:42:26.035134+0000","last_peered":"2024-04-26T10:42:26.035134+0000","last_clean":"2024-04-26T10:42:26.035134+0000","last_became_active":"2024-04-26T10:42:21.406634+0000","last_became_peered":"2024-04-26T10:42:21.406634+0000","last_unstale":"2024-04-26T10:42:26.035134+0000","last_undegraded":"2024-04-26T10:42:26.035134+0000","last_fullsized":"2024-04-26T10:42:26.035134+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:45.892841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033120+0000","last_change":"2024-04-26T10:42:25.687986+0000","last_active":"2024-04-26T10:42:27.033120+0000","last_peered":"2024-04-26T10:42:27.033120+0000","last_clean":"2024-04-26T10:42:27.033120+0000","last_became_active":"2024-04-26T10:42:25.687201+0000","last_became_peered":"2024-04-26T10:42:25.687201+0000","last_unstale":"2024-04-26T10:42:27.033120+0000","last_undegraded":"2024-04-26T10:42:27.033120+0000","last_fullsized":"2024-04-26T10:42:27.033120+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:35.867262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033630+0000","last_change":"2024-04-26T10:42:26.043723+0000","last_active":"2024-04-26T10:42:27.033630+0000","last_peered":"2024-04-26T10:42:27.033630+0000","last_clean":"2024-04-26T10:42:27.033630+0000","last_became_active":"2024-04-26T10:42:26.041814+0000","last_became_peered":"2024-04-26T10:42:26.041814+0000","last_unstale":"2024-04-26T10:42:27.033630+0000","last_undegraded":"2024-04-26T10:42:27.033630+0000","last_fullsized":"2024-04-26T10:42:27.033630+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.032836+0000","last_change":"2024-04-26T10:42:21.405597+0000","last_active":"2024-04-26T10:42:26.032836+0000","last_peered":"2024-04-26T10:42:26.032836+0000","last_clean":"2024-04-26T10:42:26.032836+0000","last_became_active":"2024-04-26T10:42:21.405117+0000","last_became_peered":"2024-04-26T10:42:21.405117+0000","last_unstale":"2024-04-26T10:42:26.032836+0000","last_undegraded":"2024-04-26T10:42:26.032836+0000","last_fullsized":"2024-04-26T10:42:26.032836+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033005+0000","last_change":"2024-04-26T10:42:25.688955+0000","last_active":"2024-04-26T10:42:27.033005+0000","last_peered":"2024-04-26T10:42:27.033005+0000","last_clean":"2024-04-26T10:42:27.033005+0000","last_became_active":"2024-04-26T10:42:25.688552+0000","last_became_peered":"2024-04-26T10:42:25.688552+0000","last_unstale":"2024-04-26T10:42:27.033005+0000","last_undegraded":"2024-04-26T10:42:27.033005+0000","last_fullsized":"2024-04-26T10:42:27.033005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:04.963775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033758+0000","last_change":"2024-04-26T10:42:26.049311+0000","last_active":"2024-04-26T10:42:27.033758+0000","last_peered":"2024-04-26T10:42:27.033758+0000","last_clean":"2024-04-26T10:42:27.033758+0000","last_became_active":"2024-04-26T10:42:26.048915+0000","last_became_peered":"2024-04-26T10:42:26.048915+0000","last_unstale":"2024-04-26T10:42:27.033758+0000","last_undegraded":"2024-04-26T10:42:27.033758+0000","last_fullsized":"2024-04-26T10:42:27.033758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:01.056945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.034656+0000","last_change":"2024-04-26T10:42:21.405298+0000","last_active":"2024-04-26T10:42:26.034656+0000","last_peered":"2024-04-26T10:42:26.034656+0000","last_clean":"2024-04-26T10:42:26.034656+0000","last_became_active":"2024-04-26T10:42:21.405011+0000","last_became_peered":"2024-04-26T10:42:21.405011+0000","last_unstale":"2024-04-26T10:42:26.034656+0000","last_undegraded":"2024-04-26T10:42:26.034656+0000","last_fullsized":"2024-04-26T10:42:26.034656+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:47.789961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033960+0000","last_change":"2024-04-26T10:42:25.686177+0000","last_active":"2024-04-26T10:42:27.033960+0000","last_peered":"2024-04-26T10:42:27.033960+0000","last_clean":"2024-04-26T10:42:27.033960+0000","last_became_active":"2024-04-26T10:42:25.685121+0000","last_became_peered":"2024-04-26T10:42:25.685121+0000","last_unstale":"2024-04-26T10:42:27.033960+0000","last_undegraded":"2024-04-26T10:42:27.033960+0000","last_fullsized":"2024-04-26T10:42:27.033960+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:34.398138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033614+0000","last_change":"2024-04-26T10:42:26.045312+0000","last_active":"2024-04-26T10:42:27.033614+0000","last_peered":"2024-04-26T10:42:27.033614+0000","last_clean":"2024-04-26T10:42:27.033614+0000","last_became_active":"2024-04-26T10:42:26.044619+0000","last_became_peered":"2024-04-26T10:42:26.044619+0000","last_unstale":"2024-04-26T10:42:27.033614+0000","last_undegraded":"2024-04-26T10:42:27.033614+0000","last_fullsized":"2024-04-26T10:42:27.033614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:50.646374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033966+0000","last_change":"2024-04-26T10:42:25.686310+0000","last_active":"2024-04-26T10:42:27.033966+0000","last_peered":"2024-04-26T10:42:27.033966+0000","last_clean":"2024-04-26T10:42:27.033966+0000","last_became_active":"2024-04-26T10:42:25.685767+0000","last_became_peered":"2024-04-26T10:42:25.685767+0000","last_unstale":"2024-04-26T10:42:27.033966+0000","last_undegraded":"2024-04-26T10:42:27.033966+0000","last_fullsized":"2024-04-26T10:42:27.033966+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:02.874807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.032839+0000","last_change":"2024-04-26T10:42:21.405754+0000","last_active":"2024-04-26T10:42:26.032839+0000","last_peered":"2024-04-26T10:42:26.032839+0000","last_clean":"2024-04-26T10:42:26.032839+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:42:26.032839+0000","last_undegraded":"2024-04-26T10:42:26.032839+0000","last_fullsized":"2024-04-26T10:42:26.032839+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:47.123256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032872+0000","last_change":"2024-04-26T10:42:26.043764+0000","last_active":"2024-04-26T10:42:27.032872+0000","last_peered":"2024-04-26T10:42:27.032872+0000","last_clean":"2024-04-26T10:42:27.032872+0000","last_became_active":"2024-04-26T10:42:26.043388+0000","last_became_peered":"2024-04-26T10:42:26.043388+0000","last_unstale":"2024-04-26T10:42:27.032872+0000","last_undegraded":"2024-04-26T10:42:27.032872+0000","last_fullsized":"2024-04-26T10:42:27.032872+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:31.020364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033601+0000","last_change":"2024-04-26T10:42:25.685368+0000","last_active":"2024-04-26T10:42:27.033601+0000","last_peered":"2024-04-26T10:42:27.033601+0000","last_clean":"2024-04-26T10:42:27.033601+0000","last_became_active":"2024-04-26T10:42:25.684379+0000","last_became_peered":"2024-04-26T10:42:25.684379+0000","last_unstale":"2024-04-26T10:42:27.033601+0000","last_undegraded":"2024-04-26T10:42:27.033601+0000","last_fullsized":"2024-04-26T10:42:27.033601+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:34.398138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.037776+0000","last_change":"2024-04-26T10:42:21.405356+0000","last_active":"2024-04-26T10:42:26.037776+0000","last_peered":"2024-04-26T10:42:26.037776+0000","last_clean":"2024-04-26T10:42:26.037776+0000","last_became_active":"2024-04-26T10:42:21.405006+0000","last_became_peered":"2024-04-26T10:42:21.405006+0000","last_unstale":"2024-04-26T10:42:26.037776+0000","last_undegraded":"2024-04-26T10:42:26.037776+0000","last_fullsized":"2024-04-26T10:42:26.037776+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:55.043967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033128+0000","last_change":"2024-04-26T10:42:26.042954+0000","last_active":"2024-04-26T10:42:27.033128+0000","last_peered":"2024-04-26T10:42:27.033128+0000","last_clean":"2024-04-26T10:42:27.033128+0000","last_became_active":"2024-04-26T10:42:26.042544+0000","last_became_peered":"2024-04-26T10:42:26.042544+0000","last_unstale":"2024-04-26T10:42:27.033128+0000","last_undegraded":"2024-04-26T10:42:27.033128+0000","last_fullsized":"2024-04-26T10:42:27.033128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:14.041039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033915+0000","last_change":"2024-04-26T10:42:25.687201+0000","last_active":"2024-04-26T10:42:27.033915+0000","last_peered":"2024-04-26T10:42:27.033915+0000","last_clean":"2024-04-26T10:42:27.033915+0000","last_became_active":"2024-04-26T10:42:25.686641+0000","last_became_peered":"2024-04-26T10:42:25.686641+0000","last_unstale":"2024-04-26T10:42:27.033915+0000","last_undegraded":"2024-04-26T10:42:27.033915+0000","last_fullsized":"2024-04-26T10:42:27.033915+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:30.225098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.033642+0000","last_change":"2024-04-26T10:42:21.405615+0000","last_active":"2024-04-26T10:42:26.033642+0000","last_peered":"2024-04-26T10:42:26.033642+0000","last_clean":"2024-04-26T10:42:26.033642+0000","last_became_active":"2024-04-26T10:42:21.405184+0000","last_became_peered":"2024-04-26T10:42:21.405184+0000","last_unstale":"2024-04-26T10:42:26.033642+0000","last_undegraded":"2024-04-26T10:42:26.033642+0000","last_fullsized":"2024-04-26T10:42:26.033642+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:52.378909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032862+0000","last_change":"2024-04-26T10:42:26.046832+0000","last_active":"2024-04-26T10:42:27.032862+0000","last_peered":"2024-04-26T10:42:27.032862+0000","last_clean":"2024-04-26T10:42:27.032862+0000","last_became_active":"2024-04-26T10:42:26.046484+0000","last_became_peered":"2024-04-26T10:42:26.046484+0000","last_unstale":"2024-04-26T10:42:27.032862+0000","last_undegraded":"2024-04-26T10:42:27.032862+0000","last_fullsized":"2024-04-26T10:42:27.032862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:28.856785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652287+0000","last_change":"2024-04-26T10:42:25.686262+0000","last_active":"2024-04-26T10:42:29.652287+0000","last_peered":"2024-04-26T10:42:29.652287+0000","last_clean":"2024-04-26T10:42:29.652287+0000","last_became_active":"2024-04-26T10:42:25.685528+0000","last_became_peered":"2024-04-26T10:42:25.685528+0000","last_unstale":"2024-04-26T10:42:29.652287+0000","last_undegraded":"2024-04-26T10:42:29.652287+0000","last_fullsized":"2024-04-26T10:42:29.652287+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:47.138273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.035316+0000","last_change":"2024-04-26T10:42:21.405863+0000","last_active":"2024-04-26T10:42:26.035316+0000","last_peered":"2024-04-26T10:42:26.035316+0000","last_clean":"2024-04-26T10:42:26.035316+0000","last_became_active":"2024-04-26T10:42:21.405555+0000","last_became_peered":"2024-04-26T10:42:21.405555+0000","last_unstale":"2024-04-26T10:42:26.035316+0000","last_undegraded":"2024-04-26T10:42:26.035316+0000","last_fullsized":"2024-04-26T10:42:26.035316+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:39.259618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032766+0000","last_change":"2024-04-26T10:42:26.044818+0000","last_active":"2024-04-26T10:42:27.032766+0000","last_peered":"2024-04-26T10:42:27.032766+0000","last_clean":"2024-04-26T10:42:27.032766+0000","last_became_active":"2024-04-26T10:42:26.043969+0000","last_became_peered":"2024-04-26T10:42:26.043969+0000","last_unstale":"2024-04-26T10:42:27.032766+0000","last_undegraded":"2024-04-26T10:42:27.032766+0000","last_fullsized":"2024-04-26T10:42:27.032766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:50.646374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033819+0000","last_change":"2024-04-26T10:42:26.040224+0000","last_active":"2024-04-26T10:42:27.033819+0000","last_peered":"2024-04-26T10:42:27.033819+0000","last_clean":"2024-04-26T10:42:27.033819+0000","last_became_active":"2024-04-26T10:42:26.038590+0000","last_became_peered":"2024-04-26T10:42:26.038590+0000","last_unstale":"2024-04-26T10:42:27.033819+0000","last_undegraded":"2024-04-26T10:42:27.033819+0000","last_fullsized":"2024-04-26T10:42:27.033819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033865+0000","last_change":"2024-04-26T10:42:25.684447+0000","last_active":"2024-04-26T10:42:27.033865+0000","last_peered":"2024-04-26T10:42:27.033865+0000","last_clean":"2024-04-26T10:42:27.033865+0000","last_became_active":"2024-04-26T10:42:25.684147+0000","last_became_peered":"2024-04-26T10:42:25.684147+0000","last_unstale":"2024-04-26T10:42:27.033865+0000","last_undegraded":"2024-04-26T10:42:27.033865+0000","last_fullsized":"2024-04-26T10:42:27.033865+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:38.873282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032960+0000","last_change":"2024-04-26T10:42:26.045459+0000","last_active":"2024-04-26T10:42:27.032960+0000","last_peered":"2024-04-26T10:42:27.032960+0000","last_clean":"2024-04-26T10:42:27.032960+0000","last_became_active":"2024-04-26T10:42:26.044972+0000","last_became_peered":"2024-04-26T10:42:26.044972+0000","last_unstale":"2024-04-26T10:42:27.032960+0000","last_undegraded":"2024-04-26T10:42:27.032960+0000","last_fullsized":"2024-04-26T10:42:27.032960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033920+0000","last_change":"2024-04-26T10:42:25.687956+0000","last_active":"2024-04-26T10:42:27.033920+0000","last_peered":"2024-04-26T10:42:27.033920+0000","last_clean":"2024-04-26T10:42:27.033920+0000","last_became_active":"2024-04-26T10:42:25.687533+0000","last_became_peered":"2024-04-26T10:42:25.687533+0000","last_unstale":"2024-04-26T10:42:27.033920+0000","last_undegraded":"2024-04-26T10:42:27.033920+0000","last_fullsized":"2024-04-26T10:42:27.033920+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:28.506897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033679+0000","last_change":"2024-04-26T10:42:25.685829+0000","last_active":"2024-04-26T10:42:27.033679+0000","last_peered":"2024-04-26T10:42:27.033679+0000","last_clean":"2024-04-26T10:42:27.033679+0000","last_became_active":"2024-04-26T10:42:25.685307+0000","last_became_peered":"2024-04-26T10:42:25.685307+0000","last_unstale":"2024-04-26T10:42:27.033679+0000","last_undegraded":"2024-04-26T10:42:27.033679+0000","last_fullsized":"2024-04-26T10:42:27.033679+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032933+0000","last_change":"2024-04-26T10:42:26.046196+0000","last_active":"2024-04-26T10:42:27.032933+0000","last_peered":"2024-04-26T10:42:27.032933+0000","last_clean":"2024-04-26T10:42:27.032933+0000","last_became_active":"2024-04-26T10:42:26.045762+0000","last_became_peered":"2024-04-26T10:42:26.045762+0000","last_unstale":"2024-04-26T10:42:27.032933+0000","last_undegraded":"2024-04-26T10:42:27.032933+0000","last_fullsized":"2024-04-26T10:42:27.032933+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033848+0000","last_change":"2024-04-26T10:42:25.685990+0000","last_active":"2024-04-26T10:42:27.033848+0000","last_peered":"2024-04-26T10:42:27.033848+0000","last_clean":"2024-04-26T10:42:27.033848+0000","last_became_active":"2024-04-26T10:42:25.684604+0000","last_became_peered":"2024-04-26T10:42:25.684604+0000","last_unstale":"2024-04-26T10:42:27.033848+0000","last_undegraded":"2024-04-26T10:42:27.033848+0000","last_fullsized":"2024-04-26T10:42:27.033848+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:02.874807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032830+0000","last_change":"2024-04-26T10:42:26.038545+0000","last_active":"2024-04-26T10:42:27.032830+0000","last_peered":"2024-04-26T10:42:27.032830+0000","last_clean":"2024-04-26T10:42:27.032830+0000","last_became_active":"2024-04-26T10:42:26.038099+0000","last_became_peered":"2024-04-26T10:42:26.038099+0000","last_unstale":"2024-04-26T10:42:27.032830+0000","last_undegraded":"2024-04-26T10:42:27.032830+0000","last_fullsized":"2024-04-26T10:42:27.032830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033882+0000","last_change":"2024-04-26T10:42:26.046506+0000","last_active":"2024-04-26T10:42:27.033882+0000","last_peered":"2024-04-26T10:42:27.033882+0000","last_clean":"2024-04-26T10:42:27.033882+0000","last_became_active":"2024-04-26T10:42:26.045904+0000","last_became_peered":"2024-04-26T10:42:26.045904+0000","last_unstale":"2024-04-26T10:42:27.033882+0000","last_undegraded":"2024-04-26T10:42:27.033882+0000","last_fullsized":"2024-04-26T10:42:27.033882+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:49.854080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032971+0000","last_change":"2024-04-26T10:42:25.683890+0000","last_active":"2024-04-26T10:42:27.032971+0000","last_peered":"2024-04-26T10:42:27.032971+0000","last_clean":"2024-04-26T10:42:27.032971+0000","last_became_active":"2024-04-26T10:42:25.683467+0000","last_became_peered":"2024-04-26T10:42:25.683467+0000","last_unstale":"2024-04-26T10:42:27.032971+0000","last_undegraded":"2024-04-26T10:42:27.032971+0000","last_fullsized":"2024-04-26T10:42:27.032971+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033657+0000","last_change":"2024-04-26T10:42:26.046384+0000","last_active":"2024-04-26T10:42:27.033657+0000","last_peered":"2024-04-26T10:42:27.033657+0000","last_clean":"2024-04-26T10:42:27.033657+0000","last_became_active":"2024-04-26T10:42:26.045860+0000","last_became_peered":"2024-04-26T10:42:26.045860+0000","last_unstale":"2024-04-26T10:42:27.033657+0000","last_undegraded":"2024-04-26T10:42:27.033657+0000","last_fullsized":"2024-04-26T10:42:27.033657+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033002+0000","last_change":"2024-04-26T10:42:25.686972+0000","last_active":"2024-04-26T10:42:27.033002+0000","last_peered":"2024-04-26T10:42:27.033002+0000","last_clean":"2024-04-26T10:42:27.033002+0000","last_became_active":"2024-04-26T10:42:25.685903+0000","last_became_peered":"2024-04-26T10:42:25.685903+0000","last_unstale":"2024-04-26T10:42:27.033002+0000","last_undegraded":"2024-04-26T10:42:27.033002+0000","last_fullsized":"2024-04-26T10:42:27.033002+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:43.969731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033703+0000","last_change":"2024-04-26T10:42:26.046515+0000","last_active":"2024-04-26T10:42:27.033703+0000","last_peered":"2024-04-26T10:42:27.033703+0000","last_clean":"2024-04-26T10:42:27.033703+0000","last_became_active":"2024-04-26T10:42:26.045798+0000","last_became_peered":"2024-04-26T10:42:26.045798+0000","last_unstale":"2024-04-26T10:42:27.033703+0000","last_undegraded":"2024-04-26T10:42:27.033703+0000","last_fullsized":"2024-04-26T10:42:27.033703+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:28.856785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033066+0000","last_change":"2024-04-26T10:42:25.688221+0000","last_active":"2024-04-26T10:42:27.033066+0000","last_peered":"2024-04-26T10:42:27.033066+0000","last_clean":"2024-04-26T10:42:27.033066+0000","last_became_active":"2024-04-26T10:42:25.687829+0000","last_became_peered":"2024-04-26T10:42:25.687829+0000","last_unstale":"2024-04-26T10:42:27.033066+0000","last_undegraded":"2024-04-26T10:42:27.033066+0000","last_fullsized":"2024-04-26T10:42:27.033066+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:05.939715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033363+0000","last_change":"2024-04-26T10:42:26.042723+0000","last_active":"2024-04-26T10:42:27.033363+0000","last_peered":"2024-04-26T10:42:27.033363+0000","last_clean":"2024-04-26T10:42:27.033363+0000","last_became_active":"2024-04-26T10:42:26.041852+0000","last_became_peered":"2024-04-26T10:42:26.041852+0000","last_unstale":"2024-04-26T10:42:27.033363+0000","last_undegraded":"2024-04-26T10:42:27.033363+0000","last_fullsized":"2024-04-26T10:42:27.033363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033492+0000","last_change":"2024-04-26T10:42:25.688815+0000","last_active":"2024-04-26T10:42:27.033492+0000","last_peered":"2024-04-26T10:42:27.033492+0000","last_clean":"2024-04-26T10:42:27.033492+0000","last_became_active":"2024-04-26T10:42:25.688451+0000","last_became_peered":"2024-04-26T10:42:25.688451+0000","last_unstale":"2024-04-26T10:42:27.033492+0000","last_undegraded":"2024-04-26T10:42:27.033492+0000","last_fullsized":"2024-04-26T10:42:27.033492+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:17.143923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033256+0000","last_change":"2024-04-26T10:42:26.044040+0000","last_active":"2024-04-26T10:42:27.033256+0000","last_peered":"2024-04-26T10:42:27.033256+0000","last_clean":"2024-04-26T10:42:27.033256+0000","last_became_active":"2024-04-26T10:42:26.042629+0000","last_became_peered":"2024-04-26T10:42:26.042629+0000","last_unstale":"2024-04-26T10:42:27.033256+0000","last_undegraded":"2024-04-26T10:42:27.033256+0000","last_fullsized":"2024-04-26T10:42:27.033256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:23:05.308070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033778+0000","last_change":"2024-04-26T10:42:25.686442+0000","last_active":"2024-04-26T10:42:27.033778+0000","last_peered":"2024-04-26T10:42:27.033778+0000","last_clean":"2024-04-26T10:42:27.033778+0000","last_became_active":"2024-04-26T10:42:25.686029+0000","last_became_peered":"2024-04-26T10:42:25.686029+0000","last_unstale":"2024-04-26T10:42:27.033778+0000","last_undegraded":"2024-04-26T10:42:27.033778+0000","last_fullsized":"2024-04-26T10:42:27.033778+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:04.241132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033516+0000","last_change":"2024-04-26T10:42:26.042561+0000","last_active":"2024-04-26T10:42:27.033516+0000","last_peered":"2024-04-26T10:42:27.033516+0000","last_clean":"2024-04-26T10:42:27.033516+0000","last_became_active":"2024-04-26T10:42:26.041751+0000","last_became_peered":"2024-04-26T10:42:26.041751+0000","last_unstale":"2024-04-26T10:42:27.033516+0000","last_undegraded":"2024-04-26T10:42:27.033516+0000","last_fullsized":"2024-04-26T10:42:27.033516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033819+0000","last_change":"2024-04-26T10:42:25.687977+0000","last_active":"2024-04-26T10:42:27.033819+0000","last_peered":"2024-04-26T10:42:27.033819+0000","last_clean":"2024-04-26T10:42:27.033819+0000","last_became_active":"2024-04-26T10:42:25.687402+0000","last_became_peered":"2024-04-26T10:42:25.687402+0000","last_unstale":"2024-04-26T10:42:27.033819+0000","last_undegraded":"2024-04-26T10:42:27.033819+0000","last_fullsized":"2024-04-26T10:42:27.033819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:35.867262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033076+0000","last_change":"2024-04-26T10:42:26.041729+0000","last_active":"2024-04-26T10:42:27.033076+0000","last_peered":"2024-04-26T10:42:27.033076+0000","last_clean":"2024-04-26T10:42:27.033076+0000","last_became_active":"2024-04-26T10:42:26.040504+0000","last_became_peered":"2024-04-26T10:42:26.040504+0000","last_unstale":"2024-04-26T10:42:27.033076+0000","last_undegraded":"2024-04-26T10:42:27.033076+0000","last_fullsized":"2024-04-26T10:42:27.033076+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033769+0000","last_change":"2024-04-26T10:42:25.686861+0000","last_active":"2024-04-26T10:42:27.033769+0000","last_peered":"2024-04-26T10:42:27.033769+0000","last_clean":"2024-04-26T10:42:27.033769+0000","last_became_active":"2024-04-26T10:42:25.686149+0000","last_became_peered":"2024-04-26T10:42:25.686149+0000","last_unstale":"2024-04-26T10:42:27.033769+0000","last_undegraded":"2024-04-26T10:42:27.033769+0000","last_fullsized":"2024-04-26T10:42:27.033769+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:42.125386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033053+0000","last_change":"2024-04-26T10:42:26.045324+0000","last_active":"2024-04-26T10:42:27.033053+0000","last_peered":"2024-04-26T10:42:27.033053+0000","last_clean":"2024-04-26T10:42:27.033053+0000","last_became_active":"2024-04-26T10:42:26.044454+0000","last_became_peered":"2024-04-26T10:42:26.044454+0000","last_unstale":"2024-04-26T10:42:27.033053+0000","last_undegraded":"2024-04-26T10:42:27.033053+0000","last_fullsized":"2024-04-26T10:42:27.033053+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033768+0000","last_change":"2024-04-26T10:42:25.685528+0000","last_active":"2024-04-26T10:42:27.033768+0000","last_peered":"2024-04-26T10:42:27.033768+0000","last_clean":"2024-04-26T10:42:27.033768+0000","last_became_active":"2024-04-26T10:42:25.684508+0000","last_became_peered":"2024-04-26T10:42:25.684508+0000","last_unstale":"2024-04-26T10:42:27.033768+0000","last_undegraded":"2024-04-26T10:42:27.033768+0000","last_fullsized":"2024-04-26T10:42:27.033768+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.850118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31264,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340576,"statfs":{"total":96636764160,"available":96604749824,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35952,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335888,"statfs":{"total":96636764160,"available":96599949312,"internally_reserved":0,"allocated":749568,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:42:37.361 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T10:42:37.361 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T10:42:37.361 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T10:42:37.362 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T10:42:37.726 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:37.727 INFO:teuthology.orchestra.run.smithi049.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T10:42:37.739 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T10:42:37.740 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:42:38.031 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:38.032 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":15,"fsid":"9837de44-a9e8-4979-adc4-611f3ddc44ce","created":"2024-04-26T10:42:11.337159+0000","modified":"2024-04-26T10:42:27.029243+0000","last_up_change":"2024-04-26T10:42:19.397933+0000","last_in_change":"2024-04-26T10:42:12.136647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:42:19.632084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:42:19.779089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:42:24.266614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:42:25.014684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eabed31c-c043-43de-a756-e217d5287116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":28839},{"type":"v1","addr":"172.21.15.60:6801","nonce":28839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":28839},{"type":"v1","addr":"172.21.15.60:6803","nonce":28839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":28839},{"type":"v1","addr":"172.21.15.60:6807","nonce":28839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":28839},{"type":"v1","addr":"172.21.15.60:6805","nonce":28839}]},"public_addr":"172.21.15.60:6801/28839","cluster_addr":"172.21.15.60:6803/28839","heartbeat_back_addr":"172.21.15.60:6807/28839","heartbeat_front_addr":"172.21.15.60:6805/28839","state":["exists","up"]},{"osd":1,"uuid":"7013621f-db09-4096-bc24-428bb170edd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":28598},{"type":"v1","addr":"172.21.15.87:6801","nonce":28598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":28598},{"type":"v1","addr":"172.21.15.87:6803","nonce":28598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":28598},{"type":"v1","addr":"172.21.15.87:6807","nonce":28598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":28598},{"type":"v1","addr":"172.21.15.87:6805","nonce":28598}]},"public_addr":"172.21.15.87:6801/28598","cluster_addr":"172.21.15.87:6803/28598","heartbeat_back_addr":"172.21.15.87:6807/28598","heartbeat_front_addr":"172.21.15.87:6805/28598","state":["exists","up"]},{"osd":2,"uuid":"a1efeadd-cf55-4ed5-9918-36607fd62229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":28733},{"type":"v1","addr":"172.21.15.195:6801","nonce":28733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":28733},{"type":"v1","addr":"172.21.15.195:6803","nonce":28733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":28733},{"type":"v1","addr":"172.21.15.195:6807","nonce":28733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":28733},{"type":"v1","addr":"172.21.15.195:6805","nonce":28733}]},"public_addr":"172.21.15.195:6801/28733","cluster_addr":"172.21.15.195:6803/28733","heartbeat_back_addr":"172.21.15.195:6807/28733","heartbeat_front_addr":"172.21.15.195:6805/28733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.152046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.177399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.123066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:42:38.044 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T10:42:19.632084+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T10:42:19.779089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T10:42:24.266614+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T10:42:25.014684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T10:42:38.045 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T10:42:38.336 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-04-26T10:42:38.349 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T10:42:38.645 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-04-26T10:42:38.658 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T10:42:38.952 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-04-26T10:42:38.965 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T10:42:39.260 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-04-26T10:42:39.273 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T10:42:39.601 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:39.601 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T10:42:26.028204+0000","modified":"2024-04-26T10:42:28.033502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4218":{"gid":4218,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6803/4129035646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":4129035646},{"type":"v1","addr":"172.21.15.49:6803","nonce":4129035646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T10:42:39.601 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 5 2024-04-26T10:42:39.614 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:42:39.909 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:39.909 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":15,"fsid":"9837de44-a9e8-4979-adc4-611f3ddc44ce","created":"2024-04-26T10:42:11.337159+0000","modified":"2024-04-26T10:42:27.029243+0000","last_up_change":"2024-04-26T10:42:19.397933+0000","last_in_change":"2024-04-26T10:42:12.136647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:42:19.632084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:42:19.779089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:42:24.266614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:42:25.014684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eabed31c-c043-43de-a756-e217d5287116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":28839},{"type":"v1","addr":"172.21.15.60:6801","nonce":28839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":28839},{"type":"v1","addr":"172.21.15.60:6803","nonce":28839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":28839},{"type":"v1","addr":"172.21.15.60:6807","nonce":28839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":28839},{"type":"v1","addr":"172.21.15.60:6805","nonce":28839}]},"public_addr":"172.21.15.60:6801/28839","cluster_addr":"172.21.15.60:6803/28839","heartbeat_back_addr":"172.21.15.60:6807/28839","heartbeat_front_addr":"172.21.15.60:6805/28839","state":["exists","up"]},{"osd":1,"uuid":"7013621f-db09-4096-bc24-428bb170edd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":28598},{"type":"v1","addr":"172.21.15.87:6801","nonce":28598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":28598},{"type":"v1","addr":"172.21.15.87:6803","nonce":28598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":28598},{"type":"v1","addr":"172.21.15.87:6807","nonce":28598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":28598},{"type":"v1","addr":"172.21.15.87:6805","nonce":28598}]},"public_addr":"172.21.15.87:6801/28598","cluster_addr":"172.21.15.87:6803/28598","heartbeat_back_addr":"172.21.15.87:6807/28598","heartbeat_front_addr":"172.21.15.87:6805/28598","state":["exists","up"]},{"osd":2,"uuid":"a1efeadd-cf55-4ed5-9918-36607fd62229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":28733},{"type":"v1","addr":"172.21.15.195:6801","nonce":28733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":28733},{"type":"v1","addr":"172.21.15.195:6803","nonce":28733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":28733},{"type":"v1","addr":"172.21.15.195:6807","nonce":28733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":28733},{"type":"v1","addr":"172.21.15.195:6805","nonce":28733}]},"public_addr":"172.21.15.195:6801/28733","cluster_addr":"172.21.15.195:6803/28733","heartbeat_back_addr":"172.21.15.195:6807/28733","heartbeat_front_addr":"172.21.15.195:6805/28733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.152046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.177399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.123066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:42:39.922 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T10:42:19.632084+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T10:42:19.779089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T10:42:24.266614+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T10:42:25.014684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T10:42:39.923 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T10:42:40.220 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-04-26T10:42:40.233 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T10:42:40.528 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-04-26T10:42:40.542 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T10:42:40.836 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-04-26T10:42:40.849 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T10:42:41.142 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-04-26T10:42:41.155 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T10:42:41.485 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:41.486 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T10:42:26.028204+0000","modified":"2024-04-26T10:42:28.033502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4218":{"gid":4218,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6803/4129035646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":4129035646},{"type":"v1","addr":"172.21.15.49:6803","nonce":4129035646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T10:42:41.486 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 5 2024-04-26T10:42:41.498 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:42:41.791 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:41.792 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":15,"fsid":"9837de44-a9e8-4979-adc4-611f3ddc44ce","created":"2024-04-26T10:42:11.337159+0000","modified":"2024-04-26T10:42:27.029243+0000","last_up_change":"2024-04-26T10:42:19.397933+0000","last_in_change":"2024-04-26T10:42:12.136647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:42:19.632084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:42:19.779089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:42:24.266614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:42:25.014684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eabed31c-c043-43de-a756-e217d5287116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":28839},{"type":"v1","addr":"172.21.15.60:6801","nonce":28839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":28839},{"type":"v1","addr":"172.21.15.60:6803","nonce":28839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":28839},{"type":"v1","addr":"172.21.15.60:6807","nonce":28839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":28839},{"type":"v1","addr":"172.21.15.60:6805","nonce":28839}]},"public_addr":"172.21.15.60:6801/28839","cluster_addr":"172.21.15.60:6803/28839","heartbeat_back_addr":"172.21.15.60:6807/28839","heartbeat_front_addr":"172.21.15.60:6805/28839","state":["exists","up"]},{"osd":1,"uuid":"7013621f-db09-4096-bc24-428bb170edd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":28598},{"type":"v1","addr":"172.21.15.87:6801","nonce":28598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":28598},{"type":"v1","addr":"172.21.15.87:6803","nonce":28598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":28598},{"type":"v1","addr":"172.21.15.87:6807","nonce":28598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":28598},{"type":"v1","addr":"172.21.15.87:6805","nonce":28598}]},"public_addr":"172.21.15.87:6801/28598","cluster_addr":"172.21.15.87:6803/28598","heartbeat_back_addr":"172.21.15.87:6807/28598","heartbeat_front_addr":"172.21.15.87:6805/28598","state":["exists","up"]},{"osd":2,"uuid":"a1efeadd-cf55-4ed5-9918-36607fd62229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":28733},{"type":"v1","addr":"172.21.15.195:6801","nonce":28733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":28733},{"type":"v1","addr":"172.21.15.195:6803","nonce":28733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":28733},{"type":"v1","addr":"172.21.15.195:6807","nonce":28733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":28733},{"type":"v1","addr":"172.21.15.195:6805","nonce":28733}]},"public_addr":"172.21.15.195:6801/28733","cluster_addr":"172.21.15.195:6803/28733","heartbeat_back_addr":"172.21.15.195:6807/28733","heartbeat_front_addr":"172.21.15.195:6805/28733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.152046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.177399+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.123066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:42:41.805 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T10:42:42.134 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:42.134 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T10:42:26.028204+0000","modified":"2024-04-26T10:42:28.033502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4218":{"gid":4218,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6803/4129035646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":4129035646},{"type":"v1","addr":"172.21.15.49:6803","nonce":4129035646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T10:42:42.134 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 5 2024-04-26T10:42:42.248 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T10:42:26.028204+0000', 'modified': '2024-04-26T10:42:28.033502+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4218}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4218': {'gid': 4218, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.49:6803/4129035646', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.49:6802', 'nonce': 4129035646}, {'type': 'v1', 'addr': '172.21.15.49:6803', 'nonce': 4129035646}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-26T10:42:42.248 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T10:42:42.248 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T10:42:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-04-26T10:42:42.360+0000 7fef277fe640 0 client.4472 ms_handle_reset on v2:172.21.15.49:6802/4129035646 2024-04-26T10:42:42.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-04-26T10:42:42.380+0000 7fef277fe640 0 client.4486 ms_handle_reset on v2:172.21.15.49:6802/4129035646 2024-04-26T10:42:42.383 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-04-26T10:42:42.383 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "9837de44-a9e8-4979-adc4-611f3ddc44ce", 2024-04-26T10:42:42.383 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-04-26T10:42:42.383 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4218, 2024-04-26T10:42:42.383 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-04-26T10:42:42.383 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-04-26T10:42:42.383 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-04-26T10:42:42.383 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 16.352224700000001, 2024-04-26T10:42:42.383 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 5, 2024-04-26T10:42:42.383 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 15, 2024-04-26T10:42:42.383 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 15, 2024-04-26T10:42:42.383 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 20.885010096999999 2024-04-26T10:42:42.384 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-04-26T10:42:42.393 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-26T10:42:42.405 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-26T10:42:42.405 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6'}} 2024-04-26T10:42:42.405 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-26T10:42:42.405 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-04-26T10:42:42.405 DEBUG:teuthology.orchestra.run.smithi049:> sync 2024-04-26T10:42:42.567 DEBUG:teuthology.orchestra.run.smithi060:> sync 2024-04-26T10:42:42.700 DEBUG:teuthology.orchestra.run.smithi087:> sync 2024-04-26T10:42:42.799 DEBUG:teuthology.orchestra.run.smithi195:> sync 2024-04-26T10:42:42.930 DEBUG:tasks.thrashosds:checking console status of smithi049 2024-04-26T10:42:42.930 DEBUG:teuthology.orchestra.console.smithi049:Waiting for login prompt 2024-04-26T10:42:42.930 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi049 2024-04-26T10:42:43.097 DEBUG:teuthology.orchestra.console.smithi049:expect before: [Enter `^Ec?' for help] 2024-04-26T10:42:43.097 DEBUG:teuthology.orchestra.console.smithi049:expect after: smithi049 login: 2024-04-26T10:42:43.149 DEBUG:teuthology.orchestra.console.smithi049:console disconnect output: [Enter `^Ec?' for help] smithi049 login: [disconnect] 2024-04-26T10:42:43.250 DEBUG:tasks.thrashosds:checking console status of smithi060 2024-04-26T10:42:43.250 DEBUG:teuthology.orchestra.console.smithi060:Waiting for login prompt 2024-04-26T10:42:43.250 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi060 2024-04-26T10:42:43.392 DEBUG:teuthology.orchestra.console.smithi060:expect before: [Enter `^Ec?' for help] 2024-04-26T10:42:43.392 DEBUG:teuthology.orchestra.console.smithi060:expect after: smithi060 login: 2024-04-26T10:42:43.444 DEBUG:teuthology.orchestra.console.smithi060:console disconnect output: [Enter `^Ec?' for help] smithi060 login: [disconnect] 2024-04-26T10:42:43.545 DEBUG:tasks.thrashosds:checking console status of smithi087 2024-04-26T10:42:43.546 DEBUG:teuthology.orchestra.console.smithi087:Waiting for login prompt 2024-04-26T10:42:43.546 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi087 2024-04-26T10:42:43.689 DEBUG:teuthology.orchestra.console.smithi087:expect before: [Enter `^Ec?' for help] 2024-04-26T10:42:43.689 DEBUG:teuthology.orchestra.console.smithi087:expect after: smithi087 login: 2024-04-26T10:42:43.742 DEBUG:teuthology.orchestra.console.smithi087:console disconnect output: [Enter `^Ec?' for help] smithi087 login: [disconnect] 2024-04-26T10:42:43.842 DEBUG:tasks.thrashosds:checking console status of smithi195 2024-04-26T10:42:43.843 DEBUG:teuthology.orchestra.console.smithi195:Waiting for login prompt 2024-04-26T10:42:43.843 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi195 2024-04-26T10:42:43.999 DEBUG:teuthology.orchestra.console.smithi195:expect before: [Enter `^Ec?' for help] 2024-04-26T10:42:43.999 DEBUG:teuthology.orchestra.console.smithi195:expect after: smithi195 login: 2024-04-26T10:42:44.051 DEBUG:teuthology.orchestra.console.smithi195:console disconnect output: [Enter `^Ec?' for help] smithi195 login: [disconnect] 2024-04-26T10:42:44.152 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-26T10:42:44.478 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-26T10:42:44.478 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T10:42:44.478 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:42:44.775 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:44.777 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:42:44.785 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-26T10:42:43.595787+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94984,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283020536,"statfs":{"total":289910292480,"available":289813028864,"internally_reserved":0,"allocated":1646592,"data_stored":1323601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002327"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033761+0000","last_change":"2024-04-26T10:42:26.045527+0000","last_active":"2024-04-26T10:42:27.033761+0000","last_peered":"2024-04-26T10:42:27.033761+0000","last_clean":"2024-04-26T10:42:27.033761+0000","last_became_active":"2024-04-26T10:42:26.044597+0000","last_became_peered":"2024-04-26T10:42:26.044597+0000","last_unstale":"2024-04-26T10:42:27.033761+0000","last_undegraded":"2024-04-26T10:42:27.033761+0000","last_fullsized":"2024-04-26T10:42:27.033761+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033531+0000","last_change":"2024-04-26T10:42:26.043815+0000","last_active":"2024-04-26T10:42:27.033531+0000","last_peered":"2024-04-26T10:42:27.033531+0000","last_clean":"2024-04-26T10:42:27.033531+0000","last_became_active":"2024-04-26T10:42:26.042757+0000","last_became_peered":"2024-04-26T10:42:26.042757+0000","last_unstale":"2024-04-26T10:42:27.033531+0000","last_undegraded":"2024-04-26T10:42:27.033531+0000","last_fullsized":"2024-04-26T10:42:27.033531+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:27.752674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033378+0000","last_change":"2024-04-26T10:42:26.041030+0000","last_active":"2024-04-26T10:42:27.033378+0000","last_peered":"2024-04-26T10:42:27.033378+0000","last_clean":"2024-04-26T10:42:27.033378+0000","last_became_active":"2024-04-26T10:42:26.039762+0000","last_became_peered":"2024-04-26T10:42:26.039762+0000","last_unstale":"2024-04-26T10:42:27.033378+0000","last_undegraded":"2024-04-26T10:42:27.033378+0000","last_fullsized":"2024-04-26T10:42:27.033378+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033311+0000","last_change":"2024-04-26T10:42:26.044004+0000","last_active":"2024-04-26T10:42:27.033311+0000","last_peered":"2024-04-26T10:42:27.033311+0000","last_clean":"2024-04-26T10:42:27.033311+0000","last_became_active":"2024-04-26T10:42:26.042953+0000","last_became_peered":"2024-04-26T10:42:26.042953+0000","last_unstale":"2024-04-26T10:42:27.033311+0000","last_undegraded":"2024-04-26T10:42:27.033311+0000","last_fullsized":"2024-04-26T10:42:27.033311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.895922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033277+0000","last_change":"2024-04-26T10:42:26.041191+0000","last_active":"2024-04-26T10:42:27.033277+0000","last_peered":"2024-04-26T10:42:27.033277+0000","last_clean":"2024-04-26T10:42:27.033277+0000","last_became_active":"2024-04-26T10:42:26.040487+0000","last_became_peered":"2024-04-26T10:42:26.040487+0000","last_unstale":"2024-04-26T10:42:27.033277+0000","last_undegraded":"2024-04-26T10:42:27.033277+0000","last_fullsized":"2024-04-26T10:42:27.033277+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032976+0000","last_change":"2024-04-26T10:42:26.043542+0000","last_active":"2024-04-26T10:42:27.032976+0000","last_peered":"2024-04-26T10:42:27.032976+0000","last_clean":"2024-04-26T10:42:27.032976+0000","last_became_active":"2024-04-26T10:42:26.042631+0000","last_became_peered":"2024-04-26T10:42:26.042631+0000","last_unstale":"2024-04-26T10:42:27.032976+0000","last_undegraded":"2024-04-26T10:42:27.032976+0000","last_fullsized":"2024-04-26T10:42:27.032976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:38.272126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033024+0000","last_change":"2024-04-26T10:42:26.042698+0000","last_active":"2024-04-26T10:42:27.033024+0000","last_peered":"2024-04-26T10:42:27.033024+0000","last_clean":"2024-04-26T10:42:27.033024+0000","last_became_active":"2024-04-26T10:42:26.041631+0000","last_became_peered":"2024-04-26T10:42:26.041631+0000","last_unstale":"2024-04-26T10:42:27.033024+0000","last_undegraded":"2024-04-26T10:42:27.033024+0000","last_fullsized":"2024-04-26T10:42:27.033024+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:27.752674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032694+0000","last_change":"2024-04-26T10:42:26.045497+0000","last_active":"2024-04-26T10:42:27.032694+0000","last_peered":"2024-04-26T10:42:27.032694+0000","last_clean":"2024-04-26T10:42:27.032694+0000","last_became_active":"2024-04-26T10:42:26.044865+0000","last_became_peered":"2024-04-26T10:42:26.044865+0000","last_unstale":"2024-04-26T10:42:27.032694+0000","last_undegraded":"2024-04-26T10:42:27.032694+0000","last_fullsized":"2024-04-26T10:42:27.032694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:59:04.853293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033544+0000","last_change":"2024-04-26T10:42:26.045893+0000","last_active":"2024-04-26T10:42:27.033544+0000","last_peered":"2024-04-26T10:42:27.033544+0000","last_clean":"2024-04-26T10:42:27.033544+0000","last_became_active":"2024-04-26T10:42:26.045177+0000","last_became_peered":"2024-04-26T10:42:26.045177+0000","last_unstale":"2024-04-26T10:42:27.033544+0000","last_undegraded":"2024-04-26T10:42:27.033544+0000","last_fullsized":"2024-04-26T10:42:27.033544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033494+0000","last_change":"2024-04-26T10:42:26.044101+0000","last_active":"2024-04-26T10:42:27.033494+0000","last_peered":"2024-04-26T10:42:27.033494+0000","last_clean":"2024-04-26T10:42:27.033494+0000","last_became_active":"2024-04-26T10:42:26.042047+0000","last_became_peered":"2024-04-26T10:42:26.042047+0000","last_unstale":"2024-04-26T10:42:27.033494+0000","last_undegraded":"2024-04-26T10:42:27.033494+0000","last_fullsized":"2024-04-26T10:42:27.033494+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:46.975947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033560+0000","last_change":"2024-04-26T10:42:26.043530+0000","last_active":"2024-04-26T10:42:27.033560+0000","last_peered":"2024-04-26T10:42:27.033560+0000","last_clean":"2024-04-26T10:42:27.033560+0000","last_became_active":"2024-04-26T10:42:26.042301+0000","last_became_peered":"2024-04-26T10:42:26.042301+0000","last_unstale":"2024-04-26T10:42:27.033560+0000","last_undegraded":"2024-04-26T10:42:27.033560+0000","last_fullsized":"2024-04-26T10:42:27.033560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:48.440963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033166+0000","last_change":"2024-04-26T10:42:26.047073+0000","last_active":"2024-04-26T10:42:27.033166+0000","last_peered":"2024-04-26T10:42:27.033166+0000","last_clean":"2024-04-26T10:42:27.033166+0000","last_became_active":"2024-04-26T10:42:26.046384+0000","last_became_peered":"2024-04-26T10:42:26.046384+0000","last_unstale":"2024-04-26T10:42:27.033166+0000","last_undegraded":"2024-04-26T10:42:27.033166+0000","last_fullsized":"2024-04-26T10:42:27.033166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:23.079349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032981+0000","last_change":"2024-04-26T10:42:26.042607+0000","last_active":"2024-04-26T10:42:27.032981+0000","last_peered":"2024-04-26T10:42:27.032981+0000","last_clean":"2024-04-26T10:42:27.032981+0000","last_became_active":"2024-04-26T10:42:26.041617+0000","last_became_peered":"2024-04-26T10:42:26.041617+0000","last_unstale":"2024-04-26T10:42:27.032981+0000","last_undegraded":"2024-04-26T10:42:27.032981+0000","last_fullsized":"2024-04-26T10:42:27.032981+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033143+0000","last_change":"2024-04-26T10:42:26.040433+0000","last_active":"2024-04-26T10:42:27.033143+0000","last_peered":"2024-04-26T10:42:27.033143+0000","last_clean":"2024-04-26T10:42:27.033143+0000","last_became_active":"2024-04-26T10:42:26.039631+0000","last_became_peered":"2024-04-26T10:42:26.039631+0000","last_unstale":"2024-04-26T10:42:27.033143+0000","last_undegraded":"2024-04-26T10:42:27.033143+0000","last_fullsized":"2024-04-26T10:42:27.033143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033116+0000","last_change":"2024-04-26T10:42:26.040182+0000","last_active":"2024-04-26T10:42:27.033116+0000","last_peered":"2024-04-26T10:42:27.033116+0000","last_clean":"2024-04-26T10:42:27.033116+0000","last_became_active":"2024-04-26T10:42:26.038614+0000","last_became_peered":"2024-04-26T10:42:26.038614+0000","last_unstale":"2024-04-26T10:42:27.033116+0000","last_undegraded":"2024-04-26T10:42:27.033116+0000","last_fullsized":"2024-04-26T10:42:27.033116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032762+0000","last_change":"2024-04-26T10:42:26.045551+0000","last_active":"2024-04-26T10:42:27.032762+0000","last_peered":"2024-04-26T10:42:27.032762+0000","last_clean":"2024-04-26T10:42:27.032762+0000","last_became_active":"2024-04-26T10:42:26.044944+0000","last_became_peered":"2024-04-26T10:42:26.044944+0000","last_unstale":"2024-04-26T10:42:27.032762+0000","last_undegraded":"2024-04-26T10:42:27.032762+0000","last_fullsized":"2024-04-26T10:42:27.032762+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:02.194279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033885+0000","last_change":"2024-04-26T10:42:26.049338+0000","last_active":"2024-04-26T10:42:27.033885+0000","last_peered":"2024-04-26T10:42:27.033885+0000","last_clean":"2024-04-26T10:42:27.033885+0000","last_became_active":"2024-04-26T10:42:26.049014+0000","last_became_peered":"2024-04-26T10:42:26.049014+0000","last_unstale":"2024-04-26T10:42:27.033885+0000","last_undegraded":"2024-04-26T10:42:27.033885+0000","last_fullsized":"2024-04-26T10:42:27.033885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033767+0000","last_change":"2024-04-26T10:42:26.043604+0000","last_active":"2024-04-26T10:42:27.033767+0000","last_peered":"2024-04-26T10:42:27.033767+0000","last_clean":"2024-04-26T10:42:27.033767+0000","last_became_active":"2024-04-26T10:42:26.041224+0000","last_became_peered":"2024-04-26T10:42:26.041224+0000","last_unstale":"2024-04-26T10:42:27.033767+0000","last_undegraded":"2024-04-26T10:42:27.033767+0000","last_fullsized":"2024-04-26T10:42:27.033767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033328+0000","last_change":"2024-04-26T10:42:26.045031+0000","last_active":"2024-04-26T10:42:27.033328+0000","last_peered":"2024-04-26T10:42:27.033328+0000","last_clean":"2024-04-26T10:42:27.033328+0000","last_became_active":"2024-04-26T10:42:26.044604+0000","last_became_peered":"2024-04-26T10:42:26.044604+0000","last_unstale":"2024-04-26T10:42:27.033328+0000","last_undegraded":"2024-04-26T10:42:27.033328+0000","last_fullsized":"2024-04-26T10:42:27.033328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033728+0000","last_change":"2024-04-26T10:42:26.043762+0000","last_active":"2024-04-26T10:42:27.033728+0000","last_peered":"2024-04-26T10:42:27.033728+0000","last_clean":"2024-04-26T10:42:27.033728+0000","last_became_active":"2024-04-26T10:42:26.042117+0000","last_became_peered":"2024-04-26T10:42:26.042117+0000","last_unstale":"2024-04-26T10:42:27.033728+0000","last_undegraded":"2024-04-26T10:42:27.033728+0000","last_fullsized":"2024-04-26T10:42:27.033728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:35.276961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033416+0000","last_change":"2024-04-26T10:42:26.044062+0000","last_active":"2024-04-26T10:42:27.033416+0000","last_peered":"2024-04-26T10:42:27.033416+0000","last_clean":"2024-04-26T10:42:27.033416+0000","last_became_active":"2024-04-26T10:42:26.042378+0000","last_became_peered":"2024-04-26T10:42:26.042378+0000","last_unstale":"2024-04-26T10:42:27.033416+0000","last_undegraded":"2024-04-26T10:42:27.033416+0000","last_fullsized":"2024-04-26T10:42:27.033416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:24.255706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032809+0000","last_change":"2024-04-26T10:42:26.046353+0000","last_active":"2024-04-26T10:42:27.032809+0000","last_peered":"2024-04-26T10:42:27.032809+0000","last_clean":"2024-04-26T10:42:27.032809+0000","last_became_active":"2024-04-26T10:42:26.045614+0000","last_became_peered":"2024-04-26T10:42:26.045614+0000","last_unstale":"2024-04-26T10:42:27.032809+0000","last_undegraded":"2024-04-26T10:42:27.032809+0000","last_fullsized":"2024-04-26T10:42:27.032809+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:19.601720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032687+0000","last_change":"2024-04-26T10:42:26.045311+0000","last_active":"2024-04-26T10:42:27.032687+0000","last_peered":"2024-04-26T10:42:27.032687+0000","last_clean":"2024-04-26T10:42:27.032687+0000","last_became_active":"2024-04-26T10:42:26.044614+0000","last_became_peered":"2024-04-26T10:42:26.044614+0000","last_unstale":"2024-04-26T10:42:27.032687+0000","last_undegraded":"2024-04-26T10:42:27.032687+0000","last_fullsized":"2024-04-26T10:42:27.032687+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032624+0000","last_change":"2024-04-26T10:42:26.043614+0000","last_active":"2024-04-26T10:42:27.032624+0000","last_peered":"2024-04-26T10:42:27.032624+0000","last_clean":"2024-04-26T10:42:27.032624+0000","last_became_active":"2024-04-26T10:42:26.042629+0000","last_became_peered":"2024-04-26T10:42:26.042629+0000","last_unstale":"2024-04-26T10:42:27.032624+0000","last_undegraded":"2024-04-26T10:42:27.032624+0000","last_fullsized":"2024-04-26T10:42:27.032624+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033909+0000","last_change":"2024-04-26T10:42:26.046876+0000","last_active":"2024-04-26T10:42:27.033909+0000","last_peered":"2024-04-26T10:42:27.033909+0000","last_clean":"2024-04-26T10:42:27.033909+0000","last_became_active":"2024-04-26T10:42:26.046177+0000","last_became_peered":"2024-04-26T10:42:26.046177+0000","last_unstale":"2024-04-26T10:42:27.033909+0000","last_undegraded":"2024-04-26T10:42:27.033909+0000","last_fullsized":"2024-04-26T10:42:27.033909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:51.567162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033546+0000","last_change":"2024-04-26T10:42:26.044190+0000","last_active":"2024-04-26T10:42:27.033546+0000","last_peered":"2024-04-26T10:42:27.033546+0000","last_clean":"2024-04-26T10:42:27.033546+0000","last_became_active":"2024-04-26T10:42:26.043736+0000","last_became_peered":"2024-04-26T10:42:26.043736+0000","last_unstale":"2024-04-26T10:42:27.033546+0000","last_undegraded":"2024-04-26T10:42:27.033546+0000","last_fullsized":"2024-04-26T10:42:27.033546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033729+0000","last_change":"2024-04-26T10:42:26.041008+0000","last_active":"2024-04-26T10:42:27.033729+0000","last_peered":"2024-04-26T10:42:27.033729+0000","last_clean":"2024-04-26T10:42:27.033729+0000","last_became_active":"2024-04-26T10:42:26.039620+0000","last_became_peered":"2024-04-26T10:42:26.039620+0000","last_unstale":"2024-04-26T10:42:27.033729+0000","last_undegraded":"2024-04-26T10:42:27.033729+0000","last_fullsized":"2024-04-26T10:42:27.033729+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033575+0000","last_change":"2024-04-26T10:42:26.046392+0000","last_active":"2024-04-26T10:42:27.033575+0000","last_peered":"2024-04-26T10:42:27.033575+0000","last_clean":"2024-04-26T10:42:27.033575+0000","last_became_active":"2024-04-26T10:42:26.045806+0000","last_became_peered":"2024-04-26T10:42:26.045806+0000","last_unstale":"2024-04-26T10:42:27.033575+0000","last_undegraded":"2024-04-26T10:42:27.033575+0000","last_fullsized":"2024-04-26T10:42:27.033575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:15:59.087635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033383+0000","last_change":"2024-04-26T10:42:26.045205+0000","last_active":"2024-04-26T10:42:27.033383+0000","last_peered":"2024-04-26T10:42:27.033383+0000","last_clean":"2024-04-26T10:42:27.033383+0000","last_became_active":"2024-04-26T10:42:26.044762+0000","last_became_peered":"2024-04-26T10:42:26.044762+0000","last_unstale":"2024-04-26T10:42:27.033383+0000","last_undegraded":"2024-04-26T10:42:27.033383+0000","last_fullsized":"2024-04-26T10:42:27.033383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033051+0000","last_change":"2024-04-26T10:42:26.046020+0000","last_active":"2024-04-26T10:42:27.033051+0000","last_peered":"2024-04-26T10:42:27.033051+0000","last_clean":"2024-04-26T10:42:27.033051+0000","last_became_active":"2024-04-26T10:42:26.045567+0000","last_became_peered":"2024-04-26T10:42:26.045567+0000","last_unstale":"2024-04-26T10:42:27.033051+0000","last_undegraded":"2024-04-26T10:42:27.033051+0000","last_fullsized":"2024-04-26T10:42:27.033051+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:53.380329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032770+0000","last_change":"2024-04-26T10:42:26.046584+0000","last_active":"2024-04-26T10:42:27.032770+0000","last_peered":"2024-04-26T10:42:27.032770+0000","last_clean":"2024-04-26T10:42:27.032770+0000","last_became_active":"2024-04-26T10:42:26.046231+0000","last_became_peered":"2024-04-26T10:42:26.046231+0000","last_unstale":"2024-04-26T10:42:27.032770+0000","last_undegraded":"2024-04-26T10:42:27.032770+0000","last_fullsized":"2024-04-26T10:42:27.032770+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032953+0000","last_change":"2024-04-26T10:42:26.045270+0000","last_active":"2024-04-26T10:42:27.032953+0000","last_peered":"2024-04-26T10:42:27.032953+0000","last_clean":"2024-04-26T10:42:27.032953+0000","last_became_active":"2024-04-26T10:42:26.044341+0000","last_became_peered":"2024-04-26T10:42:26.044341+0000","last_unstale":"2024-04-26T10:42:27.032953+0000","last_undegraded":"2024-04-26T10:42:27.032953+0000","last_fullsized":"2024-04-26T10:42:27.032953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:46.975947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033573+0000","last_change":"2024-04-26T10:42:26.041757+0000","last_active":"2024-04-26T10:42:27.033573+0000","last_peered":"2024-04-26T10:42:27.033573+0000","last_clean":"2024-04-26T10:42:27.033573+0000","last_became_active":"2024-04-26T10:42:26.040920+0000","last_became_peered":"2024-04-26T10:42:26.040920+0000","last_unstale":"2024-04-26T10:42:27.033573+0000","last_undegraded":"2024-04-26T10:42:27.033573+0000","last_fullsized":"2024-04-26T10:42:27.033573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033905+0000","last_change":"2024-04-26T10:42:25.687138+0000","last_active":"2024-04-26T10:42:27.033905+0000","last_peered":"2024-04-26T10:42:27.033905+0000","last_clean":"2024-04-26T10:42:27.033905+0000","last_became_active":"2024-04-26T10:42:25.686488+0000","last_became_peered":"2024-04-26T10:42:25.686488+0000","last_unstale":"2024-04-26T10:42:27.033905+0000","last_undegraded":"2024-04-26T10:42:27.033905+0000","last_fullsized":"2024-04-26T10:42:27.033905+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:43.969731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033779+0000","last_change":"2024-04-26T10:42:26.041850+0000","last_active":"2024-04-26T10:42:27.033779+0000","last_peered":"2024-04-26T10:42:27.033779+0000","last_clean":"2024-04-26T10:42:27.033779+0000","last_became_active":"2024-04-26T10:42:26.040464+0000","last_became_peered":"2024-04-26T10:42:26.040464+0000","last_unstale":"2024-04-26T10:42:27.033779+0000","last_undegraded":"2024-04-26T10:42:27.033779+0000","last_fullsized":"2024-04-26T10:42:27.033779+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033039+0000","last_change":"2024-04-26T10:42:25.685525+0000","last_active":"2024-04-26T10:42:27.033039+0000","last_peered":"2024-04-26T10:42:27.033039+0000","last_clean":"2024-04-26T10:42:27.033039+0000","last_became_active":"2024-04-26T10:42:25.684855+0000","last_became_peered":"2024-04-26T10:42:25.684855+0000","last_unstale":"2024-04-26T10:42:27.033039+0000","last_undegraded":"2024-04-26T10:42:27.033039+0000","last_fullsized":"2024-04-26T10:42:27.033039+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:16.723401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033789+0000","last_change":"2024-04-26T10:42:26.046616+0000","last_active":"2024-04-26T10:42:27.033789+0000","last_peered":"2024-04-26T10:42:27.033789+0000","last_clean":"2024-04-26T10:42:27.033789+0000","last_became_active":"2024-04-26T10:42:26.046010+0000","last_became_peered":"2024-04-26T10:42:26.046010+0000","last_unstale":"2024-04-26T10:42:27.033789+0000","last_undegraded":"2024-04-26T10:42:27.033789+0000","last_fullsized":"2024-04-26T10:42:27.033789+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:19.601720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032884+0000","last_change":"2024-04-26T10:42:25.688905+0000","last_active":"2024-04-26T10:42:27.032884+0000","last_peered":"2024-04-26T10:42:27.032884+0000","last_clean":"2024-04-26T10:42:27.032884+0000","last_became_active":"2024-04-26T10:42:25.688504+0000","last_became_peered":"2024-04-26T10:42:25.688504+0000","last_unstale":"2024-04-26T10:42:27.032884+0000","last_undegraded":"2024-04-26T10:42:27.032884+0000","last_fullsized":"2024-04-26T10:42:27.032884+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.930441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033655+0000","last_change":"2024-04-26T10:42:26.046158+0000","last_active":"2024-04-26T10:42:27.033655+0000","last_peered":"2024-04-26T10:42:27.033655+0000","last_clean":"2024-04-26T10:42:27.033655+0000","last_became_active":"2024-04-26T10:42:26.045797+0000","last_became_peered":"2024-04-26T10:42:26.045797+0000","last_unstale":"2024-04-26T10:42:27.033655+0000","last_undegraded":"2024-04-26T10:42:27.033655+0000","last_fullsized":"2024-04-26T10:42:27.033655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:23.079349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032889+0000","last_change":"2024-04-26T10:42:25.687207+0000","last_active":"2024-04-26T10:42:27.032889+0000","last_peered":"2024-04-26T10:42:27.032889+0000","last_clean":"2024-04-26T10:42:27.032889+0000","last_became_active":"2024-04-26T10:42:25.686549+0000","last_became_peered":"2024-04-26T10:42:25.686549+0000","last_unstale":"2024-04-26T10:42:27.032889+0000","last_undegraded":"2024-04-26T10:42:27.032889+0000","last_fullsized":"2024-04-26T10:42:27.032889+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:42.125386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033731+0000","last_change":"2024-04-26T10:42:25.684462+0000","last_active":"2024-04-26T10:42:27.033731+0000","last_peered":"2024-04-26T10:42:27.033731+0000","last_clean":"2024-04-26T10:42:27.033731+0000","last_became_active":"2024-04-26T10:42:25.684162+0000","last_became_peered":"2024-04-26T10:42:25.684162+0000","last_unstale":"2024-04-26T10:42:27.033731+0000","last_undegraded":"2024-04-26T10:42:27.033731+0000","last_fullsized":"2024-04-26T10:42:27.033731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.850118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032640+0000","last_change":"2024-04-26T10:42:26.048114+0000","last_active":"2024-04-26T10:42:27.032640+0000","last_peered":"2024-04-26T10:42:27.032640+0000","last_clean":"2024-04-26T10:42:27.032640+0000","last_became_active":"2024-04-26T10:42:26.046641+0000","last_became_peered":"2024-04-26T10:42:26.046641+0000","last_unstale":"2024-04-26T10:42:27.032640+0000","last_undegraded":"2024-04-26T10:42:27.032640+0000","last_fullsized":"2024-04-26T10:42:27.032640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:01.056945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033763+0000","last_change":"2024-04-26T10:42:25.688889+0000","last_active":"2024-04-26T10:42:27.033763+0000","last_peered":"2024-04-26T10:42:27.033763+0000","last_clean":"2024-04-26T10:42:27.033763+0000","last_became_active":"2024-04-26T10:42:25.688372+0000","last_became_peered":"2024-04-26T10:42:25.688372+0000","last_unstale":"2024-04-26T10:42:27.033763+0000","last_undegraded":"2024-04-26T10:42:27.033763+0000","last_fullsized":"2024-04-26T10:42:27.033763+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:13.799290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032734+0000","last_change":"2024-04-26T10:42:26.041968+0000","last_active":"2024-04-26T10:42:27.032734+0000","last_peered":"2024-04-26T10:42:27.032734+0000","last_clean":"2024-04-26T10:42:27.032734+0000","last_became_active":"2024-04-26T10:42:26.041070+0000","last_became_peered":"2024-04-26T10:42:26.041070+0000","last_unstale":"2024-04-26T10:42:27.032734+0000","last_undegraded":"2024-04-26T10:42:27.032734+0000","last_fullsized":"2024-04-26T10:42:27.032734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033901+0000","last_change":"2024-04-26T10:42:25.684653+0000","last_active":"2024-04-26T10:42:27.033901+0000","last_peered":"2024-04-26T10:42:27.033901+0000","last_clean":"2024-04-26T10:42:27.033901+0000","last_became_active":"2024-04-26T10:42:25.684338+0000","last_became_peered":"2024-04-26T10:42:25.684338+0000","last_unstale":"2024-04-26T10:42:27.033901+0000","last_undegraded":"2024-04-26T10:42:27.033901+0000","last_fullsized":"2024-04-26T10:42:27.033901+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:10.694039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033371+0000","last_change":"2024-04-26T10:42:26.042182+0000","last_active":"2024-04-26T10:42:27.033371+0000","last_peered":"2024-04-26T10:42:27.033371+0000","last_clean":"2024-04-26T10:42:27.033371+0000","last_became_active":"2024-04-26T10:42:26.041689+0000","last_became_peered":"2024-04-26T10:42:26.041689+0000","last_unstale":"2024-04-26T10:42:27.033371+0000","last_undegraded":"2024-04-26T10:42:27.033371+0000","last_fullsized":"2024-04-26T10:42:27.033371+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:32:19.618648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033908+0000","last_change":"2024-04-26T10:42:25.686677+0000","last_active":"2024-04-26T10:42:27.033908+0000","last_peered":"2024-04-26T10:42:27.033908+0000","last_clean":"2024-04-26T10:42:27.033908+0000","last_became_active":"2024-04-26T10:42:25.685939+0000","last_became_peered":"2024-04-26T10:42:25.685939+0000","last_unstale":"2024-04-26T10:42:27.033908+0000","last_undegraded":"2024-04-26T10:42:27.033908+0000","last_fullsized":"2024-04-26T10:42:27.033908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:30.225098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033381+0000","last_change":"2024-04-26T10:42:26.045829+0000","last_active":"2024-04-26T10:42:27.033381+0000","last_peered":"2024-04-26T10:42:27.033381+0000","last_clean":"2024-04-26T10:42:27.033381+0000","last_became_active":"2024-04-26T10:42:26.045499+0000","last_became_peered":"2024-04-26T10:42:26.045499+0000","last_unstale":"2024-04-26T10:42:27.033381+0000","last_undegraded":"2024-04-26T10:42:27.033381+0000","last_fullsized":"2024-04-26T10:42:27.033381+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:14.041039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033624+0000","last_change":"2024-04-26T10:42:25.687934+0000","last_active":"2024-04-26T10:42:27.033624+0000","last_peered":"2024-04-26T10:42:27.033624+0000","last_clean":"2024-04-26T10:42:27.033624+0000","last_became_active":"2024-04-26T10:42:25.687447+0000","last_became_peered":"2024-04-26T10:42:25.687447+0000","last_unstale":"2024-04-26T10:42:27.033624+0000","last_undegraded":"2024-04-26T10:42:27.033624+0000","last_fullsized":"2024-04-26T10:42:27.033624+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.930441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033660+0000","last_change":"2024-04-26T10:42:26.043638+0000","last_active":"2024-04-26T10:42:27.033660+0000","last_peered":"2024-04-26T10:42:27.033660+0000","last_clean":"2024-04-26T10:42:27.033660+0000","last_became_active":"2024-04-26T10:42:26.042692+0000","last_became_peered":"2024-04-26T10:42:26.042692+0000","last_unstale":"2024-04-26T10:42:27.033660+0000","last_undegraded":"2024-04-26T10:42:27.033660+0000","last_fullsized":"2024-04-26T10:42:27.033660+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033803+0000","last_change":"2024-04-26T10:42:25.687283+0000","last_active":"2024-04-26T10:42:27.033803+0000","last_peered":"2024-04-26T10:42:27.033803+0000","last_clean":"2024-04-26T10:42:27.033803+0000","last_became_active":"2024-04-26T10:42:25.686251+0000","last_became_peered":"2024-04-26T10:42:25.686251+0000","last_unstale":"2024-04-26T10:42:27.033803+0000","last_undegraded":"2024-04-26T10:42:27.033803+0000","last_fullsized":"2024-04-26T10:42:27.033803+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:16.723401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033798+0000","last_change":"2024-04-26T10:42:26.040688+0000","last_active":"2024-04-26T10:42:27.033798+0000","last_peered":"2024-04-26T10:42:27.033798+0000","last_clean":"2024-04-26T10:42:27.033798+0000","last_became_active":"2024-04-26T10:42:26.039133+0000","last_became_peered":"2024-04-26T10:42:26.039133+0000","last_unstale":"2024-04-26T10:42:27.033798+0000","last_undegraded":"2024-04-26T10:42:27.033798+0000","last_fullsized":"2024-04-26T10:42:27.033798+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032938+0000","last_change":"2024-04-26T10:42:25.688837+0000","last_active":"2024-04-26T10:42:27.032938+0000","last_peered":"2024-04-26T10:42:27.032938+0000","last_clean":"2024-04-26T10:42:27.032938+0000","last_became_active":"2024-04-26T10:42:25.688450+0000","last_became_peered":"2024-04-26T10:42:25.688450+0000","last_unstale":"2024-04-26T10:42:27.032938+0000","last_undegraded":"2024-04-26T10:42:27.032938+0000","last_fullsized":"2024-04-26T10:42:27.032938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:26.788267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033564+0000","last_change":"2024-04-26T10:42:26.039661+0000","last_active":"2024-04-26T10:42:27.033564+0000","last_peered":"2024-04-26T10:42:27.033564+0000","last_clean":"2024-04-26T10:42:27.033564+0000","last_became_active":"2024-04-26T10:42:26.038664+0000","last_became_peered":"2024-04-26T10:42:26.038664+0000","last_unstale":"2024-04-26T10:42:27.033564+0000","last_undegraded":"2024-04-26T10:42:27.033564+0000","last_fullsized":"2024-04-26T10:42:27.033564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032757+0000","last_change":"2024-04-26T10:42:25.687082+0000","last_active":"2024-04-26T10:42:27.032757+0000","last_peered":"2024-04-26T10:42:27.032757+0000","last_clean":"2024-04-26T10:42:27.032757+0000","last_became_active":"2024-04-26T10:42:25.686779+0000","last_became_peered":"2024-04-26T10:42:25.686779+0000","last_unstale":"2024-04-26T10:42:27.032757+0000","last_undegraded":"2024-04-26T10:42:27.032757+0000","last_fullsized":"2024-04-26T10:42:27.032757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:12.284219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033692+0000","last_change":"2024-04-26T10:42:26.047130+0000","last_active":"2024-04-26T10:42:27.033692+0000","last_peered":"2024-04-26T10:42:27.033692+0000","last_clean":"2024-04-26T10:42:27.033692+0000","last_became_active":"2024-04-26T10:42:26.046884+0000","last_became_peered":"2024-04-26T10:42:26.046884+0000","last_unstale":"2024-04-26T10:42:27.033692+0000","last_undegraded":"2024-04-26T10:42:27.033692+0000","last_fullsized":"2024-04-26T10:42:27.033692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:31.020364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.035198+0000","last_change":"2024-04-26T10:42:21.406599+0000","last_active":"2024-04-26T10:42:26.035198+0000","last_peered":"2024-04-26T10:42:26.035198+0000","last_clean":"2024-04-26T10:42:26.035198+0000","last_became_active":"2024-04-26T10:42:21.405587+0000","last_became_peered":"2024-04-26T10:42:21.405587+0000","last_unstale":"2024-04-26T10:42:26.035198+0000","last_undegraded":"2024-04-26T10:42:26.035198+0000","last_fullsized":"2024-04-26T10:42:26.035198+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:44.561530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.035065+0000","last_change":"2024-04-26T10:42:21.405305+0000","last_active":"2024-04-26T10:42:26.035065+0000","last_peered":"2024-04-26T10:42:26.035065+0000","last_clean":"2024-04-26T10:42:26.035065+0000","last_became_active":"2024-04-26T10:42:21.405032+0000","last_became_peered":"2024-04-26T10:42:21.405032+0000","last_unstale":"2024-04-26T10:42:26.035065+0000","last_undegraded":"2024-04-26T10:42:26.035065+0000","last_fullsized":"2024-04-26T10:42:26.035065+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033157+0000","last_change":"2024-04-26T10:42:25.686765+0000","last_active":"2024-04-26T10:42:27.033157+0000","last_peered":"2024-04-26T10:42:27.033157+0000","last_clean":"2024-04-26T10:42:27.033157+0000","last_became_active":"2024-04-26T10:42:25.686009+0000","last_became_peered":"2024-04-26T10:42:25.686009+0000","last_unstale":"2024-04-26T10:42:27.033157+0000","last_undegraded":"2024-04-26T10:42:27.033157+0000","last_fullsized":"2024-04-26T10:42:27.033157+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:54.627815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033875+0000","last_change":"2024-04-26T10:42:26.040215+0000","last_active":"2024-04-26T10:42:27.033875+0000","last_peered":"2024-04-26T10:42:27.033875+0000","last_clean":"2024-04-26T10:42:27.033875+0000","last_became_active":"2024-04-26T10:42:26.039129+0000","last_became_peered":"2024-04-26T10:42:26.039129+0000","last_unstale":"2024-04-26T10:42:27.033875+0000","last_undegraded":"2024-04-26T10:42:27.033875+0000","last_fullsized":"2024-04-26T10:42:27.033875+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.035134+0000","last_change":"2024-04-26T10:42:21.406881+0000","last_active":"2024-04-26T10:42:26.035134+0000","last_peered":"2024-04-26T10:42:26.035134+0000","last_clean":"2024-04-26T10:42:26.035134+0000","last_became_active":"2024-04-26T10:42:21.406634+0000","last_became_peered":"2024-04-26T10:42:21.406634+0000","last_unstale":"2024-04-26T10:42:26.035134+0000","last_undegraded":"2024-04-26T10:42:26.035134+0000","last_fullsized":"2024-04-26T10:42:26.035134+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:45.892841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033120+0000","last_change":"2024-04-26T10:42:25.687986+0000","last_active":"2024-04-26T10:42:27.033120+0000","last_peered":"2024-04-26T10:42:27.033120+0000","last_clean":"2024-04-26T10:42:27.033120+0000","last_became_active":"2024-04-26T10:42:25.687201+0000","last_became_peered":"2024-04-26T10:42:25.687201+0000","last_unstale":"2024-04-26T10:42:27.033120+0000","last_undegraded":"2024-04-26T10:42:27.033120+0000","last_fullsized":"2024-04-26T10:42:27.033120+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:35.867262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033630+0000","last_change":"2024-04-26T10:42:26.043723+0000","last_active":"2024-04-26T10:42:27.033630+0000","last_peered":"2024-04-26T10:42:27.033630+0000","last_clean":"2024-04-26T10:42:27.033630+0000","last_became_active":"2024-04-26T10:42:26.041814+0000","last_became_peered":"2024-04-26T10:42:26.041814+0000","last_unstale":"2024-04-26T10:42:27.033630+0000","last_undegraded":"2024-04-26T10:42:27.033630+0000","last_fullsized":"2024-04-26T10:42:27.033630+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.032836+0000","last_change":"2024-04-26T10:42:21.405597+0000","last_active":"2024-04-26T10:42:26.032836+0000","last_peered":"2024-04-26T10:42:26.032836+0000","last_clean":"2024-04-26T10:42:26.032836+0000","last_became_active":"2024-04-26T10:42:21.405117+0000","last_became_peered":"2024-04-26T10:42:21.405117+0000","last_unstale":"2024-04-26T10:42:26.032836+0000","last_undegraded":"2024-04-26T10:42:26.032836+0000","last_fullsized":"2024-04-26T10:42:26.032836+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033005+0000","last_change":"2024-04-26T10:42:25.688955+0000","last_active":"2024-04-26T10:42:27.033005+0000","last_peered":"2024-04-26T10:42:27.033005+0000","last_clean":"2024-04-26T10:42:27.033005+0000","last_became_active":"2024-04-26T10:42:25.688552+0000","last_became_peered":"2024-04-26T10:42:25.688552+0000","last_unstale":"2024-04-26T10:42:27.033005+0000","last_undegraded":"2024-04-26T10:42:27.033005+0000","last_fullsized":"2024-04-26T10:42:27.033005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:04.963775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033758+0000","last_change":"2024-04-26T10:42:26.049311+0000","last_active":"2024-04-26T10:42:27.033758+0000","last_peered":"2024-04-26T10:42:27.033758+0000","last_clean":"2024-04-26T10:42:27.033758+0000","last_became_active":"2024-04-26T10:42:26.048915+0000","last_became_peered":"2024-04-26T10:42:26.048915+0000","last_unstale":"2024-04-26T10:42:27.033758+0000","last_undegraded":"2024-04-26T10:42:27.033758+0000","last_fullsized":"2024-04-26T10:42:27.033758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:01.056945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.034656+0000","last_change":"2024-04-26T10:42:21.405298+0000","last_active":"2024-04-26T10:42:26.034656+0000","last_peered":"2024-04-26T10:42:26.034656+0000","last_clean":"2024-04-26T10:42:26.034656+0000","last_became_active":"2024-04-26T10:42:21.405011+0000","last_became_peered":"2024-04-26T10:42:21.405011+0000","last_unstale":"2024-04-26T10:42:26.034656+0000","last_undegraded":"2024-04-26T10:42:26.034656+0000","last_fullsized":"2024-04-26T10:42:26.034656+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:47.789961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033960+0000","last_change":"2024-04-26T10:42:25.686177+0000","last_active":"2024-04-26T10:42:27.033960+0000","last_peered":"2024-04-26T10:42:27.033960+0000","last_clean":"2024-04-26T10:42:27.033960+0000","last_became_active":"2024-04-26T10:42:25.685121+0000","last_became_peered":"2024-04-26T10:42:25.685121+0000","last_unstale":"2024-04-26T10:42:27.033960+0000","last_undegraded":"2024-04-26T10:42:27.033960+0000","last_fullsized":"2024-04-26T10:42:27.033960+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:34.398138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033614+0000","last_change":"2024-04-26T10:42:26.045312+0000","last_active":"2024-04-26T10:42:27.033614+0000","last_peered":"2024-04-26T10:42:27.033614+0000","last_clean":"2024-04-26T10:42:27.033614+0000","last_became_active":"2024-04-26T10:42:26.044619+0000","last_became_peered":"2024-04-26T10:42:26.044619+0000","last_unstale":"2024-04-26T10:42:27.033614+0000","last_undegraded":"2024-04-26T10:42:27.033614+0000","last_fullsized":"2024-04-26T10:42:27.033614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:50.646374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033966+0000","last_change":"2024-04-26T10:42:25.686310+0000","last_active":"2024-04-26T10:42:27.033966+0000","last_peered":"2024-04-26T10:42:27.033966+0000","last_clean":"2024-04-26T10:42:27.033966+0000","last_became_active":"2024-04-26T10:42:25.685767+0000","last_became_peered":"2024-04-26T10:42:25.685767+0000","last_unstale":"2024-04-26T10:42:27.033966+0000","last_undegraded":"2024-04-26T10:42:27.033966+0000","last_fullsized":"2024-04-26T10:42:27.033966+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:02.874807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.032839+0000","last_change":"2024-04-26T10:42:21.405754+0000","last_active":"2024-04-26T10:42:26.032839+0000","last_peered":"2024-04-26T10:42:26.032839+0000","last_clean":"2024-04-26T10:42:26.032839+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:42:26.032839+0000","last_undegraded":"2024-04-26T10:42:26.032839+0000","last_fullsized":"2024-04-26T10:42:26.032839+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:47.123256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032872+0000","last_change":"2024-04-26T10:42:26.043764+0000","last_active":"2024-04-26T10:42:27.032872+0000","last_peered":"2024-04-26T10:42:27.032872+0000","last_clean":"2024-04-26T10:42:27.032872+0000","last_became_active":"2024-04-26T10:42:26.043388+0000","last_became_peered":"2024-04-26T10:42:26.043388+0000","last_unstale":"2024-04-26T10:42:27.032872+0000","last_undegraded":"2024-04-26T10:42:27.032872+0000","last_fullsized":"2024-04-26T10:42:27.032872+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:31.020364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033601+0000","last_change":"2024-04-26T10:42:25.685368+0000","last_active":"2024-04-26T10:42:27.033601+0000","last_peered":"2024-04-26T10:42:27.033601+0000","last_clean":"2024-04-26T10:42:27.033601+0000","last_became_active":"2024-04-26T10:42:25.684379+0000","last_became_peered":"2024-04-26T10:42:25.684379+0000","last_unstale":"2024-04-26T10:42:27.033601+0000","last_undegraded":"2024-04-26T10:42:27.033601+0000","last_fullsized":"2024-04-26T10:42:27.033601+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:34.398138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.037776+0000","last_change":"2024-04-26T10:42:21.405356+0000","last_active":"2024-04-26T10:42:26.037776+0000","last_peered":"2024-04-26T10:42:26.037776+0000","last_clean":"2024-04-26T10:42:26.037776+0000","last_became_active":"2024-04-26T10:42:21.405006+0000","last_became_peered":"2024-04-26T10:42:21.405006+0000","last_unstale":"2024-04-26T10:42:26.037776+0000","last_undegraded":"2024-04-26T10:42:26.037776+0000","last_fullsized":"2024-04-26T10:42:26.037776+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:55.043967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033128+0000","last_change":"2024-04-26T10:42:26.042954+0000","last_active":"2024-04-26T10:42:27.033128+0000","last_peered":"2024-04-26T10:42:27.033128+0000","last_clean":"2024-04-26T10:42:27.033128+0000","last_became_active":"2024-04-26T10:42:26.042544+0000","last_became_peered":"2024-04-26T10:42:26.042544+0000","last_unstale":"2024-04-26T10:42:27.033128+0000","last_undegraded":"2024-04-26T10:42:27.033128+0000","last_fullsized":"2024-04-26T10:42:27.033128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:14.041039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033915+0000","last_change":"2024-04-26T10:42:25.687201+0000","last_active":"2024-04-26T10:42:27.033915+0000","last_peered":"2024-04-26T10:42:27.033915+0000","last_clean":"2024-04-26T10:42:27.033915+0000","last_became_active":"2024-04-26T10:42:25.686641+0000","last_became_peered":"2024-04-26T10:42:25.686641+0000","last_unstale":"2024-04-26T10:42:27.033915+0000","last_undegraded":"2024-04-26T10:42:27.033915+0000","last_fullsized":"2024-04-26T10:42:27.033915+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:30.225098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.033642+0000","last_change":"2024-04-26T10:42:21.405615+0000","last_active":"2024-04-26T10:42:26.033642+0000","last_peered":"2024-04-26T10:42:26.033642+0000","last_clean":"2024-04-26T10:42:26.033642+0000","last_became_active":"2024-04-26T10:42:21.405184+0000","last_became_peered":"2024-04-26T10:42:21.405184+0000","last_unstale":"2024-04-26T10:42:26.033642+0000","last_undegraded":"2024-04-26T10:42:26.033642+0000","last_fullsized":"2024-04-26T10:42:26.033642+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:52.378909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032862+0000","last_change":"2024-04-26T10:42:26.046832+0000","last_active":"2024-04-26T10:42:27.032862+0000","last_peered":"2024-04-26T10:42:27.032862+0000","last_clean":"2024-04-26T10:42:27.032862+0000","last_became_active":"2024-04-26T10:42:26.046484+0000","last_became_peered":"2024-04-26T10:42:26.046484+0000","last_unstale":"2024-04-26T10:42:27.032862+0000","last_undegraded":"2024-04-26T10:42:27.032862+0000","last_fullsized":"2024-04-26T10:42:27.032862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:28.856785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652287+0000","last_change":"2024-04-26T10:42:25.686262+0000","last_active":"2024-04-26T10:42:29.652287+0000","last_peered":"2024-04-26T10:42:29.652287+0000","last_clean":"2024-04-26T10:42:29.652287+0000","last_became_active":"2024-04-26T10:42:25.685528+0000","last_became_peered":"2024-04-26T10:42:25.685528+0000","last_unstale":"2024-04-26T10:42:29.652287+0000","last_undegraded":"2024-04-26T10:42:29.652287+0000","last_fullsized":"2024-04-26T10:42:29.652287+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:47.138273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.035316+0000","last_change":"2024-04-26T10:42:21.405863+0000","last_active":"2024-04-26T10:42:26.035316+0000","last_peered":"2024-04-26T10:42:26.035316+0000","last_clean":"2024-04-26T10:42:26.035316+0000","last_became_active":"2024-04-26T10:42:21.405555+0000","last_became_peered":"2024-04-26T10:42:21.405555+0000","last_unstale":"2024-04-26T10:42:26.035316+0000","last_undegraded":"2024-04-26T10:42:26.035316+0000","last_fullsized":"2024-04-26T10:42:26.035316+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:39.259618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032766+0000","last_change":"2024-04-26T10:42:26.044818+0000","last_active":"2024-04-26T10:42:27.032766+0000","last_peered":"2024-04-26T10:42:27.032766+0000","last_clean":"2024-04-26T10:42:27.032766+0000","last_became_active":"2024-04-26T10:42:26.043969+0000","last_became_peered":"2024-04-26T10:42:26.043969+0000","last_unstale":"2024-04-26T10:42:27.032766+0000","last_undegraded":"2024-04-26T10:42:27.032766+0000","last_fullsized":"2024-04-26T10:42:27.032766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:50.646374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033819+0000","last_change":"2024-04-26T10:42:26.040224+0000","last_active":"2024-04-26T10:42:27.033819+0000","last_peered":"2024-04-26T10:42:27.033819+0000","last_clean":"2024-04-26T10:42:27.033819+0000","last_became_active":"2024-04-26T10:42:26.038590+0000","last_became_peered":"2024-04-26T10:42:26.038590+0000","last_unstale":"2024-04-26T10:42:27.033819+0000","last_undegraded":"2024-04-26T10:42:27.033819+0000","last_fullsized":"2024-04-26T10:42:27.033819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033865+0000","last_change":"2024-04-26T10:42:25.684447+0000","last_active":"2024-04-26T10:42:27.033865+0000","last_peered":"2024-04-26T10:42:27.033865+0000","last_clean":"2024-04-26T10:42:27.033865+0000","last_became_active":"2024-04-26T10:42:25.684147+0000","last_became_peered":"2024-04-26T10:42:25.684147+0000","last_unstale":"2024-04-26T10:42:27.033865+0000","last_undegraded":"2024-04-26T10:42:27.033865+0000","last_fullsized":"2024-04-26T10:42:27.033865+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:38.873282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032960+0000","last_change":"2024-04-26T10:42:26.045459+0000","last_active":"2024-04-26T10:42:27.032960+0000","last_peered":"2024-04-26T10:42:27.032960+0000","last_clean":"2024-04-26T10:42:27.032960+0000","last_became_active":"2024-04-26T10:42:26.044972+0000","last_became_peered":"2024-04-26T10:42:26.044972+0000","last_unstale":"2024-04-26T10:42:27.032960+0000","last_undegraded":"2024-04-26T10:42:27.032960+0000","last_fullsized":"2024-04-26T10:42:27.032960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033920+0000","last_change":"2024-04-26T10:42:25.687956+0000","last_active":"2024-04-26T10:42:27.033920+0000","last_peered":"2024-04-26T10:42:27.033920+0000","last_clean":"2024-04-26T10:42:27.033920+0000","last_became_active":"2024-04-26T10:42:25.687533+0000","last_became_peered":"2024-04-26T10:42:25.687533+0000","last_unstale":"2024-04-26T10:42:27.033920+0000","last_undegraded":"2024-04-26T10:42:27.033920+0000","last_fullsized":"2024-04-26T10:42:27.033920+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:28.506897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033679+0000","last_change":"2024-04-26T10:42:25.685829+0000","last_active":"2024-04-26T10:42:27.033679+0000","last_peered":"2024-04-26T10:42:27.033679+0000","last_clean":"2024-04-26T10:42:27.033679+0000","last_became_active":"2024-04-26T10:42:25.685307+0000","last_became_peered":"2024-04-26T10:42:25.685307+0000","last_unstale":"2024-04-26T10:42:27.033679+0000","last_undegraded":"2024-04-26T10:42:27.033679+0000","last_fullsized":"2024-04-26T10:42:27.033679+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032933+0000","last_change":"2024-04-26T10:42:26.046196+0000","last_active":"2024-04-26T10:42:27.032933+0000","last_peered":"2024-04-26T10:42:27.032933+0000","last_clean":"2024-04-26T10:42:27.032933+0000","last_became_active":"2024-04-26T10:42:26.045762+0000","last_became_peered":"2024-04-26T10:42:26.045762+0000","last_unstale":"2024-04-26T10:42:27.032933+0000","last_undegraded":"2024-04-26T10:42:27.032933+0000","last_fullsized":"2024-04-26T10:42:27.032933+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033848+0000","last_change":"2024-04-26T10:42:25.685990+0000","last_active":"2024-04-26T10:42:27.033848+0000","last_peered":"2024-04-26T10:42:27.033848+0000","last_clean":"2024-04-26T10:42:27.033848+0000","last_became_active":"2024-04-26T10:42:25.684604+0000","last_became_peered":"2024-04-26T10:42:25.684604+0000","last_unstale":"2024-04-26T10:42:27.033848+0000","last_undegraded":"2024-04-26T10:42:27.033848+0000","last_fullsized":"2024-04-26T10:42:27.033848+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:02.874807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032830+0000","last_change":"2024-04-26T10:42:26.038545+0000","last_active":"2024-04-26T10:42:27.032830+0000","last_peered":"2024-04-26T10:42:27.032830+0000","last_clean":"2024-04-26T10:42:27.032830+0000","last_became_active":"2024-04-26T10:42:26.038099+0000","last_became_peered":"2024-04-26T10:42:26.038099+0000","last_unstale":"2024-04-26T10:42:27.032830+0000","last_undegraded":"2024-04-26T10:42:27.032830+0000","last_fullsized":"2024-04-26T10:42:27.032830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033882+0000","last_change":"2024-04-26T10:42:26.046506+0000","last_active":"2024-04-26T10:42:27.033882+0000","last_peered":"2024-04-26T10:42:27.033882+0000","last_clean":"2024-04-26T10:42:27.033882+0000","last_became_active":"2024-04-26T10:42:26.045904+0000","last_became_peered":"2024-04-26T10:42:26.045904+0000","last_unstale":"2024-04-26T10:42:27.033882+0000","last_undegraded":"2024-04-26T10:42:27.033882+0000","last_fullsized":"2024-04-26T10:42:27.033882+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:49.854080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032971+0000","last_change":"2024-04-26T10:42:25.683890+0000","last_active":"2024-04-26T10:42:27.032971+0000","last_peered":"2024-04-26T10:42:27.032971+0000","last_clean":"2024-04-26T10:42:27.032971+0000","last_became_active":"2024-04-26T10:42:25.683467+0000","last_became_peered":"2024-04-26T10:42:25.683467+0000","last_unstale":"2024-04-26T10:42:27.032971+0000","last_undegraded":"2024-04-26T10:42:27.032971+0000","last_fullsized":"2024-04-26T10:42:27.032971+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033657+0000","last_change":"2024-04-26T10:42:26.046384+0000","last_active":"2024-04-26T10:42:27.033657+0000","last_peered":"2024-04-26T10:42:27.033657+0000","last_clean":"2024-04-26T10:42:27.033657+0000","last_became_active":"2024-04-26T10:42:26.045860+0000","last_became_peered":"2024-04-26T10:42:26.045860+0000","last_unstale":"2024-04-26T10:42:27.033657+0000","last_undegraded":"2024-04-26T10:42:27.033657+0000","last_fullsized":"2024-04-26T10:42:27.033657+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033002+0000","last_change":"2024-04-26T10:42:25.686972+0000","last_active":"2024-04-26T10:42:27.033002+0000","last_peered":"2024-04-26T10:42:27.033002+0000","last_clean":"2024-04-26T10:42:27.033002+0000","last_became_active":"2024-04-26T10:42:25.685903+0000","last_became_peered":"2024-04-26T10:42:25.685903+0000","last_unstale":"2024-04-26T10:42:27.033002+0000","last_undegraded":"2024-04-26T10:42:27.033002+0000","last_fullsized":"2024-04-26T10:42:27.033002+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:43.969731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033703+0000","last_change":"2024-04-26T10:42:26.046515+0000","last_active":"2024-04-26T10:42:27.033703+0000","last_peered":"2024-04-26T10:42:27.033703+0000","last_clean":"2024-04-26T10:42:27.033703+0000","last_became_active":"2024-04-26T10:42:26.045798+0000","last_became_peered":"2024-04-26T10:42:26.045798+0000","last_unstale":"2024-04-26T10:42:27.033703+0000","last_undegraded":"2024-04-26T10:42:27.033703+0000","last_fullsized":"2024-04-26T10:42:27.033703+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:28.856785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033066+0000","last_change":"2024-04-26T10:42:25.688221+0000","last_active":"2024-04-26T10:42:27.033066+0000","last_peered":"2024-04-26T10:42:27.033066+0000","last_clean":"2024-04-26T10:42:27.033066+0000","last_became_active":"2024-04-26T10:42:25.687829+0000","last_became_peered":"2024-04-26T10:42:25.687829+0000","last_unstale":"2024-04-26T10:42:27.033066+0000","last_undegraded":"2024-04-26T10:42:27.033066+0000","last_fullsized":"2024-04-26T10:42:27.033066+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:05.939715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033363+0000","last_change":"2024-04-26T10:42:26.042723+0000","last_active":"2024-04-26T10:42:27.033363+0000","last_peered":"2024-04-26T10:42:27.033363+0000","last_clean":"2024-04-26T10:42:27.033363+0000","last_became_active":"2024-04-26T10:42:26.041852+0000","last_became_peered":"2024-04-26T10:42:26.041852+0000","last_unstale":"2024-04-26T10:42:27.033363+0000","last_undegraded":"2024-04-26T10:42:27.033363+0000","last_fullsized":"2024-04-26T10:42:27.033363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033492+0000","last_change":"2024-04-26T10:42:25.688815+0000","last_active":"2024-04-26T10:42:27.033492+0000","last_peered":"2024-04-26T10:42:27.033492+0000","last_clean":"2024-04-26T10:42:27.033492+0000","last_became_active":"2024-04-26T10:42:25.688451+0000","last_became_peered":"2024-04-26T10:42:25.688451+0000","last_unstale":"2024-04-26T10:42:27.033492+0000","last_undegraded":"2024-04-26T10:42:27.033492+0000","last_fullsized":"2024-04-26T10:42:27.033492+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:17.143923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033256+0000","last_change":"2024-04-26T10:42:26.044040+0000","last_active":"2024-04-26T10:42:27.033256+0000","last_peered":"2024-04-26T10:42:27.033256+0000","last_clean":"2024-04-26T10:42:27.033256+0000","last_became_active":"2024-04-26T10:42:26.042629+0000","last_became_peered":"2024-04-26T10:42:26.042629+0000","last_unstale":"2024-04-26T10:42:27.033256+0000","last_undegraded":"2024-04-26T10:42:27.033256+0000","last_fullsized":"2024-04-26T10:42:27.033256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:23:05.308070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033778+0000","last_change":"2024-04-26T10:42:25.686442+0000","last_active":"2024-04-26T10:42:27.033778+0000","last_peered":"2024-04-26T10:42:27.033778+0000","last_clean":"2024-04-26T10:42:27.033778+0000","last_became_active":"2024-04-26T10:42:25.686029+0000","last_became_peered":"2024-04-26T10:42:25.686029+0000","last_unstale":"2024-04-26T10:42:27.033778+0000","last_undegraded":"2024-04-26T10:42:27.033778+0000","last_fullsized":"2024-04-26T10:42:27.033778+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:04.241132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033516+0000","last_change":"2024-04-26T10:42:26.042561+0000","last_active":"2024-04-26T10:42:27.033516+0000","last_peered":"2024-04-26T10:42:27.033516+0000","last_clean":"2024-04-26T10:42:27.033516+0000","last_became_active":"2024-04-26T10:42:26.041751+0000","last_became_peered":"2024-04-26T10:42:26.041751+0000","last_unstale":"2024-04-26T10:42:27.033516+0000","last_undegraded":"2024-04-26T10:42:27.033516+0000","last_fullsized":"2024-04-26T10:42:27.033516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033819+0000","last_change":"2024-04-26T10:42:25.687977+0000","last_active":"2024-04-26T10:42:27.033819+0000","last_peered":"2024-04-26T10:42:27.033819+0000","last_clean":"2024-04-26T10:42:27.033819+0000","last_became_active":"2024-04-26T10:42:25.687402+0000","last_became_peered":"2024-04-26T10:42:25.687402+0000","last_unstale":"2024-04-26T10:42:27.033819+0000","last_undegraded":"2024-04-26T10:42:27.033819+0000","last_fullsized":"2024-04-26T10:42:27.033819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:35.867262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033076+0000","last_change":"2024-04-26T10:42:26.041729+0000","last_active":"2024-04-26T10:42:27.033076+0000","last_peered":"2024-04-26T10:42:27.033076+0000","last_clean":"2024-04-26T10:42:27.033076+0000","last_became_active":"2024-04-26T10:42:26.040504+0000","last_became_peered":"2024-04-26T10:42:26.040504+0000","last_unstale":"2024-04-26T10:42:27.033076+0000","last_undegraded":"2024-04-26T10:42:27.033076+0000","last_fullsized":"2024-04-26T10:42:27.033076+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033769+0000","last_change":"2024-04-26T10:42:25.686861+0000","last_active":"2024-04-26T10:42:27.033769+0000","last_peered":"2024-04-26T10:42:27.033769+0000","last_clean":"2024-04-26T10:42:27.033769+0000","last_became_active":"2024-04-26T10:42:25.686149+0000","last_became_peered":"2024-04-26T10:42:25.686149+0000","last_unstale":"2024-04-26T10:42:27.033769+0000","last_undegraded":"2024-04-26T10:42:27.033769+0000","last_fullsized":"2024-04-26T10:42:27.033769+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:42.125386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033053+0000","last_change":"2024-04-26T10:42:26.045324+0000","last_active":"2024-04-26T10:42:27.033053+0000","last_peered":"2024-04-26T10:42:27.033053+0000","last_clean":"2024-04-26T10:42:27.033053+0000","last_became_active":"2024-04-26T10:42:26.044454+0000","last_became_peered":"2024-04-26T10:42:26.044454+0000","last_unstale":"2024-04-26T10:42:27.033053+0000","last_undegraded":"2024-04-26T10:42:27.033053+0000","last_fullsized":"2024-04-26T10:42:27.033053+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033768+0000","last_change":"2024-04-26T10:42:25.685528+0000","last_active":"2024-04-26T10:42:27.033768+0000","last_peered":"2024-04-26T10:42:27.033768+0000","last_clean":"2024-04-26T10:42:27.033768+0000","last_became_active":"2024-04-26T10:42:25.684508+0000","last_became_peered":"2024-04-26T10:42:25.684508+0000","last_unstale":"2024-04-26T10:42:27.033768+0000","last_undegraded":"2024-04-26T10:42:27.033768+0000","last_fullsized":"2024-04-26T10:42:27.033768+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.850118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31264,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340576,"statfs":{"total":96636764160,"available":96604749824,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35952,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335888,"statfs":{"total":96636764160,"available":96599949312,"internally_reserved":0,"allocated":749568,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:42:44.790 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:42:45.122 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:45.124 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:42:45.133 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-26T10:42:43.595787+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94984,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283020536,"statfs":{"total":289910292480,"available":289813028864,"internally_reserved":0,"allocated":1646592,"data_stored":1323601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002327"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033761+0000","last_change":"2024-04-26T10:42:26.045527+0000","last_active":"2024-04-26T10:42:27.033761+0000","last_peered":"2024-04-26T10:42:27.033761+0000","last_clean":"2024-04-26T10:42:27.033761+0000","last_became_active":"2024-04-26T10:42:26.044597+0000","last_became_peered":"2024-04-26T10:42:26.044597+0000","last_unstale":"2024-04-26T10:42:27.033761+0000","last_undegraded":"2024-04-26T10:42:27.033761+0000","last_fullsized":"2024-04-26T10:42:27.033761+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033531+0000","last_change":"2024-04-26T10:42:26.043815+0000","last_active":"2024-04-26T10:42:27.033531+0000","last_peered":"2024-04-26T10:42:27.033531+0000","last_clean":"2024-04-26T10:42:27.033531+0000","last_became_active":"2024-04-26T10:42:26.042757+0000","last_became_peered":"2024-04-26T10:42:26.042757+0000","last_unstale":"2024-04-26T10:42:27.033531+0000","last_undegraded":"2024-04-26T10:42:27.033531+0000","last_fullsized":"2024-04-26T10:42:27.033531+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:27.752674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033378+0000","last_change":"2024-04-26T10:42:26.041030+0000","last_active":"2024-04-26T10:42:27.033378+0000","last_peered":"2024-04-26T10:42:27.033378+0000","last_clean":"2024-04-26T10:42:27.033378+0000","last_became_active":"2024-04-26T10:42:26.039762+0000","last_became_peered":"2024-04-26T10:42:26.039762+0000","last_unstale":"2024-04-26T10:42:27.033378+0000","last_undegraded":"2024-04-26T10:42:27.033378+0000","last_fullsized":"2024-04-26T10:42:27.033378+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033311+0000","last_change":"2024-04-26T10:42:26.044004+0000","last_active":"2024-04-26T10:42:27.033311+0000","last_peered":"2024-04-26T10:42:27.033311+0000","last_clean":"2024-04-26T10:42:27.033311+0000","last_became_active":"2024-04-26T10:42:26.042953+0000","last_became_peered":"2024-04-26T10:42:26.042953+0000","last_unstale":"2024-04-26T10:42:27.033311+0000","last_undegraded":"2024-04-26T10:42:27.033311+0000","last_fullsized":"2024-04-26T10:42:27.033311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.895922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033277+0000","last_change":"2024-04-26T10:42:26.041191+0000","last_active":"2024-04-26T10:42:27.033277+0000","last_peered":"2024-04-26T10:42:27.033277+0000","last_clean":"2024-04-26T10:42:27.033277+0000","last_became_active":"2024-04-26T10:42:26.040487+0000","last_became_peered":"2024-04-26T10:42:26.040487+0000","last_unstale":"2024-04-26T10:42:27.033277+0000","last_undegraded":"2024-04-26T10:42:27.033277+0000","last_fullsized":"2024-04-26T10:42:27.033277+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032976+0000","last_change":"2024-04-26T10:42:26.043542+0000","last_active":"2024-04-26T10:42:27.032976+0000","last_peered":"2024-04-26T10:42:27.032976+0000","last_clean":"2024-04-26T10:42:27.032976+0000","last_became_active":"2024-04-26T10:42:26.042631+0000","last_became_peered":"2024-04-26T10:42:26.042631+0000","last_unstale":"2024-04-26T10:42:27.032976+0000","last_undegraded":"2024-04-26T10:42:27.032976+0000","last_fullsized":"2024-04-26T10:42:27.032976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:38.272126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033024+0000","last_change":"2024-04-26T10:42:26.042698+0000","last_active":"2024-04-26T10:42:27.033024+0000","last_peered":"2024-04-26T10:42:27.033024+0000","last_clean":"2024-04-26T10:42:27.033024+0000","last_became_active":"2024-04-26T10:42:26.041631+0000","last_became_peered":"2024-04-26T10:42:26.041631+0000","last_unstale":"2024-04-26T10:42:27.033024+0000","last_undegraded":"2024-04-26T10:42:27.033024+0000","last_fullsized":"2024-04-26T10:42:27.033024+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:27.752674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032694+0000","last_change":"2024-04-26T10:42:26.045497+0000","last_active":"2024-04-26T10:42:27.032694+0000","last_peered":"2024-04-26T10:42:27.032694+0000","last_clean":"2024-04-26T10:42:27.032694+0000","last_became_active":"2024-04-26T10:42:26.044865+0000","last_became_peered":"2024-04-26T10:42:26.044865+0000","last_unstale":"2024-04-26T10:42:27.032694+0000","last_undegraded":"2024-04-26T10:42:27.032694+0000","last_fullsized":"2024-04-26T10:42:27.032694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:59:04.853293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033544+0000","last_change":"2024-04-26T10:42:26.045893+0000","last_active":"2024-04-26T10:42:27.033544+0000","last_peered":"2024-04-26T10:42:27.033544+0000","last_clean":"2024-04-26T10:42:27.033544+0000","last_became_active":"2024-04-26T10:42:26.045177+0000","last_became_peered":"2024-04-26T10:42:26.045177+0000","last_unstale":"2024-04-26T10:42:27.033544+0000","last_undegraded":"2024-04-26T10:42:27.033544+0000","last_fullsized":"2024-04-26T10:42:27.033544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033494+0000","last_change":"2024-04-26T10:42:26.044101+0000","last_active":"2024-04-26T10:42:27.033494+0000","last_peered":"2024-04-26T10:42:27.033494+0000","last_clean":"2024-04-26T10:42:27.033494+0000","last_became_active":"2024-04-26T10:42:26.042047+0000","last_became_peered":"2024-04-26T10:42:26.042047+0000","last_unstale":"2024-04-26T10:42:27.033494+0000","last_undegraded":"2024-04-26T10:42:27.033494+0000","last_fullsized":"2024-04-26T10:42:27.033494+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:46.975947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033560+0000","last_change":"2024-04-26T10:42:26.043530+0000","last_active":"2024-04-26T10:42:27.033560+0000","last_peered":"2024-04-26T10:42:27.033560+0000","last_clean":"2024-04-26T10:42:27.033560+0000","last_became_active":"2024-04-26T10:42:26.042301+0000","last_became_peered":"2024-04-26T10:42:26.042301+0000","last_unstale":"2024-04-26T10:42:27.033560+0000","last_undegraded":"2024-04-26T10:42:27.033560+0000","last_fullsized":"2024-04-26T10:42:27.033560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:48.440963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033166+0000","last_change":"2024-04-26T10:42:26.047073+0000","last_active":"2024-04-26T10:42:27.033166+0000","last_peered":"2024-04-26T10:42:27.033166+0000","last_clean":"2024-04-26T10:42:27.033166+0000","last_became_active":"2024-04-26T10:42:26.046384+0000","last_became_peered":"2024-04-26T10:42:26.046384+0000","last_unstale":"2024-04-26T10:42:27.033166+0000","last_undegraded":"2024-04-26T10:42:27.033166+0000","last_fullsized":"2024-04-26T10:42:27.033166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:23.079349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032981+0000","last_change":"2024-04-26T10:42:26.042607+0000","last_active":"2024-04-26T10:42:27.032981+0000","last_peered":"2024-04-26T10:42:27.032981+0000","last_clean":"2024-04-26T10:42:27.032981+0000","last_became_active":"2024-04-26T10:42:26.041617+0000","last_became_peered":"2024-04-26T10:42:26.041617+0000","last_unstale":"2024-04-26T10:42:27.032981+0000","last_undegraded":"2024-04-26T10:42:27.032981+0000","last_fullsized":"2024-04-26T10:42:27.032981+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033143+0000","last_change":"2024-04-26T10:42:26.040433+0000","last_active":"2024-04-26T10:42:27.033143+0000","last_peered":"2024-04-26T10:42:27.033143+0000","last_clean":"2024-04-26T10:42:27.033143+0000","last_became_active":"2024-04-26T10:42:26.039631+0000","last_became_peered":"2024-04-26T10:42:26.039631+0000","last_unstale":"2024-04-26T10:42:27.033143+0000","last_undegraded":"2024-04-26T10:42:27.033143+0000","last_fullsized":"2024-04-26T10:42:27.033143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033116+0000","last_change":"2024-04-26T10:42:26.040182+0000","last_active":"2024-04-26T10:42:27.033116+0000","last_peered":"2024-04-26T10:42:27.033116+0000","last_clean":"2024-04-26T10:42:27.033116+0000","last_became_active":"2024-04-26T10:42:26.038614+0000","last_became_peered":"2024-04-26T10:42:26.038614+0000","last_unstale":"2024-04-26T10:42:27.033116+0000","last_undegraded":"2024-04-26T10:42:27.033116+0000","last_fullsized":"2024-04-26T10:42:27.033116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032762+0000","last_change":"2024-04-26T10:42:26.045551+0000","last_active":"2024-04-26T10:42:27.032762+0000","last_peered":"2024-04-26T10:42:27.032762+0000","last_clean":"2024-04-26T10:42:27.032762+0000","last_became_active":"2024-04-26T10:42:26.044944+0000","last_became_peered":"2024-04-26T10:42:26.044944+0000","last_unstale":"2024-04-26T10:42:27.032762+0000","last_undegraded":"2024-04-26T10:42:27.032762+0000","last_fullsized":"2024-04-26T10:42:27.032762+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:02.194279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033885+0000","last_change":"2024-04-26T10:42:26.049338+0000","last_active":"2024-04-26T10:42:27.033885+0000","last_peered":"2024-04-26T10:42:27.033885+0000","last_clean":"2024-04-26T10:42:27.033885+0000","last_became_active":"2024-04-26T10:42:26.049014+0000","last_became_peered":"2024-04-26T10:42:26.049014+0000","last_unstale":"2024-04-26T10:42:27.033885+0000","last_undegraded":"2024-04-26T10:42:27.033885+0000","last_fullsized":"2024-04-26T10:42:27.033885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033767+0000","last_change":"2024-04-26T10:42:26.043604+0000","last_active":"2024-04-26T10:42:27.033767+0000","last_peered":"2024-04-26T10:42:27.033767+0000","last_clean":"2024-04-26T10:42:27.033767+0000","last_became_active":"2024-04-26T10:42:26.041224+0000","last_became_peered":"2024-04-26T10:42:26.041224+0000","last_unstale":"2024-04-26T10:42:27.033767+0000","last_undegraded":"2024-04-26T10:42:27.033767+0000","last_fullsized":"2024-04-26T10:42:27.033767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033328+0000","last_change":"2024-04-26T10:42:26.045031+0000","last_active":"2024-04-26T10:42:27.033328+0000","last_peered":"2024-04-26T10:42:27.033328+0000","last_clean":"2024-04-26T10:42:27.033328+0000","last_became_active":"2024-04-26T10:42:26.044604+0000","last_became_peered":"2024-04-26T10:42:26.044604+0000","last_unstale":"2024-04-26T10:42:27.033328+0000","last_undegraded":"2024-04-26T10:42:27.033328+0000","last_fullsized":"2024-04-26T10:42:27.033328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033728+0000","last_change":"2024-04-26T10:42:26.043762+0000","last_active":"2024-04-26T10:42:27.033728+0000","last_peered":"2024-04-26T10:42:27.033728+0000","last_clean":"2024-04-26T10:42:27.033728+0000","last_became_active":"2024-04-26T10:42:26.042117+0000","last_became_peered":"2024-04-26T10:42:26.042117+0000","last_unstale":"2024-04-26T10:42:27.033728+0000","last_undegraded":"2024-04-26T10:42:27.033728+0000","last_fullsized":"2024-04-26T10:42:27.033728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:35.276961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033416+0000","last_change":"2024-04-26T10:42:26.044062+0000","last_active":"2024-04-26T10:42:27.033416+0000","last_peered":"2024-04-26T10:42:27.033416+0000","last_clean":"2024-04-26T10:42:27.033416+0000","last_became_active":"2024-04-26T10:42:26.042378+0000","last_became_peered":"2024-04-26T10:42:26.042378+0000","last_unstale":"2024-04-26T10:42:27.033416+0000","last_undegraded":"2024-04-26T10:42:27.033416+0000","last_fullsized":"2024-04-26T10:42:27.033416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:24.255706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032809+0000","last_change":"2024-04-26T10:42:26.046353+0000","last_active":"2024-04-26T10:42:27.032809+0000","last_peered":"2024-04-26T10:42:27.032809+0000","last_clean":"2024-04-26T10:42:27.032809+0000","last_became_active":"2024-04-26T10:42:26.045614+0000","last_became_peered":"2024-04-26T10:42:26.045614+0000","last_unstale":"2024-04-26T10:42:27.032809+0000","last_undegraded":"2024-04-26T10:42:27.032809+0000","last_fullsized":"2024-04-26T10:42:27.032809+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:19.601720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032687+0000","last_change":"2024-04-26T10:42:26.045311+0000","last_active":"2024-04-26T10:42:27.032687+0000","last_peered":"2024-04-26T10:42:27.032687+0000","last_clean":"2024-04-26T10:42:27.032687+0000","last_became_active":"2024-04-26T10:42:26.044614+0000","last_became_peered":"2024-04-26T10:42:26.044614+0000","last_unstale":"2024-04-26T10:42:27.032687+0000","last_undegraded":"2024-04-26T10:42:27.032687+0000","last_fullsized":"2024-04-26T10:42:27.032687+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032624+0000","last_change":"2024-04-26T10:42:26.043614+0000","last_active":"2024-04-26T10:42:27.032624+0000","last_peered":"2024-04-26T10:42:27.032624+0000","last_clean":"2024-04-26T10:42:27.032624+0000","last_became_active":"2024-04-26T10:42:26.042629+0000","last_became_peered":"2024-04-26T10:42:26.042629+0000","last_unstale":"2024-04-26T10:42:27.032624+0000","last_undegraded":"2024-04-26T10:42:27.032624+0000","last_fullsized":"2024-04-26T10:42:27.032624+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033909+0000","last_change":"2024-04-26T10:42:26.046876+0000","last_active":"2024-04-26T10:42:27.033909+0000","last_peered":"2024-04-26T10:42:27.033909+0000","last_clean":"2024-04-26T10:42:27.033909+0000","last_became_active":"2024-04-26T10:42:26.046177+0000","last_became_peered":"2024-04-26T10:42:26.046177+0000","last_unstale":"2024-04-26T10:42:27.033909+0000","last_undegraded":"2024-04-26T10:42:27.033909+0000","last_fullsized":"2024-04-26T10:42:27.033909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:51.567162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033546+0000","last_change":"2024-04-26T10:42:26.044190+0000","last_active":"2024-04-26T10:42:27.033546+0000","last_peered":"2024-04-26T10:42:27.033546+0000","last_clean":"2024-04-26T10:42:27.033546+0000","last_became_active":"2024-04-26T10:42:26.043736+0000","last_became_peered":"2024-04-26T10:42:26.043736+0000","last_unstale":"2024-04-26T10:42:27.033546+0000","last_undegraded":"2024-04-26T10:42:27.033546+0000","last_fullsized":"2024-04-26T10:42:27.033546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033729+0000","last_change":"2024-04-26T10:42:26.041008+0000","last_active":"2024-04-26T10:42:27.033729+0000","last_peered":"2024-04-26T10:42:27.033729+0000","last_clean":"2024-04-26T10:42:27.033729+0000","last_became_active":"2024-04-26T10:42:26.039620+0000","last_became_peered":"2024-04-26T10:42:26.039620+0000","last_unstale":"2024-04-26T10:42:27.033729+0000","last_undegraded":"2024-04-26T10:42:27.033729+0000","last_fullsized":"2024-04-26T10:42:27.033729+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033575+0000","last_change":"2024-04-26T10:42:26.046392+0000","last_active":"2024-04-26T10:42:27.033575+0000","last_peered":"2024-04-26T10:42:27.033575+0000","last_clean":"2024-04-26T10:42:27.033575+0000","last_became_active":"2024-04-26T10:42:26.045806+0000","last_became_peered":"2024-04-26T10:42:26.045806+0000","last_unstale":"2024-04-26T10:42:27.033575+0000","last_undegraded":"2024-04-26T10:42:27.033575+0000","last_fullsized":"2024-04-26T10:42:27.033575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:15:59.087635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033383+0000","last_change":"2024-04-26T10:42:26.045205+0000","last_active":"2024-04-26T10:42:27.033383+0000","last_peered":"2024-04-26T10:42:27.033383+0000","last_clean":"2024-04-26T10:42:27.033383+0000","last_became_active":"2024-04-26T10:42:26.044762+0000","last_became_peered":"2024-04-26T10:42:26.044762+0000","last_unstale":"2024-04-26T10:42:27.033383+0000","last_undegraded":"2024-04-26T10:42:27.033383+0000","last_fullsized":"2024-04-26T10:42:27.033383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033051+0000","last_change":"2024-04-26T10:42:26.046020+0000","last_active":"2024-04-26T10:42:27.033051+0000","last_peered":"2024-04-26T10:42:27.033051+0000","last_clean":"2024-04-26T10:42:27.033051+0000","last_became_active":"2024-04-26T10:42:26.045567+0000","last_became_peered":"2024-04-26T10:42:26.045567+0000","last_unstale":"2024-04-26T10:42:27.033051+0000","last_undegraded":"2024-04-26T10:42:27.033051+0000","last_fullsized":"2024-04-26T10:42:27.033051+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:53.380329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032770+0000","last_change":"2024-04-26T10:42:26.046584+0000","last_active":"2024-04-26T10:42:27.032770+0000","last_peered":"2024-04-26T10:42:27.032770+0000","last_clean":"2024-04-26T10:42:27.032770+0000","last_became_active":"2024-04-26T10:42:26.046231+0000","last_became_peered":"2024-04-26T10:42:26.046231+0000","last_unstale":"2024-04-26T10:42:27.032770+0000","last_undegraded":"2024-04-26T10:42:27.032770+0000","last_fullsized":"2024-04-26T10:42:27.032770+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032953+0000","last_change":"2024-04-26T10:42:26.045270+0000","last_active":"2024-04-26T10:42:27.032953+0000","last_peered":"2024-04-26T10:42:27.032953+0000","last_clean":"2024-04-26T10:42:27.032953+0000","last_became_active":"2024-04-26T10:42:26.044341+0000","last_became_peered":"2024-04-26T10:42:26.044341+0000","last_unstale":"2024-04-26T10:42:27.032953+0000","last_undegraded":"2024-04-26T10:42:27.032953+0000","last_fullsized":"2024-04-26T10:42:27.032953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:46.975947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033573+0000","last_change":"2024-04-26T10:42:26.041757+0000","last_active":"2024-04-26T10:42:27.033573+0000","last_peered":"2024-04-26T10:42:27.033573+0000","last_clean":"2024-04-26T10:42:27.033573+0000","last_became_active":"2024-04-26T10:42:26.040920+0000","last_became_peered":"2024-04-26T10:42:26.040920+0000","last_unstale":"2024-04-26T10:42:27.033573+0000","last_undegraded":"2024-04-26T10:42:27.033573+0000","last_fullsized":"2024-04-26T10:42:27.033573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033905+0000","last_change":"2024-04-26T10:42:25.687138+0000","last_active":"2024-04-26T10:42:27.033905+0000","last_peered":"2024-04-26T10:42:27.033905+0000","last_clean":"2024-04-26T10:42:27.033905+0000","last_became_active":"2024-04-26T10:42:25.686488+0000","last_became_peered":"2024-04-26T10:42:25.686488+0000","last_unstale":"2024-04-26T10:42:27.033905+0000","last_undegraded":"2024-04-26T10:42:27.033905+0000","last_fullsized":"2024-04-26T10:42:27.033905+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:43.969731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033779+0000","last_change":"2024-04-26T10:42:26.041850+0000","last_active":"2024-04-26T10:42:27.033779+0000","last_peered":"2024-04-26T10:42:27.033779+0000","last_clean":"2024-04-26T10:42:27.033779+0000","last_became_active":"2024-04-26T10:42:26.040464+0000","last_became_peered":"2024-04-26T10:42:26.040464+0000","last_unstale":"2024-04-26T10:42:27.033779+0000","last_undegraded":"2024-04-26T10:42:27.033779+0000","last_fullsized":"2024-04-26T10:42:27.033779+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033039+0000","last_change":"2024-04-26T10:42:25.685525+0000","last_active":"2024-04-26T10:42:27.033039+0000","last_peered":"2024-04-26T10:42:27.033039+0000","last_clean":"2024-04-26T10:42:27.033039+0000","last_became_active":"2024-04-26T10:42:25.684855+0000","last_became_peered":"2024-04-26T10:42:25.684855+0000","last_unstale":"2024-04-26T10:42:27.033039+0000","last_undegraded":"2024-04-26T10:42:27.033039+0000","last_fullsized":"2024-04-26T10:42:27.033039+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:16.723401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033789+0000","last_change":"2024-04-26T10:42:26.046616+0000","last_active":"2024-04-26T10:42:27.033789+0000","last_peered":"2024-04-26T10:42:27.033789+0000","last_clean":"2024-04-26T10:42:27.033789+0000","last_became_active":"2024-04-26T10:42:26.046010+0000","last_became_peered":"2024-04-26T10:42:26.046010+0000","last_unstale":"2024-04-26T10:42:27.033789+0000","last_undegraded":"2024-04-26T10:42:27.033789+0000","last_fullsized":"2024-04-26T10:42:27.033789+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:19.601720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032884+0000","last_change":"2024-04-26T10:42:25.688905+0000","last_active":"2024-04-26T10:42:27.032884+0000","last_peered":"2024-04-26T10:42:27.032884+0000","last_clean":"2024-04-26T10:42:27.032884+0000","last_became_active":"2024-04-26T10:42:25.688504+0000","last_became_peered":"2024-04-26T10:42:25.688504+0000","last_unstale":"2024-04-26T10:42:27.032884+0000","last_undegraded":"2024-04-26T10:42:27.032884+0000","last_fullsized":"2024-04-26T10:42:27.032884+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.930441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033655+0000","last_change":"2024-04-26T10:42:26.046158+0000","last_active":"2024-04-26T10:42:27.033655+0000","last_peered":"2024-04-26T10:42:27.033655+0000","last_clean":"2024-04-26T10:42:27.033655+0000","last_became_active":"2024-04-26T10:42:26.045797+0000","last_became_peered":"2024-04-26T10:42:26.045797+0000","last_unstale":"2024-04-26T10:42:27.033655+0000","last_undegraded":"2024-04-26T10:42:27.033655+0000","last_fullsized":"2024-04-26T10:42:27.033655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:23.079349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032889+0000","last_change":"2024-04-26T10:42:25.687207+0000","last_active":"2024-04-26T10:42:27.032889+0000","last_peered":"2024-04-26T10:42:27.032889+0000","last_clean":"2024-04-26T10:42:27.032889+0000","last_became_active":"2024-04-26T10:42:25.686549+0000","last_became_peered":"2024-04-26T10:42:25.686549+0000","last_unstale":"2024-04-26T10:42:27.032889+0000","last_undegraded":"2024-04-26T10:42:27.032889+0000","last_fullsized":"2024-04-26T10:42:27.032889+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:42.125386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033731+0000","last_change":"2024-04-26T10:42:25.684462+0000","last_active":"2024-04-26T10:42:27.033731+0000","last_peered":"2024-04-26T10:42:27.033731+0000","last_clean":"2024-04-26T10:42:27.033731+0000","last_became_active":"2024-04-26T10:42:25.684162+0000","last_became_peered":"2024-04-26T10:42:25.684162+0000","last_unstale":"2024-04-26T10:42:27.033731+0000","last_undegraded":"2024-04-26T10:42:27.033731+0000","last_fullsized":"2024-04-26T10:42:27.033731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.850118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032640+0000","last_change":"2024-04-26T10:42:26.048114+0000","last_active":"2024-04-26T10:42:27.032640+0000","last_peered":"2024-04-26T10:42:27.032640+0000","last_clean":"2024-04-26T10:42:27.032640+0000","last_became_active":"2024-04-26T10:42:26.046641+0000","last_became_peered":"2024-04-26T10:42:26.046641+0000","last_unstale":"2024-04-26T10:42:27.032640+0000","last_undegraded":"2024-04-26T10:42:27.032640+0000","last_fullsized":"2024-04-26T10:42:27.032640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:01.056945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033763+0000","last_change":"2024-04-26T10:42:25.688889+0000","last_active":"2024-04-26T10:42:27.033763+0000","last_peered":"2024-04-26T10:42:27.033763+0000","last_clean":"2024-04-26T10:42:27.033763+0000","last_became_active":"2024-04-26T10:42:25.688372+0000","last_became_peered":"2024-04-26T10:42:25.688372+0000","last_unstale":"2024-04-26T10:42:27.033763+0000","last_undegraded":"2024-04-26T10:42:27.033763+0000","last_fullsized":"2024-04-26T10:42:27.033763+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:13.799290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032734+0000","last_change":"2024-04-26T10:42:26.041968+0000","last_active":"2024-04-26T10:42:27.032734+0000","last_peered":"2024-04-26T10:42:27.032734+0000","last_clean":"2024-04-26T10:42:27.032734+0000","last_became_active":"2024-04-26T10:42:26.041070+0000","last_became_peered":"2024-04-26T10:42:26.041070+0000","last_unstale":"2024-04-26T10:42:27.032734+0000","last_undegraded":"2024-04-26T10:42:27.032734+0000","last_fullsized":"2024-04-26T10:42:27.032734+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033901+0000","last_change":"2024-04-26T10:42:25.684653+0000","last_active":"2024-04-26T10:42:27.033901+0000","last_peered":"2024-04-26T10:42:27.033901+0000","last_clean":"2024-04-26T10:42:27.033901+0000","last_became_active":"2024-04-26T10:42:25.684338+0000","last_became_peered":"2024-04-26T10:42:25.684338+0000","last_unstale":"2024-04-26T10:42:27.033901+0000","last_undegraded":"2024-04-26T10:42:27.033901+0000","last_fullsized":"2024-04-26T10:42:27.033901+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:10.694039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033371+0000","last_change":"2024-04-26T10:42:26.042182+0000","last_active":"2024-04-26T10:42:27.033371+0000","last_peered":"2024-04-26T10:42:27.033371+0000","last_clean":"2024-04-26T10:42:27.033371+0000","last_became_active":"2024-04-26T10:42:26.041689+0000","last_became_peered":"2024-04-26T10:42:26.041689+0000","last_unstale":"2024-04-26T10:42:27.033371+0000","last_undegraded":"2024-04-26T10:42:27.033371+0000","last_fullsized":"2024-04-26T10:42:27.033371+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:32:19.618648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033908+0000","last_change":"2024-04-26T10:42:25.686677+0000","last_active":"2024-04-26T10:42:27.033908+0000","last_peered":"2024-04-26T10:42:27.033908+0000","last_clean":"2024-04-26T10:42:27.033908+0000","last_became_active":"2024-04-26T10:42:25.685939+0000","last_became_peered":"2024-04-26T10:42:25.685939+0000","last_unstale":"2024-04-26T10:42:27.033908+0000","last_undegraded":"2024-04-26T10:42:27.033908+0000","last_fullsized":"2024-04-26T10:42:27.033908+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:30.225098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033381+0000","last_change":"2024-04-26T10:42:26.045829+0000","last_active":"2024-04-26T10:42:27.033381+0000","last_peered":"2024-04-26T10:42:27.033381+0000","last_clean":"2024-04-26T10:42:27.033381+0000","last_became_active":"2024-04-26T10:42:26.045499+0000","last_became_peered":"2024-04-26T10:42:26.045499+0000","last_unstale":"2024-04-26T10:42:27.033381+0000","last_undegraded":"2024-04-26T10:42:27.033381+0000","last_fullsized":"2024-04-26T10:42:27.033381+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:14.041039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033624+0000","last_change":"2024-04-26T10:42:25.687934+0000","last_active":"2024-04-26T10:42:27.033624+0000","last_peered":"2024-04-26T10:42:27.033624+0000","last_clean":"2024-04-26T10:42:27.033624+0000","last_became_active":"2024-04-26T10:42:25.687447+0000","last_became_peered":"2024-04-26T10:42:25.687447+0000","last_unstale":"2024-04-26T10:42:27.033624+0000","last_undegraded":"2024-04-26T10:42:27.033624+0000","last_fullsized":"2024-04-26T10:42:27.033624+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.930441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033660+0000","last_change":"2024-04-26T10:42:26.043638+0000","last_active":"2024-04-26T10:42:27.033660+0000","last_peered":"2024-04-26T10:42:27.033660+0000","last_clean":"2024-04-26T10:42:27.033660+0000","last_became_active":"2024-04-26T10:42:26.042692+0000","last_became_peered":"2024-04-26T10:42:26.042692+0000","last_unstale":"2024-04-26T10:42:27.033660+0000","last_undegraded":"2024-04-26T10:42:27.033660+0000","last_fullsized":"2024-04-26T10:42:27.033660+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033803+0000","last_change":"2024-04-26T10:42:25.687283+0000","last_active":"2024-04-26T10:42:27.033803+0000","last_peered":"2024-04-26T10:42:27.033803+0000","last_clean":"2024-04-26T10:42:27.033803+0000","last_became_active":"2024-04-26T10:42:25.686251+0000","last_became_peered":"2024-04-26T10:42:25.686251+0000","last_unstale":"2024-04-26T10:42:27.033803+0000","last_undegraded":"2024-04-26T10:42:27.033803+0000","last_fullsized":"2024-04-26T10:42:27.033803+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:16.723401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033798+0000","last_change":"2024-04-26T10:42:26.040688+0000","last_active":"2024-04-26T10:42:27.033798+0000","last_peered":"2024-04-26T10:42:27.033798+0000","last_clean":"2024-04-26T10:42:27.033798+0000","last_became_active":"2024-04-26T10:42:26.039133+0000","last_became_peered":"2024-04-26T10:42:26.039133+0000","last_unstale":"2024-04-26T10:42:27.033798+0000","last_undegraded":"2024-04-26T10:42:27.033798+0000","last_fullsized":"2024-04-26T10:42:27.033798+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032938+0000","last_change":"2024-04-26T10:42:25.688837+0000","last_active":"2024-04-26T10:42:27.032938+0000","last_peered":"2024-04-26T10:42:27.032938+0000","last_clean":"2024-04-26T10:42:27.032938+0000","last_became_active":"2024-04-26T10:42:25.688450+0000","last_became_peered":"2024-04-26T10:42:25.688450+0000","last_unstale":"2024-04-26T10:42:27.032938+0000","last_undegraded":"2024-04-26T10:42:27.032938+0000","last_fullsized":"2024-04-26T10:42:27.032938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:26.788267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033564+0000","last_change":"2024-04-26T10:42:26.039661+0000","last_active":"2024-04-26T10:42:27.033564+0000","last_peered":"2024-04-26T10:42:27.033564+0000","last_clean":"2024-04-26T10:42:27.033564+0000","last_became_active":"2024-04-26T10:42:26.038664+0000","last_became_peered":"2024-04-26T10:42:26.038664+0000","last_unstale":"2024-04-26T10:42:27.033564+0000","last_undegraded":"2024-04-26T10:42:27.033564+0000","last_fullsized":"2024-04-26T10:42:27.033564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032757+0000","last_change":"2024-04-26T10:42:25.687082+0000","last_active":"2024-04-26T10:42:27.032757+0000","last_peered":"2024-04-26T10:42:27.032757+0000","last_clean":"2024-04-26T10:42:27.032757+0000","last_became_active":"2024-04-26T10:42:25.686779+0000","last_became_peered":"2024-04-26T10:42:25.686779+0000","last_unstale":"2024-04-26T10:42:27.032757+0000","last_undegraded":"2024-04-26T10:42:27.032757+0000","last_fullsized":"2024-04-26T10:42:27.032757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:12.284219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033692+0000","last_change":"2024-04-26T10:42:26.047130+0000","last_active":"2024-04-26T10:42:27.033692+0000","last_peered":"2024-04-26T10:42:27.033692+0000","last_clean":"2024-04-26T10:42:27.033692+0000","last_became_active":"2024-04-26T10:42:26.046884+0000","last_became_peered":"2024-04-26T10:42:26.046884+0000","last_unstale":"2024-04-26T10:42:27.033692+0000","last_undegraded":"2024-04-26T10:42:27.033692+0000","last_fullsized":"2024-04-26T10:42:27.033692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:31.020364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.035198+0000","last_change":"2024-04-26T10:42:21.406599+0000","last_active":"2024-04-26T10:42:26.035198+0000","last_peered":"2024-04-26T10:42:26.035198+0000","last_clean":"2024-04-26T10:42:26.035198+0000","last_became_active":"2024-04-26T10:42:21.405587+0000","last_became_peered":"2024-04-26T10:42:21.405587+0000","last_unstale":"2024-04-26T10:42:26.035198+0000","last_undegraded":"2024-04-26T10:42:26.035198+0000","last_fullsized":"2024-04-26T10:42:26.035198+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:44.561530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.035065+0000","last_change":"2024-04-26T10:42:21.405305+0000","last_active":"2024-04-26T10:42:26.035065+0000","last_peered":"2024-04-26T10:42:26.035065+0000","last_clean":"2024-04-26T10:42:26.035065+0000","last_became_active":"2024-04-26T10:42:21.405032+0000","last_became_peered":"2024-04-26T10:42:21.405032+0000","last_unstale":"2024-04-26T10:42:26.035065+0000","last_undegraded":"2024-04-26T10:42:26.035065+0000","last_fullsized":"2024-04-26T10:42:26.035065+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033157+0000","last_change":"2024-04-26T10:42:25.686765+0000","last_active":"2024-04-26T10:42:27.033157+0000","last_peered":"2024-04-26T10:42:27.033157+0000","last_clean":"2024-04-26T10:42:27.033157+0000","last_became_active":"2024-04-26T10:42:25.686009+0000","last_became_peered":"2024-04-26T10:42:25.686009+0000","last_unstale":"2024-04-26T10:42:27.033157+0000","last_undegraded":"2024-04-26T10:42:27.033157+0000","last_fullsized":"2024-04-26T10:42:27.033157+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:54.627815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033875+0000","last_change":"2024-04-26T10:42:26.040215+0000","last_active":"2024-04-26T10:42:27.033875+0000","last_peered":"2024-04-26T10:42:27.033875+0000","last_clean":"2024-04-26T10:42:27.033875+0000","last_became_active":"2024-04-26T10:42:26.039129+0000","last_became_peered":"2024-04-26T10:42:26.039129+0000","last_unstale":"2024-04-26T10:42:27.033875+0000","last_undegraded":"2024-04-26T10:42:27.033875+0000","last_fullsized":"2024-04-26T10:42:27.033875+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.035134+0000","last_change":"2024-04-26T10:42:21.406881+0000","last_active":"2024-04-26T10:42:26.035134+0000","last_peered":"2024-04-26T10:42:26.035134+0000","last_clean":"2024-04-26T10:42:26.035134+0000","last_became_active":"2024-04-26T10:42:21.406634+0000","last_became_peered":"2024-04-26T10:42:21.406634+0000","last_unstale":"2024-04-26T10:42:26.035134+0000","last_undegraded":"2024-04-26T10:42:26.035134+0000","last_fullsized":"2024-04-26T10:42:26.035134+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:45.892841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033120+0000","last_change":"2024-04-26T10:42:25.687986+0000","last_active":"2024-04-26T10:42:27.033120+0000","last_peered":"2024-04-26T10:42:27.033120+0000","last_clean":"2024-04-26T10:42:27.033120+0000","last_became_active":"2024-04-26T10:42:25.687201+0000","last_became_peered":"2024-04-26T10:42:25.687201+0000","last_unstale":"2024-04-26T10:42:27.033120+0000","last_undegraded":"2024-04-26T10:42:27.033120+0000","last_fullsized":"2024-04-26T10:42:27.033120+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:35.867262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033630+0000","last_change":"2024-04-26T10:42:26.043723+0000","last_active":"2024-04-26T10:42:27.033630+0000","last_peered":"2024-04-26T10:42:27.033630+0000","last_clean":"2024-04-26T10:42:27.033630+0000","last_became_active":"2024-04-26T10:42:26.041814+0000","last_became_peered":"2024-04-26T10:42:26.041814+0000","last_unstale":"2024-04-26T10:42:27.033630+0000","last_undegraded":"2024-04-26T10:42:27.033630+0000","last_fullsized":"2024-04-26T10:42:27.033630+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.032836+0000","last_change":"2024-04-26T10:42:21.405597+0000","last_active":"2024-04-26T10:42:26.032836+0000","last_peered":"2024-04-26T10:42:26.032836+0000","last_clean":"2024-04-26T10:42:26.032836+0000","last_became_active":"2024-04-26T10:42:21.405117+0000","last_became_peered":"2024-04-26T10:42:21.405117+0000","last_unstale":"2024-04-26T10:42:26.032836+0000","last_undegraded":"2024-04-26T10:42:26.032836+0000","last_fullsized":"2024-04-26T10:42:26.032836+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033005+0000","last_change":"2024-04-26T10:42:25.688955+0000","last_active":"2024-04-26T10:42:27.033005+0000","last_peered":"2024-04-26T10:42:27.033005+0000","last_clean":"2024-04-26T10:42:27.033005+0000","last_became_active":"2024-04-26T10:42:25.688552+0000","last_became_peered":"2024-04-26T10:42:25.688552+0000","last_unstale":"2024-04-26T10:42:27.033005+0000","last_undegraded":"2024-04-26T10:42:27.033005+0000","last_fullsized":"2024-04-26T10:42:27.033005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:04.963775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033758+0000","last_change":"2024-04-26T10:42:26.049311+0000","last_active":"2024-04-26T10:42:27.033758+0000","last_peered":"2024-04-26T10:42:27.033758+0000","last_clean":"2024-04-26T10:42:27.033758+0000","last_became_active":"2024-04-26T10:42:26.048915+0000","last_became_peered":"2024-04-26T10:42:26.048915+0000","last_unstale":"2024-04-26T10:42:27.033758+0000","last_undegraded":"2024-04-26T10:42:27.033758+0000","last_fullsized":"2024-04-26T10:42:27.033758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:01.056945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.034656+0000","last_change":"2024-04-26T10:42:21.405298+0000","last_active":"2024-04-26T10:42:26.034656+0000","last_peered":"2024-04-26T10:42:26.034656+0000","last_clean":"2024-04-26T10:42:26.034656+0000","last_became_active":"2024-04-26T10:42:21.405011+0000","last_became_peered":"2024-04-26T10:42:21.405011+0000","last_unstale":"2024-04-26T10:42:26.034656+0000","last_undegraded":"2024-04-26T10:42:26.034656+0000","last_fullsized":"2024-04-26T10:42:26.034656+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:47.789961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033960+0000","last_change":"2024-04-26T10:42:25.686177+0000","last_active":"2024-04-26T10:42:27.033960+0000","last_peered":"2024-04-26T10:42:27.033960+0000","last_clean":"2024-04-26T10:42:27.033960+0000","last_became_active":"2024-04-26T10:42:25.685121+0000","last_became_peered":"2024-04-26T10:42:25.685121+0000","last_unstale":"2024-04-26T10:42:27.033960+0000","last_undegraded":"2024-04-26T10:42:27.033960+0000","last_fullsized":"2024-04-26T10:42:27.033960+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:34.398138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033614+0000","last_change":"2024-04-26T10:42:26.045312+0000","last_active":"2024-04-26T10:42:27.033614+0000","last_peered":"2024-04-26T10:42:27.033614+0000","last_clean":"2024-04-26T10:42:27.033614+0000","last_became_active":"2024-04-26T10:42:26.044619+0000","last_became_peered":"2024-04-26T10:42:26.044619+0000","last_unstale":"2024-04-26T10:42:27.033614+0000","last_undegraded":"2024-04-26T10:42:27.033614+0000","last_fullsized":"2024-04-26T10:42:27.033614+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:50.646374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033966+0000","last_change":"2024-04-26T10:42:25.686310+0000","last_active":"2024-04-26T10:42:27.033966+0000","last_peered":"2024-04-26T10:42:27.033966+0000","last_clean":"2024-04-26T10:42:27.033966+0000","last_became_active":"2024-04-26T10:42:25.685767+0000","last_became_peered":"2024-04-26T10:42:25.685767+0000","last_unstale":"2024-04-26T10:42:27.033966+0000","last_undegraded":"2024-04-26T10:42:27.033966+0000","last_fullsized":"2024-04-26T10:42:27.033966+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:02.874807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.032839+0000","last_change":"2024-04-26T10:42:21.405754+0000","last_active":"2024-04-26T10:42:26.032839+0000","last_peered":"2024-04-26T10:42:26.032839+0000","last_clean":"2024-04-26T10:42:26.032839+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:42:26.032839+0000","last_undegraded":"2024-04-26T10:42:26.032839+0000","last_fullsized":"2024-04-26T10:42:26.032839+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:47.123256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032872+0000","last_change":"2024-04-26T10:42:26.043764+0000","last_active":"2024-04-26T10:42:27.032872+0000","last_peered":"2024-04-26T10:42:27.032872+0000","last_clean":"2024-04-26T10:42:27.032872+0000","last_became_active":"2024-04-26T10:42:26.043388+0000","last_became_peered":"2024-04-26T10:42:26.043388+0000","last_unstale":"2024-04-26T10:42:27.032872+0000","last_undegraded":"2024-04-26T10:42:27.032872+0000","last_fullsized":"2024-04-26T10:42:27.032872+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:31.020364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033601+0000","last_change":"2024-04-26T10:42:25.685368+0000","last_active":"2024-04-26T10:42:27.033601+0000","last_peered":"2024-04-26T10:42:27.033601+0000","last_clean":"2024-04-26T10:42:27.033601+0000","last_became_active":"2024-04-26T10:42:25.684379+0000","last_became_peered":"2024-04-26T10:42:25.684379+0000","last_unstale":"2024-04-26T10:42:27.033601+0000","last_undegraded":"2024-04-26T10:42:27.033601+0000","last_fullsized":"2024-04-26T10:42:27.033601+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:34.398138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.037776+0000","last_change":"2024-04-26T10:42:21.405356+0000","last_active":"2024-04-26T10:42:26.037776+0000","last_peered":"2024-04-26T10:42:26.037776+0000","last_clean":"2024-04-26T10:42:26.037776+0000","last_became_active":"2024-04-26T10:42:21.405006+0000","last_became_peered":"2024-04-26T10:42:21.405006+0000","last_unstale":"2024-04-26T10:42:26.037776+0000","last_undegraded":"2024-04-26T10:42:26.037776+0000","last_fullsized":"2024-04-26T10:42:26.037776+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:55.043967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033128+0000","last_change":"2024-04-26T10:42:26.042954+0000","last_active":"2024-04-26T10:42:27.033128+0000","last_peered":"2024-04-26T10:42:27.033128+0000","last_clean":"2024-04-26T10:42:27.033128+0000","last_became_active":"2024-04-26T10:42:26.042544+0000","last_became_peered":"2024-04-26T10:42:26.042544+0000","last_unstale":"2024-04-26T10:42:27.033128+0000","last_undegraded":"2024-04-26T10:42:27.033128+0000","last_fullsized":"2024-04-26T10:42:27.033128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:14.041039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033915+0000","last_change":"2024-04-26T10:42:25.687201+0000","last_active":"2024-04-26T10:42:27.033915+0000","last_peered":"2024-04-26T10:42:27.033915+0000","last_clean":"2024-04-26T10:42:27.033915+0000","last_became_active":"2024-04-26T10:42:25.686641+0000","last_became_peered":"2024-04-26T10:42:25.686641+0000","last_unstale":"2024-04-26T10:42:27.033915+0000","last_undegraded":"2024-04-26T10:42:27.033915+0000","last_fullsized":"2024-04-26T10:42:27.033915+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:30.225098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.033642+0000","last_change":"2024-04-26T10:42:21.405615+0000","last_active":"2024-04-26T10:42:26.033642+0000","last_peered":"2024-04-26T10:42:26.033642+0000","last_clean":"2024-04-26T10:42:26.033642+0000","last_became_active":"2024-04-26T10:42:21.405184+0000","last_became_peered":"2024-04-26T10:42:21.405184+0000","last_unstale":"2024-04-26T10:42:26.033642+0000","last_undegraded":"2024-04-26T10:42:26.033642+0000","last_fullsized":"2024-04-26T10:42:26.033642+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:52.378909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032862+0000","last_change":"2024-04-26T10:42:26.046832+0000","last_active":"2024-04-26T10:42:27.032862+0000","last_peered":"2024-04-26T10:42:27.032862+0000","last_clean":"2024-04-26T10:42:27.032862+0000","last_became_active":"2024-04-26T10:42:26.046484+0000","last_became_peered":"2024-04-26T10:42:26.046484+0000","last_unstale":"2024-04-26T10:42:27.032862+0000","last_undegraded":"2024-04-26T10:42:27.032862+0000","last_fullsized":"2024-04-26T10:42:27.032862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:28.856785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652287+0000","last_change":"2024-04-26T10:42:25.686262+0000","last_active":"2024-04-26T10:42:29.652287+0000","last_peered":"2024-04-26T10:42:29.652287+0000","last_clean":"2024-04-26T10:42:29.652287+0000","last_became_active":"2024-04-26T10:42:25.685528+0000","last_became_peered":"2024-04-26T10:42:25.685528+0000","last_unstale":"2024-04-26T10:42:29.652287+0000","last_undegraded":"2024-04-26T10:42:29.652287+0000","last_fullsized":"2024-04-26T10:42:29.652287+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:47.138273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:42:26.035316+0000","last_change":"2024-04-26T10:42:21.405863+0000","last_active":"2024-04-26T10:42:26.035316+0000","last_peered":"2024-04-26T10:42:26.035316+0000","last_clean":"2024-04-26T10:42:26.035316+0000","last_became_active":"2024-04-26T10:42:21.405555+0000","last_became_peered":"2024-04-26T10:42:21.405555+0000","last_unstale":"2024-04-26T10:42:26.035316+0000","last_undegraded":"2024-04-26T10:42:26.035316+0000","last_fullsized":"2024-04-26T10:42:26.035316+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:39.259618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032766+0000","last_change":"2024-04-26T10:42:26.044818+0000","last_active":"2024-04-26T10:42:27.032766+0000","last_peered":"2024-04-26T10:42:27.032766+0000","last_clean":"2024-04-26T10:42:27.032766+0000","last_became_active":"2024-04-26T10:42:26.043969+0000","last_became_peered":"2024-04-26T10:42:26.043969+0000","last_unstale":"2024-04-26T10:42:27.032766+0000","last_undegraded":"2024-04-26T10:42:27.032766+0000","last_fullsized":"2024-04-26T10:42:27.032766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:50.646374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033819+0000","last_change":"2024-04-26T10:42:26.040224+0000","last_active":"2024-04-26T10:42:27.033819+0000","last_peered":"2024-04-26T10:42:27.033819+0000","last_clean":"2024-04-26T10:42:27.033819+0000","last_became_active":"2024-04-26T10:42:26.038590+0000","last_became_peered":"2024-04-26T10:42:26.038590+0000","last_unstale":"2024-04-26T10:42:27.033819+0000","last_undegraded":"2024-04-26T10:42:27.033819+0000","last_fullsized":"2024-04-26T10:42:27.033819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033865+0000","last_change":"2024-04-26T10:42:25.684447+0000","last_active":"2024-04-26T10:42:27.033865+0000","last_peered":"2024-04-26T10:42:27.033865+0000","last_clean":"2024-04-26T10:42:27.033865+0000","last_became_active":"2024-04-26T10:42:25.684147+0000","last_became_peered":"2024-04-26T10:42:25.684147+0000","last_unstale":"2024-04-26T10:42:27.033865+0000","last_undegraded":"2024-04-26T10:42:27.033865+0000","last_fullsized":"2024-04-26T10:42:27.033865+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:38.873282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032960+0000","last_change":"2024-04-26T10:42:26.045459+0000","last_active":"2024-04-26T10:42:27.032960+0000","last_peered":"2024-04-26T10:42:27.032960+0000","last_clean":"2024-04-26T10:42:27.032960+0000","last_became_active":"2024-04-26T10:42:26.044972+0000","last_became_peered":"2024-04-26T10:42:26.044972+0000","last_unstale":"2024-04-26T10:42:27.032960+0000","last_undegraded":"2024-04-26T10:42:27.032960+0000","last_fullsized":"2024-04-26T10:42:27.032960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033920+0000","last_change":"2024-04-26T10:42:25.687956+0000","last_active":"2024-04-26T10:42:27.033920+0000","last_peered":"2024-04-26T10:42:27.033920+0000","last_clean":"2024-04-26T10:42:27.033920+0000","last_became_active":"2024-04-26T10:42:25.687533+0000","last_became_peered":"2024-04-26T10:42:25.687533+0000","last_unstale":"2024-04-26T10:42:27.033920+0000","last_undegraded":"2024-04-26T10:42:27.033920+0000","last_fullsized":"2024-04-26T10:42:27.033920+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:28.506897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033679+0000","last_change":"2024-04-26T10:42:25.685829+0000","last_active":"2024-04-26T10:42:27.033679+0000","last_peered":"2024-04-26T10:42:27.033679+0000","last_clean":"2024-04-26T10:42:27.033679+0000","last_became_active":"2024-04-26T10:42:25.685307+0000","last_became_peered":"2024-04-26T10:42:25.685307+0000","last_unstale":"2024-04-26T10:42:27.033679+0000","last_undegraded":"2024-04-26T10:42:27.033679+0000","last_fullsized":"2024-04-26T10:42:27.033679+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032933+0000","last_change":"2024-04-26T10:42:26.046196+0000","last_active":"2024-04-26T10:42:27.032933+0000","last_peered":"2024-04-26T10:42:27.032933+0000","last_clean":"2024-04-26T10:42:27.032933+0000","last_became_active":"2024-04-26T10:42:26.045762+0000","last_became_peered":"2024-04-26T10:42:26.045762+0000","last_unstale":"2024-04-26T10:42:27.032933+0000","last_undegraded":"2024-04-26T10:42:27.032933+0000","last_fullsized":"2024-04-26T10:42:27.032933+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033848+0000","last_change":"2024-04-26T10:42:25.685990+0000","last_active":"2024-04-26T10:42:27.033848+0000","last_peered":"2024-04-26T10:42:27.033848+0000","last_clean":"2024-04-26T10:42:27.033848+0000","last_became_active":"2024-04-26T10:42:25.684604+0000","last_became_peered":"2024-04-26T10:42:25.684604+0000","last_unstale":"2024-04-26T10:42:27.033848+0000","last_undegraded":"2024-04-26T10:42:27.033848+0000","last_fullsized":"2024-04-26T10:42:27.033848+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:02.874807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032830+0000","last_change":"2024-04-26T10:42:26.038545+0000","last_active":"2024-04-26T10:42:27.032830+0000","last_peered":"2024-04-26T10:42:27.032830+0000","last_clean":"2024-04-26T10:42:27.032830+0000","last_became_active":"2024-04-26T10:42:26.038099+0000","last_became_peered":"2024-04-26T10:42:26.038099+0000","last_unstale":"2024-04-26T10:42:27.032830+0000","last_undegraded":"2024-04-26T10:42:27.032830+0000","last_fullsized":"2024-04-26T10:42:27.032830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033882+0000","last_change":"2024-04-26T10:42:26.046506+0000","last_active":"2024-04-26T10:42:27.033882+0000","last_peered":"2024-04-26T10:42:27.033882+0000","last_clean":"2024-04-26T10:42:27.033882+0000","last_became_active":"2024-04-26T10:42:26.045904+0000","last_became_peered":"2024-04-26T10:42:26.045904+0000","last_unstale":"2024-04-26T10:42:27.033882+0000","last_undegraded":"2024-04-26T10:42:27.033882+0000","last_fullsized":"2024-04-26T10:42:27.033882+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:49.854080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.032971+0000","last_change":"2024-04-26T10:42:25.683890+0000","last_active":"2024-04-26T10:42:27.032971+0000","last_peered":"2024-04-26T10:42:27.032971+0000","last_clean":"2024-04-26T10:42:27.032971+0000","last_became_active":"2024-04-26T10:42:25.683467+0000","last_became_peered":"2024-04-26T10:42:25.683467+0000","last_unstale":"2024-04-26T10:42:27.032971+0000","last_undegraded":"2024-04-26T10:42:27.032971+0000","last_fullsized":"2024-04-26T10:42:27.032971+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033657+0000","last_change":"2024-04-26T10:42:26.046384+0000","last_active":"2024-04-26T10:42:27.033657+0000","last_peered":"2024-04-26T10:42:27.033657+0000","last_clean":"2024-04-26T10:42:27.033657+0000","last_became_active":"2024-04-26T10:42:26.045860+0000","last_became_peered":"2024-04-26T10:42:26.045860+0000","last_unstale":"2024-04-26T10:42:27.033657+0000","last_undegraded":"2024-04-26T10:42:27.033657+0000","last_fullsized":"2024-04-26T10:42:27.033657+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033002+0000","last_change":"2024-04-26T10:42:25.686972+0000","last_active":"2024-04-26T10:42:27.033002+0000","last_peered":"2024-04-26T10:42:27.033002+0000","last_clean":"2024-04-26T10:42:27.033002+0000","last_became_active":"2024-04-26T10:42:25.685903+0000","last_became_peered":"2024-04-26T10:42:25.685903+0000","last_unstale":"2024-04-26T10:42:27.033002+0000","last_undegraded":"2024-04-26T10:42:27.033002+0000","last_fullsized":"2024-04-26T10:42:27.033002+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:43.969731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033703+0000","last_change":"2024-04-26T10:42:26.046515+0000","last_active":"2024-04-26T10:42:27.033703+0000","last_peered":"2024-04-26T10:42:27.033703+0000","last_clean":"2024-04-26T10:42:27.033703+0000","last_became_active":"2024-04-26T10:42:26.045798+0000","last_became_peered":"2024-04-26T10:42:26.045798+0000","last_unstale":"2024-04-26T10:42:27.033703+0000","last_undegraded":"2024-04-26T10:42:27.033703+0000","last_fullsized":"2024-04-26T10:42:27.033703+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:28.856785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033066+0000","last_change":"2024-04-26T10:42:25.688221+0000","last_active":"2024-04-26T10:42:27.033066+0000","last_peered":"2024-04-26T10:42:27.033066+0000","last_clean":"2024-04-26T10:42:27.033066+0000","last_became_active":"2024-04-26T10:42:25.687829+0000","last_became_peered":"2024-04-26T10:42:25.687829+0000","last_unstale":"2024-04-26T10:42:27.033066+0000","last_undegraded":"2024-04-26T10:42:27.033066+0000","last_fullsized":"2024-04-26T10:42:27.033066+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:05.939715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033363+0000","last_change":"2024-04-26T10:42:26.042723+0000","last_active":"2024-04-26T10:42:27.033363+0000","last_peered":"2024-04-26T10:42:27.033363+0000","last_clean":"2024-04-26T10:42:27.033363+0000","last_became_active":"2024-04-26T10:42:26.041852+0000","last_became_peered":"2024-04-26T10:42:26.041852+0000","last_unstale":"2024-04-26T10:42:27.033363+0000","last_undegraded":"2024-04-26T10:42:27.033363+0000","last_fullsized":"2024-04-26T10:42:27.033363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033492+0000","last_change":"2024-04-26T10:42:25.688815+0000","last_active":"2024-04-26T10:42:27.033492+0000","last_peered":"2024-04-26T10:42:27.033492+0000","last_clean":"2024-04-26T10:42:27.033492+0000","last_became_active":"2024-04-26T10:42:25.688451+0000","last_became_peered":"2024-04-26T10:42:25.688451+0000","last_unstale":"2024-04-26T10:42:27.033492+0000","last_undegraded":"2024-04-26T10:42:27.033492+0000","last_fullsized":"2024-04-26T10:42:27.033492+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:17.143923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033256+0000","last_change":"2024-04-26T10:42:26.044040+0000","last_active":"2024-04-26T10:42:27.033256+0000","last_peered":"2024-04-26T10:42:27.033256+0000","last_clean":"2024-04-26T10:42:27.033256+0000","last_became_active":"2024-04-26T10:42:26.042629+0000","last_became_peered":"2024-04-26T10:42:26.042629+0000","last_unstale":"2024-04-26T10:42:27.033256+0000","last_undegraded":"2024-04-26T10:42:27.033256+0000","last_fullsized":"2024-04-26T10:42:27.033256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:23:05.308070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033778+0000","last_change":"2024-04-26T10:42:25.686442+0000","last_active":"2024-04-26T10:42:27.033778+0000","last_peered":"2024-04-26T10:42:27.033778+0000","last_clean":"2024-04-26T10:42:27.033778+0000","last_became_active":"2024-04-26T10:42:25.686029+0000","last_became_peered":"2024-04-26T10:42:25.686029+0000","last_unstale":"2024-04-26T10:42:27.033778+0000","last_undegraded":"2024-04-26T10:42:27.033778+0000","last_fullsized":"2024-04-26T10:42:27.033778+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:04.241132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033516+0000","last_change":"2024-04-26T10:42:26.042561+0000","last_active":"2024-04-26T10:42:27.033516+0000","last_peered":"2024-04-26T10:42:27.033516+0000","last_clean":"2024-04-26T10:42:27.033516+0000","last_became_active":"2024-04-26T10:42:26.041751+0000","last_became_peered":"2024-04-26T10:42:26.041751+0000","last_unstale":"2024-04-26T10:42:27.033516+0000","last_undegraded":"2024-04-26T10:42:27.033516+0000","last_fullsized":"2024-04-26T10:42:27.033516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033819+0000","last_change":"2024-04-26T10:42:25.687977+0000","last_active":"2024-04-26T10:42:27.033819+0000","last_peered":"2024-04-26T10:42:27.033819+0000","last_clean":"2024-04-26T10:42:27.033819+0000","last_became_active":"2024-04-26T10:42:25.687402+0000","last_became_peered":"2024-04-26T10:42:25.687402+0000","last_unstale":"2024-04-26T10:42:27.033819+0000","last_undegraded":"2024-04-26T10:42:27.033819+0000","last_fullsized":"2024-04-26T10:42:27.033819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:35.867262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033076+0000","last_change":"2024-04-26T10:42:26.041729+0000","last_active":"2024-04-26T10:42:27.033076+0000","last_peered":"2024-04-26T10:42:27.033076+0000","last_clean":"2024-04-26T10:42:27.033076+0000","last_became_active":"2024-04-26T10:42:26.040504+0000","last_became_peered":"2024-04-26T10:42:26.040504+0000","last_unstale":"2024-04-26T10:42:27.033076+0000","last_undegraded":"2024-04-26T10:42:27.033076+0000","last_fullsized":"2024-04-26T10:42:27.033076+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033769+0000","last_change":"2024-04-26T10:42:25.686861+0000","last_active":"2024-04-26T10:42:27.033769+0000","last_peered":"2024-04-26T10:42:27.033769+0000","last_clean":"2024-04-26T10:42:27.033769+0000","last_became_active":"2024-04-26T10:42:25.686149+0000","last_became_peered":"2024-04-26T10:42:25.686149+0000","last_unstale":"2024-04-26T10:42:27.033769+0000","last_undegraded":"2024-04-26T10:42:27.033769+0000","last_fullsized":"2024-04-26T10:42:27.033769+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:42.125386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033053+0000","last_change":"2024-04-26T10:42:26.045324+0000","last_active":"2024-04-26T10:42:27.033053+0000","last_peered":"2024-04-26T10:42:27.033053+0000","last_clean":"2024-04-26T10:42:27.033053+0000","last_became_active":"2024-04-26T10:42:26.044454+0000","last_became_peered":"2024-04-26T10:42:26.044454+0000","last_unstale":"2024-04-26T10:42:27.033053+0000","last_undegraded":"2024-04-26T10:42:27.033053+0000","last_fullsized":"2024-04-26T10:42:27.033053+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033768+0000","last_change":"2024-04-26T10:42:25.685528+0000","last_active":"2024-04-26T10:42:27.033768+0000","last_peered":"2024-04-26T10:42:27.033768+0000","last_clean":"2024-04-26T10:42:27.033768+0000","last_became_active":"2024-04-26T10:42:25.684508+0000","last_became_peered":"2024-04-26T10:42:25.684508+0000","last_unstale":"2024-04-26T10:42:27.033768+0000","last_undegraded":"2024-04-26T10:42:27.033768+0000","last_fullsized":"2024-04-26T10:42:27.033768+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.850118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31264,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340576,"statfs":{"total":96636764160,"available":96604749824,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35952,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335888,"statfs":{"total":96636764160,"available":96599949312,"internally_reserved":0,"allocated":749568,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:42:45.137 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T10:42:45.138 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-26T10:42:45.464 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 15 2024-04-26T10:42:45.464 INFO:teuthology.orchestra.run.smithi049.stdout:fsid 9837de44-a9e8-4979-adc4-611f3ddc44ce 2024-04-26T10:42:45.464 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-04-26T10:42:11.337159+0000 2024-04-26T10:42:45.464 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-04-26T10:42:27.029243+0000 2024-04-26T10:42:45.464 INFO:teuthology.orchestra.run.smithi049.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-26T10:42:45.464 INFO:teuthology.orchestra.run.smithi049.stdout:crush_version 4 2024-04-26T10:42:45.464 INFO:teuthology.orchestra.run.smithi049.stdout:full_ratio 0.95 2024-04-26T10:42:45.465 INFO:teuthology.orchestra.run.smithi049.stdout:backfillfull_ratio 0.9 2024-04-26T10:42:45.465 INFO:teuthology.orchestra.run.smithi049.stdout:nearfull_ratio 0.85 2024-04-26T10:42:45.465 INFO:teuthology.orchestra.run.smithi049.stdout:require_min_compat_client luminous 2024-04-26T10:42:45.465 INFO:teuthology.orchestra.run.smithi049.stdout:min_compat_client jewel 2024-04-26T10:42:45.465 INFO:teuthology.orchestra.run.smithi049.stdout:require_osd_release reef 2024-04-26T10:42:45.465 INFO:teuthology.orchestra.run.smithi049.stdout:stretch_mode_enabled false 2024-04-26T10:42:45.465 INFO:teuthology.orchestra.run.smithi049.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-04-26T10:42:45.465 INFO:teuthology.orchestra.run.smithi049.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-04-26T10:42:45.465 INFO:teuthology.orchestra.run.smithi049.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 14 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-04-26T10:42:45.465 INFO:teuthology.orchestra.run.smithi049.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-04-26T10:42:45.465 INFO:teuthology.orchestra.run.smithi049.stdout:max_osd 3 2024-04-26T10:42:45.465 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6800/28839,v1:172.21.15.60:6801/28839] [v2:172.21.15.60:6802/28839,v1:172.21.15.60:6803/28839] exists,up eabed31c-c043-43de-a756-e217d5287116 2024-04-26T10:42:45.465 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6800/28598,v1:172.21.15.87:6801/28598] [v2:172.21.15.87:6802/28598,v1:172.21.15.87:6803/28598] exists,up 7013621f-db09-4096-bc24-428bb170edd1 2024-04-26T10:42:45.465 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6800/28733,v1:172.21.15.195:6801/28733] [v2:172.21.15.195:6802/28733,v1:172.21.15.195:6803/28733] exists,up a1efeadd-cf55-4ed5-9918-36607fd62229 2024-04-26T10:42:45.476 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6800/28839,v1:172.21.15.60:6801/28839] [v2:172.21.15.60:6802/28839,v1:172.21.15.60:6803/28839] exists,up eabed31c-c043-43de-a756-e217d5287116', 'osd.1 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.87:6800/28598,v1:172.21.15.87:6801/28598] [v2:172.21.15.87:6802/28598,v1:172.21.15.87:6803/28598] exists,up 7013621f-db09-4096-bc24-428bb170edd1', 'osd.2 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6800/28733,v1:172.21.15.195:6801/28733] [v2:172.21.15.195:6802/28733,v1:172.21.15.195:6803/28733] exists,up a1efeadd-cf55-4ed5-9918-36607fd62229'] 2024-04-26T10:42:45.477 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-26T10:42:45.579 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-04-26T10:42:45.579 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mon.a", 2024-04-26T10:42:45.579 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster": "ceph", 2024-04-26T10:42:45.579 INFO:teuthology.orchestra.run.smithi049.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-26T10:42:45.579 INFO:teuthology.orchestra.run.smithi049.stdout: "admin_socket_mode": "", 2024-04-26T10:42:45.579 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-26T10:42:45.579 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_client_required": "cephx, none", 2024-04-26T10:42:45.579 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_cluster_required": "cephx", 2024-04-26T10:42:45.579 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_debug": "true", 2024-04-26T10:42:45.579 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-26T10:42:45.579 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-26T10:42:45.580 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_service_required": "cephx", 2024-04-26T10:42:45.580 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-26T10:42:45.580 INFO:teuthology.orchestra.run.smithi049.stdout: "auth_supported": "cephx", 2024-04-26T10:42:45.580 INFO:teuthology.orchestra.run.smithi049.stdout: "bdev_aio": "true", 2024-04-26T10:42:45.580 INFO:teuthology.orchestra.run.smithi049.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-26T10:42:45.580 INFO:teuthology.orchestra.run.smithi049.stdout: "bdev_aio_poll_ms": "250", 2024-04-26T10:42:45.580 INFO:teuthology.orchestra.run.smithi049.stdout: "bdev_aio_reap_max": "16", 2024-04-26T10:42:45.580 INFO:teuthology.orchestra.run.smithi049.stdout: "bdev_async_discard": "false", 2024-04-26T10:42:45.580 INFO:teuthology.orchestra.run.smithi049.stdout: "bdev_block_size": "4096", 2024-04-26T10:42:45.580 INFO:teuthology.orchestra.run.smithi049.stdout: "bdev_debug_aio": "false", 2024-04-26T10:42:45.580 INFO:teuthology.orchestra.run.smithi049.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-26T10:42:45.580 INFO:teuthology.orchestra.run.smithi049.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-26T10:42:45.580 INFO:teuthology.orchestra.run.smithi049.stdout: "bdev_debug_inflight_ios": "false", 2024-04-26T10:42:45.581 INFO:teuthology.orchestra.run.smithi049.stdout: "bdev_enable_discard": "false", 2024-04-26T10:42:45.581 INFO:teuthology.orchestra.run.smithi049.stdout: "bdev_flock_retry": "3", 2024-04-26T10:42:45.581 INFO:teuthology.orchestra.run.smithi049.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-26T10:42:45.581 INFO:teuthology.orchestra.run.smithi049.stdout: "bdev_inject_crash": "0", 2024-04-26T10:42:45.581 INFO:teuthology.orchestra.run.smithi049.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-26T10:42:45.581 INFO:teuthology.orchestra.run.smithi049.stdout: "bdev_ioring": "false", 2024-04-26T10:42:45.581 INFO:teuthology.orchestra.run.smithi049.stdout: "bdev_ioring_hipri": "false", 2024-04-26T10:42:45.581 INFO:teuthology.orchestra.run.smithi049.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-26T10:42:45.581 INFO:teuthology.orchestra.run.smithi049.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-26T10:42:45.581 INFO:teuthology.orchestra.run.smithi049.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-26T10:42:45.581 INFO:teuthology.orchestra.run.smithi049.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-26T10:42:45.581 INFO:teuthology.orchestra.run.smithi049.stdout: "bdev_type": "", 2024-04-26T10:42:45.581 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_alloc_size": "1048576", 2024-04-26T10:42:45.581 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_allocator": "hybrid", 2024-04-26T10:42:45.582 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_buffered_io": "true", 2024-04-26T10:42:45.582 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_check_for_zeros": "false", 2024-04-26T10:42:45.582 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-26T10:42:45.582 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-26T10:42:45.582 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_compact_log_sync": "false", 2024-04-26T10:42:45.582 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-26T10:42:45.582 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-26T10:42:45.582 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-26T10:42:45.582 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-26T10:42:45.582 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_max_log_runway": "4194304", 2024-04-26T10:42:45.582 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_max_prefetch": "1048576", 2024-04-26T10:42:45.582 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_min_flush_size": "524288", 2024-04-26T10:42:45.582 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_min_log_runway": "1048576", 2024-04-26T10:42:45.582 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_replay_recovery": "false", 2024-04-26T10:42:45.583 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-26T10:42:45.583 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-26T10:42:45.583 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_sync_write": "false", 2024-04-26T10:42:45.583 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-26T10:42:45.583 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-26T10:42:45.583 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-26T10:42:45.583 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_allocation_from_file": "true", 2024-04-26T10:42:45.583 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_allocator": "hybrid", 2024-04-26T10:42:45.583 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-26T10:42:45.583 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-26T10:42:45.583 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-26T10:42:45.583 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-26T10:42:45.583 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-26T10:42:45.583 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-26T10:42:45.584 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-26T10:42:45.584 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_block_create": "true", 2024-04-26T10:42:45.584 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_block_db_create": "false", 2024-04-26T10:42:45.584 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_block_db_path": "", 2024-04-26T10:42:45.584 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_block_db_size": "0", 2024-04-26T10:42:45.584 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_block_path": "", 2024-04-26T10:42:45.584 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_block_preallocate_file": "false", 2024-04-26T10:42:45.584 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_block_size": "107374182400", 2024-04-26T10:42:45.584 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_block_wal_create": "false", 2024-04-26T10:42:45.584 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_block_wal_path": "", 2024-04-26T10:42:45.584 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_block_wal_size": "100663296", 2024-04-26T10:42:45.584 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_bluefs": "true", 2024-04-26T10:42:45.584 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-26T10:42:45.584 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-26T10:42:45.585 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-26T10:42:45.585 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-26T10:42:45.585 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T10:42:45.585 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T10:42:45.585 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-26T10:42:45.585 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T10:42:45.585 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_autotune": "true", 2024-04-26T10:42:45.585 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-26T10:42:45.585 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-26T10:42:45.585 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-26T10:42:45.585 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-26T10:42:45.585 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_size": "0", 2024-04-26T10:42:45.585 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-26T10:42:45.585 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-26T10:42:45.586 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-26T10:42:45.586 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-26T10:42:45.586 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_type": "2q", 2024-04-26T10:42:45.586 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-26T10:42:45.586 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_clone_cow": "true", 2024-04-26T10:42:45.586 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-26T10:42:45.586 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-26T10:42:45.586 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-26T10:42:45.586 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-26T10:42:45.586 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-26T10:42:45.586 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-26T10:42:45.586 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-26T10:42:45.586 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_compression_mode": "none", 2024-04-26T10:42:45.587 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-26T10:42:45.587 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_csum_type": "crc32c", 2024-04-26T10:42:45.587 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-26T10:42:45.587 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_debug_freelist": "false", 2024-04-26T10:42:45.587 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-26T10:42:45.587 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-26T10:42:45.587 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_debug_inject_bug21040": "false", 2024-04-26T10:42:45.587 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-26T10:42:45.587 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-26T10:42:45.587 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-26T10:42:45.587 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-26T10:42:45.587 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-26T10:42:45.587 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-26T10:42:45.587 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-26T10:42:45.587 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-26T10:42:45.588 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-26T10:42:45.588 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-26T10:42:45.588 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-26T10:42:45.588 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_debug_small_allocations": "0", 2024-04-26T10:42:45.588 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-26T10:42:45.588 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_default_buffered_read": "true", 2024-04-26T10:42:45.588 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_default_buffered_write": "false", 2024-04-26T10:42:45.588 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-26T10:42:45.588 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-26T10:42:45.588 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-26T10:42:45.588 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-26T10:42:45.588 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-26T10:42:45.588 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-26T10:42:45.589 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-26T10:42:45.589 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-26T10:42:45.589 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fail_eio": "false", 2024-04-26T10:42:45.589 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-26T10:42:45.589 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-26T10:42:45.589 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-26T10:42:45.589 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-26T10:42:45.589 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-26T10:42:45.589 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-26T10:42:45.589 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_on_mount": "false", 2024-04-26T10:42:45.589 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-26T10:42:45.589 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_on_umount": "false", 2024-04-26T10:42:45.589 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-26T10:42:45.589 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-26T10:42:45.590 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-26T10:42:45.590 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-26T10:42:45.590 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-26T10:42:45.590 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-26T10:42:45.590 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-26T10:42:45.590 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-26T10:42:45.590 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_ignore_data_csum": "false", 2024-04-26T10:42:45.590 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-26T10:42:45.590 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-26T10:42:45.590 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-26T10:42:45.590 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-26T10:42:45.590 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_log_op_age": "5.000000", 2024-04-26T10:42:45.590 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_max_alloc_size": "0", 2024-04-26T10:42:45.590 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_max_blob_size": "0", 2024-04-26T10:42:45.591 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-26T10:42:45.591 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-26T10:42:45.591 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-26T10:42:45.591 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_max_deferred_txc": "32", 2024-04-26T10:42:45.591 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_min_alloc_size": "0", 2024-04-26T10:42:45.591 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-26T10:42:45.591 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-26T10:42:45.591 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_nid_prealloc": "1024", 2024-04-26T10:42:45.591 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-26T10:42:45.591 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-26T10:42:45.591 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-26T10:42:45.591 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-26T10:42:45.591 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_retry_disk_reads": "3", 2024-04-26T10:42:45.591 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_rocksdb_cf": "true", 2024-04-26T10:42:45.592 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-26T10:42:45.592 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-26T10:42:45.592 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-26T10:42:45.592 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-26T10:42:45.592 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-26T10:42:45.592 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-26T10:42:45.592 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_spdk_mem": "512", 2024-04-26T10:42:45.592 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-26T10:42:45.592 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-26T10:42:45.592 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-26T10:42:45.592 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-26T10:42:45.592 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-26T10:42:45.593 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-26T10:42:45.593 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-26T10:42:45.593 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_tracing": "false", 2024-04-26T10:42:45.593 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-26T10:42:45.593 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-26T10:42:45.593 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-26T10:42:45.593 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-26T10:42:45.593 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-26T10:42:45.593 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-26T10:42:45.593 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-26T10:42:45.593 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-26T10:42:45.593 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-26T10:42:45.593 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_zero_block_detection": "false", 2024-04-26T10:42:45.593 INFO:teuthology.orchestra.run.smithi049.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-26T10:42:45.594 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-26T10:42:45.594 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-26T10:42:45.594 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-26T10:42:45.594 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-26T10:42:45.594 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-26T10:42:45.594 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-26T10:42:45.594 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-26T10:42:45.594 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-26T10:42:45.594 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-26T10:42:45.594 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-26T10:42:45.594 INFO:teuthology.orchestra.run.smithi049.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-26T10:42:45.594 INFO:teuthology.orchestra.run.smithi049.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-26T10:42:45.594 INFO:teuthology.orchestra.run.smithi049.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-26T10:42:45.595 INFO:teuthology.orchestra.run.smithi049.stdout: "cephx_cluster_require_signatures": "false", 2024-04-26T10:42:45.595 INFO:teuthology.orchestra.run.smithi049.stdout: "cephx_cluster_require_version": "2", 2024-04-26T10:42:45.595 INFO:teuthology.orchestra.run.smithi049.stdout: "cephx_require_signatures": "false", 2024-04-26T10:42:45.595 INFO:teuthology.orchestra.run.smithi049.stdout: "cephx_require_version": "2", 2024-04-26T10:42:45.595 INFO:teuthology.orchestra.run.smithi049.stdout: "cephx_service_require_signatures": "false", 2024-04-26T10:42:45.595 INFO:teuthology.orchestra.run.smithi049.stdout: "cephx_service_require_version": "2", 2024-04-26T10:42:45.595 INFO:teuthology.orchestra.run.smithi049.stdout: "cephx_sign_messages": "true", 2024-04-26T10:42:45.595 INFO:teuthology.orchestra.run.smithi049.stdout: "chdir": "", 2024-04-26T10:42:45.595 INFO:teuthology.orchestra.run.smithi049.stdout: "client_acl_type": "", 2024-04-26T10:42:45.595 INFO:teuthology.orchestra.run.smithi049.stdout: "client_asio_thread_count": "2", 2024-04-26T10:42:45.595 INFO:teuthology.orchestra.run.smithi049.stdout: "client_cache_mid": "0.750000", 2024-04-26T10:42:45.595 INFO:teuthology.orchestra.run.smithi049.stdout: "client_cache_size": "16384", 2024-04-26T10:42:45.595 INFO:teuthology.orchestra.run.smithi049.stdout: "client_caps_release_delay": "5", 2024-04-26T10:42:45.595 INFO:teuthology.orchestra.run.smithi049.stdout: "client_check_pool_perm": "true", 2024-04-26T10:42:45.596 INFO:teuthology.orchestra.run.smithi049.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-26T10:42:45.596 INFO:teuthology.orchestra.run.smithi049.stdout: "client_debug_force_sync_read": "false", 2024-04-26T10:42:45.596 INFO:teuthology.orchestra.run.smithi049.stdout: "client_debug_getattr_caps": "false", 2024-04-26T10:42:45.596 INFO:teuthology.orchestra.run.smithi049.stdout: "client_debug_inject_tick_delay": "0", 2024-04-26T10:42:45.596 INFO:teuthology.orchestra.run.smithi049.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-26T10:42:45.596 INFO:teuthology.orchestra.run.smithi049.stdout: "client_die_on_failed_remount": "false", 2024-04-26T10:42:45.596 INFO:teuthology.orchestra.run.smithi049.stdout: "client_dirsize_rbytes": "true", 2024-04-26T10:42:45.596 INFO:teuthology.orchestra.run.smithi049.stdout: "client_force_lazyio": "false", 2024-04-26T10:42:45.596 INFO:teuthology.orchestra.run.smithi049.stdout: "client_fs": "", 2024-04-26T10:42:45.596 INFO:teuthology.orchestra.run.smithi049.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-26T10:42:45.596 INFO:teuthology.orchestra.run.smithi049.stdout: "client_inject_release_failure": "false", 2024-04-26T10:42:45.596 INFO:teuthology.orchestra.run.smithi049.stdout: "client_max_inline_size": "4096", 2024-04-26T10:42:45.596 INFO:teuthology.orchestra.run.smithi049.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-26T10:42:45.597 INFO:teuthology.orchestra.run.smithi049.stdout: "client_mds_namespace": "", 2024-04-26T10:42:45.597 INFO:teuthology.orchestra.run.smithi049.stdout: "client_metadata": "", 2024-04-26T10:42:45.597 INFO:teuthology.orchestra.run.smithi049.stdout: "client_mount_gid": "-1", 2024-04-26T10:42:45.597 INFO:teuthology.orchestra.run.smithi049.stdout: "client_mount_timeout": "300", 2024-04-26T10:42:45.597 INFO:teuthology.orchestra.run.smithi049.stdout: "client_mount_uid": "-1", 2024-04-26T10:42:45.597 INFO:teuthology.orchestra.run.smithi049.stdout: "client_mountpoint": "/", 2024-04-26T10:42:45.597 INFO:teuthology.orchestra.run.smithi049.stdout: "client_notify_timeout": "10", 2024-04-26T10:42:45.597 INFO:teuthology.orchestra.run.smithi049.stdout: "client_oc": "true", 2024-04-26T10:42:45.597 INFO:teuthology.orchestra.run.smithi049.stdout: "client_oc_max_dirty": "104857600", 2024-04-26T10:42:45.597 INFO:teuthology.orchestra.run.smithi049.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-26T10:42:45.597 INFO:teuthology.orchestra.run.smithi049.stdout: "client_oc_max_objects": "1000", 2024-04-26T10:42:45.597 INFO:teuthology.orchestra.run.smithi049.stdout: "client_oc_size": "209715200", 2024-04-26T10:42:45.597 INFO:teuthology.orchestra.run.smithi049.stdout: "client_oc_target_dirty": "8388608", 2024-04-26T10:42:45.597 INFO:teuthology.orchestra.run.smithi049.stdout: "client_permissions": "true", 2024-04-26T10:42:45.598 INFO:teuthology.orchestra.run.smithi049.stdout: "client_quota": "true", 2024-04-26T10:42:45.598 INFO:teuthology.orchestra.run.smithi049.stdout: "client_quota_df": "true", 2024-04-26T10:42:45.598 INFO:teuthology.orchestra.run.smithi049.stdout: "client_readahead_max_bytes": "0", 2024-04-26T10:42:45.598 INFO:teuthology.orchestra.run.smithi049.stdout: "client_readahead_max_periods": "4", 2024-04-26T10:42:45.598 INFO:teuthology.orchestra.run.smithi049.stdout: "client_readahead_min": "131072", 2024-04-26T10:42:45.598 INFO:teuthology.orchestra.run.smithi049.stdout: "client_reconnect_stale": "false", 2024-04-26T10:42:45.598 INFO:teuthology.orchestra.run.smithi049.stdout: "client_shutdown_timeout": "30", 2024-04-26T10:42:45.598 INFO:teuthology.orchestra.run.smithi049.stdout: "client_snapdir": ".snap", 2024-04-26T10:42:45.598 INFO:teuthology.orchestra.run.smithi049.stdout: "client_tick_interval": "1", 2024-04-26T10:42:45.598 INFO:teuthology.orchestra.run.smithi049.stdout: "client_trace": "", 2024-04-26T10:42:45.598 INFO:teuthology.orchestra.run.smithi049.stdout: "client_try_dentry_invalidate": "false", 2024-04-26T10:42:45.598 INFO:teuthology.orchestra.run.smithi049.stdout: "client_use_faked_inos": "false", 2024-04-26T10:42:45.598 INFO:teuthology.orchestra.run.smithi049.stdout: "client_use_random_mds": "false", 2024-04-26T10:42:45.598 INFO:teuthology.orchestra.run.smithi049.stdout: "clog_to_graylog": "false", 2024-04-26T10:42:45.599 INFO:teuthology.orchestra.run.smithi049.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-26T10:42:45.599 INFO:teuthology.orchestra.run.smithi049.stdout: "clog_to_graylog_port": "12201", 2024-04-26T10:42:45.599 INFO:teuthology.orchestra.run.smithi049.stdout: "clog_to_monitors": "default=true", 2024-04-26T10:42:45.599 INFO:teuthology.orchestra.run.smithi049.stdout: "clog_to_syslog": "false", 2024-04-26T10:42:45.599 INFO:teuthology.orchestra.run.smithi049.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-26T10:42:45.599 INFO:teuthology.orchestra.run.smithi049.stdout: "clog_to_syslog_level": "info", 2024-04-26T10:42:45.599 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "-", 2024-04-26T10:42:45.599 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_network": "", 2024-04-26T10:42:45.599 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_network_interface": "", 2024-04-26T10:42:45.599 INFO:teuthology.orchestra.run.smithi049.stdout: "compressor_zlib_isal": "false", 2024-04-26T10:42:45.599 INFO:teuthology.orchestra.run.smithi049.stdout: "compressor_zlib_level": "5", 2024-04-26T10:42:45.599 INFO:teuthology.orchestra.run.smithi049.stdout: "compressor_zlib_winsize": "-15", 2024-04-26T10:42:45.599 INFO:teuthology.orchestra.run.smithi049.stdout: "compressor_zstd_level": "1", 2024-04-26T10:42:45.599 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-26T10:42:45.600 INFO:teuthology.orchestra.run.smithi049.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-26T10:42:45.600 INFO:teuthology.orchestra.run.smithi049.stdout: "crimson_alien_op_num_threads": "6", 2024-04-26T10:42:45.600 INFO:teuthology.orchestra.run.smithi049.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-26T10:42:45.600 INFO:teuthology.orchestra.run.smithi049.stdout: "crimson_osd_obc_lru_size": "10", 2024-04-26T10:42:45.600 INFO:teuthology.orchestra.run.smithi049.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-26T10:42:45.600 INFO:teuthology.orchestra.run.smithi049.stdout: "crimson_seastar_smp": "1", 2024-04-26T10:42:45.600 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_location": "", 2024-04-26T10:42:45.600 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_location_hook": "", 2024-04-26T10:42:45.600 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_location_hook_timeout": "10", 2024-04-26T10:42:45.600 INFO:teuthology.orchestra.run.smithi049.stdout: "daemonize": "false", 2024-04-26T10:42:45.600 INFO:teuthology.orchestra.run.smithi049.stdout: "daos_pool": "tank", 2024-04-26T10:42:45.600 INFO:teuthology.orchestra.run.smithi049.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-26T10:42:45.600 INFO:teuthology.orchestra.run.smithi049.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-26T10:42:45.600 INFO:teuthology.orchestra.run.smithi049.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-26T10:42:45.601 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_alienstore": "0/5", 2024-04-26T10:42:45.601 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_allow_any_pool_priority": "false", 2024-04-26T10:42:45.601 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_asok": "1/5", 2024-04-26T10:42:45.601 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_asok_assert_abort": "false", 2024-04-26T10:42:45.601 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_asserts_on_shutdown": "true", 2024-04-26T10:42:45.601 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_auth": "20/20", 2024-04-26T10:42:45.601 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_bdev": "1/3", 2024-04-26T10:42:45.601 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_bluefs": "1/5", 2024-04-26T10:42:45.601 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_bluestore": "1/5", 2024-04-26T10:42:45.601 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_buffer": "0/1", 2024-04-26T10:42:45.601 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_ceph_exporter": "1/5", 2024-04-26T10:42:45.601 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_cephfs_mirror": "0/5", 2024-04-26T10:42:45.601 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_cephsqlite": "0/5", 2024-04-26T10:42:45.601 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_client": "0/5", 2024-04-26T10:42:45.602 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_compressor": "1/5", 2024-04-26T10:42:45.602 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_context": "0/1", 2024-04-26T10:42:45.602 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_crush": "1/1", 2024-04-26T10:42:45.602 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_crypto": "1/5", 2024-04-26T10:42:45.602 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_cyanstore": "0/5", 2024-04-26T10:42:45.602 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_deliberately_leak_memory": "false", 2024-04-26T10:42:45.602 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_disable_randomized_ping": "false", 2024-04-26T10:42:45.602 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_dpdk": "1/5", 2024-04-26T10:42:45.602 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_eventtrace": "1/5", 2024-04-26T10:42:45.602 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_filer": "0/1", 2024-04-26T10:42:45.602 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_filestore": "1/3", 2024-04-26T10:42:45.602 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_finisher": "1/1", 2024-04-26T10:42:45.602 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_fuse": "1/5", 2024-04-26T10:42:45.603 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_heartbeat_testing_span": "0", 2024-04-26T10:42:45.603 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_heartbeatmap": "1/5", 2024-04-26T10:42:45.603 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-26T10:42:45.603 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_javaclient": "1/5", 2024-04-26T10:42:45.603 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_journal": "1/3", 2024-04-26T10:42:45.603 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_journaler": "0/5", 2024-04-26T10:42:45.603 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_kstore": "1/5", 2024-04-26T10:42:45.603 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_leveldb": "4/5", 2024-04-26T10:42:45.603 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_lockdep": "0/1", 2024-04-26T10:42:45.603 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_mclock": "1/5", 2024-04-26T10:42:45.603 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_mds": "1/5", 2024-04-26T10:42:45.603 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_mds_balancer": "1/5", 2024-04-26T10:42:45.603 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_mds_locker": "1/5", 2024-04-26T10:42:45.603 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_mds_log": "1/5", 2024-04-26T10:42:45.603 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_mds_log_expire": "1/5", 2024-04-26T10:42:45.604 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_mds_migrator": "1/5", 2024-04-26T10:42:45.604 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_memstore": "1/5", 2024-04-26T10:42:45.604 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_mgr": "2/5", 2024-04-26T10:42:45.604 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_mgrc": "1/5", 2024-04-26T10:42:45.604 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_mon": "20/20", 2024-04-26T10:42:45.604 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_monc": "0/10", 2024-04-26T10:42:45.604 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_ms": "1/1", 2024-04-26T10:42:45.604 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_none": "0/5", 2024-04-26T10:42:45.604 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_objclass": "0/5", 2024-04-26T10:42:45.604 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_objectcacher": "0/5", 2024-04-26T10:42:45.604 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_objecter": "0/1", 2024-04-26T10:42:45.604 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_optracker": "0/5", 2024-04-26T10:42:45.604 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_osd": "1/5", 2024-04-26T10:42:45.604 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_paxos": "20/20", 2024-04-26T10:42:45.605 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_perfcounter": "1/5", 2024-04-26T10:42:45.605 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_prioritycache": "1/5", 2024-04-26T10:42:45.605 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_rados": "0/5", 2024-04-26T10:42:45.605 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_rbd": "0/5", 2024-04-26T10:42:45.605 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_rbd_mirror": "0/5", 2024-04-26T10:42:45.605 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_rbd_pwl": "0/5", 2024-04-26T10:42:45.605 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_rbd_replay": "0/5", 2024-04-26T10:42:45.605 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_refs": "0/0", 2024-04-26T10:42:45.605 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_reserver": "1/1", 2024-04-26T10:42:45.605 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_rgw": "1/5", 2024-04-26T10:42:45.605 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_rgw_access": "1/5", 2024-04-26T10:42:45.605 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_rgw_datacache": "1/5", 2024-04-26T10:42:45.605 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_rgw_dbstore": "1/5", 2024-04-26T10:42:45.605 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_rgw_flight": "1/5", 2024-04-26T10:42:45.606 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_rgw_sync": "1/5", 2024-04-26T10:42:45.606 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_rocksdb": "4/5", 2024-04-26T10:42:45.606 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_seastore": "0/5", 2024-04-26T10:42:45.606 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_seastore_backref": "0/5", 2024-04-26T10:42:45.606 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_seastore_cache": "0/5", 2024-04-26T10:42:45.606 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_seastore_cleaner": "0/5", 2024-04-26T10:42:45.606 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_seastore_device": "0/5", 2024-04-26T10:42:45.606 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_seastore_epm": "0/5", 2024-04-26T10:42:45.606 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-26T10:42:45.606 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_seastore_journal": "0/5", 2024-04-26T10:42:45.606 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_seastore_lba": "0/5", 2024-04-26T10:42:45.606 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_seastore_odata": "0/5", 2024-04-26T10:42:45.606 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_seastore_omap": "0/5", 2024-04-26T10:42:45.606 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_seastore_onode": "0/5", 2024-04-26T10:42:45.607 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_seastore_t": "0/5", 2024-04-26T10:42:45.607 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_seastore_tm": "0/5", 2024-04-26T10:42:45.607 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_striper": "0/1", 2024-04-26T10:42:45.607 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_test": "0/5", 2024-04-26T10:42:45.607 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_throttle": "1/1", 2024-04-26T10:42:45.607 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_timer": "0/1", 2024-04-26T10:42:45.607 INFO:teuthology.orchestra.run.smithi049.stdout: "debug_tp": "0/5", 2024-04-26T10:42:45.607 INFO:teuthology.orchestra.run.smithi049.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-26T10:42:45.607 INFO:teuthology.orchestra.run.smithi049.stdout: "device_failure_prediction_mode": "none", 2024-04-26T10:42:45.607 INFO:teuthology.orchestra.run.smithi049.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-26T10:42:45.607 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-04-26T10:42:45.607 INFO:teuthology.orchestra.run.smithi049.stdout: "err_to_graylog": "false", 2024-04-26T10:42:45.607 INFO:teuthology.orchestra.run.smithi049.stdout: "err_to_journald": "false", 2024-04-26T10:42:45.608 INFO:teuthology.orchestra.run.smithi049.stdout: "err_to_stderr": "true", 2024-04-26T10:42:45.608 INFO:teuthology.orchestra.run.smithi049.stdout: "err_to_syslog": "false", 2024-04-26T10:42:45.608 INFO:teuthology.orchestra.run.smithi049.stdout: "event_tracing": "false", 2024-04-26T10:42:45.608 INFO:teuthology.orchestra.run.smithi049.stdout: "exporter_addr": "0.0.0.0", 2024-04-26T10:42:45.608 INFO:teuthology.orchestra.run.smithi049.stdout: "exporter_http_port": "9926", 2024-04-26T10:42:45.608 INFO:teuthology.orchestra.run.smithi049.stdout: "exporter_prio_limit": "5", 2024-04-26T10:42:45.608 INFO:teuthology.orchestra.run.smithi049.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-26T10:42:45.608 INFO:teuthology.orchestra.run.smithi049.stdout: "exporter_sort_metrics": "true", 2024-04-26T10:42:45.608 INFO:teuthology.orchestra.run.smithi049.stdout: "exporter_stats_period": "5", 2024-04-26T10:42:45.608 INFO:teuthology.orchestra.run.smithi049.stdout: "fake_statfs_for_testing": "0", 2024-04-26T10:42:45.608 INFO:teuthology.orchestra.run.smithi049.stdout: "fatal_signal_handlers": "true", 2024-04-26T10:42:45.608 INFO:teuthology.orchestra.run.smithi049.stdout: "filer_max_purge_ops": "10", 2024-04-26T10:42:45.608 INFO:teuthology.orchestra.run.smithi049.stdout: "filer_max_truncate_ops": "128", 2024-04-26T10:42:45.608 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_apply_finisher_threads": "1", 2024-04-26T10:42:45.608 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_blackhole": "false", 2024-04-26T10:42:45.609 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_btrfs_clone_range": "true", 2024-04-26T10:42:45.609 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_btrfs_snap": "true", 2024-04-26T10:42:45.609 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_caller_concurrency": "10", 2024-04-26T10:42:45.609 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_collect_device_partition_information": "true", 2024-04-26T10:42:45.609 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_commit_timeout": "600.000000", 2024-04-26T10:42:45.609 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_debug_inject_read_err": "false", 2024-04-26T10:42:45.609 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_debug_omap_check": "false", 2024-04-26T10:42:45.609 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-26T10:42:45.609 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_debug_verify_split": "false", 2024-04-26T10:42:45.609 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_dump_file": "", 2024-04-26T10:42:45.609 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-26T10:42:45.609 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-26T10:42:45.610 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_fadvise": "true", 2024-04-26T10:42:45.610 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_fail_eio": "true", 2024-04-26T10:42:45.610 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_fd_cache_shards": "16", 2024-04-26T10:42:45.610 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_fd_cache_size": "128", 2024-04-26T10:42:45.610 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_fiemap": "false", 2024-04-26T10:42:45.610 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_fiemap_threshold": "4096", 2024-04-26T10:42:45.610 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-26T10:42:45.610 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-26T10:42:45.610 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_inject_stall": "0", 2024-04-26T10:42:45.610 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_journal_parallel": "false", 2024-04-26T10:42:45.610 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_journal_trailing": "false", 2024-04-26T10:42:45.610 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_journal_writeahead": "false", 2024-04-26T10:42:45.611 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_kill_at": "0", 2024-04-26T10:42:45.611 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-26T10:42:45.611 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-26T10:42:45.611 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-26T10:42:45.611 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-26T10:42:45.611 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-26T10:42:45.611 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_max_inline_xattrs": "0", 2024-04-26T10:42:45.611 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-26T10:42:45.611 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-26T10:42:45.611 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-26T10:42:45.611 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-26T10:42:45.611 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_max_xattr_value_size": "0", 2024-04-26T10:42:45.611 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-26T10:42:45.611 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-26T10:42:45.612 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-26T10:42:45.612 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_merge_threshold": "-10", 2024-04-26T10:42:45.612 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-26T10:42:45.612 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_odsync_write": "false", 2024-04-26T10:42:45.612 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_omap_backend": "rocksdb", 2024-04-26T10:42:45.612 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_omap_backend_path": "", 2024-04-26T10:42:45.612 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-26T10:42:45.612 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-26T10:42:45.612 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-26T10:42:45.612 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_op_thread_timeout": "60", 2024-04-26T10:42:45.612 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_op_threads": "2", 2024-04-26T10:42:45.612 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_punch_hole": "false", 2024-04-26T10:42:45.612 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-26T10:42:45.612 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-26T10:42:45.613 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-26T10:42:45.613 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-26T10:42:45.613 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-26T10:42:45.613 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-26T10:42:45.613 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-26T10:42:45.613 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-26T10:42:45.613 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-26T10:42:45.613 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_queue_max_ops": "50", 2024-04-26T10:42:45.613 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-26T10:42:45.613 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_seek_data_hole": "false", 2024-04-26T10:42:45.613 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_sloppy_crc": "false", 2024-04-26T10:42:45.613 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-26T10:42:45.613 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_splice": "false", 2024-04-26T10:42:45.614 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_split_multiple": "2", 2024-04-26T10:42:45.614 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_split_rand_factor": "20", 2024-04-26T10:42:45.614 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_update_to": "1000", 2024-04-26T10:42:45.614 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-26T10:42:45.614 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-26T10:42:45.614 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-26T10:42:45.614 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-26T10:42:45.614 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-26T10:42:45.614 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-26T10:42:45.614 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_wbthrottle_enable": "true", 2024-04-26T10:42:45.614 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-26T10:42:45.614 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-26T10:42:45.614 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-26T10:42:45.615 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-26T10:42:45.615 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-26T10:42:45.615 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-26T10:42:45.615 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_xfs_extsize": "false", 2024-04-26T10:42:45.615 INFO:teuthology.orchestra.run.smithi049.stdout: "filestore_zfs_snap": "false", 2024-04-26T10:42:45.615 INFO:teuthology.orchestra.run.smithi049.stdout: "fio_dir": "/tmp/fio", 2024-04-26T10:42:45.615 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "9837de44-a9e8-4979-adc4-611f3ddc44ce", 2024-04-26T10:42:45.615 INFO:teuthology.orchestra.run.smithi049.stdout: "fuse_allow_other": "true", 2024-04-26T10:42:45.615 INFO:teuthology.orchestra.run.smithi049.stdout: "fuse_atomic_o_trunc": "true", 2024-04-26T10:42:45.615 INFO:teuthology.orchestra.run.smithi049.stdout: "fuse_big_writes": "true", 2024-04-26T10:42:45.615 INFO:teuthology.orchestra.run.smithi049.stdout: "fuse_debug": "false", 2024-04-26T10:42:45.615 INFO:teuthology.orchestra.run.smithi049.stdout: "fuse_default_permissions": "false", 2024-04-26T10:42:45.616 INFO:teuthology.orchestra.run.smithi049.stdout: "fuse_disable_pagecache": "false", 2024-04-26T10:42:45.616 INFO:teuthology.orchestra.run.smithi049.stdout: "fuse_max_write": "0", 2024-04-26T10:42:45.616 INFO:teuthology.orchestra.run.smithi049.stdout: "fuse_multithreaded": "true", 2024-04-26T10:42:45.616 INFO:teuthology.orchestra.run.smithi049.stdout: "fuse_require_active_mds": "true", 2024-04-26T10:42:45.616 INFO:teuthology.orchestra.run.smithi049.stdout: "fuse_set_user_groups": "true", 2024-04-26T10:42:45.616 INFO:teuthology.orchestra.run.smithi049.stdout: "fuse_splice_move": "true", 2024-04-26T10:42:45.616 INFO:teuthology.orchestra.run.smithi049.stdout: "fuse_splice_read": "true", 2024-04-26T10:42:45.616 INFO:teuthology.orchestra.run.smithi049.stdout: "fuse_splice_write": "true", 2024-04-26T10:42:45.616 INFO:teuthology.orchestra.run.smithi049.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-26T10:42:45.616 INFO:teuthology.orchestra.run.smithi049.stdout: "fuse_use_invalidate_cb": "true", 2024-04-26T10:42:45.616 INFO:teuthology.orchestra.run.smithi049.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-26T10:42:45.616 INFO:teuthology.orchestra.run.smithi049.stdout: "gss_target_name": "ceph", 2024-04-26T10:42:45.616 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_file": "", 2024-04-26T10:42:45.616 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_inject_failure": "0", 2024-04-26T10:42:45.617 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_interval": "5", 2024-04-26T10:42:45.617 INFO:teuthology.orchestra.run.smithi049.stdout: "host": "smithi049", 2024-04-26T10:42:45.617 INFO:teuthology.orchestra.run.smithi049.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-26T10:42:45.617 INFO:teuthology.orchestra.run.smithi049.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-26T10:42:45.617 INFO:teuthology.orchestra.run.smithi049.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-26T10:42:45.617 INFO:teuthology.orchestra.run.smithi049.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-26T10:42:45.617 INFO:teuthology.orchestra.run.smithi049.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-26T10:42:45.617 INFO:teuthology.orchestra.run.smithi049.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-26T10:42:45.617 INFO:teuthology.orchestra.run.smithi049.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-26T10:42:45.617 INFO:teuthology.orchestra.run.smithi049.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-26T10:42:45.617 INFO:teuthology.orchestra.run.smithi049.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-26T10:42:45.618 INFO:teuthology.orchestra.run.smithi049.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-26T10:42:45.618 INFO:teuthology.orchestra.run.smithi049.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-26T10:42:45.618 INFO:teuthology.orchestra.run.smithi049.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-26T10:42:45.618 INFO:teuthology.orchestra.run.smithi049.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-26T10:42:45.619 INFO:teuthology.orchestra.run.smithi049.stdout: "inject_early_sigterm": "false", 2024-04-26T10:42:45.619 INFO:teuthology.orchestra.run.smithi049.stdout: "jaeger_agent_port": "6799", 2024-04-26T10:42:45.619 INFO:teuthology.orchestra.run.smithi049.stdout: "jaeger_tracing_enable": "false", 2024-04-26T10:42:45.619 INFO:teuthology.orchestra.run.smithi049.stdout: "journal_aio": "true", 2024-04-26T10:42:45.619 INFO:teuthology.orchestra.run.smithi049.stdout: "journal_align_min_size": "65536", 2024-04-26T10:42:45.619 INFO:teuthology.orchestra.run.smithi049.stdout: "journal_block_align": "true", 2024-04-26T10:42:45.619 INFO:teuthology.orchestra.run.smithi049.stdout: "journal_block_size": "4096", 2024-04-26T10:42:45.619 INFO:teuthology.orchestra.run.smithi049.stdout: "journal_dio": "true", 2024-04-26T10:42:45.619 INFO:teuthology.orchestra.run.smithi049.stdout: "journal_discard": "false", 2024-04-26T10:42:45.619 INFO:teuthology.orchestra.run.smithi049.stdout: "journal_force_aio": "false", 2024-04-26T10:42:45.619 INFO:teuthology.orchestra.run.smithi049.stdout: "journal_ignore_corruption": "false", 2024-04-26T10:42:45.619 INFO:teuthology.orchestra.run.smithi049.stdout: "journal_max_write_bytes": "10485760", 2024-04-26T10:42:45.619 INFO:teuthology.orchestra.run.smithi049.stdout: "journal_max_write_entries": "100", 2024-04-26T10:42:45.619 INFO:teuthology.orchestra.run.smithi049.stdout: "journal_replay_from": "0", 2024-04-26T10:42:45.620 INFO:teuthology.orchestra.run.smithi049.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-26T10:42:45.620 INFO:teuthology.orchestra.run.smithi049.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-26T10:42:45.620 INFO:teuthology.orchestra.run.smithi049.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-26T10:42:45.620 INFO:teuthology.orchestra.run.smithi049.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-26T10:42:45.620 INFO:teuthology.orchestra.run.smithi049.stdout: "journal_write_header_frequency": "0", 2024-04-26T10:42:45.620 INFO:teuthology.orchestra.run.smithi049.stdout: "journal_zero_on_create": "false", 2024-04-26T10:42:45.620 INFO:teuthology.orchestra.run.smithi049.stdout: "journaler_prefetch_periods": "10", 2024-04-26T10:42:45.620 INFO:teuthology.orchestra.run.smithi049.stdout: "journaler_prezero_periods": "5", 2024-04-26T10:42:45.620 INFO:teuthology.orchestra.run.smithi049.stdout: "journaler_write_head_interval": "15", 2024-04-26T10:42:45.620 INFO:teuthology.orchestra.run.smithi049.stdout: "key": "", 2024-04-26T10:42:45.620 INFO:teuthology.orchestra.run.smithi049.stdout: "keyfile": "", 2024-04-26T10:42:45.620 INFO:teuthology.orchestra.run.smithi049.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-26T10:42:45.620 INFO:teuthology.orchestra.run.smithi049.stdout: "kstore_backend": "rocksdb", 2024-04-26T10:42:45.620 INFO:teuthology.orchestra.run.smithi049.stdout: "kstore_default_stripe_size": "65536", 2024-04-26T10:42:45.621 INFO:teuthology.orchestra.run.smithi049.stdout: "kstore_fsck_on_mount": "false", 2024-04-26T10:42:45.621 INFO:teuthology.orchestra.run.smithi049.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-26T10:42:45.621 INFO:teuthology.orchestra.run.smithi049.stdout: "kstore_max_bytes": "67108864", 2024-04-26T10:42:45.621 INFO:teuthology.orchestra.run.smithi049.stdout: "kstore_max_ops": "512", 2024-04-26T10:42:45.621 INFO:teuthology.orchestra.run.smithi049.stdout: "kstore_nid_prealloc": "1024", 2024-04-26T10:42:45.621 INFO:teuthology.orchestra.run.smithi049.stdout: "kstore_onode_map_size": "1024", 2024-04-26T10:42:45.621 INFO:teuthology.orchestra.run.smithi049.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-26T10:42:45.621 INFO:teuthology.orchestra.run.smithi049.stdout: "kstore_sync_submit_transaction": "false", 2024-04-26T10:42:45.621 INFO:teuthology.orchestra.run.smithi049.stdout: "kstore_sync_transaction": "false", 2024-04-26T10:42:45.621 INFO:teuthology.orchestra.run.smithi049.stdout: "leveldb_block_size": "65536", 2024-04-26T10:42:45.621 INFO:teuthology.orchestra.run.smithi049.stdout: "leveldb_bloom_size": "0", 2024-04-26T10:42:45.621 INFO:teuthology.orchestra.run.smithi049.stdout: "leveldb_cache_size": "536870912", 2024-04-26T10:42:45.621 INFO:teuthology.orchestra.run.smithi049.stdout: "leveldb_compact_on_mount": "false", 2024-04-26T10:42:45.621 INFO:teuthology.orchestra.run.smithi049.stdout: "leveldb_compression": "false", 2024-04-26T10:42:45.622 INFO:teuthology.orchestra.run.smithi049.stdout: "leveldb_log": "", 2024-04-26T10:42:45.622 INFO:teuthology.orchestra.run.smithi049.stdout: "leveldb_log_to_ceph_log": "true", 2024-04-26T10:42:45.622 INFO:teuthology.orchestra.run.smithi049.stdout: "leveldb_max_open_files": "0", 2024-04-26T10:42:45.622 INFO:teuthology.orchestra.run.smithi049.stdout: "leveldb_paranoid": "false", 2024-04-26T10:42:45.622 INFO:teuthology.orchestra.run.smithi049.stdout: "leveldb_write_buffer_size": "33554432", 2024-04-26T10:42:45.622 INFO:teuthology.orchestra.run.smithi049.stdout: "librados_thread_count": "2", 2024-04-26T10:42:45.622 INFO:teuthology.orchestra.run.smithi049.stdout: "lockdep": "false", 2024-04-26T10:42:45.622 INFO:teuthology.orchestra.run.smithi049.stdout: "lockdep_force_backtrace": "false", 2024-04-26T10:42:45.622 INFO:teuthology.orchestra.run.smithi049.stdout: "log_coarse_timestamps": "true", 2024-04-26T10:42:45.622 INFO:teuthology.orchestra.run.smithi049.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-26T10:42:45.622 INFO:teuthology.orchestra.run.smithi049.stdout: "log_flush_on_exit": "false", 2024-04-26T10:42:45.622 INFO:teuthology.orchestra.run.smithi049.stdout: "log_graylog_host": "127.0.0.1", 2024-04-26T10:42:45.622 INFO:teuthology.orchestra.run.smithi049.stdout: "log_graylog_port": "12201", 2024-04-26T10:42:45.623 INFO:teuthology.orchestra.run.smithi049.stdout: "log_max_new": "1000", 2024-04-26T10:42:45.623 INFO:teuthology.orchestra.run.smithi049.stdout: "log_max_recent": "10000", 2024-04-26T10:42:45.623 INFO:teuthology.orchestra.run.smithi049.stdout: "log_stderr_prefix": "", 2024-04-26T10:42:45.623 INFO:teuthology.orchestra.run.smithi049.stdout: "log_stop_at_utilization": "0.970000", 2024-04-26T10:42:45.623 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": "true", 2024-04-26T10:42:45.623 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_graylog": "false", 2024-04-26T10:42:45.623 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_journald": "false", 2024-04-26T10:42:45.623 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_stderr": "false", 2024-04-26T10:42:45.623 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_syslog": "false", 2024-04-26T10:42:45.623 INFO:teuthology.orchestra.run.smithi049.stdout: "max_rotating_auth_attempts": "10", 2024-04-26T10:42:45.623 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-26T10:42:45.623 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_action_on_write_error": "1", 2024-04-26T10:42:45.623 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_alternate_name_max": "8192", 2024-04-26T10:42:45.624 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_asio_thread_count": "2", 2024-04-26T10:42:45.624 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_export_pin": "true", 2024-04-26T10:42:45.624 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_fragment_dirs": "true", 2024-04-26T10:42:45.624 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-26T10:42:45.624 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_fragment_interval": "5", 2024-04-26T10:42:45.624 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-26T10:42:45.624 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-26T10:42:45.624 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_interval": "10", 2024-04-26T10:42:45.624 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_max": "-1", 2024-04-26T10:42:45.624 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_max_until": "-1", 2024-04-26T10:42:45.624 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_merge_size": "50", 2024-04-26T10:42:45.624 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_midchunk": "0.300000", 2024-04-26T10:42:45.624 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-26T10:42:45.625 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_min_start": "0.200000", 2024-04-26T10:42:45.625 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_minchunk": "0.001000", 2024-04-26T10:42:45.625 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_mode": "0", 2024-04-26T10:42:45.625 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_need_max": "1.200000", 2024-04-26T10:42:45.625 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_need_min": "0.800000", 2024-04-26T10:42:45.625 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-26T10:42:45.625 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-26T10:42:45.625 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_split_bits": "3", 2024-04-26T10:42:45.625 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-26T10:42:45.625 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_split_size": "10000", 2024-04-26T10:42:45.625 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-26T10:42:45.625 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_target_decay": "10.000000", 2024-04-26T10:42:45.625 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-26T10:42:45.625 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_beacon_grace": "15.000000", 2024-04-26T10:42:45.626 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_beacon_interval": "4.000000", 2024-04-26T10:42:45.626 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-26T10:42:45.626 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-26T10:42:45.626 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_cache_mid": "0.700000", 2024-04-26T10:42:45.626 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_cache_release_free_interval": "10", 2024-04-26T10:42:45.626 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_cache_reservation": "0.050000", 2024-04-26T10:42:45.626 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-26T10:42:45.626 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_cache_trim_interval": "1", 2024-04-26T10:42:45.626 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_cache_trim_threshold": "262144", 2024-04-26T10:42:45.626 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-26T10:42:45.626 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-26T10:42:45.626 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-26T10:42:45.627 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_client_prealloc_inos": "1000", 2024-04-26T10:42:45.627 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-26T10:42:45.627 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_connect_bootstrapping": "false", 2024-04-26T10:42:45.627 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_damage_table_max_entries": "10000", 2024-04-26T10:42:45.627 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-26T10:42:45.627 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_debug_auth_pins": "false", 2024-04-26T10:42:45.627 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_debug_frag": "false", 2024-04-26T10:42:45.627 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_debug_scatterstat": "false", 2024-04-26T10:42:45.627 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_debug_subtrees": "false", 2024-04-26T10:42:45.627 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_decay_halflife": "5.000000", 2024-04-26T10:42:45.627 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_default_dir_hash": "2", 2024-04-26T10:42:45.627 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_defer_session_stale": "true", 2024-04-26T10:42:45.627 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_deny_all_reconnect": "false", 2024-04-26T10:42:45.628 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_dir_keys_per_op": "16384", 2024-04-26T10:42:45.628 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_dir_max_commit_size": "10", 2024-04-26T10:42:45.628 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_dir_max_entries": "0", 2024-04-26T10:42:45.628 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_dir_prefetch": "true", 2024-04-26T10:42:45.628 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-26T10:42:45.628 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-26T10:42:45.628 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_dump_cache_on_map": "false", 2024-04-26T10:42:45.628 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-26T10:42:45.628 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-26T10:42:45.628 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_early_reply": "true", 2024-04-26T10:42:45.628 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_enable_op_tracker": "true", 2024-04-26T10:42:45.628 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_enforce_unique_name": "true", 2024-04-26T10:42:45.628 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-26T10:42:45.628 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-26T10:42:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_export_ephemeral_random": "true", 2024-04-26T10:42:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-26T10:42:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-26T10:42:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-26T10:42:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-26T10:42:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-26T10:42:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-26T10:42:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-26T10:42:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-26T10:42:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_health_summarize_threshold": "10", 2024-04-26T10:42:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-26T10:42:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-26T10:42:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_inject_health_dummy": "false", 2024-04-26T10:42:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-26T10:42:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_inject_migrator_session_race": "false", 2024-04-26T10:42:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-26T10:42:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-26T10:42:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-26T10:42:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_join_fs": "", 2024-04-26T10:42:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_journal_format": "1", 2024-04-26T10:42:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_kill_create_at": "0", 2024-04-26T10:42:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_kill_export_at": "0", 2024-04-26T10:42:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_kill_import_at": "0", 2024-04-26T10:42:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_kill_journal_at": "0", 2024-04-26T10:42:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_kill_journal_expire_at": "0", 2024-04-26T10:42:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_kill_journal_replay_at": "0", 2024-04-26T10:42:45.630 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_kill_link_at": "0", 2024-04-26T10:42:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_kill_mdstable_at": "0", 2024-04-26T10:42:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_kill_openc_at": "0", 2024-04-26T10:42:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_kill_rename_at": "0", 2024-04-26T10:42:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-26T10:42:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_log_events_per_segment": "1024", 2024-04-26T10:42:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_log_max_events": "-1", 2024-04-26T10:42:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_log_max_segments": "128", 2024-04-26T10:42:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_log_pause": "false", 2024-04-26T10:42:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_log_segment_size": "0", 2024-04-26T10:42:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-26T10:42:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_log_warn_factor": "2.000000", 2024-04-26T10:42:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_max_caps_per_client": "1048576", 2024-04-26T10:42:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_max_completed_flushes": "100000", 2024-04-26T10:42:45.631 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_max_completed_requests": "100000", 2024-04-26T10:42:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_max_export_size": "20971520", 2024-04-26T10:42:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_max_file_recover": "32", 2024-04-26T10:42:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_max_purge_files": "64", 2024-04-26T10:42:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_max_purge_ops": "8192", 2024-04-26T10:42:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-26T10:42:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-26T10:42:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_max_snaps_per_dir": "100", 2024-04-26T10:42:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_metrics_update_interval": "2", 2024-04-26T10:42:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_min_caps_per_client": "100", 2024-04-26T10:42:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_min_caps_working_set": "10000", 2024-04-26T10:42:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-26T10:42:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_numa_node": "-1", 2024-04-26T10:42:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-26T10:42:45.632 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_op_complaint_time": "30.000000", 2024-04-26T10:42:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_op_history_duration": "600", 2024-04-26T10:42:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_op_history_size": "20", 2024-04-26T10:42:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_op_history_slow_op_size": "20", 2024-04-26T10:42:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-26T10:42:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_op_log_threshold": "5", 2024-04-26T10:42:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_ping_grace": "15", 2024-04-26T10:42:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_ping_interval": "5", 2024-04-26T10:42:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-26T10:42:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-26T10:42:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_recall_max_caps": "30000", 2024-04-26T10:42:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-26T10:42:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-26T10:42:45.633 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-26T10:42:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_recall_warning_threshold": "262144", 2024-04-26T10:42:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-26T10:42:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_replay_interval": "1.000000", 2024-04-26T10:42:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-26T10:42:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-26T10:42:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_root_ino_gid": "0", 2024-04-26T10:42:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_root_ino_uid": "0", 2024-04-26T10:42:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-26T10:42:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-26T10:42:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-26T10:42:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-26T10:42:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-26T10:42:45.634 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-26T10:42:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-26T10:42:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-26T10:42:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-26T10:42:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-26T10:42:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_shutdown_check": "0", 2024-04-26T10:42:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_skip_ino": "0", 2024-04-26T10:42:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-26T10:42:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_snap_max_uid": "4294967294", 2024-04-26T10:42:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_snap_min_uid": "0", 2024-04-26T10:42:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_snap_rstat": "false", 2024-04-26T10:42:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_standby_replay_damaged": "false", 2024-04-26T10:42:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_symlink_recovery": "true", 2024-04-26T10:42:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-26T10:42:45.635 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_thrash_exports": "0", 2024-04-26T10:42:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_thrash_fragments": "0", 2024-04-26T10:42:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_tick_interval": "5.000000", 2024-04-26T10:42:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_valgrind_exit": "false", 2024-04-26T10:42:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_verify_backtrace": "1", 2024-04-26T10:42:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_verify_scatter": "false", 2024-04-26T10:42:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-26T10:42:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_wipe_sessions": "false", 2024-04-26T10:42:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool_debug": "false", 2024-04-26T10:42:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-26T10:42:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "memstore_device_bytes": "1073741824", 2024-04-26T10:42:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "memstore_page_set": "false", 2024-04-26T10:42:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "memstore_page_size": "65536", 2024-04-26T10:42:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_client_bytes": "134217728", 2024-04-26T10:42:45.636 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_client_messages": "512", 2024-04-26T10:42:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-26T10:42:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-26T10:42:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-26T10:42:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-26T10:42:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_disabled_modules": "", 2024-04-26T10:42:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-26T10:42:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_max_pg_num_change": "128", 2024-04-26T10:42:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_mds_bytes": "134217728", 2024-04-26T10:42:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_mds_messages": "128", 2024-04-26T10:42:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-26T10:42:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_mon_bytes": "134217728", 2024-04-26T10:42:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_mon_messages": "128", 2024-04-26T10:42:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_osd_bytes": "536870912", 2024-04-26T10:42:45.637 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_osd_messages": "8192", 2024-04-26T10:42:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_pool": "true", 2024-04-26T10:42:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-26T10:42:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_standby_modules": "true", 2024-04-26T10:42:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_stats_period": "5", 2024-04-26T10:42:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_stats_threshold": "5", 2024-04-26T10:42:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_tick_period": "2", 2024-04-26T10:42:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-26T10:42:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-26T10:42:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_allow_pool_delete": "true", 2024-04-26T10:42:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_allow_pool_size_one": "true", 2024-04-26T10:42:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_auth_validate_all_caps": "true", 2024-04-26T10:42:45.638 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-26T10:42:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-26T10:42:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_client_bytes": "104857600", 2024-04-26T10:42:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_client_directed_command_retry": "2", 2024-04-26T10:42:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-26T10:42:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-26T10:42:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-26T10:42:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-26T10:42:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_client_hunt_parallel": "3", 2024-04-26T10:42:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_client_log_interval": "1.000000", 2024-04-26T10:42:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-26T10:42:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_client_ping_interval": "10.000000", 2024-04-26T10:42:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-26T10:42:45.639 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-26T10:42:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-26T10:42:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-26T10:42:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_cluster_log_file_level": "debug", 2024-04-26T10:42:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_cluster_log_to_file": "true", 2024-04-26T10:42:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-26T10:42:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-26T10:42:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-26T10:42:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_cluster_log_to_journald": "false", 2024-04-26T10:42:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-26T10:42:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-26T10:42:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-26T10:42:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-26T10:42:45.640 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_compact_on_bootstrap": "false", 2024-04-26T10:42:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_compact_on_start": "false", 2024-04-26T10:42:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_compact_on_trim": "true", 2024-04-26T10:42:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-26T10:42:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-26T10:42:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-26T10:42:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_cpu_threads": "4", 2024-04-26T10:42:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_crush_min_required_version": "hammer", 2024-04-26T10:42:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_daemon_bytes": "419430400", 2024-04-26T10:42:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-26T10:42:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_data_avail_crit": "5", 2024-04-26T10:42:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_data_avail_warn": "5", 2024-04-26T10:42:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_data_size_warn": "16106127360", 2024-04-26T10:42:45.641 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-26T10:42:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-26T10:42:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_debug_dump_json": "false", 2024-04-26T10:42:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-26T10:42:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_debug_dump_transactions": "false", 2024-04-26T10:42:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_debug_extra_checks": "false", 2024-04-26T10:42:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-26T10:42:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-26T10:42:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_debug_no_require_quincy": "false", 2024-04-26T10:42:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_debug_no_require_reef": "false", 2024-04-26T10:42:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-26T10:42:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-26T10:42:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-26T10:42:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_down_mkfs_grace": "120", 2024-04-26T10:42:45.642 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_election_default_strategy": "1", 2024-04-26T10:42:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_election_timeout": "5.000000", 2024-04-26T10:42:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-26T10:42:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_elector_ping_divisor": "2", 2024-04-26T10:42:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-26T10:42:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_enable_op_tracker": "true", 2024-04-26T10:42:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_fake_pool_delete": "false", 2024-04-26T10:42:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_force_quorum_join": "false", 2024-04-26T10:42:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_globalid_prealloc": "10000", 2024-04-26T10:42:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_health_detail_to_clog": "false", 2024-04-26T10:42:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_health_log_update_period": "5", 2024-04-26T10:42:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_health_max_detail": "50", 2024-04-26T10:42:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_health_to_clog": "true", 2024-04-26T10:42:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_health_to_clog_interval": "600", 2024-04-26T10:42:45.643 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-26T10:42:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_host": "172.21.15.49,[v2:172.21.15.49:3301,v1:172.21.15.49:6790],[v2:172.21.15.49:3302,v1:172.21.15.49:6791]", 2024-04-26T10:42:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_host_override": "", 2024-04-26T10:42:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_initial_members": "", 2024-04-26T10:42:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-26T10:42:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-26T10:42:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-26T10:42:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-26T10:42:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-26T10:42:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_lease": "5.000000", 2024-04-26T10:42:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-26T10:42:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-26T10:42:45.644 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_log_full_interval": "50", 2024-04-26T10:42:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_log_max": "10000", 2024-04-26T10:42:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_log_max_summary": "50", 2024-04-26T10:42:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-26T10:42:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_max_log_epochs": "500", 2024-04-26T10:42:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-26T10:42:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-26T10:42:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_max_osd": "10000", 2024-04-26T10:42:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_max_pg_per_osd": "10000", 2024-04-26T10:42:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_max_pool_pg_num": "65536", 2024-04-26T10:42:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-26T10:42:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-26T10:42:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_mds_force_trim_to": "0", 2024-04-26T10:42:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_mds_skip_sanity": "false", 2024-04-26T10:42:45.645 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_memory_autotune": "true", 2024-04-26T10:42:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_memory_target": "2147483648", 2024-04-26T10:42:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_mgr_beacon_grace": "30", 2024-04-26T10:42:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-26T10:42:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_mgr_digest_period": "5", 2024-04-26T10:42:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_mgr_inactive_grace": "60", 2024-04-26T10:42:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-26T10:42:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-26T10:42:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_min_osdmap_epochs": "500", 2024-04-26T10:42:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_op_complaint_time": "30", 2024-04-26T10:42:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_op_history_duration": "600", 2024-04-26T10:42:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_op_history_size": "20", 2024-04-26T10:42:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_op_history_slow_op_size": "20", 2024-04-26T10:42:45.646 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-26T10:42:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_op_log_threshold": "5", 2024-04-26T10:42:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-26T10:42:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-26T10:42:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-26T10:42:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_auto_mark_in": "false", 2024-04-26T10:42:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-26T10:42:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-26T10:42:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-26T10:42:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_cache_size": "500", 2024-04-26T10:42:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-26T10:42:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-26T10:42:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-26T10:42:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_down_out_interval": "600", 2024-04-26T10:42:45.647 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-26T10:42:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-26T10:42:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_force_trim_to": "0", 2024-04-26T10:42:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-26T10:42:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-26T10:42:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-26T10:42:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-26T10:42:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-26T10:42:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-26T10:42:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-26T10:42:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-26T10:42:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_min_down_reporters": "2", 2024-04-26T10:42:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-26T10:42:45.648 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-26T10:42:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-26T10:42:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-26T10:42:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-26T10:42:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-26T10:42:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_report_timeout": "900", 2024-04-26T10:42:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-26T10:42:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-26T10:42:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-26T10:42:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-26T10:42:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-26T10:42:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-26T10:42:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-26T10:42:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-26T10:42:45.649 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-26T10:42:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_pg_stuck_threshold": "60", 2024-04-26T10:42:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-26T10:42:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-26T10:42:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-26T10:42:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-26T10:42:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-26T10:42:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-26T10:42:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_probe_timeout": "2.000000", 2024-04-26T10:42:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_reweight_max_change": "0.050000", 2024-04-26T10:42:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_reweight_max_osds": "4", 2024-04-26T10:42:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-26T10:42:45.650 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-26T10:42:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-26T10:42:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-26T10:42:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-26T10:42:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_scrub_interval": "86400", 2024-04-26T10:42:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_scrub_max_keys": "100", 2024-04-26T10:42:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_scrub_timeout": "300", 2024-04-26T10:42:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_session_timeout": "300", 2024-04-26T10:42:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_smart_report_timeout": "5", 2024-04-26T10:42:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_stat_smooth_intervals": "6", 2024-04-26T10:42:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-26T10:42:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_stretch_pool_min_size": "2", 2024-04-26T10:42:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_stretch_pool_size": "4", 2024-04-26T10:42:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-26T10:42:45.651 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-26T10:42:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_sync_debug": "false", 2024-04-26T10:42:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-26T10:42:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-26T10:42:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_sync_provider_kill_at": "0", 2024-04-26T10:42:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_sync_requester_kill_at": "0", 2024-04-26T10:42:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_sync_timeout": "60.000000", 2024-04-26T10:42:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_target_pg_per_osd": "100", 2024-04-26T10:42:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_tick_interval": "5", 2024-04-26T10:42:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_timecheck_interval": "300.000000", 2024-04-26T10:42:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-26T10:42:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_use_min_delay_socket": "false", 2024-04-26T10:42:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_warn_older_version_delay": "604800", 2024-04-26T10:42:45.652 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-26T10:42:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-26T10:42:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-26T10:42:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-26T10:42:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-26T10:42:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-26T10:42:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-26T10:42:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_warn_on_misplaced": "false", 2024-04-26T10:42:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-26T10:42:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_warn_on_older_version": "true", 2024-04-26T10:42:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-26T10:42:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-26T10:42:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-26T10:42:45.653 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-26T10:42:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-26T10:42:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-26T10:42:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-26T10:42:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-26T10:42:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-26T10:42:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: "monmap": "", 2024-04-26T10:42:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T10:42:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-26T10:42:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-26T10:42:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T10:42:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-26T10:42:45.654 INFO:teuthology.orchestra.run.smithi049.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-26T10:42:45.655 INFO:teuthology.orchestra.run.smithi049.stdout: "motr_tracing_enabled": "false", 2024-04-26T10:42:45.655 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_async_op_threads": "3", 2024-04-26T10:42:45.655 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-26T10:42:45.655 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_async_rdma_cm": "false", 2024-04-26T10:42:45.655 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_async_rdma_device_name": "", 2024-04-26T10:42:45.655 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_async_rdma_dscp": "96", 2024-04-26T10:42:45.655 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-26T10:42:45.655 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-26T10:42:45.655 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_async_rdma_local_gid": "", 2024-04-26T10:42:45.655 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-26T10:42:45.655 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_async_rdma_port_num": "1", 2024-04-26T10:42:45.655 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-26T10:42:45.655 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-26T10:42:45.655 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-26T10:42:45.656 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-26T10:42:45.656 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_async_rdma_sl": "3", 2024-04-26T10:42:45.656 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_async_rdma_support_srq": "true", 2024-04-26T10:42:45.656 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_async_rdma_type": "ib", 2024-04-26T10:42:45.656 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_async_reap_threshold": "5", 2024-04-26T10:42:45.656 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_bind_before_connect": "false", 2024-04-26T10:42:45.656 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_bind_ipv4": "true", 2024-04-26T10:42:45.656 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_bind_ipv6": "false", 2024-04-26T10:42:45.656 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_bind_msgr1": "true", 2024-04-26T10:42:45.656 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_bind_msgr2": "true", 2024-04-26T10:42:45.656 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_bind_port_max": "7568", 2024-04-26T10:42:45.656 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_bind_port_min": "6800", 2024-04-26T10:42:45.656 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-26T10:42:45.656 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_bind_retry_count": "3", 2024-04-26T10:42:45.657 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_bind_retry_delay": "5", 2024-04-26T10:42:45.657 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_blackhole_client": "false", 2024-04-26T10:42:45.657 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_blackhole_mds": "false", 2024-04-26T10:42:45.657 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_blackhole_mgr": "false", 2024-04-26T10:42:45.657 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_blackhole_mon": "false", 2024-04-26T10:42:45.657 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_blackhole_osd": "false", 2024-04-26T10:42:45.657 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_client_mode": "crc secure", 2024-04-26T10:42:45.657 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_cluster_mode": "crc secure", 2024-04-26T10:42:45.657 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_cluster_type": "", 2024-04-26T10:42:45.657 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_compress_secure": "false", 2024-04-26T10:42:45.657 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_connection_idle_timeout": "900", 2024-04-26T10:42:45.657 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_connection_ready_timeout": "10", 2024-04-26T10:42:45.657 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_crc_data": "true", 2024-04-26T10:42:45.657 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_crc_header": "true", 2024-04-26T10:42:45.658 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_die_on_bad_msg": "false", 2024-04-26T10:42:45.658 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_die_on_bug": "true", 2024-04-26T10:42:45.658 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_die_on_old_message": "true", 2024-04-26T10:42:45.658 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_die_on_skipped_message": "false", 2024-04-26T10:42:45.658 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-26T10:42:45.658 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-26T10:42:45.658 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_dpdk_coremask": "0xF", 2024-04-26T10:42:45.658 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-26T10:42:45.658 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-26T10:42:45.658 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_dpdk_enable_tso": "true", 2024-04-26T10:42:45.658 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-26T10:42:45.658 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-26T10:42:45.658 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_dpdk_hugepages": "", 2024-04-26T10:42:45.658 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-26T10:42:45.659 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-26T10:42:45.659 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_dpdk_lro": "true", 2024-04-26T10:42:45.659 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_dpdk_memory_channel": "4", 2024-04-26T10:42:45.659 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-26T10:42:45.659 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_dpdk_pmd": "", 2024-04-26T10:42:45.659 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_dpdk_port_id": "0", 2024-04-26T10:42:45.659 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-26T10:42:45.659 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-26T10:42:45.659 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_dump_on_send": "false", 2024-04-26T10:42:45.659 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_initial_backoff": "0.200000", 2024-04-26T10:42:45.659 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_inject_delay_max": "1.000000", 2024-04-26T10:42:45.659 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-26T10:42:45.659 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_inject_delay_type": "", 2024-04-26T10:42:45.660 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-26T10:42:45.660 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_inject_network_congestion": "0", 2024-04-26T10:42:45.660 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_inject_socket_failures": "0", 2024-04-26T10:42:45.660 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_learn_addr_from_peer": "true", 2024-04-26T10:42:45.660 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_max_accept_failures": "4", 2024-04-26T10:42:45.660 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_max_backoff": "15.000000", 2024-04-26T10:42:45.660 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_mon_client_mode": "secure crc", 2024-04-26T10:42:45.660 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-26T10:42:45.660 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_mon_service_mode": "secure crc", 2024-04-26T10:42:45.660 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_osd_compress_min_size": "1024", 2024-04-26T10:42:45.660 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_osd_compress_mode": "none", 2024-04-26T10:42:45.660 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-26T10:42:45.660 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-26T10:42:45.660 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_pq_min_cost": "65536", 2024-04-26T10:42:45.661 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_public_type": "", 2024-04-26T10:42:45.661 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_service_mode": "crc secure", 2024-04-26T10:42:45.661 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_tcp_listen_backlog": "512", 2024-04-26T10:42:45.661 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_tcp_nodelay": "true", 2024-04-26T10:42:45.661 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-26T10:42:45.661 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_tcp_rcvbuf": "0", 2024-04-26T10:42:45.661 INFO:teuthology.orchestra.run.smithi049.stdout: "ms_type": "async+posix", 2024-04-26T10:42:45.661 INFO:teuthology.orchestra.run.smithi049.stdout: "no_config_file": "false", 2024-04-26T10:42:45.661 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter_completion_locks_per_session": "32", 2024-04-26T10:42:45.661 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-26T10:42:45.661 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-26T10:42:45.661 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter_inflight_ops": "1024", 2024-04-26T10:42:45.661 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-26T10:42:45.661 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-26T10:42:45.662 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter_tick_interval": "5.000000", 2024-04-26T10:42:45.662 INFO:teuthology.orchestra.run.smithi049.stdout: "objecter_timeout": "10.000000", 2024-04-26T10:42:45.662 INFO:teuthology.orchestra.run.smithi049.stdout: "objectstore_blackhole": "false", 2024-04-26T10:42:45.662 INFO:teuthology.orchestra.run.smithi049.stdout: "openssl_engine_opts": "", 2024-04-26T10:42:45.662 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_agent_delay_time": "5.000000", 2024-04-26T10:42:45.662 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_agent_hist_halflife": "1000", 2024-04-26T10:42:45.662 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_agent_max_low_ops": "2", 2024-04-26T10:42:45.662 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_agent_max_ops": "4", 2024-04-26T10:42:45.662 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-26T10:42:45.662 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-26T10:42:45.662 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_agent_slop": "0.020000", 2024-04-26T10:42:45.662 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-26T10:42:45.662 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-26T10:42:45.662 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_asio_thread_count": "2", 2024-04-26T10:42:45.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_async_recovery_min_cost": "100", 2024-04-26T10:42:45.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-26T10:42:45.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-26T10:42:45.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_backfill_scan_max": "512", 2024-04-26T10:42:45.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_backfill_scan_min": "64", 2024-04-26T10:42:45.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_backoff_on_degraded": "false", 2024-04-26T10:42:45.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_backoff_on_peering": "false", 2024-04-26T10:42:45.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_backoff_on_unfound": "true", 2024-04-26T10:42:45.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_beacon_report_interval": "300", 2024-04-26T10:42:45.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bench_duration": "30", 2024-04-26T10:42:45.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-26T10:42:45.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bench_max_block_size": "67108864", 2024-04-26T10:42:45.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-26T10:42:45.663 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_blkin_trace_all": "false", 2024-04-26T10:42:45.664 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-26T10:42:45.664 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-26T10:42:45.664 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-26T10:42:45.664 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-26T10:42:45.664 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_check_for_log_corruption": "false", 2024-04-26T10:42:45.664 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-26T10:42:45.664 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T10:42:45.664 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-04-26T10:42:45.664 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T10:42:45.664 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_class_update_on_start": "true", 2024-04-26T10:42:45.664 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_client_message_cap": "256", 2024-04-26T10:42:45.664 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_client_message_size_cap": "524288000", 2024-04-26T10:42:45.664 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_client_op_priority": "63", 2024-04-26T10:42:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_client_watch_timeout": "30", 2024-04-26T10:42:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_command_max_records": "256", 2024-04-26T10:42:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_compact_on_start": "false", 2024-04-26T10:42:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-26T10:42:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-26T10:42:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-26T10:42:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_crush_update_on_start": "true", 2024-04-26T10:42:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_crush_update_weight_set": "true", 2024-04-26T10:42:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-26T10:42:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-26T10:42:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-26T10:42:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-26T10:42:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-26T10:42:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_debug_feed_pullee": "-1", 2024-04-26T10:42:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-26T10:42:45.666 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-26T10:42:45.666 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-26T10:42:45.666 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_debug_misdirected_ops": "false", 2024-04-26T10:42:45.666 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_debug_no_acting_change": "false", 2024-04-26T10:42:45.666 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_debug_no_purge_strays": "false", 2024-04-26T10:42:45.666 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_debug_op_order": "false", 2024-04-26T10:42:45.666 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-26T10:42:45.666 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-26T10:42:45.666 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-26T10:42:45.666 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-26T10:42:45.666 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_debug_shutdown": "false", 2024-04-26T10:42:45.667 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-26T10:42:45.667 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-26T10:42:45.667 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-26T10:42:45.667 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-26T10:42:45.667 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_debug_verify_snaps": "false", 2024-04-26T10:42:45.667 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-26T10:42:45.667 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-26T10:42:45.667 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_deep_scrub_keys": "1024", 2024-04-26T10:42:45.667 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-26T10:42:45.667 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-26T10:42:45.667 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-26T10:42:45.667 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_deep_scrub_stride": "524288", 2024-04-26T10:42:45.667 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-26T10:42:45.668 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-26T10:42:45.668 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_default_notify_timeout": "30", 2024-04-26T10:42:45.668 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_delete_sleep": "0.000000", 2024-04-26T10:42:45.668 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-26T10:42:45.668 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-26T10:42:45.668 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-26T10:42:45.668 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_discard_disconnected_ops": "true", 2024-04-26T10:42:45.668 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_enable_op_tracker": "true", 2024-04-26T10:42:45.668 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-26T10:42:45.668 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-26T10:42:45.668 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-26T10:42:45.669 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-26T10:42:45.669 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_fast_info": "true", 2024-04-26T10:42:45.669 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_fast_shutdown": "true", 2024-04-26T10:42:45.669 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-26T10:42:45.669 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-26T10:42:45.669 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-26T10:42:45.669 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-26T10:42:45.669 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-26T10:42:45.669 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_function_tracing": "false", 2024-04-26T10:42:45.669 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_heartbeat_grace": "20", 2024-04-26T10:42:45.669 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_heartbeat_interval": "6", 2024-04-26T10:42:45.669 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-26T10:42:45.669 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_heartbeat_min_peers": "10", 2024-04-26T10:42:45.670 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_heartbeat_min_size": "2000", 2024-04-26T10:42:45.670 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_heartbeat_stale": "600", 2024-04-26T10:42:45.670 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-26T10:42:45.670 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_hit_set_max_size": "100000", 2024-04-26T10:42:45.670 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_hit_set_min_size": "1000", 2024-04-26T10:42:45.670 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-26T10:42:45.670 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-26T10:42:45.670 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-26T10:42:45.670 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-26T10:42:45.670 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-26T10:42:45.670 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-26T10:42:45.670 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_journal_size": "5120", 2024-04-26T10:42:45.670 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_kill_backfill_at": "0", 2024-04-26T10:42:45.671 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-26T10:42:45.671 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_map_cache_size": "50", 2024-04-26T10:42:45.671 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_map_dedup": "true", 2024-04-26T10:42:45.671 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_map_message_max": "40", 2024-04-26T10:42:45.671 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-26T10:42:45.671 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_map_share_max_epochs": "40", 2024-04-26T10:42:45.671 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_max_attr_name_len": "100", 2024-04-26T10:42:45.671 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_max_attr_size": "0", 2024-04-26T10:42:45.671 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_max_backfills": "1", 2024-04-26T10:42:45.671 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_max_markdown_count": "5", 2024-04-26T10:42:45.671 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_max_markdown_period": "600", 2024-04-26T10:42:45.671 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_max_object_name_len": "2048", 2024-04-26T10:42:45.672 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_max_object_namespace_len": "256", 2024-04-26T10:42:45.672 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_max_object_size": "134217728", 2024-04-26T10:42:45.672 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-26T10:42:45.672 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-26T10:42:45.672 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_max_pg_blocked_by": "16", 2024-04-26T10:42:45.672 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_max_pg_log_entries": "10000", 2024-04-26T10:42:45.672 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-26T10:42:45.672 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_max_pgls": "1024", 2024-04-26T10:42:45.672 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_max_push_cost": "8388608", 2024-04-26T10:42:45.672 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_max_push_objects": "10", 2024-04-26T10:42:45.672 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_max_scrubs": "3", 2024-04-26T10:42:45.672 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-26T10:42:45.672 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_max_trimming_pgs": "2", 2024-04-26T10:42:45.673 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_max_write_op_reply_len": "64", 2024-04-26T10:42:45.673 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_max_write_size": "90", 2024-04-26T10:42:45.673 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-26T10:42:45.673 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-26T10:42:45.673 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-26T10:42:45.673 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-26T10:42:45.673 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-26T10:42:45.673 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-26T10:42:45.673 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-26T10:42:45.673 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-26T10:42:45.673 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mclock_profile": "balanced", 2024-04-26T10:42:45.673 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-26T10:42:45.674 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-26T10:42:45.674 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-26T10:42:45.674 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-26T10:42:45.674 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-26T10:42:45.674 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-26T10:42:45.674 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-26T10:42:45.674 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-26T10:42:45.674 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-26T10:42:45.674 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-26T10:42:45.674 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-26T10:42:45.674 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_memory_base": "805306368", 2024-04-26T10:42:45.674 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_memory_cache_min": "134217728", 2024-04-26T10:42:45.674 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-26T10:42:45.675 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-26T10:42:45.675 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_memory_target": "4294967296", 2024-04-26T10:42:45.675 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_memory_target_autotune": "false", 2024-04-26T10:42:45.675 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-26T10:42:45.675 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_min_pg_log_entries": "250", 2024-04-26T10:42:45.675 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_min_recovery_priority": "0", 2024-04-26T10:42:45.675 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-26T10:42:45.675 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-26T10:42:45.675 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mon_report_interval": "5", 2024-04-26T10:42:45.675 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-26T10:42:45.675 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-26T10:42:45.675 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_num_cache_shards": "32", 2024-04-26T10:42:45.675 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_num_op_tracker_shard": "32", 2024-04-26T10:42:45.675 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_numa_auto_affinity": "true", 2024-04-26T10:42:45.676 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_numa_node": "-1", 2024-04-26T10:42:45.676 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_numa_prefer_iface": "true", 2024-04-26T10:42:45.676 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-26T10:42:45.676 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_objecter_finishers": "1", 2024-04-26T10:42:45.676 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_objectstore": "bluestore", 2024-04-26T10:42:45.676 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_objectstore_fuse": "false", 2024-04-26T10:42:45.676 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_objectstore_tracing": "false", 2024-04-26T10:42:45.676 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_op_complaint_time": "30.000000", 2024-04-26T10:42:45.676 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_op_history_duration": "600", 2024-04-26T10:42:45.676 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_op_history_size": "20", 2024-04-26T10:42:45.676 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_op_history_slow_op_size": "20", 2024-04-26T10:42:45.676 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-26T10:42:45.676 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_op_log_threshold": "5", 2024-04-26T10:42:45.676 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_op_num_shards": "0", 2024-04-26T10:42:45.677 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_op_num_shards_hdd": "5", 2024-04-26T10:42:45.677 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_op_num_shards_ssd": "8", 2024-04-26T10:42:45.677 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-26T10:42:45.677 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-26T10:42:45.677 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-26T10:42:45.677 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-26T10:42:45.677 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_op_pq_min_cost": "65536", 2024-04-26T10:42:45.677 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-26T10:42:45.677 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_op_queue_cut_off": "high", 2024-04-26T10:42:45.677 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-26T10:42:45.677 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_op_thread_timeout": "15", 2024-04-26T10:42:45.677 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_open_classes_on_start": "true", 2024-04-26T10:42:45.677 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_os_flags": "0", 2024-04-26T10:42:45.677 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_peering_op_priority": "255", 2024-04-26T10:42:45.677 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pg_delete_cost": "1048576", 2024-04-26T10:42:45.678 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pg_delete_priority": "5", 2024-04-26T10:42:45.678 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-26T10:42:45.678 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-26T10:42:45.678 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-26T10:42:45.678 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pg_log_trim_max": "10000", 2024-04-26T10:42:45.678 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pg_log_trim_min": "100", 2024-04-26T10:42:45.678 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-26T10:42:45.678 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-26T10:42:45.678 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pg_stat_report_interval_max": "500", 2024-04-26T10:42:45.678 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-26T10:42:45.678 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-26T10:42:45.678 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-26T10:42:45.678 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-26T10:42:45.678 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-26T10:42:45.679 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-26T10:42:45.679 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_crimson": "false", 2024-04-26T10:42:45.679 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-26T10:42:45.679 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-26T10:42:45.679 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-26T10:42:45.679 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-26T10:42:45.679 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-26T10:42:45.679 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-26T10:42:45.679 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-26T10:42:45.679 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-26T10:42:45.679 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_flags": "0", 2024-04-26T10:42:45.679 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-26T10:42:45.679 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_min_size": "0", 2024-04-26T10:42:45.679 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-26T10:42:45.680 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_pg_num": "32", 2024-04-26T10:42:45.680 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_pgp_num": "0", 2024-04-26T10:42:45.680 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-26T10:42:45.680 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_size": "2", 2024-04-26T10:42:45.680 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_default_type": "replicated", 2024-04-26T10:42:45.680 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-26T10:42:45.680 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-26T10:42:45.680 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_push_per_object_cost": "1000", 2024-04-26T10:42:45.680 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-26T10:42:45.680 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_recover_clone_overlap": "true", 2024-04-26T10:42:45.680 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-26T10:42:45.680 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_recovery_cost": "20971520", 2024-04-26T10:42:45.680 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-26T10:42:45.680 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_recovery_max_active": "0", 2024-04-26T10:42:45.680 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-26T10:42:45.681 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-26T10:42:45.681 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-26T10:42:45.681 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-26T10:42:45.681 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_recovery_max_single_start": "1", 2024-04-26T10:42:45.681 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_recovery_op_priority": "3", 2024-04-26T10:42:45.681 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-26T10:42:45.681 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_recovery_priority": "5", 2024-04-26T10:42:45.681 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-26T10:42:45.681 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_recovery_sleep": "0.000000", 2024-04-26T10:42:45.681 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-26T10:42:45.681 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-26T10:42:45.681 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-26T10:42:45.682 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_repair_during_recovery": "false", 2024-04-26T10:42:45.682 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_requested_scrub_priority": "120", 2024-04-26T10:42:45.682 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-26T10:42:45.682 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-26T10:42:45.682 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_scrub_auto_repair": "false", 2024-04-26T10:42:45.682 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-26T10:42:45.682 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-26T10:42:45.682 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_scrub_begin_hour": "0", 2024-04-26T10:42:45.682 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_scrub_begin_week_day": "0", 2024-04-26T10:42:45.682 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_scrub_chunk_max": "25", 2024-04-26T10:42:45.682 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_scrub_chunk_min": "5", 2024-04-26T10:42:45.683 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_scrub_cost": "52428800", 2024-04-26T10:42:45.683 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_scrub_during_recovery": "false", 2024-04-26T10:42:45.683 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_scrub_end_hour": "0", 2024-04-26T10:42:45.683 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_scrub_end_week_day": "0", 2024-04-26T10:42:45.683 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_scrub_event_cost": "4096", 2024-04-26T10:42:45.683 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-26T10:42:45.683 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-26T10:42:45.683 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_scrub_invalid_stats": "true", 2024-04-26T10:42:45.683 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-26T10:42:45.683 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-26T10:42:45.683 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_scrub_max_preemptions": "5", 2024-04-26T10:42:45.683 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-26T10:42:45.683 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_scrub_priority": "5", 2024-04-26T10:42:45.684 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_scrub_reservation_timeout": "5000", 2024-04-26T10:42:45.684 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_scrub_sleep": "0.000000", 2024-04-26T10:42:45.684 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_scrub_slow_reservation_response": "2200", 2024-04-26T10:42:45.684 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-26T10:42:45.684 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-26T10:42:45.684 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-26T10:42:45.684 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_skip_data_digest": "false", 2024-04-26T10:42:45.684 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_smart_report_timeout": "5", 2024-04-26T10:42:45.684 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_snap_trim_cost": "1048576", 2024-04-26T10:42:45.684 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_snap_trim_priority": "5", 2024-04-26T10:42:45.684 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-26T10:42:45.684 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-26T10:42:45.684 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-26T10:42:45.684 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-26T10:42:45.685 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-26T10:42:45.685 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-26T10:42:45.685 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-26T10:42:45.685 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_target_transaction_size": "30", 2024-04-26T10:42:45.685 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-26T10:42:45.685 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-26T10:42:45.685 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-26T10:42:45.685 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-26T10:42:45.685 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-26T10:42:45.685 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-26T10:42:45.685 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-26T10:42:45.685 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-26T10:42:45.685 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-26T10:42:45.686 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-26T10:42:45.686 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_tracing": "false", 2024-04-26T10:42:45.686 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_use_stale_snap": "false", 2024-04-26T10:42:45.686 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-26T10:42:45.686 INFO:teuthology.orchestra.run.smithi049.stdout: "osdc_blkin_trace_all": "false", 2024-04-26T10:42:45.686 INFO:teuthology.orchestra.run.smithi049.stdout: "paxos_kill_at": "0", 2024-04-26T10:42:45.686 INFO:teuthology.orchestra.run.smithi049.stdout: "paxos_max_join_drift": "10", 2024-04-26T10:42:45.686 INFO:teuthology.orchestra.run.smithi049.stdout: "paxos_min": "500", 2024-04-26T10:42:45.686 INFO:teuthology.orchestra.run.smithi049.stdout: "paxos_min_wait": "0.050000", 2024-04-26T10:42:45.686 INFO:teuthology.orchestra.run.smithi049.stdout: "paxos_propose_interval": "1.000000", 2024-04-26T10:42:45.686 INFO:teuthology.orchestra.run.smithi049.stdout: "paxos_service_trim_max": "500", 2024-04-26T10:42:45.686 INFO:teuthology.orchestra.run.smithi049.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-26T10:42:45.686 INFO:teuthology.orchestra.run.smithi049.stdout: "paxos_service_trim_min": "250", 2024-04-26T10:42:45.687 INFO:teuthology.orchestra.run.smithi049.stdout: "paxos_stash_full_interval": "25", 2024-04-26T10:42:45.687 INFO:teuthology.orchestra.run.smithi049.stdout: "paxos_trim_max": "500", 2024-04-26T10:42:45.687 INFO:teuthology.orchestra.run.smithi049.stdout: "paxos_trim_min": "250", 2024-04-26T10:42:45.687 INFO:teuthology.orchestra.run.smithi049.stdout: "perf": "true", 2024-04-26T10:42:45.687 INFO:teuthology.orchestra.run.smithi049.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-26T10:42:45.687 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-26T10:42:45.687 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-04-26T10:42:45.687 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "-", 2024-04-26T10:42:45.687 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrv": "", 2024-04-26T10:42:45.687 INFO:teuthology.orchestra.run.smithi049.stdout: "public_bind_addr": "-", 2024-04-26T10:42:45.687 INFO:teuthology.orchestra.run.smithi049.stdout: "public_network": "", 2024-04-26T10:42:45.687 INFO:teuthology.orchestra.run.smithi049.stdout: "public_network_interface": "", 2024-04-26T10:42:45.687 INFO:teuthology.orchestra.run.smithi049.stdout: "qat_compressor_enabled": "false", 2024-04-26T10:42:45.687 INFO:teuthology.orchestra.run.smithi049.stdout: "qat_compressor_session_max_number": "256", 2024-04-26T10:42:45.688 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_mon_op_timeout": "0", 2024-04-26T10:42:45.688 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_osd_op_timeout": "0", 2024-04-26T10:42:45.688 INFO:teuthology.orchestra.run.smithi049.stdout: "rados_tracing": "false", 2024-04-26T10:42:45.688 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_atime_update_interval": "60", 2024-04-26T10:42:45.688 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-26T10:42:45.688 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_balance_parent_reads": "false", 2024-04-26T10:42:45.688 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_balance_snap_reads": "false", 2024-04-26T10:42:45.688 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_blkin_trace_all": "false", 2024-04-26T10:42:45.688 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-26T10:42:45.688 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-26T10:42:45.688 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_cache": "true", 2024-04-26T10:42:45.688 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-26T10:42:45.688 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-26T10:42:45.688 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-26T10:42:45.689 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-26T10:42:45.689 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_cache_policy": "writearound", 2024-04-26T10:42:45.689 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_cache_size": "33554432", 2024-04-26T10:42:45.689 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-26T10:42:45.689 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-26T10:42:45.689 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_clone_copy_on_read": "false", 2024-04-26T10:42:45.689 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_compression_hint": "none", 2024-04-26T10:42:45.689 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_concurrent_management_ops": "10", 2024-04-26T10:42:45.689 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-26T10:42:45.689 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_default_clone_format": "auto", 2024-04-26T10:42:45.689 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_default_data_pool": "", 2024-04-26T10:42:45.689 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_default_features": "61", 2024-04-26T10:42:45.689 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_default_format": "2", 2024-04-26T10:42:45.690 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_default_map_options": "", 2024-04-26T10:42:45.690 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_default_order": "22", 2024-04-26T10:42:45.690 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_default_pool": "rbd", 2024-04-26T10:42:45.690 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-26T10:42:45.690 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_default_stripe_count": "0", 2024-04-26T10:42:45.690 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_default_stripe_unit": "0", 2024-04-26T10:42:45.690 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-26T10:42:45.690 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-26T10:42:45.690 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-26T10:42:45.690 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_enable_alloc_hint": "true", 2024-04-26T10:42:45.690 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-26T10:42:45.690 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_io_scheduler": "simple", 2024-04-26T10:42:45.690 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-26T10:42:45.691 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-26T10:42:45.691 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-26T10:42:45.691 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-26T10:42:45.691 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-26T10:42:45.691 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-26T10:42:45.691 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-26T10:42:45.691 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-26T10:42:45.691 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-26T10:42:45.691 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_journal_order": "24", 2024-04-26T10:42:45.691 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_journal_pool": "", 2024-04-26T10:42:45.691 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_journal_splay_width": "4", 2024-04-26T10:42:45.691 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_localize_parent_reads": "false", 2024-04-26T10:42:45.691 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_localize_snap_reads": "false", 2024-04-26T10:42:45.691 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-26T10:42:45.692 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-26T10:42:45.692 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-26T10:42:45.692 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-26T10:42:45.692 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-26T10:42:45.692 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-26T10:42:45.692 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-26T10:42:45.692 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-26T10:42:45.692 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-26T10:42:45.692 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-26T10:42:45.692 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-26T10:42:45.692 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-26T10:42:45.692 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-26T10:42:45.692 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-26T10:42:45.692 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-26T10:42:45.693 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-26T10:42:45.693 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-26T10:42:45.693 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-26T10:42:45.693 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-26T10:42:45.693 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-26T10:42:45.693 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-26T10:42:45.693 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-26T10:42:45.693 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-26T10:42:45.693 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-26T10:42:45.693 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-26T10:42:45.693 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-26T10:42:45.693 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-26T10:42:45.693 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-26T10:42:45.693 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-26T10:42:45.694 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-26T10:42:45.694 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-26T10:42:45.694 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_mtime_update_interval": "60", 2024-04-26T10:42:45.694 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_non_blocking_aio": "true", 2024-04-26T10:42:45.694 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_op_thread_timeout": "60", 2024-04-26T10:42:45.694 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_op_threads": "1", 2024-04-26T10:42:45.694 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_parent_cache_enabled": "false", 2024-04-26T10:42:45.694 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-26T10:42:45.694 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-26T10:42:45.694 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-26T10:42:45.694 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_plugins": "", 2024-04-26T10:42:45.694 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_qos_bps_burst": "0", 2024-04-26T10:42:45.694 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-26T10:42:45.694 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_qos_bps_limit": "0", 2024-04-26T10:42:45.695 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_qos_exclude_ops": "0", 2024-04-26T10:42:45.695 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_qos_iops_burst": "0", 2024-04-26T10:42:45.695 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-26T10:42:45.695 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_qos_iops_limit": "0", 2024-04-26T10:42:45.695 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-26T10:42:45.695 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-26T10:42:45.695 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-26T10:42:45.695 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-26T10:42:45.695 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-26T10:42:45.695 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-26T10:42:45.695 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-26T10:42:45.695 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-26T10:42:45.695 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-26T10:42:45.696 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-26T10:42:45.696 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-26T10:42:45.696 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-26T10:42:45.696 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-26T10:42:45.696 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-26T10:42:45.696 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_read_from_replica_policy": "default", 2024-04-26T10:42:45.696 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-26T10:42:45.696 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-26T10:42:45.696 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-26T10:42:45.696 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-26T10:42:45.696 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_skip_partial_discard": "true", 2024-04-26T10:42:45.696 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-26T10:42:45.696 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_tracing": "false", 2024-04-26T10:42:45.697 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_validate_names": "true", 2024-04-26T10:42:45.697 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_validate_pool": "true", 2024-04-26T10:42:45.697 INFO:teuthology.orchestra.run.smithi049.stdout: "restapi_base_url": "", 2024-04-26T10:42:45.697 INFO:teuthology.orchestra.run.smithi049.stdout: "restapi_log_level": "", 2024-04-26T10:42:45.697 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_acl_grants_max_num": "100", 2024-04-26T10:42:45.697 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_admin_entry": "admin", 2024-04-26T10:42:45.697 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-26T10:42:45.697 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_backend_store": "rados", 2024-04-26T10:42:45.697 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_barbican_url": "", 2024-04-26T10:42:45.697 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_beast_enable_async": "true", 2024-04-26T10:42:45.697 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-26T10:42:45.697 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-26T10:42:45.697 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-26T10:42:45.697 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-26T10:42:45.697 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-26T10:42:45.698 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-26T10:42:45.698 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-26T10:42:45.698 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_cache_enabled": "true", 2024-04-26T10:42:45.698 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_cache_expiry_interval": "900", 2024-04-26T10:42:45.698 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_cache_lru_size": "10000", 2024-04-26T10:42:45.698 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_config_store": "rados", 2024-04-26T10:42:45.698 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_content_length_compat": "false", 2024-04-26T10:42:45.698 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_copy_obj_progress": "true", 2024-04-26T10:42:45.698 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-26T10:42:45.698 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_cors_rules_max_num": "100", 2024-04-26T10:42:45.698 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_cross_domain_policy": "", 2024-04-26T10:42:45.698 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-26T10:42:45.698 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_kmip_addr": "", 2024-04-26T10:42:45.699 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-26T10:42:45.699 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-26T10:42:45.699 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-26T10:42:45.699 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-26T10:42:45.699 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_kmip_password": "", 2024-04-26T10:42:45.699 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-26T10:42:45.699 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_kmip_username": "", 2024-04-26T10:42:45.699 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_require_ssl": "true", 2024-04-26T10:42:45.699 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-26T10:42:45.699 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-26T10:42:45.699 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-26T10:42:45.699 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-26T10:42:45.699 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-26T10:42:45.700 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-26T10:42:45.700 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-26T10:42:45.700 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-26T10:42:45.700 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-26T10:42:45.700 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-26T10:42:45.700 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-26T10:42:45.700 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-26T10:42:45.700 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-26T10:42:45.700 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-26T10:42:45.700 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-26T10:42:45.700 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_vault_addr": "", 2024-04-26T10:42:45.700 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_vault_auth": "token", 2024-04-26T10:42:45.700 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_vault_namespace": "", 2024-04-26T10:42:45.700 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_vault_prefix": "", 2024-04-26T10:42:45.701 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-26T10:42:45.701 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-26T10:42:45.701 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-26T10:42:45.701 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-26T10:42:45.701 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_vault_token_file": "", 2024-04-26T10:42:45.701 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-26T10:42:45.701 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_curl_buffersize": "524288", 2024-04-26T10:42:45.701 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-26T10:42:45.701 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_curl_low_speed_time": "300", 2024-04-26T10:42:45.701 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-26T10:42:45.701 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-26T10:42:45.701 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-26T10:42:45.701 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-26T10:42:45.701 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-26T10:42:45.702 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-26T10:42:45.702 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-26T10:42:45.702 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-26T10:42:45.702 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-26T10:42:45.702 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-26T10:42:45.702 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-26T10:42:45.702 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_data_log_changes_size": "1000", 2024-04-26T10:42:45.702 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_data_log_num_shards": "128", 2024-04-26T10:42:45.702 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-26T10:42:45.702 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_data_log_window": "30", 2024-04-26T10:42:45.702 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-26T10:42:45.702 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-26T10:42:45.702 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-26T10:42:45.703 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-26T10:42:45.703 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-26T10:42:45.703 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-26T10:42:45.703 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-26T10:42:45.703 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-26T10:42:45.703 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-26T10:42:45.703 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-26T10:42:45.703 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-26T10:42:45.703 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-26T10:42:45.703 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-26T10:42:45.703 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-26T10:42:45.703 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-26T10:42:45.703 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-26T10:42:45.703 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-26T10:42:45.704 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-26T10:42:45.704 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-26T10:42:45.704 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-26T10:42:45.704 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-26T10:42:45.704 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-26T10:42:45.704 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-26T10:42:45.704 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-26T10:42:45.704 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_dns_name": "", 2024-04-26T10:42:45.704 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_dns_s3website_name": "", 2024-04-26T10:42:45.704 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_dynamic_resharding": "true", 2024-04-26T10:42:45.704 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-26T10:42:45.704 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_enable_gc_threads": "true", 2024-04-26T10:42:45.704 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_enable_lc_threads": "true", 2024-04-26T10:42:45.704 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_enable_ops_log": "false", 2024-04-26T10:42:45.705 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_enable_quota_threads": "true", 2024-04-26T10:42:45.705 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_enable_static_website": "false", 2024-04-26T10:42:45.705 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_enable_usage_log": "false", 2024-04-26T10:42:45.705 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_enforce_swift_acls": "true", 2024-04-26T10:42:45.705 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_exit_timeout_secs": "120", 2024-04-26T10:42:45.705 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_expose_bucket": "false", 2024-04-26T10:42:45.705 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_extended_http_attrs": "", 2024-04-26T10:42:45.705 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_filter": "none", 2024-04-26T10:42:45.705 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-26T10:42:45.705 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_frontends": "beast port=7480", 2024-04-26T10:42:45.705 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-26T10:42:45.705 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_gc_max_deferred": "50", 2024-04-26T10:42:45.705 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-26T10:42:45.705 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_gc_max_objs": "32", 2024-04-26T10:42:45.706 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-26T10:42:45.706 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-26T10:42:45.706 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-26T10:42:45.706 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-26T10:42:45.706 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_gc_processor_period": "3600", 2024-04-26T10:42:45.706 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-26T10:42:45.706 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-26T10:42:45.706 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-26T10:42:45.706 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-26T10:42:45.706 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_init_timeout": "300", 2024-04-26T10:42:45.706 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-26T10:42:45.706 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-26T10:42:45.707 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-26T10:42:45.707 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-26T10:42:45.707 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_keystone_admin_domain": "", 2024-04-26T10:42:45.707 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_keystone_admin_password": "", 2024-04-26T10:42:45.707 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_keystone_admin_password_path": "", 2024-04-26T10:42:45.707 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_keystone_admin_project": "", 2024-04-26T10:42:45.707 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_keystone_admin_tenant": "", 2024-04-26T10:42:45.707 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_keystone_admin_token": "", 2024-04-26T10:42:45.707 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_keystone_admin_token_path": "", 2024-04-26T10:42:45.707 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_keystone_admin_user": "", 2024-04-26T10:42:45.707 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_keystone_api_version": "2", 2024-04-26T10:42:45.707 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_keystone_barbican_domain": "", 2024-04-26T10:42:45.707 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_keystone_barbican_password": "", 2024-04-26T10:42:45.707 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_keystone_barbican_project": "", 2024-04-26T10:42:45.708 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-26T10:42:45.708 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_keystone_barbican_user": "", 2024-04-26T10:42:45.708 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-26T10:42:45.708 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-26T10:42:45.708 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-26T10:42:45.708 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-26T10:42:45.708 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-26T10:42:45.708 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_keystone_url": "", 2024-04-26T10:42:45.708 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-26T10:42:45.708 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_lc_debug_interval": "-1", 2024-04-26T10:42:45.708 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_lc_lock_max_time": "90", 2024-04-26T10:42:45.708 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_lc_max_objs": "32", 2024-04-26T10:42:45.708 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_lc_max_rules": "1000", 2024-04-26T10:42:45.708 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_lc_max_worker": "3", 2024-04-26T10:42:45.709 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-26T10:42:45.709 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_lc_thread_delay": "0", 2024-04-26T10:42:45.709 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-26T10:42:45.709 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_ldap_dnattr": "uid", 2024-04-26T10:42:45.709 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-26T10:42:45.709 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_ldap_searchfilter": "", 2024-04-26T10:42:45.709 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-26T10:42:45.709 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_ldap_uri": "ldaps://", 2024-04-26T10:42:45.709 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-26T10:42:45.709 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-26T10:42:45.709 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-26T10:42:45.709 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_log_http_headers": "", 2024-04-26T10:42:45.709 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-26T10:42:45.709 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-26T10:42:45.710 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_log_object_name_utc": "false", 2024-04-26T10:42:45.710 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-04-26T10:42:45.710 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_max_attr_name_len": "0", 2024-04-26T10:42:45.710 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_max_attr_size": "0", 2024-04-26T10:42:45.710 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-26T10:42:45.710 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_max_chunk_size": "4194304", 2024-04-26T10:42:45.710 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-26T10:42:45.710 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-26T10:42:45.710 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-26T10:42:45.710 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_max_listing_results": "1000", 2024-04-26T10:42:45.710 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_max_notify_retries": "10", 2024-04-26T10:42:45.710 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-26T10:42:45.710 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_max_put_param_size": "1048576", 2024-04-26T10:42:45.711 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_max_put_size": "5368709120", 2024-04-26T10:42:45.711 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_max_slo_entries": "1000", 2024-04-26T10:42:45.711 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_md_log_max_shards": "64", 2024-04-26T10:42:45.711 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-26T10:42:45.711 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-26T10:42:45.711 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-26T10:42:45.711 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-26T10:42:45.711 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_mp_lock_max_time": "600", 2024-04-26T10:42:45.711 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-26T10:42:45.711 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-26T10:42:45.711 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-26T10:42:45.711 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-26T10:42:45.711 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-26T10:42:45.711 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-26T10:42:45.712 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-26T10:42:45.712 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-26T10:42:45.712 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_nfs_max_gc": "300", 2024-04-26T10:42:45.712 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-26T10:42:45.712 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-26T10:42:45.712 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-26T10:42:45.712 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-26T10:42:45.712 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-26T10:42:45.712 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-26T10:42:45.712 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-26T10:42:45.712 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_num_async_rados_threads": "32", 2024-04-26T10:42:45.712 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_num_control_oids": "8", 2024-04-26T10:42:45.712 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_numa_node": "-1", 2024-04-26T10:42:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-26T10:42:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-26T10:42:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_objexp_chunk_size": "100", 2024-04-26T10:42:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_objexp_gc_interval": "600", 2024-04-26T10:42:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-26T10:42:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-26T10:42:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-26T10:42:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_op_thread_timeout": "600", 2024-04-26T10:42:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_op_tracing": "false", 2024-04-26T10:42:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_opa_token": "", 2024-04-26T10:42:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_opa_url": "", 2024-04-26T10:42:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_opa_verify_ssl": "true", 2024-04-26T10:42:45.713 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-26T10:42:45.714 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-26T10:42:45.714 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_ops_log_rados": "false", 2024-04-26T10:42:45.714 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_ops_log_socket_path": "", 2024-04-26T10:42:45.714 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-26T10:42:45.714 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-26T10:42:45.714 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-26T10:42:45.714 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_period_push_interval": "2.000000", 2024-04-26T10:42:45.714 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-26T10:42:45.714 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-26T10:42:45.714 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-26T10:42:45.714 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_print_continue": "true", 2024-04-26T10:42:45.714 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-26T10:42:45.714 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-26T10:42:45.715 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-26T10:42:45.715 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-26T10:42:45.715 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-26T10:42:45.715 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_rados_tracing": "false", 2024-04-26T10:42:45.715 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_realm": "", 2024-04-26T10:42:45.715 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_realm_id": "", 2024-04-26T10:42:45.715 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-26T10:42:45.715 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_region": "", 2024-04-26T10:42:45.715 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-26T10:42:45.715 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-26T10:42:45.715 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-26T10:42:45.715 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-26T10:42:45.715 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_request_uri": "", 2024-04-26T10:42:45.715 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_reshard_batch_size": "64", 2024-04-26T10:42:45.716 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-26T10:42:45.716 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_reshard_max_aio": "128", 2024-04-26T10:42:45.716 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_reshard_num_logs": "16", 2024-04-26T10:42:45.716 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_reshard_thread_interval": "600", 2024-04-26T10:42:45.716 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_resolve_cname": "false", 2024-04-26T10:42:45.716 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-26T10:42:45.716 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_run_sync_thread": "true", 2024-04-26T10:42:45.716 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-26T10:42:45.716 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-26T10:42:45.716 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-26T10:42:45.716 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-26T10:42:45.716 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-26T10:42:45.716 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-26T10:42:45.717 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-26T10:42:45.717 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-26T10:42:45.717 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_scheduler_type": "throttler", 2024-04-26T10:42:45.717 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_script_uri": "", 2024-04-26T10:42:45.717 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_service_provider_name": "", 2024-04-26T10:42:45.717 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-26T10:42:45.717 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_sts_client_id": "", 2024-04-26T10:42:45.717 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_sts_client_secret": "", 2024-04-26T10:42:45.717 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_sts_entry": "sts", 2024-04-26T10:42:45.717 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_sts_key": "sts", 2024-04-26T10:42:45.717 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-26T10:42:45.717 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_sts_min_session_duration": "900", 2024-04-26T10:42:45.718 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_sts_token_introspection_url": "", 2024-04-26T10:42:45.718 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_swift_account_in_url": "false", 2024-04-26T10:42:45.718 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_swift_auth_entry": "auth", 2024-04-26T10:42:45.718 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_swift_auth_url": "", 2024-04-26T10:42:45.718 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_swift_custom_header": "", 2024-04-26T10:42:45.718 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-26T10:42:45.718 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_swift_need_stats": "true", 2024-04-26T10:42:45.718 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_swift_tenant_name": "", 2024-04-26T10:42:45.718 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_swift_token_expiration": "86400", 2024-04-26T10:42:45.718 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_swift_url": "", 2024-04-26T10:42:45.718 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_swift_url_prefix": "swift", 2024-04-26T10:42:45.718 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-26T10:42:45.718 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-26T10:42:45.718 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-26T10:42:45.719 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_sync_lease_period": "120", 2024-04-26T10:42:45.719 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-26T10:42:45.719 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-26T10:42:45.719 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-26T10:42:45.719 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-26T10:42:45.719 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-26T10:42:45.719 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-26T10:42:45.719 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-26T10:42:45.719 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-26T10:42:45.719 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-26T10:42:45.719 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_thread_pool_size": "512", 2024-04-26T10:42:45.719 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_torrent_comment": "", 2024-04-26T10:42:45.719 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_torrent_createby": "", 2024-04-26T10:42:45.720 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_torrent_encoding": "", 2024-04-26T10:42:45.720 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_torrent_flag": "false", 2024-04-26T10:42:45.720 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_torrent_origin": "", 2024-04-26T10:42:45.720 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-26T10:42:45.720 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_torrent_tracker": "", 2024-04-26T10:42:45.720 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_trust_forwarded_https": "false", 2024-04-26T10:42:45.720 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-26T10:42:45.720 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-26T10:42:45.720 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_usage_max_shards": "32", 2024-04-26T10:42:45.720 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_usage_max_user_shards": "1", 2024-04-26T10:42:45.720 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_use_opa_authz": "false", 2024-04-26T10:42:45.720 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-26T10:42:45.720 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-26T10:42:45.721 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_user_max_buckets": "1000", 2024-04-26T10:42:45.721 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_user_policies_max_num": "100", 2024-04-26T10:42:45.721 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-26T10:42:45.721 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-26T10:42:45.721 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-26T10:42:45.721 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-26T10:42:45.721 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_user_unique_email": "true", 2024-04-26T10:42:45.721 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_verify_ssl": "true", 2024-04-26T10:42:45.721 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-26T10:42:45.721 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_zone": "", 2024-04-26T10:42:45.721 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_zone_id": "", 2024-04-26T10:42:45.721 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-26T10:42:45.721 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_zonegroup": "", 2024-04-26T10:42:45.722 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_zonegroup_id": "", 2024-04-26T10:42:45.722 INFO:teuthology.orchestra.run.smithi049.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-26T10:42:45.722 INFO:teuthology.orchestra.run.smithi049.stdout: "rgwlc_auto_session_clear": "true", 2024-04-26T10:42:45.722 INFO:teuthology.orchestra.run.smithi049.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-26T10:42:45.722 INFO:teuthology.orchestra.run.smithi049.stdout: "rocksdb_block_size": "4096", 2024-04-26T10:42:45.722 INFO:teuthology.orchestra.run.smithi049.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-26T10:42:45.722 INFO:teuthology.orchestra.run.smithi049.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-26T10:42:45.722 INFO:teuthology.orchestra.run.smithi049.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-26T10:42:45.722 INFO:teuthology.orchestra.run.smithi049.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-26T10:42:45.722 INFO:teuthology.orchestra.run.smithi049.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-26T10:42:45.722 INFO:teuthology.orchestra.run.smithi049.stdout: "rocksdb_cache_size": "536870912", 2024-04-26T10:42:45.722 INFO:teuthology.orchestra.run.smithi049.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-26T10:42:45.722 INFO:teuthology.orchestra.run.smithi049.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-26T10:42:45.723 INFO:teuthology.orchestra.run.smithi049.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-26T10:42:45.723 INFO:teuthology.orchestra.run.smithi049.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-26T10:42:45.723 INFO:teuthology.orchestra.run.smithi049.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-26T10:42:45.723 INFO:teuthology.orchestra.run.smithi049.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-26T10:42:45.723 INFO:teuthology.orchestra.run.smithi049.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-26T10:42:45.723 INFO:teuthology.orchestra.run.smithi049.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-26T10:42:45.723 INFO:teuthology.orchestra.run.smithi049.stdout: "rocksdb_index_type": "binary_search", 2024-04-26T10:42:45.723 INFO:teuthology.orchestra.run.smithi049.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-26T10:42:45.723 INFO:teuthology.orchestra.run.smithi049.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-26T10:42:45.723 INFO:teuthology.orchestra.run.smithi049.stdout: "rocksdb_partition_filters": "false", 2024-04-26T10:42:45.723 INFO:teuthology.orchestra.run.smithi049.stdout: "rocksdb_perf": "false", 2024-04-26T10:42:45.723 INFO:teuthology.orchestra.run.smithi049.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-26T10:42:45.723 INFO:teuthology.orchestra.run.smithi049.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-26T10:42:45.723 INFO:teuthology.orchestra.run.smithi049.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-26T10:42:45.724 INFO:teuthology.orchestra.run.smithi049.stdout: "run_dir": "/var/run/ceph", 2024-04-26T10:42:45.724 INFO:teuthology.orchestra.run.smithi049.stdout: "seastore_block_create": "true", 2024-04-26T10:42:45.724 INFO:teuthology.orchestra.run.smithi049.stdout: "seastore_cache_lru_size": "67108864", 2024-04-26T10:42:45.724 INFO:teuthology.orchestra.run.smithi049.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-26T10:42:45.724 INFO:teuthology.orchestra.run.smithi049.stdout: "seastore_default_max_object_size": "16777216", 2024-04-26T10:42:45.724 INFO:teuthology.orchestra.run.smithi049.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-26T10:42:45.724 INFO:teuthology.orchestra.run.smithi049.stdout: "seastore_device_size": "53687091200", 2024-04-26T10:42:45.724 INFO:teuthology.orchestra.run.smithi049.stdout: "seastore_journal_batch_capacity": "16", 2024-04-26T10:42:45.724 INFO:teuthology.orchestra.run.smithi049.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-26T10:42:45.724 INFO:teuthology.orchestra.run.smithi049.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-26T10:42:45.724 INFO:teuthology.orchestra.run.smithi049.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-26T10:42:45.724 INFO:teuthology.orchestra.run.smithi049.stdout: "seastore_main_device_type": "SSD", 2024-04-26T10:42:45.724 INFO:teuthology.orchestra.run.smithi049.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-26T10:42:45.724 INFO:teuthology.orchestra.run.smithi049.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-26T10:42:45.725 INFO:teuthology.orchestra.run.smithi049.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-26T10:42:45.725 INFO:teuthology.orchestra.run.smithi049.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-26T10:42:45.725 INFO:teuthology.orchestra.run.smithi049.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-26T10:42:45.725 INFO:teuthology.orchestra.run.smithi049.stdout: "seastore_segment_size": "67108864", 2024-04-26T10:42:45.725 INFO:teuthology.orchestra.run.smithi049.stdout: "set_keepcaps": "false", 2024-04-26T10:42:45.725 INFO:teuthology.orchestra.run.smithi049.stdout: "setgroup": "", 2024-04-26T10:42:45.725 INFO:teuthology.orchestra.run.smithi049.stdout: "setuser": "", 2024-04-26T10:42:45.725 INFO:teuthology.orchestra.run.smithi049.stdout: "setuser_match_path": "", 2024-04-26T10:42:45.725 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-26T10:42:45.725 INFO:teuthology.orchestra.run.smithi049.stdout: "thp": "false", 2024-04-26T10:42:45.725 INFO:teuthology.orchestra.run.smithi049.stdout: "threadpool_default_timeout": "60", 2024-04-26T10:42:45.725 INFO:teuthology.orchestra.run.smithi049.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-26T10:42:45.725 INFO:teuthology.orchestra.run.smithi049.stdout: "throttler_perf_counter": "true" 2024-04-26T10:42:45.725 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-04-26T10:42:45.728 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-26T10:42:45.842 INFO:teuthology.orchestra.run.smithi049.stdout:mon.a: {} 2024-04-26T10:42:45.843 INFO:teuthology.orchestra.run.smithi049.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T10:42:45.851 INFO:teuthology.orchestra.run.smithi049.stdout:mon.b: {} 2024-04-26T10:42:45.851 INFO:teuthology.orchestra.run.smithi049.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T10:42:45.859 INFO:teuthology.orchestra.run.smithi049.stdout:mon.c: {} 2024-04-26T10:42:45.859 INFO:teuthology.orchestra.run.smithi049.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T10:42:45.870 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-04-26T10:42:45.870 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-26T10:42:45.896 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-26T10:42:45.896 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-26T10:42:45.896 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-26T10:42:45.896 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T10:42:45.896 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T10:42:45.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T10:42:45.897 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-04-26T10:42:45.897 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-26T10:42:45.897 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T10:42:45.897 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:42:45.898 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-26T10:42:45.898 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T10:42:45.898 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T10:42:45.898 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-26T10:42:45.898 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-26T10:42:45.899 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-26T10:42:45.899 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:42:45.899 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-26T10:42:45.899 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:42:45.900 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-26T10:42:45.900 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:42:45.902 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:45.899+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:45.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T10:42:45.917 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2024-04-26T10:42:45.984 INFO:teuthology.orchestra.run.smithi049.stderr:Cannot find device "ceph-brx" 2024-04-26T10:42:45.985 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:42:45.985 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-26T10:42:45.986 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T10:42:46.000 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:45.999+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:46.022 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:42:46.022 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T10:42:46.022 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:42:46.023 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:42:46.023 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:42:46.023 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:42:46.023 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:42:46.026 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:42:46.027 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:42:46.033 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:42:46.046 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1: {} 2024-04-26T10:42:46.046 INFO:teuthology.orchestra.run.smithi049.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:42:46.064 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:42:46.064 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:42:46.101 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:46.100+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:46.139 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:46.140 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:46.148 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:42:46.202 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:46.201+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:46.254 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:46.255 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:46.263 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:42:46.303 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:46.302+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:46.357 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T10:42:46.370 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T10:42:46.370 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T10:42:46.370 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-04-26T10:42:46.370 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T10:42:46.370 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T10:42:46.370 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T10:42:46.370 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T10:42:46.370 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T10:42:46.370 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T10:42:46.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T10:42:46.370 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-04-26T10:42:46.374 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:46.375 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:46.384 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:42:46.386 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T10:42:46.386 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T10:42:46.386 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T10:42:46.386 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-04-26T10:42:46.386 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-04-26T10:42:46.386 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-04-26T10:42:46.386 INFO:teuthology.orchestra.run.smithi049.stdout:2: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T10:42:46.386 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-04-26T10:42:46.386 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-04-26T10:42:46.386 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-26T10:42:46.387 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42775sec preferred_lft 42775sec 2024-04-26T10:42:46.387 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link noprefixroute 2024-04-26T10:42:46.387 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-04-26T10:42:46.387 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T10:42:46.387 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-04-26T10:42:46.387 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-04-26T10:42:46.387 INFO:teuthology.orchestra.run.smithi049.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T10:42:46.387 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-04-26T10:42:46.387 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-04-26T10:42:46.387 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T10:42:46.387 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-04-26T10:42:46.387 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-04-26T10:42:46.388 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T10:42:46.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T10:42:46.388 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-04-26T10:42:46.388 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-04-26T10:42:46.388 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add name ceph-brx type bridge 2024-04-26T10:42:46.388 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr flush dev ceph-brx 2024-04-26T10:42:46.388 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set ceph-brx up 2024-04-26T10:42:46.388 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T10:42:46.388 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-04-26T10:42:46.431 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:46.430+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:46.486 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:46.486 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:46.495 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:42:46.506 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:46.505+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:46.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T10:42:46.539 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T10:42:46.563 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-04-26T10:42:46.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T10:42:46.565 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-04-26T10:42:46.606 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:46.606+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:46.628 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-04-26T10:42:46.628 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T10:42:46.628 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-26T10:42:46.628 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-26T10:42:46.628 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T10:42:46.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T10:42:46.629 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-04-26T10:42:46.629 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-04-26T10:42:46.629 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T10:42:46.629 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T10:42:46.629 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T10:42:46.629 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-04-26T10:42:46.636 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:46.636 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:46.645 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:42:46.707 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:46.706+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:46.714 INFO:teuthology.orchestra.run.smithi049.stderr:noscrub is set 2024-04-26T10:42:46.762 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:46.762 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:46.769 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:42:46.811 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:46.809+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:46.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T10:42:46.859 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-04-26T10:42:46.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T10:42:46.875 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2024-04-26T10:42:46.909 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:46.908+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:46.912 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:46.912 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:46.920 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:42:46.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T10:42:46.930 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-04-26T10:42:46.930 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-04-26T10:42:46.930 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T10:42:46.930 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T10:42:46.930 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-04-26T10:42:47.008 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T10:42:47.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T10:42:47.008 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-04-26T10:42:47.008 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-04-26T10:42:47.008 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T10:42:47.008 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T10:42:47.008 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T10:42:47.008 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T10:42:47.008 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T10:42:47.008 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-04-26T10:42:47.010 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:47.009+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:47.020 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:47.020 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:47.029 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:42:47.111 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:47.110+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:47.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T10:42:47.135 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-04-26T10:42:47.135 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-04-26T10:42:47.135 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-04-26T10:42:47.135 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T10:42:47.135 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-04-26T10:42:47.148 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:47.148 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:47.157 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:42:47.173 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-26T10:42:47.173 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T10:42:47.173 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T10:42:47.212 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:47.211+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:47.229 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T10:42:47.229 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T10:42:47.229 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T10:42:47.262 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:47.263 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:47.271 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:42:47.284 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-04-26T10:42:47.313 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:47.312+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:47.350 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-26T10:42:47.350 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-26T10:42:47.377 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:47.378 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:47.387 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:42:47.414 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-26T10:42:47.415 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:47.413+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:47.415 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-26T10:42:47.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T10:42:47.416 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-04-26T10:42:47.470 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T10:42:47.471 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-26T10:42:47.501 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:47.501 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:47.510 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:42:47.512 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-04-26T10:42:47.514 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:47.513+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:47.537 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-26T10:42:47.537 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-26T10:42:47.601 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-26T10:42:47.603 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-26T10:42:47.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T10:42:47.603 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-04-26T10:42:47.606 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:2024-04-26T10:42:47.605+0000 7f72b3823480 -1 init, newargv = 0x563b17ec8a90 newargc=15 2024-04-26T10:42:47.606 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[31578]: starting ceph client 2024-04-26T10:42:47.610 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[31578]: starting fuse 2024-04-26T10:42:47.611 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:47.611 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:47.615 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:47.613+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:47.621 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:42:47.623 INFO:teuthology.orchestra.run.smithi049.stdout:42 2024-04-26T10:42:47.623 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-04-26T10:42:47.623 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-26T10:42:47.624 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-04-26T10:42:47.624 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-04-26T10:42:47.624 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-04-26T10:42:47.624 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-04-26T10:42:47.624 DEBUG:teuthology.orchestra.run.smithi049:> 2024-04-26T10:42:47.624 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-04-26T10:42:47.624 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-26T10:42:47.624 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-04-26T10:42:47.624 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T10:42:47.624 DEBUG:teuthology.orchestra.run.smithi049:> 2024-04-26T10:42:47.624 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-04-26T10:42:47.624 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-04-26T10:42:47.624 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-04-26T10:42:47.624 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-04-26T10:42:47.624 DEBUG:teuthology.orchestra.run.smithi049:> 2024-04-26T10:42:47.625 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-04-26T10:42:47.625 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T10:42:47.625 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T10:42:47.625 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T10:42:47.625 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-04-26T10:42:47.625 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-04-26T10:42:47.625 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-04-26T10:42:47.625 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T10:42:47.625 DEBUG:teuthology.orchestra.run.smithi049:> 2024-04-26T10:42:47.625 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.0")) 2024-04-26T10:42:47.625 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-04-26T10:42:47.716 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:47.715+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:47.725 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:47.726 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:47.735 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:42:47.742 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.0.31578.asok 2024-04-26T10:42:47.817 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:47.816+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:47.841 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:47.842 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:47.851 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:42:47.919 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:47.918+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:47.927 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.31578.asok 2024-04-26T10:42:47.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T10:42:47.928 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.31578.asok status 2024-04-26T10:42:47.952 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:47.953 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:47.962 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:42:48.019 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:48.019+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:48.064 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:48.064 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:48.065 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-04-26T10:42:48.065 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-04-26T10:42:48.065 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "dc093b5e41f728edab6e0330295fdf9156d31664", 2024-04-26T10:42:48.065 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 18.2.2-1256-gdc093b5e (dc093b5e41f728edab6e0330295fdf9156d31664) reef (stable)", 2024-04-26T10:42:48.065 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "0", 2024-04-26T10:42:48.065 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-04-26T10:42:48.065 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-26T10:42:48.065 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "31578", 2024-04-26T10:42:48.065 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-04-26T10:42:48.065 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:42:48.065 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-04-26T10:42:48.065 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-04-26T10:42:48.066 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 4532, 2024-04-26T10:42:48.066 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-04-26T10:42:48.066 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-04-26T10:42:48.066 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-04-26T10:42:48.066 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 4532 2024-04-26T10:42:48.066 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:42:48.066 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-04-26T10:42:48.066 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-04-26T10:42:48.066 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-04-26T10:42:48.066 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 1339716484 2024-04-26T10:42:48.066 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:42:48.066 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:42:48.066 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-04-26T10:42:48.066 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-04-26T10:42:48.066 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-04-26T10:42:48.067 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 1339716484 2024-04-26T10:42:48.067 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:42:48.067 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.4532 192.168.0.1:0/1339716484", 2024-04-26T10:42:48.067 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/1339716484", 2024-04-26T10:42:48.067 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-04-26T10:42:48.067 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 5, 2024-04-26T10:42:48.067 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 16, 2024-04-26T10:42:48.067 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-04-26T10:42:48.067 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-04-26T10:42:48.067 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-04-26T10:42:48.067 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-04-26T10:42:48.073 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:42:48.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T10:42:48.074 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-04-26T10:42:48.074 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-26T10:42:48.076 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:42:48.090 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-04-26T10:42:48.090 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-26T10:42:48.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T10:42:48.090 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T10:42:48.119 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:48.118+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:48.154 INFO:teuthology.run_tasks:Running task workunit... 2024-04-26T10:42:48.187 INFO:tasks.workunit:Pulling workunits from ref 7d2137f0a666c92a9411c1af5c33e4968be54da6 2024-04-26T10:42:48.188 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-26T10:42:48.188 INFO:tasks.workunit:timeout=3h 2024-04-26T10:42:48.188 INFO:tasks.workunit:cleanup=True 2024-04-26T10:42:48.188 DEBUG:teuthology.orchestra.run.smithi049:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-26T10:42:48.193 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:48.193 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:48.198 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:42:48.198 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:42:48.203 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:42:48.210 INFO:teuthology.orchestra.run.smithi049.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-26T10:42:48.210 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-26T10:42:48.210 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 2ah/42d Inode: 1 Links: 2 2024-04-26T10:42:48.210 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:42:48.210 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-26T10:42:48.210 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-26T10:42:48.210 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-04-26 10:42:26.030177801 +0000 2024-04-26T10:42:48.210 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-04-26 10:42:48.152762377 +0000 2024-04-26T10:42:48.210 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2024-04-26T10:42:48.211 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-26T10:42:48.211 DEBUG:teuthology.orchestra.run.smithi049:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-26T10:42:48.216 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1: {} 2024-04-26T10:42:48.217 INFO:teuthology.orchestra.run.smithi049.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:42:48.221 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:48.220+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:48.234 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:42:48.234 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:42:48.246 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7d2137f0a666c92a9411c1af5c33e4968be54da6 2024-04-26T10:42:48.302 INFO:tasks.workunit.client.0.smithi049.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-26T10:42:48.310 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:42:48.310 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:42:48.310 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:42:48.310 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:42:48.310 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:42:48.319 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:42:48.321 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:48.321+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:48.422 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:48.422+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:48.426 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:42:48.427 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:42:48.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:42:48.427 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:42:48.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.427 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:42:48.427 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:42:48.427 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 22.388840564999999, 2024-04-26T10:42:48.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:42:48.427 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:48.427 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.427 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:48.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.427 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:48.428 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:42:48.428 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.428 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:48.428 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:42:48.428 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.428 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:48.428 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:42:48.428 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:48.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:42:48.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:42:48.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:48.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:42:48.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:42:48.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:42:48.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:42:48.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:48.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:42:48.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:42:48.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:48.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:42:48.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:42:48.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:48.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:42:48.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:42:48.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:48.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:42:48.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:42:48.431 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.431 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:48.431 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.431 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.431 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:42:48.431 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 22.387090443999998, 2024-04-26T10:42:48.432 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:42:48.432 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:48.432 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.432 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:48.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.432 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:48.432 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:42:48.432 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.432 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:48.432 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:42:48.432 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.433 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:48.433 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:42:48.433 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:42:48.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.433 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:48.433 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:42:48.433 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:42:48.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.433 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:48.433 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:42:48.433 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:42:48.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.434 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.434 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:42:48.434 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:42:48.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.434 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:48.434 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:42:48.434 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:42:48.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.434 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:48.434 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:42:48.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:42:48.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:48.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:42:48.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:42:48.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:48.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:42:48.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:42:48.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:42:48.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:42:48.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:48.436 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:42:48.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:42:48.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:48.436 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:42:48.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:42:48.436 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.436 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:48.436 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 22.387037446000001, 2024-04-26T10:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:42:48.439 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:42:48.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.439 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:48.439 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:42:48.439 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:42:48.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.439 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.439 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:42:48.439 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:42:48.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.439 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:48.439 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:42:48.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:42:48.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.440 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:48.440 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:42:48.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:42:48.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.440 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:48.440 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:42:48.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:42:48.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:48.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:42:48.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:42:48.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:42:48.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:42:48.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:48.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:42:48.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:42:48.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:48.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:42:48.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:42:48.442 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.442 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:48.442 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.442 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.442 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:42:48.442 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 22.386959701999999, 2024-04-26T10:42:48.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:42:48.443 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:48.443 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.443 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:48.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:48.443 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:42:48.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:48.443 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:42:48.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:48.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:42:48.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:42:48.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:48.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:42:48.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:42:48.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:48.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:42:48.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:42:48.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:42:48.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:42:48.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:48.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:42:48.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:42:48.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:48.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:42:48.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:42:48.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:48.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:42:48.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:42:48.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:48.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:42:48.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:42:48.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:42:48.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:42:48.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:48.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:42:48.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:42:48.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:48.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:42:48.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:42:48.448 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.448 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:48.448 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.448 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.448 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:42:48.448 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 22.386920696000001, 2024-04-26T10:42:48.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:42:48.448 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:48.448 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.448 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:48.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:48.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:42:48.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:48.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:42:48.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:48.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:42:48.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:42:48.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:48.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:42:48.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:42:48.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:48.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:42:48.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:42:48.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:42:48.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:42:48.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:48.451 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:42:48.451 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:42:48.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:48.451 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:42:48.451 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:42:48.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:48.451 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:42:48.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:42:48.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.452 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:48.452 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:42:48.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:42:48.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.452 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.452 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:42:48.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:42:48.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.452 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:48.453 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:42:48.453 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:42:48.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.453 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:48.453 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:42:48.453 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:42:48.453 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.453 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:48.453 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.453 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.453 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:42:48.453 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 22.386901875, 2024-04-26T10:42:48.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:42:48.454 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:48.454 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.454 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:48.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.454 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:48.454 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:42:48.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.454 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:48.454 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:42:48.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:48.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:42:48.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:42:48.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:48.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:42:48.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:42:48.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:48.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:42:48.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:42:48.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:42:48.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:42:48.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:48.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:42:48.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:42:48.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:48.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:42:48.457 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:42:48.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.457 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:48.457 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:42:48.457 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:42:48.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.457 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:48.457 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:42:48.457 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:42:48.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.457 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.458 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:42:48.458 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:42:48.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.458 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:48.458 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:42:48.458 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:42:48.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.458 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:48.458 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:42:48.458 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:42:48.458 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.459 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:48.459 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.459 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.459 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:42:48.459 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 22.386869872999998, 2024-04-26T10:42:48.459 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:42:48.459 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:48.459 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.459 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:48.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.459 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:48.459 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:42:48.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.460 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:48.460 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:42:48.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.460 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:48.460 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:42:48.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.460 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:48.460 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:42:48.461 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:42:48.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:48.461 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:42:48.461 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:42:48.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.461 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:42:48.461 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:42:48.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:48.461 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:42:48.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:42:48.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.462 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:48.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:42:48.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:42:48.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.462 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:48.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:42:48.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:42:48.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.463 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:48.463 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:42:48.463 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:42:48.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.463 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.463 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:42:48.463 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:42:48.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.463 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:48.463 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:42:48.463 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:42:48.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.464 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:48.464 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:42:48.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:42:48.464 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.464 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:48.464 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.464 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.464 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:42:48.464 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 22.386661064999998, 2024-04-26T10:42:48.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:42:48.464 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:48.465 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.465 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:48.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:48.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:42:48.465 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:48.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:42:48.465 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:48.466 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:42:48.466 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:42:48.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.466 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:48.466 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:42:48.466 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:42:48.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.466 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:48.466 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:42:48.466 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:42:48.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.467 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.467 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:42:48.467 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:42:48.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.467 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:48.467 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:42:48.467 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:42:48.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.467 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:48.467 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:42:48.467 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:42:48.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.468 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:48.468 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:42:48.468 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:42:48.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.468 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:48.468 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:42:48.468 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:42:48.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.468 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.468 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:42:48.468 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:42:48.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.469 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:48.469 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:42:48.469 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:42:48.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.469 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:48.469 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:42:48.469 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:42:48.469 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.469 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:48.469 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.470 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.470 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:42:48.470 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 22.386629773999999, 2024-04-26T10:42:48.470 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:42:48.470 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:48.470 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:42:48.470 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:48.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.470 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:48.470 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:42:48.470 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.471 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:48.471 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:42:48.471 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.471 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:48.471 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:42:48.471 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.471 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:48.471 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:42:48.471 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:42:48.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.472 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:48.472 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:42:48.472 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:42:48.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.472 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.472 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:42:48.472 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:42:48.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.472 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:48.472 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:42:48.472 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:42:48.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.473 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:48.473 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:42:48.473 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:42:48.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.473 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:48.473 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:42:48.473 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:42:48.473 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.473 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:48.473 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.474 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.474 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:42:48.474 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 22.386602524000001, 2024-04-26T10:42:48.474 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:42:48.474 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:48.474 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:42:48.474 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:48.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.474 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:48.474 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:42:48.474 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:42:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:42:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:42:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:42:48.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:42:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:42:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:42:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:42:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:42:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:42:48.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:42:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:42:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:42:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:42:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.478 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:42:48.478 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:42:48.478 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 22.383825773000002, 2024-04-26T10:42:48.478 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:42:48.478 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:48.478 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:42:48.478 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:48.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.478 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:48.478 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:42:48.478 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:42:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:42:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:42:48.479 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:42:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:42:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:42:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:42:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:42:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:48.480 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:42:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:42:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:42:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:42:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:42:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:42:48.481 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 22.383775684, 2024-04-26T10:42:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:42:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:42:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:42:48.482 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:42:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:42:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:42:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:48.483 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:42:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:42:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:42:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:42:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:42:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:42:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:48.484 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:42:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:42:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:42:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:42:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:42:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:42:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:48.485 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:42:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:42:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 22.382883615000001, 2024-04-26T10:42:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:42:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:42:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.487 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:48.487 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:42:48.487 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.487 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:48.487 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:42:48.487 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.487 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:48.487 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:42:48.488 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:42:48.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.488 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:48.488 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:42:48.488 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:42:48.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.488 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.488 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:42:48.488 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:42:48.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.488 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:48.488 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:42:48.489 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:42:48.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.489 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:48.489 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:42:48.489 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:42:48.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.489 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:48.489 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:42:48.489 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:42:48.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.489 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:48.490 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:42:48.490 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:42:48.490 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.490 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:48.490 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.490 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.490 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.490 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:42:48.490 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:42:48.490 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 22.380695286000002, 2024-04-26T10:42:48.490 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:42:48.490 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:48.490 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.491 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:48.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.491 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:48.491 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:42:48.491 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.491 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:48.491 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:42:48.491 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.491 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:48.491 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:42:48.491 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.492 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:48.492 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:42:48.492 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:42:48.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.492 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:48.492 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:42:48.492 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:42:48.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.492 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.492 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:42:48.493 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:42:48.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.493 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:48.493 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:42:48.493 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:42:48.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.493 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:48.493 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:42:48.493 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:42:48.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.493 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:48.494 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:42:48.494 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:42:48.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.494 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.494 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:48.494 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:42:48.494 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:42:48.494 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.494 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:48.494 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.494 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.494 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:42:48.494 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:42:48.495 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 22.380559915999999, 2024-04-26T10:42:48.495 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:42:48.495 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:48.495 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.495 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:48.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.495 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:48.495 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:42:48.495 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.495 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:48.495 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:42:48.495 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.496 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:48.496 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:42:48.496 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.496 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:48.496 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:42:48.496 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:42:48.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.496 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:48.496 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:42:48.496 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:42:48.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.497 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.497 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:42:48.497 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:42:48.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.497 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:48.497 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:42:48.497 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:42:48.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.497 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:48.497 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:42:48.498 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:42:48.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.498 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:48.498 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:42:48.498 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:42:48.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.498 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:48.498 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:42:48.498 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:42:48.498 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.498 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:48.498 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.499 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:42:48.499 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:42:48.499 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 22.380345341999998, 2024-04-26T10:42:48.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:42:48.499 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:48.499 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.499 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:48.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.499 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:48.499 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:42:48.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:42:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:42:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:48.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:42:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:42:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:42:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:42:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:42:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:42:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:48.501 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:42:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:42:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:42:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:42:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:42:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:42:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:42:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:42:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:42:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:42:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 22.380006400999999, 2024-04-26T10:42:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:42:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:48.503 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:42:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:42:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:42:48.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:42:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:42:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:42:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:42:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.505 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:42:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:42:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:42:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:42:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:42:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:42:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:42:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:42:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:42:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:42:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:42:48.507 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:42:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 22.379897024000002, 2024-04-26T10:42:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:42:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:42:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:42:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:48.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:42:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:42:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:42:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:42:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:42:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.509 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:42:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:42:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:42:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:42:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:42:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:42:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:42:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:42:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:42:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:42:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 22.379857305000002, 2024-04-26T10:42:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:42:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:48.511 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.512 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:48.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:48.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:42:48.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:48.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:42:48.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:48.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:42:48.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:42:48.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:48.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:42:48.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:42:48.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:48.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:42:48.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:42:48.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:42:48.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:42:48.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:48.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:42:48.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:42:48.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:48.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:42:48.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:42:48.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:48.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:42:48.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:42:48.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:48.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:42:48.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:42:48.515 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.515 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:48.515 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.515 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:42:48.515 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:42:48.516 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 22.379519771999998, 2024-04-26T10:42:48.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:42:48.517 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:48.517 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.517 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:48.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:48.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:42:48.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:48.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:42:48.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:48.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:48.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:42:48.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:48.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:42:48.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:42:48.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:48.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:42:48.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:42:48.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:42:48.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:42:48.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:48.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:42:48.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:42:48.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:48.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:42:48.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:42:48.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:48.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:42:48.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:42:48.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:48.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:48.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:48.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:42:48.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:42:48.520 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.520 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:48.520 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.520 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:48.520 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:48.521 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:42:48.522 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:42:48.523 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:48.522+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:48.624 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:48.623+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:48.635 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-26T10:42:48.635 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-26T10:42:48.635 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-26T10:42:48.635 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-26T10:42:48.644 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:42:48.725 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:48.725+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:48.729 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:42:48.788 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-26T10:42:48.788 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-26T10:42:48.788 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-26T10:42:48.788 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-26T10:42:48.789 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-26T10:42:48.797 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:42:48.841 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:48.840+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:48.901 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-26T10:42:48.901 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-26T10:42:48.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-26T10:42:48.901 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-26T10:42:48.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.901 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:42:48.901 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:42:48.902 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.033967144999998, 2024-04-26T10:42:48.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086884530000000005, 2024-04-26T10:42:48.902 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:48.902 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.902 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:42:48.902 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:42:48.902 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:42:48.902 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 164 2024-04-26T10:42:48.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.902 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:48.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.902 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:48.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:42:48.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:48.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:42:48.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:48.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:42:48.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-26T10:42:48.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:48.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864858+0000", 2024-04-26T10:42:48.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3231e-05 2024-04-26T10:42:48.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:48.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864862+0000", 2024-04-26T10:42:48.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9280000000000003e-06 2024-04-26T10:42:48.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864865+0000", 2024-04-26T10:42:48.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8289999999999999e-06 2024-04-26T10:42:48.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:48.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869688+0000", 2024-04-26T10:42:48.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048234990000000002 2024-04-26T10:42:48.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:48.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869732+0000", 2024-04-26T10:42:48.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3232999999999998e-05 2024-04-26T10:42:48.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:48.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869804+0000", 2024-04-26T10:42:48.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2152999999999998e-05 2024-04-26T10:42:48.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.872812+0000", 2024-04-26T10:42:48.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003008372 2024-04-26T10:42:48.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:48.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873459+0000", 2024-04-26T10:42:48.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064655699999999997 2024-04-26T10:42:48.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:48.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873482+0000", 2024-04-26T10:42:48.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3419999999999999e-05 2024-04-26T10:42:48.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:48.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873504+0000", 2024-04-26T10:42:48.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1440000000000001e-05 2024-04-26T10:42:48.907 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.907 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:48.908 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.908 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:42:48.908 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:42:48.908 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.033914205999999, 2024-04-26T10:42:48.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0092811590000000006, 2024-04-26T10:42:48.908 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:48.908 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.908 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:42:48.908 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:42:48.908 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:42:48.908 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 165 2024-04-26T10:42:48.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.908 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:48.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:48.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:42:48.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:48.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:42:48.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:48.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:42:48.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:48.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864871+0000", 2024-04-26T10:42:48.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2200000000000001e-06 2024-04-26T10:42:48.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:48.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864875+0000", 2024-04-26T10:42:48.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.206e-06 2024-04-26T10:42:48.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864878+0000", 2024-04-26T10:42:48.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5799999999999999e-06 2024-04-26T10:42:48.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:48.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873137+0000", 2024-04-26T10:42:48.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082591609999999992 2024-04-26T10:42:48.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:48.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873186+0000", 2024-04-26T10:42:48.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8741e-05 2024-04-26T10:42:48.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:48.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873252+0000", 2024-04-26T10:42:48.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5877000000000006e-05 2024-04-26T10:42:48.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:48.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873708+0000", 2024-04-26T10:42:48.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00045660299999999998 2024-04-26T10:42:48.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874091+0000", 2024-04-26T10:42:48.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038295000000000001 2024-04-26T10:42:48.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:48.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874115+0000", 2024-04-26T10:42:48.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:42:48.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.913 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:48.913 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874149+0000", 2024-04-26T10:42:48.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4320999999999999e-05 2024-04-26T10:42:48.913 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.913 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:48.913 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.913 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:42:48.913 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:42:48.913 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.896816570999999, 2024-04-26T10:42:48.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010199138999999999, 2024-04-26T10:42:48.913 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:48.914 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.914 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:42:48.914 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:42:48.914 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:42:48.914 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 188 2024-04-26T10:42:48.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.914 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:48.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.914 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:48.914 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:42:48.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.914 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:48.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:42:48.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:48.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:42:48.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-26T10:42:48.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:48.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002024+0000", 2024-04-26T10:42:48.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8050999999999997e-05 2024-04-26T10:42:48.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:48.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002034+0000", 2024-04-26T10:42:48.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0217000000000001e-05 2024-04-26T10:42:48.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002039+0000", 2024-04-26T10:42:48.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6879999999999998e-06 2024-04-26T10:42:48.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:48.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006586+0000", 2024-04-26T10:42:48.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045473570000000001 2024-04-26T10:42:48.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:48.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006626+0000", 2024-04-26T10:42:48.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9688999999999999e-05 2024-04-26T10:42:48.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:48.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006689+0000", 2024-04-26T10:42:48.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3243000000000004e-05 2024-04-26T10:42:48.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007850+0000", 2024-04-26T10:42:48.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011607989999999999 2024-04-26T10:42:48.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:48.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012084+0000", 2024-04-26T10:42:48.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042340069999999997 2024-04-26T10:42:48.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:48.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012132+0000", 2024-04-26T10:42:48.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8112999999999998e-05 2024-04-26T10:42:48.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.918 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:48.918 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012165+0000", 2024-04-26T10:42:48.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3189999999999999e-05 2024-04-26T10:42:48.919 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.919 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:48.919 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.919 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:42:48.919 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:42:48.919 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 26.896739871000001, 2024-04-26T10:42:48.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010167136, 2024-04-26T10:42:48.919 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:48.919 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.919 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:42:48.919 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:42:48.919 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:42:48.920 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 189 2024-04-26T10:42:48.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.920 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:48.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:48.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:42:48.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:48.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:42:48.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:48.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:42:48.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:48.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002044+0000", 2024-04-26T10:42:48.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.119e-06 2024-04-26T10:42:48.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:48.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002047+0000", 2024-04-26T10:42:48.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0199999999999999e-06 2024-04-26T10:42:48.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002050+0000", 2024-04-26T10:42:48.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3360000000000002e-06 2024-04-26T10:42:48.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:48.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007165+0000", 2024-04-26T10:42:48.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051155879999999999 2024-04-26T10:42:48.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:48.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007209+0000", 2024-04-26T10:42:48.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4097000000000001e-05 2024-04-26T10:42:48.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:48.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007278+0000", 2024-04-26T10:42:48.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8663000000000003e-05 2024-04-26T10:42:48.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.008047+0000", 2024-04-26T10:42:48.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00076935299999999996 2024-04-26T10:42:48.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:48.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012171+0000", 2024-04-26T10:42:48.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004123219 2024-04-26T10:42:48.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:48.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012193+0000", 2024-04-26T10:42:48.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2169000000000001e-05 2024-04-26T10:42:48.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:48.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012210+0000", 2024-04-26T10:42:48.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6841999999999999e-05 2024-04-26T10:42:48.924 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.924 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:48.924 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.925 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.925 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:42:48.925 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.865276477999998, 2024-04-26T10:42:48.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010195469, 2024-04-26T10:42:48.925 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:48.925 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.925 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:48.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:48.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:42:48.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:48.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:42:48.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:48.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033504+0000", 2024-04-26T10:42:48.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999981 2024-04-26T10:42:48.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:48.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033513+0000", 2024-04-26T10:42:48.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6829999999999997e-06 2024-04-26T10:42:48.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:48.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033525+0000", 2024-04-26T10:42:48.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2748000000000001e-05 2024-04-26T10:42:48.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033537+0000", 2024-04-26T10:42:48.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1243999999999999e-05 2024-04-26T10:42:48.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:48.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034018+0000", 2024-04-26T10:42:48.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048138899999999998 2024-04-26T10:42:48.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-04-26T10:42:48.928 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034025+0000", 2024-04-26T10:42:48.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8870000000000003e-06 2024-04-26T10:42:48.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.928 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:48.928 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035264+0000", 2024-04-26T10:42:48.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0012385370000000001 2024-04-26T10:42:48.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.928 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:48.928 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035372+0000", 2024-04-26T10:42:48.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010851199999999999 2024-04-26T10:42:48.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:48.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035473+0000", 2024-04-26T10:42:48.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000100967 2024-04-26T10:42:48.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043270+0000", 2024-04-26T10:42:48.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0077971869999999997 2024-04-26T10:42:48.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:48.929 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043620+0000", 2024-04-26T10:42:48.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034962099999999999 2024-04-26T10:42:48.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:48.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043665+0000", 2024-04-26T10:42:48.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5426999999999997e-05 2024-04-26T10:42:48.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:48.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043701+0000", 2024-04-26T10:42:48.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6072000000000003e-05 2024-04-26T10:42:48.930 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.930 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:48.930 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.930 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.931 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:42:48.931 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.864791399000001, 2024-04-26T10:42:48.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099286970000000002, 2024-04-26T10:42:48.931 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:48.931 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.931 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:48.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:48.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:42:48.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:48.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:42:48.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:48.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033990+0000", 2024-04-26T10:42:48.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-26T10:42:48.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:48.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033998+0000", 2024-04-26T10:42:48.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7970000000000001e-06 2024-04-26T10:42:48.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:48.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034010+0000", 2024-04-26T10:42:48.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2383e-05 2024-04-26T10:42:48.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034021+0000", 2024-04-26T10:42:48.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0824e-05 2024-04-26T10:42:48.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:48.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035774+0000", 2024-04-26T10:42:48.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017527479999999999 2024-04-26T10:42:48.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:48.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035929+0000", 2024-04-26T10:42:48.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000155735 2024-04-26T10:42:48.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:48.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036083+0000", 2024-04-26T10:42:48.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000153635 2024-04-26T10:42:48.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043369+0000", 2024-04-26T10:42:48.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0072854490000000003 2024-04-26T10:42:48.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:48.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043709+0000", 2024-04-26T10:42:48.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034039600000000003 2024-04-26T10:42:48.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:48.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043878+0000", 2024-04-26T10:42:48.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016924799999999999 2024-04-26T10:42:48.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:48.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043920+0000", 2024-04-26T10:42:48.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1471999999999999e-05 2024-04-26T10:42:48.935 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.936 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:48.936 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.936 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.936 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:42:48.936 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.864752120999999, 2024-04-26T10:42:48.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010011091999999999, 2024-04-26T10:42:48.936 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:48.936 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.936 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:48.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:48.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:42:48.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:48.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:42:48.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:48.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:42:48.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:48.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034040+0000", 2024-04-26T10:42:48.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8560000000000002e-06 2024-04-26T10:42:48.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:48.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034048+0000", 2024-04-26T10:42:48.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4139999999999994e-06 2024-04-26T10:42:48.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034054+0000", 2024-04-26T10:42:48.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8950000000000003e-06 2024-04-26T10:42:48.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:48.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036269+0000", 2024-04-26T10:42:48.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002215528 2024-04-26T10:42:48.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:48.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036364+0000", 2024-04-26T10:42:48.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4089e-05 2024-04-26T10:42:48.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:48.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036443+0000", 2024-04-26T10:42:48.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9666000000000006e-05 2024-04-26T10:42:48.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043451+0000", 2024-04-26T10:42:48.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0070081939999999997 2024-04-26T10:42:48.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:48.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043930+0000", 2024-04-26T10:42:48.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00047819799999999999 2024-04-26T10:42:48.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:48.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043999+0000", 2024-04-26T10:42:48.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9136999999999999e-05 2024-04-26T10:42:48.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.940 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:48.940 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044041+0000", 2024-04-26T10:42:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2624999999999999e-05 2024-04-26T10:42:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:42:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.864713154, 2024-04-26T10:42:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015256755, 2024-04-26T10:42:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:48.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:42:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:42:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:42:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:48.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034073+0000", 2024-04-26T10:42:48.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1099999999999996e-06 2024-04-26T10:42:48.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:48.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034081+0000", 2024-04-26T10:42:48.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0539999999999995e-06 2024-04-26T10:42:48.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034087+0000", 2024-04-26T10:42:48.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0240000000000003e-06 2024-04-26T10:42:48.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:48.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036668+0000", 2024-04-26T10:42:48.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002581014 2024-04-26T10:42:48.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:48.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036717+0000", 2024-04-26T10:42:48.944 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9299999999999999e-05 2024-04-26T10:42:48.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.944 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.944 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:48.944 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036846+0000", 2024-04-26T10:42:48.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012901000000000001 2024-04-26T10:42:48.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:48.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044050+0000", 2024-04-26T10:42:48.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007203816 2024-04-26T10:42:48.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049229+0000", 2024-04-26T10:42:48.945 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051792169999999998 2024-04-26T10:42:48.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.945 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.945 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:48.945 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049282+0000", 2024-04-26T10:42:48.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2605000000000002e-05 2024-04-26T10:42:48.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.946 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:48.946 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049326+0000", 2024-04-26T10:42:48.946 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4255000000000002e-05 2024-04-26T10:42:48.946 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.946 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:48.946 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.946 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.946 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.946 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:42:48.946 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.864688491999999, 2024-04-26T10:42:48.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01538838, 2024-04-26T10:42:48.947 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:48.947 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.947 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:48.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.947 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:48.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:42:48.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.947 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:48.947 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:42:48.947 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.947 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:48.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034093+0000", 2024-04-26T10:42:48.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:48.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034097+0000", 2024-04-26T10:42:48.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.213e-06 2024-04-26T10:42:48.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.948 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:48.948 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034104+0000", 2024-04-26T10:42:48.948 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9840000000000004e-06 2024-04-26T10:42:48.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.948 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034111+0000", 2024-04-26T10:42:48.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9199999999999998e-06 2024-04-26T10:42:48.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:48.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.037736+0000", 2024-04-26T10:42:48.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036257429999999998 2024-04-26T10:42:48.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.949 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:48.949 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:42:48.949 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034004 2024-04-26T10:42:48.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.949 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:48.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038526+0000", 2024-04-26T10:42:48.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00044924100000000002 2024-04-26T10:42:48.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:48.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044708+0000", 2024-04-26T10:42:48.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061823360000000001 2024-04-26T10:42:48.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.950 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.950 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.950 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:42:48.950 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046886159999999996 2024-04-26T10:42:48.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:48.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049446+0000", 2024-04-26T10:42:48.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.973e-05 2024-04-26T10:42:48.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.951 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:48.951 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049482+0000", 2024-04-26T10:42:48.951 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6004999999999998e-05 2024-04-26T10:42:48.951 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.951 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:48.951 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.951 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.951 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.952 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:42:48.952 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.864666970999998, 2024-04-26T10:42:48.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015480648, 2024-04-26T10:42:48.952 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:48.952 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.952 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:48.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:48.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:42:48.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.952 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.952 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:48.952 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:42:48.952 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:48.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:42:48.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:48.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034118+0000", 2024-04-26T10:42:48.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1769999999999998e-06 2024-04-26T10:42:48.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.953 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.953 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:48.953 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034126+0000", 2024-04-26T10:42:48.953 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7770000000000002e-06 2024-04-26T10:42:48.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034146+0000", 2024-04-26T10:42:48.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0579999999999999e-05 2024-04-26T10:42:48.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:48.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039740+0000", 2024-04-26T10:42:48.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0055940269999999997 2024-04-26T10:42:48.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.954 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.954 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:48.954 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039848+0000", 2024-04-26T10:42:48.954 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010775100000000001 2024-04-26T10:42:48.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:48.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040022+0000", 2024-04-26T10:42:48.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000173964 2024-04-26T10:42:48.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:48.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044721+0000", 2024-04-26T10:42:48.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046989099999999997 2024-04-26T10:42:48.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.955 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.955 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.955 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049541+0000", 2024-04-26T10:42:48.955 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048200789999999997 2024-04-26T10:42:48.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:48.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049574+0000", 2024-04-26T10:42:48.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2817000000000001e-05 2024-04-26T10:42:48.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.956 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:48.956 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049596+0000", 2024-04-26T10:42:48.956 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2011999999999999e-05 2024-04-26T10:42:48.956 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.956 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:48.956 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.957 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.957 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:42:48.957 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.864631012, 2024-04-26T10:42:48.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015538033, 2024-04-26T10:42:48.957 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:48.957 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.957 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:48.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.957 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:48.957 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:42:48.957 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.957 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.957 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.957 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:48.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:42:48.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:48.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:42:48.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:48.958 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034155+0000", 2024-04-26T10:42:48.958 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.177e-06 2024-04-26T10:42:48.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.958 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.958 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:48.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034161+0000", 2024-04-26T10:42:48.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0780000000000001e-06 2024-04-26T10:42:48.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034168+0000", 2024-04-26T10:42:48.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8689999999999998e-06 2024-04-26T10:42:48.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.959 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:48.959 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041069+0000", 2024-04-26T10:42:48.959 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069010440000000003 2024-04-26T10:42:48.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.959 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:48.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041221+0000", 2024-04-26T10:42:48.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015175 2024-04-26T10:42:48.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:48.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041350+0000", 2024-04-26T10:42:48.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012870899999999999 2024-04-26T10:42:48.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.960 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:48.960 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045386+0000", 2024-04-26T10:42:48.960 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040364789999999999 2024-04-26T10:42:48.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.960 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049641+0000", 2024-04-26T10:42:48.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042552120000000004 2024-04-26T10:42:48.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:48.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049669+0000", 2024-04-26T10:42:48.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7809000000000001e-05 2024-04-26T10:42:48.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.961 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.961 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:48.961 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049689+0000", 2024-04-26T10:42:48.961 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0336e-05 2024-04-26T10:42:48.961 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.961 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:48.962 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.962 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.962 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.962 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:42:48.962 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.864609182999999, 2024-04-26T10:42:48.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015595107, 2024-04-26T10:42:48.962 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:48.962 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.962 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:48.962 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.962 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:48.962 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:42:48.962 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.962 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:48.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:42:48.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:48.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:42:48.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.963 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:48.963 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034176+0000", 2024-04-26T10:42:48.963 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0089999999999999e-06 2024-04-26T10:42:48.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:48.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034182+0000", 2024-04-26T10:42:48.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4579999999999998e-06 2024-04-26T10:42:48.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034187+0000", 2024-04-26T10:42:48.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0880000000000002e-06 2024-04-26T10:42:48.964 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.964 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.964 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:48.964 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045564+0000", 2024-04-26T10:42:48.964 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011376475 2024-04-26T10:42:48.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:48.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045623+0000", 2024-04-26T10:42:48.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9388999999999997e-05 2024-04-26T10:42:48.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:48.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045713+0000", 2024-04-26T10:42:48.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0211999999999996e-05 2024-04-26T10:42:48.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.965 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.965 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:48.965 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046325+0000", 2024-04-26T10:42:48.965 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00061181699999999996 2024-04-26T10:42:48.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049722+0000", 2024-04-26T10:42:48.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033962380000000002 2024-04-26T10:42:48.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:48.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049750+0000", 2024-04-26T10:42:48.966 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8087000000000001e-05 2024-04-26T10:42:48.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.966 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.966 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:48.966 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049768+0000", 2024-04-26T10:42:48.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8681999999999998e-05 2024-04-26T10:42:48.967 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.967 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:48.967 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.967 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.967 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:42:48.967 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.864395658999999, 2024-04-26T10:42:48.967 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087543810000000003, 2024-04-26T10:42:48.967 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:48.967 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.967 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:48.967 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:48.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:42:48.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:48.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:42:48.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.968 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:48.968 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034386+0000", 2024-04-26T10:42:48.968 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-26T10:42:48.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.968 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:48.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034397+0000", 2024-04-26T10:42:48.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0878e-05 2024-04-26T10:42:48.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:48.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034408+0000", 2024-04-26T10:42:48.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1138000000000001e-05 2024-04-26T10:42:48.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.969 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.969 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034414+0000", 2024-04-26T10:42:48.969 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2910000000000004e-06 2024-04-26T10:42:48.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.969 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:48.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036009+0000", 2024-04-26T10:42:48.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0015952029999999999 2024-04-26T10:42:48.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:48.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036120+0000", 2024-04-26T10:42:48.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000110584 2024-04-26T10:42:48.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.970 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.970 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:42:48.970 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036225+0000", 2024-04-26T10:42:48.970 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010523599999999999 2024-04-26T10:42:48.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:48.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039276+0000", 2024-04-26T10:42:48.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003050404 2024-04-26T10:42:48.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:42:48.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037356099999999999 2024-04-26T10:42:48.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.971 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.971 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:48.971 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043079+0000", 2024-04-26T10:42:48.971 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8099e-05 2024-04-26T10:42:48.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.972 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:48.972 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043141+0000", 2024-04-26T10:42:48.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1655999999999994e-05 2024-04-26T10:42:48.972 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.972 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:48.972 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.972 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.972 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.972 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:42:48.972 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.864335101999998, 2024-04-26T10:42:48.972 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090131610000000004, 2024-04-26T10:42:48.972 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:48.973 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.973 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:48.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:48.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:42:48.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:48.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:42:48.973 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.973 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.973 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:48.973 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:42:48.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:48.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034451+0000", 2024-04-26T10:42:48.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9600000000000002e-06 2024-04-26T10:42:48.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:48.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034458+0000", 2024-04-26T10:42:48.974 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5820000000000004e-06 2024-04-26T10:42:48.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.974 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.974 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.974 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034463+0000", 2024-04-26T10:42:48.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0719999999999999e-06 2024-04-26T10:42:48.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:48.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036527+0000", 2024-04-26T10:42:48.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002063755 2024-04-26T10:42:48.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:48.975 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036610+0000", 2024-04-26T10:42:48.975 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2669000000000004e-05 2024-04-26T10:42:48.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.975 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.975 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:42:48.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036744+0000", 2024-04-26T10:42:48.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013412499999999999 2024-04-26T10:42:48.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:48.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040144+0000", 2024-04-26T10:42:48.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033999799999999999 2024-04-26T10:42:48.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.976 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043301+0000", 2024-04-26T10:42:48.976 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031572240000000001 2024-04-26T10:42:48.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.976 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.976 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:48.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043425+0000", 2024-04-26T10:42:48.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000123664 2024-04-26T10:42:48.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.977 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:48.977 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043460+0000", 2024-04-26T10:42:48.977 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5651000000000001e-05 2024-04-26T10:42:48.977 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.977 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:48.977 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.977 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.977 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.977 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:42:48.977 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.864310201999999, 2024-04-26T10:42:48.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086028210000000001, 2024-04-26T10:42:48.978 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:48.978 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.978 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:48.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:48.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:42:48.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.978 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.978 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:48.978 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:42:48.978 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:48.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:42:48.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:48.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034482+0000", 2024-04-26T10:42:48.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8630000000000003e-06 2024-04-26T10:42:48.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.979 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.979 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:48.979 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034494+0000", 2024-04-26T10:42:48.979 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-04-26T10:42:48.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034501+0000", 2024-04-26T10:42:48.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7050000000000002e-06 2024-04-26T10:42:48.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:48.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035138+0000", 2024-04-26T10:42:48.980 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00063744099999999998 2024-04-26T10:42:48.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.980 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.980 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:48.980 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035286+0000", 2024-04-26T10:42:48.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014766200000000001 2024-04-26T10:42:48.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:42:48.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035654+0000", 2024-04-26T10:42:48.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00036779100000000002 2024-04-26T10:42:48.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:48.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040833+0000", 2024-04-26T10:42:48.981 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051795640000000002 2024-04-26T10:42:48.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.981 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.981 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.981 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.042886+0000", 2024-04-26T10:42:48.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020531220000000001 2024-04-26T10:42:48.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:48.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043015+0000", 2024-04-26T10:42:48.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012824099999999999 2024-04-26T10:42:48.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.982 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.982 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:48.982 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043075+0000", 2024-04-26T10:42:48.982 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0262e-05 2024-04-26T10:42:48.982 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.982 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:48.982 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.983 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.983 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:42:48.983 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.864274239, 2024-04-26T10:42:48.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01482116, 2024-04-26T10:42:48.983 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:48.983 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.983 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:48.983 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.983 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:48.983 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:42:48.983 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:48.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:42:48.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:48.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:42:48.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.984 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.984 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:48.984 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034515+0000", 2024-04-26T10:42:48.984 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.391e-06 2024-04-26T10:42:48.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:48.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034522+0000", 2024-04-26T10:42:48.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7889999999999997e-06 2024-04-26T10:42:48.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034601+0000", 2024-04-26T10:42:48.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9547000000000003e-05 2024-04-26T10:42:48.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.985 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.985 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:48.985 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036510+0000", 2024-04-26T10:42:48.985 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019092289999999999 2024-04-26T10:42:48.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.986 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:48.986 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036642+0000", 2024-04-26T10:42:48.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013151100000000001 2024-04-26T10:42:48.986 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.986 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:48.986 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036766+0000", 2024-04-26T10:42:48.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012367300000000001 2024-04-26T10:42:48.986 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.986 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.986 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:48.986 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040749+0000", 2024-04-26T10:42:48.986 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039838419999999996 2024-04-26T10:42:48.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049262+0000", 2024-04-26T10:42:48.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085127789999999998 2024-04-26T10:42:48.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:48.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049301+0000", 2024-04-26T10:42:48.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8834000000000001e-05 2024-04-26T10:42:48.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.987 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.987 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:48.987 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049329+0000", 2024-04-26T10:42:48.987 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.817e-05 2024-04-26T10:42:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:42:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.864141541999999, 2024-04-26T10:42:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014796093999999999, 2024-04-26T10:42:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.988 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:42:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:42:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034640+0000", 2024-04-26T10:42:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.989 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034650+0000", 2024-04-26T10:42:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0064999999999999e-05 2024-04-26T10:42:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034660+0000", 2024-04-26T10:42:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.961e-06 2024-04-26T10:42:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034680+0000", 2024-04-26T10:42:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9219e-05 2024-04-26T10:42:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.990 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:48.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.037926+0000", 2024-04-26T10:42:48.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032460380000000001 2024-04-26T10:42:48.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:48.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038068+0000", 2024-04-26T10:42:48.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014236000000000001 2024-04-26T10:42:48.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.991 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:48.991 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038201+0000", 2024-04-26T10:42:48.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013345300000000001 2024-04-26T10:42:48.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:48.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043497+0000", 2024-04-26T10:42:48.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052952770000000001 2024-04-26T10:42:48.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049373+0000", 2024-04-26T10:42:48.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058762900000000002 2024-04-26T10:42:48.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:48.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049411+0000", 2024-04-26T10:42:48.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7737000000000001e-05 2024-04-26T10:42:48.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:48.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049437+0000", 2024-04-26T10:42:48.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6169999999999998e-05 2024-04-26T10:42:48.993 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.993 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:48.993 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.993 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.993 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:42:48.993 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.864097032, 2024-04-26T10:42:48.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0092140799999999995, 2024-04-26T10:42:48.994 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:48.994 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.994 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:48.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:48.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:42:48.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:48.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:42:48.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:42:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034688+0000", 2024-04-26T10:42:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5480000000000002e-06 2024-04-26T10:42:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034694+0000", 2024-04-26T10:42:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1310000000000003e-06 2024-04-26T10:42:48.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:48.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034700+0000", 2024-04-26T10:42:48.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4229999999999996e-06 2024-04-26T10:42:48.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:48.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036183+0000", 2024-04-26T10:42:48.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001482964 2024-04-26T10:42:48.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:48.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036297+0000", 2024-04-26T10:42:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113649 2024-04-26T10:42:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:42:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036426+0000", 2024-04-26T10:42:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012924900000000001 2024-04-26T10:42:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040839+0000", 2024-04-26T10:42:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044137079999999997 2024-04-26T10:42:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:48.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043679+0000", 2024-04-26T10:42:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028397850000000001 2024-04-26T10:42:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043725+0000", 2024-04-26T10:42:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5859999999999998e-05 2024-04-26T10:42:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043899+0000", 2024-04-26T10:42:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000174267 2024-04-26T10:42:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.998 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:42:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.864074098, 2024-04-26T10:42:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011493046999999999, 2024-04-26T10:42:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:42:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:48.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:42:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:42:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034711+0000", 2024-04-26T10:42:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4359999999999998e-06 2024-04-26T10:42:49.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034717+0000", 2024-04-26T10:42:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7939999999999999e-06 2024-04-26T10:42:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034723+0000", 2024-04-26T10:42:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6219999999999997e-06 2024-04-26T10:42:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035221+0000", 2024-04-26T10:42:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00049811199999999999 2024-04-26T10:42:49.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035351+0000", 2024-04-26T10:42:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013049200000000001 2024-04-26T10:42:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035467+0000", 2024-04-26T10:42:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115364 2024-04-26T10:42:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040085+0000", 2024-04-26T10:42:49.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046182300000000001 2024-04-26T10:42:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046133+0000", 2024-04-26T10:42:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060476059999999996 2024-04-26T10:42:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046165+0000", 2024-04-26T10:42:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2155e-05 2024-04-26T10:42:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046201+0000", 2024-04-26T10:42:49.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6566999999999997e-05 2024-04-26T10:42:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:42:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 22.863987688999998, 2024-04-26T10:42:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014742026, 2024-04-26T10:42:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-26T10:42:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:49.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:42:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:42:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034793+0000", 2024-04-26T10:42:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-26T10:42:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:49.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034802+0000", 2024-04-26T10:42:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.551e-06 2024-04-26T10:42:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034815+0000", 2024-04-26T10:42:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2706e-05 2024-04-26T10:42:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034824+0000", 2024-04-26T10:42:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5189999999999998e-06 2024-04-26T10:42:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:49.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039312+0000", 2024-04-26T10:42:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044874030000000001 2024-04-26T10:42:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039457+0000", 2024-04-26T10:42:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000145081 2024-04-26T10:42:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049537+0000", 2024-04-26T10:42:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010080053 2024-04-26T10:42:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:49.007 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:49.008 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:49.008 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:49.008 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:49.008 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-26T10:42:49.009 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:42:49.010 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:49.008+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:49.110 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:49.109+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:49.123 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:42:49.123 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:42:49.123 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:42:49.124 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:42:49.133 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:42:49.211 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:49.210+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:49.235 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:42:49.235 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:42:49.235 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:42:49.235 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:42:49.235 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:42:49.245 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:42:49.312 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:49.311+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:49.348 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:42:49.348 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:42:49.348 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:42:49.348 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:42:49.349 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.349 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:42:49.349 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:42:49.349 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.309870479000001, 2024-04-26T10:42:49.349 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:42:49.349 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:49.349 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.349 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:49.349 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.349 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:49.349 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:42:49.349 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.349 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.350 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.350 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:49.350 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:42:49.350 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.350 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.350 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.350 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:49.350 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:42:49.350 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.350 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.350 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.350 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:49.350 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:42:49.350 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:42:49.351 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.351 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.351 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:49.351 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:42:49.351 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:42:49.351 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.351 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.351 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.351 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:42:49.351 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:42:49.351 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.351 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.351 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:49.351 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:42:49.352 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:42:49.352 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.352 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.352 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:49.352 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:42:49.352 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:42:49.352 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.352 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.352 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:49.352 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:42:49.352 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:42:49.352 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.352 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.352 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:49.353 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:42:49.353 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:42:49.353 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.353 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:49.353 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.353 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.353 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.353 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:42:49.353 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:42:49.353 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.308999699000001, 2024-04-26T10:42:49.353 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:42:49.353 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:49.353 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.353 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:49.353 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.354 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:49.354 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:42:49.354 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.354 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.354 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.354 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:49.354 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:42:49.354 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.354 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.354 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.354 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:49.354 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:42:49.354 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.354 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.355 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.355 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:49.355 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:42:49.355 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:42:49.355 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.355 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.355 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:49.355 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:42:49.355 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:42:49.355 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.355 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.355 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.355 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:42:49.355 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:42:49.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.356 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.356 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:49.356 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:42:49.356 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:42:49.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.356 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.356 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:49.356 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:42:49.356 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:42:49.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.356 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.356 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:49.356 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:42:49.356 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:42:49.357 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.357 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.357 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:49.357 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:42:49.357 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:42:49.357 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.357 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:49.357 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.357 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.357 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.357 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:42:49.357 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:42:49.357 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.308012355999999, 2024-04-26T10:42:49.357 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:42:49.358 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:49.358 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.358 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:49.358 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.358 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:49.358 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:42:49.358 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.358 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.358 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.358 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:49.358 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:42:49.358 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.358 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.358 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.359 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:49.359 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:42:49.359 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:42:49.359 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.359 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.359 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:49.359 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:42:49.359 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:42:49.359 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.359 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.359 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:49.359 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:42:49.359 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:42:49.359 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.359 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.360 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:42:49.360 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:42:49.360 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.360 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:49.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:42:49.360 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:42:49.360 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.360 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:49.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:42:49.360 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:42:49.360 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.361 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:49.361 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:42:49.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:42:49.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.361 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.361 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:49.361 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:42:49.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:42:49.361 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.361 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:49.361 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.361 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.361 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:42:49.362 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:42:49.362 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.307807091000001, 2024-04-26T10:42:49.362 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:42:49.362 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:49.362 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.362 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:49.362 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.362 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:49.362 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:42:49.362 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.362 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.362 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.362 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:49.362 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:42:49.363 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.363 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.363 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.363 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:49.363 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:42:49.363 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.363 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.363 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.363 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:49.363 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:42:49.363 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:42:49.363 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.363 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.363 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:49.364 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:42:49.364 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:42:49.364 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.364 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.364 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.364 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:42:49.364 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:42:49.364 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.364 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.364 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:49.364 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:42:49.364 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:42:49.364 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.364 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.364 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:49.365 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:42:49.365 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:42:49.365 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.365 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.365 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:49.365 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:42:49.365 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:42:49.365 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.365 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.365 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:49.365 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:42:49.365 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:42:49.365 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.365 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:49.365 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.366 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.366 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.366 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:49.366 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:42:49.366 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.307486212000001, 2024-04-26T10:42:49.366 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:42:49.366 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:49.366 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.366 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:49.366 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.366 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:49.366 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:42:49.366 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.366 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.367 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.367 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:49.367 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:42:49.367 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.367 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.367 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.367 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:49.367 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:42:49.367 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:42:49.367 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.367 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.367 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:49.367 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:42:49.367 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:42:49.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.368 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:49.368 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:42:49.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:42:49.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.368 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.368 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:42:49.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:42:49.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.369 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:49.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:42:49.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:42:49.369 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.369 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:49.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:42:49.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:42:49.369 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.369 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:49.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:42:49.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:42:49.370 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.370 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.370 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:49.370 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:42:49.370 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:42:49.370 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.370 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.370 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:49.370 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:42:49.370 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:42:49.370 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.370 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.370 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:49.371 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:42:49.371 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:42:49.371 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.371 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.371 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:49.371 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:42:49.371 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:42:49.371 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.371 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:49.371 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.371 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.371 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.371 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:49.371 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:42:49.371 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.307434388000001, 2024-04-26T10:42:49.372 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:42:49.372 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:49.372 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.372 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:49.372 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.372 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:49.372 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:42:49.372 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.372 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.372 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.372 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:49.372 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:42:49.372 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.372 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.372 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.373 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:49.373 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:42:49.373 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.373 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.373 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.373 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:49.373 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:42:49.373 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:42:49.373 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.373 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.373 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:49.373 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:42:49.373 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:42:49.373 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.373 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.374 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.374 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:42:49.374 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:42:49.374 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.374 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.374 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:49.374 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:42:49.374 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:42:49.374 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.374 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.374 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:49.374 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:42:49.374 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:42:49.374 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.375 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.375 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:49.375 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:42:49.375 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:42:49.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.375 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.375 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:49.375 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:42:49.375 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:42:49.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.375 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.375 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:49.375 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:42:49.375 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:42:49.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.376 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.376 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:49.376 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:42:49.376 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:42:49.376 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.376 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.376 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:49.376 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:42:49.376 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:42:49.376 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.376 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:49.376 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.376 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.376 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.376 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:49.377 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:42:49.377 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.307381016000001, 2024-04-26T10:42:49.377 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:42:49.377 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:49.377 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.377 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:49.377 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.377 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:49.377 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:42:49.377 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.377 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.377 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.377 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:49.377 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:42:49.378 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.378 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.378 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.378 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:49.378 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:42:49.378 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.378 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.378 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.378 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:49.378 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:42:49.378 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:42:49.378 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.378 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.378 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:49.378 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:42:49.379 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:42:49.379 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.379 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.379 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.379 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:42:49.379 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:42:49.379 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.379 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.379 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:49.379 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:42:49.379 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:42:49.380 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:49.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:42:49.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:42:49.380 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:49.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:42:49.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:42:49.380 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:49.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:42:49.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:42:49.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:49.381 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:42:49.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:42:49.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:49.381 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:42:49.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:42:49.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:49.381 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:42:49.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:42:49.382 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.382 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:49.382 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.382 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.382 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.382 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:49.382 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:42:49.382 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.307336689, 2024-04-26T10:42:49.382 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:42:49.382 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:49.382 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.382 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:49.382 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.382 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:49.382 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:42:49.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.383 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.383 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:49.383 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:42:49.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.383 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.383 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:49.383 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:42:49.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:42:49.383 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.383 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:49.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:42:49.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:42:49.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.384 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:49.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:42:49.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:42:49.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.384 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:42:49.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:42:49.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.384 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:49.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:42:49.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:42:49.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:49.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:42:49.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:42:49.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:49.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:42:49.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:42:49.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:49.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:42:49.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:42:49.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:49.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:42:49.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:42:49.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:49.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:42:49.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:42:49.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:49.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:42:49.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:42:49.387 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.387 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:49.387 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.387 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:49.387 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:42:49.387 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.307312975999999, 2024-04-26T10:42:49.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:42:49.387 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:49.387 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.387 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:49.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.388 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:49.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:42:49.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.388 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:49.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:42:49.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.388 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:49.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:42:49.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.389 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:49.389 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:42:49.389 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:42:49.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.389 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.389 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:49.389 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:42:49.389 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:42:49.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.389 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.389 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.389 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:42:49.389 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:42:49.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.390 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.390 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:49.390 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:42:49.390 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:42:49.390 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.390 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.390 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:49.390 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:42:49.390 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:42:49.390 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.390 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.390 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:49.390 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:42:49.390 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:42:49.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:49.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:42:49.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:42:49.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:49.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:42:49.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:42:49.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:49.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:42:49.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:42:49.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:49.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:42:49.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:42:49.392 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.392 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:49.392 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.392 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:49.392 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:42:49.392 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.307278670999999, 2024-04-26T10:42:49.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:42:49.393 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:49.393 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.393 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:49.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:49.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:42:49.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:49.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:42:49.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:49.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:42:49.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:49.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:42:49.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:42:49.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:49.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:42:49.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:42:49.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:42:49.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:42:49.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:49.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:42:49.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:42:49.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:49.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:42:49.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:42:49.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:49.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:42:49.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:42:49.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:49.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:42:49.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:42:49.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:49.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:42:49.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:42:49.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.397 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:49.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:42:49.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:42:49.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.397 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:49.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:42:49.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:42:49.397 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.397 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:49.397 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.397 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:49.398 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:42:49.398 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.306942074999998, 2024-04-26T10:42:49.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:42:49.398 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:49.398 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:49.398 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:49.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:49.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:42:49.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:49.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:42:49.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:49.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:42:49.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:42:49.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:49.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:42:49.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:42:49.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:49.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:42:49.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:42:49.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:42:49.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:42:49.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:49.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:42:49.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:42:49.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:49.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:42:49.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:42:49.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.401 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:49.401 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:42:49.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:42:49.401 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.401 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:49.401 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.401 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:49.401 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:42:49.401 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.306900046999999, 2024-04-26T10:42:49.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:42:49.401 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:49.402 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:49.402 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:49.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:49.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:42:49.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:49.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:42:49.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:49.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:42:49.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:49.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:42:49.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:42:49.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:49.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:42:49.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:42:49.406 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.406 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.406 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:42:49.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:42:49.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.407 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:49.407 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:42:49.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:42:49.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:49.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:42:49.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:42:49.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:49.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:42:49.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:42:49.409 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.410 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:49.410 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.410 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.410 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:49.410 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:42:49.411 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.306846875000002, 2024-04-26T10:42:49.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:42:49.411 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:49.411 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:49.411 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:49.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:49.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:42:49.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:49.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:42:49.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:49.414 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:42:49.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.414 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.414 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:49.414 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:42:49.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:42:49.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:49.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:42:49.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:42:49.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:42:49.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:42:49.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:49.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:42:49.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:42:49.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.418 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.418 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:49.418 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:42:49.418 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:42:49.418 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:49.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:42:49.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:42:49.419 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.419 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:49.420 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.420 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:42:49.420 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:42:49.420 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.303440465000001, 2024-04-26T10:42:49.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:42:49.421 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:49.421 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:42:49.421 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:49.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:49.422 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:42:49.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.422 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.422 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.422 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:49.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:42:49.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:49.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:42:49.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:49.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:42:49.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:42:49.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:49.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:42:49.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:42:49.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:42:49.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:42:49.429 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:49.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:42:49.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:42:49.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:49.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:42:49.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:42:49.431 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.431 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:49.431 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.432 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:42:49.432 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:42:49.432 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.300968512000001, 2024-04-26T10:42:49.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:42:49.433 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:49.433 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:49.433 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:49.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.433 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:49.434 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:42:49.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.434 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.434 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:49.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:42:49.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:49.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:42:49.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:49.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:42:49.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:42:49.437 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.437 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:49.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:42:49.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:42:49.438 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.438 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.438 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:42:49.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:42:49.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:49.439 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:42:49.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:42:49.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:49.440 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:42:49.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:42:49.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:49.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:42:49.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:42:49.441 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.441 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:49.442 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.442 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.442 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.442 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:42:49.442 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:42:49.443 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.300314954000001, 2024-04-26T10:42:49.443 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:42:49.443 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:49.443 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:49.443 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:49.443 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.444 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:49.444 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:42:49.444 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.444 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.444 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.445 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:49.445 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:42:49.445 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.445 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.445 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.445 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:49.446 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:42:49.446 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.446 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.446 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.446 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:49.447 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:42:49.447 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:42:49.447 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.447 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.447 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:49.447 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:42:49.448 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:42:49.448 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.448 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.448 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.448 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:42:49.449 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:42:49.449 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.449 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.449 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:49.449 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:42:49.449 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:42:49.450 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.450 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.450 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:49.450 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:42:49.450 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:42:49.450 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.451 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.451 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:49.451 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:42:49.451 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:42:49.451 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.452 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:49.452 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.452 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.452 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.452 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:42:49.452 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:42:49.453 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.300239169000001, 2024-04-26T10:42:49.453 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:42:49.453 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:49.453 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:49.453 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:49.453 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.454 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:49.454 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:42:49.454 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.454 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.454 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.455 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:49.455 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:42:49.455 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.455 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.455 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.455 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:49.456 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:42:49.456 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.456 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.456 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.456 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:49.456 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:42:49.457 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:42:49.457 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.457 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.457 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:49.457 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:42:49.457 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:42:49.458 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.458 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.458 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.458 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:42:49.458 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:42:49.459 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.459 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.459 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:49.459 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:42:49.459 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:42:49.459 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.460 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.460 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:49.460 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:42:49.460 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:42:49.460 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.461 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.461 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:49.461 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:42:49.461 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:42:49.461 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.461 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:49.462 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.462 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.462 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.462 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:42:49.462 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:42:49.462 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.300025474999998, 2024-04-26T10:42:49.463 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:42:49.463 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:49.463 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:42:49.463 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:49.463 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.463 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:49.463 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:42:49.463 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.463 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.464 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.464 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:49.464 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:42:49.464 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.464 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.464 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.464 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:49.464 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:42:49.464 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.464 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.464 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.464 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:49.464 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:42:49.464 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:42:49.464 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.465 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.465 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:49.465 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:42:49.465 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:42:49.465 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.465 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.465 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.465 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:42:49.465 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:42:49.465 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.465 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.465 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:49.465 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:42:49.465 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:42:49.466 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.466 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.466 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:49.466 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:42:49.466 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:42:49.466 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.466 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:49.466 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.466 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.466 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.466 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:42:49.466 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:42:49.466 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.297581661999999, 2024-04-26T10:42:49.466 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:42:49.467 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:49.467 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:49.467 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:49.467 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.467 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:49.467 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:42:49.467 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.467 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.467 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.467 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:49.467 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:42:49.467 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.467 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.467 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.467 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:49.467 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:42:49.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:42:49.468 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.468 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.468 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:49.468 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:42:49.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:42:49.468 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.468 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.468 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:49.468 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:42:49.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:42:49.468 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.468 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.468 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.468 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:42:49.469 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:42:49.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.469 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:49.469 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:42:49.469 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:42:49.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.469 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:49.469 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:42:49.469 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:42:49.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.469 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:49.470 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:42:49.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:42:49.470 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.470 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:49.470 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.470 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.470 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.470 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:42:49.470 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:42:49.470 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 17.847519217999999, 2024-04-26T10:42:49.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:42:49.470 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:49.470 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.470 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:49.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:49.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:42:49.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:49.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:42:49.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:49.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:49.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:42:49.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:42:49.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.472 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:49.472 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:42:49.472 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:42:49.472 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.472 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.472 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:49.472 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:42:49.472 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:42:49.472 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.472 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.472 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.472 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:42:49.472 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:42:49.472 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.472 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.473 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:49.473 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:42:49.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:42:49.473 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.473 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.473 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:49.473 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:42:49.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:42:49.473 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.473 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.473 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:49.473 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:42:49.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:42:49.473 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.473 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:49.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:42:49.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:42:49.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:49.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:42:49.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:42:49.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:49.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:42:49.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:42:49.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:49.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:49.475 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:49.475 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:42:49.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:42:49.475 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.475 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:49.475 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.475 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:49.475 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:49.475 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:42:49.477 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:42:49.477 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:49.475+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:49.578 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:49.577+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:49.596 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:42:49.596 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:42:49.596 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:42:49.596 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:42:49.605 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:42:49.679 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:49.678+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:49.713 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:42:49.713 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:42:49.713 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:42:49.713 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:42:49.713 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:42:49.722 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:42:49.727 INFO:teuthology.orchestra.run.smithi049.stderr:nodeep-scrub is set 2024-04-26T10:42:49.780 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:49.779+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:49.829 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:42:49.829 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:42:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:42:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:42:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:42:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:42:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.791924539, 2024-04-26T10:42:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:42:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.830 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:42:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:42:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:42:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:42:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:42:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:42:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:42:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:42:49.832 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:42:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:42:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:42:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:42:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:42:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:49.833 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:42:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:42:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:42:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:42:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:49.834 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:42:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.790174417999999, 2024-04-26T10:42:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:42:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:42:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:42:49.835 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:42:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:42:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:42:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:42:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:49.836 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:42:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:42:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:42:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:42:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:42:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:42:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.837 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:42:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:42:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:42:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:42:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:42:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:42:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.838 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:42:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:42:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:42:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:42:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:42:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:42:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.839 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:42:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.790121419999998, 2024-04-26T10:42:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:42:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:42:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:42:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:42:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:42:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:42:49.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:42:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:42:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:42:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:42:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:49.842 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:42:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:42:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:42:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:42:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:42:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:42:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.843 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:49.844 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:42:49.844 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:42:49.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.844 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:49.844 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:42:49.844 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:42:49.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.844 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:49.844 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:42:49.844 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:42:49.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.845 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:49.845 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:42:49.845 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:42:49.845 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.845 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:49.845 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.845 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:49.845 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:42:49.845 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.790043676, 2024-04-26T10:42:49.845 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:42:49.845 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:49.845 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:42:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:42:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:49.846 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:42:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:42:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:42:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:42:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:42:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:42:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:42:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:42:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:42:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:42:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:42:49.848 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:42:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:42:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:42:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:42:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:42:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:49.849 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:42:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:42:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:42:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:42:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:42:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:42:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:49.850 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:42:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.790004669999998, 2024-04-26T10:42:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:42:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:42:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:42:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:42:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:42:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:42:49.852 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:42:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:42:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:42:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:42:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:42:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:42:49.853 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:42:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:42:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:42:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:42:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:42:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:49.854 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:42:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:42:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:42:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:42:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:42:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:42:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.855 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:42:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:42:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:42:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.789985849000001, 2024-04-26T10:42:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:42:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:49.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:42:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:42:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:42:49.857 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:42:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:42:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:42:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:42:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:42:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.858 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:42:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:42:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:42:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:42:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:42:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:42:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.859 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:42:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:42:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:42:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:42:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:42:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:42:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:42:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:42:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:42:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:42:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:42:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.789953847, 2024-04-26T10:42:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:42:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:42:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.862 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:42:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:42:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:42:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:42:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:42:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:42:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:42:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:42:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:42:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:42:49.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:42:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:42:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:42:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:42:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:42:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:42:49.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:42:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:42:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:42:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:42:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:49.866 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:42:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:42:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:42:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.789745039, 2024-04-26T10:42:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:42:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.867 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:42:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:42:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:42:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:42:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.868 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:42:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:42:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:42:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:42:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:42:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:42:49.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:42:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:42:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:42:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:42:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:42:49.870 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:42:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:42:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:42:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:42:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:42:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.871 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:42:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:42:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:42:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:42:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:49.872 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:42:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.789713748, 2024-04-26T10:42:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:42:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:42:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:42:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:42:49.873 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:42:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:42:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:42:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:49.874 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:42:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:42:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:42:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:42:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:42:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:42:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:49.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:42:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:42:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:42:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:42:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:42:49.876 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.789686498000002, 2024-04-26T10:42:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:42:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:42:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:42:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:42:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:42:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:42:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:42:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:42:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:42:49.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:42:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:42:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:42:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:42:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:49.879 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:42:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:42:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:42:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:42:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:42:49.880 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:42:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.786909746999999, 2024-04-26T10:42:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:42:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:42:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:42:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:42:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:42:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:42:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:42:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:42:49.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:42:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:42:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:42:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:42:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:42:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:42:49.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:42:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:42:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:42:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.786859658000001, 2024-04-26T10:42:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:42:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:42:49.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:42:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:42:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:42:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:42:49.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:42:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:42:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:42:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:42:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:42:49.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:42:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:42:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:42:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:42:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:42:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:42:49.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:42:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:42:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:42:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.785967588999998, 2024-04-26T10:42:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:42:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:42:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:42:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:42:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:42:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:42:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:42:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:42:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:42:49.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:42:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:42:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:42:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:42:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:42:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:49.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:42:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:42:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:42:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:42:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:42:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:42:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.783779259999999, 2024-04-26T10:42:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:42:49.892 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:42:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:42:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:42:49.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:42:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:42:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:42:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:42:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:42:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:42:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:42:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:42:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:42:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:42:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:49.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:42:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:42:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:42:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:42:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:42:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:42:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.78364389, 2024-04-26T10:42:49.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:42:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:42:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:42:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:42:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:42:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:42:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:42:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:42:49.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:42:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:42:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:42:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:42:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:42:49.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:42:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:42:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:42:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:42:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:42:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:42:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:42:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.783429315999999, 2024-04-26T10:42:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:42:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:42:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:42:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:42:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:42:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:42:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:42:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:42:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:42:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:42:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:42:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:42:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:42:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:42:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:42:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:42:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:42:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:42:49.904 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:42:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:42:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.783090375, 2024-04-26T10:42:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:42:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:42:49.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:42:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:42:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:49.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:42:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:42:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:42:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:42:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:42:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:42:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:49.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:42:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:42:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:42:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:42:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:42:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:42:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:49.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:42:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:42:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:42:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:42:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.782980997999999, 2024-04-26T10:42:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:42:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:42:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:49.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:42:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:42:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:42:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:42:49.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:42:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:42:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:42:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:42:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:42:49.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:42:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:42:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:42:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:42:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:42:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:42:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:42:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.782941278999999, 2024-04-26T10:42:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:42:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:42:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:49.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:42:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:42:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:42:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:42:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:42:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:42:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:42:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:42:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:42:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:42:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:42:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:42:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:42:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:42:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:42:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:42:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:42:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.916 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:42:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:42:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.782603745999999, 2024-04-26T10:42:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:42:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:42:49.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:42:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:42:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:49.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:42:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:42:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:42:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:42:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:42:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:42:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:42:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:42:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:42:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:42:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:42:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:42:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:49.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:49.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:49.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:42:49.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:42:49.921 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.921 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:49.921 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.921 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:49.921 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:49.921 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:42:49.922 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:49.921+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:49.923 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:42:50.023 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:50.022+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:50.036 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-26T10:42:50.036 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-26T10:42:50.036 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-26T10:42:50.036 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-26T10:42:50.047 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:42:50.125 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:50.123+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:50.149 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-26T10:42:50.149 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-26T10:42:50.149 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-26T10:42:50.149 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-26T10:42:50.149 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-26T10:42:50.157 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:42:50.225 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:50.223+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:50.247 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:42:50.260 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-26T10:42:50.260 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-26T10:42:50.260 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-26T10:42:50.260 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-26T10:42:50.261 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.261 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:42:50.261 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:42:50.261 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.393463533999999, 2024-04-26T10:42:50.261 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086884530000000005, 2024-04-26T10:42:50.261 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:50.261 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:50.261 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:42:50.261 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:42:50.261 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:42:50.261 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 164 2024-04-26T10:42:50.261 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.261 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:50.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.262 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:50.262 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:42:50.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.262 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:50.262 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:42:50.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.262 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.262 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:50.262 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:42:50.262 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-26T10:42:50.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:50.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864858+0000", 2024-04-26T10:42:50.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3231e-05 2024-04-26T10:42:50.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:50.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864862+0000", 2024-04-26T10:42:50.263 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9280000000000003e-06 2024-04-26T10:42:50.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.263 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:50.263 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864865+0000", 2024-04-26T10:42:50.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8289999999999999e-06 2024-04-26T10:42:50.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:50.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869688+0000", 2024-04-26T10:42:50.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048234990000000002 2024-04-26T10:42:50.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:50.264 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869732+0000", 2024-04-26T10:42:50.264 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3232999999999998e-05 2024-04-26T10:42:50.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.264 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:50.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869804+0000", 2024-04-26T10:42:50.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2152999999999998e-05 2024-04-26T10:42:50.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:50.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.872812+0000", 2024-04-26T10:42:50.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003008372 2024-04-26T10:42:50.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.265 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:50.265 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873459+0000", 2024-04-26T10:42:50.265 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064655699999999997 2024-04-26T10:42:50.265 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:50.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873482+0000", 2024-04-26T10:42:50.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3419999999999999e-05 2024-04-26T10:42:50.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.266 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:50.266 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873504+0000", 2024-04-26T10:42:50.266 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1440000000000001e-05 2024-04-26T10:42:50.266 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.266 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:50.266 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.266 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.266 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.266 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:42:50.267 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:42:50.267 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.393410594999999, 2024-04-26T10:42:50.267 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0092811590000000006, 2024-04-26T10:42:50.267 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:50.267 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:50.267 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:42:50.267 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:42:50.267 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:42:50.267 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 165 2024-04-26T10:42:50.267 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.267 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:50.267 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.267 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:50.267 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:42:50.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:50.268 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:42:50.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:50.268 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:42:50.268 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:50.268 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.268 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.268 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:50.268 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864871+0000", 2024-04-26T10:42:50.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2200000000000001e-06 2024-04-26T10:42:50.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:50.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864875+0000", 2024-04-26T10:42:50.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.206e-06 2024-04-26T10:42:50.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:50.269 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864878+0000", 2024-04-26T10:42:50.269 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5799999999999999e-06 2024-04-26T10:42:50.269 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.269 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.269 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:50.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873137+0000", 2024-04-26T10:42:50.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082591609999999992 2024-04-26T10:42:50.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:50.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873186+0000", 2024-04-26T10:42:50.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8741e-05 2024-04-26T10:42:50.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.270 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:50.270 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873252+0000", 2024-04-26T10:42:50.270 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5877000000000006e-05 2024-04-26T10:42:50.270 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.270 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:50.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873708+0000", 2024-04-26T10:42:50.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00045660299999999998 2024-04-26T10:42:50.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:50.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874091+0000", 2024-04-26T10:42:50.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038295000000000001 2024-04-26T10:42:50.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.271 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:50.271 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874115+0000", 2024-04-26T10:42:50.271 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:42:50.271 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.271 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.272 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:50.272 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874149+0000", 2024-04-26T10:42:50.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4320999999999999e-05 2024-04-26T10:42:50.272 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.272 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:50.272 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.272 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.272 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.272 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:42:50.272 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:42:50.272 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.256312959999999, 2024-04-26T10:42:50.272 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010199138999999999, 2024-04-26T10:42:50.272 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:50.272 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:50.272 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:42:50.272 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:42:50.273 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:42:50.273 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 188 2024-04-26T10:42:50.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.273 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:50.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:50.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:42:50.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.273 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:50.273 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:42:50.273 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.273 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.273 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:50.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:42:50.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-26T10:42:50.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:50.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002024+0000", 2024-04-26T10:42:50.274 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8050999999999997e-05 2024-04-26T10:42:50.274 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.274 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.274 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:50.274 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002034+0000", 2024-04-26T10:42:50.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0217000000000001e-05 2024-04-26T10:42:50.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:50.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002039+0000", 2024-04-26T10:42:50.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6879999999999998e-06 2024-04-26T10:42:50.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:50.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006586+0000", 2024-04-26T10:42:50.275 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045473570000000001 2024-04-26T10:42:50.275 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.275 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.275 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:50.275 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006626+0000", 2024-04-26T10:42:50.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9688999999999999e-05 2024-04-26T10:42:50.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:50.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006689+0000", 2024-04-26T10:42:50.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3243000000000004e-05 2024-04-26T10:42:50.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:50.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007850+0000", 2024-04-26T10:42:50.276 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011607989999999999 2024-04-26T10:42:50.276 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.276 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.276 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:50.276 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012084+0000", 2024-04-26T10:42:50.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042340069999999997 2024-04-26T10:42:50.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:50.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012132+0000", 2024-04-26T10:42:50.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8112999999999998e-05 2024-04-26T10:42:50.277 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.277 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.277 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:50.277 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012165+0000", 2024-04-26T10:42:50.277 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3189999999999999e-05 2024-04-26T10:42:50.277 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.277 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:50.277 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.278 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.278 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:42:50.278 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:42:50.278 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 28.256236260000001, 2024-04-26T10:42:50.278 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010167136, 2024-04-26T10:42:50.278 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:50.278 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:50.278 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:42:50.278 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:42:50.278 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:42:50.278 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 189 2024-04-26T10:42:50.278 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.278 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:50.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:50.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:42:50.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:50.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:42:50.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.279 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.279 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.279 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:50.279 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:42:50.279 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:50.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:50.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002044+0000", 2024-04-26T10:42:50.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.119e-06 2024-04-26T10:42:50.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:50.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002047+0000", 2024-04-26T10:42:50.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0199999999999999e-06 2024-04-26T10:42:50.280 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.280 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.280 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:50.280 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002050+0000", 2024-04-26T10:42:50.280 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3360000000000002e-06 2024-04-26T10:42:50.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.281 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:50.281 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007165+0000", 2024-04-26T10:42:50.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051155879999999999 2024-04-26T10:42:50.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.281 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:50.281 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007209+0000", 2024-04-26T10:42:50.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4097000000000001e-05 2024-04-26T10:42:50.281 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.281 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.281 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:50.281 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007278+0000", 2024-04-26T10:42:50.281 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8663000000000003e-05 2024-04-26T10:42:50.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:50.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.008047+0000", 2024-04-26T10:42:50.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00076935299999999996 2024-04-26T10:42:50.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:50.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012171+0000", 2024-04-26T10:42:50.282 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004123219 2024-04-26T10:42:50.282 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.282 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.282 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:50.282 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012193+0000", 2024-04-26T10:42:50.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2169000000000001e-05 2024-04-26T10:42:50.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.283 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:50.283 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012210+0000", 2024-04-26T10:42:50.283 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6841999999999999e-05 2024-04-26T10:42:50.283 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.283 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:50.283 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.283 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.283 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.283 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:50.283 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:42:50.283 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.224772866999999, 2024-04-26T10:42:50.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010195469, 2024-04-26T10:42:50.284 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:50.284 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:50.284 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:50.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:50.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:42:50.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.284 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.284 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.284 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:50.284 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:42:50.284 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.285 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:50.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033504+0000", 2024-04-26T10:42:50.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999981 2024-04-26T10:42:50.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.285 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:50.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033513+0000", 2024-04-26T10:42:50.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6829999999999997e-06 2024-04-26T10:42:50.285 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.285 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.285 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:50.285 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033525+0000", 2024-04-26T10:42:50.285 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2748000000000001e-05 2024-04-26T10:42:50.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.286 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:50.286 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033537+0000", 2024-04-26T10:42:50.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1243999999999999e-05 2024-04-26T10:42:50.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.286 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:50.286 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034018+0000", 2024-04-26T10:42:50.286 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048138899999999998 2024-04-26T10:42:50.286 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.286 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.286 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-04-26T10:42:50.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034025+0000", 2024-04-26T10:42:50.287 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8870000000000003e-06 2024-04-26T10:42:50.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:50.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035264+0000", 2024-04-26T10:42:50.287 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0012385370000000001 2024-04-26T10:42:50.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:50.287 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035372+0000", 2024-04-26T10:42:50.287 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010851199999999999 2024-04-26T10:42:50.287 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.287 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.287 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:50.288 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035473+0000", 2024-04-26T10:42:50.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000100967 2024-04-26T10:42:50.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:50.288 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043270+0000", 2024-04-26T10:42:50.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0077971869999999997 2024-04-26T10:42:50.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.288 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:50.288 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043620+0000", 2024-04-26T10:42:50.288 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034962099999999999 2024-04-26T10:42:50.288 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.288 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.289 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:50.289 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043665+0000", 2024-04-26T10:42:50.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5426999999999997e-05 2024-04-26T10:42:50.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.289 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:50.289 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043701+0000", 2024-04-26T10:42:50.289 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6072000000000003e-05 2024-04-26T10:42:50.289 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.289 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:50.289 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.289 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.289 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.289 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:50.289 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:42:50.289 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.224287788000002, 2024-04-26T10:42:50.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099286970000000002, 2024-04-26T10:42:50.290 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:50.290 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:50.290 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:50.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.290 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:50.290 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:42:50.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.290 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.290 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:50.290 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:42:50.290 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.290 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.290 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.291 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:50.291 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033990+0000", 2024-04-26T10:42:50.291 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-26T10:42:50.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.291 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.291 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:50.291 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033998+0000", 2024-04-26T10:42:50.291 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7970000000000001e-06 2024-04-26T10:42:50.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.291 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.291 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:50.291 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034010+0000", 2024-04-26T10:42:50.291 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2383e-05 2024-04-26T10:42:50.291 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.291 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.291 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:50.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034021+0000", 2024-04-26T10:42:50.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0824e-05 2024-04-26T10:42:50.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:50.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035774+0000", 2024-04-26T10:42:50.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017527479999999999 2024-04-26T10:42:50.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:50.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035929+0000", 2024-04-26T10:42:50.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000155735 2024-04-26T10:42:50.292 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.292 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.292 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:50.292 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036083+0000", 2024-04-26T10:42:50.292 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000153635 2024-04-26T10:42:50.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.293 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:50.293 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043369+0000", 2024-04-26T10:42:50.293 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0072854490000000003 2024-04-26T10:42:50.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.293 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:50.293 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043709+0000", 2024-04-26T10:42:50.293 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034039600000000003 2024-04-26T10:42:50.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.293 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.293 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:50.293 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043878+0000", 2024-04-26T10:42:50.293 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016924799999999999 2024-04-26T10:42:50.293 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.294 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.294 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:50.294 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043920+0000", 2024-04-26T10:42:50.294 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1471999999999999e-05 2024-04-26T10:42:50.294 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.294 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:50.294 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.294 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.294 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.294 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:50.294 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:42:50.294 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.224248509999999, 2024-04-26T10:42:50.294 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010011091999999999, 2024-04-26T10:42:50.295 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:50.295 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:50.295 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:50.295 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.295 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:50.295 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:42:50.295 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.295 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.295 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:50.295 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:42:50.295 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.295 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.295 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:50.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:42:50.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:50.296 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:50.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034040+0000", 2024-04-26T10:42:50.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8560000000000002e-06 2024-04-26T10:42:50.296 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.296 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.296 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:50.296 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034048+0000", 2024-04-26T10:42:50.296 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4139999999999994e-06 2024-04-26T10:42:50.296 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.297 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:50.297 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034054+0000", 2024-04-26T10:42:50.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8950000000000003e-06 2024-04-26T10:42:50.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.297 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:50.297 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036269+0000", 2024-04-26T10:42:50.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002215528 2024-04-26T10:42:50.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.297 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.297 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:50.297 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036364+0000", 2024-04-26T10:42:50.297 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4089e-05 2024-04-26T10:42:50.297 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:50.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036443+0000", 2024-04-26T10:42:50.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9666000000000006e-05 2024-04-26T10:42:50.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:50.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043451+0000", 2024-04-26T10:42:50.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0070081939999999997 2024-04-26T10:42:50.298 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.298 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.298 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:50.298 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043930+0000", 2024-04-26T10:42:50.298 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00047819799999999999 2024-04-26T10:42:50.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.299 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:50.299 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043999+0000", 2024-04-26T10:42:50.299 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9136999999999999e-05 2024-04-26T10:42:50.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.299 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:50.299 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044041+0000", 2024-04-26T10:42:50.299 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2624999999999999e-05 2024-04-26T10:42:50.299 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.299 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:50.299 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.299 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.299 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.300 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:50.300 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:42:50.300 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.224209543000001, 2024-04-26T10:42:50.300 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015256755, 2024-04-26T10:42:50.300 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:50.300 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:50.300 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:50.300 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.300 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:50.300 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:42:50.300 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.300 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.300 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.301 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:50.301 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:42:50.301 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.301 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.301 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:50.301 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:42:50.301 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:50.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.301 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.301 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:50.301 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034073+0000", 2024-04-26T10:42:50.301 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1099999999999996e-06 2024-04-26T10:42:50.301 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.301 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.302 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:50.302 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034081+0000", 2024-04-26T10:42:50.302 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0539999999999995e-06 2024-04-26T10:42:50.302 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.302 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.302 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:50.302 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034087+0000", 2024-04-26T10:42:50.302 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0240000000000003e-06 2024-04-26T10:42:50.302 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.302 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.302 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:50.302 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036668+0000", 2024-04-26T10:42:50.302 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002581014 2024-04-26T10:42:50.302 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.303 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:50.303 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036717+0000", 2024-04-26T10:42:50.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9299999999999999e-05 2024-04-26T10:42:50.303 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.303 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:50.303 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036846+0000", 2024-04-26T10:42:50.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012901000000000001 2024-04-26T10:42:50.303 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.303 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.303 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:50.303 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044050+0000", 2024-04-26T10:42:50.303 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007203816 2024-04-26T10:42:50.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.304 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.304 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:50.304 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049229+0000", 2024-04-26T10:42:50.304 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051792169999999998 2024-04-26T10:42:50.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.304 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.304 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:50.304 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049282+0000", 2024-04-26T10:42:50.304 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2605000000000002e-05 2024-04-26T10:42:50.304 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.304 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.304 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:50.305 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049326+0000", 2024-04-26T10:42:50.305 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4255000000000002e-05 2024-04-26T10:42:50.305 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.305 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:50.305 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.305 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.305 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.305 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:50.305 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:42:50.305 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.224184880999999, 2024-04-26T10:42:50.305 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01538838, 2024-04-26T10:42:50.305 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:50.305 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:50.305 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:50.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.306 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:50.306 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:42:50.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.306 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:50.306 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:42:50.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.306 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.306 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.306 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:50.306 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034093+0000", 2024-04-26T10:42:50.306 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034097+0000", 2024-04-26T10:42:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.213e-06 2024-04-26T10:42:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034104+0000", 2024-04-26T10:42:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9840000000000004e-06 2024-04-26T10:42:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034111+0000", 2024-04-26T10:42:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9199999999999998e-06 2024-04-26T10:42:50.307 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.037736+0000", 2024-04-26T10:42:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036257429999999998 2024-04-26T10:42:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:42:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034004 2024-04-26T10:42:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038526+0000", 2024-04-26T10:42:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00044924100000000002 2024-04-26T10:42:50.308 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044708+0000", 2024-04-26T10:42:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061823360000000001 2024-04-26T10:42:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:42:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046886159999999996 2024-04-26T10:42:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049446+0000", 2024-04-26T10:42:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.973e-05 2024-04-26T10:42:50.309 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049482+0000", 2024-04-26T10:42:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6004999999999998e-05 2024-04-26T10:42:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:42:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.224163359999999, 2024-04-26T10:42:50.310 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015480648, 2024-04-26T10:42:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:42:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:42:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.311 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:42:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034118+0000", 2024-04-26T10:42:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1769999999999998e-06 2024-04-26T10:42:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034126+0000", 2024-04-26T10:42:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7770000000000002e-06 2024-04-26T10:42:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034146+0000", 2024-04-26T10:42:50.312 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0579999999999999e-05 2024-04-26T10:42:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039740+0000", 2024-04-26T10:42:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0055940269999999997 2024-04-26T10:42:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039848+0000", 2024-04-26T10:42:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010775100000000001 2024-04-26T10:42:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040022+0000", 2024-04-26T10:42:50.313 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000173964 2024-04-26T10:42:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044721+0000", 2024-04-26T10:42:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046989099999999997 2024-04-26T10:42:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049541+0000", 2024-04-26T10:42:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048200789999999997 2024-04-26T10:42:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:50.314 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049574+0000", 2024-04-26T10:42:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2817000000000001e-05 2024-04-26T10:42:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049596+0000", 2024-04-26T10:42:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2011999999999999e-05 2024-04-26T10:42:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:42:50.315 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.224127401000001, 2024-04-26T10:42:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015538033, 2024-04-26T10:42:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:42:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:42:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.316 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:42:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034155+0000", 2024-04-26T10:42:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.177e-06 2024-04-26T10:42:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034161+0000", 2024-04-26T10:42:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0780000000000001e-06 2024-04-26T10:42:50.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034168+0000", 2024-04-26T10:42:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8689999999999998e-06 2024-04-26T10:42:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041069+0000", 2024-04-26T10:42:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069010440000000003 2024-04-26T10:42:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041221+0000", 2024-04-26T10:42:50.318 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015175 2024-04-26T10:42:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041350+0000", 2024-04-26T10:42:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012870899999999999 2024-04-26T10:42:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045386+0000", 2024-04-26T10:42:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040364789999999999 2024-04-26T10:42:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049641+0000", 2024-04-26T10:42:50.319 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042552120000000004 2024-04-26T10:42:50.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:50.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049669+0000", 2024-04-26T10:42:50.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7809000000000001e-05 2024-04-26T10:42:50.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.320 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.320 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:50.320 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049689+0000", 2024-04-26T10:42:50.320 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0336e-05 2024-04-26T10:42:50.320 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.320 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:50.320 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.320 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.321 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:50.321 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:42:50.321 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.224105571999999, 2024-04-26T10:42:50.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015595107, 2024-04-26T10:42:50.321 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:50.321 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:50.321 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:50.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.321 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:50.321 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:42:50.321 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.321 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.321 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:50.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:42:50.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:50.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:42:50.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:50.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.322 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.322 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:50.322 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034176+0000", 2024-04-26T10:42:50.322 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0089999999999999e-06 2024-04-26T10:42:50.322 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:50.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034182+0000", 2024-04-26T10:42:50.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4579999999999998e-06 2024-04-26T10:42:50.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:50.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034187+0000", 2024-04-26T10:42:50.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0880000000000002e-06 2024-04-26T10:42:50.323 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.323 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.323 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:50.323 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045564+0000", 2024-04-26T10:42:50.323 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011376475 2024-04-26T10:42:50.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:50.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045623+0000", 2024-04-26T10:42:50.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9388999999999997e-05 2024-04-26T10:42:50.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:50.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045713+0000", 2024-04-26T10:42:50.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0211999999999996e-05 2024-04-26T10:42:50.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.324 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.324 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:50.324 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046325+0000", 2024-04-26T10:42:50.324 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00061181699999999996 2024-04-26T10:42:50.324 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:50.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049722+0000", 2024-04-26T10:42:50.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033962380000000002 2024-04-26T10:42:50.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:50.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049750+0000", 2024-04-26T10:42:50.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8087000000000001e-05 2024-04-26T10:42:50.325 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.325 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.325 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:50.325 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049768+0000", 2024-04-26T10:42:50.325 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8681999999999998e-05 2024-04-26T10:42:50.325 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.325 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:50.326 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.326 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.326 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:50.326 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:42:50.326 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.223892048, 2024-04-26T10:42:50.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087543810000000003, 2024-04-26T10:42:50.326 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:50.326 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:50.326 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:50.326 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.326 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:50.326 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:42:50.326 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:50.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:42:50.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:50.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034386+0000", 2024-04-26T10:42:50.327 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-26T10:42:50.327 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.327 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.327 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:50.327 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034397+0000", 2024-04-26T10:42:50.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0878e-05 2024-04-26T10:42:50.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:50.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034408+0000", 2024-04-26T10:42:50.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1138000000000001e-05 2024-04-26T10:42:50.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:50.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034414+0000", 2024-04-26T10:42:50.328 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2910000000000004e-06 2024-04-26T10:42:50.328 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.328 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.328 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:50.328 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036009+0000", 2024-04-26T10:42:50.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0015952029999999999 2024-04-26T10:42:50.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:50.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036120+0000", 2024-04-26T10:42:50.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000110584 2024-04-26T10:42:50.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:42:50.329 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036225+0000", 2024-04-26T10:42:50.329 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010523599999999999 2024-04-26T10:42:50.329 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.329 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.329 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:50.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039276+0000", 2024-04-26T10:42:50.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003050404 2024-04-26T10:42:50.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:50.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:42:50.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037356099999999999 2024-04-26T10:42:50.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.330 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.330 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:50.330 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043079+0000", 2024-04-26T10:42:50.330 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8099e-05 2024-04-26T10:42:50.330 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.331 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:50.331 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043141+0000", 2024-04-26T10:42:50.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1655999999999994e-05 2024-04-26T10:42:50.331 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.331 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:50.331 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.331 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.331 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.331 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:50.331 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:42:50.331 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.223831490999999, 2024-04-26T10:42:50.331 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090131610000000004, 2024-04-26T10:42:50.331 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:50.332 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:50.332 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:50.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:50.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:42:50.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:50.332 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:42:50.332 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.332 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.332 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.332 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:50.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:42:50.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:50.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:50.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034451+0000", 2024-04-26T10:42:50.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9600000000000002e-06 2024-04-26T10:42:50.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.333 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:50.333 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034458+0000", 2024-04-26T10:42:50.333 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5820000000000004e-06 2024-04-26T10:42:50.333 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.333 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:50.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034463+0000", 2024-04-26T10:42:50.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0719999999999999e-06 2024-04-26T10:42:50.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:50.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036527+0000", 2024-04-26T10:42:50.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002063755 2024-04-26T10:42:50.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.334 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:50.334 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036610+0000", 2024-04-26T10:42:50.334 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2669000000000004e-05 2024-04-26T10:42:50.334 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.334 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:42:50.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036744+0000", 2024-04-26T10:42:50.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013412499999999999 2024-04-26T10:42:50.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:50.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040144+0000", 2024-04-26T10:42:50.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033999799999999999 2024-04-26T10:42:50.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.335 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.335 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:50.335 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043301+0000", 2024-04-26T10:42:50.335 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031572240000000001 2024-04-26T10:42:50.335 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:50.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043425+0000", 2024-04-26T10:42:50.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000123664 2024-04-26T10:42:50.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.336 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:50.336 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043460+0000", 2024-04-26T10:42:50.336 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5651000000000001e-05 2024-04-26T10:42:50.336 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.336 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:50.336 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.336 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.336 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.337 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:50.337 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:42:50.337 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.223806590999999, 2024-04-26T10:42:50.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086028210000000001, 2024-04-26T10:42:50.337 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:50.337 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:50.337 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:50.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:50.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:42:50.337 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.337 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.337 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.337 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:50.337 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:42:50.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:50.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:42:50.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:50.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:50.338 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034482+0000", 2024-04-26T10:42:50.338 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8630000000000003e-06 2024-04-26T10:42:50.338 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.338 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.338 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:50.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034494+0000", 2024-04-26T10:42:50.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-04-26T10:42:50.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:50.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034501+0000", 2024-04-26T10:42:50.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7050000000000002e-06 2024-04-26T10:42:50.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.339 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:50.339 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035138+0000", 2024-04-26T10:42:50.339 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00063744099999999998 2024-04-26T10:42:50.339 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.339 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:50.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035286+0000", 2024-04-26T10:42:50.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014766200000000001 2024-04-26T10:42:50.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:42:50.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035654+0000", 2024-04-26T10:42:50.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00036779100000000002 2024-04-26T10:42:50.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.340 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.340 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:50.340 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040833+0000", 2024-04-26T10:42:50.340 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051795640000000002 2024-04-26T10:42:50.340 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:50.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.042886+0000", 2024-04-26T10:42:50.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020531220000000001 2024-04-26T10:42:50.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:50.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043015+0000", 2024-04-26T10:42:50.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012824099999999999 2024-04-26T10:42:50.341 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.341 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.341 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:50.341 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043075+0000", 2024-04-26T10:42:50.341 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0262e-05 2024-04-26T10:42:50.342 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.342 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:50.342 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.342 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.342 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:50.342 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:42:50.342 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.223770628, 2024-04-26T10:42:50.342 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01482116, 2024-04-26T10:42:50.342 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:50.342 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:50.342 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:50.342 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.342 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:50.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:42:50.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:50.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:42:50.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:50.343 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:42:50.343 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:50.343 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.343 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.343 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:50.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034515+0000", 2024-04-26T10:42:50.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.391e-06 2024-04-26T10:42:50.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:50.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034522+0000", 2024-04-26T10:42:50.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7889999999999997e-06 2024-04-26T10:42:50.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.344 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.344 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:50.344 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034601+0000", 2024-04-26T10:42:50.344 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9547000000000003e-05 2024-04-26T10:42:50.344 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:50.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036510+0000", 2024-04-26T10:42:50.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019092289999999999 2024-04-26T10:42:50.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:50.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036642+0000", 2024-04-26T10:42:50.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013151100000000001 2024-04-26T10:42:50.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.345 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.345 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:50.345 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036766+0000", 2024-04-26T10:42:50.345 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012367300000000001 2024-04-26T10:42:50.345 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:50.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040749+0000", 2024-04-26T10:42:50.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039838419999999996 2024-04-26T10:42:50.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:50.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049262+0000", 2024-04-26T10:42:50.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085127789999999998 2024-04-26T10:42:50.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.346 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.346 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:50.346 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049301+0000", 2024-04-26T10:42:50.346 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8834000000000001e-05 2024-04-26T10:42:50.346 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.347 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:50.347 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049329+0000", 2024-04-26T10:42:50.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.817e-05 2024-04-26T10:42:50.347 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.347 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:50.347 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.347 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.347 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.347 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:50.347 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:42:50.347 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.223637930999999, 2024-04-26T10:42:50.347 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014796093999999999, 2024-04-26T10:42:50.347 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:50.348 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:50.348 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:50.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:50.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:42:50.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:50.348 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:42:50.348 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.348 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.348 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.348 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:50.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034640+0000", 2024-04-26T10:42:50.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:50.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:50.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034650+0000", 2024-04-26T10:42:50.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0064999999999999e-05 2024-04-26T10:42:50.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.349 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:50.349 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034660+0000", 2024-04-26T10:42:50.349 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.961e-06 2024-04-26T10:42:50.349 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.349 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:50.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034680+0000", 2024-04-26T10:42:50.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9219e-05 2024-04-26T10:42:50.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:50.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.037926+0000", 2024-04-26T10:42:50.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032460380000000001 2024-04-26T10:42:50.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.350 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.350 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:50.350 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038068+0000", 2024-04-26T10:42:50.350 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014236000000000001 2024-04-26T10:42:50.350 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:50.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038201+0000", 2024-04-26T10:42:50.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013345300000000001 2024-04-26T10:42:50.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:50.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043497+0000", 2024-04-26T10:42:50.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052952770000000001 2024-04-26T10:42:50.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.351 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.351 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:50.351 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049373+0000", 2024-04-26T10:42:50.351 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058762900000000002 2024-04-26T10:42:50.351 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:50.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049411+0000", 2024-04-26T10:42:50.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7737000000000001e-05 2024-04-26T10:42:50.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.352 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:50.352 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049437+0000", 2024-04-26T10:42:50.352 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6169999999999998e-05 2024-04-26T10:42:50.352 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.352 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:50.352 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.352 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.352 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.352 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:50.353 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:42:50.353 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.223593421, 2024-04-26T10:42:50.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0092140799999999995, 2024-04-26T10:42:50.353 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:50.353 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:50.353 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:50.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:50.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:42:50.353 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.353 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.353 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.353 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:50.353 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:42:50.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:50.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:42:50.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:50.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:50.354 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034688+0000", 2024-04-26T10:42:50.354 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5480000000000002e-06 2024-04-26T10:42:50.354 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.354 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.354 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:50.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034694+0000", 2024-04-26T10:42:50.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1310000000000003e-06 2024-04-26T10:42:50.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:50.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034700+0000", 2024-04-26T10:42:50.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4229999999999996e-06 2024-04-26T10:42:50.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:50.355 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036183+0000", 2024-04-26T10:42:50.355 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001482964 2024-04-26T10:42:50.355 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.355 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.355 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:50.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036297+0000", 2024-04-26T10:42:50.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113649 2024-04-26T10:42:50.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:42:50.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036426+0000", 2024-04-26T10:42:50.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012924900000000001 2024-04-26T10:42:50.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:50.356 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040839+0000", 2024-04-26T10:42:50.356 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044137079999999997 2024-04-26T10:42:50.356 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.356 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.356 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:50.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043679+0000", 2024-04-26T10:42:50.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028397850000000001 2024-04-26T10:42:50.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:50.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043725+0000", 2024-04-26T10:42:50.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5859999999999998e-05 2024-04-26T10:42:50.357 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.357 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.357 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:50.357 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043899+0000", 2024-04-26T10:42:50.357 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000174267 2024-04-26T10:42:50.357 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.357 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:50.357 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.358 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:50.358 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:42:50.358 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.223570487, 2024-04-26T10:42:50.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011493046999999999, 2024-04-26T10:42:50.358 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:50.358 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:50.358 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:50.358 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.358 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:50.358 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:42:50.358 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.358 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:50.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:42:50.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:50.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:42:50.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:50.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.359 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.359 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:50.359 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034711+0000", 2024-04-26T10:42:50.359 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4359999999999998e-06 2024-04-26T10:42:50.359 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:50.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034717+0000", 2024-04-26T10:42:50.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7939999999999999e-06 2024-04-26T10:42:50.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:50.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034723+0000", 2024-04-26T10:42:50.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6219999999999997e-06 2024-04-26T10:42:50.360 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.360 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.360 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:50.360 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035221+0000", 2024-04-26T10:42:50.360 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00049811199999999999 2024-04-26T10:42:50.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:50.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035351+0000", 2024-04-26T10:42:50.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013049200000000001 2024-04-26T10:42:50.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:50.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035467+0000", 2024-04-26T10:42:50.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115364 2024-04-26T10:42:50.361 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.361 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.361 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:50.361 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040085+0000", 2024-04-26T10:42:50.361 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046182300000000001 2024-04-26T10:42:50.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:50.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046133+0000", 2024-04-26T10:42:50.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060476059999999996 2024-04-26T10:42:50.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:50.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046165+0000", 2024-04-26T10:42:50.362 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2155e-05 2024-04-26T10:42:50.362 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.362 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.362 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:50.362 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046201+0000", 2024-04-26T10:42:50.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6566999999999997e-05 2024-04-26T10:42:50.363 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.363 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:50.363 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.363 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.363 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:50.363 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:42:50.363 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 24.223484077999998, 2024-04-26T10:42:50.363 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014742026, 2024-04-26T10:42:50.363 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:50.363 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-26T10:42:50.363 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:50.363 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.363 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:50.363 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:42:50.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:50.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:42:50.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:50.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:50.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034793+0000", 2024-04-26T10:42:50.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-26T10:42:50.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.364 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.364 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:50.364 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034802+0000", 2024-04-26T10:42:50.364 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.551e-06 2024-04-26T10:42:50.364 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:50.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034815+0000", 2024-04-26T10:42:50.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2706e-05 2024-04-26T10:42:50.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:50.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034824+0000", 2024-04-26T10:42:50.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5189999999999998e-06 2024-04-26T10:42:50.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.365 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:50.365 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039312+0000", 2024-04-26T10:42:50.365 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044874030000000001 2024-04-26T10:42:50.365 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.365 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:50.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039457+0000", 2024-04-26T10:42:50.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000145081 2024-04-26T10:42:50.366 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:50.366 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:50.366 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:50.366 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049537+0000", 2024-04-26T10:42:50.366 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010080053 2024-04-26T10:42:50.366 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.366 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:50.366 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.366 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:50.366 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:50.366 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-26T10:42:50.368 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:42:50.368 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:50.366+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:50.383 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:42:50.383 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:42:50.401 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1: {} 2024-04-26T10:42:50.402 INFO:teuthology.orchestra.run.smithi049.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:42:50.419 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:42:50.419 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:42:50.469 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:50.468+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:50.481 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:50.481 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:50.490 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:42:50.570 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:50.569+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:50.592 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:50.593 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:50.601 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:42:50.671 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:50.670+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:50.744 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:50.744 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:50.753 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:42:50.798 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:50.796+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:50.873 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:50.873 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:50.873 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:50.871+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:50.882 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:42:50.974 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:50.973+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:51.029 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:51.029 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:51.033 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T10:42:51.034 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T10:42:51.037 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:42:51.075 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:51.074+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:51.143 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:51.143 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:51.152 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:42:51.176 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:51.175+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:51.263 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:51.263 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:51.274 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:42:51.277 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:51.276+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:51.375 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:51.375 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:51.378 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:51.376+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:51.384 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:42:51.479 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:51.478+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:51.485 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:51.486 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:51.495 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:42:51.580 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:51.578+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:51.601 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:51.601 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:51.610 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:42:51.682 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:51.681+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:51.711 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:51.712 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:51.720 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:42:51.732 INFO:teuthology.orchestra.run.smithi049.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T10:42:51.743 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:42:51.748 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T10:42:51.783 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:51.781+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:51.822 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:51.822 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:51.831 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:42:51.884 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:51.883+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:51.947 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:51.947 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:51.957 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:42:51.984 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:51.983+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:52.063 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:52.063 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:52.072 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:42:52.085 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:52.084+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:52.178 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:52.178 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:52.187 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:42:52.188 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:52.185+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:52.287 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:52.286+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:52.299 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:52.299 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:52.308 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:42:52.388 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:52.386+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:52.430 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:42:52.451 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:52.452 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:52.460 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:42:52.504 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:52.503+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:52.555 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:42:52.556 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:42:52.562 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:52.562 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:52.571 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:42:52.573 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1: {} 2024-04-26T10:42:52.573 INFO:teuthology.orchestra.run.smithi049.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:42:52.589 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:52.588+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:52.591 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:42:52.592 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:42:52.679 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:42:52.679 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:42:52.679 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:42:52.679 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:42:52.688 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:42:52.690 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:52.689+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:52.734 INFO:teuthology.orchestra.run.smithi049.stderr:noscrub is unset 2024-04-26T10:42:52.735 INFO:teuthology.orchestra.run.smithi049.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T10:42:52.749 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T10:42:52.790 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:42:52.791 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:42:52.791 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:42:52.791 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:42:52.791 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:42:52.791 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:52.789+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:52.799 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:42:52.892 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:52.890+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:52.970 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:42:52.970 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:42:52.972 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:42:52.972 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:42:52.972 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.972 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:42:52.973 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:42:52.973 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.90515049, 2024-04-26T10:42:52.973 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:42:52.973 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:52.973 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:52.973 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:52.973 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.973 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:52.973 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:42:52.974 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:52.974 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.974 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.974 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:52.974 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:42:52.974 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:52.974 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.975 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.975 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:52.975 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:42:52.975 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:52.976 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.976 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.976 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:52.976 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:42:52.976 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:42:52.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.977 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:52.978 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:42:52.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:42:52.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.978 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.978 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:52.979 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:42:52.979 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:42:52.979 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.979 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.980 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:52.982 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:42:52.982 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:42:52.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.982 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.983 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:52.983 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:42:52.983 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:42:52.983 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.984 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.984 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:52.984 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:42:52.984 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:42:52.984 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.985 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.985 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:52.985 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:42:52.985 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:42:52.985 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:52.986 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:52.986 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:52.986 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.986 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.986 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:42:52.986 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:42:52.987 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.904279710000001, 2024-04-26T10:42:52.987 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:42:52.987 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:52.987 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:52.987 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:52.987 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.988 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:52.988 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:42:52.988 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:52.988 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.988 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.988 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:52.988 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:42:52.988 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:52.988 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.988 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.988 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:52.989 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:42:52.989 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:52.989 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.989 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.989 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:52.989 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:42:52.990 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:42:52.990 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.990 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.990 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:52.990 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:42:52.990 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:42:52.991 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.991 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.991 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:52.991 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:42:52.991 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:42:52.991 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.991 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.991 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:52.991 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:42:52.992 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:42:52.992 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.992 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.992 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:52.992 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:42:52.992 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:42:52.992 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.993 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.993 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:52.993 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:42:52.993 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:42:52.993 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.993 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.993 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:52.993 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:42:52.994 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:42:52.994 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:52.994 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:52.994 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:52.994 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.994 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.994 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:42:52.994 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:42:52.994 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.903292366999999, 2024-04-26T10:42:52.995 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:42:52.995 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:52.995 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:52.995 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:52.995 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.995 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:52.995 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:42:52.995 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:52.995 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.996 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.996 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:52.996 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:42:52.996 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:52.996 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.996 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.996 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:52.996 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:42:52.997 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:42:52.997 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.997 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.997 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:52.997 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:42:52.997 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:42:52.997 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.997 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.997 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:52.998 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:42:52.998 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:42:52.998 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.998 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.998 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:52.998 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:42:52.998 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:42:52.998 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.998 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.999 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:52.999 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:42:52.999 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:42:52.999 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:52.999 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:52.999 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:52.999 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:42:53.000 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:42:53.000 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.000 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.000 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:53.000 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:42:53.000 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:42:53.000 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.001 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.001 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:53.001 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:42:53.001 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:42:53.002 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.002 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:53.002 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.002 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.003 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.003 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:42:53.003 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:42:53.003 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.903087102000001, 2024-04-26T10:42:53.003 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:42:53.003 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:53.003 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.004 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:53.004 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.004 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:53.004 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:42:53.004 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.004 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.004 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.005 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:53.005 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:42:53.005 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.005 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.005 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.005 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:53.005 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:42:53.006 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.006 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.006 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.006 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:53.006 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:42:53.006 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:42:53.006 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.007 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.007 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:53.007 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:42:53.007 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:42:53.007 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.007 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.007 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.007 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:42:53.007 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:42:53.008 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.008 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.008 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:53.008 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:42:53.008 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:42:53.008 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.008 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.008 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:53.008 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:42:53.009 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:42:53.009 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.009 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.009 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:53.009 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:42:53.009 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:42:53.009 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.009 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.009 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:53.009 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:42:53.009 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:42:53.010 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.010 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:53.010 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.010 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.010 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.010 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:53.010 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:42:53.010 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.902766223, 2024-04-26T10:42:53.010 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:42:53.010 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:53.010 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.010 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:53.011 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.011 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:53.011 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:42:53.011 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.011 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.011 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.011 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:53.011 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:42:53.011 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.011 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.012 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.012 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:53.012 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:42:53.012 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:42:53.012 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.012 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.012 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:53.012 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:42:53.012 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:42:53.012 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.013 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.013 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:53.013 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:42:53.013 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:42:53.013 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.013 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.013 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.013 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:42:53.013 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:42:53.013 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.013 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.013 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:53.014 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:42:53.014 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:42:53.014 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.014 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.014 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:53.014 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:42:53.014 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:42:53.014 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.014 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.014 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:53.014 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:42:53.015 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:42:53.015 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.015 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.015 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:53.015 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:42:53.015 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:42:53.015 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.015 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.015 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:53.015 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:42:53.015 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:42:53.015 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.015 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.016 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:53.016 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:42:53.016 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:42:53.016 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.016 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.016 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:53.016 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:42:53.016 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:42:53.016 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.016 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:53.016 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.016 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.017 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.017 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:53.017 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:42:53.017 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.902714399000001, 2024-04-26T10:42:53.017 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:42:53.017 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:53.017 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.017 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:53.017 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.017 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:53.017 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:42:53.018 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.018 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.018 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.018 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:53.018 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:42:53.018 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.018 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.018 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.018 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:53.019 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:42:53.019 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.019 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.019 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.019 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:53.019 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:42:53.019 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:42:53.019 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.019 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.019 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:53.019 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:42:53.020 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:42:53.020 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.020 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.020 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.020 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:42:53.020 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:42:53.020 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.020 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.020 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:53.020 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:42:53.020 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:42:53.021 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.021 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.021 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:53.021 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:42:53.021 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:42:53.022 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.022 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.022 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:53.022 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:42:53.022 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:42:53.022 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.022 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.022 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:53.022 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:42:53.022 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:42:53.022 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.022 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.023 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:53.023 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:42:53.023 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:42:53.023 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.023 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.023 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:53.023 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:42:53.023 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:42:53.023 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.023 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.023 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:53.023 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:42:53.024 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:42:53.024 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.024 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:53.024 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.024 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.024 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.024 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:53.024 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:42:53.024 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.902661027000001, 2024-04-26T10:42:53.024 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:42:53.024 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:53.024 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.025 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:53.025 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.025 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:53.025 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:42:53.025 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.025 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.025 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.026 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:53.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:42:53.026 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.026 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.026 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.026 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:53.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:42:53.026 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.026 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.026 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.026 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:53.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:42:53.026 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:42:53.027 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.027 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.027 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:53.027 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:42:53.027 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:42:53.027 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.027 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.027 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.027 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:42:53.028 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:42:53.028 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.028 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.028 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:53.028 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:42:53.028 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:42:53.028 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.028 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.028 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:53.028 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:42:53.028 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:42:53.028 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.028 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.029 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:53.029 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:42:53.029 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:42:53.029 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.029 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.029 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:53.029 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:42:53.029 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:42:53.029 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.029 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.029 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:53.029 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:42:53.029 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:42:53.029 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.030 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.030 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:53.030 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:42:53.030 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:42:53.030 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.030 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.030 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:53.030 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:42:53.030 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:42:53.030 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.030 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:53.030 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.030 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.031 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.031 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:53.031 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:42:53.031 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.902616699999999, 2024-04-26T10:42:53.031 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:42:53.031 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:53.031 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.031 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:53.031 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.031 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:53.031 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:42:53.031 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.032 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:53.032 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:42:53.032 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.032 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:53.032 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:42:53.032 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:42:53.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.032 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:53.033 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:42:53.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:42:53.033 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.033 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.033 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:53.033 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:42:53.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:42:53.033 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.033 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.033 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.033 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:42:53.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:42:53.034 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.034 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.034 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:53.034 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:42:53.034 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:42:53.034 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.035 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.035 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:53.035 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:42:53.035 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:42:53.035 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.035 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.035 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:53.035 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:42:53.035 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:42:53.035 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.035 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.035 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:53.036 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:42:53.036 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:42:53.036 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.036 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.036 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:53.036 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:42:53.036 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:42:53.036 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.036 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.036 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:53.036 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:42:53.036 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:42:53.036 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.037 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.037 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:53.037 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:42:53.037 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:42:53.037 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.037 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:53.037 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.037 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.037 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.037 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:53.037 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:42:53.037 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.902592986999998, 2024-04-26T10:42:53.037 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:42:53.038 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:53.038 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.038 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:53.038 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.038 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:53.038 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:42:53.038 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.038 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.038 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.038 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:53.038 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:42:53.039 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.039 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:53.039 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:42:53.039 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.039 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:53.039 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:42:53.039 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:42:53.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.039 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:53.040 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:42:53.040 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:42:53.040 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.040 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.040 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.040 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:42:53.040 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:42:53.040 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.040 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.040 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:53.040 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:42:53.040 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:42:53.040 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.040 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.041 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:53.041 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:42:53.041 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:42:53.041 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.041 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.041 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:53.041 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:42:53.041 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:42:53.041 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.041 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.041 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:53.041 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:42:53.041 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:42:53.041 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.042 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:53.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:42:53.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:42:53.042 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.042 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:53.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:42:53.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:42:53.042 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.042 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:53.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:42:53.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:42:53.043 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.043 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:53.043 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.043 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.043 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.043 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:53.043 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:42:53.043 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.902558681999999, 2024-04-26T10:42:53.044 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:42:53.044 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:53.044 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.044 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:53.044 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.044 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:53.044 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:42:53.044 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.044 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.044 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.044 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:53.044 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:42:53.044 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.044 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.045 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.045 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:53.045 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:42:53.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.045 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.045 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.045 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:53.045 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:42:53.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:42:53.045 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.045 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.045 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:53.045 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:42:53.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:42:53.046 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.046 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.046 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.046 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:42:53.046 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:42:53.046 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.046 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.046 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:53.046 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:42:53.046 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:42:53.046 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.047 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.047 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:53.047 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:42:53.047 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:42:53.047 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.047 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.047 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:53.047 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:42:53.047 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:42:53.047 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.047 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.047 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:53.047 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:42:53.047 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:42:53.048 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.048 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.048 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:53.048 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:42:53.048 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:42:53.048 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.048 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.048 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:53.048 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:42:53.048 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:42:53.048 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.048 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.048 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:53.049 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:42:53.049 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:42:53.049 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.049 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:53.049 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.049 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.049 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.049 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:53.049 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:42:53.049 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.902222085999998, 2024-04-26T10:42:53.049 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:42:53.049 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:53.049 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:53.049 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:53.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.050 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:53.050 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:42:53.050 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.050 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.050 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:53.050 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:42:53.050 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.050 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.050 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:53.051 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:42:53.051 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:42:53.051 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.051 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.051 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:53.051 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:42:53.051 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:42:53.051 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.051 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.051 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:53.051 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:42:53.051 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:42:53.051 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.052 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.052 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.052 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:42:53.052 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:42:53.052 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.052 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.052 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:53.052 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:42:53.052 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:42:53.052 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.052 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.052 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:53.052 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:42:53.053 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:42:53.053 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.053 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.053 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:53.053 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:42:53.053 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:42:53.053 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.053 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:53.053 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.053 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.053 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.053 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:53.053 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:42:53.054 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.902180057999999, 2024-04-26T10:42:53.054 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:42:53.054 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:53.054 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:53.054 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:53.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.054 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:53.054 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:42:53.054 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.055 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:53.055 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:42:53.055 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.055 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.055 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.055 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:53.055 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:42:53.055 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.055 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.055 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.055 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:53.055 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:42:53.055 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:42:53.056 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.056 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:53.056 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:42:53.056 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:42:53.056 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.056 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.056 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:42:53.056 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:42:53.056 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.056 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:53.056 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:42:53.057 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:42:53.057 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.057 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.057 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:53.057 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:42:53.057 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:42:53.057 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.057 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.057 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:53.058 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:42:53.058 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:42:53.058 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.058 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:53.058 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.058 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.058 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.058 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:53.058 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:42:53.058 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.902126886000001, 2024-04-26T10:42:53.058 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:42:53.058 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:53.058 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:53.059 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:53.059 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.059 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:53.059 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:42:53.059 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.059 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.059 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.059 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:53.059 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:42:53.059 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.059 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.059 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.059 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:53.059 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:42:53.060 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.060 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.060 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.061 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:53.061 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:42:53.061 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:42:53.061 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.061 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.061 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:53.061 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:42:53.061 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:42:53.061 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.061 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.061 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.061 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:42:53.062 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:42:53.062 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.062 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.062 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:53.062 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:42:53.062 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:42:53.062 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.062 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.062 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:53.062 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:42:53.062 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:42:53.062 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.062 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.062 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:53.063 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:42:53.063 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:42:53.063 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.063 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:53.063 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.063 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.063 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.063 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:42:53.063 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:42:53.063 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.898720476000001, 2024-04-26T10:42:53.063 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:42:53.063 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:53.063 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:42:53.063 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:53.064 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.064 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:53.064 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:42:53.064 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.064 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.064 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.064 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:53.064 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:42:53.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:53.065 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:42:53.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:53.065 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:42:53.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:42:53.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:53.066 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:42:53.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:42:53.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.066 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.066 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.066 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:42:53.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:42:53.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.066 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.066 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:53.066 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:42:53.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:42:53.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.067 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.067 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:53.067 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:42:53.067 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:42:53.067 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.067 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:53.067 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.067 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.067 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:42:53.067 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:42:53.067 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.896248523000001, 2024-04-26T10:42:53.067 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:42:53.067 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:53.068 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:53.068 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:53.068 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.068 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:53.068 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:42:53.068 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.068 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.068 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.068 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:53.068 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:42:53.068 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.068 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.068 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.068 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:53.069 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:42:53.069 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.069 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.069 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.069 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:53.069 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:42:53.069 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:42:53.069 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.069 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.069 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:53.069 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:42:53.069 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:42:53.069 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.069 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.069 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.070 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:42:53.070 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:42:53.070 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.070 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.070 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:53.070 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:42:53.070 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:42:53.070 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.070 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.070 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:53.070 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:42:53.070 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:42:53.070 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.071 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.071 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:53.071 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:42:53.071 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:42:53.071 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.071 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:53.071 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.071 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.071 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.071 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:42:53.071 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:42:53.071 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.895594965000001, 2024-04-26T10:42:53.071 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:42:53.071 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:53.072 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:53.072 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:53.072 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.072 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:53.072 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:42:53.072 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.072 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.072 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.072 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:53.072 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:42:53.072 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.072 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.072 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.072 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:53.073 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:42:53.073 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.073 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.073 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.073 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:53.073 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:42:53.073 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:42:53.073 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.073 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.073 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:53.073 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:42:53.073 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:42:53.073 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.073 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.073 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.074 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:42:53.074 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:42:53.074 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.074 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.074 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:53.074 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:42:53.074 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:42:53.074 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.074 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.074 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:53.074 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:42:53.074 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:42:53.074 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.075 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.075 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:53.075 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:42:53.075 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:42:53.075 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.075 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:53.075 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.075 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.075 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.075 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:42:53.075 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:42:53.075 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.895519180000001, 2024-04-26T10:42:53.075 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:42:53.075 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:53.075 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:53.076 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:53.076 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.076 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:53.076 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:42:53.076 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.076 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.076 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.076 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:53.076 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:42:53.076 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.076 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.076 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.076 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:53.076 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:42:53.077 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.077 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.077 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.077 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:53.077 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:42:53.077 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:42:53.077 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.077 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.077 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:53.077 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:42:53.077 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:42:53.077 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.077 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.077 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.078 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:42:53.078 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:42:53.078 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.078 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.078 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:53.078 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:42:53.078 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:42:53.078 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.078 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.078 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:53.078 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:42:53.078 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:42:53.078 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.079 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.079 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:53.079 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:42:53.079 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:42:53.079 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.079 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:53.079 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.079 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.079 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.079 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:42:53.079 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:42:53.079 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.895305486000002, 2024-04-26T10:42:53.080 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:42:53.080 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:53.080 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:42:53.080 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:53.080 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.080 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:53.080 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:42:53.080 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.080 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.080 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.080 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:53.080 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:42:53.080 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.081 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.081 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.081 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:53.081 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:42:53.081 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.081 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.081 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.081 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:53.081 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:42:53.081 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:42:53.081 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.081 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.081 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:53.081 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:42:53.081 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:42:53.082 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.082 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.082 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.082 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:42:53.082 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:42:53.082 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.082 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.082 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:53.082 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:42:53.082 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:42:53.082 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.082 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.082 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:53.082 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:42:53.083 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:42:53.083 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.083 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:53.083 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.083 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.083 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.083 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:42:53.083 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:42:53.083 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.892861672999999, 2024-04-26T10:42:53.083 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:42:53.083 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:53.083 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:53.083 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:53.083 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.084 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:53.084 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:42:53.084 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.084 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.084 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.084 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:53.084 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:42:53.084 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.084 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.084 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.084 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:53.084 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:42:53.084 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:42:53.084 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.084 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.085 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:53.085 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:42:53.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:42:53.085 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.085 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.085 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:53.085 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:42:53.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:42:53.085 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.085 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.085 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.085 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:42:53.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:42:53.085 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.085 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.086 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:53.086 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:42:53.086 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:42:53.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.086 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.086 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:53.086 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:42:53.086 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:42:53.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.086 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.086 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:53.086 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:42:53.086 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:42:53.086 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.087 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:53.087 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.087 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.087 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.087 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:42:53.087 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:42:53.087 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.442799228999998, 2024-04-26T10:42:53.087 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:42:53.087 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:53.087 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.087 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:53.087 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.087 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:53.087 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:42:53.088 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.088 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.088 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.088 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:53.088 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:42:53.088 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:53.088 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.088 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.088 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:53.088 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:42:53.088 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:42:53.088 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.088 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.088 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:53.089 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:42:53.089 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:42:53.089 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.089 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.089 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:53.089 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:42:53.089 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:42:53.089 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.089 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.089 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.089 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:42:53.089 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:42:53.089 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.090 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.090 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:53.090 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:42:53.090 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:42:53.090 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.090 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.090 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:53.090 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:42:53.090 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:42:53.090 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.090 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.090 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:53.090 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:42:53.090 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:42:53.091 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.091 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.091 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:53.091 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:42:53.091 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:42:53.091 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.091 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.091 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:53.091 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:42:53.091 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:42:53.091 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.091 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.091 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:53.091 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:42:53.092 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:42:53.092 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:53.092 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:53.092 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:53.092 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:42:53.092 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:42:53.092 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.092 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:53.092 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.092 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:53.092 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:53.092 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:42:53.093 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:42:53.094 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:53.092+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:53.195 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:53.193+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:53.200 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:42:53.200 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:42:53.200 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:42:53.200 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:42:53.209 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:42:53.295 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:53.294+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:53.355 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:42:53.355 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:42:53.356 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:42:53.356 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:42:53.356 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:42:53.365 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:42:53.396 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:53.395+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:53.497 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:53.496+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:53.513 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:42:53.513 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:42:53.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:42:53.513 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:42:53.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.514 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:42:53.514 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:42:53.514 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 27.475300633, 2024-04-26T10:42:53.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:42:53.514 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:53.514 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.514 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:53.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:53.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:42:53.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:53.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:42:53.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:53.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:42:53.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:53.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:42:53.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:42:53.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:53.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:42:53.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:42:53.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:42:53.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:42:53.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:53.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:42:53.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:42:53.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:53.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:42:53.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:42:53.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:53.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:42:53.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:42:53.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:53.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:42:53.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:42:53.518 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.518 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:53.518 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.518 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:53.518 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:42:53.518 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 27.473550511999999, 2024-04-26T10:42:53.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:42:53.519 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:53.519 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.519 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:53.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:53.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:42:53.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:53.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:42:53.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:53.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:42:53.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:42:53.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:53.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:42:53.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:42:53.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:53.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:42:53.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:42:53.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:42:53.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:42:53.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:53.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:42:53.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:42:53.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.522 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:53.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:42:53.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:42:53.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.522 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:53.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:42:53.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:42:53.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.522 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:53.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:42:53.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:42:53.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:53.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:42:53.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:42:53.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:53.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:42:53.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:42:53.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:53.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:42:53.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:42:53.523 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.523 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:53.524 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.524 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:53.524 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:42:53.524 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 27.473497514000002, 2024-04-26T10:42:53.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:42:53.524 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:53.524 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.524 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:53.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:53.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:42:53.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:53.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:42:53.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:53.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:42:53.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:53.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:42:53.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:42:53.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:53.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:42:53.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:42:53.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:42:53.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:42:53.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:53.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:42:53.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:42:53.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.527 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:53.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:42:53.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:42:53.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.527 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:53.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:42:53.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:42:53.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:53.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:42:53.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:42:53.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:53.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:42:53.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:42:53.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:53.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:42:53.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:42:53.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:53.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:42:53.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:42:53.529 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.529 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:53.529 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.530 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:53.530 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:42:53.530 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 27.47341977, 2024-04-26T10:42:53.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:42:53.530 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:53.530 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.530 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:53.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.530 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:53.530 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:42:53.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:53.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:42:53.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:53.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:42:53.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:42:53.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:53.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:42:53.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:42:53.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.532 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:53.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:42:53.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:42:53.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.532 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:42:53.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:42:53.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:53.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:42:53.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:42:53.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:53.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:42:53.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:42:53.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:53.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:42:53.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:42:53.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:53.534 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:42:53.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:42:53.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:53.534 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:42:53.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:42:53.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:53.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:42:53.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:42:53.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:53.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:42:53.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:42:53.535 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.535 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:53.535 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.536 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:53.536 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:42:53.536 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 27.473380764000002, 2024-04-26T10:42:53.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:42:53.536 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:53.536 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.536 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:53.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.536 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:53.536 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:42:53.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:53.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:42:53.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:53.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:42:53.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:42:53.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:53.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:42:53.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:42:53.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:53.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:42:53.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:42:53.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:42:53.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:42:53.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.539 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:53.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:42:53.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:42:53.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.539 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:53.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:42:53.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:42:53.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.539 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:53.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:42:53.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:42:53.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:53.540 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:42:53.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:42:53.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:53.540 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:42:53.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:42:53.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:53.540 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:42:53.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:42:53.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.541 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:53.541 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:42:53.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:42:53.541 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.541 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:53.541 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.541 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:53.541 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:42:53.541 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 27.473361943, 2024-04-26T10:42:53.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:42:53.541 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:53.542 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.542 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:53.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:53.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:42:53.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:53.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:42:53.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:53.543 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:42:53.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:42:53.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:53.543 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:42:53.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:42:53.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:53.543 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:42:53.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:42:53.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:42:53.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:42:53.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:53.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:42:53.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:42:53.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:53.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:42:53.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:42:53.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.545 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:53.545 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:42:53.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:42:53.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.545 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:53.545 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:42:53.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:42:53.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.545 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:53.545 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:42:53.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:42:53.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:53.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:42:53.546 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:42:53.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:53.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:42:53.546 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:42:53.546 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.546 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:53.546 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.547 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:53.547 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:42:53.547 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 27.473329940999999, 2024-04-26T10:42:53.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:42:53.547 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:53.547 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.547 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:53.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:53.547 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:42:53.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.548 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:53.548 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:42:53.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.548 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:53.548 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:42:53.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.548 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:53.548 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:42:53.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:42:53.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.549 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:53.549 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:42:53.549 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:42:53.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.549 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.549 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:42:53.549 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:42:53.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.549 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:53.550 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:42:53.550 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:42:53.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.550 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:53.550 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:42:53.550 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:42:53.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.550 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:53.550 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:42:53.550 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:42:53.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:53.551 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:42:53.551 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:42:53.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:53.551 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:42:53.551 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:42:53.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:53.551 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:42:53.551 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:42:53.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.552 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:53.552 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:42:53.552 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:42:53.552 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.552 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:53.552 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.552 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:53.552 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:42:53.552 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 27.473121132999999, 2024-04-26T10:42:53.553 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:42:53.553 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:53.553 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.553 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:53.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.553 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:53.553 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:42:53.553 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.553 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:53.553 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:42:53.553 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.554 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:53.554 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:42:53.554 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:42:53.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.554 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:53.554 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:42:53.554 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:42:53.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.554 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:53.554 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:42:53.555 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:42:53.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.555 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.555 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:42:53.555 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:42:53.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.555 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:53.555 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:42:53.555 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:42:53.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.556 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:53.556 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:42:53.556 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:42:53.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.556 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:53.556 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:42:53.556 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:42:53.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.556 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:53.556 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:42:53.556 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:42:53.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.557 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:53.557 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:42:53.557 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:42:53.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.557 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:53.557 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:42:53.557 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:42:53.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.557 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:53.558 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:42:53.558 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:42:53.558 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.558 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:53.558 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.558 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:53.558 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:42:53.558 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 27.473089842, 2024-04-26T10:42:53.558 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:42:53.558 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:53.558 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:42:53.558 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:53.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.559 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:53.559 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:42:53.559 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.559 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:53.559 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:42:53.559 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.559 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:53.559 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:42:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:42:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:42:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:42:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:42:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.560 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:42:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:42:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:42:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:42:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:42:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:42:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.562 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:53.562 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:42:53.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:42:53.562 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.562 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:53.562 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.562 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:53.562 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:42:53.562 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 27.473062592000002, 2024-04-26T10:42:53.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:42:53.562 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:42:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:42:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:42:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:53.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:42:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:42:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:42:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:42:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:42:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.564 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:42:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:42:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:42:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:42:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:42:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:42:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:53.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:42:53.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:42:53.566 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.566 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:53.566 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.566 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:42:53.566 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:42:53.566 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 27.470285840999999, 2024-04-26T10:42:53.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:42:53.566 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:53.567 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:42:53.567 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:53.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:53.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:42:53.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:53.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:42:53.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:42:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:42:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:42:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:42:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:42:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:42:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:42:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:42:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:42:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:42:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:42:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.569 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:42:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:42:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 27.470235752000001, 2024-04-26T10:42:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:42:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:53.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:42:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:42:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:42:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:42:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:42:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:42:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:42:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:42:53.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:42:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:42:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:42:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:42:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:42:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:53.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:42:53.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:42:53.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.574 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:53.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:42:53.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:42:53.574 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.574 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:53.574 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.574 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:42:53.574 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:42:53.575 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 27.469343683000002, 2024-04-26T10:42:53.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:42:53.575 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:53.575 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.575 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:53.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:53.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:42:53.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:53.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:42:53.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:53.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:42:53.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:53.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:42:53.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:42:53.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:53.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:42:53.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:42:53.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:42:53.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:42:53.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:53.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:42:53.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:42:53.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:53.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:42:53.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:42:53.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:53.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:42:53.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:42:53.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:53.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:42:53.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:42:53.578 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.578 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:53.579 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.579 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:42:53.579 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:42:53.579 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 27.467155353999999, 2024-04-26T10:42:53.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:42:53.579 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:53.579 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.579 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:53.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:53.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:42:53.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.580 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:53.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:42:53.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.580 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:53.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:42:53.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.580 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:53.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:42:53.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:42:53.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:53.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:42:53.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:42:53.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:42:53.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:42:53.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:53.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:42:53.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:42:53.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:53.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:42:53.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:42:53.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:53.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:42:53.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:42:53.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:53.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:42:53.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:42:53.583 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.583 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:53.583 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.583 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:42:53.583 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:42:53.583 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 27.467019984, 2024-04-26T10:42:53.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:42:53.583 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:53.583 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.584 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:53.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:53.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:42:53.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:53.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:42:53.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:53.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:42:53.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:53.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:42:53.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:42:53.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:53.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:42:53.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:42:53.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:42:53.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:42:53.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:53.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:42:53.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:42:53.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:53.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:42:53.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:42:53.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:53.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:42:53.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:42:53.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:53.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:42:53.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:42:53.587 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.587 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:53.587 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.587 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:42:53.587 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:42:53.587 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 27.466805409999999, 2024-04-26T10:42:53.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:42:53.588 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:53.588 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.588 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:53.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.588 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:53.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:42:53.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.588 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:53.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:42:53.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:53.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:42:53.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:53.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:42:53.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:42:53.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:53.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:42:53.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:42:53.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:42:53.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:42:53.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:53.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:42:53.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:42:53.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:53.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:42:53.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:42:53.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:53.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:42:53.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:42:53.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:53.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:42:53.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:42:53.591 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.591 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:53.591 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.592 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:42:53.592 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:42:53.592 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 27.466466469, 2024-04-26T10:42:53.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:42:53.592 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:53.592 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.592 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:53.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:53.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:42:53.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:53.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:42:53.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:53.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:42:53.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:53.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:42:53.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:42:53.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:53.594 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:42:53.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:42:53.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.594 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:42:53.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:42:53.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:53.594 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:42:53.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:42:53.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.595 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:53.595 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:42:53.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:42:53.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.595 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:53.595 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:42:53.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:42:53.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.596 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:53.596 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:42:53.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:42:53.596 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.596 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:53.596 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.596 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:42:53.596 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:42:53.596 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 27.466357091999999, 2024-04-26T10:42:53.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:42:53.597 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:53.597 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:42:53.597 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:53.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:53.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:42:53.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:53.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:42:53.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:53.598 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:42:53.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:42:53.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:53.598 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:42:53.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:42:53.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:53.598 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:42:53.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:42:53.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.599 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:42:53.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:42:53.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.599 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:53.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:42:53.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:42:53.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.599 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:42:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:42:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:42:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:42:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 27.466317372999999, 2024-04-26T10:42:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:42:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.600 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:42:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:42:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:42:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:42:53.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:42:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:42:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:42:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:42:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:42:53.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:42:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:42:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:42:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:42:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:42:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:53.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:42:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:42:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:42:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:42:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:42:53.604 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:42:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 27.465979839999999, 2024-04-26T10:42:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:42:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:42:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:42:53.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:42:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:42:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:42:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:53.606 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:42:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:42:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:42:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:42:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:42:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:42:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:42:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:42:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:42:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:42:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:42:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:42:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.609 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:53.609 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.609 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:53.609 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:53.609 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:42:53.611 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:42:53.611 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:53.609+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:53.711 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:53.710+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:53.726 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-26T10:42:53.726 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-26T10:42:53.726 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-26T10:42:53.726 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-26T10:42:53.735 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:42:53.739 INFO:teuthology.orchestra.run.smithi049.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T10:42:53.756 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T10:42:53.757 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:42:53.812 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:53.810+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:53.838 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-26T10:42:53.838 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-26T10:42:53.838 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-26T10:42:53.839 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-26T10:42:53.839 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-26T10:42:53.848 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:42:53.932 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:53.931+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:53.991 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-26T10:42:53.991 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-26T10:42:53.991 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-26T10:42:53.991 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-26T10:42:53.991 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:53.991 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:42:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:42:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.124229986000003, 2024-04-26T10:42:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086884530000000005, 2024-04-26T10:42:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:42:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:42:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:42:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 164 2024-04-26T10:42:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:53.992 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:42:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:42:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:42:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-26T10:42:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:53.993 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864858+0000", 2024-04-26T10:42:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3231e-05 2024-04-26T10:42:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864862+0000", 2024-04-26T10:42:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9280000000000003e-06 2024-04-26T10:42:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864865+0000", 2024-04-26T10:42:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8289999999999999e-06 2024-04-26T10:42:53.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869688+0000", 2024-04-26T10:42:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048234990000000002 2024-04-26T10:42:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869732+0000", 2024-04-26T10:42:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3232999999999998e-05 2024-04-26T10:42:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869804+0000", 2024-04-26T10:42:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2152999999999998e-05 2024-04-26T10:42:53.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.872812+0000", 2024-04-26T10:42:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003008372 2024-04-26T10:42:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873459+0000", 2024-04-26T10:42:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064655699999999997 2024-04-26T10:42:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873482+0000", 2024-04-26T10:42:53.996 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3419999999999999e-05 2024-04-26T10:42:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873504+0000", 2024-04-26T10:42:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1440000000000001e-05 2024-04-26T10:42:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:42:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:42:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.124177047000003, 2024-04-26T10:42:53.997 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0092811590000000006, 2024-04-26T10:42:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:42:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:42:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:42:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 165 2024-04-26T10:42:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:42:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:53.998 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:42:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:42:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864871+0000", 2024-04-26T10:42:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2200000000000001e-06 2024-04-26T10:42:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:53.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864875+0000", 2024-04-26T10:42:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.206e-06 2024-04-26T10:42:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864878+0000", 2024-04-26T10:42:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5799999999999999e-06 2024-04-26T10:42:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873137+0000", 2024-04-26T10:42:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082591609999999992 2024-04-26T10:42:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873186+0000", 2024-04-26T10:42:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8741e-05 2024-04-26T10:42:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873252+0000", 2024-04-26T10:42:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5877000000000006e-05 2024-04-26T10:42:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873708+0000", 2024-04-26T10:42:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00045660299999999998 2024-04-26T10:42:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874091+0000", 2024-04-26T10:42:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038295000000000001 2024-04-26T10:42:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874115+0000", 2024-04-26T10:42:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:42:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874149+0000", 2024-04-26T10:42:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4320999999999999e-05 2024-04-26T10:42:54.002 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:42:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:42:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.987079412, 2024-04-26T10:42:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010199138999999999, 2024-04-26T10:42:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:42:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:42:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:42:54.003 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 188 2024-04-26T10:42:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:42:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:42:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:54.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:42:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-26T10:42:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002024+0000", 2024-04-26T10:42:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8050999999999997e-05 2024-04-26T10:42:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002034+0000", 2024-04-26T10:42:54.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0217000000000001e-05 2024-04-26T10:42:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002039+0000", 2024-04-26T10:42:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6879999999999998e-06 2024-04-26T10:42:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006586+0000", 2024-04-26T10:42:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045473570000000001 2024-04-26T10:42:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006626+0000", 2024-04-26T10:42:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9688999999999999e-05 2024-04-26T10:42:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006689+0000", 2024-04-26T10:42:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3243000000000004e-05 2024-04-26T10:42:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007850+0000", 2024-04-26T10:42:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011607989999999999 2024-04-26T10:42:54.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012084+0000", 2024-04-26T10:42:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042340069999999997 2024-04-26T10:42:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012132+0000", 2024-04-26T10:42:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8112999999999998e-05 2024-04-26T10:42:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012165+0000", 2024-04-26T10:42:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3189999999999999e-05 2024-04-26T10:42:54.008 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:42:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:42:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.987002711999999, 2024-04-26T10:42:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010167136, 2024-04-26T10:42:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:42:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:42:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:42:54.009 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 189 2024-04-26T10:42:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:42:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:42:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.010 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:42:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002044+0000", 2024-04-26T10:42:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.119e-06 2024-04-26T10:42:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002047+0000", 2024-04-26T10:42:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0199999999999999e-06 2024-04-26T10:42:54.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002050+0000", 2024-04-26T10:42:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3360000000000002e-06 2024-04-26T10:42:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007165+0000", 2024-04-26T10:42:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051155879999999999 2024-04-26T10:42:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007209+0000", 2024-04-26T10:42:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4097000000000001e-05 2024-04-26T10:42:54.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007278+0000", 2024-04-26T10:42:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8663000000000003e-05 2024-04-26T10:42:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.008047+0000", 2024-04-26T10:42:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00076935299999999996 2024-04-26T10:42:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012171+0000", 2024-04-26T10:42:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004123219 2024-04-26T10:42:54.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012193+0000", 2024-04-26T10:42:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2169000000000001e-05 2024-04-26T10:42:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012210+0000", 2024-04-26T10:42:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6841999999999999e-05 2024-04-26T10:42:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.014 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:42:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.955539319, 2024-04-26T10:42:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010195469, 2024-04-26T10:42:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:42:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:42:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033504+0000", 2024-04-26T10:42:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999981 2024-04-26T10:42:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033513+0000", 2024-04-26T10:42:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6829999999999997e-06 2024-04-26T10:42:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:54.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033525+0000", 2024-04-26T10:42:54.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2748000000000001e-05 2024-04-26T10:42:54.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033537+0000", 2024-04-26T10:42:54.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1243999999999999e-05 2024-04-26T10:42:54.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:54.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034018+0000", 2024-04-26T10:42:54.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048138899999999998 2024-04-26T10:42:54.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-04-26T10:42:54.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034025+0000", 2024-04-26T10:42:54.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8870000000000003e-06 2024-04-26T10:42:54.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:54.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035264+0000", 2024-04-26T10:42:54.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0012385370000000001 2024-04-26T10:42:54.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:54.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035372+0000", 2024-04-26T10:42:54.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010851199999999999 2024-04-26T10:42:54.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:54.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035473+0000", 2024-04-26T10:42:54.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000100967 2024-04-26T10:42:54.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043270+0000", 2024-04-26T10:42:54.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0077971869999999997 2024-04-26T10:42:54.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:54.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043620+0000", 2024-04-26T10:42:54.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034962099999999999 2024-04-26T10:42:54.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:54.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043665+0000", 2024-04-26T10:42:54.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5426999999999997e-05 2024-04-26T10:42:54.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:54.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043701+0000", 2024-04-26T10:42:54.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6072000000000003e-05 2024-04-26T10:42:54.020 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.020 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:54.020 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.021 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.021 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:42:54.021 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.955054239999999, 2024-04-26T10:42:54.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099286970000000002, 2024-04-26T10:42:54.021 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:54.021 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.021 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:54.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:54.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:42:54.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:54.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:42:54.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:54.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033990+0000", 2024-04-26T10:42:54.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-26T10:42:54.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:54.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033998+0000", 2024-04-26T10:42:54.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7970000000000001e-06 2024-04-26T10:42:54.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:54.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034010+0000", 2024-04-26T10:42:54.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2383e-05 2024-04-26T10:42:54.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034021+0000", 2024-04-26T10:42:54.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0824e-05 2024-04-26T10:42:54.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:54.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035774+0000", 2024-04-26T10:42:54.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017527479999999999 2024-04-26T10:42:54.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:54.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035929+0000", 2024-04-26T10:42:54.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000155735 2024-04-26T10:42:54.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:54.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036083+0000", 2024-04-26T10:42:54.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000153635 2024-04-26T10:42:54.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043369+0000", 2024-04-26T10:42:54.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0072854490000000003 2024-04-26T10:42:54.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:54.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043709+0000", 2024-04-26T10:42:54.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034039600000000003 2024-04-26T10:42:54.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:54.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043878+0000", 2024-04-26T10:42:54.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016924799999999999 2024-04-26T10:42:54.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:54.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043920+0000", 2024-04-26T10:42:54.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1471999999999999e-05 2024-04-26T10:42:54.025 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.025 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:54.025 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.026 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.026 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:42:54.026 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.955014962, 2024-04-26T10:42:54.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010011091999999999, 2024-04-26T10:42:54.026 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:54.026 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.026 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:54.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:54.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:42:54.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:54.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:42:54.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:54.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:42:54.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:54.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034040+0000", 2024-04-26T10:42:54.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8560000000000002e-06 2024-04-26T10:42:54.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:54.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034048+0000", 2024-04-26T10:42:54.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4139999999999994e-06 2024-04-26T10:42:54.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034054+0000", 2024-04-26T10:42:54.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8950000000000003e-06 2024-04-26T10:42:54.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:54.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036269+0000", 2024-04-26T10:42:54.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002215528 2024-04-26T10:42:54.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:54.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036364+0000", 2024-04-26T10:42:54.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4089e-05 2024-04-26T10:42:54.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:54.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036443+0000", 2024-04-26T10:42:54.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9666000000000006e-05 2024-04-26T10:42:54.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043451+0000", 2024-04-26T10:42:54.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0070081939999999997 2024-04-26T10:42:54.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:54.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043930+0000", 2024-04-26T10:42:54.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00047819799999999999 2024-04-26T10:42:54.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:54.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043999+0000", 2024-04-26T10:42:54.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9136999999999999e-05 2024-04-26T10:42:54.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:54.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044041+0000", 2024-04-26T10:42:54.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2624999999999999e-05 2024-04-26T10:42:54.030 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.030 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:54.030 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.031 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.031 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:42:54.031 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.954975995000002, 2024-04-26T10:42:54.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015256755, 2024-04-26T10:42:54.031 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:54.031 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.031 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:54.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:54.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:42:54.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:54.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:42:54.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:54.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:42:54.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:54.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034073+0000", 2024-04-26T10:42:54.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1099999999999996e-06 2024-04-26T10:42:54.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:54.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034081+0000", 2024-04-26T10:42:54.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0539999999999995e-06 2024-04-26T10:42:54.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034087+0000", 2024-04-26T10:42:54.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0240000000000003e-06 2024-04-26T10:42:54.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:54.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036668+0000", 2024-04-26T10:42:54.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002581014 2024-04-26T10:42:54.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:54.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036717+0000", 2024-04-26T10:42:54.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9299999999999999e-05 2024-04-26T10:42:54.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:54.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036846+0000", 2024-04-26T10:42:54.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012901000000000001 2024-04-26T10:42:54.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:54.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044050+0000", 2024-04-26T10:42:54.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007203816 2024-04-26T10:42:54.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049229+0000", 2024-04-26T10:42:54.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051792169999999998 2024-04-26T10:42:54.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:54.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049282+0000", 2024-04-26T10:42:54.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2605000000000002e-05 2024-04-26T10:42:54.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:54.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049326+0000", 2024-04-26T10:42:54.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4255000000000002e-05 2024-04-26T10:42:54.035 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.035 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:54.035 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.036 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.036 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:42:54.036 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.954951333, 2024-04-26T10:42:54.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01538838, 2024-04-26T10:42:54.036 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:54.036 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.036 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:54.036 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.036 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:54.036 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:42:54.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.036 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.036 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:54.036 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:42:54.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:54.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034093+0000", 2024-04-26T10:42:54.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:54.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034097+0000", 2024-04-26T10:42:54.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.213e-06 2024-04-26T10:42:54.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:54.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034104+0000", 2024-04-26T10:42:54.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9840000000000004e-06 2024-04-26T10:42:54.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034111+0000", 2024-04-26T10:42:54.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9199999999999998e-06 2024-04-26T10:42:54.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:54.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.037736+0000", 2024-04-26T10:42:54.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036257429999999998 2024-04-26T10:42:54.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.038 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:54.038 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:42:54.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034004 2024-04-26T10:42:54.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:54.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038526+0000", 2024-04-26T10:42:54.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00044924100000000002 2024-04-26T10:42:54.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:54.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044708+0000", 2024-04-26T10:42:54.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061823360000000001 2024-04-26T10:42:54.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:42:54.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046886159999999996 2024-04-26T10:42:54.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:54.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049446+0000", 2024-04-26T10:42:54.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.973e-05 2024-04-26T10:42:54.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:54.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049482+0000", 2024-04-26T10:42:54.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6004999999999998e-05 2024-04-26T10:42:54.040 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.041 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:54.041 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.041 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.041 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:42:54.041 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.954929812, 2024-04-26T10:42:54.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015480648, 2024-04-26T10:42:54.041 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:54.041 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.041 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:54.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.041 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:54.041 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:42:54.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:54.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:42:54.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:54.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:42:54.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:54.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034118+0000", 2024-04-26T10:42:54.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1769999999999998e-06 2024-04-26T10:42:54.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:54.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034126+0000", 2024-04-26T10:42:54.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7770000000000002e-06 2024-04-26T10:42:54.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034146+0000", 2024-04-26T10:42:54.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0579999999999999e-05 2024-04-26T10:42:54.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:54.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039740+0000", 2024-04-26T10:42:54.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0055940269999999997 2024-04-26T10:42:54.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:54.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039848+0000", 2024-04-26T10:42:54.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010775100000000001 2024-04-26T10:42:54.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:54.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040022+0000", 2024-04-26T10:42:54.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000173964 2024-04-26T10:42:54.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:54.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044721+0000", 2024-04-26T10:42:54.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046989099999999997 2024-04-26T10:42:54.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049541+0000", 2024-04-26T10:42:54.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048200789999999997 2024-04-26T10:42:54.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:54.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049574+0000", 2024-04-26T10:42:54.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2817000000000001e-05 2024-04-26T10:42:54.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:54.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049596+0000", 2024-04-26T10:42:54.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2011999999999999e-05 2024-04-26T10:42:54.046 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.046 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:54.046 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.046 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.046 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:42:54.046 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.954893853000002, 2024-04-26T10:42:54.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015538033, 2024-04-26T10:42:54.046 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:54.046 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.046 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:54.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:54.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:42:54.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:54.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:42:54.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:54.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:42:54.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:54.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034155+0000", 2024-04-26T10:42:54.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.177e-06 2024-04-26T10:42:54.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:54.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034161+0000", 2024-04-26T10:42:54.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0780000000000001e-06 2024-04-26T10:42:54.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034168+0000", 2024-04-26T10:42:54.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8689999999999998e-06 2024-04-26T10:42:54.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:54.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041069+0000", 2024-04-26T10:42:54.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069010440000000003 2024-04-26T10:42:54.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:54.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041221+0000", 2024-04-26T10:42:54.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015175 2024-04-26T10:42:54.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:54.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041350+0000", 2024-04-26T10:42:54.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012870899999999999 2024-04-26T10:42:54.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:54.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045386+0000", 2024-04-26T10:42:54.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040364789999999999 2024-04-26T10:42:54.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049641+0000", 2024-04-26T10:42:54.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042552120000000004 2024-04-26T10:42:54.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:54.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049669+0000", 2024-04-26T10:42:54.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7809000000000001e-05 2024-04-26T10:42:54.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:54.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049689+0000", 2024-04-26T10:42:54.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0336e-05 2024-04-26T10:42:54.051 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.051 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:54.051 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.051 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.051 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:42:54.051 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.954872024, 2024-04-26T10:42:54.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015595107, 2024-04-26T10:42:54.051 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:54.052 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.052 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:54.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:54.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:42:54.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:54.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:42:54.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:54.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:42:54.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:54.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034176+0000", 2024-04-26T10:42:54.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0089999999999999e-06 2024-04-26T10:42:54.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:54.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034182+0000", 2024-04-26T10:42:54.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4579999999999998e-06 2024-04-26T10:42:54.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034187+0000", 2024-04-26T10:42:54.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0880000000000002e-06 2024-04-26T10:42:54.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:54.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045564+0000", 2024-04-26T10:42:54.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011376475 2024-04-26T10:42:54.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:54.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045623+0000", 2024-04-26T10:42:54.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9388999999999997e-05 2024-04-26T10:42:54.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:54.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045713+0000", 2024-04-26T10:42:54.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0211999999999996e-05 2024-04-26T10:42:54.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:54.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046325+0000", 2024-04-26T10:42:54.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00061181699999999996 2024-04-26T10:42:54.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049722+0000", 2024-04-26T10:42:54.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033962380000000002 2024-04-26T10:42:54.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:54.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049750+0000", 2024-04-26T10:42:54.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8087000000000001e-05 2024-04-26T10:42:54.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:54.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049768+0000", 2024-04-26T10:42:54.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8681999999999998e-05 2024-04-26T10:42:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:42:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.954658500000001, 2024-04-26T10:42:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087543810000000003, 2024-04-26T10:42:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.059 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:42:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:42:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034386+0000", 2024-04-26T10:42:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-26T10:42:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034397+0000", 2024-04-26T10:42:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0878e-05 2024-04-26T10:42:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034408+0000", 2024-04-26T10:42:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1138000000000001e-05 2024-04-26T10:42:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034414+0000", 2024-04-26T10:42:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2910000000000004e-06 2024-04-26T10:42:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036009+0000", 2024-04-26T10:42:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0015952029999999999 2024-04-26T10:42:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036120+0000", 2024-04-26T10:42:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000110584 2024-04-26T10:42:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:42:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036225+0000", 2024-04-26T10:42:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010523599999999999 2024-04-26T10:42:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039276+0000", 2024-04-26T10:42:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003050404 2024-04-26T10:42:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:42:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037356099999999999 2024-04-26T10:42:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043079+0000", 2024-04-26T10:42:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8099e-05 2024-04-26T10:42:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.063 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043141+0000", 2024-04-26T10:42:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1655999999999994e-05 2024-04-26T10:42:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:42:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.954597943, 2024-04-26T10:42:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090131610000000004, 2024-04-26T10:42:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:54.064 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:42:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:42:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:42:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034451+0000", 2024-04-26T10:42:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9600000000000002e-06 2024-04-26T10:42:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034458+0000", 2024-04-26T10:42:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5820000000000004e-06 2024-04-26T10:42:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034463+0000", 2024-04-26T10:42:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0719999999999999e-06 2024-04-26T10:42:54.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036527+0000", 2024-04-26T10:42:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002063755 2024-04-26T10:42:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036610+0000", 2024-04-26T10:42:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2669000000000004e-05 2024-04-26T10:42:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:42:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036744+0000", 2024-04-26T10:42:54.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013412499999999999 2024-04-26T10:42:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040144+0000", 2024-04-26T10:42:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033999799999999999 2024-04-26T10:42:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043301+0000", 2024-04-26T10:42:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031572240000000001 2024-04-26T10:42:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043425+0000", 2024-04-26T10:42:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000123664 2024-04-26T10:42:54.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:54.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043460+0000", 2024-04-26T10:42:54.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5651000000000001e-05 2024-04-26T10:42:54.069 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.069 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:54.069 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.069 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.069 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:42:54.069 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.954573043, 2024-04-26T10:42:54.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086028210000000001, 2024-04-26T10:42:54.069 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:54.069 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.070 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:54.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:54.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:42:54.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:54.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:42:54.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:54.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:42:54.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:54.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034482+0000", 2024-04-26T10:42:54.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8630000000000003e-06 2024-04-26T10:42:54.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:54.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034494+0000", 2024-04-26T10:42:54.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-04-26T10:42:54.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034501+0000", 2024-04-26T10:42:54.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7050000000000002e-06 2024-04-26T10:42:54.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:54.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035138+0000", 2024-04-26T10:42:54.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00063744099999999998 2024-04-26T10:42:54.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:54.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035286+0000", 2024-04-26T10:42:54.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014766200000000001 2024-04-26T10:42:54.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:42:54.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035654+0000", 2024-04-26T10:42:54.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00036779100000000002 2024-04-26T10:42:54.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:54.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040833+0000", 2024-04-26T10:42:54.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051795640000000002 2024-04-26T10:42:54.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.042886+0000", 2024-04-26T10:42:54.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020531220000000001 2024-04-26T10:42:54.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:54.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043015+0000", 2024-04-26T10:42:54.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012824099999999999 2024-04-26T10:42:54.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:54.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043075+0000", 2024-04-26T10:42:54.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0262e-05 2024-04-26T10:42:54.074 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.075 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:54.075 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.075 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.075 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:42:54.075 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.954537080000001, 2024-04-26T10:42:54.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01482116, 2024-04-26T10:42:54.075 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:54.075 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.075 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:54.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:54.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:42:54.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:54.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:42:54.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:54.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:42:54.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:54.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034515+0000", 2024-04-26T10:42:54.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.391e-06 2024-04-26T10:42:54.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:54.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034522+0000", 2024-04-26T10:42:54.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7889999999999997e-06 2024-04-26T10:42:54.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034601+0000", 2024-04-26T10:42:54.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9547000000000003e-05 2024-04-26T10:42:54.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:54.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036510+0000", 2024-04-26T10:42:54.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019092289999999999 2024-04-26T10:42:54.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:54.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036642+0000", 2024-04-26T10:42:54.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013151100000000001 2024-04-26T10:42:54.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:54.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036766+0000", 2024-04-26T10:42:54.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012367300000000001 2024-04-26T10:42:54.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:54.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040749+0000", 2024-04-26T10:42:54.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039838419999999996 2024-04-26T10:42:54.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049262+0000", 2024-04-26T10:42:54.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085127789999999998 2024-04-26T10:42:54.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:54.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049301+0000", 2024-04-26T10:42:54.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8834000000000001e-05 2024-04-26T10:42:54.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:54.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049329+0000", 2024-04-26T10:42:54.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.817e-05 2024-04-26T10:42:54.080 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.080 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:54.080 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.081 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.081 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:42:54.081 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.954404383, 2024-04-26T10:42:54.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014796093999999999, 2024-04-26T10:42:54.081 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:54.081 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.081 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:54.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:54.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:42:54.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:54.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:42:54.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:54.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034640+0000", 2024-04-26T10:42:54.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:54.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034650+0000", 2024-04-26T10:42:54.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0064999999999999e-05 2024-04-26T10:42:54.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:54.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034660+0000", 2024-04-26T10:42:54.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.961e-06 2024-04-26T10:42:54.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034680+0000", 2024-04-26T10:42:54.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9219e-05 2024-04-26T10:42:54.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:54.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.037926+0000", 2024-04-26T10:42:54.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032460380000000001 2024-04-26T10:42:54.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:54.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038068+0000", 2024-04-26T10:42:54.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014236000000000001 2024-04-26T10:42:54.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:54.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038201+0000", 2024-04-26T10:42:54.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013345300000000001 2024-04-26T10:42:54.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:54.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043497+0000", 2024-04-26T10:42:54.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052952770000000001 2024-04-26T10:42:54.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049373+0000", 2024-04-26T10:42:54.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058762900000000002 2024-04-26T10:42:54.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:54.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049411+0000", 2024-04-26T10:42:54.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7737000000000001e-05 2024-04-26T10:42:54.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:54.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049437+0000", 2024-04-26T10:42:54.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6169999999999998e-05 2024-04-26T10:42:54.086 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.086 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:54.086 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.086 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.086 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:42:54.086 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.954359873000001, 2024-04-26T10:42:54.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0092140799999999995, 2024-04-26T10:42:54.086 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:54.087 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.087 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:54.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:54.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:42:54.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:54.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:42:54.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:54.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:42:54.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:54.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034688+0000", 2024-04-26T10:42:54.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5480000000000002e-06 2024-04-26T10:42:54.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:54.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034694+0000", 2024-04-26T10:42:54.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1310000000000003e-06 2024-04-26T10:42:54.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034700+0000", 2024-04-26T10:42:54.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4229999999999996e-06 2024-04-26T10:42:54.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:54.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036183+0000", 2024-04-26T10:42:54.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001482964 2024-04-26T10:42:54.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:54.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036297+0000", 2024-04-26T10:42:54.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113649 2024-04-26T10:42:54.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:42:54.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036426+0000", 2024-04-26T10:42:54.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012924900000000001 2024-04-26T10:42:54.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:54.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040839+0000", 2024-04-26T10:42:54.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044137079999999997 2024-04-26T10:42:54.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043679+0000", 2024-04-26T10:42:54.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028397850000000001 2024-04-26T10:42:54.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:54.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043725+0000", 2024-04-26T10:42:54.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5859999999999998e-05 2024-04-26T10:42:54.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:54.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043899+0000", 2024-04-26T10:42:54.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000174267 2024-04-26T10:42:54.091 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.091 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:54.091 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.091 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.091 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:42:54.092 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.954336939000001, 2024-04-26T10:42:54.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011493046999999999, 2024-04-26T10:42:54.092 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:54.092 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.092 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:54.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:54.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:42:54.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:54.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:42:54.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:54.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:42:54.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:54.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034711+0000", 2024-04-26T10:42:54.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4359999999999998e-06 2024-04-26T10:42:54.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:54.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034717+0000", 2024-04-26T10:42:54.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7939999999999999e-06 2024-04-26T10:42:54.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034723+0000", 2024-04-26T10:42:54.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6219999999999997e-06 2024-04-26T10:42:54.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:54.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035221+0000", 2024-04-26T10:42:54.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00049811199999999999 2024-04-26T10:42:54.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.094 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:54.094 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035351+0000", 2024-04-26T10:42:54.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013049200000000001 2024-04-26T10:42:54.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:54.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035467+0000", 2024-04-26T10:42:54.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115364 2024-04-26T10:42:54.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:54.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040085+0000", 2024-04-26T10:42:54.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046182300000000001 2024-04-26T10:42:54.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046133+0000", 2024-04-26T10:42:54.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060476059999999996 2024-04-26T10:42:54.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:54.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046165+0000", 2024-04-26T10:42:54.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2155e-05 2024-04-26T10:42:54.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:54.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046201+0000", 2024-04-26T10:42:54.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6566999999999997e-05 2024-04-26T10:42:54.096 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.096 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:54.096 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.097 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.097 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:42:54.097 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 27.954250529999999, 2024-04-26T10:42:54.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014742026, 2024-04-26T10:42:54.097 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:54.097 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-26T10:42:54.097 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:54.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:54.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:42:54.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:54.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:42:54.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:54.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:54.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034793+0000", 2024-04-26T10:42:54.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-26T10:42:54.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:54.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034802+0000", 2024-04-26T10:42:54.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.551e-06 2024-04-26T10:42:54.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:54.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034815+0000", 2024-04-26T10:42:54.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2706e-05 2024-04-26T10:42:54.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034824+0000", 2024-04-26T10:42:54.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5189999999999998e-06 2024-04-26T10:42:54.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:54.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039312+0000", 2024-04-26T10:42:54.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044874030000000001 2024-04-26T10:42:54.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:54.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039457+0000", 2024-04-26T10:42:54.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000145081 2024-04-26T10:42:54.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:54.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:54.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:54.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049537+0000", 2024-04-26T10:42:54.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010080053 2024-04-26T10:42:54.100 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.100 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:54.100 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.100 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:54.101 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:54.101 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-26T10:42:54.102 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:54.101+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:54.103 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:42:54.106 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:54.108 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:42:54.109 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-26T10:42:53.736560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596004,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":251,"num_write_kb":3479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94988,"kb_used_data":1640,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283020532,"statfs":{"total":289910292480,"available":289813024768,"internally_reserved":0,"allocated":1679360,"data_stored":1342785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3274,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.139258"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652035+0000","last_change":"2024-04-26T10:42:26.045527+0000","last_active":"2024-04-26T10:42:29.652035+0000","last_peered":"2024-04-26T10:42:29.652035+0000","last_clean":"2024-04-26T10:42:29.652035+0000","last_became_active":"2024-04-26T10:42:26.044597+0000","last_became_peered":"2024-04-26T10:42:26.044597+0000","last_unstale":"2024-04-26T10:42:29.652035+0000","last_undegraded":"2024-04-26T10:42:29.652035+0000","last_fullsized":"2024-04-26T10:42:29.652035+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651979+0000","last_change":"2024-04-26T10:42:26.043815+0000","last_active":"2024-04-26T10:42:29.651979+0000","last_peered":"2024-04-26T10:42:29.651979+0000","last_clean":"2024-04-26T10:42:29.651979+0000","last_became_active":"2024-04-26T10:42:26.042757+0000","last_became_peered":"2024-04-26T10:42:26.042757+0000","last_unstale":"2024-04-26T10:42:29.651979+0000","last_undegraded":"2024-04-26T10:42:29.651979+0000","last_fullsized":"2024-04-26T10:42:29.651979+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:27.752674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652112+0000","last_change":"2024-04-26T10:42:26.041030+0000","last_active":"2024-04-26T10:42:29.652112+0000","last_peered":"2024-04-26T10:42:29.652112+0000","last_clean":"2024-04-26T10:42:29.652112+0000","last_became_active":"2024-04-26T10:42:26.039762+0000","last_became_peered":"2024-04-26T10:42:26.039762+0000","last_unstale":"2024-04-26T10:42:29.652112+0000","last_undegraded":"2024-04-26T10:42:29.652112+0000","last_fullsized":"2024-04-26T10:42:29.652112+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652044+0000","last_change":"2024-04-26T10:42:26.044004+0000","last_active":"2024-04-26T10:42:29.652044+0000","last_peered":"2024-04-26T10:42:29.652044+0000","last_clean":"2024-04-26T10:42:29.652044+0000","last_became_active":"2024-04-26T10:42:26.042953+0000","last_became_peered":"2024-04-26T10:42:26.042953+0000","last_unstale":"2024-04-26T10:42:29.652044+0000","last_undegraded":"2024-04-26T10:42:29.652044+0000","last_fullsized":"2024-04-26T10:42:29.652044+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.895922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651873+0000","last_change":"2024-04-26T10:42:26.041191+0000","last_active":"2024-04-26T10:42:29.651873+0000","last_peered":"2024-04-26T10:42:29.651873+0000","last_clean":"2024-04-26T10:42:29.651873+0000","last_became_active":"2024-04-26T10:42:26.040487+0000","last_became_peered":"2024-04-26T10:42:26.040487+0000","last_unstale":"2024-04-26T10:42:29.651873+0000","last_undegraded":"2024-04-26T10:42:29.651873+0000","last_fullsized":"2024-04-26T10:42:29.651873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651921+0000","last_change":"2024-04-26T10:42:26.043542+0000","last_active":"2024-04-26T10:42:29.651921+0000","last_peered":"2024-04-26T10:42:29.651921+0000","last_clean":"2024-04-26T10:42:29.651921+0000","last_became_active":"2024-04-26T10:42:26.042631+0000","last_became_peered":"2024-04-26T10:42:26.042631+0000","last_unstale":"2024-04-26T10:42:29.651921+0000","last_undegraded":"2024-04-26T10:42:29.651921+0000","last_fullsized":"2024-04-26T10:42:29.651921+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:38.272126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651900+0000","last_change":"2024-04-26T10:42:26.042698+0000","last_active":"2024-04-26T10:42:29.651900+0000","last_peered":"2024-04-26T10:42:29.651900+0000","last_clean":"2024-04-26T10:42:29.651900+0000","last_became_active":"2024-04-26T10:42:26.041631+0000","last_became_peered":"2024-04-26T10:42:26.041631+0000","last_unstale":"2024-04-26T10:42:29.651900+0000","last_undegraded":"2024-04-26T10:42:29.651900+0000","last_fullsized":"2024-04-26T10:42:29.651900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:27.752674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651815+0000","last_change":"2024-04-26T10:42:26.045497+0000","last_active":"2024-04-26T10:42:29.651815+0000","last_peered":"2024-04-26T10:42:29.651815+0000","last_clean":"2024-04-26T10:42:29.651815+0000","last_became_active":"2024-04-26T10:42:26.044865+0000","last_became_peered":"2024-04-26T10:42:26.044865+0000","last_unstale":"2024-04-26T10:42:29.651815+0000","last_undegraded":"2024-04-26T10:42:29.651815+0000","last_fullsized":"2024-04-26T10:42:29.651815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:59:04.853293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652300+0000","last_change":"2024-04-26T10:42:26.045893+0000","last_active":"2024-04-26T10:42:29.652300+0000","last_peered":"2024-04-26T10:42:29.652300+0000","last_clean":"2024-04-26T10:42:29.652300+0000","last_became_active":"2024-04-26T10:42:26.045177+0000","last_became_peered":"2024-04-26T10:42:26.045177+0000","last_unstale":"2024-04-26T10:42:29.652300+0000","last_undegraded":"2024-04-26T10:42:29.652300+0000","last_fullsized":"2024-04-26T10:42:29.652300+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651987+0000","last_change":"2024-04-26T10:42:26.044101+0000","last_active":"2024-04-26T10:42:29.651987+0000","last_peered":"2024-04-26T10:42:29.651987+0000","last_clean":"2024-04-26T10:42:29.651987+0000","last_became_active":"2024-04-26T10:42:26.042047+0000","last_became_peered":"2024-04-26T10:42:26.042047+0000","last_unstale":"2024-04-26T10:42:29.651987+0000","last_undegraded":"2024-04-26T10:42:29.651987+0000","last_fullsized":"2024-04-26T10:42:29.651987+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:46.975947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652122+0000","last_change":"2024-04-26T10:42:26.043530+0000","last_active":"2024-04-26T10:42:29.652122+0000","last_peered":"2024-04-26T10:42:29.652122+0000","last_clean":"2024-04-26T10:42:29.652122+0000","last_became_active":"2024-04-26T10:42:26.042301+0000","last_became_peered":"2024-04-26T10:42:26.042301+0000","last_unstale":"2024-04-26T10:42:29.652122+0000","last_undegraded":"2024-04-26T10:42:29.652122+0000","last_fullsized":"2024-04-26T10:42:29.652122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:48.440963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651893+0000","last_change":"2024-04-26T10:42:26.047073+0000","last_active":"2024-04-26T10:42:29.651893+0000","last_peered":"2024-04-26T10:42:29.651893+0000","last_clean":"2024-04-26T10:42:29.651893+0000","last_became_active":"2024-04-26T10:42:26.046384+0000","last_became_peered":"2024-04-26T10:42:26.046384+0000","last_unstale":"2024-04-26T10:42:29.651893+0000","last_undegraded":"2024-04-26T10:42:29.651893+0000","last_fullsized":"2024-04-26T10:42:29.651893+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:23.079349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651854+0000","last_change":"2024-04-26T10:42:26.042607+0000","last_active":"2024-04-26T10:42:29.651854+0000","last_peered":"2024-04-26T10:42:29.651854+0000","last_clean":"2024-04-26T10:42:29.651854+0000","last_became_active":"2024-04-26T10:42:26.041617+0000","last_became_peered":"2024-04-26T10:42:26.041617+0000","last_unstale":"2024-04-26T10:42:29.651854+0000","last_undegraded":"2024-04-26T10:42:29.651854+0000","last_fullsized":"2024-04-26T10:42:29.651854+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651942+0000","last_change":"2024-04-26T10:42:26.040433+0000","last_active":"2024-04-26T10:42:29.651942+0000","last_peered":"2024-04-26T10:42:29.651942+0000","last_clean":"2024-04-26T10:42:29.651942+0000","last_became_active":"2024-04-26T10:42:26.039631+0000","last_became_peered":"2024-04-26T10:42:26.039631+0000","last_unstale":"2024-04-26T10:42:29.651942+0000","last_undegraded":"2024-04-26T10:42:29.651942+0000","last_fullsized":"2024-04-26T10:42:29.651942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651911+0000","last_change":"2024-04-26T10:42:26.040182+0000","last_active":"2024-04-26T10:42:29.651911+0000","last_peered":"2024-04-26T10:42:29.651911+0000","last_clean":"2024-04-26T10:42:29.651911+0000","last_became_active":"2024-04-26T10:42:26.038614+0000","last_became_peered":"2024-04-26T10:42:26.038614+0000","last_unstale":"2024-04-26T10:42:29.651911+0000","last_undegraded":"2024-04-26T10:42:29.651911+0000","last_fullsized":"2024-04-26T10:42:29.651911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651827+0000","last_change":"2024-04-26T10:42:26.045551+0000","last_active":"2024-04-26T10:42:29.651827+0000","last_peered":"2024-04-26T10:42:29.651827+0000","last_clean":"2024-04-26T10:42:29.651827+0000","last_became_active":"2024-04-26T10:42:26.044944+0000","last_became_peered":"2024-04-26T10:42:26.044944+0000","last_unstale":"2024-04-26T10:42:29.651827+0000","last_undegraded":"2024-04-26T10:42:29.651827+0000","last_fullsized":"2024-04-26T10:42:29.651827+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:02.194279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652367+0000","last_change":"2024-04-26T10:42:26.049338+0000","last_active":"2024-04-26T10:42:29.652367+0000","last_peered":"2024-04-26T10:42:29.652367+0000","last_clean":"2024-04-26T10:42:29.652367+0000","last_became_active":"2024-04-26T10:42:26.049014+0000","last_became_peered":"2024-04-26T10:42:26.049014+0000","last_unstale":"2024-04-26T10:42:29.652367+0000","last_undegraded":"2024-04-26T10:42:29.652367+0000","last_fullsized":"2024-04-26T10:42:29.652367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652015+0000","last_change":"2024-04-26T10:42:26.043604+0000","last_active":"2024-04-26T10:42:29.652015+0000","last_peered":"2024-04-26T10:42:29.652015+0000","last_clean":"2024-04-26T10:42:29.652015+0000","last_became_active":"2024-04-26T10:42:26.041224+0000","last_became_peered":"2024-04-26T10:42:26.041224+0000","last_unstale":"2024-04-26T10:42:29.652015+0000","last_undegraded":"2024-04-26T10:42:29.652015+0000","last_fullsized":"2024-04-26T10:42:29.652015+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652233+0000","last_change":"2024-04-26T10:42:26.045031+0000","last_active":"2024-04-26T10:42:29.652233+0000","last_peered":"2024-04-26T10:42:29.652233+0000","last_clean":"2024-04-26T10:42:29.652233+0000","last_became_active":"2024-04-26T10:42:26.044604+0000","last_became_peered":"2024-04-26T10:42:26.044604+0000","last_unstale":"2024-04-26T10:42:29.652233+0000","last_undegraded":"2024-04-26T10:42:29.652233+0000","last_fullsized":"2024-04-26T10:42:29.652233+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652055+0000","last_change":"2024-04-26T10:42:26.043762+0000","last_active":"2024-04-26T10:42:29.652055+0000","last_peered":"2024-04-26T10:42:29.652055+0000","last_clean":"2024-04-26T10:42:29.652055+0000","last_became_active":"2024-04-26T10:42:26.042117+0000","last_became_peered":"2024-04-26T10:42:26.042117+0000","last_unstale":"2024-04-26T10:42:29.652055+0000","last_undegraded":"2024-04-26T10:42:29.652055+0000","last_fullsized":"2024-04-26T10:42:29.652055+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:35.276961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652005+0000","last_change":"2024-04-26T10:42:26.044062+0000","last_active":"2024-04-26T10:42:29.652005+0000","last_peered":"2024-04-26T10:42:29.652005+0000","last_clean":"2024-04-26T10:42:29.652005+0000","last_became_active":"2024-04-26T10:42:26.042378+0000","last_became_peered":"2024-04-26T10:42:26.042378+0000","last_unstale":"2024-04-26T10:42:29.652005+0000","last_undegraded":"2024-04-26T10:42:29.652005+0000","last_fullsized":"2024-04-26T10:42:29.652005+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:24.255706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651810+0000","last_change":"2024-04-26T10:42:26.046353+0000","last_active":"2024-04-26T10:42:29.651810+0000","last_peered":"2024-04-26T10:42:29.651810+0000","last_clean":"2024-04-26T10:42:29.651810+0000","last_became_active":"2024-04-26T10:42:26.045614+0000","last_became_peered":"2024-04-26T10:42:26.045614+0000","last_unstale":"2024-04-26T10:42:29.651810+0000","last_undegraded":"2024-04-26T10:42:29.651810+0000","last_fullsized":"2024-04-26T10:42:29.651810+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:19.601720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652076+0000","last_change":"2024-04-26T10:42:26.045311+0000","last_active":"2024-04-26T10:42:29.652076+0000","last_peered":"2024-04-26T10:42:29.652076+0000","last_clean":"2024-04-26T10:42:29.652076+0000","last_became_active":"2024-04-26T10:42:26.044614+0000","last_became_peered":"2024-04-26T10:42:26.044614+0000","last_unstale":"2024-04-26T10:42:29.652076+0000","last_undegraded":"2024-04-26T10:42:29.652076+0000","last_fullsized":"2024-04-26T10:42:29.652076+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651710+0000","last_change":"2024-04-26T10:42:26.043614+0000","last_active":"2024-04-26T10:42:29.651710+0000","last_peered":"2024-04-26T10:42:29.651710+0000","last_clean":"2024-04-26T10:42:29.651710+0000","last_became_active":"2024-04-26T10:42:26.042629+0000","last_became_peered":"2024-04-26T10:42:26.042629+0000","last_unstale":"2024-04-26T10:42:29.651710+0000","last_undegraded":"2024-04-26T10:42:29.651710+0000","last_fullsized":"2024-04-26T10:42:29.651710+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652044+0000","last_change":"2024-04-26T10:42:26.046876+0000","last_active":"2024-04-26T10:42:29.652044+0000","last_peered":"2024-04-26T10:42:29.652044+0000","last_clean":"2024-04-26T10:42:29.652044+0000","last_became_active":"2024-04-26T10:42:26.046177+0000","last_became_peered":"2024-04-26T10:42:26.046177+0000","last_unstale":"2024-04-26T10:42:29.652044+0000","last_undegraded":"2024-04-26T10:42:29.652044+0000","last_fullsized":"2024-04-26T10:42:29.652044+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:51.567162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652242+0000","last_change":"2024-04-26T10:42:26.044190+0000","last_active":"2024-04-26T10:42:29.652242+0000","last_peered":"2024-04-26T10:42:29.652242+0000","last_clean":"2024-04-26T10:42:29.652242+0000","last_became_active":"2024-04-26T10:42:26.043736+0000","last_became_peered":"2024-04-26T10:42:26.043736+0000","last_unstale":"2024-04-26T10:42:29.652242+0000","last_undegraded":"2024-04-26T10:42:29.652242+0000","last_fullsized":"2024-04-26T10:42:29.652242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652132+0000","last_change":"2024-04-26T10:42:26.041008+0000","last_active":"2024-04-26T10:42:29.652132+0000","last_peered":"2024-04-26T10:42:29.652132+0000","last_clean":"2024-04-26T10:42:29.652132+0000","last_became_active":"2024-04-26T10:42:26.039620+0000","last_became_peered":"2024-04-26T10:42:26.039620+0000","last_unstale":"2024-04-26T10:42:29.652132+0000","last_undegraded":"2024-04-26T10:42:29.652132+0000","last_fullsized":"2024-04-26T10:42:29.652132+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651921+0000","last_change":"2024-04-26T10:42:26.046392+0000","last_active":"2024-04-26T10:42:29.651921+0000","last_peered":"2024-04-26T10:42:29.651921+0000","last_clean":"2024-04-26T10:42:29.651921+0000","last_became_active":"2024-04-26T10:42:26.045806+0000","last_became_peered":"2024-04-26T10:42:26.045806+0000","last_unstale":"2024-04-26T10:42:29.651921+0000","last_undegraded":"2024-04-26T10:42:29.651921+0000","last_fullsized":"2024-04-26T10:42:29.651921+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:15:59.087635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652164+0000","last_change":"2024-04-26T10:42:26.045205+0000","last_active":"2024-04-26T10:42:29.652164+0000","last_peered":"2024-04-26T10:42:29.652164+0000","last_clean":"2024-04-26T10:42:29.652164+0000","last_became_active":"2024-04-26T10:42:26.044762+0000","last_became_peered":"2024-04-26T10:42:26.044762+0000","last_unstale":"2024-04-26T10:42:29.652164+0000","last_undegraded":"2024-04-26T10:42:29.652164+0000","last_fullsized":"2024-04-26T10:42:29.652164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651829+0000","last_change":"2024-04-26T10:42:26.046020+0000","last_active":"2024-04-26T10:42:29.651829+0000","last_peered":"2024-04-26T10:42:29.651829+0000","last_clean":"2024-04-26T10:42:29.651829+0000","last_became_active":"2024-04-26T10:42:26.045567+0000","last_became_peered":"2024-04-26T10:42:26.045567+0000","last_unstale":"2024-04-26T10:42:29.651829+0000","last_undegraded":"2024-04-26T10:42:29.651829+0000","last_fullsized":"2024-04-26T10:42:29.651829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:53.380329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652085+0000","last_change":"2024-04-26T10:42:26.046584+0000","last_active":"2024-04-26T10:42:29.652085+0000","last_peered":"2024-04-26T10:42:29.652085+0000","last_clean":"2024-04-26T10:42:29.652085+0000","last_became_active":"2024-04-26T10:42:26.046231+0000","last_became_peered":"2024-04-26T10:42:26.046231+0000","last_unstale":"2024-04-26T10:42:29.652085+0000","last_undegraded":"2024-04-26T10:42:29.652085+0000","last_fullsized":"2024-04-26T10:42:29.652085+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651835+0000","last_change":"2024-04-26T10:42:26.045270+0000","last_active":"2024-04-26T10:42:29.651835+0000","last_peered":"2024-04-26T10:42:29.651835+0000","last_clean":"2024-04-26T10:42:29.651835+0000","last_became_active":"2024-04-26T10:42:26.044341+0000","last_became_peered":"2024-04-26T10:42:26.044341+0000","last_unstale":"2024-04-26T10:42:29.651835+0000","last_undegraded":"2024-04-26T10:42:29.651835+0000","last_fullsized":"2024-04-26T10:42:29.651835+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:46.975947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651912+0000","last_change":"2024-04-26T10:42:26.041757+0000","last_active":"2024-04-26T10:42:29.651912+0000","last_peered":"2024-04-26T10:42:29.651912+0000","last_clean":"2024-04-26T10:42:29.651912+0000","last_became_active":"2024-04-26T10:42:26.040920+0000","last_became_peered":"2024-04-26T10:42:26.040920+0000","last_unstale":"2024-04-26T10:42:29.651912+0000","last_undegraded":"2024-04-26T10:42:29.651912+0000","last_fullsized":"2024-04-26T10:42:29.651912+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652020+0000","last_change":"2024-04-26T10:42:25.687138+0000","last_active":"2024-04-26T10:42:29.652020+0000","last_peered":"2024-04-26T10:42:29.652020+0000","last_clean":"2024-04-26T10:42:29.652020+0000","last_became_active":"2024-04-26T10:42:25.686488+0000","last_became_peered":"2024-04-26T10:42:25.686488+0000","last_unstale":"2024-04-26T10:42:29.652020+0000","last_undegraded":"2024-04-26T10:42:29.652020+0000","last_fullsized":"2024-04-26T10:42:29.652020+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:43.969731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651943+0000","last_change":"2024-04-26T10:42:26.041850+0000","last_active":"2024-04-26T10:42:29.651943+0000","last_peered":"2024-04-26T10:42:29.651943+0000","last_clean":"2024-04-26T10:42:29.651943+0000","last_became_active":"2024-04-26T10:42:26.040464+0000","last_became_peered":"2024-04-26T10:42:26.040464+0000","last_unstale":"2024-04-26T10:42:29.651943+0000","last_undegraded":"2024-04-26T10:42:29.651943+0000","last_fullsized":"2024-04-26T10:42:29.651943+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652146+0000","last_change":"2024-04-26T10:42:25.685525+0000","last_active":"2024-04-26T10:42:29.652146+0000","last_peered":"2024-04-26T10:42:29.652146+0000","last_clean":"2024-04-26T10:42:29.652146+0000","last_became_active":"2024-04-26T10:42:25.684855+0000","last_became_peered":"2024-04-26T10:42:25.684855+0000","last_unstale":"2024-04-26T10:42:29.652146+0000","last_undegraded":"2024-04-26T10:42:29.652146+0000","last_fullsized":"2024-04-26T10:42:29.652146+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:16.723401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652272+0000","last_change":"2024-04-26T10:42:26.046616+0000","last_active":"2024-04-26T10:42:29.652272+0000","last_peered":"2024-04-26T10:42:29.652272+0000","last_clean":"2024-04-26T10:42:29.652272+0000","last_became_active":"2024-04-26T10:42:26.046010+0000","last_became_peered":"2024-04-26T10:42:26.046010+0000","last_unstale":"2024-04-26T10:42:29.652272+0000","last_undegraded":"2024-04-26T10:42:29.652272+0000","last_fullsized":"2024-04-26T10:42:29.652272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:19.601720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651779+0000","last_change":"2024-04-26T10:42:25.688905+0000","last_active":"2024-04-26T10:42:29.651779+0000","last_peered":"2024-04-26T10:42:29.651779+0000","last_clean":"2024-04-26T10:42:29.651779+0000","last_became_active":"2024-04-26T10:42:25.688504+0000","last_became_peered":"2024-04-26T10:42:25.688504+0000","last_unstale":"2024-04-26T10:42:29.651779+0000","last_undegraded":"2024-04-26T10:42:29.651779+0000","last_fullsized":"2024-04-26T10:42:29.651779+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.930441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652311+0000","last_change":"2024-04-26T10:42:26.046158+0000","last_active":"2024-04-26T10:42:29.652311+0000","last_peered":"2024-04-26T10:42:29.652311+0000","last_clean":"2024-04-26T10:42:29.652311+0000","last_became_active":"2024-04-26T10:42:26.045797+0000","last_became_peered":"2024-04-26T10:42:26.045797+0000","last_unstale":"2024-04-26T10:42:29.652311+0000","last_undegraded":"2024-04-26T10:42:29.652311+0000","last_fullsized":"2024-04-26T10:42:29.652311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:23.079349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651844+0000","last_change":"2024-04-26T10:42:25.687207+0000","last_active":"2024-04-26T10:42:29.651844+0000","last_peered":"2024-04-26T10:42:29.651844+0000","last_clean":"2024-04-26T10:42:29.651844+0000","last_became_active":"2024-04-26T10:42:25.686549+0000","last_became_peered":"2024-04-26T10:42:25.686549+0000","last_unstale":"2024-04-26T10:42:29.651844+0000","last_undegraded":"2024-04-26T10:42:29.651844+0000","last_fullsized":"2024-04-26T10:42:29.651844+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:42.125386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652219+0000","last_change":"2024-04-26T10:42:25.684462+0000","last_active":"2024-04-26T10:42:29.652219+0000","last_peered":"2024-04-26T10:42:29.652219+0000","last_clean":"2024-04-26T10:42:29.652219+0000","last_became_active":"2024-04-26T10:42:25.684162+0000","last_became_peered":"2024-04-26T10:42:25.684162+0000","last_unstale":"2024-04-26T10:42:29.652219+0000","last_undegraded":"2024-04-26T10:42:29.652219+0000","last_fullsized":"2024-04-26T10:42:29.652219+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.850118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651723+0000","last_change":"2024-04-26T10:42:26.048114+0000","last_active":"2024-04-26T10:42:29.651723+0000","last_peered":"2024-04-26T10:42:29.651723+0000","last_clean":"2024-04-26T10:42:29.651723+0000","last_became_active":"2024-04-26T10:42:26.046641+0000","last_became_peered":"2024-04-26T10:42:26.046641+0000","last_unstale":"2024-04-26T10:42:29.651723+0000","last_undegraded":"2024-04-26T10:42:29.651723+0000","last_fullsized":"2024-04-26T10:42:29.651723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:01.056945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652023+0000","last_change":"2024-04-26T10:42:25.688889+0000","last_active":"2024-04-26T10:42:29.652023+0000","last_peered":"2024-04-26T10:42:29.652023+0000","last_clean":"2024-04-26T10:42:29.652023+0000","last_became_active":"2024-04-26T10:42:25.688372+0000","last_became_peered":"2024-04-26T10:42:25.688372+0000","last_unstale":"2024-04-26T10:42:29.652023+0000","last_undegraded":"2024-04-26T10:42:29.652023+0000","last_fullsized":"2024-04-26T10:42:29.652023+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:13.799290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651753+0000","last_change":"2024-04-26T10:42:26.041968+0000","last_active":"2024-04-26T10:42:29.651753+0000","last_peered":"2024-04-26T10:42:29.651753+0000","last_clean":"2024-04-26T10:42:29.651753+0000","last_became_active":"2024-04-26T10:42:26.041070+0000","last_became_peered":"2024-04-26T10:42:26.041070+0000","last_unstale":"2024-04-26T10:42:29.651753+0000","last_undegraded":"2024-04-26T10:42:29.651753+0000","last_fullsized":"2024-04-26T10:42:29.651753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652175+0000","last_change":"2024-04-26T10:42:25.684653+0000","last_active":"2024-04-26T10:42:29.652175+0000","last_peered":"2024-04-26T10:42:29.652175+0000","last_clean":"2024-04-26T10:42:29.652175+0000","last_became_active":"2024-04-26T10:42:25.684338+0000","last_became_peered":"2024-04-26T10:42:25.684338+0000","last_unstale":"2024-04-26T10:42:29.652175+0000","last_undegraded":"2024-04-26T10:42:29.652175+0000","last_fullsized":"2024-04-26T10:42:29.652175+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:10.694039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651951+0000","last_change":"2024-04-26T10:42:26.042182+0000","last_active":"2024-04-26T10:42:29.651951+0000","last_peered":"2024-04-26T10:42:29.651951+0000","last_clean":"2024-04-26T10:42:29.651951+0000","last_became_active":"2024-04-26T10:42:26.041689+0000","last_became_peered":"2024-04-26T10:42:26.041689+0000","last_unstale":"2024-04-26T10:42:29.651951+0000","last_undegraded":"2024-04-26T10:42:29.651951+0000","last_fullsized":"2024-04-26T10:42:29.651951+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:32:19.618648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652102+0000","last_change":"2024-04-26T10:42:25.686677+0000","last_active":"2024-04-26T10:42:29.652102+0000","last_peered":"2024-04-26T10:42:29.652102+0000","last_clean":"2024-04-26T10:42:29.652102+0000","last_became_active":"2024-04-26T10:42:25.685939+0000","last_became_peered":"2024-04-26T10:42:25.685939+0000","last_unstale":"2024-04-26T10:42:29.652102+0000","last_undegraded":"2024-04-26T10:42:29.652102+0000","last_fullsized":"2024-04-26T10:42:29.652102+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:30.225098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652173+0000","last_change":"2024-04-26T10:42:26.045829+0000","last_active":"2024-04-26T10:42:29.652173+0000","last_peered":"2024-04-26T10:42:29.652173+0000","last_clean":"2024-04-26T10:42:29.652173+0000","last_became_active":"2024-04-26T10:42:26.045499+0000","last_became_peered":"2024-04-26T10:42:26.045499+0000","last_unstale":"2024-04-26T10:42:29.652173+0000","last_undegraded":"2024-04-26T10:42:29.652173+0000","last_fullsized":"2024-04-26T10:42:29.652173+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:14.041039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652184+0000","last_change":"2024-04-26T10:42:25.687934+0000","last_active":"2024-04-26T10:42:29.652184+0000","last_peered":"2024-04-26T10:42:29.652184+0000","last_clean":"2024-04-26T10:42:29.652184+0000","last_became_active":"2024-04-26T10:42:25.687447+0000","last_became_peered":"2024-04-26T10:42:25.687447+0000","last_unstale":"2024-04-26T10:42:29.652184+0000","last_undegraded":"2024-04-26T10:42:29.652184+0000","last_fullsized":"2024-04-26T10:42:29.652184+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.930441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652064+0000","last_change":"2024-04-26T10:42:26.043638+0000","last_active":"2024-04-26T10:42:29.652064+0000","last_peered":"2024-04-26T10:42:29.652064+0000","last_clean":"2024-04-26T10:42:29.652064+0000","last_became_active":"2024-04-26T10:42:26.042692+0000","last_became_peered":"2024-04-26T10:42:26.042692+0000","last_unstale":"2024-04-26T10:42:29.652064+0000","last_undegraded":"2024-04-26T10:42:29.652064+0000","last_fullsized":"2024-04-26T10:42:29.652064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651970+0000","last_change":"2024-04-26T10:42:25.687283+0000","last_active":"2024-04-26T10:42:29.651970+0000","last_peered":"2024-04-26T10:42:29.651970+0000","last_clean":"2024-04-26T10:42:29.651970+0000","last_became_active":"2024-04-26T10:42:25.686251+0000","last_became_peered":"2024-04-26T10:42:25.686251+0000","last_unstale":"2024-04-26T10:42:29.651970+0000","last_undegraded":"2024-04-26T10:42:29.651970+0000","last_fullsized":"2024-04-26T10:42:29.651970+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:16.723401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652141+0000","last_change":"2024-04-26T10:42:26.040688+0000","last_active":"2024-04-26T10:42:29.652141+0000","last_peered":"2024-04-26T10:42:29.652141+0000","last_clean":"2024-04-26T10:42:29.652141+0000","last_became_active":"2024-04-26T10:42:26.039133+0000","last_became_peered":"2024-04-26T10:42:26.039133+0000","last_unstale":"2024-04-26T10:42:29.652141+0000","last_undegraded":"2024-04-26T10:42:29.652141+0000","last_fullsized":"2024-04-26T10:42:29.652141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651787+0000","last_change":"2024-04-26T10:42:25.688837+0000","last_active":"2024-04-26T10:42:29.651787+0000","last_peered":"2024-04-26T10:42:29.651787+0000","last_clean":"2024-04-26T10:42:29.651787+0000","last_became_active":"2024-04-26T10:42:25.688450+0000","last_became_peered":"2024-04-26T10:42:25.688450+0000","last_unstale":"2024-04-26T10:42:29.651787+0000","last_undegraded":"2024-04-26T10:42:29.651787+0000","last_fullsized":"2024-04-26T10:42:29.651787+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:26.788267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652199+0000","last_change":"2024-04-26T10:42:26.039661+0000","last_active":"2024-04-26T10:42:29.652199+0000","last_peered":"2024-04-26T10:42:29.652199+0000","last_clean":"2024-04-26T10:42:29.652199+0000","last_became_active":"2024-04-26T10:42:26.038664+0000","last_became_peered":"2024-04-26T10:42:26.038664+0000","last_unstale":"2024-04-26T10:42:29.652199+0000","last_undegraded":"2024-04-26T10:42:29.652199+0000","last_fullsized":"2024-04-26T10:42:29.652199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651732+0000","last_change":"2024-04-26T10:42:25.687082+0000","last_active":"2024-04-26T10:42:29.651732+0000","last_peered":"2024-04-26T10:42:29.651732+0000","last_clean":"2024-04-26T10:42:29.651732+0000","last_became_active":"2024-04-26T10:42:25.686779+0000","last_became_peered":"2024-04-26T10:42:25.686779+0000","last_unstale":"2024-04-26T10:42:29.651732+0000","last_undegraded":"2024-04-26T10:42:29.651732+0000","last_fullsized":"2024-04-26T10:42:29.651732+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:12.284219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652320+0000","last_change":"2024-04-26T10:42:26.047130+0000","last_active":"2024-04-26T10:42:29.652320+0000","last_peered":"2024-04-26T10:42:29.652320+0000","last_clean":"2024-04-26T10:42:29.652320+0000","last_became_active":"2024-04-26T10:42:26.046884+0000","last_became_peered":"2024-04-26T10:42:26.046884+0000","last_unstale":"2024-04-26T10:42:29.652320+0000","last_undegraded":"2024-04-26T10:42:29.652320+0000","last_fullsized":"2024-04-26T10:42:29.652320+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:31.020364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":211,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033391+0000","last_change":"2024-04-26T10:42:21.406599+0000","last_active":"2024-04-26T10:42:27.033391+0000","last_peered":"2024-04-26T10:42:27.033391+0000","last_clean":"2024-04-26T10:42:27.033391+0000","last_became_active":"2024-04-26T10:42:21.405587+0000","last_became_peered":"2024-04-26T10:42:21.405587+0000","last_unstale":"2024-04-26T10:42:27.033391+0000","last_undegraded":"2024-04-26T10:42:27.033391+0000","last_fullsized":"2024-04-26T10:42:27.033391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:44.561530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033986+0000","last_change":"2024-04-26T10:42:21.405305+0000","last_active":"2024-04-26T10:42:27.033986+0000","last_peered":"2024-04-26T10:42:27.033986+0000","last_clean":"2024-04-26T10:42:27.033986+0000","last_became_active":"2024-04-26T10:42:21.405032+0000","last_became_peered":"2024-04-26T10:42:21.405032+0000","last_unstale":"2024-04-26T10:42:27.033986+0000","last_undegraded":"2024-04-26T10:42:27.033986+0000","last_fullsized":"2024-04-26T10:42:27.033986+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652154+0000","last_change":"2024-04-26T10:42:25.686765+0000","last_active":"2024-04-26T10:42:29.652154+0000","last_peered":"2024-04-26T10:42:29.652154+0000","last_clean":"2024-04-26T10:42:29.652154+0000","last_became_active":"2024-04-26T10:42:25.686009+0000","last_became_peered":"2024-04-26T10:42:25.686009+0000","last_unstale":"2024-04-26T10:42:29.652154+0000","last_undegraded":"2024-04-26T10:42:29.652154+0000","last_fullsized":"2024-04-26T10:42:29.652154+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:54.627815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652165+0000","last_change":"2024-04-26T10:42:26.040215+0000","last_active":"2024-04-26T10:42:29.652165+0000","last_peered":"2024-04-26T10:42:29.652165+0000","last_clean":"2024-04-26T10:42:29.652165+0000","last_became_active":"2024-04-26T10:42:26.039129+0000","last_became_peered":"2024-04-26T10:42:26.039129+0000","last_unstale":"2024-04-26T10:42:29.652165+0000","last_undegraded":"2024-04-26T10:42:29.652165+0000","last_fullsized":"2024-04-26T10:42:29.652165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033051+0000","last_change":"2024-04-26T10:42:21.406881+0000","last_active":"2024-04-26T10:42:27.033051+0000","last_peered":"2024-04-26T10:42:27.033051+0000","last_clean":"2024-04-26T10:42:27.033051+0000","last_became_active":"2024-04-26T10:42:21.406634+0000","last_became_peered":"2024-04-26T10:42:21.406634+0000","last_unstale":"2024-04-26T10:42:27.033051+0000","last_undegraded":"2024-04-26T10:42:27.033051+0000","last_fullsized":"2024-04-26T10:42:27.033051+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:45.892841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652119+0000","last_change":"2024-04-26T10:42:25.687986+0000","last_active":"2024-04-26T10:42:29.652119+0000","last_peered":"2024-04-26T10:42:29.652119+0000","last_clean":"2024-04-26T10:42:29.652119+0000","last_became_active":"2024-04-26T10:42:25.687201+0000","last_became_peered":"2024-04-26T10:42:25.687201+0000","last_unstale":"2024-04-26T10:42:29.652119+0000","last_undegraded":"2024-04-26T10:42:29.652119+0000","last_fullsized":"2024-04-26T10:42:29.652119+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:35.867262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651998+0000","last_change":"2024-04-26T10:42:26.043723+0000","last_active":"2024-04-26T10:42:29.651998+0000","last_peered":"2024-04-26T10:42:29.651998+0000","last_clean":"2024-04-26T10:42:29.651998+0000","last_became_active":"2024-04-26T10:42:26.041814+0000","last_became_peered":"2024-04-26T10:42:26.041814+0000","last_unstale":"2024-04-26T10:42:29.651998+0000","last_undegraded":"2024-04-26T10:42:29.651998+0000","last_fullsized":"2024-04-26T10:42:29.651998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033479+0000","last_change":"2024-04-26T10:42:21.405597+0000","last_active":"2024-04-26T10:42:27.033479+0000","last_peered":"2024-04-26T10:42:27.033479+0000","last_clean":"2024-04-26T10:42:27.033479+0000","last_became_active":"2024-04-26T10:42:21.405117+0000","last_became_peered":"2024-04-26T10:42:21.405117+0000","last_unstale":"2024-04-26T10:42:27.033479+0000","last_undegraded":"2024-04-26T10:42:27.033479+0000","last_fullsized":"2024-04-26T10:42:27.033479+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651741+0000","last_change":"2024-04-26T10:42:25.688955+0000","last_active":"2024-04-26T10:42:29.651741+0000","last_peered":"2024-04-26T10:42:29.651741+0000","last_clean":"2024-04-26T10:42:29.651741+0000","last_became_active":"2024-04-26T10:42:25.688552+0000","last_became_peered":"2024-04-26T10:42:25.688552+0000","last_unstale":"2024-04-26T10:42:29.651741+0000","last_undegraded":"2024-04-26T10:42:29.651741+0000","last_fullsized":"2024-04-26T10:42:29.651741+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:04.963775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652331+0000","last_change":"2024-04-26T10:42:26.049311+0000","last_active":"2024-04-26T10:42:29.652331+0000","last_peered":"2024-04-26T10:42:29.652331+0000","last_clean":"2024-04-26T10:42:29.652331+0000","last_became_active":"2024-04-26T10:42:26.048915+0000","last_became_peered":"2024-04-26T10:42:26.048915+0000","last_unstale":"2024-04-26T10:42:29.652331+0000","last_undegraded":"2024-04-26T10:42:29.652331+0000","last_fullsized":"2024-04-26T10:42:29.652331+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:01.056945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033740+0000","last_change":"2024-04-26T10:42:21.405298+0000","last_active":"2024-04-26T10:42:27.033740+0000","last_peered":"2024-04-26T10:42:27.033740+0000","last_clean":"2024-04-26T10:42:27.033740+0000","last_became_active":"2024-04-26T10:42:21.405011+0000","last_became_peered":"2024-04-26T10:42:21.405011+0000","last_unstale":"2024-04-26T10:42:27.033740+0000","last_undegraded":"2024-04-26T10:42:27.033740+0000","last_fullsized":"2024-04-26T10:42:27.033740+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:47.789961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652031+0000","last_change":"2024-04-26T10:42:25.686177+0000","last_active":"2024-04-26T10:42:29.652031+0000","last_peered":"2024-04-26T10:42:29.652031+0000","last_clean":"2024-04-26T10:42:29.652031+0000","last_became_active":"2024-04-26T10:42:25.685121+0000","last_became_peered":"2024-04-26T10:42:25.685121+0000","last_unstale":"2024-04-26T10:42:29.652031+0000","last_undegraded":"2024-04-26T10:42:29.652031+0000","last_fullsized":"2024-04-26T10:42:29.652031+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:34.398138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652200+0000","last_change":"2024-04-26T10:42:26.045312+0000","last_active":"2024-04-26T10:42:29.652200+0000","last_peered":"2024-04-26T10:42:29.652200+0000","last_clean":"2024-04-26T10:42:29.652200+0000","last_became_active":"2024-04-26T10:42:26.044619+0000","last_became_peered":"2024-04-26T10:42:26.044619+0000","last_unstale":"2024-04-26T10:42:29.652200+0000","last_undegraded":"2024-04-26T10:42:29.652200+0000","last_fullsized":"2024-04-26T10:42:29.652200+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:50.646374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652189+0000","last_change":"2024-04-26T10:42:25.686310+0000","last_active":"2024-04-26T10:42:29.652189+0000","last_peered":"2024-04-26T10:42:29.652189+0000","last_clean":"2024-04-26T10:42:29.652189+0000","last_became_active":"2024-04-26T10:42:25.685767+0000","last_became_peered":"2024-04-26T10:42:25.685767+0000","last_unstale":"2024-04-26T10:42:29.652189+0000","last_undegraded":"2024-04-26T10:42:29.652189+0000","last_fullsized":"2024-04-26T10:42:29.652189+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:02.874807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033723+0000","last_change":"2024-04-26T10:42:21.405754+0000","last_active":"2024-04-26T10:42:27.033723+0000","last_peered":"2024-04-26T10:42:27.033723+0000","last_clean":"2024-04-26T10:42:27.033723+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:42:27.033723+0000","last_undegraded":"2024-04-26T10:42:27.033723+0000","last_fullsized":"2024-04-26T10:42:27.033723+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:47.123256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651818+0000","last_change":"2024-04-26T10:42:26.043764+0000","last_active":"2024-04-26T10:42:29.651818+0000","last_peered":"2024-04-26T10:42:29.651818+0000","last_clean":"2024-04-26T10:42:29.651818+0000","last_became_active":"2024-04-26T10:42:26.043388+0000","last_became_peered":"2024-04-26T10:42:26.043388+0000","last_unstale":"2024-04-26T10:42:29.651818+0000","last_undegraded":"2024-04-26T10:42:29.651818+0000","last_fullsized":"2024-04-26T10:42:29.651818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:31.020364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652208+0000","last_change":"2024-04-26T10:42:25.685368+0000","last_active":"2024-04-26T10:42:29.652208+0000","last_peered":"2024-04-26T10:42:29.652208+0000","last_clean":"2024-04-26T10:42:29.652208+0000","last_became_active":"2024-04-26T10:42:25.684379+0000","last_became_peered":"2024-04-26T10:42:25.684379+0000","last_unstale":"2024-04-26T10:42:29.652208+0000","last_undegraded":"2024-04-26T10:42:29.652208+0000","last_fullsized":"2024-04-26T10:42:29.652208+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:34.398138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033992+0000","last_change":"2024-04-26T10:42:21.405356+0000","last_active":"2024-04-26T10:42:27.033992+0000","last_peered":"2024-04-26T10:42:27.033992+0000","last_clean":"2024-04-26T10:42:27.033992+0000","last_became_active":"2024-04-26T10:42:21.405006+0000","last_became_peered":"2024-04-26T10:42:21.405006+0000","last_unstale":"2024-04-26T10:42:27.033992+0000","last_undegraded":"2024-04-26T10:42:27.033992+0000","last_fullsized":"2024-04-26T10:42:27.033992+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:55.043967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651864+0000","last_change":"2024-04-26T10:42:26.042954+0000","last_active":"2024-04-26T10:42:29.651864+0000","last_peered":"2024-04-26T10:42:29.651864+0000","last_clean":"2024-04-26T10:42:29.651864+0000","last_became_active":"2024-04-26T10:42:26.042544+0000","last_became_peered":"2024-04-26T10:42:26.042544+0000","last_unstale":"2024-04-26T10:42:29.651864+0000","last_undegraded":"2024-04-26T10:42:29.651864+0000","last_fullsized":"2024-04-26T10:42:29.651864+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:14.041039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652378+0000","last_change":"2024-04-26T10:42:25.687201+0000","last_active":"2024-04-26T10:42:29.652378+0000","last_peered":"2024-04-26T10:42:29.652378+0000","last_clean":"2024-04-26T10:42:29.652378+0000","last_became_active":"2024-04-26T10:42:25.686641+0000","last_became_peered":"2024-04-26T10:42:25.686641+0000","last_unstale":"2024-04-26T10:42:29.652378+0000","last_undegraded":"2024-04-26T10:42:29.652378+0000","last_fullsized":"2024-04-26T10:42:29.652378+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:30.225098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033887+0000","last_change":"2024-04-26T10:42:21.405615+0000","last_active":"2024-04-26T10:42:27.033887+0000","last_peered":"2024-04-26T10:42:27.033887+0000","last_clean":"2024-04-26T10:42:27.033887+0000","last_became_active":"2024-04-26T10:42:21.405184+0000","last_became_peered":"2024-04-26T10:42:21.405184+0000","last_unstale":"2024-04-26T10:42:27.033887+0000","last_undegraded":"2024-04-26T10:42:27.033887+0000","last_fullsized":"2024-04-26T10:42:27.033887+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:52.378909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652056+0000","last_change":"2024-04-26T10:42:26.046832+0000","last_active":"2024-04-26T10:42:29.652056+0000","last_peered":"2024-04-26T10:42:29.652056+0000","last_clean":"2024-04-26T10:42:29.652056+0000","last_became_active":"2024-04-26T10:42:26.046484+0000","last_became_peered":"2024-04-26T10:42:26.046484+0000","last_unstale":"2024-04-26T10:42:29.652056+0000","last_undegraded":"2024-04-26T10:42:29.652056+0000","last_fullsized":"2024-04-26T10:42:29.652056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:28.856785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:31.500548+0000","last_change":"2024-04-26T10:42:25.686262+0000","last_active":"2024-04-26T10:42:31.500548+0000","last_peered":"2024-04-26T10:42:31.500548+0000","last_clean":"2024-04-26T10:42:31.500548+0000","last_became_active":"2024-04-26T10:42:25.685528+0000","last_became_peered":"2024-04-26T10:42:25.685528+0000","last_unstale":"2024-04-26T10:42:31.500548+0000","last_undegraded":"2024-04-26T10:42:31.500548+0000","last_fullsized":"2024-04-26T10:42:31.500548+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:47.138273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033773+0000","last_change":"2024-04-26T10:42:21.405863+0000","last_active":"2024-04-26T10:42:27.033773+0000","last_peered":"2024-04-26T10:42:27.033773+0000","last_clean":"2024-04-26T10:42:27.033773+0000","last_became_active":"2024-04-26T10:42:21.405555+0000","last_became_peered":"2024-04-26T10:42:21.405555+0000","last_unstale":"2024-04-26T10:42:27.033773+0000","last_undegraded":"2024-04-26T10:42:27.033773+0000","last_fullsized":"2024-04-26T10:42:27.033773+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:39.259618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651769+0000","last_change":"2024-04-26T10:42:26.044818+0000","last_active":"2024-04-26T10:42:29.651769+0000","last_peered":"2024-04-26T10:42:29.651769+0000","last_clean":"2024-04-26T10:42:29.651769+0000","last_became_active":"2024-04-26T10:42:26.043969+0000","last_became_peered":"2024-04-26T10:42:26.043969+0000","last_unstale":"2024-04-26T10:42:29.651769+0000","last_undegraded":"2024-04-26T10:42:29.651769+0000","last_fullsized":"2024-04-26T10:42:29.651769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:50.646374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651994+0000","last_change":"2024-04-26T10:42:26.040224+0000","last_active":"2024-04-26T10:42:29.651994+0000","last_peered":"2024-04-26T10:42:29.651994+0000","last_clean":"2024-04-26T10:42:29.651994+0000","last_became_active":"2024-04-26T10:42:26.038590+0000","last_became_peered":"2024-04-26T10:42:26.038590+0000","last_unstale":"2024-04-26T10:42:29.651994+0000","last_undegraded":"2024-04-26T10:42:29.651994+0000","last_fullsized":"2024-04-26T10:42:29.651994+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'9","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T10:42:47.610009+0000","last_change":"2024-04-26T10:42:25.684447+0000","last_active":"2024-04-26T10:42:47.610009+0000","last_peered":"2024-04-26T10:42:47.610009+0000","last_clean":"2024-04-26T10:42:47.610009+0000","last_became_active":"2024-04-26T10:42:25.684147+0000","last_became_peered":"2024-04-26T10:42:25.684147+0000","last_unstale":"2024-04-26T10:42:47.610009+0000","last_undegraded":"2024-04-26T10:42:47.610009+0000","last_fullsized":"2024-04-26T10:42:47.610009+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:38.873282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4838,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652135+0000","last_change":"2024-04-26T10:42:26.045459+0000","last_active":"2024-04-26T10:42:29.652135+0000","last_peered":"2024-04-26T10:42:29.652135+0000","last_clean":"2024-04-26T10:42:29.652135+0000","last_became_active":"2024-04-26T10:42:26.044972+0000","last_became_peered":"2024-04-26T10:42:26.044972+0000","last_unstale":"2024-04-26T10:42:29.652135+0000","last_undegraded":"2024-04-26T10:42:29.652135+0000","last_fullsized":"2024-04-26T10:42:29.652135+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651963+0000","last_change":"2024-04-26T10:42:25.687956+0000","last_active":"2024-04-26T10:42:29.651963+0000","last_peered":"2024-04-26T10:42:29.651963+0000","last_clean":"2024-04-26T10:42:29.651963+0000","last_became_active":"2024-04-26T10:42:25.687533+0000","last_became_peered":"2024-04-26T10:42:25.687533+0000","last_unstale":"2024-04-26T10:42:29.651963+0000","last_undegraded":"2024-04-26T10:42:29.651963+0000","last_fullsized":"2024-04-26T10:42:29.651963+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:28.506897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652209+0000","last_change":"2024-04-26T10:42:25.685829+0000","last_active":"2024-04-26T10:42:29.652209+0000","last_peered":"2024-04-26T10:42:29.652209+0000","last_clean":"2024-04-26T10:42:29.652209+0000","last_became_active":"2024-04-26T10:42:25.685307+0000","last_became_peered":"2024-04-26T10:42:25.685307+0000","last_unstale":"2024-04-26T10:42:29.652209+0000","last_undegraded":"2024-04-26T10:42:29.652209+0000","last_fullsized":"2024-04-26T10:42:29.652209+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652094+0000","last_change":"2024-04-26T10:42:26.046196+0000","last_active":"2024-04-26T10:42:29.652094+0000","last_peered":"2024-04-26T10:42:29.652094+0000","last_clean":"2024-04-26T10:42:29.652094+0000","last_became_active":"2024-04-26T10:42:26.045762+0000","last_became_peered":"2024-04-26T10:42:26.045762+0000","last_unstale":"2024-04-26T10:42:29.652094+0000","last_undegraded":"2024-04-26T10:42:29.652094+0000","last_fullsized":"2024-04-26T10:42:29.652094+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652351+0000","last_change":"2024-04-26T10:42:25.685990+0000","last_active":"2024-04-26T10:42:29.652351+0000","last_peered":"2024-04-26T10:42:29.652351+0000","last_clean":"2024-04-26T10:42:29.652351+0000","last_became_active":"2024-04-26T10:42:25.684604+0000","last_became_peered":"2024-04-26T10:42:25.684604+0000","last_unstale":"2024-04-26T10:42:29.652351+0000","last_undegraded":"2024-04-26T10:42:29.652351+0000","last_fullsized":"2024-04-26T10:42:29.652351+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:02.874807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652032+0000","last_change":"2024-04-26T10:42:26.038545+0000","last_active":"2024-04-26T10:42:29.652032+0000","last_peered":"2024-04-26T10:42:29.652032+0000","last_clean":"2024-04-26T10:42:29.652032+0000","last_became_active":"2024-04-26T10:42:26.038099+0000","last_became_peered":"2024-04-26T10:42:26.038099+0000","last_unstale":"2024-04-26T10:42:29.652032+0000","last_undegraded":"2024-04-26T10:42:29.652032+0000","last_fullsized":"2024-04-26T10:42:29.652032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652053+0000","last_change":"2024-04-26T10:42:26.046506+0000","last_active":"2024-04-26T10:42:29.652053+0000","last_peered":"2024-04-26T10:42:29.652053+0000","last_clean":"2024-04-26T10:42:29.652053+0000","last_became_active":"2024-04-26T10:42:26.045904+0000","last_became_peered":"2024-04-26T10:42:26.045904+0000","last_unstale":"2024-04-26T10:42:29.652053+0000","last_undegraded":"2024-04-26T10:42:29.652053+0000","last_fullsized":"2024-04-26T10:42:29.652053+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:49.854080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652067+0000","last_change":"2024-04-26T10:42:25.683890+0000","last_active":"2024-04-26T10:42:29.652067+0000","last_peered":"2024-04-26T10:42:29.652067+0000","last_clean":"2024-04-26T10:42:29.652067+0000","last_became_active":"2024-04-26T10:42:25.683467+0000","last_became_peered":"2024-04-26T10:42:25.683467+0000","last_unstale":"2024-04-26T10:42:29.652067+0000","last_undegraded":"2024-04-26T10:42:29.652067+0000","last_fullsized":"2024-04-26T10:42:29.652067+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652251+0000","last_change":"2024-04-26T10:42:26.046384+0000","last_active":"2024-04-26T10:42:29.652251+0000","last_peered":"2024-04-26T10:42:29.652251+0000","last_clean":"2024-04-26T10:42:29.652251+0000","last_became_active":"2024-04-26T10:42:26.045860+0000","last_became_peered":"2024-04-26T10:42:26.045860+0000","last_unstale":"2024-04-26T10:42:29.652251+0000","last_undegraded":"2024-04-26T10:42:29.652251+0000","last_fullsized":"2024-04-26T10:42:29.652251+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652103+0000","last_change":"2024-04-26T10:42:25.686972+0000","last_active":"2024-04-26T10:42:29.652103+0000","last_peered":"2024-04-26T10:42:29.652103+0000","last_clean":"2024-04-26T10:42:29.652103+0000","last_became_active":"2024-04-26T10:42:25.685903+0000","last_became_peered":"2024-04-26T10:42:25.685903+0000","last_unstale":"2024-04-26T10:42:29.652103+0000","last_undegraded":"2024-04-26T10:42:29.652103+0000","last_fullsized":"2024-04-26T10:42:29.652103+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:43.969731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651936+0000","last_change":"2024-04-26T10:42:26.046515+0000","last_active":"2024-04-26T10:42:29.651936+0000","last_peered":"2024-04-26T10:42:29.651936+0000","last_clean":"2024-04-26T10:42:29.651936+0000","last_became_active":"2024-04-26T10:42:26.045798+0000","last_became_peered":"2024-04-26T10:42:26.045798+0000","last_unstale":"2024-04-26T10:42:29.651936+0000","last_undegraded":"2024-04-26T10:42:29.651936+0000","last_fullsized":"2024-04-26T10:42:29.651936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:28.856785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651838+0000","last_change":"2024-04-26T10:42:25.688221+0000","last_active":"2024-04-26T10:42:29.651838+0000","last_peered":"2024-04-26T10:42:29.651838+0000","last_clean":"2024-04-26T10:42:29.651838+0000","last_became_active":"2024-04-26T10:42:25.687829+0000","last_became_peered":"2024-04-26T10:42:25.687829+0000","last_unstale":"2024-04-26T10:42:29.651838+0000","last_undegraded":"2024-04-26T10:42:29.651838+0000","last_fullsized":"2024-04-26T10:42:29.651838+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:05.939715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651903+0000","last_change":"2024-04-26T10:42:26.042723+0000","last_active":"2024-04-26T10:42:29.651903+0000","last_peered":"2024-04-26T10:42:29.651903+0000","last_clean":"2024-04-26T10:42:29.651903+0000","last_became_active":"2024-04-26T10:42:26.041852+0000","last_became_peered":"2024-04-26T10:42:26.041852+0000","last_unstale":"2024-04-26T10:42:29.651903+0000","last_undegraded":"2024-04-26T10:42:29.651903+0000","last_fullsized":"2024-04-26T10:42:29.651903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651882+0000","last_change":"2024-04-26T10:42:25.688815+0000","last_active":"2024-04-26T10:42:29.651882+0000","last_peered":"2024-04-26T10:42:29.651882+0000","last_clean":"2024-04-26T10:42:29.651882+0000","last_became_active":"2024-04-26T10:42:25.688451+0000","last_became_peered":"2024-04-26T10:42:25.688451+0000","last_unstale":"2024-04-26T10:42:29.651882+0000","last_undegraded":"2024-04-26T10:42:29.651882+0000","last_fullsized":"2024-04-26T10:42:29.651882+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:17.143923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651984+0000","last_change":"2024-04-26T10:42:26.044040+0000","last_active":"2024-04-26T10:42:29.651984+0000","last_peered":"2024-04-26T10:42:29.651984+0000","last_clean":"2024-04-26T10:42:29.651984+0000","last_became_active":"2024-04-26T10:42:26.042629+0000","last_became_peered":"2024-04-26T10:42:26.042629+0000","last_unstale":"2024-04-26T10:42:29.651984+0000","last_undegraded":"2024-04-26T10:42:29.651984+0000","last_fullsized":"2024-04-26T10:42:29.651984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:23:05.308070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652076+0000","last_change":"2024-04-26T10:42:25.686442+0000","last_active":"2024-04-26T10:42:29.652076+0000","last_peered":"2024-04-26T10:42:29.652076+0000","last_clean":"2024-04-26T10:42:29.652076+0000","last_became_active":"2024-04-26T10:42:25.686029+0000","last_became_peered":"2024-04-26T10:42:25.686029+0000","last_unstale":"2024-04-26T10:42:29.652076+0000","last_undegraded":"2024-04-26T10:42:29.652076+0000","last_fullsized":"2024-04-26T10:42:29.652076+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:04.241132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651962+0000","last_change":"2024-04-26T10:42:26.042561+0000","last_active":"2024-04-26T10:42:29.651962+0000","last_peered":"2024-04-26T10:42:29.651962+0000","last_clean":"2024-04-26T10:42:29.651962+0000","last_became_active":"2024-04-26T10:42:26.041751+0000","last_became_peered":"2024-04-26T10:42:26.041751+0000","last_unstale":"2024-04-26T10:42:29.651962+0000","last_undegraded":"2024-04-26T10:42:29.651962+0000","last_fullsized":"2024-04-26T10:42:29.651962+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651952+0000","last_change":"2024-04-26T10:42:25.687977+0000","last_active":"2024-04-26T10:42:29.651952+0000","last_peered":"2024-04-26T10:42:29.651952+0000","last_clean":"2024-04-26T10:42:29.651952+0000","last_became_active":"2024-04-26T10:42:25.687402+0000","last_became_peered":"2024-04-26T10:42:25.687402+0000","last_unstale":"2024-04-26T10:42:29.651952+0000","last_undegraded":"2024-04-26T10:42:29.651952+0000","last_fullsized":"2024-04-26T10:42:29.651952+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:35.867262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651798+0000","last_change":"2024-04-26T10:42:26.041729+0000","last_active":"2024-04-26T10:42:29.651798+0000","last_peered":"2024-04-26T10:42:29.651798+0000","last_clean":"2024-04-26T10:42:29.651798+0000","last_became_active":"2024-04-26T10:42:26.040504+0000","last_became_peered":"2024-04-26T10:42:26.040504+0000","last_unstale":"2024-04-26T10:42:29.651798+0000","last_undegraded":"2024-04-26T10:42:29.651798+0000","last_fullsized":"2024-04-26T10:42:29.651798+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652261+0000","last_change":"2024-04-26T10:42:25.686861+0000","last_active":"2024-04-26T10:42:29.652261+0000","last_peered":"2024-04-26T10:42:29.652261+0000","last_clean":"2024-04-26T10:42:29.652261+0000","last_became_active":"2024-04-26T10:42:25.686149+0000","last_became_peered":"2024-04-26T10:42:25.686149+0000","last_unstale":"2024-04-26T10:42:29.652261+0000","last_undegraded":"2024-04-26T10:42:29.652261+0000","last_fullsized":"2024-04-26T10:42:29.652261+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:42.125386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651872+0000","last_change":"2024-04-26T10:42:26.045324+0000","last_active":"2024-04-26T10:42:29.651872+0000","last_peered":"2024-04-26T10:42:29.651872+0000","last_clean":"2024-04-26T10:42:29.651872+0000","last_became_active":"2024-04-26T10:42:26.044454+0000","last_became_peered":"2024-04-26T10:42:26.044454+0000","last_unstale":"2024-04-26T10:42:29.651872+0000","last_undegraded":"2024-04-26T10:42:29.651872+0000","last_fullsized":"2024-04-26T10:42:29.651872+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652341+0000","last_change":"2024-04-26T10:42:25.685528+0000","last_active":"2024-04-26T10:42:29.652341+0000","last_peered":"2024-04-26T10:42:29.652341+0000","last_clean":"2024-04-26T10:42:29.652341+0000","last_became_active":"2024-04-26T10:42:25.684508+0000","last_became_peered":"2024-04-26T10:42:25.684508+0000","last_unstale":"2024-04-26T10:42:29.652341+0000","last_undegraded":"2024-04-26T10:42:29.652341+0000","last_fullsized":"2024-04-26T10:42:29.652341+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.850118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5636,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31260,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340580,"statfs":{"total":96636764160,"available":96604753920,"internally_reserved":0,"allocated":147456,"data_stored":50875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":770048,"data_stored":646263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]}]},{"osd":0,"up_from":8,"seq":34359738378,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35956,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335884,"statfs":{"total":96636764160,"available":96599945216,"internally_reserved":0,"allocated":761856,"data_stored":645647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:42:54.114 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:42:54.203 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:54.201+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:54.225 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:42:54.225 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:42:54.225 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:42:54.226 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:42:54.235 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:42:54.303 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:54.302+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:54.337 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:42:54.337 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:42:54.337 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:42:54.337 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:42:54.337 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:42:54.346 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:42:54.404 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:54.403+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:54.411 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:42:54.412 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:42:54.421 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-26T10:42:53.736560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596004,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":251,"num_write_kb":3479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94988,"kb_used_data":1640,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283020532,"statfs":{"total":289910292480,"available":289813024768,"internally_reserved":0,"allocated":1679360,"data_stored":1342785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3274,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.139258"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652035+0000","last_change":"2024-04-26T10:42:26.045527+0000","last_active":"2024-04-26T10:42:29.652035+0000","last_peered":"2024-04-26T10:42:29.652035+0000","last_clean":"2024-04-26T10:42:29.652035+0000","last_became_active":"2024-04-26T10:42:26.044597+0000","last_became_peered":"2024-04-26T10:42:26.044597+0000","last_unstale":"2024-04-26T10:42:29.652035+0000","last_undegraded":"2024-04-26T10:42:29.652035+0000","last_fullsized":"2024-04-26T10:42:29.652035+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651979+0000","last_change":"2024-04-26T10:42:26.043815+0000","last_active":"2024-04-26T10:42:29.651979+0000","last_peered":"2024-04-26T10:42:29.651979+0000","last_clean":"2024-04-26T10:42:29.651979+0000","last_became_active":"2024-04-26T10:42:26.042757+0000","last_became_peered":"2024-04-26T10:42:26.042757+0000","last_unstale":"2024-04-26T10:42:29.651979+0000","last_undegraded":"2024-04-26T10:42:29.651979+0000","last_fullsized":"2024-04-26T10:42:29.651979+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:27.752674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652112+0000","last_change":"2024-04-26T10:42:26.041030+0000","last_active":"2024-04-26T10:42:29.652112+0000","last_peered":"2024-04-26T10:42:29.652112+0000","last_clean":"2024-04-26T10:42:29.652112+0000","last_became_active":"2024-04-26T10:42:26.039762+0000","last_became_peered":"2024-04-26T10:42:26.039762+0000","last_unstale":"2024-04-26T10:42:29.652112+0000","last_undegraded":"2024-04-26T10:42:29.652112+0000","last_fullsized":"2024-04-26T10:42:29.652112+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652044+0000","last_change":"2024-04-26T10:42:26.044004+0000","last_active":"2024-04-26T10:42:29.652044+0000","last_peered":"2024-04-26T10:42:29.652044+0000","last_clean":"2024-04-26T10:42:29.652044+0000","last_became_active":"2024-04-26T10:42:26.042953+0000","last_became_peered":"2024-04-26T10:42:26.042953+0000","last_unstale":"2024-04-26T10:42:29.652044+0000","last_undegraded":"2024-04-26T10:42:29.652044+0000","last_fullsized":"2024-04-26T10:42:29.652044+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.895922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651873+0000","last_change":"2024-04-26T10:42:26.041191+0000","last_active":"2024-04-26T10:42:29.651873+0000","last_peered":"2024-04-26T10:42:29.651873+0000","last_clean":"2024-04-26T10:42:29.651873+0000","last_became_active":"2024-04-26T10:42:26.040487+0000","last_became_peered":"2024-04-26T10:42:26.040487+0000","last_unstale":"2024-04-26T10:42:29.651873+0000","last_undegraded":"2024-04-26T10:42:29.651873+0000","last_fullsized":"2024-04-26T10:42:29.651873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651921+0000","last_change":"2024-04-26T10:42:26.043542+0000","last_active":"2024-04-26T10:42:29.651921+0000","last_peered":"2024-04-26T10:42:29.651921+0000","last_clean":"2024-04-26T10:42:29.651921+0000","last_became_active":"2024-04-26T10:42:26.042631+0000","last_became_peered":"2024-04-26T10:42:26.042631+0000","last_unstale":"2024-04-26T10:42:29.651921+0000","last_undegraded":"2024-04-26T10:42:29.651921+0000","last_fullsized":"2024-04-26T10:42:29.651921+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:38.272126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651900+0000","last_change":"2024-04-26T10:42:26.042698+0000","last_active":"2024-04-26T10:42:29.651900+0000","last_peered":"2024-04-26T10:42:29.651900+0000","last_clean":"2024-04-26T10:42:29.651900+0000","last_became_active":"2024-04-26T10:42:26.041631+0000","last_became_peered":"2024-04-26T10:42:26.041631+0000","last_unstale":"2024-04-26T10:42:29.651900+0000","last_undegraded":"2024-04-26T10:42:29.651900+0000","last_fullsized":"2024-04-26T10:42:29.651900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:27.752674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651815+0000","last_change":"2024-04-26T10:42:26.045497+0000","last_active":"2024-04-26T10:42:29.651815+0000","last_peered":"2024-04-26T10:42:29.651815+0000","last_clean":"2024-04-26T10:42:29.651815+0000","last_became_active":"2024-04-26T10:42:26.044865+0000","last_became_peered":"2024-04-26T10:42:26.044865+0000","last_unstale":"2024-04-26T10:42:29.651815+0000","last_undegraded":"2024-04-26T10:42:29.651815+0000","last_fullsized":"2024-04-26T10:42:29.651815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:59:04.853293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652300+0000","last_change":"2024-04-26T10:42:26.045893+0000","last_active":"2024-04-26T10:42:29.652300+0000","last_peered":"2024-04-26T10:42:29.652300+0000","last_clean":"2024-04-26T10:42:29.652300+0000","last_became_active":"2024-04-26T10:42:26.045177+0000","last_became_peered":"2024-04-26T10:42:26.045177+0000","last_unstale":"2024-04-26T10:42:29.652300+0000","last_undegraded":"2024-04-26T10:42:29.652300+0000","last_fullsized":"2024-04-26T10:42:29.652300+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651987+0000","last_change":"2024-04-26T10:42:26.044101+0000","last_active":"2024-04-26T10:42:29.651987+0000","last_peered":"2024-04-26T10:42:29.651987+0000","last_clean":"2024-04-26T10:42:29.651987+0000","last_became_active":"2024-04-26T10:42:26.042047+0000","last_became_peered":"2024-04-26T10:42:26.042047+0000","last_unstale":"2024-04-26T10:42:29.651987+0000","last_undegraded":"2024-04-26T10:42:29.651987+0000","last_fullsized":"2024-04-26T10:42:29.651987+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:46.975947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652122+0000","last_change":"2024-04-26T10:42:26.043530+0000","last_active":"2024-04-26T10:42:29.652122+0000","last_peered":"2024-04-26T10:42:29.652122+0000","last_clean":"2024-04-26T10:42:29.652122+0000","last_became_active":"2024-04-26T10:42:26.042301+0000","last_became_peered":"2024-04-26T10:42:26.042301+0000","last_unstale":"2024-04-26T10:42:29.652122+0000","last_undegraded":"2024-04-26T10:42:29.652122+0000","last_fullsized":"2024-04-26T10:42:29.652122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:48.440963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651893+0000","last_change":"2024-04-26T10:42:26.047073+0000","last_active":"2024-04-26T10:42:29.651893+0000","last_peered":"2024-04-26T10:42:29.651893+0000","last_clean":"2024-04-26T10:42:29.651893+0000","last_became_active":"2024-04-26T10:42:26.046384+0000","last_became_peered":"2024-04-26T10:42:26.046384+0000","last_unstale":"2024-04-26T10:42:29.651893+0000","last_undegraded":"2024-04-26T10:42:29.651893+0000","last_fullsized":"2024-04-26T10:42:29.651893+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:23.079349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651854+0000","last_change":"2024-04-26T10:42:26.042607+0000","last_active":"2024-04-26T10:42:29.651854+0000","last_peered":"2024-04-26T10:42:29.651854+0000","last_clean":"2024-04-26T10:42:29.651854+0000","last_became_active":"2024-04-26T10:42:26.041617+0000","last_became_peered":"2024-04-26T10:42:26.041617+0000","last_unstale":"2024-04-26T10:42:29.651854+0000","last_undegraded":"2024-04-26T10:42:29.651854+0000","last_fullsized":"2024-04-26T10:42:29.651854+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651942+0000","last_change":"2024-04-26T10:42:26.040433+0000","last_active":"2024-04-26T10:42:29.651942+0000","last_peered":"2024-04-26T10:42:29.651942+0000","last_clean":"2024-04-26T10:42:29.651942+0000","last_became_active":"2024-04-26T10:42:26.039631+0000","last_became_peered":"2024-04-26T10:42:26.039631+0000","last_unstale":"2024-04-26T10:42:29.651942+0000","last_undegraded":"2024-04-26T10:42:29.651942+0000","last_fullsized":"2024-04-26T10:42:29.651942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651911+0000","last_change":"2024-04-26T10:42:26.040182+0000","last_active":"2024-04-26T10:42:29.651911+0000","last_peered":"2024-04-26T10:42:29.651911+0000","last_clean":"2024-04-26T10:42:29.651911+0000","last_became_active":"2024-04-26T10:42:26.038614+0000","last_became_peered":"2024-04-26T10:42:26.038614+0000","last_unstale":"2024-04-26T10:42:29.651911+0000","last_undegraded":"2024-04-26T10:42:29.651911+0000","last_fullsized":"2024-04-26T10:42:29.651911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651827+0000","last_change":"2024-04-26T10:42:26.045551+0000","last_active":"2024-04-26T10:42:29.651827+0000","last_peered":"2024-04-26T10:42:29.651827+0000","last_clean":"2024-04-26T10:42:29.651827+0000","last_became_active":"2024-04-26T10:42:26.044944+0000","last_became_peered":"2024-04-26T10:42:26.044944+0000","last_unstale":"2024-04-26T10:42:29.651827+0000","last_undegraded":"2024-04-26T10:42:29.651827+0000","last_fullsized":"2024-04-26T10:42:29.651827+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:02.194279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652367+0000","last_change":"2024-04-26T10:42:26.049338+0000","last_active":"2024-04-26T10:42:29.652367+0000","last_peered":"2024-04-26T10:42:29.652367+0000","last_clean":"2024-04-26T10:42:29.652367+0000","last_became_active":"2024-04-26T10:42:26.049014+0000","last_became_peered":"2024-04-26T10:42:26.049014+0000","last_unstale":"2024-04-26T10:42:29.652367+0000","last_undegraded":"2024-04-26T10:42:29.652367+0000","last_fullsized":"2024-04-26T10:42:29.652367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652015+0000","last_change":"2024-04-26T10:42:26.043604+0000","last_active":"2024-04-26T10:42:29.652015+0000","last_peered":"2024-04-26T10:42:29.652015+0000","last_clean":"2024-04-26T10:42:29.652015+0000","last_became_active":"2024-04-26T10:42:26.041224+0000","last_became_peered":"2024-04-26T10:42:26.041224+0000","last_unstale":"2024-04-26T10:42:29.652015+0000","last_undegraded":"2024-04-26T10:42:29.652015+0000","last_fullsized":"2024-04-26T10:42:29.652015+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652233+0000","last_change":"2024-04-26T10:42:26.045031+0000","last_active":"2024-04-26T10:42:29.652233+0000","last_peered":"2024-04-26T10:42:29.652233+0000","last_clean":"2024-04-26T10:42:29.652233+0000","last_became_active":"2024-04-26T10:42:26.044604+0000","last_became_peered":"2024-04-26T10:42:26.044604+0000","last_unstale":"2024-04-26T10:42:29.652233+0000","last_undegraded":"2024-04-26T10:42:29.652233+0000","last_fullsized":"2024-04-26T10:42:29.652233+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652055+0000","last_change":"2024-04-26T10:42:26.043762+0000","last_active":"2024-04-26T10:42:29.652055+0000","last_peered":"2024-04-26T10:42:29.652055+0000","last_clean":"2024-04-26T10:42:29.652055+0000","last_became_active":"2024-04-26T10:42:26.042117+0000","last_became_peered":"2024-04-26T10:42:26.042117+0000","last_unstale":"2024-04-26T10:42:29.652055+0000","last_undegraded":"2024-04-26T10:42:29.652055+0000","last_fullsized":"2024-04-26T10:42:29.652055+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:35.276961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652005+0000","last_change":"2024-04-26T10:42:26.044062+0000","last_active":"2024-04-26T10:42:29.652005+0000","last_peered":"2024-04-26T10:42:29.652005+0000","last_clean":"2024-04-26T10:42:29.652005+0000","last_became_active":"2024-04-26T10:42:26.042378+0000","last_became_peered":"2024-04-26T10:42:26.042378+0000","last_unstale":"2024-04-26T10:42:29.652005+0000","last_undegraded":"2024-04-26T10:42:29.652005+0000","last_fullsized":"2024-04-26T10:42:29.652005+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:24.255706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651810+0000","last_change":"2024-04-26T10:42:26.046353+0000","last_active":"2024-04-26T10:42:29.651810+0000","last_peered":"2024-04-26T10:42:29.651810+0000","last_clean":"2024-04-26T10:42:29.651810+0000","last_became_active":"2024-04-26T10:42:26.045614+0000","last_became_peered":"2024-04-26T10:42:26.045614+0000","last_unstale":"2024-04-26T10:42:29.651810+0000","last_undegraded":"2024-04-26T10:42:29.651810+0000","last_fullsized":"2024-04-26T10:42:29.651810+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:19.601720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652076+0000","last_change":"2024-04-26T10:42:26.045311+0000","last_active":"2024-04-26T10:42:29.652076+0000","last_peered":"2024-04-26T10:42:29.652076+0000","last_clean":"2024-04-26T10:42:29.652076+0000","last_became_active":"2024-04-26T10:42:26.044614+0000","last_became_peered":"2024-04-26T10:42:26.044614+0000","last_unstale":"2024-04-26T10:42:29.652076+0000","last_undegraded":"2024-04-26T10:42:29.652076+0000","last_fullsized":"2024-04-26T10:42:29.652076+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651710+0000","last_change":"2024-04-26T10:42:26.043614+0000","last_active":"2024-04-26T10:42:29.651710+0000","last_peered":"2024-04-26T10:42:29.651710+0000","last_clean":"2024-04-26T10:42:29.651710+0000","last_became_active":"2024-04-26T10:42:26.042629+0000","last_became_peered":"2024-04-26T10:42:26.042629+0000","last_unstale":"2024-04-26T10:42:29.651710+0000","last_undegraded":"2024-04-26T10:42:29.651710+0000","last_fullsized":"2024-04-26T10:42:29.651710+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652044+0000","last_change":"2024-04-26T10:42:26.046876+0000","last_active":"2024-04-26T10:42:29.652044+0000","last_peered":"2024-04-26T10:42:29.652044+0000","last_clean":"2024-04-26T10:42:29.652044+0000","last_became_active":"2024-04-26T10:42:26.046177+0000","last_became_peered":"2024-04-26T10:42:26.046177+0000","last_unstale":"2024-04-26T10:42:29.652044+0000","last_undegraded":"2024-04-26T10:42:29.652044+0000","last_fullsized":"2024-04-26T10:42:29.652044+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:51.567162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652242+0000","last_change":"2024-04-26T10:42:26.044190+0000","last_active":"2024-04-26T10:42:29.652242+0000","last_peered":"2024-04-26T10:42:29.652242+0000","last_clean":"2024-04-26T10:42:29.652242+0000","last_became_active":"2024-04-26T10:42:26.043736+0000","last_became_peered":"2024-04-26T10:42:26.043736+0000","last_unstale":"2024-04-26T10:42:29.652242+0000","last_undegraded":"2024-04-26T10:42:29.652242+0000","last_fullsized":"2024-04-26T10:42:29.652242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652132+0000","last_change":"2024-04-26T10:42:26.041008+0000","last_active":"2024-04-26T10:42:29.652132+0000","last_peered":"2024-04-26T10:42:29.652132+0000","last_clean":"2024-04-26T10:42:29.652132+0000","last_became_active":"2024-04-26T10:42:26.039620+0000","last_became_peered":"2024-04-26T10:42:26.039620+0000","last_unstale":"2024-04-26T10:42:29.652132+0000","last_undegraded":"2024-04-26T10:42:29.652132+0000","last_fullsized":"2024-04-26T10:42:29.652132+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651921+0000","last_change":"2024-04-26T10:42:26.046392+0000","last_active":"2024-04-26T10:42:29.651921+0000","last_peered":"2024-04-26T10:42:29.651921+0000","last_clean":"2024-04-26T10:42:29.651921+0000","last_became_active":"2024-04-26T10:42:26.045806+0000","last_became_peered":"2024-04-26T10:42:26.045806+0000","last_unstale":"2024-04-26T10:42:29.651921+0000","last_undegraded":"2024-04-26T10:42:29.651921+0000","last_fullsized":"2024-04-26T10:42:29.651921+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:15:59.087635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652164+0000","last_change":"2024-04-26T10:42:26.045205+0000","last_active":"2024-04-26T10:42:29.652164+0000","last_peered":"2024-04-26T10:42:29.652164+0000","last_clean":"2024-04-26T10:42:29.652164+0000","last_became_active":"2024-04-26T10:42:26.044762+0000","last_became_peered":"2024-04-26T10:42:26.044762+0000","last_unstale":"2024-04-26T10:42:29.652164+0000","last_undegraded":"2024-04-26T10:42:29.652164+0000","last_fullsized":"2024-04-26T10:42:29.652164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651829+0000","last_change":"2024-04-26T10:42:26.046020+0000","last_active":"2024-04-26T10:42:29.651829+0000","last_peered":"2024-04-26T10:42:29.651829+0000","last_clean":"2024-04-26T10:42:29.651829+0000","last_became_active":"2024-04-26T10:42:26.045567+0000","last_became_peered":"2024-04-26T10:42:26.045567+0000","last_unstale":"2024-04-26T10:42:29.651829+0000","last_undegraded":"2024-04-26T10:42:29.651829+0000","last_fullsized":"2024-04-26T10:42:29.651829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:53.380329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652085+0000","last_change":"2024-04-26T10:42:26.046584+0000","last_active":"2024-04-26T10:42:29.652085+0000","last_peered":"2024-04-26T10:42:29.652085+0000","last_clean":"2024-04-26T10:42:29.652085+0000","last_became_active":"2024-04-26T10:42:26.046231+0000","last_became_peered":"2024-04-26T10:42:26.046231+0000","last_unstale":"2024-04-26T10:42:29.652085+0000","last_undegraded":"2024-04-26T10:42:29.652085+0000","last_fullsized":"2024-04-26T10:42:29.652085+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651835+0000","last_change":"2024-04-26T10:42:26.045270+0000","last_active":"2024-04-26T10:42:29.651835+0000","last_peered":"2024-04-26T10:42:29.651835+0000","last_clean":"2024-04-26T10:42:29.651835+0000","last_became_active":"2024-04-26T10:42:26.044341+0000","last_became_peered":"2024-04-26T10:42:26.044341+0000","last_unstale":"2024-04-26T10:42:29.651835+0000","last_undegraded":"2024-04-26T10:42:29.651835+0000","last_fullsized":"2024-04-26T10:42:29.651835+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:46.975947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651912+0000","last_change":"2024-04-26T10:42:26.041757+0000","last_active":"2024-04-26T10:42:29.651912+0000","last_peered":"2024-04-26T10:42:29.651912+0000","last_clean":"2024-04-26T10:42:29.651912+0000","last_became_active":"2024-04-26T10:42:26.040920+0000","last_became_peered":"2024-04-26T10:42:26.040920+0000","last_unstale":"2024-04-26T10:42:29.651912+0000","last_undegraded":"2024-04-26T10:42:29.651912+0000","last_fullsized":"2024-04-26T10:42:29.651912+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652020+0000","last_change":"2024-04-26T10:42:25.687138+0000","last_active":"2024-04-26T10:42:29.652020+0000","last_peered":"2024-04-26T10:42:29.652020+0000","last_clean":"2024-04-26T10:42:29.652020+0000","last_became_active":"2024-04-26T10:42:25.686488+0000","last_became_peered":"2024-04-26T10:42:25.686488+0000","last_unstale":"2024-04-26T10:42:29.652020+0000","last_undegraded":"2024-04-26T10:42:29.652020+0000","last_fullsized":"2024-04-26T10:42:29.652020+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:43.969731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651943+0000","last_change":"2024-04-26T10:42:26.041850+0000","last_active":"2024-04-26T10:42:29.651943+0000","last_peered":"2024-04-26T10:42:29.651943+0000","last_clean":"2024-04-26T10:42:29.651943+0000","last_became_active":"2024-04-26T10:42:26.040464+0000","last_became_peered":"2024-04-26T10:42:26.040464+0000","last_unstale":"2024-04-26T10:42:29.651943+0000","last_undegraded":"2024-04-26T10:42:29.651943+0000","last_fullsized":"2024-04-26T10:42:29.651943+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652146+0000","last_change":"2024-04-26T10:42:25.685525+0000","last_active":"2024-04-26T10:42:29.652146+0000","last_peered":"2024-04-26T10:42:29.652146+0000","last_clean":"2024-04-26T10:42:29.652146+0000","last_became_active":"2024-04-26T10:42:25.684855+0000","last_became_peered":"2024-04-26T10:42:25.684855+0000","last_unstale":"2024-04-26T10:42:29.652146+0000","last_undegraded":"2024-04-26T10:42:29.652146+0000","last_fullsized":"2024-04-26T10:42:29.652146+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:16.723401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652272+0000","last_change":"2024-04-26T10:42:26.046616+0000","last_active":"2024-04-26T10:42:29.652272+0000","last_peered":"2024-04-26T10:42:29.652272+0000","last_clean":"2024-04-26T10:42:29.652272+0000","last_became_active":"2024-04-26T10:42:26.046010+0000","last_became_peered":"2024-04-26T10:42:26.046010+0000","last_unstale":"2024-04-26T10:42:29.652272+0000","last_undegraded":"2024-04-26T10:42:29.652272+0000","last_fullsized":"2024-04-26T10:42:29.652272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:19.601720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651779+0000","last_change":"2024-04-26T10:42:25.688905+0000","last_active":"2024-04-26T10:42:29.651779+0000","last_peered":"2024-04-26T10:42:29.651779+0000","last_clean":"2024-04-26T10:42:29.651779+0000","last_became_active":"2024-04-26T10:42:25.688504+0000","last_became_peered":"2024-04-26T10:42:25.688504+0000","last_unstale":"2024-04-26T10:42:29.651779+0000","last_undegraded":"2024-04-26T10:42:29.651779+0000","last_fullsized":"2024-04-26T10:42:29.651779+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.930441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652311+0000","last_change":"2024-04-26T10:42:26.046158+0000","last_active":"2024-04-26T10:42:29.652311+0000","last_peered":"2024-04-26T10:42:29.652311+0000","last_clean":"2024-04-26T10:42:29.652311+0000","last_became_active":"2024-04-26T10:42:26.045797+0000","last_became_peered":"2024-04-26T10:42:26.045797+0000","last_unstale":"2024-04-26T10:42:29.652311+0000","last_undegraded":"2024-04-26T10:42:29.652311+0000","last_fullsized":"2024-04-26T10:42:29.652311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:23.079349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651844+0000","last_change":"2024-04-26T10:42:25.687207+0000","last_active":"2024-04-26T10:42:29.651844+0000","last_peered":"2024-04-26T10:42:29.651844+0000","last_clean":"2024-04-26T10:42:29.651844+0000","last_became_active":"2024-04-26T10:42:25.686549+0000","last_became_peered":"2024-04-26T10:42:25.686549+0000","last_unstale":"2024-04-26T10:42:29.651844+0000","last_undegraded":"2024-04-26T10:42:29.651844+0000","last_fullsized":"2024-04-26T10:42:29.651844+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:42.125386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652219+0000","last_change":"2024-04-26T10:42:25.684462+0000","last_active":"2024-04-26T10:42:29.652219+0000","last_peered":"2024-04-26T10:42:29.652219+0000","last_clean":"2024-04-26T10:42:29.652219+0000","last_became_active":"2024-04-26T10:42:25.684162+0000","last_became_peered":"2024-04-26T10:42:25.684162+0000","last_unstale":"2024-04-26T10:42:29.652219+0000","last_undegraded":"2024-04-26T10:42:29.652219+0000","last_fullsized":"2024-04-26T10:42:29.652219+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.850118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651723+0000","last_change":"2024-04-26T10:42:26.048114+0000","last_active":"2024-04-26T10:42:29.651723+0000","last_peered":"2024-04-26T10:42:29.651723+0000","last_clean":"2024-04-26T10:42:29.651723+0000","last_became_active":"2024-04-26T10:42:26.046641+0000","last_became_peered":"2024-04-26T10:42:26.046641+0000","last_unstale":"2024-04-26T10:42:29.651723+0000","last_undegraded":"2024-04-26T10:42:29.651723+0000","last_fullsized":"2024-04-26T10:42:29.651723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:01.056945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652023+0000","last_change":"2024-04-26T10:42:25.688889+0000","last_active":"2024-04-26T10:42:29.652023+0000","last_peered":"2024-04-26T10:42:29.652023+0000","last_clean":"2024-04-26T10:42:29.652023+0000","last_became_active":"2024-04-26T10:42:25.688372+0000","last_became_peered":"2024-04-26T10:42:25.688372+0000","last_unstale":"2024-04-26T10:42:29.652023+0000","last_undegraded":"2024-04-26T10:42:29.652023+0000","last_fullsized":"2024-04-26T10:42:29.652023+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:13.799290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651753+0000","last_change":"2024-04-26T10:42:26.041968+0000","last_active":"2024-04-26T10:42:29.651753+0000","last_peered":"2024-04-26T10:42:29.651753+0000","last_clean":"2024-04-26T10:42:29.651753+0000","last_became_active":"2024-04-26T10:42:26.041070+0000","last_became_peered":"2024-04-26T10:42:26.041070+0000","last_unstale":"2024-04-26T10:42:29.651753+0000","last_undegraded":"2024-04-26T10:42:29.651753+0000","last_fullsized":"2024-04-26T10:42:29.651753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652175+0000","last_change":"2024-04-26T10:42:25.684653+0000","last_active":"2024-04-26T10:42:29.652175+0000","last_peered":"2024-04-26T10:42:29.652175+0000","last_clean":"2024-04-26T10:42:29.652175+0000","last_became_active":"2024-04-26T10:42:25.684338+0000","last_became_peered":"2024-04-26T10:42:25.684338+0000","last_unstale":"2024-04-26T10:42:29.652175+0000","last_undegraded":"2024-04-26T10:42:29.652175+0000","last_fullsized":"2024-04-26T10:42:29.652175+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:10.694039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651951+0000","last_change":"2024-04-26T10:42:26.042182+0000","last_active":"2024-04-26T10:42:29.651951+0000","last_peered":"2024-04-26T10:42:29.651951+0000","last_clean":"2024-04-26T10:42:29.651951+0000","last_became_active":"2024-04-26T10:42:26.041689+0000","last_became_peered":"2024-04-26T10:42:26.041689+0000","last_unstale":"2024-04-26T10:42:29.651951+0000","last_undegraded":"2024-04-26T10:42:29.651951+0000","last_fullsized":"2024-04-26T10:42:29.651951+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:32:19.618648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652102+0000","last_change":"2024-04-26T10:42:25.686677+0000","last_active":"2024-04-26T10:42:29.652102+0000","last_peered":"2024-04-26T10:42:29.652102+0000","last_clean":"2024-04-26T10:42:29.652102+0000","last_became_active":"2024-04-26T10:42:25.685939+0000","last_became_peered":"2024-04-26T10:42:25.685939+0000","last_unstale":"2024-04-26T10:42:29.652102+0000","last_undegraded":"2024-04-26T10:42:29.652102+0000","last_fullsized":"2024-04-26T10:42:29.652102+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:30.225098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652173+0000","last_change":"2024-04-26T10:42:26.045829+0000","last_active":"2024-04-26T10:42:29.652173+0000","last_peered":"2024-04-26T10:42:29.652173+0000","last_clean":"2024-04-26T10:42:29.652173+0000","last_became_active":"2024-04-26T10:42:26.045499+0000","last_became_peered":"2024-04-26T10:42:26.045499+0000","last_unstale":"2024-04-26T10:42:29.652173+0000","last_undegraded":"2024-04-26T10:42:29.652173+0000","last_fullsized":"2024-04-26T10:42:29.652173+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:14.041039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652184+0000","last_change":"2024-04-26T10:42:25.687934+0000","last_active":"2024-04-26T10:42:29.652184+0000","last_peered":"2024-04-26T10:42:29.652184+0000","last_clean":"2024-04-26T10:42:29.652184+0000","last_became_active":"2024-04-26T10:42:25.687447+0000","last_became_peered":"2024-04-26T10:42:25.687447+0000","last_unstale":"2024-04-26T10:42:29.652184+0000","last_undegraded":"2024-04-26T10:42:29.652184+0000","last_fullsized":"2024-04-26T10:42:29.652184+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.930441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652064+0000","last_change":"2024-04-26T10:42:26.043638+0000","last_active":"2024-04-26T10:42:29.652064+0000","last_peered":"2024-04-26T10:42:29.652064+0000","last_clean":"2024-04-26T10:42:29.652064+0000","last_became_active":"2024-04-26T10:42:26.042692+0000","last_became_peered":"2024-04-26T10:42:26.042692+0000","last_unstale":"2024-04-26T10:42:29.652064+0000","last_undegraded":"2024-04-26T10:42:29.652064+0000","last_fullsized":"2024-04-26T10:42:29.652064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651970+0000","last_change":"2024-04-26T10:42:25.687283+0000","last_active":"2024-04-26T10:42:29.651970+0000","last_peered":"2024-04-26T10:42:29.651970+0000","last_clean":"2024-04-26T10:42:29.651970+0000","last_became_active":"2024-04-26T10:42:25.686251+0000","last_became_peered":"2024-04-26T10:42:25.686251+0000","last_unstale":"2024-04-26T10:42:29.651970+0000","last_undegraded":"2024-04-26T10:42:29.651970+0000","last_fullsized":"2024-04-26T10:42:29.651970+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:16.723401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652141+0000","last_change":"2024-04-26T10:42:26.040688+0000","last_active":"2024-04-26T10:42:29.652141+0000","last_peered":"2024-04-26T10:42:29.652141+0000","last_clean":"2024-04-26T10:42:29.652141+0000","last_became_active":"2024-04-26T10:42:26.039133+0000","last_became_peered":"2024-04-26T10:42:26.039133+0000","last_unstale":"2024-04-26T10:42:29.652141+0000","last_undegraded":"2024-04-26T10:42:29.652141+0000","last_fullsized":"2024-04-26T10:42:29.652141+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651787+0000","last_change":"2024-04-26T10:42:25.688837+0000","last_active":"2024-04-26T10:42:29.651787+0000","last_peered":"2024-04-26T10:42:29.651787+0000","last_clean":"2024-04-26T10:42:29.651787+0000","last_became_active":"2024-04-26T10:42:25.688450+0000","last_became_peered":"2024-04-26T10:42:25.688450+0000","last_unstale":"2024-04-26T10:42:29.651787+0000","last_undegraded":"2024-04-26T10:42:29.651787+0000","last_fullsized":"2024-04-26T10:42:29.651787+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:26.788267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652199+0000","last_change":"2024-04-26T10:42:26.039661+0000","last_active":"2024-04-26T10:42:29.652199+0000","last_peered":"2024-04-26T10:42:29.652199+0000","last_clean":"2024-04-26T10:42:29.652199+0000","last_became_active":"2024-04-26T10:42:26.038664+0000","last_became_peered":"2024-04-26T10:42:26.038664+0000","last_unstale":"2024-04-26T10:42:29.652199+0000","last_undegraded":"2024-04-26T10:42:29.652199+0000","last_fullsized":"2024-04-26T10:42:29.652199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651732+0000","last_change":"2024-04-26T10:42:25.687082+0000","last_active":"2024-04-26T10:42:29.651732+0000","last_peered":"2024-04-26T10:42:29.651732+0000","last_clean":"2024-04-26T10:42:29.651732+0000","last_became_active":"2024-04-26T10:42:25.686779+0000","last_became_peered":"2024-04-26T10:42:25.686779+0000","last_unstale":"2024-04-26T10:42:29.651732+0000","last_undegraded":"2024-04-26T10:42:29.651732+0000","last_fullsized":"2024-04-26T10:42:29.651732+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:12.284219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652320+0000","last_change":"2024-04-26T10:42:26.047130+0000","last_active":"2024-04-26T10:42:29.652320+0000","last_peered":"2024-04-26T10:42:29.652320+0000","last_clean":"2024-04-26T10:42:29.652320+0000","last_became_active":"2024-04-26T10:42:26.046884+0000","last_became_peered":"2024-04-26T10:42:26.046884+0000","last_unstale":"2024-04-26T10:42:29.652320+0000","last_undegraded":"2024-04-26T10:42:29.652320+0000","last_fullsized":"2024-04-26T10:42:29.652320+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:31.020364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":211,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033391+0000","last_change":"2024-04-26T10:42:21.406599+0000","last_active":"2024-04-26T10:42:27.033391+0000","last_peered":"2024-04-26T10:42:27.033391+0000","last_clean":"2024-04-26T10:42:27.033391+0000","last_became_active":"2024-04-26T10:42:21.405587+0000","last_became_peered":"2024-04-26T10:42:21.405587+0000","last_unstale":"2024-04-26T10:42:27.033391+0000","last_undegraded":"2024-04-26T10:42:27.033391+0000","last_fullsized":"2024-04-26T10:42:27.033391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:44.561530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033986+0000","last_change":"2024-04-26T10:42:21.405305+0000","last_active":"2024-04-26T10:42:27.033986+0000","last_peered":"2024-04-26T10:42:27.033986+0000","last_clean":"2024-04-26T10:42:27.033986+0000","last_became_active":"2024-04-26T10:42:21.405032+0000","last_became_peered":"2024-04-26T10:42:21.405032+0000","last_unstale":"2024-04-26T10:42:27.033986+0000","last_undegraded":"2024-04-26T10:42:27.033986+0000","last_fullsized":"2024-04-26T10:42:27.033986+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652154+0000","last_change":"2024-04-26T10:42:25.686765+0000","last_active":"2024-04-26T10:42:29.652154+0000","last_peered":"2024-04-26T10:42:29.652154+0000","last_clean":"2024-04-26T10:42:29.652154+0000","last_became_active":"2024-04-26T10:42:25.686009+0000","last_became_peered":"2024-04-26T10:42:25.686009+0000","last_unstale":"2024-04-26T10:42:29.652154+0000","last_undegraded":"2024-04-26T10:42:29.652154+0000","last_fullsized":"2024-04-26T10:42:29.652154+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:54.627815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652165+0000","last_change":"2024-04-26T10:42:26.040215+0000","last_active":"2024-04-26T10:42:29.652165+0000","last_peered":"2024-04-26T10:42:29.652165+0000","last_clean":"2024-04-26T10:42:29.652165+0000","last_became_active":"2024-04-26T10:42:26.039129+0000","last_became_peered":"2024-04-26T10:42:26.039129+0000","last_unstale":"2024-04-26T10:42:29.652165+0000","last_undegraded":"2024-04-26T10:42:29.652165+0000","last_fullsized":"2024-04-26T10:42:29.652165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033051+0000","last_change":"2024-04-26T10:42:21.406881+0000","last_active":"2024-04-26T10:42:27.033051+0000","last_peered":"2024-04-26T10:42:27.033051+0000","last_clean":"2024-04-26T10:42:27.033051+0000","last_became_active":"2024-04-26T10:42:21.406634+0000","last_became_peered":"2024-04-26T10:42:21.406634+0000","last_unstale":"2024-04-26T10:42:27.033051+0000","last_undegraded":"2024-04-26T10:42:27.033051+0000","last_fullsized":"2024-04-26T10:42:27.033051+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:45.892841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652119+0000","last_change":"2024-04-26T10:42:25.687986+0000","last_active":"2024-04-26T10:42:29.652119+0000","last_peered":"2024-04-26T10:42:29.652119+0000","last_clean":"2024-04-26T10:42:29.652119+0000","last_became_active":"2024-04-26T10:42:25.687201+0000","last_became_peered":"2024-04-26T10:42:25.687201+0000","last_unstale":"2024-04-26T10:42:29.652119+0000","last_undegraded":"2024-04-26T10:42:29.652119+0000","last_fullsized":"2024-04-26T10:42:29.652119+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:35.867262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651998+0000","last_change":"2024-04-26T10:42:26.043723+0000","last_active":"2024-04-26T10:42:29.651998+0000","last_peered":"2024-04-26T10:42:29.651998+0000","last_clean":"2024-04-26T10:42:29.651998+0000","last_became_active":"2024-04-26T10:42:26.041814+0000","last_became_peered":"2024-04-26T10:42:26.041814+0000","last_unstale":"2024-04-26T10:42:29.651998+0000","last_undegraded":"2024-04-26T10:42:29.651998+0000","last_fullsized":"2024-04-26T10:42:29.651998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033479+0000","last_change":"2024-04-26T10:42:21.405597+0000","last_active":"2024-04-26T10:42:27.033479+0000","last_peered":"2024-04-26T10:42:27.033479+0000","last_clean":"2024-04-26T10:42:27.033479+0000","last_became_active":"2024-04-26T10:42:21.405117+0000","last_became_peered":"2024-04-26T10:42:21.405117+0000","last_unstale":"2024-04-26T10:42:27.033479+0000","last_undegraded":"2024-04-26T10:42:27.033479+0000","last_fullsized":"2024-04-26T10:42:27.033479+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651741+0000","last_change":"2024-04-26T10:42:25.688955+0000","last_active":"2024-04-26T10:42:29.651741+0000","last_peered":"2024-04-26T10:42:29.651741+0000","last_clean":"2024-04-26T10:42:29.651741+0000","last_became_active":"2024-04-26T10:42:25.688552+0000","last_became_peered":"2024-04-26T10:42:25.688552+0000","last_unstale":"2024-04-26T10:42:29.651741+0000","last_undegraded":"2024-04-26T10:42:29.651741+0000","last_fullsized":"2024-04-26T10:42:29.651741+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:04.963775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652331+0000","last_change":"2024-04-26T10:42:26.049311+0000","last_active":"2024-04-26T10:42:29.652331+0000","last_peered":"2024-04-26T10:42:29.652331+0000","last_clean":"2024-04-26T10:42:29.652331+0000","last_became_active":"2024-04-26T10:42:26.048915+0000","last_became_peered":"2024-04-26T10:42:26.048915+0000","last_unstale":"2024-04-26T10:42:29.652331+0000","last_undegraded":"2024-04-26T10:42:29.652331+0000","last_fullsized":"2024-04-26T10:42:29.652331+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:01.056945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033740+0000","last_change":"2024-04-26T10:42:21.405298+0000","last_active":"2024-04-26T10:42:27.033740+0000","last_peered":"2024-04-26T10:42:27.033740+0000","last_clean":"2024-04-26T10:42:27.033740+0000","last_became_active":"2024-04-26T10:42:21.405011+0000","last_became_peered":"2024-04-26T10:42:21.405011+0000","last_unstale":"2024-04-26T10:42:27.033740+0000","last_undegraded":"2024-04-26T10:42:27.033740+0000","last_fullsized":"2024-04-26T10:42:27.033740+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:47.789961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652031+0000","last_change":"2024-04-26T10:42:25.686177+0000","last_active":"2024-04-26T10:42:29.652031+0000","last_peered":"2024-04-26T10:42:29.652031+0000","last_clean":"2024-04-26T10:42:29.652031+0000","last_became_active":"2024-04-26T10:42:25.685121+0000","last_became_peered":"2024-04-26T10:42:25.685121+0000","last_unstale":"2024-04-26T10:42:29.652031+0000","last_undegraded":"2024-04-26T10:42:29.652031+0000","last_fullsized":"2024-04-26T10:42:29.652031+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:34.398138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652200+0000","last_change":"2024-04-26T10:42:26.045312+0000","last_active":"2024-04-26T10:42:29.652200+0000","last_peered":"2024-04-26T10:42:29.652200+0000","last_clean":"2024-04-26T10:42:29.652200+0000","last_became_active":"2024-04-26T10:42:26.044619+0000","last_became_peered":"2024-04-26T10:42:26.044619+0000","last_unstale":"2024-04-26T10:42:29.652200+0000","last_undegraded":"2024-04-26T10:42:29.652200+0000","last_fullsized":"2024-04-26T10:42:29.652200+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:50.646374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652189+0000","last_change":"2024-04-26T10:42:25.686310+0000","last_active":"2024-04-26T10:42:29.652189+0000","last_peered":"2024-04-26T10:42:29.652189+0000","last_clean":"2024-04-26T10:42:29.652189+0000","last_became_active":"2024-04-26T10:42:25.685767+0000","last_became_peered":"2024-04-26T10:42:25.685767+0000","last_unstale":"2024-04-26T10:42:29.652189+0000","last_undegraded":"2024-04-26T10:42:29.652189+0000","last_fullsized":"2024-04-26T10:42:29.652189+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:02.874807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033723+0000","last_change":"2024-04-26T10:42:21.405754+0000","last_active":"2024-04-26T10:42:27.033723+0000","last_peered":"2024-04-26T10:42:27.033723+0000","last_clean":"2024-04-26T10:42:27.033723+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:42:27.033723+0000","last_undegraded":"2024-04-26T10:42:27.033723+0000","last_fullsized":"2024-04-26T10:42:27.033723+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:47.123256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651818+0000","last_change":"2024-04-26T10:42:26.043764+0000","last_active":"2024-04-26T10:42:29.651818+0000","last_peered":"2024-04-26T10:42:29.651818+0000","last_clean":"2024-04-26T10:42:29.651818+0000","last_became_active":"2024-04-26T10:42:26.043388+0000","last_became_peered":"2024-04-26T10:42:26.043388+0000","last_unstale":"2024-04-26T10:42:29.651818+0000","last_undegraded":"2024-04-26T10:42:29.651818+0000","last_fullsized":"2024-04-26T10:42:29.651818+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:31.020364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652208+0000","last_change":"2024-04-26T10:42:25.685368+0000","last_active":"2024-04-26T10:42:29.652208+0000","last_peered":"2024-04-26T10:42:29.652208+0000","last_clean":"2024-04-26T10:42:29.652208+0000","last_became_active":"2024-04-26T10:42:25.684379+0000","last_became_peered":"2024-04-26T10:42:25.684379+0000","last_unstale":"2024-04-26T10:42:29.652208+0000","last_undegraded":"2024-04-26T10:42:29.652208+0000","last_fullsized":"2024-04-26T10:42:29.652208+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:34.398138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033992+0000","last_change":"2024-04-26T10:42:21.405356+0000","last_active":"2024-04-26T10:42:27.033992+0000","last_peered":"2024-04-26T10:42:27.033992+0000","last_clean":"2024-04-26T10:42:27.033992+0000","last_became_active":"2024-04-26T10:42:21.405006+0000","last_became_peered":"2024-04-26T10:42:21.405006+0000","last_unstale":"2024-04-26T10:42:27.033992+0000","last_undegraded":"2024-04-26T10:42:27.033992+0000","last_fullsized":"2024-04-26T10:42:27.033992+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:55.043967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651864+0000","last_change":"2024-04-26T10:42:26.042954+0000","last_active":"2024-04-26T10:42:29.651864+0000","last_peered":"2024-04-26T10:42:29.651864+0000","last_clean":"2024-04-26T10:42:29.651864+0000","last_became_active":"2024-04-26T10:42:26.042544+0000","last_became_peered":"2024-04-26T10:42:26.042544+0000","last_unstale":"2024-04-26T10:42:29.651864+0000","last_undegraded":"2024-04-26T10:42:29.651864+0000","last_fullsized":"2024-04-26T10:42:29.651864+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:14.041039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652378+0000","last_change":"2024-04-26T10:42:25.687201+0000","last_active":"2024-04-26T10:42:29.652378+0000","last_peered":"2024-04-26T10:42:29.652378+0000","last_clean":"2024-04-26T10:42:29.652378+0000","last_became_active":"2024-04-26T10:42:25.686641+0000","last_became_peered":"2024-04-26T10:42:25.686641+0000","last_unstale":"2024-04-26T10:42:29.652378+0000","last_undegraded":"2024-04-26T10:42:29.652378+0000","last_fullsized":"2024-04-26T10:42:29.652378+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:30.225098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033887+0000","last_change":"2024-04-26T10:42:21.405615+0000","last_active":"2024-04-26T10:42:27.033887+0000","last_peered":"2024-04-26T10:42:27.033887+0000","last_clean":"2024-04-26T10:42:27.033887+0000","last_became_active":"2024-04-26T10:42:21.405184+0000","last_became_peered":"2024-04-26T10:42:21.405184+0000","last_unstale":"2024-04-26T10:42:27.033887+0000","last_undegraded":"2024-04-26T10:42:27.033887+0000","last_fullsized":"2024-04-26T10:42:27.033887+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:52.378909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652056+0000","last_change":"2024-04-26T10:42:26.046832+0000","last_active":"2024-04-26T10:42:29.652056+0000","last_peered":"2024-04-26T10:42:29.652056+0000","last_clean":"2024-04-26T10:42:29.652056+0000","last_became_active":"2024-04-26T10:42:26.046484+0000","last_became_peered":"2024-04-26T10:42:26.046484+0000","last_unstale":"2024-04-26T10:42:29.652056+0000","last_undegraded":"2024-04-26T10:42:29.652056+0000","last_fullsized":"2024-04-26T10:42:29.652056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:28.856785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:31.500548+0000","last_change":"2024-04-26T10:42:25.686262+0000","last_active":"2024-04-26T10:42:31.500548+0000","last_peered":"2024-04-26T10:42:31.500548+0000","last_clean":"2024-04-26T10:42:31.500548+0000","last_became_active":"2024-04-26T10:42:25.685528+0000","last_became_peered":"2024-04-26T10:42:25.685528+0000","last_unstale":"2024-04-26T10:42:31.500548+0000","last_undegraded":"2024-04-26T10:42:31.500548+0000","last_fullsized":"2024-04-26T10:42:31.500548+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:47.138273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:27.033773+0000","last_change":"2024-04-26T10:42:21.405863+0000","last_active":"2024-04-26T10:42:27.033773+0000","last_peered":"2024-04-26T10:42:27.033773+0000","last_clean":"2024-04-26T10:42:27.033773+0000","last_became_active":"2024-04-26T10:42:21.405555+0000","last_became_peered":"2024-04-26T10:42:21.405555+0000","last_unstale":"2024-04-26T10:42:27.033773+0000","last_undegraded":"2024-04-26T10:42:27.033773+0000","last_fullsized":"2024-04-26T10:42:27.033773+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:39.259618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651769+0000","last_change":"2024-04-26T10:42:26.044818+0000","last_active":"2024-04-26T10:42:29.651769+0000","last_peered":"2024-04-26T10:42:29.651769+0000","last_clean":"2024-04-26T10:42:29.651769+0000","last_became_active":"2024-04-26T10:42:26.043969+0000","last_became_peered":"2024-04-26T10:42:26.043969+0000","last_unstale":"2024-04-26T10:42:29.651769+0000","last_undegraded":"2024-04-26T10:42:29.651769+0000","last_fullsized":"2024-04-26T10:42:29.651769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:50.646374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651994+0000","last_change":"2024-04-26T10:42:26.040224+0000","last_active":"2024-04-26T10:42:29.651994+0000","last_peered":"2024-04-26T10:42:29.651994+0000","last_clean":"2024-04-26T10:42:29.651994+0000","last_became_active":"2024-04-26T10:42:26.038590+0000","last_became_peered":"2024-04-26T10:42:26.038590+0000","last_unstale":"2024-04-26T10:42:29.651994+0000","last_undegraded":"2024-04-26T10:42:29.651994+0000","last_fullsized":"2024-04-26T10:42:29.651994+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'9","reported_seq":21,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T10:42:47.610009+0000","last_change":"2024-04-26T10:42:25.684447+0000","last_active":"2024-04-26T10:42:47.610009+0000","last_peered":"2024-04-26T10:42:47.610009+0000","last_clean":"2024-04-26T10:42:47.610009+0000","last_became_active":"2024-04-26T10:42:25.684147+0000","last_became_peered":"2024-04-26T10:42:25.684147+0000","last_unstale":"2024-04-26T10:42:47.610009+0000","last_undegraded":"2024-04-26T10:42:47.610009+0000","last_fullsized":"2024-04-26T10:42:47.610009+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:38.873282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4838,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652135+0000","last_change":"2024-04-26T10:42:26.045459+0000","last_active":"2024-04-26T10:42:29.652135+0000","last_peered":"2024-04-26T10:42:29.652135+0000","last_clean":"2024-04-26T10:42:29.652135+0000","last_became_active":"2024-04-26T10:42:26.044972+0000","last_became_peered":"2024-04-26T10:42:26.044972+0000","last_unstale":"2024-04-26T10:42:29.652135+0000","last_undegraded":"2024-04-26T10:42:29.652135+0000","last_fullsized":"2024-04-26T10:42:29.652135+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651963+0000","last_change":"2024-04-26T10:42:25.687956+0000","last_active":"2024-04-26T10:42:29.651963+0000","last_peered":"2024-04-26T10:42:29.651963+0000","last_clean":"2024-04-26T10:42:29.651963+0000","last_became_active":"2024-04-26T10:42:25.687533+0000","last_became_peered":"2024-04-26T10:42:25.687533+0000","last_unstale":"2024-04-26T10:42:29.651963+0000","last_undegraded":"2024-04-26T10:42:29.651963+0000","last_fullsized":"2024-04-26T10:42:29.651963+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:28.506897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652209+0000","last_change":"2024-04-26T10:42:25.685829+0000","last_active":"2024-04-26T10:42:29.652209+0000","last_peered":"2024-04-26T10:42:29.652209+0000","last_clean":"2024-04-26T10:42:29.652209+0000","last_became_active":"2024-04-26T10:42:25.685307+0000","last_became_peered":"2024-04-26T10:42:25.685307+0000","last_unstale":"2024-04-26T10:42:29.652209+0000","last_undegraded":"2024-04-26T10:42:29.652209+0000","last_fullsized":"2024-04-26T10:42:29.652209+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652094+0000","last_change":"2024-04-26T10:42:26.046196+0000","last_active":"2024-04-26T10:42:29.652094+0000","last_peered":"2024-04-26T10:42:29.652094+0000","last_clean":"2024-04-26T10:42:29.652094+0000","last_became_active":"2024-04-26T10:42:26.045762+0000","last_became_peered":"2024-04-26T10:42:26.045762+0000","last_unstale":"2024-04-26T10:42:29.652094+0000","last_undegraded":"2024-04-26T10:42:29.652094+0000","last_fullsized":"2024-04-26T10:42:29.652094+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652351+0000","last_change":"2024-04-26T10:42:25.685990+0000","last_active":"2024-04-26T10:42:29.652351+0000","last_peered":"2024-04-26T10:42:29.652351+0000","last_clean":"2024-04-26T10:42:29.652351+0000","last_became_active":"2024-04-26T10:42:25.684604+0000","last_became_peered":"2024-04-26T10:42:25.684604+0000","last_unstale":"2024-04-26T10:42:29.652351+0000","last_undegraded":"2024-04-26T10:42:29.652351+0000","last_fullsized":"2024-04-26T10:42:29.652351+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:02.874807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652032+0000","last_change":"2024-04-26T10:42:26.038545+0000","last_active":"2024-04-26T10:42:29.652032+0000","last_peered":"2024-04-26T10:42:29.652032+0000","last_clean":"2024-04-26T10:42:29.652032+0000","last_became_active":"2024-04-26T10:42:26.038099+0000","last_became_peered":"2024-04-26T10:42:26.038099+0000","last_unstale":"2024-04-26T10:42:29.652032+0000","last_undegraded":"2024-04-26T10:42:29.652032+0000","last_fullsized":"2024-04-26T10:42:29.652032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652053+0000","last_change":"2024-04-26T10:42:26.046506+0000","last_active":"2024-04-26T10:42:29.652053+0000","last_peered":"2024-04-26T10:42:29.652053+0000","last_clean":"2024-04-26T10:42:29.652053+0000","last_became_active":"2024-04-26T10:42:26.045904+0000","last_became_peered":"2024-04-26T10:42:26.045904+0000","last_unstale":"2024-04-26T10:42:29.652053+0000","last_undegraded":"2024-04-26T10:42:29.652053+0000","last_fullsized":"2024-04-26T10:42:29.652053+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:49.854080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652067+0000","last_change":"2024-04-26T10:42:25.683890+0000","last_active":"2024-04-26T10:42:29.652067+0000","last_peered":"2024-04-26T10:42:29.652067+0000","last_clean":"2024-04-26T10:42:29.652067+0000","last_became_active":"2024-04-26T10:42:25.683467+0000","last_became_peered":"2024-04-26T10:42:25.683467+0000","last_unstale":"2024-04-26T10:42:29.652067+0000","last_undegraded":"2024-04-26T10:42:29.652067+0000","last_fullsized":"2024-04-26T10:42:29.652067+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652251+0000","last_change":"2024-04-26T10:42:26.046384+0000","last_active":"2024-04-26T10:42:29.652251+0000","last_peered":"2024-04-26T10:42:29.652251+0000","last_clean":"2024-04-26T10:42:29.652251+0000","last_became_active":"2024-04-26T10:42:26.045860+0000","last_became_peered":"2024-04-26T10:42:26.045860+0000","last_unstale":"2024-04-26T10:42:29.652251+0000","last_undegraded":"2024-04-26T10:42:29.652251+0000","last_fullsized":"2024-04-26T10:42:29.652251+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652103+0000","last_change":"2024-04-26T10:42:25.686972+0000","last_active":"2024-04-26T10:42:29.652103+0000","last_peered":"2024-04-26T10:42:29.652103+0000","last_clean":"2024-04-26T10:42:29.652103+0000","last_became_active":"2024-04-26T10:42:25.685903+0000","last_became_peered":"2024-04-26T10:42:25.685903+0000","last_unstale":"2024-04-26T10:42:29.652103+0000","last_undegraded":"2024-04-26T10:42:29.652103+0000","last_fullsized":"2024-04-26T10:42:29.652103+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:43.969731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651936+0000","last_change":"2024-04-26T10:42:26.046515+0000","last_active":"2024-04-26T10:42:29.651936+0000","last_peered":"2024-04-26T10:42:29.651936+0000","last_clean":"2024-04-26T10:42:29.651936+0000","last_became_active":"2024-04-26T10:42:26.045798+0000","last_became_peered":"2024-04-26T10:42:26.045798+0000","last_unstale":"2024-04-26T10:42:29.651936+0000","last_undegraded":"2024-04-26T10:42:29.651936+0000","last_fullsized":"2024-04-26T10:42:29.651936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:28.856785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651838+0000","last_change":"2024-04-26T10:42:25.688221+0000","last_active":"2024-04-26T10:42:29.651838+0000","last_peered":"2024-04-26T10:42:29.651838+0000","last_clean":"2024-04-26T10:42:29.651838+0000","last_became_active":"2024-04-26T10:42:25.687829+0000","last_became_peered":"2024-04-26T10:42:25.687829+0000","last_unstale":"2024-04-26T10:42:29.651838+0000","last_undegraded":"2024-04-26T10:42:29.651838+0000","last_fullsized":"2024-04-26T10:42:29.651838+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:05.939715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651903+0000","last_change":"2024-04-26T10:42:26.042723+0000","last_active":"2024-04-26T10:42:29.651903+0000","last_peered":"2024-04-26T10:42:29.651903+0000","last_clean":"2024-04-26T10:42:29.651903+0000","last_became_active":"2024-04-26T10:42:26.041852+0000","last_became_peered":"2024-04-26T10:42:26.041852+0000","last_unstale":"2024-04-26T10:42:29.651903+0000","last_undegraded":"2024-04-26T10:42:29.651903+0000","last_fullsized":"2024-04-26T10:42:29.651903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651882+0000","last_change":"2024-04-26T10:42:25.688815+0000","last_active":"2024-04-26T10:42:29.651882+0000","last_peered":"2024-04-26T10:42:29.651882+0000","last_clean":"2024-04-26T10:42:29.651882+0000","last_became_active":"2024-04-26T10:42:25.688451+0000","last_became_peered":"2024-04-26T10:42:25.688451+0000","last_unstale":"2024-04-26T10:42:29.651882+0000","last_undegraded":"2024-04-26T10:42:29.651882+0000","last_fullsized":"2024-04-26T10:42:29.651882+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:17.143923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651984+0000","last_change":"2024-04-26T10:42:26.044040+0000","last_active":"2024-04-26T10:42:29.651984+0000","last_peered":"2024-04-26T10:42:29.651984+0000","last_clean":"2024-04-26T10:42:29.651984+0000","last_became_active":"2024-04-26T10:42:26.042629+0000","last_became_peered":"2024-04-26T10:42:26.042629+0000","last_unstale":"2024-04-26T10:42:29.651984+0000","last_undegraded":"2024-04-26T10:42:29.651984+0000","last_fullsized":"2024-04-26T10:42:29.651984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:23:05.308070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652076+0000","last_change":"2024-04-26T10:42:25.686442+0000","last_active":"2024-04-26T10:42:29.652076+0000","last_peered":"2024-04-26T10:42:29.652076+0000","last_clean":"2024-04-26T10:42:29.652076+0000","last_became_active":"2024-04-26T10:42:25.686029+0000","last_became_peered":"2024-04-26T10:42:25.686029+0000","last_unstale":"2024-04-26T10:42:29.652076+0000","last_undegraded":"2024-04-26T10:42:29.652076+0000","last_fullsized":"2024-04-26T10:42:29.652076+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:04.241132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651962+0000","last_change":"2024-04-26T10:42:26.042561+0000","last_active":"2024-04-26T10:42:29.651962+0000","last_peered":"2024-04-26T10:42:29.651962+0000","last_clean":"2024-04-26T10:42:29.651962+0000","last_became_active":"2024-04-26T10:42:26.041751+0000","last_became_peered":"2024-04-26T10:42:26.041751+0000","last_unstale":"2024-04-26T10:42:29.651962+0000","last_undegraded":"2024-04-26T10:42:29.651962+0000","last_fullsized":"2024-04-26T10:42:29.651962+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651952+0000","last_change":"2024-04-26T10:42:25.687977+0000","last_active":"2024-04-26T10:42:29.651952+0000","last_peered":"2024-04-26T10:42:29.651952+0000","last_clean":"2024-04-26T10:42:29.651952+0000","last_became_active":"2024-04-26T10:42:25.687402+0000","last_became_peered":"2024-04-26T10:42:25.687402+0000","last_unstale":"2024-04-26T10:42:29.651952+0000","last_undegraded":"2024-04-26T10:42:29.651952+0000","last_fullsized":"2024-04-26T10:42:29.651952+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:35.867262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651798+0000","last_change":"2024-04-26T10:42:26.041729+0000","last_active":"2024-04-26T10:42:29.651798+0000","last_peered":"2024-04-26T10:42:29.651798+0000","last_clean":"2024-04-26T10:42:29.651798+0000","last_became_active":"2024-04-26T10:42:26.040504+0000","last_became_peered":"2024-04-26T10:42:26.040504+0000","last_unstale":"2024-04-26T10:42:29.651798+0000","last_undegraded":"2024-04-26T10:42:29.651798+0000","last_fullsized":"2024-04-26T10:42:29.651798+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652261+0000","last_change":"2024-04-26T10:42:25.686861+0000","last_active":"2024-04-26T10:42:29.652261+0000","last_peered":"2024-04-26T10:42:29.652261+0000","last_clean":"2024-04-26T10:42:29.652261+0000","last_became_active":"2024-04-26T10:42:25.686149+0000","last_became_peered":"2024-04-26T10:42:25.686149+0000","last_unstale":"2024-04-26T10:42:29.652261+0000","last_undegraded":"2024-04-26T10:42:29.652261+0000","last_fullsized":"2024-04-26T10:42:29.652261+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:42.125386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.651872+0000","last_change":"2024-04-26T10:42:26.045324+0000","last_active":"2024-04-26T10:42:29.651872+0000","last_peered":"2024-04-26T10:42:29.651872+0000","last_clean":"2024-04-26T10:42:29.651872+0000","last_became_active":"2024-04-26T10:42:26.044454+0000","last_became_peered":"2024-04-26T10:42:26.044454+0000","last_unstale":"2024-04-26T10:42:29.651872+0000","last_undegraded":"2024-04-26T10:42:29.651872+0000","last_fullsized":"2024-04-26T10:42:29.651872+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:42:29.652341+0000","last_change":"2024-04-26T10:42:25.685528+0000","last_active":"2024-04-26T10:42:29.652341+0000","last_peered":"2024-04-26T10:42:29.652341+0000","last_clean":"2024-04-26T10:42:29.652341+0000","last_became_active":"2024-04-26T10:42:25.684508+0000","last_became_peered":"2024-04-26T10:42:25.684508+0000","last_unstale":"2024-04-26T10:42:29.652341+0000","last_undegraded":"2024-04-26T10:42:29.652341+0000","last_fullsized":"2024-04-26T10:42:29.652341+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.850118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5636,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31260,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340580,"statfs":{"total":96636764160,"available":96604753920,"internally_reserved":0,"allocated":147456,"data_stored":50875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":770048,"data_stored":646263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]}]},{"osd":0,"up_from":8,"seq":34359738378,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35956,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335884,"statfs":{"total":96636764160,"available":96599945216,"internally_reserved":0,"allocated":761856,"data_stored":645647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:42:54.425 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T10:42:54.425 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:42:54.426 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-26T10:42:54.426 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 1.000000 2024-04-26T10:42:54.426 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-26T10:42:54.448 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:42:54.448 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:42:54.448 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:42:54.448 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:42:54.448 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.448 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:42:54.448 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:42:54.449 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 28.409696672999999, 2024-04-26T10:42:54.449 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:42:54.449 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:54.449 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.449 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:54.449 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.449 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:54.449 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:42:54.449 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.449 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.450 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.450 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:54.450 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:42:54.450 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.450 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.450 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.450 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:54.450 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:42:54.450 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.450 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.450 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:42:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:42:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:42:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:42:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.451 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:42:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:42:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:42:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:42:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:42:54.452 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:42:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:42:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:42:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:42:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:42:54.453 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:42:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:42:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 28.408825892999999, 2024-04-26T10:42:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:42:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.454 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:42:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:42:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.455 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:42:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:42:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:42:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.456 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:42:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:42:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:42:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:42:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:42:54.457 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:42:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:42:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:42:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:42:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:42:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.458 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:42:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:42:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:42:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:42:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 28.407838550000001, 2024-04-26T10:42:54.459 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:42:54.460 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:54.460 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.460 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:54.460 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.460 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:54.460 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:42:54.460 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.460 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.460 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.460 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:54.460 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:42:54.460 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.461 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.461 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.461 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:54.461 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:42:54.461 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:42:54.461 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.461 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.461 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:54.461 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:42:54.461 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:42:54.461 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.461 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.461 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:54.462 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:42:54.462 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:42:54.462 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.462 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.462 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.462 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:42:54.462 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:42:54.462 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.462 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.462 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:54.462 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:42:54.463 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:42:54.463 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.463 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.463 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:54.463 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:42:54.463 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:42:54.463 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.463 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.463 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:54.463 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:42:54.463 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:42:54.463 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.464 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.464 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:54.464 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:42:54.464 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:42:54.464 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.464 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:54.464 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.464 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.464 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.464 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:42:54.464 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:42:54.464 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 28.407633284999999, 2024-04-26T10:42:54.464 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:42:54.465 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:54.465 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.465 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:54.465 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.465 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:54.465 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:42:54.465 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.465 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.465 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.465 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:54.465 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:42:54.465 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.466 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.466 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.466 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:54.466 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:42:54.466 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.466 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.466 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.466 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:54.466 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:42:54.466 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:42:54.466 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.466 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.467 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:54.467 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:42:54.467 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:42:54.467 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.467 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.467 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.467 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:42:54.467 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:42:54.467 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.467 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.467 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:54.468 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:42:54.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:42:54.468 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.468 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.468 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:54.468 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:42:54.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:42:54.468 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.468 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.468 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:54.468 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:42:54.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:42:54.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.469 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:54.469 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:42:54.469 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:42:54.469 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.469 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:54.469 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.469 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.469 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:42:54.470 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 28.407312405999999, 2024-04-26T10:42:54.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:42:54.470 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:54.470 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.470 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:54.470 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.470 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:54.470 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:42:54.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.470 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.470 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:54.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:42:54.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:54.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:42:54.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:42:54.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:54.472 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:42:54.472 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:42:54.472 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.472 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.472 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:54.472 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:42:54.472 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:42:54.472 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.472 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.472 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.472 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:42:54.472 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:42:54.473 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.473 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.473 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:54.473 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:42:54.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:42:54.473 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.473 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.473 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:54.473 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:42:54.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:42:54.473 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:54.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:42:54.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:42:54.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:54.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:42:54.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:42:54.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.475 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.475 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:42:54.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:42:54.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.475 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:54.475 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:42:54.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:42:54.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.475 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:54.476 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:42:54.476 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:42:54.476 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.476 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:54.476 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.476 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.476 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.476 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.476 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:42:54.476 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 28.407260581999999, 2024-04-26T10:42:54.477 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:42:54.477 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:54.477 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.477 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:54.477 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.477 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:54.477 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:42:54.477 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.477 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.477 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.477 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:54.477 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:42:54.478 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.478 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.478 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.478 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:54.478 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:42:54.478 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.478 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.478 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.478 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:54.478 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:42:54.478 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:42:54.478 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.479 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.479 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:54.479 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:42:54.479 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:42:54.479 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.479 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.479 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.479 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:42:54.479 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:42:54.479 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.479 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.479 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:54.480 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:42:54.480 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:42:54.480 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.480 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.480 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:54.480 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:42:54.480 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:42:54.480 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.480 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.480 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:54.481 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:42:54.481 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:42:54.481 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.481 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.481 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:54.481 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:42:54.481 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:42:54.481 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.481 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.481 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.481 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:42:54.481 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:42:54.482 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.482 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.482 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:54.482 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:42:54.482 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:42:54.482 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.482 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.482 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:54.482 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:42:54.482 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:42:54.483 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.483 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:54.483 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.483 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.483 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.483 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.483 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:42:54.483 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 28.407207209999999, 2024-04-26T10:42:54.483 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:42:54.483 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:54.483 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.484 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:54.484 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.484 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:54.484 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:42:54.484 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.484 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.484 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.484 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:54.484 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:42:54.484 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.484 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.484 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.485 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:54.485 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:42:54.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.485 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.485 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:54.485 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:42:54.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:42:54.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.485 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.485 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:54.485 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:42:54.486 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:42:54.486 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.486 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.486 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.486 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:42:54.486 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:42:54.486 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.486 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.486 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:54.486 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:42:54.486 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:42:54.487 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.487 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.487 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:54.487 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:42:54.487 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:42:54.487 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.487 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.487 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:54.487 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:42:54.487 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:42:54.487 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.487 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.487 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:54.488 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:42:54.488 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:42:54.488 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.488 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.488 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.488 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:42:54.488 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:42:54.488 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.488 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.488 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:54.488 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:42:54.488 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:42:54.489 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.489 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.489 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:54.489 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:42:54.489 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:42:54.489 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.489 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:54.489 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.489 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.489 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.489 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.489 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:42:54.490 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 28.407162883000002, 2024-04-26T10:42:54.490 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:42:54.490 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:54.490 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.490 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:54.490 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.490 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:54.490 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:42:54.490 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.490 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.490 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.490 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:54.491 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:42:54.491 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.491 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.491 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.491 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:54.491 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:42:54.491 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:42:54.491 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.491 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.491 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:54.491 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:42:54.492 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:42:54.492 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.492 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.492 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:54.492 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:42:54.492 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:42:54.492 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.492 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.492 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.492 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:42:54.492 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:42:54.492 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.493 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.493 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:54.493 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:42:54.493 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:42:54.493 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.493 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.493 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:54.493 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:42:54.493 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:42:54.493 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.493 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.493 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:54.494 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:42:54.494 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:42:54.494 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.494 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.494 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:54.494 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:42:54.494 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:42:54.494 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.494 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.494 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.494 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:42:54.494 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:42:54.495 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.495 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.495 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:54.495 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:42:54.495 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:42:54.495 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.495 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.495 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:54.495 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:42:54.495 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:42:54.495 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.495 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:54.496 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.496 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.496 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.496 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.496 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:42:54.496 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 28.407139170000001, 2024-04-26T10:42:54.496 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:42:54.496 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:54.496 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.496 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:54.496 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.496 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:54.497 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:42:54.497 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.497 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.497 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.497 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:54.497 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:42:54.497 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.497 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.497 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.497 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:54.497 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:42:54.497 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.498 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.498 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.498 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:54.498 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:42:54.498 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:42:54.498 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.498 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.498 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:54.498 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:42:54.498 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:42:54.498 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.499 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.499 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.499 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:42:54.499 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:42:54.499 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.499 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.499 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:54.499 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:42:54.499 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:42:54.499 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.499 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.499 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:54.500 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:42:54.500 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:42:54.500 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.500 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.500 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:54.500 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:42:54.500 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:42:54.500 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.500 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.500 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:54.500 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:42:54.500 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:42:54.501 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.501 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.501 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.501 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:42:54.501 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:42:54.501 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.501 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.501 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:54.501 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:42:54.501 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:42:54.501 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.502 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.502 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:54.502 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:42:54.502 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:42:54.502 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.502 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:54.502 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.502 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.502 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.502 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.502 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:42:54.502 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 28.407104865000001, 2024-04-26T10:42:54.503 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:42:54.503 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:54.503 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.503 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:54.503 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.503 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:54.503 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:42:54.503 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.503 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.503 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.503 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:54.503 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:42:54.504 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.504 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.504 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.504 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:54.504 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:42:54.504 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.504 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.504 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.504 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:54.504 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:42:54.504 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:42:54.504 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.505 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.505 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:54.505 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:42:54.505 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:42:54.505 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.505 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.505 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.505 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:42:54.505 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:42:54.505 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.505 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.505 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:54.506 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:42:54.506 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:42:54.506 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.506 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.506 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:54.506 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:42:54.506 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:42:54.506 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.506 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.506 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:54.506 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:42:54.507 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:42:54.507 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.507 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.507 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:54.507 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:42:54.507 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:42:54.507 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.507 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.507 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.507 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:42:54.507 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:42:54.507 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.507 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.508 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:54.508 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:42:54.508 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:42:54.508 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.508 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.508 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:54.508 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:42:54.508 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:42:54.508 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.508 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:54.508 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.509 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.509 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.509 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.509 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:42:54.509 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 28.406768269000001, 2024-04-26T10:42:54.509 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:42:54.509 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:54.509 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:54.509 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:54.509 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.509 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:54.510 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:42:54.510 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.510 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.510 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.510 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:54.510 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:42:54.510 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.510 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.510 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.510 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:54.510 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:42:54.511 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:42:54.511 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.511 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.511 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:54.511 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:42:54.511 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:42:54.511 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.511 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.511 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:54.511 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:42:54.511 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:42:54.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.512 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.512 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.512 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:42:54.512 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:42:54.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.512 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.512 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:54.512 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:42:54.512 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:42:54.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.512 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.512 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:54.513 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:42:54.513 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:42:54.513 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.513 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.513 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:54.513 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:42:54.513 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:42:54.513 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.513 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:54.513 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.513 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.513 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.514 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.514 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:42:54.514 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 28.406726241000001, 2024-04-26T10:42:54.514 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:42:54.514 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:54.514 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:54.514 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:54.514 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.514 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:54.514 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:42:54.514 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.515 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.515 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.515 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:54.515 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:42:54.515 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.515 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.515 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.515 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:54.515 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:42:54.515 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.515 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.515 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.516 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:54.516 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:42:54.516 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:42:54.516 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.516 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.516 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:54.516 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:42:54.516 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:42:54.516 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.516 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.516 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.516 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:42:54.517 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:42:54.517 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.517 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.517 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:54.517 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:42:54.517 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:42:54.517 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.517 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.517 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:54.517 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:42:54.517 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:42:54.517 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.518 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.518 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:54.518 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:42:54.518 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:42:54.518 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.518 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:54.518 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.518 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.518 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.518 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:54.518 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:42:54.518 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 28.406673069, 2024-04-26T10:42:54.519 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:42:54.519 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:54.519 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:54.519 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:54.519 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.519 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:54.519 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:42:54.519 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.519 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.519 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.519 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:54.520 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:42:54.520 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.520 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.520 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.520 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:54.520 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:42:54.520 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.520 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.520 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.520 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:54.521 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:42:54.521 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:42:54.521 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.521 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.521 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:54.521 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:42:54.521 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:42:54.521 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.521 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.521 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.521 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:42:54.521 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:42:54.522 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.522 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.522 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:54.522 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:42:54.522 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:42:54.522 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.522 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.522 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:54.522 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:42:54.523 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:42:54.523 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.523 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.523 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:54.523 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:42:54.523 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:42:54.523 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.523 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:54.523 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.523 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.523 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.523 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:42:54.524 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:42:54.524 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 28.403266659, 2024-04-26T10:42:54.524 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:42:54.524 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:54.524 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:42:54.524 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:54.524 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.524 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:54.524 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:42:54.524 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.524 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.525 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.525 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:54.525 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:42:54.525 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.525 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.525 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.525 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:54.525 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:42:54.525 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.525 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.525 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.526 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:54.526 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:42:54.526 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:42:54.526 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.526 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.526 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:54.526 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:42:54.526 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:42:54.526 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.526 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.527 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.527 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:42:54.527 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:42:54.527 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.527 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.527 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:54.527 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:42:54.527 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:42:54.527 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.527 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.527 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:54.527 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:42:54.528 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:42:54.528 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.528 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:54.528 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.528 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.528 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.528 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:42:54.528 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:42:54.528 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 28.400794705999999, 2024-04-26T10:42:54.528 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:42:54.528 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:54.529 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:54.529 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:54.529 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.529 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:54.529 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:42:54.529 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.529 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.529 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.529 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:54.529 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:42:54.529 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.530 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.530 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.530 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:54.530 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:42:54.530 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.530 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.530 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.530 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:54.530 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:42:54.530 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:42:54.530 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.530 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.531 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:54.531 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:42:54.531 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:42:54.531 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.531 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.531 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.531 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:42:54.531 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:42:54.531 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.531 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.531 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:54.531 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:42:54.532 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:42:54.532 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.532 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.532 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:54.532 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:42:54.532 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:42:54.532 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.532 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.532 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:54.532 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:42:54.532 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:42:54.533 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.533 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:54.533 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.533 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.533 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.533 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:42:54.533 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:42:54.533 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 28.400141147999999, 2024-04-26T10:42:54.533 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:42:54.533 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:54.533 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:54.533 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:54.533 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.534 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:54.534 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:42:54.534 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.534 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.534 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:54.534 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:42:54.534 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.534 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.534 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:54.535 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:42:54.535 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.535 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.535 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:54.535 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:42:54.535 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:42:54.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.535 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.535 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:54.535 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:42:54.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:42:54.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.536 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.536 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.536 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:42:54.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:42:54.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.536 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.536 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:54.536 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:42:54.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:42:54.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.537 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.537 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:54.537 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:42:54.537 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:42:54.537 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.537 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.537 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:54.537 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:42:54.537 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:42:54.537 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.537 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:54.537 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.538 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.538 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.538 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:42:54.538 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:42:54.538 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 28.400065363, 2024-04-26T10:42:54.538 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:42:54.538 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:54.538 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:54.538 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:54.539 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.539 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:54.539 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:42:54.539 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.539 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.539 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.539 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:54.540 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:42:54.540 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.540 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.540 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.540 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:54.540 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:42:54.540 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.540 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.540 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.540 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:54.540 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:42:54.540 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:42:54.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.541 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:54.541 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:42:54.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:42:54.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.541 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.541 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:42:54.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:42:54.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.542 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:54.542 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:42:54.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:42:54.542 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.542 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:54.542 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:42:54.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:42:54.543 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.543 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.543 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:54.543 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:42:54.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:42:54.544 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.544 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:54.544 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.544 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:42:54.544 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:42:54.544 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 28.399851669, 2024-04-26T10:42:54.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:42:54.544 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:54.545 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:42:54.545 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:54.545 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.545 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:54.545 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:42:54.545 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.545 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.545 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:54.545 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:42:54.545 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.546 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:54.546 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:42:54.546 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:54.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.546 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:54.546 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:42:54.546 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:42:54.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:54.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:42:54.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:42:54.547 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:42:54.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:42:54.547 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:54.548 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:42:54.548 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:42:54.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.548 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.548 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:54.548 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:42:54.548 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:42:54.548 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.548 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:54.548 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.549 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:42:54.549 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:42:54.549 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 28.397407856000001, 2024-04-26T10:42:54.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:42:54.549 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:54.549 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:54.549 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:54.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.549 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:54.549 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:42:54.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.550 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:54.550 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:42:54.550 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.550 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:54.550 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:42:54.550 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:42:54.550 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.551 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.551 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:54.551 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:42:54.551 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:42:54.551 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.551 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.551 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:54.551 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:42:54.551 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:42:54.551 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.552 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.552 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.552 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:42:54.552 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:42:54.552 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.552 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.552 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:54.552 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:42:54.552 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:42:54.552 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.552 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.553 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:54.553 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:42:54.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:42:54.553 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.553 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.553 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:54.553 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:42:54.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:42:54.553 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.553 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:54.553 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.554 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.554 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.554 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:42:54.554 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:42:54.554 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 22.947345412000001, 2024-04-26T10:42:54.554 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:42:54.554 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:54.554 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:54.554 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:54.554 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.554 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:54.555 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:42:54.555 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.555 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:54.555 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:42:54.555 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:54.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.555 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:54.555 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:42:54.555 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:42:54.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.556 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:54.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:42:54.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:42:54.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.556 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:54.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:42:54.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:42:54.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.556 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:54.557 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:42:54.557 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:42:54.557 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.557 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.557 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:54.557 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:42:54.557 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:42:54.557 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.557 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.557 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:54.557 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:42:54.557 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:42:54.558 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.558 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:54.558 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:42:54.558 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:42:54.558 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.558 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:54.558 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:42:54.558 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:42:54.558 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.559 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:54.559 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:42:54.559 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:42:54.559 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.559 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.559 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:54.559 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:42:54.559 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:42:54.559 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:54.559 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:54.559 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:54.559 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:42:54.559 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:42:54.560 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.560 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:54.560 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.560 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:54.560 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:54.560 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:42:54.562 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:54.560+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:54.563 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:42:54.602 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:42:54.662 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:54.661+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:54.681 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:42:54.681 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:42:54.681 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:42:54.681 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:42:54.691 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:42:54.731 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:42:54.731 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:42:54.751 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:42:54.752 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1: {} 2024-04-26T10:42:54.752 INFO:teuthology.orchestra.run.smithi049.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:42:54.764 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:54.762+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:54.768 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:42:54.768 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:42:54.797 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:54.797 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:54.806 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:42:54.864 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:54.863+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:54.911 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:54.911 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:54.921 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:42:54.965 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:54.965+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:55.033 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:55.033 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:55.043 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:42:55.067 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:55.066+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:55.144 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:55.144 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:55.153 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:42:55.171 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:55.169+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:55.254 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:55.254 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:55.263 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:42:55.307 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:55.306+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:55.369 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:55.369 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:55.371 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:55.370+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:55.379 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:42:55.472 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:55.471+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:55.520 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:55.521 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:55.530 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:42:55.573 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:55.572+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:55.673 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:55.673 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:55.674 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:55.673+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:55.681 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:42:55.748 INFO:teuthology.orchestra.run.smithi049.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-26T10:42:55.749 INFO:teuthology.orchestra.run.smithi049.stderr:nodeep-scrub is unset 2024-04-26T10:42:55.776 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:55.773+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:55.801 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:55.801 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:55.811 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:42:55.875 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:55.874+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:55.917 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:55.917 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:55.926 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:42:55.976 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:55.975+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:56.072 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:56.072 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:56.077 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:56.075+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:56.080 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:42:56.178 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:56.177+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:56.194 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:56.194 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:56.202 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:42:56.279 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:56.278+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:56.305 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:56.305 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:56.314 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:42:56.381 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:56.379+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:56.455 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:56.455 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:56.463 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:42:56.507 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:56.506+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:56.573 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:56.573 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:56.583 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:42:56.583 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:56.581+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:56.684 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:56.683+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:56.726 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:56.726 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:56.735 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:42:56.781 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:42:56.785 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:56.784+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:56.837 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:56.837 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:56.846 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:42:56.885 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:56.884+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:56.919 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:42:56.919 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:42:56.937 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1: {} 2024-04-26T10:42:56.937 INFO:teuthology.orchestra.run.smithi049.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:42:56.954 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:42:56.955 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:42:56.966 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:42:56.966 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:42:56.966 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:42:56.966 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:42:56.975 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:42:56.986 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:56.985+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:57.082 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:42:57.082 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:42:57.082 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:42:57.082 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:42:57.083 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:42:57.087 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:57.086+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:57.091 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:42:57.188 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:57.187+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:57.198 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:42:57.198 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:42:57.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:42:57.198 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:42:57.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.198 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:42:57.199 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:42:57.199 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.160436678, 2024-04-26T10:42:57.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:42:57.199 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:57.199 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.199 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:57.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:57.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:42:57.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:57.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:42:57.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:57.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:42:57.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:57.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:42:57.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:42:57.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:57.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:42:57.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:42:57.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:42:57.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:42:57.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:57.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:42:57.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:42:57.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.202 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:57.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:42:57.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:42:57.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.202 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:57.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:42:57.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:42:57.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:57.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:42:57.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:42:57.203 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.203 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:57.203 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.203 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.203 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:42:57.203 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.158686556999999, 2024-04-26T10:42:57.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:42:57.203 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:57.204 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.204 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:57.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:57.204 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:42:57.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:57.204 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:42:57.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:57.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:42:57.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:42:57.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.205 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:57.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:42:57.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:42:57.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.205 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:57.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:42:57.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:42:57.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.206 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:42:57.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:42:57.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:57.206 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:42:57.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:42:57.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:57.206 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:42:57.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:42:57.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:57.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:42:57.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:42:57.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:57.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:42:57.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:42:57.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:42:57.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:42:57.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:57.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:42:57.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:42:57.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:57.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:42:57.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:42:57.208 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.208 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:57.208 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.209 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.209 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:42:57.209 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.158633558999998, 2024-04-26T10:42:57.209 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:42:57.209 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:57.209 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.209 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:57.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.209 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:57.209 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:42:57.209 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.209 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:57.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:42:57.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.210 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:57.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:42:57.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.210 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:57.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:42:57.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:42:57.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.211 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:57.211 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:42:57.211 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:42:57.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.211 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.211 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:42:57.211 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:42:57.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.211 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:57.211 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:42:57.211 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:42:57.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:57.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:42:57.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:42:57.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:57.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:42:57.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:42:57.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:57.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:42:57.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:42:57.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.213 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.213 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:42:57.213 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:42:57.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.213 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:57.213 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:42:57.213 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:42:57.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.214 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:57.214 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:42:57.214 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:42:57.214 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.214 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:57.214 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.214 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.214 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:42:57.214 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.158555815, 2024-04-26T10:42:57.214 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:42:57.214 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:57.214 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.215 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:57.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.215 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:57.215 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:42:57.215 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.215 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:57.215 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:42:57.215 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.215 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:57.215 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:42:57.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:42:57.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.216 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:57.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:42:57.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:42:57.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.216 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:57.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:42:57.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:42:57.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.217 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.217 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:42:57.217 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:42:57.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.217 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:57.217 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:42:57.217 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:42:57.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.218 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:57.218 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:42:57.218 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:42:57.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.218 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:57.218 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:42:57.218 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:42:57.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.218 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:57.218 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:42:57.219 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:42:57.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.221 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:42:57.221 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:42:57.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.222 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:57.222 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:42:57.222 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:42:57.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.222 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:57.222 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:42:57.222 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:42:57.223 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.223 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:57.223 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.223 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.223 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.223 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:42:57.223 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.158516809000002, 2024-04-26T10:42:57.223 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:42:57.223 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:57.223 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.223 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:57.223 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.224 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:57.224 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:42:57.224 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.224 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:57.224 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:42:57.224 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.224 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:57.224 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:42:57.224 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:42:57.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:57.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:42:57.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:42:57.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:57.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:42:57.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:42:57.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:42:57.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:42:57.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.226 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:57.226 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:42:57.226 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:42:57.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.226 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:57.226 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:42:57.226 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:42:57.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.226 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:57.226 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:42:57.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:42:57.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.227 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:57.227 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:42:57.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:42:57.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.227 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.227 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:42:57.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:42:57.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.228 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:57.228 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:42:57.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:42:57.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.228 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:57.228 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:42:57.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:42:57.228 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.228 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:57.228 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.229 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.229 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:42:57.229 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.158497988000001, 2024-04-26T10:42:57.229 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:42:57.229 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:57.229 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.229 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:57.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.229 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:57.229 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:42:57.229 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.230 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:57.230 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:42:57.230 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.230 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:57.230 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:42:57.230 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:42:57.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.231 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:57.231 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:42:57.231 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:42:57.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.231 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:57.231 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:42:57.231 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:42:57.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.231 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.231 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:42:57.232 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:42:57.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.232 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:57.232 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:42:57.232 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:42:57.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.232 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:57.232 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:42:57.232 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:42:57.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.232 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:57.233 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:42:57.233 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:42:57.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.233 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:57.233 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:42:57.233 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:42:57.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.233 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.233 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:42:57.233 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:42:57.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.234 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:57.234 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:42:57.234 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:42:57.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.234 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:57.234 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:42:57.234 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:42:57.234 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.234 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:57.234 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.235 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.235 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:42:57.235 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.158465986, 2024-04-26T10:42:57.235 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:42:57.235 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:57.235 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.235 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:57.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.235 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:57.235 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:42:57.235 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.236 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:57.236 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:42:57.236 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.236 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:57.236 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:42:57.236 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.236 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:57.236 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:42:57.236 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:42:57.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.237 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:57.237 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:42:57.237 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:42:57.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.237 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.237 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:42:57.237 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:42:57.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.237 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:57.237 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:42:57.238 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:42:57.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.238 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:57.238 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:42:57.238 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:42:57.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.238 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:57.238 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:42:57.238 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:42:57.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.239 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:57.239 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:42:57.239 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:42:57.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.239 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.239 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:42:57.239 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:42:57.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.239 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:57.239 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:42:57.240 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:42:57.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.240 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:57.240 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:42:57.240 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:42:57.240 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.240 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:57.240 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.240 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.240 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:42:57.241 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.158257177999999, 2024-04-26T10:42:57.241 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:42:57.241 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:57.241 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.241 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:57.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.241 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:57.241 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:42:57.241 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.241 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:57.241 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:42:57.241 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.242 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:57.242 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:42:57.242 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:42:57.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.242 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:57.242 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:42:57.242 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:42:57.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.242 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:57.242 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:42:57.243 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:42:57.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.243 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.243 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:42:57.243 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:42:57.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.243 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:57.243 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:42:57.243 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:42:57.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.243 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:57.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:42:57.244 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:42:57.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.244 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:57.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:42:57.244 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:42:57.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.244 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:57.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:42:57.244 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:42:57.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.245 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.245 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:42:57.245 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:42:57.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.245 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:57.245 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:42:57.245 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:42:57.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.245 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:57.245 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:42:57.245 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:42:57.246 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.246 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:57.246 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.246 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.246 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:42:57.246 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.158225887, 2024-04-26T10:42:57.246 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:42:57.246 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:57.246 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:42:57.246 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:57.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.247 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:57.247 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:42:57.247 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.247 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:57.247 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:42:57.247 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.247 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:57.247 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:42:57.247 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.248 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:57.248 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:42:57.248 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:42:57.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.248 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:57.248 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:42:57.248 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:42:57.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.248 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.248 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:42:57.249 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:42:57.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.249 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:57.249 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:42:57.249 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:42:57.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.249 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:57.249 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:42:57.249 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:42:57.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.249 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:57.250 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:42:57.250 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:42:57.250 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.250 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:57.250 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.250 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.250 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:42:57.250 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.158198637000002, 2024-04-26T10:42:57.250 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:42:57.250 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:57.250 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:42:57.251 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:57.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.251 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:57.251 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:42:57.251 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.251 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:57.251 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:42:57.251 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.251 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:57.251 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:42:57.252 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.252 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.252 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:57.252 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:42:57.252 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:42:57.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.252 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.252 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:57.252 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:42:57.252 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:42:57.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.252 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.252 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.253 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:42:57.253 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:42:57.253 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.253 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.253 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:57.253 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:42:57.253 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:42:57.253 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.253 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.253 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:57.253 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:42:57.253 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:42:57.253 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.254 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.254 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:57.254 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:42:57.254 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:42:57.254 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.254 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:57.254 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.254 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.254 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:42:57.254 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:42:57.254 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.155421885999999, 2024-04-26T10:42:57.255 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:42:57.255 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:57.255 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:42:57.255 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:57.255 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.255 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:57.255 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:42:57.255 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.255 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.255 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:57.255 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:42:57.255 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.256 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.256 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:57.256 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:42:57.256 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.256 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.256 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:57.256 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:42:57.256 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:42:57.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.256 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.256 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:57.256 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:42:57.256 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:42:57.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.257 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.257 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.257 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:42:57.257 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:42:57.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.257 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.257 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:57.257 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:42:57.257 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:42:57.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.257 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.257 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:57.257 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:42:57.258 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:42:57.258 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.258 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:57.258 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.258 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.258 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:42:57.258 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:42:57.258 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.155371797000001, 2024-04-26T10:42:57.258 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:42:57.258 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:57.258 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.258 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:57.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.259 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:57.259 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:42:57.259 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.259 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.259 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:57.259 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:42:57.259 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.259 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.259 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:57.259 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:42:57.260 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.260 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:57.260 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:42:57.260 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:42:57.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.260 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:57.260 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:42:57.260 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:42:57.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.261 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.261 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:42:57.261 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:42:57.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.261 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:57.261 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:42:57.261 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:42:57.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.261 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:57.261 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:42:57.261 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:42:57.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.262 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:57.262 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:42:57.262 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:42:57.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.262 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:57.262 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:42:57.262 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:42:57.262 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.262 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:57.262 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.263 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:42:57.263 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:42:57.263 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.154479727999998, 2024-04-26T10:42:57.263 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:42:57.263 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:57.263 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.263 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:57.263 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.263 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:57.263 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:42:57.263 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.263 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.264 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:57.264 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:42:57.264 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.264 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.264 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.264 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:57.264 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:42:57.264 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.264 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.264 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.264 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:57.264 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:42:57.264 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:42:57.264 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.265 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:57.265 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:42:57.265 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:42:57.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.265 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.265 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:42:57.265 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:42:57.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.265 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:57.265 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:42:57.265 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:42:57.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.266 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.266 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:57.266 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:42:57.266 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:42:57.266 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.266 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.266 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:57.266 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:42:57.266 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:42:57.266 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.266 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.266 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:57.266 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:42:57.267 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:42:57.267 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.267 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:57.267 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.267 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.267 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.267 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:42:57.267 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:42:57.267 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.152291398999999, 2024-04-26T10:42:57.267 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:42:57.267 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:57.267 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.267 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:57.267 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.268 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:57.268 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:42:57.268 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.268 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:57.268 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:42:57.268 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.268 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:57.268 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:42:57.268 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.269 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.269 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:57.269 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:42:57.269 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:42:57.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.269 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.269 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:57.269 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:42:57.269 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:42:57.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.269 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.269 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.269 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:42:57.269 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:42:57.270 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.270 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.270 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:57.270 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:42:57.270 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:42:57.270 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.270 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.270 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:57.270 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:42:57.270 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:42:57.270 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.270 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.270 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:57.271 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:42:57.271 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:42:57.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.271 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.271 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:57.271 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:42:57.271 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:42:57.271 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.271 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:57.271 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.271 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.271 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:42:57.271 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:42:57.272 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.152156029, 2024-04-26T10:42:57.272 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:42:57.272 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:57.272 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.272 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:57.272 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.272 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:57.272 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:42:57.272 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.272 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.272 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.272 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:57.272 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:42:57.272 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.273 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:57.273 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:42:57.273 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.273 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:57.273 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:42:57.273 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:42:57.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.274 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:57.274 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:42:57.274 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:42:57.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.274 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.274 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:42:57.274 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:42:57.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.274 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:57.274 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:42:57.274 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:42:57.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.275 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:57.275 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:42:57.275 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:42:57.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.275 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:57.275 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:42:57.275 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:42:57.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.275 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:57.275 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:42:57.275 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:42:57.276 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.276 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:57.276 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.276 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:42:57.276 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:42:57.276 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.151941454999999, 2024-04-26T10:42:57.276 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:42:57.276 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:57.276 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.276 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:57.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.276 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:57.277 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:42:57.277 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.277 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:57.277 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:42:57.277 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.277 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:57.277 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:42:57.277 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.278 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.278 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:57.278 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:42:57.278 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:42:57.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.278 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.278 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:57.278 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:42:57.278 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:42:57.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.278 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.278 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.279 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:42:57.279 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:42:57.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.279 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:57.279 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:42:57.279 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:42:57.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.279 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:57.279 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:42:57.279 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:42:57.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.280 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:57.280 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:42:57.280 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:42:57.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.280 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:57.280 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:42:57.280 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:42:57.280 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.280 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:57.280 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.281 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:42:57.281 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:42:57.281 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.151602514, 2024-04-26T10:42:57.281 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:42:57.281 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:57.281 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.281 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:57.281 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.281 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:57.281 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:42:57.281 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.281 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.281 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.281 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:57.282 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:42:57.282 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.282 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.282 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.282 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:57.282 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:42:57.282 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.282 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.282 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.282 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:57.282 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:42:57.282 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:42:57.282 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.282 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.283 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:57.283 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:42:57.283 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:42:57.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.283 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.283 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.283 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:42:57.283 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:42:57.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.283 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.283 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:57.283 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:42:57.283 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:42:57.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.283 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.283 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:57.283 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:42:57.284 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:42:57.284 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.284 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.284 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:57.284 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:42:57.284 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:42:57.284 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.284 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.284 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:57.284 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:42:57.284 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:42:57.284 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.284 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:57.284 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.284 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.284 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.285 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:42:57.285 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:42:57.285 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.151493136999999, 2024-04-26T10:42:57.285 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:42:57.285 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:57.285 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:42:57.285 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:57.285 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.285 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:57.285 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:42:57.285 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.285 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.285 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.285 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:57.285 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:42:57.286 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.286 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.286 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:57.286 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:42:57.286 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:42:57.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.286 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.286 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:57.286 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:42:57.286 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:42:57.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.286 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.286 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:57.287 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:42:57.287 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:42:57.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.287 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.287 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.287 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:42:57.287 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:42:57.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.287 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.287 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:57.287 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:42:57.287 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:42:57.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.287 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.287 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:57.288 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:42:57.288 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:42:57.288 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.288 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:57.288 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.288 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.288 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:42:57.288 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:42:57.288 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.151453417999999, 2024-04-26T10:42:57.288 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:42:57.288 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:57.288 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.288 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:57.288 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.288 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:57.289 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:42:57.289 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.289 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.289 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.289 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:57.289 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:42:57.289 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.289 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.289 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.289 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:57.289 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:42:57.289 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:42:57.289 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.289 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.289 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:57.289 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:42:57.290 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:42:57.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.290 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.290 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:57.290 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:42:57.290 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:42:57.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.290 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.290 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.290 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:42:57.290 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:42:57.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.290 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.291 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:57.291 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:42:57.291 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:42:57.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.291 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:57.291 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:42:57.291 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:42:57.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.291 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:57.291 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:42:57.291 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:42:57.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.291 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:57.292 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:42:57.292 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:42:57.292 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.292 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:57.292 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.292 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:42:57.292 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:42:57.292 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.151115884999999, 2024-04-26T10:42:57.292 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:42:57.292 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:57.292 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.292 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:57.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.293 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:57.293 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:42:57.293 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.293 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.293 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:57.293 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:42:57.293 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:57.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.293 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.293 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:57.293 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:42:57.293 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.294 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:57.294 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:42:57.294 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:42:57.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.294 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:57.294 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:42:57.294 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:42:57.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.294 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.295 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:42:57.295 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:42:57.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.295 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:57.295 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:42:57.295 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:42:57.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.295 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:57.295 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:42:57.295 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:42:57.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.296 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:57.296 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:42:57.296 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:42:57.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:57.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:57.296 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:57.296 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:42:57.296 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:42:57.296 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.296 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:57.296 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.296 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:57.297 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:57.297 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:42:57.298 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:57.297+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:57.299 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:42:57.399 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:57.398+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:57.408 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-26T10:42:57.408 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-26T10:42:57.408 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-26T10:42:57.408 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-26T10:42:57.417 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:42:57.500 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:57.499+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:57.520 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-26T10:42:57.520 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-26T10:42:57.520 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-26T10:42:57.520 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-26T10:42:57.520 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-26T10:42:57.529 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:42:57.601 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:57.600+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:57.674 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-26T10:42:57.674 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-26T10:42:57.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-26T10:42:57.674 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-26T10:42:57.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.674 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:42:57.674 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:42:57.674 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.806918422999999, 2024-04-26T10:42:57.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086884530000000005, 2024-04-26T10:42:57.675 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:57.675 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.675 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:42:57.675 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:42:57.675 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:42:57.675 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 164 2024-04-26T10:42:57.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.675 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:57.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:57.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:42:57.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:57.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:42:57.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:57.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:42:57.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-26T10:42:57.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:57.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864858+0000", 2024-04-26T10:42:57.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3231e-05 2024-04-26T10:42:57.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:57.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864862+0000", 2024-04-26T10:42:57.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9280000000000003e-06 2024-04-26T10:42:57.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864865+0000", 2024-04-26T10:42:57.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8289999999999999e-06 2024-04-26T10:42:57.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:57.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869688+0000", 2024-04-26T10:42:57.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048234990000000002 2024-04-26T10:42:57.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:57.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869732+0000", 2024-04-26T10:42:57.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3232999999999998e-05 2024-04-26T10:42:57.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:57.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869804+0000", 2024-04-26T10:42:57.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2152999999999998e-05 2024-04-26T10:42:57.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.872812+0000", 2024-04-26T10:42:57.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003008372 2024-04-26T10:42:57.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:57.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873459+0000", 2024-04-26T10:42:57.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064655699999999997 2024-04-26T10:42:57.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:57.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873482+0000", 2024-04-26T10:42:57.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3419999999999999e-05 2024-04-26T10:42:57.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:57.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873504+0000", 2024-04-26T10:42:57.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1440000000000001e-05 2024-04-26T10:42:57.680 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.680 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:57.680 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.680 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:42:57.681 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:42:57.681 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.806865483999999, 2024-04-26T10:42:57.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0092811590000000006, 2024-04-26T10:42:57.681 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:57.681 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.681 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:42:57.681 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:42:57.681 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:42:57.681 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 165 2024-04-26T10:42:57.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.681 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:57.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:57.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:42:57.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:57.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:42:57.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:57.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:42:57.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:57.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864871+0000", 2024-04-26T10:42:57.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2200000000000001e-06 2024-04-26T10:42:57.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:57.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864875+0000", 2024-04-26T10:42:57.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.206e-06 2024-04-26T10:42:57.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864878+0000", 2024-04-26T10:42:57.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5799999999999999e-06 2024-04-26T10:42:57.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:57.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873137+0000", 2024-04-26T10:42:57.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082591609999999992 2024-04-26T10:42:57.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:57.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873186+0000", 2024-04-26T10:42:57.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8741e-05 2024-04-26T10:42:57.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:57.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873252+0000", 2024-04-26T10:42:57.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5877000000000006e-05 2024-04-26T10:42:57.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:57.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873708+0000", 2024-04-26T10:42:57.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00045660299999999998 2024-04-26T10:42:57.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874091+0000", 2024-04-26T10:42:57.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038295000000000001 2024-04-26T10:42:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874115+0000", 2024-04-26T10:42:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:42:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874149+0000", 2024-04-26T10:42:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4320999999999999e-05 2024-04-26T10:42:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:42:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:42:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.669767849000003, 2024-04-26T10:42:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010199138999999999, 2024-04-26T10:42:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:42:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:42:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:42:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 188 2024-04-26T10:42:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:42:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:42:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:42:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-26T10:42:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002024+0000", 2024-04-26T10:42:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8050999999999997e-05 2024-04-26T10:42:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002034+0000", 2024-04-26T10:42:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0217000000000001e-05 2024-04-26T10:42:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002039+0000", 2024-04-26T10:42:57.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6879999999999998e-06 2024-04-26T10:42:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006586+0000", 2024-04-26T10:42:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045473570000000001 2024-04-26T10:42:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006626+0000", 2024-04-26T10:42:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9688999999999999e-05 2024-04-26T10:42:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006689+0000", 2024-04-26T10:42:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3243000000000004e-05 2024-04-26T10:42:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007850+0000", 2024-04-26T10:42:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011607989999999999 2024-04-26T10:42:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012084+0000", 2024-04-26T10:42:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042340069999999997 2024-04-26T10:42:57.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012132+0000", 2024-04-26T10:42:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8112999999999998e-05 2024-04-26T10:42:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012165+0000", 2024-04-26T10:42:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3189999999999999e-05 2024-04-26T10:42:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:42:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:42:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.669691149000002, 2024-04-26T10:42:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010167136, 2024-04-26T10:42:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:42:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:42:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:42:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 189 2024-04-26T10:42:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:57.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:42:57.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:57.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:42:57.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:57.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:42:57.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:57.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002044+0000", 2024-04-26T10:42:57.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.119e-06 2024-04-26T10:42:57.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:57.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002047+0000", 2024-04-26T10:42:57.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0199999999999999e-06 2024-04-26T10:42:57.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002050+0000", 2024-04-26T10:42:57.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3360000000000002e-06 2024-04-26T10:42:57.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:57.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007165+0000", 2024-04-26T10:42:57.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051155879999999999 2024-04-26T10:42:57.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:57.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007209+0000", 2024-04-26T10:42:57.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4097000000000001e-05 2024-04-26T10:42:57.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:57.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007278+0000", 2024-04-26T10:42:57.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8663000000000003e-05 2024-04-26T10:42:57.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.008047+0000", 2024-04-26T10:42:57.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00076935299999999996 2024-04-26T10:42:57.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:57.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012171+0000", 2024-04-26T10:42:57.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004123219 2024-04-26T10:42:57.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:57.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012193+0000", 2024-04-26T10:42:57.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2169000000000001e-05 2024-04-26T10:42:57.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.697 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:57.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012210+0000", 2024-04-26T10:42:57.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6841999999999999e-05 2024-04-26T10:42:57.698 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.698 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:57.698 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.698 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.698 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:42:57.698 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.638227755999999, 2024-04-26T10:42:57.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010195469, 2024-04-26T10:42:57.698 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:57.698 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.699 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:57.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:57.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:42:57.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:57.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:42:57.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:57.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033504+0000", 2024-04-26T10:42:57.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999981 2024-04-26T10:42:57.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:57.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033513+0000", 2024-04-26T10:42:57.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6829999999999997e-06 2024-04-26T10:42:57.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:57.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033525+0000", 2024-04-26T10:42:57.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2748000000000001e-05 2024-04-26T10:42:57.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033537+0000", 2024-04-26T10:42:57.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1243999999999999e-05 2024-04-26T10:42:57.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:57.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034018+0000", 2024-04-26T10:42:57.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048138899999999998 2024-04-26T10:42:57.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-04-26T10:42:57.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034025+0000", 2024-04-26T10:42:57.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8870000000000003e-06 2024-04-26T10:42:57.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:57.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035264+0000", 2024-04-26T10:42:57.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0012385370000000001 2024-04-26T10:42:57.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:57.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035372+0000", 2024-04-26T10:42:57.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010851199999999999 2024-04-26T10:42:57.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:57.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035473+0000", 2024-04-26T10:42:57.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000100967 2024-04-26T10:42:57.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043270+0000", 2024-04-26T10:42:57.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0077971869999999997 2024-04-26T10:42:57.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:57.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043620+0000", 2024-04-26T10:42:57.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034962099999999999 2024-04-26T10:42:57.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:57.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043665+0000", 2024-04-26T10:42:57.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5426999999999997e-05 2024-04-26T10:42:57.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:57.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043701+0000", 2024-04-26T10:42:57.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6072000000000003e-05 2024-04-26T10:42:57.704 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.704 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:57.704 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.704 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.704 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:42:57.704 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.637742676999999, 2024-04-26T10:42:57.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099286970000000002, 2024-04-26T10:42:57.705 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:57.705 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.705 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:57.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:57.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:42:57.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.705 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:57.705 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:42:57.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:57.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033990+0000", 2024-04-26T10:42:57.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-26T10:42:57.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:57.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033998+0000", 2024-04-26T10:42:57.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7970000000000001e-06 2024-04-26T10:42:57.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:57.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034010+0000", 2024-04-26T10:42:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2383e-05 2024-04-26T10:42:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034021+0000", 2024-04-26T10:42:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0824e-05 2024-04-26T10:42:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035774+0000", 2024-04-26T10:42:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017527479999999999 2024-04-26T10:42:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035929+0000", 2024-04-26T10:42:57.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000155735 2024-04-26T10:42:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036083+0000", 2024-04-26T10:42:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000153635 2024-04-26T10:42:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043369+0000", 2024-04-26T10:42:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0072854490000000003 2024-04-26T10:42:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043709+0000", 2024-04-26T10:42:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034039600000000003 2024-04-26T10:42:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043878+0000", 2024-04-26T10:42:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016924799999999999 2024-04-26T10:42:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043920+0000", 2024-04-26T10:42:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1471999999999999e-05 2024-04-26T10:42:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:57.709 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:42:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.637703398999999, 2024-04-26T10:42:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010011091999999999, 2024-04-26T10:42:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:42:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:42:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:42:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034040+0000", 2024-04-26T10:42:57.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8560000000000002e-06 2024-04-26T10:42:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034048+0000", 2024-04-26T10:42:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4139999999999994e-06 2024-04-26T10:42:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034054+0000", 2024-04-26T10:42:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8950000000000003e-06 2024-04-26T10:42:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036269+0000", 2024-04-26T10:42:57.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002215528 2024-04-26T10:42:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036364+0000", 2024-04-26T10:42:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4089e-05 2024-04-26T10:42:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036443+0000", 2024-04-26T10:42:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9666000000000006e-05 2024-04-26T10:42:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043451+0000", 2024-04-26T10:42:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0070081939999999997 2024-04-26T10:42:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043930+0000", 2024-04-26T10:42:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00047819799999999999 2024-04-26T10:42:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043999+0000", 2024-04-26T10:42:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9136999999999999e-05 2024-04-26T10:42:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044041+0000", 2024-04-26T10:42:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2624999999999999e-05 2024-04-26T10:42:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:42:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.637664432000001, 2024-04-26T10:42:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015256755, 2024-04-26T10:42:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:57.715 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:42:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:42:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:57.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:42:57.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:57.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034073+0000", 2024-04-26T10:42:57.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1099999999999996e-06 2024-04-26T10:42:57.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:57.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034081+0000", 2024-04-26T10:42:57.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0539999999999995e-06 2024-04-26T10:42:57.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034087+0000", 2024-04-26T10:42:57.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0240000000000003e-06 2024-04-26T10:42:57.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:57.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036668+0000", 2024-04-26T10:42:57.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002581014 2024-04-26T10:42:57.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:57.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036717+0000", 2024-04-26T10:42:57.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9299999999999999e-05 2024-04-26T10:42:57.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:57.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036846+0000", 2024-04-26T10:42:57.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012901000000000001 2024-04-26T10:42:57.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.719 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:57.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044050+0000", 2024-04-26T10:42:57.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007203816 2024-04-26T10:42:57.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049229+0000", 2024-04-26T10:42:57.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051792169999999998 2024-04-26T10:42:57.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:57.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049282+0000", 2024-04-26T10:42:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2605000000000002e-05 2024-04-26T10:42:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049326+0000", 2024-04-26T10:42:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4255000000000002e-05 2024-04-26T10:42:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.721 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:42:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.63763977, 2024-04-26T10:42:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01538838, 2024-04-26T10:42:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:42:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:42:57.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:57.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034093+0000", 2024-04-26T10:42:57.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:57.723 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034097+0000", 2024-04-26T10:42:57.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.213e-06 2024-04-26T10:42:57.723 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.723 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.723 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:57.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034104+0000", 2024-04-26T10:42:57.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9840000000000004e-06 2024-04-26T10:42:57.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034111+0000", 2024-04-26T10:42:57.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9199999999999998e-06 2024-04-26T10:42:57.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.724 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:57.724 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.037736+0000", 2024-04-26T10:42:57.724 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036257429999999998 2024-04-26T10:42:57.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.724 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:57.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:42:57.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034004 2024-04-26T10:42:57.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:57.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038526+0000", 2024-04-26T10:42:57.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00044924100000000002 2024-04-26T10:42:57.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.725 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.725 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:57.725 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044708+0000", 2024-04-26T10:42:57.725 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061823360000000001 2024-04-26T10:42:57.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:42:57.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046886159999999996 2024-04-26T10:42:57.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:57.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049446+0000", 2024-04-26T10:42:57.726 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.973e-05 2024-04-26T10:42:57.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.726 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.726 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:57.726 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049482+0000", 2024-04-26T10:42:57.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6004999999999998e-05 2024-04-26T10:42:57.727 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.727 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:57.727 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.727 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.727 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:42:57.727 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.637618248999999, 2024-04-26T10:42:57.727 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015480648, 2024-04-26T10:42:57.727 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:57.727 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.727 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:57.727 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:57.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:42:57.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:57.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:42:57.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.728 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:57.728 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:42:57.728 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.728 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.728 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:57.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034118+0000", 2024-04-26T10:42:57.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1769999999999998e-06 2024-04-26T10:42:57.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:57.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034126+0000", 2024-04-26T10:42:57.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7770000000000002e-06 2024-04-26T10:42:57.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.729 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.729 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034146+0000", 2024-04-26T10:42:57.729 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0579999999999999e-05 2024-04-26T10:42:57.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.729 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:57.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039740+0000", 2024-04-26T10:42:57.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0055940269999999997 2024-04-26T10:42:57.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.730 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:57.730 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039848+0000", 2024-04-26T10:42:57.730 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010775100000000001 2024-04-26T10:42:57.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:57.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040022+0000", 2024-04-26T10:42:57.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000173964 2024-04-26T10:42:57.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:57.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044721+0000", 2024-04-26T10:42:57.731 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046989099999999997 2024-04-26T10:42:57.731 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.731 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.731 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.731 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049541+0000", 2024-04-26T10:42:57.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048200789999999997 2024-04-26T10:42:57.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:57.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049574+0000", 2024-04-26T10:42:57.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2817000000000001e-05 2024-04-26T10:42:57.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.732 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.732 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:57.732 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049596+0000", 2024-04-26T10:42:57.732 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2011999999999999e-05 2024-04-26T10:42:57.732 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.732 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:57.733 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.733 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.733 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.733 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:42:57.733 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.637582290000001, 2024-04-26T10:42:57.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015538033, 2024-04-26T10:42:57.733 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:57.733 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.733 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:57.733 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.733 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:57.733 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:42:57.733 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:57.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:42:57.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.734 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:57.734 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:42:57.734 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.734 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:57.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034155+0000", 2024-04-26T10:42:57.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.177e-06 2024-04-26T10:42:57.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:57.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034161+0000", 2024-04-26T10:42:57.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0780000000000001e-06 2024-04-26T10:42:57.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.735 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.735 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.735 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034168+0000", 2024-04-26T10:42:57.735 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8689999999999998e-06 2024-04-26T10:42:57.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:57.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041069+0000", 2024-04-26T10:42:57.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069010440000000003 2024-04-26T10:42:57.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:57.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041221+0000", 2024-04-26T10:42:57.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015175 2024-04-26T10:42:57.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.736 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.736 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:57.736 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041350+0000", 2024-04-26T10:42:57.736 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012870899999999999 2024-04-26T10:42:57.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:57.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045386+0000", 2024-04-26T10:42:57.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040364789999999999 2024-04-26T10:42:57.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049641+0000", 2024-04-26T10:42:57.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042552120000000004 2024-04-26T10:42:57.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.737 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.737 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:57.737 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049669+0000", 2024-04-26T10:42:57.737 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7809000000000001e-05 2024-04-26T10:42:57.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.738 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:57.738 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049689+0000", 2024-04-26T10:42:57.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0336e-05 2024-04-26T10:42:57.738 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.738 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:57.738 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.738 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.738 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.738 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:42:57.738 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.637560461, 2024-04-26T10:42:57.738 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015595107, 2024-04-26T10:42:57.738 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:57.739 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.739 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:57.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:57.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:42:57.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:57.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:42:57.739 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.739 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:57.739 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:42:57.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:57.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034176+0000", 2024-04-26T10:42:57.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0089999999999999e-06 2024-04-26T10:42:57.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:57.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034182+0000", 2024-04-26T10:42:57.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4579999999999998e-06 2024-04-26T10:42:57.740 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.740 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.740 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.740 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034187+0000", 2024-04-26T10:42:57.740 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0880000000000002e-06 2024-04-26T10:42:57.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:57.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045564+0000", 2024-04-26T10:42:57.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011376475 2024-04-26T10:42:57.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:57.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045623+0000", 2024-04-26T10:42:57.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9388999999999997e-05 2024-04-26T10:42:57.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.741 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.741 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:57.741 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045713+0000", 2024-04-26T10:42:57.741 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0211999999999996e-05 2024-04-26T10:42:57.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:57.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046325+0000", 2024-04-26T10:42:57.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00061181699999999996 2024-04-26T10:42:57.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.742 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049722+0000", 2024-04-26T10:42:57.742 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033962380000000002 2024-04-26T10:42:57.742 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.742 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.742 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:57.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049750+0000", 2024-04-26T10:42:57.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8087000000000001e-05 2024-04-26T10:42:57.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.743 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:57.743 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049768+0000", 2024-04-26T10:42:57.743 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8681999999999998e-05 2024-04-26T10:42:57.743 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.743 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:57.743 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.743 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.743 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.743 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:42:57.744 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.637346937, 2024-04-26T10:42:57.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087543810000000003, 2024-04-26T10:42:57.744 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:57.744 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.744 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:57.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:57.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:42:57.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.744 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.744 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:57.744 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:42:57.744 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:57.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034386+0000", 2024-04-26T10:42:57.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-26T10:42:57.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:57.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034397+0000", 2024-04-26T10:42:57.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0878e-05 2024-04-26T10:42:57.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.745 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.745 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:57.745 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034408+0000", 2024-04-26T10:42:57.745 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1138000000000001e-05 2024-04-26T10:42:57.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034414+0000", 2024-04-26T10:42:57.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2910000000000004e-06 2024-04-26T10:42:57.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:57.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036009+0000", 2024-04-26T10:42:57.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0015952029999999999 2024-04-26T10:42:57.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.746 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.746 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:57.746 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036120+0000", 2024-04-26T10:42:57.746 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000110584 2024-04-26T10:42:57.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:42:57.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036225+0000", 2024-04-26T10:42:57.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010523599999999999 2024-04-26T10:42:57.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:57.747 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039276+0000", 2024-04-26T10:42:57.747 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003050404 2024-04-26T10:42:57.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.747 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.747 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:42:57.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037356099999999999 2024-04-26T10:42:57.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:57.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043079+0000", 2024-04-26T10:42:57.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8099e-05 2024-04-26T10:42:57.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.748 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.748 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:57.748 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043141+0000", 2024-04-26T10:42:57.748 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1655999999999994e-05 2024-04-26T10:42:57.748 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.749 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:57.749 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.749 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.749 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:42:57.749 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.637286379999999, 2024-04-26T10:42:57.749 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090131610000000004, 2024-04-26T10:42:57.749 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:57.749 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.749 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:57.749 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.749 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:57.749 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:42:57.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:57.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:42:57.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:57.750 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:42:57.750 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.750 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.750 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:57.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034451+0000", 2024-04-26T10:42:57.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9600000000000002e-06 2024-04-26T10:42:57.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:57.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034458+0000", 2024-04-26T10:42:57.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5820000000000004e-06 2024-04-26T10:42:57.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.751 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.751 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034463+0000", 2024-04-26T10:42:57.751 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0719999999999999e-06 2024-04-26T10:42:57.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.751 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:57.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036527+0000", 2024-04-26T10:42:57.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002063755 2024-04-26T10:42:57.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:57.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036610+0000", 2024-04-26T10:42:57.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2669000000000004e-05 2024-04-26T10:42:57.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.752 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.752 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:42:57.752 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036744+0000", 2024-04-26T10:42:57.752 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013412499999999999 2024-04-26T10:42:57.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:57.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040144+0000", 2024-04-26T10:42:57.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033999799999999999 2024-04-26T10:42:57.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043301+0000", 2024-04-26T10:42:57.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031572240000000001 2024-04-26T10:42:57.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.753 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.753 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:57.753 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043425+0000", 2024-04-26T10:42:57.753 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000123664 2024-04-26T10:42:57.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.754 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:57.754 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043460+0000", 2024-04-26T10:42:57.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5651000000000001e-05 2024-04-26T10:42:57.754 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.754 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:57.754 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.754 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.754 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:42:57.754 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.637261479999999, 2024-04-26T10:42:57.754 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086028210000000001, 2024-04-26T10:42:57.755 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:57.755 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.755 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:57.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:57.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:42:57.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.755 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:57.755 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:42:57.755 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.755 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.755 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:57.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:42:57.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:57.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034482+0000", 2024-04-26T10:42:57.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8630000000000003e-06 2024-04-26T10:42:57.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.756 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:57.756 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034494+0000", 2024-04-26T10:42:57.756 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-04-26T10:42:57.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.756 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034501+0000", 2024-04-26T10:42:57.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7050000000000002e-06 2024-04-26T10:42:57.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:57.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035138+0000", 2024-04-26T10:42:57.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00063744099999999998 2024-04-26T10:42:57.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.757 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:57.757 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035286+0000", 2024-04-26T10:42:57.757 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014766200000000001 2024-04-26T10:42:57.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.757 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:42:57.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035654+0000", 2024-04-26T10:42:57.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00036779100000000002 2024-04-26T10:42:57.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:57.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040833+0000", 2024-04-26T10:42:57.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051795640000000002 2024-04-26T10:42:57.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.758 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.758 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.758 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.042886+0000", 2024-04-26T10:42:57.758 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020531220000000001 2024-04-26T10:42:57.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:57.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043015+0000", 2024-04-26T10:42:57.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012824099999999999 2024-04-26T10:42:57.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.759 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:57.759 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043075+0000", 2024-04-26T10:42:57.759 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0262e-05 2024-04-26T10:42:57.759 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.759 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:57.759 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.759 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.759 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.760 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.760 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:42:57.760 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.637225517000001, 2024-04-26T10:42:57.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01482116, 2024-04-26T10:42:57.760 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:57.760 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.760 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:57.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:57.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:42:57.760 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.760 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.760 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:57.760 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:42:57.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:57.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:42:57.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.761 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:57.761 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034515+0000", 2024-04-26T10:42:57.761 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.391e-06 2024-04-26T10:42:57.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.761 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:57.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034522+0000", 2024-04-26T10:42:57.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7889999999999997e-06 2024-04-26T10:42:57.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034601+0000", 2024-04-26T10:42:57.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9547000000000003e-05 2024-04-26T10:42:57.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.762 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.762 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:57.762 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036510+0000", 2024-04-26T10:42:57.762 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019092289999999999 2024-04-26T10:42:57.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:57.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036642+0000", 2024-04-26T10:42:57.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013151100000000001 2024-04-26T10:42:57.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:57.763 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036766+0000", 2024-04-26T10:42:57.763 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012367300000000001 2024-04-26T10:42:57.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.763 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:57.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040749+0000", 2024-04-26T10:42:57.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039838419999999996 2024-04-26T10:42:57.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049262+0000", 2024-04-26T10:42:57.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085127789999999998 2024-04-26T10:42:57.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.764 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:57.764 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049301+0000", 2024-04-26T10:42:57.764 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8834000000000001e-05 2024-04-26T10:42:57.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.764 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.765 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:57.765 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049329+0000", 2024-04-26T10:42:57.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.817e-05 2024-04-26T10:42:57.765 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.765 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:57.765 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.765 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.765 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.765 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:42:57.765 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.637092819999999, 2024-04-26T10:42:57.765 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014796093999999999, 2024-04-26T10:42:57.766 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:57.766 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.766 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:57.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:57.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:42:57.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.766 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:57.766 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:42:57.766 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.766 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:57.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034640+0000", 2024-04-26T10:42:57.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:57.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034650+0000", 2024-04-26T10:42:57.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0064999999999999e-05 2024-04-26T10:42:57.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.767 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.767 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:57.767 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034660+0000", 2024-04-26T10:42:57.767 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.961e-06 2024-04-26T10:42:57.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034680+0000", 2024-04-26T10:42:57.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9219e-05 2024-04-26T10:42:57.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:57.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.037926+0000", 2024-04-26T10:42:57.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032460380000000001 2024-04-26T10:42:57.768 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.768 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.768 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:57.768 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038068+0000", 2024-04-26T10:42:57.768 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014236000000000001 2024-04-26T10:42:57.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:57.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038201+0000", 2024-04-26T10:42:57.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013345300000000001 2024-04-26T10:42:57.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:57.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043497+0000", 2024-04-26T10:42:57.769 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052952770000000001 2024-04-26T10:42:57.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.769 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.769 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.769 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049373+0000", 2024-04-26T10:42:57.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058762900000000002 2024-04-26T10:42:57.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:57.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049411+0000", 2024-04-26T10:42:57.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7737000000000001e-05 2024-04-26T10:42:57.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.770 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.770 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:57.770 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049437+0000", 2024-04-26T10:42:57.770 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6169999999999998e-05 2024-04-26T10:42:57.770 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.770 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:57.770 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.771 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.771 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:42:57.771 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.637048310000001, 2024-04-26T10:42:57.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0092140799999999995, 2024-04-26T10:42:57.771 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:57.771 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.771 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:57.771 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.771 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:57.771 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:42:57.771 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:57.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:42:57.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:57.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:42:57.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.772 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:57.772 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034688+0000", 2024-04-26T10:42:57.772 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5480000000000002e-06 2024-04-26T10:42:57.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:57.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034694+0000", 2024-04-26T10:42:57.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1310000000000003e-06 2024-04-26T10:42:57.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034700+0000", 2024-04-26T10:42:57.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4229999999999996e-06 2024-04-26T10:42:57.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.773 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.773 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:57.773 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036183+0000", 2024-04-26T10:42:57.773 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001482964 2024-04-26T10:42:57.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:57.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036297+0000", 2024-04-26T10:42:57.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113649 2024-04-26T10:42:57.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:42:57.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036426+0000", 2024-04-26T10:42:57.774 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012924900000000001 2024-04-26T10:42:57.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.774 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.774 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:57.774 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040839+0000", 2024-04-26T10:42:57.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044137079999999997 2024-04-26T10:42:57.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043679+0000", 2024-04-26T10:42:57.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028397850000000001 2024-04-26T10:42:57.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:57.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043725+0000", 2024-04-26T10:42:57.775 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5859999999999998e-05 2024-04-26T10:42:57.775 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.775 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.775 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:57.775 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043899+0000", 2024-04-26T10:42:57.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000174267 2024-04-26T10:42:57.776 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.776 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:57.776 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.776 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.776 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:42:57.776 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.637025376, 2024-04-26T10:42:57.776 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011493046999999999, 2024-04-26T10:42:57.776 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:57.776 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:57.776 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:57.776 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:57.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:42:57.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:57.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:42:57.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.777 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:57.777 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:42:57.777 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:57.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:57.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034711+0000", 2024-04-26T10:42:57.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4359999999999998e-06 2024-04-26T10:42:57.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:57.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034717+0000", 2024-04-26T10:42:57.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7939999999999999e-06 2024-04-26T10:42:57.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.778 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.778 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034723+0000", 2024-04-26T10:42:57.778 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6219999999999997e-06 2024-04-26T10:42:57.778 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.778 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:57.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035221+0000", 2024-04-26T10:42:57.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00049811199999999999 2024-04-26T10:42:57.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:57.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035351+0000", 2024-04-26T10:42:57.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013049200000000001 2024-04-26T10:42:57.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.779 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.779 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:57.779 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035467+0000", 2024-04-26T10:42:57.779 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115364 2024-04-26T10:42:57.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:57.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040085+0000", 2024-04-26T10:42:57.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046182300000000001 2024-04-26T10:42:57.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:57.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046133+0000", 2024-04-26T10:42:57.780 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060476059999999996 2024-04-26T10:42:57.780 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.780 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.780 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:57.780 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046165+0000", 2024-04-26T10:42:57.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2155e-05 2024-04-26T10:42:57.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.781 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:57.781 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046201+0000", 2024-04-26T10:42:57.781 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6566999999999997e-05 2024-04-26T10:42:57.781 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.781 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:57.781 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.781 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.781 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:57.781 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:42:57.781 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 31.636938966999999, 2024-04-26T10:42:57.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014742026, 2024-04-26T10:42:57.782 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:57.782 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-26T10:42:57.782 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:57.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:57.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:42:57.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.782 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.782 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:57.782 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:42:57.782 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:57.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:57.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034793+0000", 2024-04-26T10:42:57.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-26T10:42:57.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:57.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034802+0000", 2024-04-26T10:42:57.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.551e-06 2024-04-26T10:42:57.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.783 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:57.783 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034815+0000", 2024-04-26T10:42:57.783 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2706e-05 2024-04-26T10:42:57.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:57.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034824+0000", 2024-04-26T10:42:57.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5189999999999998e-06 2024-04-26T10:42:57.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:57.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039312+0000", 2024-04-26T10:42:57.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044874030000000001 2024-04-26T10:42:57.784 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.784 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.784 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:57.784 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039457+0000", 2024-04-26T10:42:57.784 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000145081 2024-04-26T10:42:57.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:57.785 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:57.785 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:57.785 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049537+0000", 2024-04-26T10:42:57.785 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010080053 2024-04-26T10:42:57.785 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.785 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:57.785 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.785 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:57.785 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:57.785 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-26T10:42:57.786 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:42:57.787 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:57.785+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:57.788 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:42:57.888 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:57.886+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:57.901 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:42:57.901 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:42:57.901 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:42:57.901 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:42:57.910 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:42:57.989 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:57.988+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:58.012 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:42:58.012 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:42:58.012 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:42:58.012 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:42:58.012 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:42:58.021 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:42:58.090 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:58.089+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:58.125 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:42:58.125 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:42:58.125 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:42:58.125 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:42:58.125 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.126 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:42:58.126 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:42:58.126 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 32.087028355000001, 2024-04-26T10:42:58.126 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:42:58.126 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:58.126 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.126 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:58.126 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.126 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:58.126 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:42:58.126 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.127 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.127 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.127 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:58.127 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:42:58.127 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.127 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.127 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.127 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:58.127 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:42:58.127 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.127 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.127 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.127 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:58.127 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:42:58.128 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:42:58.128 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.128 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.128 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:58.128 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:42:58.128 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:42:58.128 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.128 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.128 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.128 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:42:58.128 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:42:58.128 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.128 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.128 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:58.128 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:42:58.129 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:42:58.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.129 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.129 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:58.129 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:42:58.129 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:42:58.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.129 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.129 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:58.129 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:42:58.129 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:42:58.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.129 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.129 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:58.130 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:42:58.130 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:42:58.130 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.130 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:58.130 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.130 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.130 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.130 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:42:58.130 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:42:58.130 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 32.086157575000001, 2024-04-26T10:42:58.130 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:42:58.131 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:58.131 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.131 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:58.131 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.131 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:58.131 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:42:58.131 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.132 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.132 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:58.132 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:42:58.132 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.132 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.132 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:58.132 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:42:58.132 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.132 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.132 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:58.133 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:42:58.133 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:42:58.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.133 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:58.133 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:42:58.133 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:42:58.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.133 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.133 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:42:58.133 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:42:58.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.133 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:58.134 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:42:58.134 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:42:58.134 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.134 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.134 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:58.134 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:42:58.134 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:42:58.134 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.134 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.134 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:58.134 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:42:58.134 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:42:58.134 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.134 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.134 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:58.135 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:42:58.135 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:42:58.135 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.135 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:58.135 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.135 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.135 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:42:58.135 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:42:58.135 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 32.085170232000003, 2024-04-26T10:42:58.135 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:42:58.135 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:58.135 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.135 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:58.136 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.136 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:58.136 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:42:58.136 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.136 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.136 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.136 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:58.136 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:42:58.136 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.136 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.136 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.136 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:58.136 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:42:58.136 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:42:58.136 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.137 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.137 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:58.137 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:42:58.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:42:58.137 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.137 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.137 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:58.137 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:42:58.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:42:58.137 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.137 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.137 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.137 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:42:58.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:42:58.137 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.138 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.138 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:58.138 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:42:58.138 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:42:58.138 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.138 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.138 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:58.138 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:42:58.138 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:42:58.138 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.138 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.138 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:58.138 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:42:58.138 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:42:58.138 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.139 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.139 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:58.139 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:42:58.139 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:42:58.139 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.139 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:58.139 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.139 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.139 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.139 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:42:58.139 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:42:58.139 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 32.084964966999998, 2024-04-26T10:42:58.139 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:42:58.139 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:58.139 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.140 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:58.140 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.140 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:58.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:42:58.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.140 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.140 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.140 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:58.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:42:58.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.140 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.140 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.140 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:58.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:42:58.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.141 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.141 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.141 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:58.141 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:42:58.141 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:42:58.141 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.141 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.141 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:58.141 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:42:58.141 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:42:58.141 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.141 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.141 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.141 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:42:58.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:42:58.142 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.142 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.142 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:58.142 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:42:58.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:42:58.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:58.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:42:58.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:42:58.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:58.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:42:58.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:42:58.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:58.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:42:58.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:42:58.144 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.144 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:58.144 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.144 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:58.144 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:42:58.144 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 32.084644087999997, 2024-04-26T10:42:58.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:42:58.144 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:58.144 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.144 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:58.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.144 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:58.145 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:42:58.145 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.145 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.145 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.145 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:58.145 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:42:58.145 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.145 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.145 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.145 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:58.145 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:42:58.145 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:42:58.145 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.145 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.145 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:58.146 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:42:58.146 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:42:58.146 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.146 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.146 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:58.146 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:42:58.146 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:42:58.146 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.146 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.146 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.146 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:42:58.146 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:42:58.146 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.147 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.147 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:58.147 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:42:58.147 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:42:58.147 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.147 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.147 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:58.147 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:42:58.147 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:42:58.147 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.147 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.147 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:58.147 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:42:58.147 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:42:58.147 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.147 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:58.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:42:58.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:42:58.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:58.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:42:58.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:42:58.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:58.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:42:58.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:42:58.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.149 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:58.149 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:42:58.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:42:58.149 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.149 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:58.149 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.149 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.149 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:58.149 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:42:58.149 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 32.084592264000001, 2024-04-26T10:42:58.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:42:58.149 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:58.149 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.150 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:58.150 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.150 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:58.150 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:42:58.150 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.150 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.150 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.150 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:58.150 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:42:58.150 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.150 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.150 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.150 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:58.151 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:42:58.151 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.151 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.151 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.151 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:58.151 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:42:58.151 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:42:58.151 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.151 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.151 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:58.151 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:42:58.151 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:42:58.151 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.151 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.151 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.151 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:42:58.152 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:42:58.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.152 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.152 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:58.152 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:42:58.152 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:42:58.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.152 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.152 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:58.152 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:42:58.152 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:42:58.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.152 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.152 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:58.152 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:42:58.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:42:58.153 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:58.153 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:42:58.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:42:58.153 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:58.153 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:42:58.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:42:58.153 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:58.153 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:42:58.154 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:42:58.154 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.154 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.154 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:58.154 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:42:58.154 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:42:58.154 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.154 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:58.154 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.154 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.154 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.154 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:58.154 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:42:58.154 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 32.084538891999998, 2024-04-26T10:42:58.154 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:42:58.155 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:58.155 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.155 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:58.155 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.155 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:58.155 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:42:58.155 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.155 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.155 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.155 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:58.155 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:42:58.155 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.155 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.155 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.155 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:58.156 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:42:58.156 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.156 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.156 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.156 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:58.156 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:42:58.156 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:42:58.156 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.156 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.156 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:58.156 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:42:58.156 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:42:58.156 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.157 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.157 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.157 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:42:58.157 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:42:58.157 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.157 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.157 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:58.157 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:42:58.157 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:42:58.157 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.157 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.157 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:58.157 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:42:58.157 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:42:58.158 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.158 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.158 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:58.158 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:42:58.158 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:42:58.158 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.158 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.158 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:58.158 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:42:58.158 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:42:58.158 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.158 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.158 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:58.158 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:42:58.158 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:42:58.159 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.159 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.159 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:58.159 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:42:58.159 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:42:58.159 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.159 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.159 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:58.159 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:42:58.159 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:42:58.159 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.159 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:58.159 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.159 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.159 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.160 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:58.160 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:42:58.160 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 32.084494565, 2024-04-26T10:42:58.160 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:42:58.160 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:58.160 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.160 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:58.160 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.160 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:58.160 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:42:58.160 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.160 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.160 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.160 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:58.161 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:42:58.161 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.161 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.161 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.161 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:58.161 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:42:58.161 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:42:58.161 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.161 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.161 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:58.161 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:42:58.161 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:42:58.161 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.161 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.162 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:58.162 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:42:58.162 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:42:58.162 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.162 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.162 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.162 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:42:58.162 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:42:58.162 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.162 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.162 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:58.162 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:42:58.162 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:42:58.162 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.162 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.163 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:58.163 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:42:58.163 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:42:58.163 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.163 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.163 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:58.163 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:42:58.163 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:42:58.163 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.163 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.163 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:58.163 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:42:58.163 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:42:58.163 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.163 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.163 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:58.164 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:42:58.164 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:42:58.164 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.164 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.164 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:58.164 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:42:58.164 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:42:58.164 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.164 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.164 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:58.164 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:42:58.164 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:42:58.164 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.164 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:58.164 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.164 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.165 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.165 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:58.165 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:42:58.165 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 32.084470852000003, 2024-04-26T10:42:58.165 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:42:58.165 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:58.165 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.165 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:58.165 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.165 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:58.165 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:42:58.165 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.165 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.165 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.165 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:58.165 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:42:58.166 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.166 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.166 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.166 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:58.166 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:42:58.166 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.166 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.166 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.166 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:58.166 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:42:58.166 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:42:58.166 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.167 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.167 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:58.167 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:42:58.167 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:42:58.167 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.167 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.167 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.167 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:42:58.167 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:42:58.167 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.167 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.167 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:58.167 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:42:58.167 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:42:58.167 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.168 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.168 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:58.168 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:42:58.168 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:42:58.168 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.168 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.168 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:58.168 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:42:58.168 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:42:58.168 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.168 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.168 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:58.168 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:42:58.168 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:42:58.168 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.168 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.169 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:58.169 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:42:58.169 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:42:58.169 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.169 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.169 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:58.169 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:42:58.169 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:42:58.169 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.169 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.169 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:58.169 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:42:58.169 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:42:58.169 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.169 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:58.169 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.170 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.170 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.170 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:58.170 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:42:58.170 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 32.084436547000003, 2024-04-26T10:42:58.170 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:42:58.170 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:58.170 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.170 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:58.170 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.170 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:58.170 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:42:58.170 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.170 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.171 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.171 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:58.171 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:42:58.171 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.171 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.171 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.171 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:58.171 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:42:58.171 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.171 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.171 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.171 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:58.171 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:42:58.171 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:42:58.171 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.172 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.172 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:58.172 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:42:58.172 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:42:58.172 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.172 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.172 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.172 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:42:58.172 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:42:58.172 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.172 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.172 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:58.172 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:42:58.172 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:42:58.172 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.172 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.173 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:58.173 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:42:58.173 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:42:58.173 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.173 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.173 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:58.173 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:42:58.173 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:42:58.173 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.173 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.173 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:58.173 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:42:58.173 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:42:58.173 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.173 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.174 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:58.174 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:42:58.174 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:42:58.174 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.174 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.174 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:58.174 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:42:58.174 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:42:58.174 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.174 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.174 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:58.174 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:42:58.174 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:42:58.174 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.174 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:58.175 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.175 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.175 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.175 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:58.175 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:42:58.175 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 32.084099950999999, 2024-04-26T10:42:58.175 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:42:58.175 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:58.175 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:58.175 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:58.175 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.175 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:58.175 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:42:58.175 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.175 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.175 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.176 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:58.176 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:42:58.176 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.176 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.176 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.176 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:58.176 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:42:58.176 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:42:58.176 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.176 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.176 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:58.176 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:42:58.176 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:42:58.176 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.176 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.176 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:58.177 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:42:58.177 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:42:58.177 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.177 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.177 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.177 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:42:58.177 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:42:58.177 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.177 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.177 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:58.177 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:42:58.177 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:42:58.177 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.177 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.177 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:58.178 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:42:58.178 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:42:58.178 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.178 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.178 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:58.178 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:42:58.178 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:42:58.178 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.178 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:58.178 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.178 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.178 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.178 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:58.178 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:42:58.178 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 32.084057923000003, 2024-04-26T10:42:58.178 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:42:58.179 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:58.179 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:58.179 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:58.179 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.179 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:58.179 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:42:58.179 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.179 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.179 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.179 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:58.179 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:42:58.179 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.179 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.179 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.179 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:58.180 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:42:58.180 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.180 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.180 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.180 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:58.180 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:42:58.180 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:42:58.180 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.180 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.180 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:58.180 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:42:58.180 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:42:58.180 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.180 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.180 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.180 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:42:58.181 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:42:58.181 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.181 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.181 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:58.181 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:42:58.181 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:42:58.181 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.181 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.181 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:58.181 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:42:58.181 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:42:58.181 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.181 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.181 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:58.181 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:42:58.181 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:42:58.182 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.182 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:58.182 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.182 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.182 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.182 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:58.182 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:42:58.182 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 32.084004751000002, 2024-04-26T10:42:58.182 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:42:58.182 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:58.182 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:58.182 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:58.182 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.182 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:58.183 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:42:58.183 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.183 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.183 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.183 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:58.183 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:42:58.183 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.183 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.183 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.183 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:58.183 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:42:58.183 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.183 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.183 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.183 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:58.183 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:42:58.184 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:42:58.184 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.184 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.184 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:58.184 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:42:58.184 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:42:58.184 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.184 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.184 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.184 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:42:58.184 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:42:58.184 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.184 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.184 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:58.184 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:42:58.184 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:42:58.185 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.185 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.185 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:58.185 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:42:58.185 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:42:58.185 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.185 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.185 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:58.185 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:42:58.185 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:42:58.185 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.185 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:58.185 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.185 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.185 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.186 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:42:58.186 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:42:58.186 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 32.080598340999998, 2024-04-26T10:42:58.186 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:42:58.186 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:58.186 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:42:58.186 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:58.186 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.186 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:58.186 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:42:58.186 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.186 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.186 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.186 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:58.187 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:42:58.187 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.187 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.187 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.187 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:58.187 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:42:58.187 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.187 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.187 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.187 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:58.187 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:42:58.187 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:42:58.187 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.187 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.188 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:58.188 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:42:58.188 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:42:58.188 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.188 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.188 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.188 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:42:58.188 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:42:58.188 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.188 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.188 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:58.188 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:42:58.188 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:42:58.188 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.188 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.188 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:58.189 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:42:58.189 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:42:58.189 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.189 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:58.189 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.189 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.189 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.189 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:42:58.189 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:42:58.189 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 32.078126388000001, 2024-04-26T10:42:58.189 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:42:58.189 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:58.189 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:58.189 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:58.189 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.189 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:58.190 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:42:58.190 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.190 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.190 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.190 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:58.190 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:42:58.190 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.190 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.190 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.190 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:58.190 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:42:58.190 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.190 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.190 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.190 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:58.190 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:42:58.191 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:42:58.191 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.191 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.191 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:58.191 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:42:58.191 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:42:58.191 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.191 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.191 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.191 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:42:58.191 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:42:58.191 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.191 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.191 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:58.191 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:42:58.191 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:42:58.192 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.192 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.192 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:58.192 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:42:58.192 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:42:58.192 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.192 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.192 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:58.192 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:42:58.192 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:42:58.192 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.192 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:58.192 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.192 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.193 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.193 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:42:58.193 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:42:58.193 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 32.077472829999998, 2024-04-26T10:42:58.193 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:42:58.193 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:58.193 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:58.193 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:58.193 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.193 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:58.193 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:42:58.193 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.194 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.194 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.194 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:58.194 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:42:58.194 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.194 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.194 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.194 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:58.194 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:42:58.194 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.194 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.194 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.194 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:58.194 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:42:58.194 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:42:58.195 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.195 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.195 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:58.195 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:42:58.195 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:42:58.195 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.195 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.195 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.195 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:42:58.195 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:42:58.195 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.195 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.195 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:58.195 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:42:58.195 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:42:58.196 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.196 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.196 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:58.196 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:42:58.196 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:42:58.196 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.196 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.196 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:58.196 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:42:58.196 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:42:58.196 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.196 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:58.196 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.196 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.196 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.196 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:42:58.197 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:42:58.197 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 32.077397044999998, 2024-04-26T10:42:58.197 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:42:58.197 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:58.197 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:58.197 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:58.197 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.197 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:58.197 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:42:58.197 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.197 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.197 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.197 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:58.197 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:42:58.197 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.198 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.198 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.198 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:58.198 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:42:58.198 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.198 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.198 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.198 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:58.198 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:42:58.198 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:42:58.198 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.198 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.198 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:58.198 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:42:58.199 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:42:58.199 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.199 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.199 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.199 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:42:58.199 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:42:58.199 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.199 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.199 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:58.199 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:42:58.199 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:42:58.199 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.199 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.199 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:58.199 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:42:58.199 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:42:58.200 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.200 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.200 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:58.200 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:42:58.200 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:42:58.200 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.200 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:58.200 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.200 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.200 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.200 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:42:58.200 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:42:58.200 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 32.077183351000002, 2024-04-26T10:42:58.200 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:42:58.200 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:58.200 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:42:58.200 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:58.201 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.201 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:58.201 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:42:58.201 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.201 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.201 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.201 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:58.201 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:42:58.201 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.201 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.201 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.201 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:58.201 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:42:58.201 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.201 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.202 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.202 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:58.202 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:42:58.202 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:42:58.202 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.202 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.202 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:58.202 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:42:58.202 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:42:58.202 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.202 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.202 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.202 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:42:58.202 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:42:58.202 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.203 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.203 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:58.203 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:42:58.203 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:42:58.203 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.203 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.203 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:58.203 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:42:58.203 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:42:58.203 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.203 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:58.203 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.203 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.203 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.203 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:42:58.203 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:42:58.204 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 32.074739538000003, 2024-04-26T10:42:58.204 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:42:58.204 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:58.204 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:42:58.204 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:58.204 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.204 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:58.204 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:42:58.204 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.204 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.204 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.204 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:58.204 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:42:58.204 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.204 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.204 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.205 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:58.205 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:42:58.205 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:42:58.205 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.205 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.205 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:58.205 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:42:58.205 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:42:58.205 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.205 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.205 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:58.205 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:42:58.205 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:42:58.205 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.205 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.205 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.206 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:42:58.206 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:42:58.206 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.206 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.206 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:58.206 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:42:58.206 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:42:58.206 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.206 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.206 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:58.206 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:42:58.206 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:42:58.206 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.207 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.207 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:58.207 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:42:58.207 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:42:58.207 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.207 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:58.207 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.207 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.207 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.207 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:42:58.207 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:42:58.207 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.624677093999999, 2024-04-26T10:42:58.207 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:42:58.207 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:42:58.207 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.207 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:42:58.208 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.208 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:42:58.208 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:42:58.208 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.208 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.208 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.208 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:42:58.208 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:42:58.208 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:42:58.208 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.208 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.208 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:42:58.208 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:42:58.208 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:42:58.208 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.209 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.209 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:42:58.209 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:42:58.209 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:42:58.209 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.209 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.209 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:42:58.209 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:42:58.209 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:42:58.209 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.209 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.209 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.209 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:42:58.209 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:42:58.209 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.209 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.210 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:42:58.210 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:42:58.210 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:42:58.210 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.210 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.210 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:42:58.210 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:42:58.210 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:42:58.210 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.210 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.210 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:58.210 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:42:58.210 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:42:58.210 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.210 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.211 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:42:58.211 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:42:58.211 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:42:58.211 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.211 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.211 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:58.211 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:42:58.211 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:42:58.211 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.211 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.211 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:42:58.211 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:42:58.211 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:42:58.211 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:42:58.211 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:42:58.211 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:42:58.212 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:42:58.212 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:42:58.212 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.212 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:58.212 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.212 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:42:58.212 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:42:58.212 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:42:58.213 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:42:58.214 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:58.212+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:58.314 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:58.313+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:58.332 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:42:58.332 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:42:58.332 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:42:58.332 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:42:58.341 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:42:58.415 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:58.414+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:42:58.448 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:42:58.448 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:42:58.448 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:42:58.448 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:42:58.448 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:42:58.457 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:42:58.516 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:58.514+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:58.564 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:42:58.564 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:42:58.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:42:58.564 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:42:58.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.564 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:42:58.564 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:42:58.564 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.525818809, 2024-04-26T10:42:58.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:42:58.564 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:42:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:42:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:58.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:42:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:42:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:42:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:42:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:42:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:42:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:42:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:42:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:42:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:42:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:42:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:42:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:42:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:42:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:42:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.568 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:42:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.524068688, 2024-04-26T10:42:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:42:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:42:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:42:58.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:42:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:42:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:42:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:42:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:58.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:42:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:42:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:42:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:42:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:42:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:42:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:42:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:42:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:42:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:42:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:42:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:42:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:42:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:42:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:42:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:42:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:42:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:42:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.573 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:42:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.524015689999999, 2024-04-26T10:42:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:42:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:42:58.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:42:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:42:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:42:58.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:42:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:42:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:42:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:42:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:42:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:42:58.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:42:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:42:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:42:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:42:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:42:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:58.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:42:58.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:42:58.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:58.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:42:58.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:42:58.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:58.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:42:58.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:42:58.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:58.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:42:58.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:42:58.579 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.579 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:58.579 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.579 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:58.579 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:42:58.579 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.523937945999997, 2024-04-26T10:42:58.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:42:58.579 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:58.579 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.579 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:58.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.580 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:58.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:42:58.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.580 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:58.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:42:58.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.580 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:58.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:42:58.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:42:58.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:58.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:42:58.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:42:58.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:58.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:42:58.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:42:58.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:42:58.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:42:58.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:58.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:42:58.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:42:58.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:58.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:42:58.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:42:58.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:58.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:42:58.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:42:58.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:58.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:42:58.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:42:58.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:58.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:42:58.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:42:58.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:58.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:42:58.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:42:58.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:58.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:42:58.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:42:58.584 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.584 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:58.584 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.584 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:58.584 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:42:58.584 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.523898940000002, 2024-04-26T10:42:58.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:42:58.585 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:58.585 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.585 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:58.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:58.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:42:58.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:58.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:42:58.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:58.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:42:58.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:42:58.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:58.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:42:58.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:42:58.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:58.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:42:58.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:42:58.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:42:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:42:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:42:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:42:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:42:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:42:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.588 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:58.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:42:58.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:42:58.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.588 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:58.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:42:58.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:42:58.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.588 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:58.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:42:58.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:42:58.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:58.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:42:58.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:42:58.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:58.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:42:58.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:42:58.589 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.589 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:58.589 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.589 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:58.590 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:42:58.590 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.523880118999998, 2024-04-26T10:42:58.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:42:58.590 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:58.590 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.590 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:58.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:58.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:42:58.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:58.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:42:58.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:58.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:42:58.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:42:58.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:58.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:42:58.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:42:58.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:58.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:42:58.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:42:58.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:42:58.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:42:58.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:58.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:42:58.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:42:58.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:58.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:42:58.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:42:58.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:58.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:42:58.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:42:58.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:58.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:42:58.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:42:58.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:58.594 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:42:58.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:42:58.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:58.594 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:42:58.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:42:58.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:58.594 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:42:58.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:42:58.594 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.595 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:58.595 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.595 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:58.595 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:42:58.595 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.523848117, 2024-04-26T10:42:58.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:42:58.595 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:58.595 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.595 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:58.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.596 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:58.596 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:42:58.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.596 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:58.596 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:42:58.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.596 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:58.596 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:42:58.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:58.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:42:58.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:42:58.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:58.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:42:58.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:42:58.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:42:58.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:42:58.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:58.598 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:42:58.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:42:58.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:58.598 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:42:58.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:42:58.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:58.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:42:58.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:42:58.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.599 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:58.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:42:58.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:42:58.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.599 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:58.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:42:58.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:42:58.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.600 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:58.600 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:42:58.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:42:58.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.600 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:58.600 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:42:58.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:42:58.600 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.600 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:58.600 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.600 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:58.600 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:42:58.601 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.523639309000004, 2024-04-26T10:42:58.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:42:58.601 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:58.601 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.601 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:58.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.601 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:58.601 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:42:58.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.601 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:58.601 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:42:58.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:58.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:42:58.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:42:58.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:58.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:42:58.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:42:58.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:58.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:42:58.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:42:58.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:42:58.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:42:58.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:58.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:42:58.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:42:58.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:58.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:42:58.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:42:58.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:42:58.604 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:42:58.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:42:58.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:42:58.604 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:42:58.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:42:58.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:58.604 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:42:58.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:42:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:42:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:42:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:42:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:42:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:42:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.523608017999997, 2024-04-26T10:42:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:42:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:42:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:42:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:42:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:42:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:42:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:42:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:42:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:42:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:42:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:42:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:42:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:42:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:42:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:42:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:42:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:42:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:42:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.523580768000002, 2024-04-26T10:42:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:42:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:42:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:42:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:42:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:42:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:42:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:42:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:42:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:42:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:42:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:42:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:42:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:42:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:42:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:42:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:42:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:42:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:42:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:42:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.520804017000003, 2024-04-26T10:42:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:42:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:42:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:42:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:42:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:42:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:42:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:42:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:42:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:42:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:42:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:42:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:42:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:42:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:42:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:42:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:42:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:42:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.520753927999998, 2024-04-26T10:42:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:42:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:42:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:42:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:42:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:42:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:42:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:42:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:42:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:42:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:42:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:42:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:42:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:42:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:42:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:42:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:42:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:42:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:42:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:42:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:42:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.519861859000002, 2024-04-26T10:42:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:42:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:42:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:42:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:42:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:42:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:42:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:42:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:42:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:42:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:42:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:42:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:42:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:42:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:42:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:42:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:42:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:42:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:42:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:42:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:42:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.517673530000003, 2024-04-26T10:42:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:42:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:42:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:42:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:42:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:42:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:42:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:42:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:42:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:42:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:42:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:42:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:42:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:42:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:42:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:42:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:42:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:42:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:42:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:42:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:42:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.517538160000001, 2024-04-26T10:42:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:42:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:42:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:42:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:42:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:42:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:42:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:42:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:42:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:42:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:42:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:42:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:42:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:42:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:42:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:42:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:42:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:42:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:42:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:42:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:42:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.517323586000003, 2024-04-26T10:42:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:42:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:42:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:42:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:42:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:42:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:42:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:42:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:42:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:42:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:42:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:42:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:42:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:42:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:42:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:42:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:42:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:42:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:42:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:42:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:42:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.516984645000001, 2024-04-26T10:42:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:42:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:42:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:42:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:42:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:42:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:42:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:42:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:42:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:42:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:42:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:42:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:42:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:42:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:42:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:42:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:42:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:42:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:42:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:42:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:42:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.516875268, 2024-04-26T10:42:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:42:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:42:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:42:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:42:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:42:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:42:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:42:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:42:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:42:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:42:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:42:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:42:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:42:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:42:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:42:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:42:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:42:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:42:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.516835549, 2024-04-26T10:42:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:42:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:42:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:42:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:42:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:42:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:42:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:42:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:42:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:42:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:42:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:42:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:42:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:42:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:42:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:42:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:42:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:42:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:42:58.653 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:42:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:42:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:42:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.516498016, 2024-04-26T10:42:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:42:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:42:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:42:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:42:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:42:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:42:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:42:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:42:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:42:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:42:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:42:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:42:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:42:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:42:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:42:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:42:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:42:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:42:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:42:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:42:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:42:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:42:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:42:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:42:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:42:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:42:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:42:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:42:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:42:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:42:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:42:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:42:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:42:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:42:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:42:58.658 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:42:58.660 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:42:58.660 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:58.658+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:58.758 INFO:teuthology.orchestra.run.smithi049.stderr:noscrub is set 2024-04-26T10:42:58.760 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:58.758+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:58.774 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-26T10:42:58.774 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-26T10:42:58.774 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-26T10:42:58.774 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-26T10:42:58.783 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:42:58.862 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:58.861+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:58.885 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-26T10:42:58.885 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-26T10:42:58.886 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-26T10:42:58.886 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-26T10:42:58.886 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-26T10:42:58.894 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:42:58.963 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:58.961+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:58.966 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:42:58.998 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-26T10:42:58.998 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-26T10:42:58.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-26T10:42:58.998 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-26T10:42:58.998 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:58.998 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:42:58.998 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:42:58.998 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 37.130907286000003, 2024-04-26T10:42:58.998 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086884530000000005, 2024-04-26T10:42:58.999 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:58.999 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:58.999 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:42:58.999 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:42:58.999 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:42:58.999 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 164 2024-04-26T10:42:58.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:58.999 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:58.999 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:58.999 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:58.999 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:42:58.999 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:58.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:59.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:42:59.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:59.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:42:59.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-26T10:42:59.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.000 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.000 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:59.000 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864858+0000", 2024-04-26T10:42:59.000 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3231e-05 2024-04-26T10:42:59.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:59.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864862+0000", 2024-04-26T10:42:59.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9280000000000003e-06 2024-04-26T10:42:59.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:59.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864865+0000", 2024-04-26T10:42:59.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8289999999999999e-06 2024-04-26T10:42:59.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.001 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.001 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:59.001 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869688+0000", 2024-04-26T10:42:59.001 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048234990000000002 2024-04-26T10:42:59.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:59.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869732+0000", 2024-04-26T10:42:59.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3232999999999998e-05 2024-04-26T10:42:59.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:59.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869804+0000", 2024-04-26T10:42:59.002 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2152999999999998e-05 2024-04-26T10:42:59.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.002 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.002 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:59.002 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.872812+0000", 2024-04-26T10:42:59.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003008372 2024-04-26T10:42:59.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:59.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873459+0000", 2024-04-26T10:42:59.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064655699999999997 2024-04-26T10:42:59.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:59.003 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873482+0000", 2024-04-26T10:42:59.003 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3419999999999999e-05 2024-04-26T10:42:59.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.003 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.003 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:59.004 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873504+0000", 2024-04-26T10:42:59.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1440000000000001e-05 2024-04-26T10:42:59.004 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.004 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:59.004 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.004 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.004 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:42:59.004 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:42:59.004 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 37.130854347000003, 2024-04-26T10:42:59.004 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0092811590000000006, 2024-04-26T10:42:59.004 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:59.004 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:59.005 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:42:59.005 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:42:59.005 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:42:59.005 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 165 2024-04-26T10:42:59.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.005 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:59.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:59.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:42:59.005 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.005 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.005 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:59.005 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:42:59.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:59.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:42:59.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:59.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:59.006 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864871+0000", 2024-04-26T10:42:59.006 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2200000000000001e-06 2024-04-26T10:42:59.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.006 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.006 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:59.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864875+0000", 2024-04-26T10:42:59.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.206e-06 2024-04-26T10:42:59.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:59.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864878+0000", 2024-04-26T10:42:59.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5799999999999999e-06 2024-04-26T10:42:59.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:59.007 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873137+0000", 2024-04-26T10:42:59.007 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082591609999999992 2024-04-26T10:42:59.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.007 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.007 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:59.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873186+0000", 2024-04-26T10:42:59.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8741e-05 2024-04-26T10:42:59.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:59.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873252+0000", 2024-04-26T10:42:59.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5877000000000006e-05 2024-04-26T10:42:59.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.008 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:59.008 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873708+0000", 2024-04-26T10:42:59.008 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00045660299999999998 2024-04-26T10:42:59.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.008 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:59.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874091+0000", 2024-04-26T10:42:59.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038295000000000001 2024-04-26T10:42:59.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:59.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874115+0000", 2024-04-26T10:42:59.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:42:59.009 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.009 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.009 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:59.009 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874149+0000", 2024-04-26T10:42:59.009 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4320999999999999e-05 2024-04-26T10:42:59.009 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.009 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:59.010 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.010 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.010 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:42:59.010 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:42:59.010 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.993756712, 2024-04-26T10:42:59.010 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010199138999999999, 2024-04-26T10:42:59.010 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:59.010 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:59.010 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:42:59.010 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:42:59.010 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:42:59.010 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 188 2024-04-26T10:42:59.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.010 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:59.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:59.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:42:59.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:59.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:42:59.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.011 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.011 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:59.011 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:42:59.011 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-26T10:42:59.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:59.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002024+0000", 2024-04-26T10:42:59.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8050999999999997e-05 2024-04-26T10:42:59.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:59.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002034+0000", 2024-04-26T10:42:59.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0217000000000001e-05 2024-04-26T10:42:59.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.012 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.012 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:59.012 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002039+0000", 2024-04-26T10:42:59.012 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6879999999999998e-06 2024-04-26T10:42:59.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:59.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006586+0000", 2024-04-26T10:42:59.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045473570000000001 2024-04-26T10:42:59.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:59.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006626+0000", 2024-04-26T10:42:59.013 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9688999999999999e-05 2024-04-26T10:42:59.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.013 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.013 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:59.013 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006689+0000", 2024-04-26T10:42:59.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3243000000000004e-05 2024-04-26T10:42:59.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:59.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007850+0000", 2024-04-26T10:42:59.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011607989999999999 2024-04-26T10:42:59.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.014 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:59.014 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012084+0000", 2024-04-26T10:42:59.014 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042340069999999997 2024-04-26T10:42:59.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.014 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:59.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012132+0000", 2024-04-26T10:42:59.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8112999999999998e-05 2024-04-26T10:42:59.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.015 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:59.015 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012165+0000", 2024-04-26T10:42:59.015 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3189999999999999e-05 2024-04-26T10:42:59.015 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.015 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:59.015 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.015 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.015 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:42:59.016 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:42:59.016 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.993680011999999, 2024-04-26T10:42:59.016 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010167136, 2024-04-26T10:42:59.016 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:59.016 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:59.016 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:42:59.016 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:42:59.016 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:42:59.016 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 189 2024-04-26T10:42:59.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.016 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:59.016 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.016 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:59.016 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:42:59.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:59.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:42:59.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:59.017 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:42:59.017 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:59.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.017 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.017 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:59.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002044+0000", 2024-04-26T10:42:59.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.119e-06 2024-04-26T10:42:59.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:59.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002047+0000", 2024-04-26T10:42:59.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0199999999999999e-06 2024-04-26T10:42:59.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.018 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:59.018 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002050+0000", 2024-04-26T10:42:59.018 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3360000000000002e-06 2024-04-26T10:42:59.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.018 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:59.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007165+0000", 2024-04-26T10:42:59.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051155879999999999 2024-04-26T10:42:59.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:59.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007209+0000", 2024-04-26T10:42:59.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4097000000000001e-05 2024-04-26T10:42:59.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.019 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.019 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:59.019 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007278+0000", 2024-04-26T10:42:59.019 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8663000000000003e-05 2024-04-26T10:42:59.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:59.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.008047+0000", 2024-04-26T10:42:59.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00076935299999999996 2024-04-26T10:42:59.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:59.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012171+0000", 2024-04-26T10:42:59.020 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004123219 2024-04-26T10:42:59.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.020 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.020 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:59.020 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012193+0000", 2024-04-26T10:42:59.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2169000000000001e-05 2024-04-26T10:42:59.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.021 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:59.021 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012210+0000", 2024-04-26T10:42:59.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6841999999999999e-05 2024-04-26T10:42:59.021 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.021 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:59.021 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.021 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.021 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:59.021 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:42:59.021 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.962216619000003, 2024-04-26T10:42:59.021 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010195469, 2024-04-26T10:42:59.022 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:59.022 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:59.022 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:59.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:59.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:42:59.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.022 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:59.022 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:42:59.022 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:59.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033504+0000", 2024-04-26T10:42:59.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999981 2024-04-26T10:42:59.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:59.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033513+0000", 2024-04-26T10:42:59.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6829999999999997e-06 2024-04-26T10:42:59.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.023 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.023 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:59.023 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033525+0000", 2024-04-26T10:42:59.023 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2748000000000001e-05 2024-04-26T10:42:59.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:59.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033537+0000", 2024-04-26T10:42:59.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1243999999999999e-05 2024-04-26T10:42:59.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:59.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034018+0000", 2024-04-26T10:42:59.024 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048138899999999998 2024-04-26T10:42:59.024 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.024 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.024 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-04-26T10:42:59.024 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034025+0000", 2024-04-26T10:42:59.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8870000000000003e-06 2024-04-26T10:42:59.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:59.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035264+0000", 2024-04-26T10:42:59.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0012385370000000001 2024-04-26T10:42:59.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:59.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035372+0000", 2024-04-26T10:42:59.025 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010851199999999999 2024-04-26T10:42:59.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.025 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.025 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:59.025 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035473+0000", 2024-04-26T10:42:59.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000100967 2024-04-26T10:42:59.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:59.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043270+0000", 2024-04-26T10:42:59.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0077971869999999997 2024-04-26T10:42:59.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.026 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:59.026 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043620+0000", 2024-04-26T10:42:59.026 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034962099999999999 2024-04-26T10:42:59.026 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.026 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:59.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043665+0000", 2024-04-26T10:42:59.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5426999999999997e-05 2024-04-26T10:42:59.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.027 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:59.027 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043701+0000", 2024-04-26T10:42:59.027 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6072000000000003e-05 2024-04-26T10:42:59.027 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.027 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:59.027 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.027 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.027 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:59.028 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:42:59.028 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.961731540000002, 2024-04-26T10:42:59.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099286970000000002, 2024-04-26T10:42:59.028 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:59.028 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:59.028 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:59.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:59.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:42:59.028 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.028 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.028 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:59.028 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:42:59.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:59.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033990+0000", 2024-04-26T10:42:59.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-26T10:42:59.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:59.029 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033998+0000", 2024-04-26T10:42:59.029 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7970000000000001e-06 2024-04-26T10:42:59.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.029 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.029 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:59.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034010+0000", 2024-04-26T10:42:59.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2383e-05 2024-04-26T10:42:59.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:59.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034021+0000", 2024-04-26T10:42:59.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0824e-05 2024-04-26T10:42:59.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.030 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:59.030 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035774+0000", 2024-04-26T10:42:59.030 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017527479999999999 2024-04-26T10:42:59.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.030 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:59.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035929+0000", 2024-04-26T10:42:59.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000155735 2024-04-26T10:42:59.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:59.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036083+0000", 2024-04-26T10:42:59.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000153635 2024-04-26T10:42:59.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.031 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.031 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:59.031 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043369+0000", 2024-04-26T10:42:59.031 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0072854490000000003 2024-04-26T10:42:59.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:59.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043709+0000", 2024-04-26T10:42:59.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034039600000000003 2024-04-26T10:42:59.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:59.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043878+0000", 2024-04-26T10:42:59.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016924799999999999 2024-04-26T10:42:59.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.032 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.032 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:59.032 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043920+0000", 2024-04-26T10:42:59.032 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1471999999999999e-05 2024-04-26T10:42:59.032 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.033 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:59.033 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.033 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:59.033 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:42:59.033 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.961692262, 2024-04-26T10:42:59.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010011091999999999, 2024-04-26T10:42:59.033 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:59.033 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:59.033 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:59.033 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.033 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:59.033 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:42:59.033 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:59.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:42:59.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:59.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:42:59.034 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:59.034 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.034 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.034 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:59.034 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034040+0000", 2024-04-26T10:42:59.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8560000000000002e-06 2024-04-26T10:42:59.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:59.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034048+0000", 2024-04-26T10:42:59.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4139999999999994e-06 2024-04-26T10:42:59.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:59.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034054+0000", 2024-04-26T10:42:59.035 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8950000000000003e-06 2024-04-26T10:42:59.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.035 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:59.035 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036269+0000", 2024-04-26T10:42:59.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002215528 2024-04-26T10:42:59.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.036 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.036 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:59.036 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036364+0000", 2024-04-26T10:42:59.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4089e-05 2024-04-26T10:42:59.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.036 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.036 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:59.036 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036443+0000", 2024-04-26T10:42:59.036 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9666000000000006e-05 2024-04-26T10:42:59.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.036 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.036 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:59.036 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043451+0000", 2024-04-26T10:42:59.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0070081939999999997 2024-04-26T10:42:59.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:59.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043930+0000", 2024-04-26T10:42:59.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00047819799999999999 2024-04-26T10:42:59.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:59.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043999+0000", 2024-04-26T10:42:59.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9136999999999999e-05 2024-04-26T10:42:59.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.037 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.037 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:59.037 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044041+0000", 2024-04-26T10:42:59.037 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2624999999999999e-05 2024-04-26T10:42:59.038 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.038 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:59.038 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.038 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.038 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:59.038 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:42:59.038 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.961653294999998, 2024-04-26T10:42:59.038 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015256755, 2024-04-26T10:42:59.038 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:59.038 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:59.038 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:59.038 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:59.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:42:59.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:59.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:42:59.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.039 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:59.039 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:42:59.039 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:59.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.039 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:59.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034073+0000", 2024-04-26T10:42:59.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1099999999999996e-06 2024-04-26T10:42:59.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:59.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034081+0000", 2024-04-26T10:42:59.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0539999999999995e-06 2024-04-26T10:42:59.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.040 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.040 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:59.040 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034087+0000", 2024-04-26T10:42:59.040 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0240000000000003e-06 2024-04-26T10:42:59.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.041 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:59.041 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036668+0000", 2024-04-26T10:42:59.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002581014 2024-04-26T10:42:59.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.041 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:59.041 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036717+0000", 2024-04-26T10:42:59.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9299999999999999e-05 2024-04-26T10:42:59.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.041 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.041 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:59.041 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036846+0000", 2024-04-26T10:42:59.041 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012901000000000001 2024-04-26T10:42:59.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:59.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044050+0000", 2024-04-26T10:42:59.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007203816 2024-04-26T10:42:59.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:59.042 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049229+0000", 2024-04-26T10:42:59.042 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051792169999999998 2024-04-26T10:42:59.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.042 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.042 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:59.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049282+0000", 2024-04-26T10:42:59.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2605000000000002e-05 2024-04-26T10:42:59.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.043 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:59.043 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049326+0000", 2024-04-26T10:42:59.043 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4255000000000002e-05 2024-04-26T10:42:59.043 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.043 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:59.043 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.043 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.043 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:59.043 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:42:59.044 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.961628632999997, 2024-04-26T10:42:59.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01538838, 2024-04-26T10:42:59.044 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:59.044 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:59.044 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:59.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:59.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:42:59.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.044 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.044 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:59.044 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:42:59.044 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:59.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034093+0000", 2024-04-26T10:42:59.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:59.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:59.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034097+0000", 2024-04-26T10:42:59.045 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.213e-06 2024-04-26T10:42:59.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.045 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.045 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:59.045 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034104+0000", 2024-04-26T10:42:59.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9840000000000004e-06 2024-04-26T10:42:59.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:59.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034111+0000", 2024-04-26T10:42:59.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9199999999999998e-06 2024-04-26T10:42:59.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:59.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.037736+0000", 2024-04-26T10:42:59.046 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036257429999999998 2024-04-26T10:42:59.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.046 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.046 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:59.046 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:42:59.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034004 2024-04-26T10:42:59.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:59.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038526+0000", 2024-04-26T10:42:59.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00044924100000000002 2024-04-26T10:42:59.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:59.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044708+0000", 2024-04-26T10:42:59.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061823360000000001 2024-04-26T10:42:59.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.047 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.047 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:59.047 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:42:59.047 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046886159999999996 2024-04-26T10:42:59.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:59.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049446+0000", 2024-04-26T10:42:59.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.973e-05 2024-04-26T10:42:59.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.048 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:59.048 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049482+0000", 2024-04-26T10:42:59.048 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6004999999999998e-05 2024-04-26T10:42:59.048 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.048 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:59.048 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.048 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.048 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:59.049 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:42:59.049 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.961607112000003, 2024-04-26T10:42:59.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015480648, 2024-04-26T10:42:59.049 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:59.049 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:59.049 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:59.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:59.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:42:59.049 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.049 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.049 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:59.049 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:42:59.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:59.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:42:59.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:59.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:59.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034118+0000", 2024-04-26T10:42:59.050 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1769999999999998e-06 2024-04-26T10:42:59.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.050 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.050 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:59.050 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034126+0000", 2024-04-26T10:42:59.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7770000000000002e-06 2024-04-26T10:42:59.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:59.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034146+0000", 2024-04-26T10:42:59.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0579999999999999e-05 2024-04-26T10:42:59.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:59.051 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039740+0000", 2024-04-26T10:42:59.051 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0055940269999999997 2024-04-26T10:42:59.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.051 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.051 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:59.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039848+0000", 2024-04-26T10:42:59.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010775100000000001 2024-04-26T10:42:59.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:59.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040022+0000", 2024-04-26T10:42:59.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000173964 2024-04-26T10:42:59.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.052 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:59.052 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044721+0000", 2024-04-26T10:42:59.052 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046989099999999997 2024-04-26T10:42:59.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.052 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:59.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049541+0000", 2024-04-26T10:42:59.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048200789999999997 2024-04-26T10:42:59.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:59.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049574+0000", 2024-04-26T10:42:59.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2817000000000001e-05 2024-04-26T10:42:59.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.053 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.053 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:59.053 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049596+0000", 2024-04-26T10:42:59.053 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2011999999999999e-05 2024-04-26T10:42:59.053 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.053 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:59.054 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.054 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:59.054 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:42:59.054 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.961571153000001, 2024-04-26T10:42:59.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015538033, 2024-04-26T10:42:59.054 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:59.054 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:59.054 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:59.054 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.054 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:59.054 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:42:59.054 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:59.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:42:59.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:59.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:42:59.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:59.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.055 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.055 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:59.055 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034155+0000", 2024-04-26T10:42:59.055 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.177e-06 2024-04-26T10:42:59.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:59.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034161+0000", 2024-04-26T10:42:59.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0780000000000001e-06 2024-04-26T10:42:59.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:59.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034168+0000", 2024-04-26T10:42:59.056 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8689999999999998e-06 2024-04-26T10:42:59.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.056 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.056 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:59.056 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041069+0000", 2024-04-26T10:42:59.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069010440000000003 2024-04-26T10:42:59.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:59.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041221+0000", 2024-04-26T10:42:59.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015175 2024-04-26T10:42:59.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:59.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041350+0000", 2024-04-26T10:42:59.057 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012870899999999999 2024-04-26T10:42:59.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.057 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:59.057 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045386+0000", 2024-04-26T10:42:59.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040364789999999999 2024-04-26T10:42:59.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:59.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049641+0000", 2024-04-26T10:42:59.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042552120000000004 2024-04-26T10:42:59.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:59.058 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049669+0000", 2024-04-26T10:42:59.058 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7809000000000001e-05 2024-04-26T10:42:59.058 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.058 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.058 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:59.059 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049689+0000", 2024-04-26T10:42:59.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0336e-05 2024-04-26T10:42:59.059 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.059 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:59.059 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.059 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.059 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:59.059 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:42:59.059 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.961549324000003, 2024-04-26T10:42:59.059 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015595107, 2024-04-26T10:42:59.059 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:59.059 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:59.059 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:59.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.060 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:59.060 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:42:59.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.060 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:59.060 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:42:59.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.060 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:59.060 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:42:59.060 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:59.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.060 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.060 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:59.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034176+0000", 2024-04-26T10:42:59.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0089999999999999e-06 2024-04-26T10:42:59.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:59.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034182+0000", 2024-04-26T10:42:59.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4579999999999998e-06 2024-04-26T10:42:59.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:59.061 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034187+0000", 2024-04-26T10:42:59.061 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0880000000000002e-06 2024-04-26T10:42:59.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.061 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.061 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:59.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045564+0000", 2024-04-26T10:42:59.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011376475 2024-04-26T10:42:59.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:59.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045623+0000", 2024-04-26T10:42:59.062 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9388999999999997e-05 2024-04-26T10:42:59.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.062 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:59.062 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045713+0000", 2024-04-26T10:42:59.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0211999999999996e-05 2024-04-26T10:42:59.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.065 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.065 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:59.065 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046325+0000", 2024-04-26T10:42:59.065 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00061181699999999996 2024-04-26T10:42:59.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:59.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049722+0000", 2024-04-26T10:42:59.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033962380000000002 2024-04-26T10:42:59.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:59.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049750+0000", 2024-04-26T10:42:59.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8087000000000001e-05 2024-04-26T10:42:59.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.066 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.066 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:59.066 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049768+0000", 2024-04-26T10:42:59.066 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8681999999999998e-05 2024-04-26T10:42:59.067 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.067 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:59.067 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.067 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:59.067 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:42:59.067 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.961335800000001, 2024-04-26T10:42:59.067 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087543810000000003, 2024-04-26T10:42:59.067 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:59.067 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:59.067 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:59.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.067 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:59.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:42:59.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:59.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:42:59.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.068 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.068 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:59.068 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034386+0000", 2024-04-26T10:42:59.068 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-26T10:42:59.068 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:59.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034397+0000", 2024-04-26T10:42:59.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0878e-05 2024-04-26T10:42:59.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:59.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034408+0000", 2024-04-26T10:42:59.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1138000000000001e-05 2024-04-26T10:42:59.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.069 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.069 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:59.069 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034414+0000", 2024-04-26T10:42:59.069 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2910000000000004e-06 2024-04-26T10:42:59.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:59.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036009+0000", 2024-04-26T10:42:59.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0015952029999999999 2024-04-26T10:42:59.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:59.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036120+0000", 2024-04-26T10:42:59.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000110584 2024-04-26T10:42:59.070 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.070 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.070 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:42:59.070 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036225+0000", 2024-04-26T10:42:59.070 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010523599999999999 2024-04-26T10:42:59.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:59.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039276+0000", 2024-04-26T10:42:59.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003050404 2024-04-26T10:42:59.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:59.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:42:59.071 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037356099999999999 2024-04-26T10:42:59.071 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.071 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.071 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:59.071 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043079+0000", 2024-04-26T10:42:59.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8099e-05 2024-04-26T10:42:59.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.072 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:59.072 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043141+0000", 2024-04-26T10:42:59.072 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1655999999999994e-05 2024-04-26T10:42:59.072 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.072 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:59.072 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.072 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.072 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:59.072 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:42:59.073 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.961275243000003, 2024-04-26T10:42:59.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090131610000000004, 2024-04-26T10:42:59.073 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:59.073 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:59.073 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:59.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:59.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:42:59.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.073 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.073 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:59.073 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:42:59.073 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:59.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:42:59.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:59.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:59.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034451+0000", 2024-04-26T10:42:59.074 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9600000000000002e-06 2024-04-26T10:42:59.074 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.074 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.074 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:59.074 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034458+0000", 2024-04-26T10:42:59.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5820000000000004e-06 2024-04-26T10:42:59.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:59.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034463+0000", 2024-04-26T10:42:59.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0719999999999999e-06 2024-04-26T10:42:59.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:59.075 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036527+0000", 2024-04-26T10:42:59.075 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002063755 2024-04-26T10:42:59.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.075 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.075 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:59.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036610+0000", 2024-04-26T10:42:59.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2669000000000004e-05 2024-04-26T10:42:59.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:42:59.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036744+0000", 2024-04-26T10:42:59.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013412499999999999 2024-04-26T10:42:59.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:59.076 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040144+0000", 2024-04-26T10:42:59.076 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033999799999999999 2024-04-26T10:42:59.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.076 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.076 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:59.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043301+0000", 2024-04-26T10:42:59.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031572240000000001 2024-04-26T10:42:59.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:59.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043425+0000", 2024-04-26T10:42:59.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000123664 2024-04-26T10:42:59.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.077 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.077 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:59.077 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043460+0000", 2024-04-26T10:42:59.077 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5651000000000001e-05 2024-04-26T10:42:59.077 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.077 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:59.077 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.078 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:59.078 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:42:59.078 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.961250343000003, 2024-04-26T10:42:59.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086028210000000001, 2024-04-26T10:42:59.078 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:59.078 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:59.078 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:59.078 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.078 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:59.078 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:42:59.078 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:59.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:42:59.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:59.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:42:59.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:59.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.079 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.079 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:59.079 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034482+0000", 2024-04-26T10:42:59.079 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8630000000000003e-06 2024-04-26T10:42:59.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:59.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034494+0000", 2024-04-26T10:42:59.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-04-26T10:42:59.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:59.080 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034501+0000", 2024-04-26T10:42:59.080 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7050000000000002e-06 2024-04-26T10:42:59.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.080 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.080 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:59.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035138+0000", 2024-04-26T10:42:59.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00063744099999999998 2024-04-26T10:42:59.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:59.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035286+0000", 2024-04-26T10:42:59.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014766200000000001 2024-04-26T10:42:59.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:42:59.081 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035654+0000", 2024-04-26T10:42:59.081 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00036779100000000002 2024-04-26T10:42:59.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.081 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040833+0000", 2024-04-26T10:42:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051795640000000002 2024-04-26T10:42:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.042886+0000", 2024-04-26T10:42:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020531220000000001 2024-04-26T10:42:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043015+0000", 2024-04-26T10:42:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012824099999999999 2024-04-26T10:42:59.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043075+0000", 2024-04-26T10:42:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0262e-05 2024-04-26T10:42:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:42:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.961214380000001, 2024-04-26T10:42:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01482116, 2024-04-26T10:42:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:59.083 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:42:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:42:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:59.084 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:42:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034515+0000", 2024-04-26T10:42:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.391e-06 2024-04-26T10:42:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034522+0000", 2024-04-26T10:42:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7889999999999997e-06 2024-04-26T10:42:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.085 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034601+0000", 2024-04-26T10:42:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9547000000000003e-05 2024-04-26T10:42:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036510+0000", 2024-04-26T10:42:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019092289999999999 2024-04-26T10:42:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036642+0000", 2024-04-26T10:42:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013151100000000001 2024-04-26T10:42:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036766+0000", 2024-04-26T10:42:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012367300000000001 2024-04-26T10:42:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040749+0000", 2024-04-26T10:42:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039838419999999996 2024-04-26T10:42:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049262+0000", 2024-04-26T10:42:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085127789999999998 2024-04-26T10:42:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.087 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:59.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049301+0000", 2024-04-26T10:42:59.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8834000000000001e-05 2024-04-26T10:42:59.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.088 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.088 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:59.088 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049329+0000", 2024-04-26T10:42:59.088 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.817e-05 2024-04-26T10:42:59.088 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.088 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:59.088 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:42:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.961081683000003, 2024-04-26T10:42:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014796093999999999, 2024-04-26T10:42:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:42:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:42:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034640+0000", 2024-04-26T10:42:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:59.090 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034650+0000", 2024-04-26T10:42:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0064999999999999e-05 2024-04-26T10:42:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034660+0000", 2024-04-26T10:42:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.961e-06 2024-04-26T10:42:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034680+0000", 2024-04-26T10:42:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9219e-05 2024-04-26T10:42:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:59.091 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.037926+0000", 2024-04-26T10:42:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032460380000000001 2024-04-26T10:42:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038068+0000", 2024-04-26T10:42:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014236000000000001 2024-04-26T10:42:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038201+0000", 2024-04-26T10:42:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013345300000000001 2024-04-26T10:42:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:59.092 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043497+0000", 2024-04-26T10:42:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052952770000000001 2024-04-26T10:42:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049373+0000", 2024-04-26T10:42:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058762900000000002 2024-04-26T10:42:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049411+0000", 2024-04-26T10:42:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7737000000000001e-05 2024-04-26T10:42:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:59.093 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049437+0000", 2024-04-26T10:42:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6169999999999998e-05 2024-04-26T10:42:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:42:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.961037173000001, 2024-04-26T10:42:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0092140799999999995, 2024-04-26T10:42:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:59.094 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:42:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:42:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:42:59.095 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034688+0000", 2024-04-26T10:42:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5480000000000002e-06 2024-04-26T10:42:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034694+0000", 2024-04-26T10:42:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1310000000000003e-06 2024-04-26T10:42:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034700+0000", 2024-04-26T10:42:59.096 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4229999999999996e-06 2024-04-26T10:42:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036183+0000", 2024-04-26T10:42:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001482964 2024-04-26T10:42:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036297+0000", 2024-04-26T10:42:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113649 2024-04-26T10:42:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:42:59.097 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036426+0000", 2024-04-26T10:42:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012924900000000001 2024-04-26T10:42:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040839+0000", 2024-04-26T10:42:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044137079999999997 2024-04-26T10:42:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043679+0000", 2024-04-26T10:42:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028397850000000001 2024-04-26T10:42:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.098 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043725+0000", 2024-04-26T10:42:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5859999999999998e-05 2024-04-26T10:42:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043899+0000", 2024-04-26T10:42:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000174267 2024-04-26T10:42:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:59.099 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:42:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.961014239000001, 2024-04-26T10:42:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011493046999999999, 2024-04-26T10:42:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:42:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:42:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:42:59.100 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:42:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:42:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034711+0000", 2024-04-26T10:42:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4359999999999998e-06 2024-04-26T10:42:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034717+0000", 2024-04-26T10:42:59.101 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7939999999999999e-06 2024-04-26T10:42:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034723+0000", 2024-04-26T10:42:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6219999999999997e-06 2024-04-26T10:42:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035221+0000", 2024-04-26T10:42:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00049811199999999999 2024-04-26T10:42:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:59.102 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035351+0000", 2024-04-26T10:42:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013049200000000001 2024-04-26T10:42:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:42:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035467+0000", 2024-04-26T10:42:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115364 2024-04-26T10:42:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:42:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040085+0000", 2024-04-26T10:42:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046182300000000001 2024-04-26T10:42:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:42:59.103 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046133+0000", 2024-04-26T10:42:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060476059999999996 2024-04-26T10:42:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:42:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046165+0000", 2024-04-26T10:42:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2155e-05 2024-04-26T10:42:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046201+0000", 2024-04-26T10:42:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6566999999999997e-05 2024-04-26T10:42:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.104 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:42:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:42:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 32.960927830000003, 2024-04-26T10:42:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014742026, 2024-04-26T10:42:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:42:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-26T10:42:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:42:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:42:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:42:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:42:59.105 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:42:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:42:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:42:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034793+0000", 2024-04-26T10:42:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-26T10:42:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:42:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034802+0000", 2024-04-26T10:42:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.551e-06 2024-04-26T10:42:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.106 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:42:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034815+0000", 2024-04-26T10:42:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2706e-05 2024-04-26T10:42:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:42:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034824+0000", 2024-04-26T10:42:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5189999999999998e-06 2024-04-26T10:42:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:42:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039312+0000", 2024-04-26T10:42:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044874030000000001 2024-04-26T10:42:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.107 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:42:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039457+0000", 2024-04-26T10:42:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000145081 2024-04-26T10:42:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:42:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:42:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:42:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049537+0000", 2024-04-26T10:42:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010080053 2024-04-26T10:42:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:42:59.108 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:42:59.108 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-26T10:42:59.109 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:42:59.110 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:42:59.110 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:42:59.111 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:59.108+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:59.117 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1: {} 2024-04-26T10:42:59.118 INFO:teuthology.orchestra.run.smithi049.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:42:59.135 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:42:59.135 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:42:59.211 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:59.209+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:59.223 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:59.223 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:59.233 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:42:59.317 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:59.316+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:59.376 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:59.376 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:59.385 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:42:59.412 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:59.411+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:59.513 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:59.512+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:59.527 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:59.528 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:59.536 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:42:59.614 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:59.613+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:59.654 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:59.655 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:59.664 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:42:59.714 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:42:59.713+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:42:59.770 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:59.771 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:59.779 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:42:59.823 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:42:59.821+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:42:59.886 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:42:59.886 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:42:59.894 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:42:59.938 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:42:59.937+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:00.006 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:00.006 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:00.015 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:43:00.017 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:00.016+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:00.118 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:00.117+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:00.160 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:00.160 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:00.169 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:43:00.218 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:00.217+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:00.310 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:00.310 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:00.319 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:00.320 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:00.318+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:00.420 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:00.419+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:00.433 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:00.433 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:00.443 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:00.522 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:00.520+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:00.544 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:00.545 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:00.554 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:00.623 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:00.622+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:00.655 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:00.656 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:00.664 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:00.724 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:00.723+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:00.768 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T10:43:00.768 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:43:00.769 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-26T10:43:00.769 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T10:43:00.774 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:43:00.782 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:00.782 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:00.792 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:00.837 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:00.835+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:00.899 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:00.899 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:00.908 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:00.950 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:00.947+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:01.027 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:01.026+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:01.055 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:01.055 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:01.064 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:43:01.082 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:43:01.083 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-04-26T10:43:01.083 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 22, 2024-04-26T10:43:01.083 INFO:teuthology.orchestra.run.smithi049.stdout: "fsid": "9837de44-a9e8-4979-adc4-611f3ddc44ce", 2024-04-26T10:43:01.083 INFO:teuthology.orchestra.run.smithi049.stdout: "created": "2024-04-26T10:42:11.337159+0000", 2024-04-26T10:43:01.083 INFO:teuthology.orchestra.run.smithi049.stdout: "modified": "2024-04-26T10:42:58.751460+0000", 2024-04-26T10:43:01.083 INFO:teuthology.orchestra.run.smithi049.stdout: "last_up_change": "2024-04-26T10:42:19.397933+0000", 2024-04-26T10:43:01.083 INFO:teuthology.orchestra.run.smithi049.stdout: "last_in_change": "2024-04-26T10:42:12.136647+0000", 2024-04-26T10:43:01.083 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T10:43:01.083 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_num": 5801984, 2024-04-26T10:43:01.083 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_set": [ 2024-04-26T10:43:01.083 INFO:teuthology.orchestra.run.smithi049.stdout: "noscrub", 2024-04-26T10:43:01.083 INFO:teuthology.orchestra.run.smithi049.stdout: "pglog_hardlimit", 2024-04-26T10:43:01.084 INFO:teuthology.orchestra.run.smithi049.stdout: "purged_snapdirs", 2024-04-26T10:43:01.084 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_deletes", 2024-04-26T10:43:01.084 INFO:teuthology.orchestra.run.smithi049.stdout: "sortbitwise" 2024-04-26T10:43:01.084 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-04-26T10:43:01.084 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_version": 4, 2024-04-26T10:43:01.084 INFO:teuthology.orchestra.run.smithi049.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T10:43:01.084 INFO:teuthology.orchestra.run.smithi049.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T10:43:01.085 INFO:teuthology.orchestra.run.smithi049.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T10:43:01.085 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_snapshot": "", 2024-04-26T10:43:01.085 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_max": 4, 2024-04-26T10:43:01.085 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd": 3, 2024-04-26T10:43:01.085 INFO:teuthology.orchestra.run.smithi049.stdout: "require_min_compat_client": "luminous", 2024-04-26T10:43:01.085 INFO:teuthology.orchestra.run.smithi049.stdout: "min_compat_client": "jewel", 2024-04-26T10:43:01.085 INFO:teuthology.orchestra.run.smithi049.stdout: "require_osd_release": "reef", 2024-04-26T10:43:01.085 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_crimson": false, 2024-04-26T10:43:01.085 INFO:teuthology.orchestra.run.smithi049.stdout: "pools": [ 2024-04-26T10:43:01.085 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.085 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 1, 2024-04-26T10:43:01.085 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": ".mgr", 2024-04-26T10:43:01.087 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2024-04-26T10:42:19.632084+0000", 2024-04-26T10:43:01.087 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-04-26T10:43:01.087 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2024-04-26T10:43:01.087 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2024-04-26T10:43:01.087 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2024-04-26T10:43:01.087 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2024-04-26T10:43:01.087 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2024-04-26T10:43:01.087 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:43:01.087 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:43:01.087 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:43:01.087 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:43:01.087 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2024-04-26T10:43:01.087 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:43:01.088 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 1, 2024-04-26T10:43:01.088 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 1, 2024-04-26T10:43:01.088 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 1, 2024-04-26T10:43:01.088 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 1, 2024-04-26T10:43:01.088 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 1, 2024-04-26T10:43:01.088 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2024-04-26T10:43:01.088 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2024-04-26T10:43:01.088 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2024-04-26T10:43:01.088 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2024-04-26T10:43:01.088 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2024-04-26T10:43:01.088 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2024-04-26T10:43:01.088 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2024-04-26T10:43:01.088 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.088 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "11", 2024-04-26T10:43:01.089 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2024-04-26T10:43:01.089 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:43:01.089 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:43:01.089 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2024-04-26T10:43:01.089 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:43:01.089 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2024-04-26T10:43:01.089 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2024-04-26T10:43:01.089 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2024-04-26T10:43:01.089 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2024-04-26T10:43:01.089 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2024-04-26T10:43:01.089 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2024-04-26T10:43:01.089 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2024-04-26T10:43:01.089 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2024-04-26T10:43:01.089 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2024-04-26T10:43:01.090 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2024-04-26T10:43:01.090 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2024-04-26T10:43:01.090 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2024-04-26T10:43:01.090 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2024-04-26T10:43:01.090 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:43:01.090 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:43:01.090 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:43:01.090 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2024-04-26T10:43:01.090 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2024-04-26T10:43:01.090 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2024-04-26T10:43:01.090 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2024-04-26T10:43:01.090 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2024-04-26T10:43:01.090 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.091 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2024-04-26T10:43:01.091 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2024-04-26T10:43:01.091 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2024-04-26T10:43:01.091 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:43:01.091 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:43:01.091 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:43:01.091 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:43:01.091 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2024-04-26T10:43:01.091 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2024-04-26T10:43:01.091 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2024-04-26T10:43:01.091 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2024-04-26T10:43:01.091 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2024-04-26T10:43:01.091 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_max": 32, 2024-04-26T10:43:01.091 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 1 2024-04-26T10:43:01.091 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.092 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2024-04-26T10:43:01.092 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": {} 2024-04-26T10:43:01.092 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.092 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2024-04-26T10:43:01.092 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 2.9900000095367432, 2024-04-26T10:43:01.092 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 2.9900000095367432, 2024-04-26T10:43:01.092 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T10:43:01.092 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 2, 2024-04-26T10:43:01.092 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 2, 2024-04-26T10:43:01.092 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:43:01.092 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2024-04-26T10:43:01.092 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:43:01.092 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:43:01.092 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.092 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.093 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 2, 2024-04-26T10:43:01.093 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "rbd", 2024-04-26T10:43:01.093 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2024-04-26T10:42:19.779089+0000", 2024-04-26T10:43:01.093 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-04-26T10:43:01.093 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2024-04-26T10:43:01.093 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2024-04-26T10:43:01.093 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2024-04-26T10:43:01.093 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2024-04-26T10:43:01.093 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2024-04-26T10:43:01.093 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:43:01.093 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:43:01.093 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:43:01.093 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:43:01.093 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2024-04-26T10:43:01.094 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:43:01.094 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 8, 2024-04-26T10:43:01.094 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 8, 2024-04-26T10:43:01.094 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 8, 2024-04-26T10:43:01.094 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 8, 2024-04-26T10:43:01.094 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 8, 2024-04-26T10:43:01.094 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2024-04-26T10:43:01.094 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2024-04-26T10:43:01.094 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2024-04-26T10:43:01.094 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2024-04-26T10:43:01.094 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2024-04-26T10:43:01.094 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2024-04-26T10:43:01.094 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2024-04-26T10:43:01.095 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.095 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "11", 2024-04-26T10:43:01.095 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2024-04-26T10:43:01.095 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:43:01.095 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:43:01.095 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2024-04-26T10:43:01.095 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:43:01.095 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2024-04-26T10:43:01.095 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2024-04-26T10:43:01.095 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2024-04-26T10:43:01.095 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2024-04-26T10:43:01.095 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2024-04-26T10:43:01.095 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2024-04-26T10:43:01.095 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2024-04-26T10:43:01.096 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2024-04-26T10:43:01.096 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2024-04-26T10:43:01.096 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2024-04-26T10:43:01.096 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2024-04-26T10:43:01.096 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2024-04-26T10:43:01.096 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2024-04-26T10:43:01.096 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:43:01.096 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:43:01.096 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:43:01.096 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2024-04-26T10:43:01.096 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2024-04-26T10:43:01.096 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2024-04-26T10:43:01.096 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2024-04-26T10:43:01.096 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2024-04-26T10:43:01.097 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.097 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2024-04-26T10:43:01.097 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2024-04-26T10:43:01.097 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2024-04-26T10:43:01.097 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:43:01.097 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:43:01.097 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:43:01.097 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:43:01.097 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2024-04-26T10:43:01.097 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2024-04-26T10:43:01.097 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2024-04-26T10:43:01.097 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2024-04-26T10:43:01.097 INFO:teuthology.orchestra.run.smithi049.stdout: "options": {}, 2024-04-26T10:43:01.097 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2024-04-26T10:43:01.098 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd": {} 2024-04-26T10:43:01.098 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.098 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2024-04-26T10:43:01.098 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.5, 2024-04-26T10:43:01.098 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.5, 2024-04-26T10:43:01.098 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2024-04-26T10:43:01.098 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.5, 2024-04-26T10:43:01.098 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.5, 2024-04-26T10:43:01.098 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:43:01.098 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2024-04-26T10:43:01.098 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:43:01.098 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:43:01.098 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.098 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.099 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 3, 2024-04-26T10:43:01.099 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_metadata", 2024-04-26T10:43:01.099 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2024-04-26T10:42:24.266614+0000", 2024-04-26T10:43:01.099 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-04-26T10:43:01.099 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2024-04-26T10:43:01.099 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2024-04-26T10:43:01.099 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2024-04-26T10:43:01.099 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2024-04-26T10:43:01.099 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2024-04-26T10:43:01.099 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:43:01.099 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:43:01.099 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:43:01.099 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:43:01.099 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2024-04-26T10:43:01.100 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:43:01.100 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 32, 2024-04-26T10:43:01.100 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 32, 2024-04-26T10:43:01.100 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 32, 2024-04-26T10:43:01.100 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 32, 2024-04-26T10:43:01.100 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 32, 2024-04-26T10:43:01.100 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2024-04-26T10:43:01.100 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2024-04-26T10:43:01.100 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2024-04-26T10:43:01.100 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2024-04-26T10:43:01.100 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2024-04-26T10:43:01.100 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2024-04-26T10:43:01.100 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2024-04-26T10:43:01.100 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.101 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "14", 2024-04-26T10:43:01.101 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2024-04-26T10:43:01.101 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:43:01.101 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:43:01.101 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2024-04-26T10:43:01.101 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:43:01.101 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2024-04-26T10:43:01.101 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2024-04-26T10:43:01.101 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2024-04-26T10:43:01.101 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2024-04-26T10:43:01.101 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2024-04-26T10:43:01.101 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2024-04-26T10:43:01.101 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2024-04-26T10:43:01.101 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2024-04-26T10:43:01.102 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2024-04-26T10:43:01.102 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2024-04-26T10:43:01.102 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2024-04-26T10:43:01.102 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2024-04-26T10:43:01.102 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2024-04-26T10:43:01.102 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:43:01.102 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:43:01.102 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:43:01.102 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2024-04-26T10:43:01.102 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2024-04-26T10:43:01.102 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2024-04-26T10:43:01.102 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2024-04-26T10:43:01.102 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2024-04-26T10:43:01.102 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.103 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2024-04-26T10:43:01.103 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2024-04-26T10:43:01.103 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2024-04-26T10:43:01.103 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:43:01.103 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:43:01.103 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:43:01.103 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:43:01.103 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2024-04-26T10:43:01.103 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2024-04-26T10:43:01.103 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2024-04-26T10:43:01.103 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2024-04-26T10:43:01.103 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2024-04-26T10:43:01.103 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_bias": 4, 2024-04-26T10:43:01.103 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 16, 2024-04-26T10:43:01.103 INFO:teuthology.orchestra.run.smithi049.stdout: "recovery_priority": 5 2024-04-26T10:43:01.104 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.104 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2024-04-26T10:43:01.104 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2024-04-26T10:43:01.104 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": "cephfs" 2024-04-26T10:43:01.104 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:43:01.104 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.104 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2024-04-26T10:43:01.104 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.1299999952316284, 2024-04-26T10:43:01.104 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.1299999952316284, 2024-04-26T10:43:01.104 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2024-04-26T10:43:01.104 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T10:43:01.104 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T10:43:01.104 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:43:01.105 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2024-04-26T10:43:01.105 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:43:01.105 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:43:01.105 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.105 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.105 INFO:teuthology.orchestra.run.smithi049.stdout: "pool": 4, 2024-04-26T10:43:01.105 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": "cephfs_data", 2024-04-26T10:43:01.105 INFO:teuthology.orchestra.run.smithi049.stdout: "create_time": "2024-04-26T10:42:25.014684+0000", 2024-04-26T10:43:01.105 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-04-26T10:43:01.105 INFO:teuthology.orchestra.run.smithi049.stdout: "flags_names": "hashpspool", 2024-04-26T10:43:01.105 INFO:teuthology.orchestra.run.smithi049.stdout: "type": 1, 2024-04-26T10:43:01.105 INFO:teuthology.orchestra.run.smithi049.stdout: "size": 2, 2024-04-26T10:43:01.105 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": 1, 2024-04-26T10:43:01.105 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_rule": 0, 2024-04-26T10:43:01.105 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:43:01.105 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:43:01.106 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:43:01.106 INFO:teuthology.orchestra.run.smithi049.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:43:01.106 INFO:teuthology.orchestra.run.smithi049.stdout: "object_hash": 2, 2024-04-26T10:43:01.106 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:43:01.106 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": 64, 2024-04-26T10:43:01.106 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num": 64, 2024-04-26T10:43:01.106 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_placement_num_target": 64, 2024-04-26T10:43:01.106 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_target": 64, 2024-04-26T10:43:01.106 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_pending": 64, 2024-04-26T10:43:01.106 INFO:teuthology.orchestra.run.smithi049.stdout: "last_pg_merge_meta": { 2024-04-26T10:43:01.106 INFO:teuthology.orchestra.run.smithi049.stdout: "source_pgid": "0.0", 2024-04-26T10:43:01.106 INFO:teuthology.orchestra.run.smithi049.stdout: "ready_epoch": 0, 2024-04-26T10:43:01.106 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_started": 0, 2024-04-26T10:43:01.106 INFO:teuthology.orchestra.run.smithi049.stdout: "last_epoch_clean": 0, 2024-04-26T10:43:01.107 INFO:teuthology.orchestra.run.smithi049.stdout: "source_version": "0'0", 2024-04-26T10:43:01.107 INFO:teuthology.orchestra.run.smithi049.stdout: "target_version": "0'0" 2024-04-26T10:43:01.107 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.107 INFO:teuthology.orchestra.run.smithi049.stdout: "last_change": "15", 2024-04-26T10:43:01.107 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend": "0", 2024-04-26T10:43:01.107 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:43:01.107 INFO:teuthology.orchestra.run.smithi049.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:43:01.107 INFO:teuthology.orchestra.run.smithi049.stdout: "auid": 0, 2024-04-26T10:43:01.107 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:43:01.107 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_seq": 0, 2024-04-26T10:43:01.107 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_epoch": 0, 2024-04-26T10:43:01.107 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_snaps": [], 2024-04-26T10:43:01.107 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps": "[]", 2024-04-26T10:43:01.107 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_bytes": 0, 2024-04-26T10:43:01.108 INFO:teuthology.orchestra.run.smithi049.stdout: "quota_max_objects": 0, 2024-04-26T10:43:01.108 INFO:teuthology.orchestra.run.smithi049.stdout: "tiers": [], 2024-04-26T10:43:01.108 INFO:teuthology.orchestra.run.smithi049.stdout: "tier_of": -1, 2024-04-26T10:43:01.108 INFO:teuthology.orchestra.run.smithi049.stdout: "read_tier": -1, 2024-04-26T10:43:01.108 INFO:teuthology.orchestra.run.smithi049.stdout: "write_tier": -1, 2024-04-26T10:43:01.108 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_mode": "none", 2024-04-26T10:43:01.108 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_bytes": 0, 2024-04-26T10:43:01.108 INFO:teuthology.orchestra.run.smithi049.stdout: "target_max_objects": 0, 2024-04-26T10:43:01.108 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:43:01.108 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:43:01.108 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:43:01.108 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_flush_age": 0, 2024-04-26T10:43:01.108 INFO:teuthology.orchestra.run.smithi049.stdout: "cache_min_evict_age": 0, 2024-04-26T10:43:01.108 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profile": "", 2024-04-26T10:43:01.109 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_params": { 2024-04-26T10:43:01.109 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "none" 2024-04-26T10:43:01.109 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.109 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_period": 0, 2024-04-26T10:43:01.109 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_count": 0, 2024-04-26T10:43:01.109 INFO:teuthology.orchestra.run.smithi049.stdout: "use_gmt_hitset": true, 2024-04-26T10:43:01.109 INFO:teuthology.orchestra.run.smithi049.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:43:01.109 INFO:teuthology.orchestra.run.smithi049.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:43:01.109 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:43:01.109 INFO:teuthology.orchestra.run.smithi049.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:43:01.109 INFO:teuthology.orchestra.run.smithi049.stdout: "grade_table": [], 2024-04-26T10:43:01.109 INFO:teuthology.orchestra.run.smithi049.stdout: "stripe_width": 0, 2024-04-26T10:43:01.109 INFO:teuthology.orchestra.run.smithi049.stdout: "expected_num_objects": 0, 2024-04-26T10:43:01.109 INFO:teuthology.orchestra.run.smithi049.stdout: "fast_read": false, 2024-04-26T10:43:01.110 INFO:teuthology.orchestra.run.smithi049.stdout: "options": { 2024-04-26T10:43:01.110 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num_min": 64, 2024-04-26T10:43:01.110 INFO:teuthology.orchestra.run.smithi049.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T10:43:01.110 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.110 INFO:teuthology.orchestra.run.smithi049.stdout: "application_metadata": { 2024-04-26T10:43:01.110 INFO:teuthology.orchestra.run.smithi049.stdout: "cephfs": { 2024-04-26T10:43:01.110 INFO:teuthology.orchestra.run.smithi049.stdout: "data": "cephfs" 2024-04-26T10:43:01.110 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:43:01.110 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.113 INFO:teuthology.orchestra.run.smithi049.stdout: "read_balance": { 2024-04-26T10:43:01.113 INFO:teuthology.orchestra.run.smithi049.stdout: "score_acting": 1.1299999952316284, 2024-04-26T10:43:01.114 INFO:teuthology.orchestra.run.smithi049.stdout: "score_stable": 1.1299999952316284, 2024-04-26T10:43:01.114 INFO:teuthology.orchestra.run.smithi049.stdout: "optimal_score": 1, 2024-04-26T10:43:01.114 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T10:43:01.114 INFO:teuthology.orchestra.run.smithi049.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T10:43:01.114 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:43:01.114 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity": 1, 2024-04-26T10:43:01.114 INFO:teuthology.orchestra.run.smithi049.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:43:01.114 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:43:01.114 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:43:01.114 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-04-26T10:43:01.114 INFO:teuthology.orchestra.run.smithi049.stdout: "osds": [ 2024-04-26T10:43:01.114 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.114 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2024-04-26T10:43:01.114 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "eabed31c-c043-43de-a756-e217d5287116", 2024-04-26T10:43:01.115 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2024-04-26T10:43:01.115 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2024-04-26T10:43:01.115 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2024-04-26T10:43:01.115 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2024-04-26T10:43:01.115 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2024-04-26T10:43:01.115 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2024-04-26T10:43:01.115 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 8, 2024-04-26T10:43:01.115 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 13, 2024-04-26T10:43:01.115 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2024-04-26T10:43:01.115 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2024-04-26T10:43:01.115 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2024-04-26T10:43:01.115 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-04-26T10:43:01.115 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.115 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-04-26T10:43:01.116 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.60:6800", 2024-04-26T10:43:01.116 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28839 2024-04-26T10:43:01.116 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.116 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.116 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-04-26T10:43:01.116 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.60:6801", 2024-04-26T10:43:01.116 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28839 2024-04-26T10:43:01.116 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:43:01.116 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-04-26T10:43:01.116 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.116 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2024-04-26T10:43:01.117 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-04-26T10:43:01.117 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.117 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-04-26T10:43:01.117 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.60:6802", 2024-04-26T10:43:01.117 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28839 2024-04-26T10:43:01.117 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.117 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.117 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-04-26T10:43:01.117 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.60:6803", 2024-04-26T10:43:01.117 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28839 2024-04-26T10:43:01.117 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:43:01.117 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-04-26T10:43:01.117 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.118 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2024-04-26T10:43:01.118 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-04-26T10:43:01.118 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.118 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-04-26T10:43:01.118 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.60:6806", 2024-04-26T10:43:01.118 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28839 2024-04-26T10:43:01.118 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.118 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.118 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-04-26T10:43:01.118 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.60:6807", 2024-04-26T10:43:01.118 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28839 2024-04-26T10:43:01.118 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:43:01.118 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-04-26T10:43:01.118 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.119 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2024-04-26T10:43:01.119 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-04-26T10:43:01.119 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.119 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-04-26T10:43:01.119 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.60:6804", 2024-04-26T10:43:01.119 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28839 2024-04-26T10:43:01.119 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.119 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.119 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-04-26T10:43:01.119 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.60:6805", 2024-04-26T10:43:01.119 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28839 2024-04-26T10:43:01.119 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:43:01.119 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-04-26T10:43:01.120 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.120 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.60:6801/28839", 2024-04-26T10:43:01.120 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.60:6803/28839", 2024-04-26T10:43:01.120 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.60:6807/28839", 2024-04-26T10:43:01.120 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.60:6805/28839", 2024-04-26T10:43:01.120 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2024-04-26T10:43:01.120 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2024-04-26T10:43:01.120 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2024-04-26T10:43:01.120 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-04-26T10:43:01.120 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.120 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.120 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2024-04-26T10:43:01.120 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "7013621f-db09-4096-bc24-428bb170edd1", 2024-04-26T10:43:01.121 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2024-04-26T10:43:01.121 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2024-04-26T10:43:01.121 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2024-04-26T10:43:01.121 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2024-04-26T10:43:01.121 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2024-04-26T10:43:01.121 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2024-04-26T10:43:01.121 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 8, 2024-04-26T10:43:01.121 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 13, 2024-04-26T10:43:01.121 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2024-04-26T10:43:01.121 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2024-04-26T10:43:01.121 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2024-04-26T10:43:01.121 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-04-26T10:43:01.122 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.122 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-04-26T10:43:01.122 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.87:6800", 2024-04-26T10:43:01.122 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28598 2024-04-26T10:43:01.122 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.122 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.122 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-04-26T10:43:01.122 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.87:6801", 2024-04-26T10:43:01.122 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28598 2024-04-26T10:43:01.122 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:43:01.122 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-04-26T10:43:01.122 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.122 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2024-04-26T10:43:01.122 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-04-26T10:43:01.123 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.123 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-04-26T10:43:01.123 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.87:6802", 2024-04-26T10:43:01.123 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28598 2024-04-26T10:43:01.123 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.123 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.123 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-04-26T10:43:01.123 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.87:6803", 2024-04-26T10:43:01.123 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28598 2024-04-26T10:43:01.123 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:43:01.123 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-04-26T10:43:01.123 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.123 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2024-04-26T10:43:01.124 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-04-26T10:43:01.124 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.124 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-04-26T10:43:01.124 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.87:6806", 2024-04-26T10:43:01.124 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28598 2024-04-26T10:43:01.124 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.124 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.124 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-04-26T10:43:01.124 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.87:6807", 2024-04-26T10:43:01.124 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28598 2024-04-26T10:43:01.124 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:43:01.124 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-04-26T10:43:01.124 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.124 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2024-04-26T10:43:01.125 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-04-26T10:43:01.125 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.125 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-04-26T10:43:01.125 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.87:6804", 2024-04-26T10:43:01.125 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28598 2024-04-26T10:43:01.125 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.125 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.125 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-04-26T10:43:01.125 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.87:6805", 2024-04-26T10:43:01.125 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28598 2024-04-26T10:43:01.125 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:43:01.125 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-04-26T10:43:01.125 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.125 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.87:6801/28598", 2024-04-26T10:43:01.125 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.87:6803/28598", 2024-04-26T10:43:01.126 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.87:6807/28598", 2024-04-26T10:43:01.126 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.87:6805/28598", 2024-04-26T10:43:01.126 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2024-04-26T10:43:01.126 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2024-04-26T10:43:01.126 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2024-04-26T10:43:01.126 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-04-26T10:43:01.126 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.126 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.126 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2024-04-26T10:43:01.126 INFO:teuthology.orchestra.run.smithi049.stdout: "uuid": "a1efeadd-cf55-4ed5-9918-36607fd62229", 2024-04-26T10:43:01.126 INFO:teuthology.orchestra.run.smithi049.stdout: "up": 1, 2024-04-26T10:43:01.126 INFO:teuthology.orchestra.run.smithi049.stdout: "in": 1, 2024-04-26T10:43:01.126 INFO:teuthology.orchestra.run.smithi049.stdout: "weight": 1, 2024-04-26T10:43:01.126 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_affinity": 1, 2024-04-26T10:43:01.127 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_begin": 0, 2024-04-26T10:43:01.127 INFO:teuthology.orchestra.run.smithi049.stdout: "last_clean_end": 0, 2024-04-26T10:43:01.127 INFO:teuthology.orchestra.run.smithi049.stdout: "up_from": 8, 2024-04-26T10:43:01.127 INFO:teuthology.orchestra.run.smithi049.stdout: "up_thru": 13, 2024-04-26T10:43:01.127 INFO:teuthology.orchestra.run.smithi049.stdout: "down_at": 0, 2024-04-26T10:43:01.127 INFO:teuthology.orchestra.run.smithi049.stdout: "lost_at": 0, 2024-04-26T10:43:01.127 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addrs": { 2024-04-26T10:43:01.127 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-04-26T10:43:01.127 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.127 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-04-26T10:43:01.127 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.195:6800", 2024-04-26T10:43:01.127 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28733 2024-04-26T10:43:01.127 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.127 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.128 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-04-26T10:43:01.128 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.195:6801", 2024-04-26T10:43:01.128 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28733 2024-04-26T10:43:01.128 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:43:01.128 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-04-26T10:43:01.128 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.128 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addrs": { 2024-04-26T10:43:01.128 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-04-26T10:43:01.128 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.128 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-04-26T10:43:01.128 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.195:6802", 2024-04-26T10:43:01.128 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28733 2024-04-26T10:43:01.128 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.129 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.129 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-04-26T10:43:01.129 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.195:6803", 2024-04-26T10:43:01.129 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28733 2024-04-26T10:43:01.129 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:43:01.129 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-04-26T10:43:01.129 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.129 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addrs": { 2024-04-26T10:43:01.129 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-04-26T10:43:01.129 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.129 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-04-26T10:43:01.129 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.195:6806", 2024-04-26T10:43:01.129 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28733 2024-04-26T10:43:01.129 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.130 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.130 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-04-26T10:43:01.130 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.195:6807", 2024-04-26T10:43:01.130 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28733 2024-04-26T10:43:01.130 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:43:01.130 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-04-26T10:43:01.130 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.130 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addrs": { 2024-04-26T10:43:01.130 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-04-26T10:43:01.130 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.130 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-04-26T10:43:01.130 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.195:6804", 2024-04-26T10:43:01.130 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28733 2024-04-26T10:43:01.131 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.131 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.131 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-04-26T10:43:01.131 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.195:6805", 2024-04-26T10:43:01.131 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 28733 2024-04-26T10:43:01.131 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:43:01.131 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-04-26T10:43:01.131 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.131 INFO:teuthology.orchestra.run.smithi049.stdout: "public_addr": "172.21.15.195:6801/28733", 2024-04-26T10:43:01.131 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_addr": "172.21.15.195:6803/28733", 2024-04-26T10:43:01.131 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_back_addr": "172.21.15.195:6807/28733", 2024-04-26T10:43:01.131 INFO:teuthology.orchestra.run.smithi049.stdout: "heartbeat_front_addr": "172.21.15.195:6805/28733", 2024-04-26T10:43:01.131 INFO:teuthology.orchestra.run.smithi049.stdout: "state": [ 2024-04-26T10:43:01.131 INFO:teuthology.orchestra.run.smithi049.stdout: "exists", 2024-04-26T10:43:01.131 INFO:teuthology.orchestra.run.smithi049.stdout: "up" 2024-04-26T10:43:01.132 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-04-26T10:43:01.132 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:43:01.132 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-04-26T10:43:01.132 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_xinfo": [ 2024-04-26T10:43:01.132 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.132 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 0, 2024-04-26T10:43:01.132 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2024-04-26T10:43:01.132 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2024-04-26T10:43:01.132 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2024-04-26T10:43:01.132 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2024-04-26T10:43:01.132 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2024-04-26T10:43:01.132 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2024-04-26T10:42:17.152046+0000", 2024-04-26T10:43:01.132 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2024-04-26T10:43:01.132 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.132 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.133 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 1, 2024-04-26T10:43:01.133 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2024-04-26T10:43:01.133 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2024-04-26T10:43:01.133 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2024-04-26T10:43:01.133 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2024-04-26T10:43:01.133 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2024-04-26T10:43:01.133 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2024-04-26T10:42:17.177399+0000", 2024-04-26T10:43:01.133 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2024-04-26T10:43:01.133 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.133 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-04-26T10:43:01.133 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": 2, 2024-04-26T10:43:01.134 INFO:teuthology.orchestra.run.smithi049.stdout: "down_stamp": "0.000000", 2024-04-26T10:43:01.134 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_probability": 0, 2024-04-26T10:43:01.134 INFO:teuthology.orchestra.run.smithi049.stdout: "laggy_interval": 0, 2024-04-26T10:43:01.134 INFO:teuthology.orchestra.run.smithi049.stdout: "features": 4540138322906710015, 2024-04-26T10:43:01.134 INFO:teuthology.orchestra.run.smithi049.stdout: "old_weight": 0, 2024-04-26T10:43:01.134 INFO:teuthology.orchestra.run.smithi049.stdout: "last_purged_snaps_scrub": "2024-04-26T10:42:17.123066+0000", 2024-04-26T10:43:01.134 INFO:teuthology.orchestra.run.smithi049.stdout: "dead_epoch": 0 2024-04-26T10:43:01.134 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:43:01.134 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-04-26T10:43:01.134 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap": [], 2024-04-26T10:43:01.134 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_items": [], 2024-04-26T10:43:01.134 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_upmap_primaries": [], 2024-04-26T10:43:01.134 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_temp": [], 2024-04-26T10:43:01.135 INFO:teuthology.orchestra.run.smithi049.stdout: "primary_temp": [], 2024-04-26T10:43:01.135 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklist": {}, 2024-04-26T10:43:01.135 INFO:teuthology.orchestra.run.smithi049.stdout: "range_blocklist": {}, 2024-04-26T10:43:01.135 INFO:teuthology.orchestra.run.smithi049.stdout: "erasure_code_profiles": { 2024-04-26T10:43:01.135 INFO:teuthology.orchestra.run.smithi049.stdout: "default": { 2024-04-26T10:43:01.135 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-failure-domain": "osd", 2024-04-26T10:43:01.135 INFO:teuthology.orchestra.run.smithi049.stdout: "k": "2", 2024-04-26T10:43:01.135 INFO:teuthology.orchestra.run.smithi049.stdout: "m": "1", 2024-04-26T10:43:01.135 INFO:teuthology.orchestra.run.smithi049.stdout: "plugin": "jerasure", 2024-04-26T10:43:01.135 INFO:teuthology.orchestra.run.smithi049.stdout: "technique": "reed_sol_van" 2024-04-26T10:43:01.135 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:43:01.135 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-04-26T10:43:01.135 INFO:teuthology.orchestra.run.smithi049.stdout: "removed_snaps_queue": [], 2024-04-26T10:43:01.135 INFO:teuthology.orchestra.run.smithi049.stdout: "new_removed_snaps": [], 2024-04-26T10:43:01.135 INFO:teuthology.orchestra.run.smithi049.stdout: "new_purged_snaps": [], 2024-04-26T10:43:01.136 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_node_flags": {}, 2024-04-26T10:43:01.136 INFO:teuthology.orchestra.run.smithi049.stdout: "device_class_flags": {}, 2024-04-26T10:43:01.136 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode": { 2024-04-26T10:43:01.136 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_enabled": false, 2024-04-26T10:43:01.136 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_bucket_count": 0, 2024-04-26T10:43:01.136 INFO:teuthology.orchestra.run.smithi049.stdout: "degraded_stretch_mode": 0, 2024-04-26T10:43:01.136 INFO:teuthology.orchestra.run.smithi049.stdout: "recovering_stretch_mode": 0, 2024-04-26T10:43:01.136 INFO:teuthology.orchestra.run.smithi049.stdout: "stretch_mode_bucket": 0 2024-04-26T10:43:01.136 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-04-26T10:43:01.136 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-04-26T10:43:01.138 INFO:tasks.thrashosds.thrasher:j is {'epoch': 22, 'fsid': '9837de44-a9e8-4979-adc4-611f3ddc44ce', 'created': '2024-04-26T10:42:11.337159+0000', 'modified': '2024-04-26T10:42:58.751460+0000', 'last_up_change': '2024-04-26T10:42:19.397933+0000', 'last_in_change': '2024-04-26T10:42:12.136647+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T10:42:19.632084+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T10:42:19.779089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T10:42:24.266614+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T10:42:25.014684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'eabed31c-c043-43de-a756-e217d5287116', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6800', 'nonce': 28839}, {'type': 'v1', 'addr': '172.21.15.60:6801', 'nonce': 28839}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6802', 'nonce': 28839}, {'type': 'v1', 'addr': '172.21.15.60:6803', 'nonce': 28839}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6806', 'nonce': 28839}, {'type': 'v1', 'addr': '172.21.15.60:6807', 'nonce': 28839}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6804', 'nonce': 28839}, {'type': 'v1', 'addr': '172.21.15.60:6805', 'nonce': 28839}]}, 'public_addr': '172.21.15.60:6801/28839', 'cluster_addr': '172.21.15.60:6803/28839', 'heartbeat_back_addr': '172.21.15.60:6807/28839', 'heartbeat_front_addr': '172.21.15.60:6805/28839', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7013621f-db09-4096-bc24-428bb170edd1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6800', 'nonce': 28598}, {'type': 'v1', 'addr': '172.21.15.87:6801', 'nonce': 28598}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6802', 'nonce': 28598}, {'type': 'v1', 'addr': '172.21.15.87:6803', 'nonce': 28598}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6806', 'nonce': 28598}, {'type': 'v1', 'addr': '172.21.15.87:6807', 'nonce': 28598}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6804', 'nonce': 28598}, {'type': 'v1', 'addr': '172.21.15.87:6805', 'nonce': 28598}]}, 'public_addr': '172.21.15.87:6801/28598', 'cluster_addr': '172.21.15.87:6803/28598', 'heartbeat_back_addr': '172.21.15.87:6807/28598', 'heartbeat_front_addr': '172.21.15.87:6805/28598', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'a1efeadd-cf55-4ed5-9918-36607fd62229', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6800', 'nonce': 28733}, {'type': 'v1', 'addr': '172.21.15.195:6801', 'nonce': 28733}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6802', 'nonce': 28733}, {'type': 'v1', 'addr': '172.21.15.195:6803', 'nonce': 28733}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6806', 'nonce': 28733}, {'type': 'v1', 'addr': '172.21.15.195:6807', 'nonce': 28733}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6804', 'nonce': 28733}, {'type': 'v1', 'addr': '172.21.15.195:6805', 'nonce': 28733}]}, 'public_addr': '172.21.15.195:6801/28733', 'cluster_addr': '172.21.15.195:6803/28733', 'heartbeat_back_addr': '172.21.15.195:6807/28733', 'heartbeat_front_addr': '172.21.15.195:6805/28733', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:42:17.152046+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:42:17.177399+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:42:17.123066+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T10:43:01.138 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:43:01.139 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:01.136+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:01.146 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:43:01.168 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:01.168 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:01.177 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:43:01.239 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:01.237+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:01.276 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:01.277 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:01.286 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:43:01.307 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:01.307 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:01.325 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1: {} 2024-04-26T10:43:01.325 INFO:teuthology.orchestra.run.smithi049.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:43:01.340 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:01.339+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:01.343 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:01.344 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:01.388 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-26T10:43:01.388 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-26T10:43:01.388 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-26T10:43:01.388 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-26T10:43:01.388 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.388 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:43:01.388 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:43:01.389 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.521325556000001, 2024-04-26T10:43:01.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086884530000000005, 2024-04-26T10:43:01.389 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:01.389 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.389 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:43:01.389 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:43:01.389 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:43:01.389 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 164 2024-04-26T10:43:01.389 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.389 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:01.389 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.389 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:01.389 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:43:01.389 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:01.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:43:01.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:01.390 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:43:01.390 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-26T10:43:01.390 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.390 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.390 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:01.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864858+0000", 2024-04-26T10:43:01.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3231e-05 2024-04-26T10:43:01.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:01.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864862+0000", 2024-04-26T10:43:01.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9280000000000003e-06 2024-04-26T10:43:01.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.391 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.391 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.391 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864865+0000", 2024-04-26T10:43:01.391 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8289999999999999e-06 2024-04-26T10:43:01.391 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:01.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869688+0000", 2024-04-26T10:43:01.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048234990000000002 2024-04-26T10:43:01.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:01.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869732+0000", 2024-04-26T10:43:01.392 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3232999999999998e-05 2024-04-26T10:43:01.392 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.392 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.392 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:01.392 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869804+0000", 2024-04-26T10:43:01.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2152999999999998e-05 2024-04-26T10:43:01.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.872812+0000", 2024-04-26T10:43:01.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003008372 2024-04-26T10:43:01.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.393 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.393 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:01.393 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873459+0000", 2024-04-26T10:43:01.393 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064655699999999997 2024-04-26T10:43:01.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:01.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873482+0000", 2024-04-26T10:43:01.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3419999999999999e-05 2024-04-26T10:43:01.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.394 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.394 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:01.394 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873504+0000", 2024-04-26T10:43:01.394 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1440000000000001e-05 2024-04-26T10:43:01.394 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.394 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:01.394 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.395 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.395 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:43:01.395 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:43:01.395 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.521272617000001, 2024-04-26T10:43:01.395 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0092811590000000006, 2024-04-26T10:43:01.395 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:01.395 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.395 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:43:01.395 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:43:01.395 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:43:01.395 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 165 2024-04-26T10:43:01.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.396 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:01.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:01.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:43:01.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.396 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.396 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:01.396 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:43:01.396 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:01.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:43:01.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:01.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864871+0000", 2024-04-26T10:43:01.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2200000000000001e-06 2024-04-26T10:43:01.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.397 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.397 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:01.397 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864875+0000", 2024-04-26T10:43:01.397 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.206e-06 2024-04-26T10:43:01.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864878+0000", 2024-04-26T10:43:01.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5799999999999999e-06 2024-04-26T10:43:01.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:01.398 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873137+0000", 2024-04-26T10:43:01.398 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082591609999999992 2024-04-26T10:43:01.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.398 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.398 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:01.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873186+0000", 2024-04-26T10:43:01.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8741e-05 2024-04-26T10:43:01.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:01.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873252+0000", 2024-04-26T10:43:01.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5877000000000006e-05 2024-04-26T10:43:01.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.399 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.399 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:01.399 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873708+0000", 2024-04-26T10:43:01.399 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00045660299999999998 2024-04-26T10:43:01.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874091+0000", 2024-04-26T10:43:01.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038295000000000001 2024-04-26T10:43:01.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:01.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874115+0000", 2024-04-26T10:43:01.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:01.400 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.400 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.400 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:01.400 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874149+0000", 2024-04-26T10:43:01.400 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4320999999999999e-05 2024-04-26T10:43:01.401 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.401 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:01.401 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.401 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.401 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.401 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:43:01.401 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:43:01.401 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.384174981999998, 2024-04-26T10:43:01.401 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010199138999999999, 2024-04-26T10:43:01.401 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:01.401 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.401 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:43:01.401 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:43:01.401 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:43:01.402 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 188 2024-04-26T10:43:01.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.402 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:01.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:01.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:43:01.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.402 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:01.402 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:43:01.402 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.402 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:01.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:43:01.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-26T10:43:01.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:01.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002024+0000", 2024-04-26T10:43:01.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8050999999999997e-05 2024-04-26T10:43:01.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.403 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.403 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:01.403 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002034+0000", 2024-04-26T10:43:01.403 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0217000000000001e-05 2024-04-26T10:43:01.403 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002039+0000", 2024-04-26T10:43:01.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6879999999999998e-06 2024-04-26T10:43:01.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:01.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006586+0000", 2024-04-26T10:43:01.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045473570000000001 2024-04-26T10:43:01.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.404 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.404 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:01.404 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006626+0000", 2024-04-26T10:43:01.404 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9688999999999999e-05 2024-04-26T10:43:01.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:01.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006689+0000", 2024-04-26T10:43:01.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3243000000000004e-05 2024-04-26T10:43:01.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007850+0000", 2024-04-26T10:43:01.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011607989999999999 2024-04-26T10:43:01.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.405 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.405 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:01.405 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012084+0000", 2024-04-26T10:43:01.405 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042340069999999997 2024-04-26T10:43:01.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:01.406 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012132+0000", 2024-04-26T10:43:01.406 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8112999999999998e-05 2024-04-26T10:43:01.406 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.406 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.406 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:01.407 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012165+0000", 2024-04-26T10:43:01.407 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3189999999999999e-05 2024-04-26T10:43:01.407 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.407 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:01.407 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.407 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.407 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:43:01.407 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:43:01.407 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 39.384098281999997, 2024-04-26T10:43:01.408 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010167136, 2024-04-26T10:43:01.408 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:01.408 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.408 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:43:01.408 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:43:01.408 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:43:01.408 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 189 2024-04-26T10:43:01.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.408 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:01.408 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:01.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:43:01.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:01.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:43:01.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.409 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.409 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:01.409 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:43:01.409 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:01.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002044+0000", 2024-04-26T10:43:01.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.119e-06 2024-04-26T10:43:01.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:01.410 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002047+0000", 2024-04-26T10:43:01.410 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0199999999999999e-06 2024-04-26T10:43:01.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.410 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.410 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002050+0000", 2024-04-26T10:43:01.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3360000000000002e-06 2024-04-26T10:43:01.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:01.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007165+0000", 2024-04-26T10:43:01.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051155879999999999 2024-04-26T10:43:01.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.411 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.411 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:01.411 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007209+0000", 2024-04-26T10:43:01.411 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4097000000000001e-05 2024-04-26T10:43:01.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:01.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007278+0000", 2024-04-26T10:43:01.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8663000000000003e-05 2024-04-26T10:43:01.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.008047+0000", 2024-04-26T10:43:01.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00076935299999999996 2024-04-26T10:43:01.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.412 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.412 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:01.412 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012171+0000", 2024-04-26T10:43:01.412 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004123219 2024-04-26T10:43:01.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:01.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012193+0000", 2024-04-26T10:43:01.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2169000000000001e-05 2024-04-26T10:43:01.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.413 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.413 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:01.413 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012210+0000", 2024-04-26T10:43:01.413 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6841999999999999e-05 2024-04-26T10:43:01.413 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.413 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:01.413 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.414 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.414 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:43:01.414 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.352634889000001, 2024-04-26T10:43:01.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010195469, 2024-04-26T10:43:01.414 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:01.414 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.414 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:01.414 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.414 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:01.414 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:43:01.414 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:01.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:43:01.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:01.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033504+0000", 2024-04-26T10:43:01.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:01.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.415 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.415 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:01.415 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033513+0000", 2024-04-26T10:43:01.415 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6829999999999997e-06 2024-04-26T10:43:01.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:01.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033525+0000", 2024-04-26T10:43:01.416 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2748000000000001e-05 2024-04-26T10:43:01.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.416 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.416 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.416 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033537+0000", 2024-04-26T10:43:01.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1243999999999999e-05 2024-04-26T10:43:01.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:01.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034018+0000", 2024-04-26T10:43:01.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048138899999999998 2024-04-26T10:43:01.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-04-26T10:43:01.417 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034025+0000", 2024-04-26T10:43:01.417 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8870000000000003e-06 2024-04-26T10:43:01.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.417 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.417 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:01.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035264+0000", 2024-04-26T10:43:01.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0012385370000000001 2024-04-26T10:43:01.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:01.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035372+0000", 2024-04-26T10:43:01.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010851199999999999 2024-04-26T10:43:01.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.418 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.418 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:01.418 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035473+0000", 2024-04-26T10:43:01.418 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000100967 2024-04-26T10:43:01.418 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043270+0000", 2024-04-26T10:43:01.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0077971869999999997 2024-04-26T10:43:01.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:01.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043620+0000", 2024-04-26T10:43:01.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034962099999999999 2024-04-26T10:43:01.419 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.419 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.419 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:01.419 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043665+0000", 2024-04-26T10:43:01.419 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5426999999999997e-05 2024-04-26T10:43:01.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.420 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:01.420 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043701+0000", 2024-04-26T10:43:01.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6072000000000003e-05 2024-04-26T10:43:01.420 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.420 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:01.420 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.420 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.420 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.420 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.420 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:43:01.420 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.35214981, 2024-04-26T10:43:01.420 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099286970000000002, 2024-04-26T10:43:01.421 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:01.421 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.421 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:01.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:01.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:43:01.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.421 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:01.421 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:43:01.421 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.421 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:01.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033990+0000", 2024-04-26T10:43:01.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-26T10:43:01.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:01.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033998+0000", 2024-04-26T10:43:01.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7970000000000001e-06 2024-04-26T10:43:01.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.422 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.422 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:01.422 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034010+0000", 2024-04-26T10:43:01.422 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2383e-05 2024-04-26T10:43:01.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034021+0000", 2024-04-26T10:43:01.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0824e-05 2024-04-26T10:43:01.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:01.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035774+0000", 2024-04-26T10:43:01.423 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017527479999999999 2024-04-26T10:43:01.423 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.423 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.423 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:01.423 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035929+0000", 2024-04-26T10:43:01.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000155735 2024-04-26T10:43:01.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:01.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036083+0000", 2024-04-26T10:43:01.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000153635 2024-04-26T10:43:01.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043369+0000", 2024-04-26T10:43:01.424 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0072854490000000003 2024-04-26T10:43:01.424 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.424 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.424 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:01.424 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043709+0000", 2024-04-26T10:43:01.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034039600000000003 2024-04-26T10:43:01.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:01.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043878+0000", 2024-04-26T10:43:01.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016924799999999999 2024-04-26T10:43:01.425 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.425 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.425 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:01.425 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043920+0000", 2024-04-26T10:43:01.425 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1471999999999999e-05 2024-04-26T10:43:01.425 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.425 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:01.426 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.426 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.426 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:43:01.426 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.352110531999998, 2024-04-26T10:43:01.426 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010011091999999999, 2024-04-26T10:43:01.426 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:01.426 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.426 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:01.426 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.426 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:01.426 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:43:01.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:01.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:43:01.427 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.427 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.427 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:01.427 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:43:01.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:01.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034040+0000", 2024-04-26T10:43:01.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8560000000000002e-06 2024-04-26T10:43:01.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.428 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:01.428 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034048+0000", 2024-04-26T10:43:01.428 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4139999999999994e-06 2024-04-26T10:43:01.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.428 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034054+0000", 2024-04-26T10:43:01.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8950000000000003e-06 2024-04-26T10:43:01.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:01.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036269+0000", 2024-04-26T10:43:01.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002215528 2024-04-26T10:43:01.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.429 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.429 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:01.429 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036364+0000", 2024-04-26T10:43:01.429 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4089e-05 2024-04-26T10:43:01.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:01.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036443+0000", 2024-04-26T10:43:01.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9666000000000006e-05 2024-04-26T10:43:01.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.430 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043451+0000", 2024-04-26T10:43:01.430 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0070081939999999997 2024-04-26T10:43:01.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.430 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.430 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:01.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043930+0000", 2024-04-26T10:43:01.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00047819799999999999 2024-04-26T10:43:01.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:01.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043999+0000", 2024-04-26T10:43:01.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9136999999999999e-05 2024-04-26T10:43:01.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.431 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.431 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:01.431 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044041+0000", 2024-04-26T10:43:01.431 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2624999999999999e-05 2024-04-26T10:43:01.431 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.432 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:01.432 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.432 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.432 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.432 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:43:01.432 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.352071565000003, 2024-04-26T10:43:01.432 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015256755, 2024-04-26T10:43:01.432 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:01.432 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.432 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:01.432 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.432 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:01.432 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:43:01.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.433 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:01.433 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:43:01.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.433 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:01.433 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:43:01.433 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.433 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.433 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.433 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:01.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034073+0000", 2024-04-26T10:43:01.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1099999999999996e-06 2024-04-26T10:43:01.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:01.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034081+0000", 2024-04-26T10:43:01.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0539999999999995e-06 2024-04-26T10:43:01.434 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.434 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.434 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.434 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034087+0000", 2024-04-26T10:43:01.434 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0240000000000003e-06 2024-04-26T10:43:01.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:01.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036668+0000", 2024-04-26T10:43:01.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002581014 2024-04-26T10:43:01.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:01.435 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036717+0000", 2024-04-26T10:43:01.435 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9299999999999999e-05 2024-04-26T10:43:01.435 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.435 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.435 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:01.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036846+0000", 2024-04-26T10:43:01.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012901000000000001 2024-04-26T10:43:01.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:01.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044050+0000", 2024-04-26T10:43:01.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007203816 2024-04-26T10:43:01.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.436 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.436 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.436 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049229+0000", 2024-04-26T10:43:01.436 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051792169999999998 2024-04-26T10:43:01.436 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.437 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:01.437 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049282+0000", 2024-04-26T10:43:01.437 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2605000000000002e-05 2024-04-26T10:43:01.437 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.437 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.437 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:01.437 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049326+0000", 2024-04-26T10:43:01.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4255000000000002e-05 2024-04-26T10:43:01.438 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.438 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:01.438 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.438 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.438 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.438 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.438 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:43:01.438 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.352046903000002, 2024-04-26T10:43:01.438 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01538838, 2024-04-26T10:43:01.438 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:01.438 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.439 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:01.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:01.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:43:01.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:01.439 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:43:01.439 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.439 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.439 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.439 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:01.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034093+0000", 2024-04-26T10:43:01.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:01.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034097+0000", 2024-04-26T10:43:01.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.213e-06 2024-04-26T10:43:01.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.440 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:01.440 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034104+0000", 2024-04-26T10:43:01.440 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9840000000000004e-06 2024-04-26T10:43:01.440 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.440 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034111+0000", 2024-04-26T10:43:01.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9199999999999998e-06 2024-04-26T10:43:01.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:01.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.037736+0000", 2024-04-26T10:43:01.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036257429999999998 2024-04-26T10:43:01.441 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.441 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.441 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:01.441 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:01.441 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034004 2024-04-26T10:43:01.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:01.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038526+0000", 2024-04-26T10:43:01.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00044924100000000002 2024-04-26T10:43:01.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.442 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:01.442 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044708+0000", 2024-04-26T10:43:01.442 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061823360000000001 2024-04-26T10:43:01.442 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.442 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:01.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046886159999999996 2024-04-26T10:43:01.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:01.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049446+0000", 2024-04-26T10:43:01.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.973e-05 2024-04-26T10:43:01.443 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.443 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.443 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:01.443 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049482+0000", 2024-04-26T10:43:01.443 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6004999999999998e-05 2024-04-26T10:43:01.444 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.444 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:01.444 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.444 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.444 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.444 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:43:01.444 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.352025382000001, 2024-04-26T10:43:01.444 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015480648, 2024-04-26T10:43:01.444 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:01.444 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.444 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:01.444 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:01.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:43:01.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:01.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:43:01.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.445 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.445 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.445 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:01.445 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:43:01.445 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:01.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034118+0000", 2024-04-26T10:43:01.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1769999999999998e-06 2024-04-26T10:43:01.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.446 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:01.446 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034126+0000", 2024-04-26T10:43:01.446 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7770000000000002e-06 2024-04-26T10:43:01.446 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.446 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034146+0000", 2024-04-26T10:43:01.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0579999999999999e-05 2024-04-26T10:43:01.447 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.447 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.447 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:01.447 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039740+0000", 2024-04-26T10:43:01.447 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0055940269999999997 2024-04-26T10:43:01.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.448 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:01.448 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039848+0000", 2024-04-26T10:43:01.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010775100000000001 2024-04-26T10:43:01.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.448 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:01.448 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040022+0000", 2024-04-26T10:43:01.448 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000173964 2024-04-26T10:43:01.448 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.448 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.448 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:01.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044721+0000", 2024-04-26T10:43:01.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046989099999999997 2024-04-26T10:43:01.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049541+0000", 2024-04-26T10:43:01.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048200789999999997 2024-04-26T10:43:01.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.449 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:01.449 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049574+0000", 2024-04-26T10:43:01.449 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2817000000000001e-05 2024-04-26T10:43:01.449 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.449 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.450 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:01.450 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049596+0000", 2024-04-26T10:43:01.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2011999999999999e-05 2024-04-26T10:43:01.450 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.450 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:01.450 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.450 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.450 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.450 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.450 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:43:01.450 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.351989422999999, 2024-04-26T10:43:01.450 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015538033, 2024-04-26T10:43:01.450 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:01.450 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.451 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:01.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:01.451 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:43:01.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:01.451 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:43:01.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.451 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.451 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.451 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:01.451 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:43:01.451 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:01.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034155+0000", 2024-04-26T10:43:01.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.177e-06 2024-04-26T10:43:01.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:01.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034161+0000", 2024-04-26T10:43:01.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0780000000000001e-06 2024-04-26T10:43:01.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.452 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.452 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.452 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034168+0000", 2024-04-26T10:43:01.452 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8689999999999998e-06 2024-04-26T10:43:01.452 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:01.453 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041069+0000", 2024-04-26T10:43:01.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069010440000000003 2024-04-26T10:43:01.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:01.453 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041221+0000", 2024-04-26T10:43:01.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015175 2024-04-26T10:43:01.453 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.453 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.453 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:01.453 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041350+0000", 2024-04-26T10:43:01.453 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012870899999999999 2024-04-26T10:43:01.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.454 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:01.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045386+0000", 2024-04-26T10:43:01.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040364789999999999 2024-04-26T10:43:01.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.454 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049641+0000", 2024-04-26T10:43:01.454 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042552120000000004 2024-04-26T10:43:01.454 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.454 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.454 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:01.454 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049669+0000", 2024-04-26T10:43:01.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7809000000000001e-05 2024-04-26T10:43:01.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.455 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:01.455 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049689+0000", 2024-04-26T10:43:01.455 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0336e-05 2024-04-26T10:43:01.455 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.455 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:01.455 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.455 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.455 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.455 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.455 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:43:01.455 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.351967594000001, 2024-04-26T10:43:01.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015595107, 2024-04-26T10:43:01.456 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:01.456 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.456 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:01.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:01.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:43:01.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.456 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:01.456 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:43:01.456 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.456 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.456 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.457 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:01.457 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:43:01.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.457 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:01.457 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034176+0000", 2024-04-26T10:43:01.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0089999999999999e-06 2024-04-26T10:43:01.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.457 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.457 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:01.457 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034182+0000", 2024-04-26T10:43:01.457 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4579999999999998e-06 2024-04-26T10:43:01.457 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.458 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034187+0000", 2024-04-26T10:43:01.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0880000000000002e-06 2024-04-26T10:43:01.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:01.458 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045564+0000", 2024-04-26T10:43:01.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011376475 2024-04-26T10:43:01.458 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.458 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.458 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:01.458 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045623+0000", 2024-04-26T10:43:01.458 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9388999999999997e-05 2024-04-26T10:43:01.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:01.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045713+0000", 2024-04-26T10:43:01.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0211999999999996e-05 2024-04-26T10:43:01.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:01.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046325+0000", 2024-04-26T10:43:01.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00061181699999999996 2024-04-26T10:43:01.459 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.459 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.459 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.459 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049722+0000", 2024-04-26T10:43:01.459 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033962380000000002 2024-04-26T10:43:01.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:01.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049750+0000", 2024-04-26T10:43:01.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8087000000000001e-05 2024-04-26T10:43:01.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.460 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:01.460 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049768+0000", 2024-04-26T10:43:01.460 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8681999999999998e-05 2024-04-26T10:43:01.460 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.460 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:01.460 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.460 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.460 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.461 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.461 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:43:01.461 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.351754069999998, 2024-04-26T10:43:01.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087543810000000003, 2024-04-26T10:43:01.461 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:01.461 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.461 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:01.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.461 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:01.461 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:43:01.461 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.461 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.461 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:01.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:43:01.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:01.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034386+0000", 2024-04-26T10:43:01.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-26T10:43:01.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.462 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.462 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:01.462 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034397+0000", 2024-04-26T10:43:01.462 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0878e-05 2024-04-26T10:43:01.462 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:01.463 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034408+0000", 2024-04-26T10:43:01.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1138000000000001e-05 2024-04-26T10:43:01.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.463 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034414+0000", 2024-04-26T10:43:01.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2910000000000004e-06 2024-04-26T10:43:01.463 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.463 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.463 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:01.463 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036009+0000", 2024-04-26T10:43:01.463 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0015952029999999999 2024-04-26T10:43:01.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:01.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036120+0000", 2024-04-26T10:43:01.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000110584 2024-04-26T10:43:01.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:43:01.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036225+0000", 2024-04-26T10:43:01.464 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010523599999999999 2024-04-26T10:43:01.464 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.464 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.464 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:01.464 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039276+0000", 2024-04-26T10:43:01.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003050404 2024-04-26T10:43:01.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.465 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.465 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:01.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037356099999999999 2024-04-26T10:43:01.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.465 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:01.465 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043079+0000", 2024-04-26T10:43:01.465 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8099e-05 2024-04-26T10:43:01.465 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.465 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.465 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:01.465 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043141+0000", 2024-04-26T10:43:01.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1655999999999994e-05 2024-04-26T10:43:01.466 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.466 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:01.466 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.466 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.466 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.466 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.466 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:43:01.466 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.351693513000001, 2024-04-26T10:43:01.466 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090131610000000004, 2024-04-26T10:43:01.466 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:01.466 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.466 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:01.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:01.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:43:01.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:01.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:43:01.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.467 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.467 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:01.467 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:43:01.467 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.467 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:01.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034451+0000", 2024-04-26T10:43:01.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9600000000000002e-06 2024-04-26T10:43:01.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:01.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034458+0000", 2024-04-26T10:43:01.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5820000000000004e-06 2024-04-26T10:43:01.468 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.468 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.468 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.468 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034463+0000", 2024-04-26T10:43:01.468 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0719999999999999e-06 2024-04-26T10:43:01.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:01.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036527+0000", 2024-04-26T10:43:01.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002063755 2024-04-26T10:43:01.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:01.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036610+0000", 2024-04-26T10:43:01.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2669000000000004e-05 2024-04-26T10:43:01.469 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.469 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.469 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:43:01.469 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036744+0000", 2024-04-26T10:43:01.469 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013412499999999999 2024-04-26T10:43:01.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.470 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:01.470 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040144+0000", 2024-04-26T10:43:01.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033999799999999999 2024-04-26T10:43:01.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.470 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.470 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043301+0000", 2024-04-26T10:43:01.470 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031572240000000001 2024-04-26T10:43:01.470 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.470 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.470 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:01.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043425+0000", 2024-04-26T10:43:01.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000123664 2024-04-26T10:43:01.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.471 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:01.471 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043460+0000", 2024-04-26T10:43:01.471 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5651000000000001e-05 2024-04-26T10:43:01.471 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.471 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:01.471 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.471 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.471 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.471 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.471 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:43:01.471 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.351668613000001, 2024-04-26T10:43:01.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086028210000000001, 2024-04-26T10:43:01.472 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:01.472 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.472 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:01.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:01.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:43:01.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:01.472 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:43:01.472 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.472 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.472 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.472 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:43:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034482+0000", 2024-04-26T10:43:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8630000000000003e-06 2024-04-26T10:43:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034494+0000", 2024-04-26T10:43:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-04-26T10:43:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034501+0000", 2024-04-26T10:43:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7050000000000002e-06 2024-04-26T10:43:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035138+0000", 2024-04-26T10:43:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00063744099999999998 2024-04-26T10:43:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035286+0000", 2024-04-26T10:43:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014766200000000001 2024-04-26T10:43:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:43:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035654+0000", 2024-04-26T10:43:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00036779100000000002 2024-04-26T10:43:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040833+0000", 2024-04-26T10:43:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051795640000000002 2024-04-26T10:43:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.042886+0000", 2024-04-26T10:43:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020531220000000001 2024-04-26T10:43:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043015+0000", 2024-04-26T10:43:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012824099999999999 2024-04-26T10:43:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043075+0000", 2024-04-26T10:43:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0262e-05 2024-04-26T10:43:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:43:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.351632649999999, 2024-04-26T10:43:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01482116, 2024-04-26T10:43:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:43:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:43:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:43:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034515+0000", 2024-04-26T10:43:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.391e-06 2024-04-26T10:43:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034522+0000", 2024-04-26T10:43:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7889999999999997e-06 2024-04-26T10:43:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034601+0000", 2024-04-26T10:43:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9547000000000003e-05 2024-04-26T10:43:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036510+0000", 2024-04-26T10:43:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019092289999999999 2024-04-26T10:43:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036642+0000", 2024-04-26T10:43:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013151100000000001 2024-04-26T10:43:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036766+0000", 2024-04-26T10:43:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012367300000000001 2024-04-26T10:43:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040749+0000", 2024-04-26T10:43:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039838419999999996 2024-04-26T10:43:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049262+0000", 2024-04-26T10:43:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085127789999999998 2024-04-26T10:43:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049301+0000", 2024-04-26T10:43:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8834000000000001e-05 2024-04-26T10:43:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049329+0000", 2024-04-26T10:43:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.817e-05 2024-04-26T10:43:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:43:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.351499953000001, 2024-04-26T10:43:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014796093999999999, 2024-04-26T10:43:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:43:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:43:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034640+0000", 2024-04-26T10:43:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034650+0000", 2024-04-26T10:43:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0064999999999999e-05 2024-04-26T10:43:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034660+0000", 2024-04-26T10:43:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.961e-06 2024-04-26T10:43:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034680+0000", 2024-04-26T10:43:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9219e-05 2024-04-26T10:43:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.037926+0000", 2024-04-26T10:43:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032460380000000001 2024-04-26T10:43:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038068+0000", 2024-04-26T10:43:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014236000000000001 2024-04-26T10:43:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038201+0000", 2024-04-26T10:43:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013345300000000001 2024-04-26T10:43:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043497+0000", 2024-04-26T10:43:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052952770000000001 2024-04-26T10:43:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049373+0000", 2024-04-26T10:43:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058762900000000002 2024-04-26T10:43:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049411+0000", 2024-04-26T10:43:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7737000000000001e-05 2024-04-26T10:43:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049437+0000", 2024-04-26T10:43:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6169999999999998e-05 2024-04-26T10:43:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:43:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.351455442999999, 2024-04-26T10:43:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0092140799999999995, 2024-04-26T10:43:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:43:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:43:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:43:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034688+0000", 2024-04-26T10:43:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5480000000000002e-06 2024-04-26T10:43:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034694+0000", 2024-04-26T10:43:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1310000000000003e-06 2024-04-26T10:43:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034700+0000", 2024-04-26T10:43:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4229999999999996e-06 2024-04-26T10:43:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036183+0000", 2024-04-26T10:43:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001482964 2024-04-26T10:43:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036297+0000", 2024-04-26T10:43:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113649 2024-04-26T10:43:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:43:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036426+0000", 2024-04-26T10:43:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012924900000000001 2024-04-26T10:43:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040839+0000", 2024-04-26T10:43:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044137079999999997 2024-04-26T10:43:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043679+0000", 2024-04-26T10:43:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028397850000000001 2024-04-26T10:43:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043725+0000", 2024-04-26T10:43:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5859999999999998e-05 2024-04-26T10:43:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043899+0000", 2024-04-26T10:43:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000174267 2024-04-26T10:43:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:43:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.351432508999999, 2024-04-26T10:43:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011493046999999999, 2024-04-26T10:43:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:43:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:43:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:43:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034711+0000", 2024-04-26T10:43:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4359999999999998e-06 2024-04-26T10:43:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034717+0000", 2024-04-26T10:43:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7939999999999999e-06 2024-04-26T10:43:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034723+0000", 2024-04-26T10:43:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6219999999999997e-06 2024-04-26T10:43:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035221+0000", 2024-04-26T10:43:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00049811199999999999 2024-04-26T10:43:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035351+0000", 2024-04-26T10:43:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013049200000000001 2024-04-26T10:43:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035467+0000", 2024-04-26T10:43:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115364 2024-04-26T10:43:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040085+0000", 2024-04-26T10:43:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046182300000000001 2024-04-26T10:43:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046133+0000", 2024-04-26T10:43:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060476059999999996 2024-04-26T10:43:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046165+0000", 2024-04-26T10:43:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2155e-05 2024-04-26T10:43:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046201+0000", 2024-04-26T10:43:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6566999999999997e-05 2024-04-26T10:43:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:43:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 35.351346100000001, 2024-04-26T10:43:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014742026, 2024-04-26T10:43:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-26T10:43:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:43:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:43:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034793+0000", 2024-04-26T10:43:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-26T10:43:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034802+0000", 2024-04-26T10:43:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.551e-06 2024-04-26T10:43:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034815+0000", 2024-04-26T10:43:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2706e-05 2024-04-26T10:43:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034824+0000", 2024-04-26T10:43:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5189999999999998e-06 2024-04-26T10:43:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039312+0000", 2024-04-26T10:43:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044874030000000001 2024-04-26T10:43:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039457+0000", 2024-04-26T10:43:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000145081 2024-04-26T10:43:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049537+0000", 2024-04-26T10:43:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010080053 2024-04-26T10:43:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.502 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:01.502 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:01.502 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-26T10:43:01.503 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:01.502+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:01.505 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:01.507 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:43:01.508 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:43:01.510 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-26T10:42:59.599003+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596004,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":253,"num_write_kb":3480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95100,"kb_used_data":1736,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283020420,"statfs":{"total":289910292480,"available":289812910080,"internally_reserved":0,"allocated":1777664,"data_stored":1393401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001142"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.734183+0000","last_change":"2024-04-26T10:42:26.045527+0000","last_active":"2024-04-26T10:42:52.734183+0000","last_peered":"2024-04-26T10:42:52.734183+0000","last_clean":"2024-04-26T10:42:52.734183+0000","last_became_active":"2024-04-26T10:42:26.044597+0000","last_became_peered":"2024-04-26T10:42:26.044597+0000","last_unstale":"2024-04-26T10:42:52.734183+0000","last_undegraded":"2024-04-26T10:42:52.734183+0000","last_fullsized":"2024-04-26T10:42:52.734183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.734130+0000","last_change":"2024-04-26T10:42:26.043815+0000","last_active":"2024-04-26T10:42:52.734130+0000","last_peered":"2024-04-26T10:42:52.734130+0000","last_clean":"2024-04-26T10:42:52.734130+0000","last_became_active":"2024-04-26T10:42:26.042757+0000","last_became_peered":"2024-04-26T10:42:26.042757+0000","last_unstale":"2024-04-26T10:42:52.734130+0000","last_undegraded":"2024-04-26T10:42:52.734130+0000","last_fullsized":"2024-04-26T10:42:52.734130+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:27.752674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733490+0000","last_change":"2024-04-26T10:42:26.041030+0000","last_active":"2024-04-26T10:42:52.733490+0000","last_peered":"2024-04-26T10:42:52.733490+0000","last_clean":"2024-04-26T10:42:52.733490+0000","last_became_active":"2024-04-26T10:42:26.039762+0000","last_became_peered":"2024-04-26T10:42:26.039762+0000","last_unstale":"2024-04-26T10:42:52.733490+0000","last_undegraded":"2024-04-26T10:42:52.733490+0000","last_fullsized":"2024-04-26T10:42:52.733490+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733604+0000","last_change":"2024-04-26T10:42:26.044004+0000","last_active":"2024-04-26T10:42:52.733604+0000","last_peered":"2024-04-26T10:42:52.733604+0000","last_clean":"2024-04-26T10:42:52.733604+0000","last_became_active":"2024-04-26T10:42:26.042953+0000","last_became_peered":"2024-04-26T10:42:26.042953+0000","last_unstale":"2024-04-26T10:42:52.733604+0000","last_undegraded":"2024-04-26T10:42:52.733604+0000","last_fullsized":"2024-04-26T10:42:52.733604+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.895922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733926+0000","last_change":"2024-04-26T10:42:26.041191+0000","last_active":"2024-04-26T10:42:52.733926+0000","last_peered":"2024-04-26T10:42:52.733926+0000","last_clean":"2024-04-26T10:42:52.733926+0000","last_became_active":"2024-04-26T10:42:26.040487+0000","last_became_peered":"2024-04-26T10:42:26.040487+0000","last_unstale":"2024-04-26T10:42:52.733926+0000","last_undegraded":"2024-04-26T10:42:52.733926+0000","last_fullsized":"2024-04-26T10:42:52.733926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733325+0000","last_change":"2024-04-26T10:42:26.043542+0000","last_active":"2024-04-26T10:42:52.733325+0000","last_peered":"2024-04-26T10:42:52.733325+0000","last_clean":"2024-04-26T10:42:52.733325+0000","last_became_active":"2024-04-26T10:42:26.042631+0000","last_became_peered":"2024-04-26T10:42:26.042631+0000","last_unstale":"2024-04-26T10:42:52.733325+0000","last_undegraded":"2024-04-26T10:42:52.733325+0000","last_fullsized":"2024-04-26T10:42:52.733325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:38.272126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733304+0000","last_change":"2024-04-26T10:42:26.042698+0000","last_active":"2024-04-26T10:42:52.733304+0000","last_peered":"2024-04-26T10:42:52.733304+0000","last_clean":"2024-04-26T10:42:52.733304+0000","last_became_active":"2024-04-26T10:42:26.041631+0000","last_became_peered":"2024-04-26T10:42:26.041631+0000","last_unstale":"2024-04-26T10:42:52.733304+0000","last_undegraded":"2024-04-26T10:42:52.733304+0000","last_fullsized":"2024-04-26T10:42:52.733304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:27.752674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733135+0000","last_change":"2024-04-26T10:42:26.045497+0000","last_active":"2024-04-26T10:42:52.733135+0000","last_peered":"2024-04-26T10:42:52.733135+0000","last_clean":"2024-04-26T10:42:52.733135+0000","last_became_active":"2024-04-26T10:42:26.044865+0000","last_became_peered":"2024-04-26T10:42:26.044865+0000","last_unstale":"2024-04-26T10:42:52.733135+0000","last_undegraded":"2024-04-26T10:42:52.733135+0000","last_fullsized":"2024-04-26T10:42:52.733135+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:59:04.853293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733730+0000","last_change":"2024-04-26T10:42:26.045893+0000","last_active":"2024-04-26T10:42:52.733730+0000","last_peered":"2024-04-26T10:42:52.733730+0000","last_clean":"2024-04-26T10:42:52.733730+0000","last_became_active":"2024-04-26T10:42:26.045177+0000","last_became_peered":"2024-04-26T10:42:26.045177+0000","last_unstale":"2024-04-26T10:42:52.733730+0000","last_undegraded":"2024-04-26T10:42:52.733730+0000","last_fullsized":"2024-04-26T10:42:52.733730+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.734232+0000","last_change":"2024-04-26T10:42:26.044101+0000","last_active":"2024-04-26T10:42:52.734232+0000","last_peered":"2024-04-26T10:42:52.734232+0000","last_clean":"2024-04-26T10:42:52.734232+0000","last_became_active":"2024-04-26T10:42:26.042047+0000","last_became_peered":"2024-04-26T10:42:26.042047+0000","last_unstale":"2024-04-26T10:42:52.734232+0000","last_undegraded":"2024-04-26T10:42:52.734232+0000","last_fullsized":"2024-04-26T10:42:52.734232+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:46.975947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733584+0000","last_change":"2024-04-26T10:42:26.043530+0000","last_active":"2024-04-26T10:42:52.733584+0000","last_peered":"2024-04-26T10:42:52.733584+0000","last_clean":"2024-04-26T10:42:52.733584+0000","last_became_active":"2024-04-26T10:42:26.042301+0000","last_became_peered":"2024-04-26T10:42:26.042301+0000","last_unstale":"2024-04-26T10:42:52.733584+0000","last_undegraded":"2024-04-26T10:42:52.733584+0000","last_fullsized":"2024-04-26T10:42:52.733584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:48.440963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733832+0000","last_change":"2024-04-26T10:42:26.047073+0000","last_active":"2024-04-26T10:42:52.733832+0000","last_peered":"2024-04-26T10:42:52.733832+0000","last_clean":"2024-04-26T10:42:52.733832+0000","last_became_active":"2024-04-26T10:42:26.046384+0000","last_became_peered":"2024-04-26T10:42:26.046384+0000","last_unstale":"2024-04-26T10:42:52.733832+0000","last_undegraded":"2024-04-26T10:42:52.733832+0000","last_fullsized":"2024-04-26T10:42:52.733832+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:23.079349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733716+0000","last_change":"2024-04-26T10:42:26.042607+0000","last_active":"2024-04-26T10:42:52.733716+0000","last_peered":"2024-04-26T10:42:52.733716+0000","last_clean":"2024-04-26T10:42:52.733716+0000","last_became_active":"2024-04-26T10:42:26.041617+0000","last_became_peered":"2024-04-26T10:42:26.041617+0000","last_unstale":"2024-04-26T10:42:52.733716+0000","last_undegraded":"2024-04-26T10:42:52.733716+0000","last_fullsized":"2024-04-26T10:42:52.733716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733345+0000","last_change":"2024-04-26T10:42:26.040433+0000","last_active":"2024-04-26T10:42:52.733345+0000","last_peered":"2024-04-26T10:42:52.733345+0000","last_clean":"2024-04-26T10:42:52.733345+0000","last_became_active":"2024-04-26T10:42:26.039631+0000","last_became_peered":"2024-04-26T10:42:26.039631+0000","last_unstale":"2024-04-26T10:42:52.733345+0000","last_undegraded":"2024-04-26T10:42:52.733345+0000","last_fullsized":"2024-04-26T10:42:52.733345+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733342+0000","last_change":"2024-04-26T10:42:26.040182+0000","last_active":"2024-04-26T10:42:52.733342+0000","last_peered":"2024-04-26T10:42:52.733342+0000","last_clean":"2024-04-26T10:42:52.733342+0000","last_became_active":"2024-04-26T10:42:26.038614+0000","last_became_peered":"2024-04-26T10:42:26.038614+0000","last_unstale":"2024-04-26T10:42:52.733342+0000","last_undegraded":"2024-04-26T10:42:52.733342+0000","last_fullsized":"2024-04-26T10:42:52.733342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733163+0000","last_change":"2024-04-26T10:42:26.045551+0000","last_active":"2024-04-26T10:42:52.733163+0000","last_peered":"2024-04-26T10:42:52.733163+0000","last_clean":"2024-04-26T10:42:52.733163+0000","last_became_active":"2024-04-26T10:42:26.044944+0000","last_became_peered":"2024-04-26T10:42:26.044944+0000","last_unstale":"2024-04-26T10:42:52.733163+0000","last_undegraded":"2024-04-26T10:42:52.733163+0000","last_fullsized":"2024-04-26T10:42:52.733163+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:02.194279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.734039+0000","last_change":"2024-04-26T10:42:26.049338+0000","last_active":"2024-04-26T10:42:52.734039+0000","last_peered":"2024-04-26T10:42:52.734039+0000","last_clean":"2024-04-26T10:42:52.734039+0000","last_became_active":"2024-04-26T10:42:26.049014+0000","last_became_peered":"2024-04-26T10:42:26.049014+0000","last_unstale":"2024-04-26T10:42:52.734039+0000","last_undegraded":"2024-04-26T10:42:52.734039+0000","last_fullsized":"2024-04-26T10:42:52.734039+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.734365+0000","last_change":"2024-04-26T10:42:26.043604+0000","last_active":"2024-04-26T10:42:52.734365+0000","last_peered":"2024-04-26T10:42:52.734365+0000","last_clean":"2024-04-26T10:42:52.734365+0000","last_became_active":"2024-04-26T10:42:26.041224+0000","last_became_peered":"2024-04-26T10:42:26.041224+0000","last_unstale":"2024-04-26T10:42:52.734365+0000","last_undegraded":"2024-04-26T10:42:52.734365+0000","last_fullsized":"2024-04-26T10:42:52.734365+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733671+0000","last_change":"2024-04-26T10:42:26.045031+0000","last_active":"2024-04-26T10:42:52.733671+0000","last_peered":"2024-04-26T10:42:52.733671+0000","last_clean":"2024-04-26T10:42:52.733671+0000","last_became_active":"2024-04-26T10:42:26.044604+0000","last_became_peered":"2024-04-26T10:42:26.044604+0000","last_unstale":"2024-04-26T10:42:52.733671+0000","last_undegraded":"2024-04-26T10:42:52.733671+0000","last_fullsized":"2024-04-26T10:42:52.733671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733595+0000","last_change":"2024-04-26T10:42:26.043762+0000","last_active":"2024-04-26T10:42:52.733595+0000","last_peered":"2024-04-26T10:42:52.733595+0000","last_clean":"2024-04-26T10:42:52.733595+0000","last_became_active":"2024-04-26T10:42:26.042117+0000","last_became_peered":"2024-04-26T10:42:26.042117+0000","last_unstale":"2024-04-26T10:42:52.733595+0000","last_undegraded":"2024-04-26T10:42:52.733595+0000","last_fullsized":"2024-04-26T10:42:52.733595+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:35.276961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733793+0000","last_change":"2024-04-26T10:42:26.044062+0000","last_active":"2024-04-26T10:42:52.733793+0000","last_peered":"2024-04-26T10:42:52.733793+0000","last_clean":"2024-04-26T10:42:52.733793+0000","last_became_active":"2024-04-26T10:42:26.042378+0000","last_became_peered":"2024-04-26T10:42:26.042378+0000","last_unstale":"2024-04-26T10:42:52.733793+0000","last_undegraded":"2024-04-26T10:42:52.733793+0000","last_fullsized":"2024-04-26T10:42:52.733793+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:24.255706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733539+0000","last_change":"2024-04-26T10:42:26.046353+0000","last_active":"2024-04-26T10:42:52.733539+0000","last_peered":"2024-04-26T10:42:52.733539+0000","last_clean":"2024-04-26T10:42:52.733539+0000","last_became_active":"2024-04-26T10:42:26.045614+0000","last_became_peered":"2024-04-26T10:42:26.045614+0000","last_unstale":"2024-04-26T10:42:52.733539+0000","last_undegraded":"2024-04-26T10:42:52.733539+0000","last_fullsized":"2024-04-26T10:42:52.733539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:19.601720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733053+0000","last_change":"2024-04-26T10:42:26.045311+0000","last_active":"2024-04-26T10:42:52.733053+0000","last_peered":"2024-04-26T10:42:52.733053+0000","last_clean":"2024-04-26T10:42:52.733053+0000","last_became_active":"2024-04-26T10:42:26.044614+0000","last_became_peered":"2024-04-26T10:42:26.044614+0000","last_unstale":"2024-04-26T10:42:52.733053+0000","last_undegraded":"2024-04-26T10:42:52.733053+0000","last_fullsized":"2024-04-26T10:42:52.733053+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733356+0000","last_change":"2024-04-26T10:42:26.043614+0000","last_active":"2024-04-26T10:42:52.733356+0000","last_peered":"2024-04-26T10:42:52.733356+0000","last_clean":"2024-04-26T10:42:52.733356+0000","last_became_active":"2024-04-26T10:42:26.042629+0000","last_became_peered":"2024-04-26T10:42:26.042629+0000","last_unstale":"2024-04-26T10:42:52.733356+0000","last_undegraded":"2024-04-26T10:42:52.733356+0000","last_fullsized":"2024-04-26T10:42:52.733356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.734267+0000","last_change":"2024-04-26T10:42:26.046876+0000","last_active":"2024-04-26T10:42:52.734267+0000","last_peered":"2024-04-26T10:42:52.734267+0000","last_clean":"2024-04-26T10:42:52.734267+0000","last_became_active":"2024-04-26T10:42:26.046177+0000","last_became_peered":"2024-04-26T10:42:26.046177+0000","last_unstale":"2024-04-26T10:42:52.734267+0000","last_undegraded":"2024-04-26T10:42:52.734267+0000","last_fullsized":"2024-04-26T10:42:52.734267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:51.567162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733621+0000","last_change":"2024-04-26T10:42:26.044190+0000","last_active":"2024-04-26T10:42:52.733621+0000","last_peered":"2024-04-26T10:42:52.733621+0000","last_clean":"2024-04-26T10:42:52.733621+0000","last_became_active":"2024-04-26T10:42:26.043736+0000","last_became_peered":"2024-04-26T10:42:26.043736+0000","last_unstale":"2024-04-26T10:42:52.733621+0000","last_undegraded":"2024-04-26T10:42:52.733621+0000","last_fullsized":"2024-04-26T10:42:52.733621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733787+0000","last_change":"2024-04-26T10:42:26.041008+0000","last_active":"2024-04-26T10:42:52.733787+0000","last_peered":"2024-04-26T10:42:52.733787+0000","last_clean":"2024-04-26T10:42:52.733787+0000","last_became_active":"2024-04-26T10:42:26.039620+0000","last_became_peered":"2024-04-26T10:42:26.039620+0000","last_unstale":"2024-04-26T10:42:52.733787+0000","last_undegraded":"2024-04-26T10:42:52.733787+0000","last_fullsized":"2024-04-26T10:42:52.733787+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.734164+0000","last_change":"2024-04-26T10:42:26.046392+0000","last_active":"2024-04-26T10:42:52.734164+0000","last_peered":"2024-04-26T10:42:52.734164+0000","last_clean":"2024-04-26T10:42:52.734164+0000","last_became_active":"2024-04-26T10:42:26.045806+0000","last_became_peered":"2024-04-26T10:42:26.045806+0000","last_unstale":"2024-04-26T10:42:52.734164+0000","last_undegraded":"2024-04-26T10:42:52.734164+0000","last_fullsized":"2024-04-26T10:42:52.734164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:15:59.087635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733489+0000","last_change":"2024-04-26T10:42:26.045205+0000","last_active":"2024-04-26T10:42:52.733489+0000","last_peered":"2024-04-26T10:42:52.733489+0000","last_clean":"2024-04-26T10:42:52.733489+0000","last_became_active":"2024-04-26T10:42:26.044762+0000","last_became_peered":"2024-04-26T10:42:26.044762+0000","last_unstale":"2024-04-26T10:42:52.733489+0000","last_undegraded":"2024-04-26T10:42:52.733489+0000","last_fullsized":"2024-04-26T10:42:52.733489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733917+0000","last_change":"2024-04-26T10:42:26.046020+0000","last_active":"2024-04-26T10:42:52.733917+0000","last_peered":"2024-04-26T10:42:52.733917+0000","last_clean":"2024-04-26T10:42:52.733917+0000","last_became_active":"2024-04-26T10:42:26.045567+0000","last_became_peered":"2024-04-26T10:42:26.045567+0000","last_unstale":"2024-04-26T10:42:52.733917+0000","last_undegraded":"2024-04-26T10:42:52.733917+0000","last_fullsized":"2024-04-26T10:42:52.733917+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:53.380329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733086+0000","last_change":"2024-04-26T10:42:26.046584+0000","last_active":"2024-04-26T10:42:52.733086+0000","last_peered":"2024-04-26T10:42:52.733086+0000","last_clean":"2024-04-26T10:42:52.733086+0000","last_became_active":"2024-04-26T10:42:26.046231+0000","last_became_peered":"2024-04-26T10:42:26.046231+0000","last_unstale":"2024-04-26T10:42:52.733086+0000","last_undegraded":"2024-04-26T10:42:52.733086+0000","last_fullsized":"2024-04-26T10:42:52.733086+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733233+0000","last_change":"2024-04-26T10:42:26.045270+0000","last_active":"2024-04-26T10:42:52.733233+0000","last_peered":"2024-04-26T10:42:52.733233+0000","last_clean":"2024-04-26T10:42:52.733233+0000","last_became_active":"2024-04-26T10:42:26.044341+0000","last_became_peered":"2024-04-26T10:42:26.044341+0000","last_unstale":"2024-04-26T10:42:52.733233+0000","last_undegraded":"2024-04-26T10:42:52.733233+0000","last_fullsized":"2024-04-26T10:42:52.733233+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:46.975947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733940+0000","last_change":"2024-04-26T10:42:26.041757+0000","last_active":"2024-04-26T10:42:52.733940+0000","last_peered":"2024-04-26T10:42:52.733940+0000","last_clean":"2024-04-26T10:42:52.733940+0000","last_became_active":"2024-04-26T10:42:26.040920+0000","last_became_peered":"2024-04-26T10:42:26.040920+0000","last_unstale":"2024-04-26T10:42:52.733940+0000","last_undegraded":"2024-04-26T10:42:52.733940+0000","last_fullsized":"2024-04-26T10:42:52.733940+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733761+0000","last_change":"2024-04-26T10:42:25.687138+0000","last_active":"2024-04-26T10:42:52.733761+0000","last_peered":"2024-04-26T10:42:52.733761+0000","last_clean":"2024-04-26T10:42:52.733761+0000","last_became_active":"2024-04-26T10:42:25.686488+0000","last_became_peered":"2024-04-26T10:42:25.686488+0000","last_unstale":"2024-04-26T10:42:52.733761+0000","last_undegraded":"2024-04-26T10:42:52.733761+0000","last_fullsized":"2024-04-26T10:42:52.733761+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:43.969731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.734065+0000","last_change":"2024-04-26T10:42:26.041850+0000","last_active":"2024-04-26T10:42:52.734065+0000","last_peered":"2024-04-26T10:42:52.734065+0000","last_clean":"2024-04-26T10:42:52.734065+0000","last_became_active":"2024-04-26T10:42:26.040464+0000","last_became_peered":"2024-04-26T10:42:26.040464+0000","last_unstale":"2024-04-26T10:42:52.734065+0000","last_undegraded":"2024-04-26T10:42:52.734065+0000","last_fullsized":"2024-04-26T10:42:52.734065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733272+0000","last_change":"2024-04-26T10:42:25.685525+0000","last_active":"2024-04-26T10:42:52.733272+0000","last_peered":"2024-04-26T10:42:52.733272+0000","last_clean":"2024-04-26T10:42:52.733272+0000","last_became_active":"2024-04-26T10:42:25.684855+0000","last_became_peered":"2024-04-26T10:42:25.684855+0000","last_unstale":"2024-04-26T10:42:52.733272+0000","last_undegraded":"2024-04-26T10:42:52.733272+0000","last_fullsized":"2024-04-26T10:42:52.733272+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:16.723401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733754+0000","last_change":"2024-04-26T10:42:26.046616+0000","last_active":"2024-04-26T10:42:52.733754+0000","last_peered":"2024-04-26T10:42:52.733754+0000","last_clean":"2024-04-26T10:42:52.733754+0000","last_became_active":"2024-04-26T10:42:26.046010+0000","last_became_peered":"2024-04-26T10:42:26.046010+0000","last_unstale":"2024-04-26T10:42:52.733754+0000","last_undegraded":"2024-04-26T10:42:52.733754+0000","last_fullsized":"2024-04-26T10:42:52.733754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:19.601720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733722+0000","last_change":"2024-04-26T10:42:25.688905+0000","last_active":"2024-04-26T10:42:52.733722+0000","last_peered":"2024-04-26T10:42:52.733722+0000","last_clean":"2024-04-26T10:42:52.733722+0000","last_became_active":"2024-04-26T10:42:25.688504+0000","last_became_peered":"2024-04-26T10:42:25.688504+0000","last_unstale":"2024-04-26T10:42:52.733722+0000","last_undegraded":"2024-04-26T10:42:52.733722+0000","last_fullsized":"2024-04-26T10:42:52.733722+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.930441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733801+0000","last_change":"2024-04-26T10:42:26.046158+0000","last_active":"2024-04-26T10:42:52.733801+0000","last_peered":"2024-04-26T10:42:52.733801+0000","last_clean":"2024-04-26T10:42:52.733801+0000","last_became_active":"2024-04-26T10:42:26.045797+0000","last_became_peered":"2024-04-26T10:42:26.045797+0000","last_unstale":"2024-04-26T10:42:52.733801+0000","last_undegraded":"2024-04-26T10:42:52.733801+0000","last_fullsized":"2024-04-26T10:42:52.733801+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:23.079349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733242+0000","last_change":"2024-04-26T10:42:25.687207+0000","last_active":"2024-04-26T10:42:52.733242+0000","last_peered":"2024-04-26T10:42:52.733242+0000","last_clean":"2024-04-26T10:42:52.733242+0000","last_became_active":"2024-04-26T10:42:25.686549+0000","last_became_peered":"2024-04-26T10:42:25.686549+0000","last_unstale":"2024-04-26T10:42:52.733242+0000","last_undegraded":"2024-04-26T10:42:52.733242+0000","last_fullsized":"2024-04-26T10:42:52.733242+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:42.125386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733920+0000","last_change":"2024-04-26T10:42:25.684462+0000","last_active":"2024-04-26T10:42:52.733920+0000","last_peered":"2024-04-26T10:42:52.733920+0000","last_clean":"2024-04-26T10:42:52.733920+0000","last_became_active":"2024-04-26T10:42:25.684162+0000","last_became_peered":"2024-04-26T10:42:25.684162+0000","last_unstale":"2024-04-26T10:42:52.733920+0000","last_undegraded":"2024-04-26T10:42:52.733920+0000","last_fullsized":"2024-04-26T10:42:52.733920+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.850118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733400+0000","last_change":"2024-04-26T10:42:26.048114+0000","last_active":"2024-04-26T10:42:52.733400+0000","last_peered":"2024-04-26T10:42:52.733400+0000","last_clean":"2024-04-26T10:42:52.733400+0000","last_became_active":"2024-04-26T10:42:26.046641+0000","last_became_peered":"2024-04-26T10:42:26.046641+0000","last_unstale":"2024-04-26T10:42:52.733400+0000","last_undegraded":"2024-04-26T10:42:52.733400+0000","last_fullsized":"2024-04-26T10:42:52.733400+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:01.056945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.734377+0000","last_change":"2024-04-26T10:42:25.688889+0000","last_active":"2024-04-26T10:42:52.734377+0000","last_peered":"2024-04-26T10:42:52.734377+0000","last_clean":"2024-04-26T10:42:52.734377+0000","last_became_active":"2024-04-26T10:42:25.688372+0000","last_became_peered":"2024-04-26T10:42:25.688372+0000","last_unstale":"2024-04-26T10:42:52.734377+0000","last_undegraded":"2024-04-26T10:42:52.734377+0000","last_fullsized":"2024-04-26T10:42:52.734377+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:21:13.799290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733486+0000","last_change":"2024-04-26T10:42:26.041968+0000","last_active":"2024-04-26T10:42:52.733486+0000","last_peered":"2024-04-26T10:42:52.733486+0000","last_clean":"2024-04-26T10:42:52.733486+0000","last_became_active":"2024-04-26T10:42:26.041070+0000","last_became_peered":"2024-04-26T10:42:26.041070+0000","last_unstale":"2024-04-26T10:42:52.733486+0000","last_undegraded":"2024-04-26T10:42:52.733486+0000","last_fullsized":"2024-04-26T10:42:52.733486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733953+0000","last_change":"2024-04-26T10:42:25.684653+0000","last_active":"2024-04-26T10:42:52.733953+0000","last_peered":"2024-04-26T10:42:52.733953+0000","last_clean":"2024-04-26T10:42:52.733953+0000","last_became_active":"2024-04-26T10:42:25.684338+0000","last_became_peered":"2024-04-26T10:42:25.684338+0000","last_unstale":"2024-04-26T10:42:52.733953+0000","last_undegraded":"2024-04-26T10:42:52.733953+0000","last_fullsized":"2024-04-26T10:42:52.733953+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:10.694039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733405+0000","last_change":"2024-04-26T10:42:26.042182+0000","last_active":"2024-04-26T10:42:52.733405+0000","last_peered":"2024-04-26T10:42:52.733405+0000","last_clean":"2024-04-26T10:42:52.733405+0000","last_became_active":"2024-04-26T10:42:26.041689+0000","last_became_peered":"2024-04-26T10:42:26.041689+0000","last_unstale":"2024-04-26T10:42:52.733405+0000","last_undegraded":"2024-04-26T10:42:52.733405+0000","last_fullsized":"2024-04-26T10:42:52.733405+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:32:19.618648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733819+0000","last_change":"2024-04-26T10:42:25.686677+0000","last_active":"2024-04-26T10:42:52.733819+0000","last_peered":"2024-04-26T10:42:52.733819+0000","last_clean":"2024-04-26T10:42:52.733819+0000","last_became_active":"2024-04-26T10:42:25.685939+0000","last_became_peered":"2024-04-26T10:42:25.685939+0000","last_unstale":"2024-04-26T10:42:52.733819+0000","last_undegraded":"2024-04-26T10:42:52.733819+0000","last_fullsized":"2024-04-26T10:42:52.733819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:30.225098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733480+0000","last_change":"2024-04-26T10:42:26.045829+0000","last_active":"2024-04-26T10:42:52.733480+0000","last_peered":"2024-04-26T10:42:52.733480+0000","last_clean":"2024-04-26T10:42:52.733480+0000","last_became_active":"2024-04-26T10:42:26.045499+0000","last_became_peered":"2024-04-26T10:42:26.045499+0000","last_unstale":"2024-04-26T10:42:52.733480+0000","last_undegraded":"2024-04-26T10:42:52.733480+0000","last_fullsized":"2024-04-26T10:42:52.733480+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:14.041039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733712+0000","last_change":"2024-04-26T10:42:25.687934+0000","last_active":"2024-04-26T10:42:52.733712+0000","last_peered":"2024-04-26T10:42:52.733712+0000","last_clean":"2024-04-26T10:42:52.733712+0000","last_became_active":"2024-04-26T10:42:25.687447+0000","last_became_peered":"2024-04-26T10:42:25.687447+0000","last_unstale":"2024-04-26T10:42:52.733712+0000","last_undegraded":"2024-04-26T10:42:52.733712+0000","last_fullsized":"2024-04-26T10:42:52.733712+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.930441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733701+0000","last_change":"2024-04-26T10:42:26.043638+0000","last_active":"2024-04-26T10:42:52.733701+0000","last_peered":"2024-04-26T10:42:52.733701+0000","last_clean":"2024-04-26T10:42:52.733701+0000","last_became_active":"2024-04-26T10:42:26.042692+0000","last_became_peered":"2024-04-26T10:42:26.042692+0000","last_unstale":"2024-04-26T10:42:52.733701+0000","last_undegraded":"2024-04-26T10:42:52.733701+0000","last_fullsized":"2024-04-26T10:42:52.733701+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733594+0000","last_change":"2024-04-26T10:42:25.687283+0000","last_active":"2024-04-26T10:42:52.733594+0000","last_peered":"2024-04-26T10:42:52.733594+0000","last_clean":"2024-04-26T10:42:52.733594+0000","last_became_active":"2024-04-26T10:42:25.686251+0000","last_became_peered":"2024-04-26T10:42:25.686251+0000","last_unstale":"2024-04-26T10:42:52.733594+0000","last_undegraded":"2024-04-26T10:42:52.733594+0000","last_fullsized":"2024-04-26T10:42:52.733594+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:16.723401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733889+0000","last_change":"2024-04-26T10:42:26.040688+0000","last_active":"2024-04-26T10:42:52.733889+0000","last_peered":"2024-04-26T10:42:52.733889+0000","last_clean":"2024-04-26T10:42:52.733889+0000","last_became_active":"2024-04-26T10:42:26.039133+0000","last_became_peered":"2024-04-26T10:42:26.039133+0000","last_unstale":"2024-04-26T10:42:52.733889+0000","last_undegraded":"2024-04-26T10:42:52.733889+0000","last_fullsized":"2024-04-26T10:42:52.733889+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733610+0000","last_change":"2024-04-26T10:42:25.688837+0000","last_active":"2024-04-26T10:42:52.733610+0000","last_peered":"2024-04-26T10:42:52.733610+0000","last_clean":"2024-04-26T10:42:52.733610+0000","last_became_active":"2024-04-26T10:42:25.688450+0000","last_became_peered":"2024-04-26T10:42:25.688450+0000","last_unstale":"2024-04-26T10:42:52.733610+0000","last_undegraded":"2024-04-26T10:42:52.733610+0000","last_fullsized":"2024-04-26T10:42:52.733610+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:26.788267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733755+0000","last_change":"2024-04-26T10:42:26.039661+0000","last_active":"2024-04-26T10:42:52.733755+0000","last_peered":"2024-04-26T10:42:52.733755+0000","last_clean":"2024-04-26T10:42:52.733755+0000","last_became_active":"2024-04-26T10:42:26.038664+0000","last_became_peered":"2024-04-26T10:42:26.038664+0000","last_unstale":"2024-04-26T10:42:52.733755+0000","last_undegraded":"2024-04-26T10:42:52.733755+0000","last_fullsized":"2024-04-26T10:42:52.733755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733421+0000","last_change":"2024-04-26T10:42:25.687082+0000","last_active":"2024-04-26T10:42:52.733421+0000","last_peered":"2024-04-26T10:42:52.733421+0000","last_clean":"2024-04-26T10:42:52.733421+0000","last_became_active":"2024-04-26T10:42:25.686779+0000","last_became_peered":"2024-04-26T10:42:25.686779+0000","last_unstale":"2024-04-26T10:42:52.733421+0000","last_undegraded":"2024-04-26T10:42:52.733421+0000","last_fullsized":"2024-04-26T10:42:52.733421+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:12.284219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733854+0000","last_change":"2024-04-26T10:42:26.047130+0000","last_active":"2024-04-26T10:42:52.733854+0000","last_peered":"2024-04-26T10:42:52.733854+0000","last_clean":"2024-04-26T10:42:52.733854+0000","last_became_active":"2024-04-26T10:42:26.046884+0000","last_became_peered":"2024-04-26T10:42:26.046884+0000","last_unstale":"2024-04-26T10:42:52.733854+0000","last_undegraded":"2024-04-26T10:42:52.733854+0000","last_fullsized":"2024-04-26T10:42:52.733854+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:31.020364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":215,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733567+0000","last_change":"2024-04-26T10:42:21.406599+0000","last_active":"2024-04-26T10:42:52.733567+0000","last_peered":"2024-04-26T10:42:52.733567+0000","last_clean":"2024-04-26T10:42:52.733567+0000","last_became_active":"2024-04-26T10:42:21.405587+0000","last_became_peered":"2024-04-26T10:42:21.405587+0000","last_unstale":"2024-04-26T10:42:52.733567+0000","last_undegraded":"2024-04-26T10:42:52.733567+0000","last_fullsized":"2024-04-26T10:42:52.733567+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:44.561530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733880+0000","last_change":"2024-04-26T10:42:21.405305+0000","last_active":"2024-04-26T10:42:52.733880+0000","last_peered":"2024-04-26T10:42:52.733880+0000","last_clean":"2024-04-26T10:42:52.733880+0000","last_became_active":"2024-04-26T10:42:21.405032+0000","last_became_peered":"2024-04-26T10:42:21.405032+0000","last_unstale":"2024-04-26T10:42:52.733880+0000","last_undegraded":"2024-04-26T10:42:52.733880+0000","last_fullsized":"2024-04-26T10:42:52.733880+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733399+0000","last_change":"2024-04-26T10:42:25.686765+0000","last_active":"2024-04-26T10:42:52.733399+0000","last_peered":"2024-04-26T10:42:52.733399+0000","last_clean":"2024-04-26T10:42:52.733399+0000","last_became_active":"2024-04-26T10:42:25.686009+0000","last_became_peered":"2024-04-26T10:42:25.686009+0000","last_unstale":"2024-04-26T10:42:52.733399+0000","last_undegraded":"2024-04-26T10:42:52.733399+0000","last_fullsized":"2024-04-26T10:42:52.733399+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:54.627815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733896+0000","last_change":"2024-04-26T10:42:26.040215+0000","last_active":"2024-04-26T10:42:52.733896+0000","last_peered":"2024-04-26T10:42:52.733896+0000","last_clean":"2024-04-26T10:42:52.733896+0000","last_became_active":"2024-04-26T10:42:26.039129+0000","last_became_peered":"2024-04-26T10:42:26.039129+0000","last_unstale":"2024-04-26T10:42:52.733896+0000","last_undegraded":"2024-04-26T10:42:52.733896+0000","last_fullsized":"2024-04-26T10:42:52.733896+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733388+0000","last_change":"2024-04-26T10:42:21.406881+0000","last_active":"2024-04-26T10:42:52.733388+0000","last_peered":"2024-04-26T10:42:52.733388+0000","last_clean":"2024-04-26T10:42:52.733388+0000","last_became_active":"2024-04-26T10:42:21.406634+0000","last_became_peered":"2024-04-26T10:42:21.406634+0000","last_unstale":"2024-04-26T10:42:52.733388+0000","last_undegraded":"2024-04-26T10:42:52.733388+0000","last_fullsized":"2024-04-26T10:42:52.733388+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:45.892841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733247+0000","last_change":"2024-04-26T10:42:25.687986+0000","last_active":"2024-04-26T10:42:52.733247+0000","last_peered":"2024-04-26T10:42:52.733247+0000","last_clean":"2024-04-26T10:42:52.733247+0000","last_became_active":"2024-04-26T10:42:25.687201+0000","last_became_peered":"2024-04-26T10:42:25.687201+0000","last_unstale":"2024-04-26T10:42:52.733247+0000","last_undegraded":"2024-04-26T10:42:52.733247+0000","last_fullsized":"2024-04-26T10:42:52.733247+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:35.867262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.734272+0000","last_change":"2024-04-26T10:42:26.043723+0000","last_active":"2024-04-26T10:42:52.734272+0000","last_peered":"2024-04-26T10:42:52.734272+0000","last_clean":"2024-04-26T10:42:52.734272+0000","last_became_active":"2024-04-26T10:42:26.041814+0000","last_became_peered":"2024-04-26T10:42:26.041814+0000","last_unstale":"2024-04-26T10:42:52.734272+0000","last_undegraded":"2024-04-26T10:42:52.734272+0000","last_fullsized":"2024-04-26T10:42:52.734272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:11.993163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733321+0000","last_change":"2024-04-26T10:42:21.405597+0000","last_active":"2024-04-26T10:42:52.733321+0000","last_peered":"2024-04-26T10:42:52.733321+0000","last_clean":"2024-04-26T10:42:52.733321+0000","last_became_active":"2024-04-26T10:42:21.405117+0000","last_became_peered":"2024-04-26T10:42:21.405117+0000","last_unstale":"2024-04-26T10:42:52.733321+0000","last_undegraded":"2024-04-26T10:42:52.733321+0000","last_fullsized":"2024-04-26T10:42:52.733321+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:17.146824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733476+0000","last_change":"2024-04-26T10:42:25.688955+0000","last_active":"2024-04-26T10:42:52.733476+0000","last_peered":"2024-04-26T10:42:52.733476+0000","last_clean":"2024-04-26T10:42:52.733476+0000","last_became_active":"2024-04-26T10:42:25.688552+0000","last_became_peered":"2024-04-26T10:42:25.688552+0000","last_unstale":"2024-04-26T10:42:52.733476+0000","last_undegraded":"2024-04-26T10:42:52.733476+0000","last_fullsized":"2024-04-26T10:42:52.733476+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:04.963775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733909+0000","last_change":"2024-04-26T10:42:26.049311+0000","last_active":"2024-04-26T10:42:52.733909+0000","last_peered":"2024-04-26T10:42:52.733909+0000","last_clean":"2024-04-26T10:42:52.733909+0000","last_became_active":"2024-04-26T10:42:26.048915+0000","last_became_peered":"2024-04-26T10:42:26.048915+0000","last_unstale":"2024-04-26T10:42:52.733909+0000","last_undegraded":"2024-04-26T10:42:52.733909+0000","last_fullsized":"2024-04-26T10:42:52.733909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:01.056945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733575+0000","last_change":"2024-04-26T10:42:21.405298+0000","last_active":"2024-04-26T10:42:52.733575+0000","last_peered":"2024-04-26T10:42:52.733575+0000","last_clean":"2024-04-26T10:42:52.733575+0000","last_became_active":"2024-04-26T10:42:21.405011+0000","last_became_peered":"2024-04-26T10:42:21.405011+0000","last_unstale":"2024-04-26T10:42:52.733575+0000","last_undegraded":"2024-04-26T10:42:52.733575+0000","last_fullsized":"2024-04-26T10:42:52.733575+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:47.789961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733836+0000","last_change":"2024-04-26T10:42:25.686177+0000","last_active":"2024-04-26T10:42:52.733836+0000","last_peered":"2024-04-26T10:42:52.733836+0000","last_clean":"2024-04-26T10:42:52.733836+0000","last_became_active":"2024-04-26T10:42:25.685121+0000","last_became_peered":"2024-04-26T10:42:25.685121+0000","last_unstale":"2024-04-26T10:42:52.733836+0000","last_undegraded":"2024-04-26T10:42:52.733836+0000","last_fullsized":"2024-04-26T10:42:52.733836+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:34.398138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733754+0000","last_change":"2024-04-26T10:42:26.045312+0000","last_active":"2024-04-26T10:42:52.733754+0000","last_peered":"2024-04-26T10:42:52.733754+0000","last_clean":"2024-04-26T10:42:52.733754+0000","last_became_active":"2024-04-26T10:42:26.044619+0000","last_became_peered":"2024-04-26T10:42:26.044619+0000","last_unstale":"2024-04-26T10:42:52.733754+0000","last_undegraded":"2024-04-26T10:42:52.733754+0000","last_fullsized":"2024-04-26T10:42:52.733754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:50.646374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733980+0000","last_change":"2024-04-26T10:42:25.686310+0000","last_active":"2024-04-26T10:42:52.733980+0000","last_peered":"2024-04-26T10:42:52.733980+0000","last_clean":"2024-04-26T10:42:52.733980+0000","last_became_active":"2024-04-26T10:42:25.685767+0000","last_became_peered":"2024-04-26T10:42:25.685767+0000","last_unstale":"2024-04-26T10:42:52.733980+0000","last_undegraded":"2024-04-26T10:42:52.733980+0000","last_fullsized":"2024-04-26T10:42:52.733980+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:02.874807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733841+0000","last_change":"2024-04-26T10:42:21.405754+0000","last_active":"2024-04-26T10:42:52.733841+0000","last_peered":"2024-04-26T10:42:52.733841+0000","last_clean":"2024-04-26T10:42:52.733841+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:42:52.733841+0000","last_undegraded":"2024-04-26T10:42:52.733841+0000","last_fullsized":"2024-04-26T10:42:52.733841+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:47.123256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733671+0000","last_change":"2024-04-26T10:42:26.043764+0000","last_active":"2024-04-26T10:42:52.733671+0000","last_peered":"2024-04-26T10:42:52.733671+0000","last_clean":"2024-04-26T10:42:52.733671+0000","last_became_active":"2024-04-26T10:42:26.043388+0000","last_became_peered":"2024-04-26T10:42:26.043388+0000","last_unstale":"2024-04-26T10:42:52.733671+0000","last_undegraded":"2024-04-26T10:42:52.733671+0000","last_fullsized":"2024-04-26T10:42:52.733671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:31.020364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733767+0000","last_change":"2024-04-26T10:42:25.685368+0000","last_active":"2024-04-26T10:42:52.733767+0000","last_peered":"2024-04-26T10:42:52.733767+0000","last_clean":"2024-04-26T10:42:52.733767+0000","last_became_active":"2024-04-26T10:42:25.684379+0000","last_became_peered":"2024-04-26T10:42:25.684379+0000","last_unstale":"2024-04-26T10:42:52.733767+0000","last_undegraded":"2024-04-26T10:42:52.733767+0000","last_fullsized":"2024-04-26T10:42:52.733767+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:34.398138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.734436+0000","last_change":"2024-04-26T10:42:21.405356+0000","last_active":"2024-04-26T10:42:52.734436+0000","last_peered":"2024-04-26T10:42:52.734436+0000","last_clean":"2024-04-26T10:42:52.734436+0000","last_became_active":"2024-04-26T10:42:21.405006+0000","last_became_peered":"2024-04-26T10:42:21.405006+0000","last_unstale":"2024-04-26T10:42:52.734436+0000","last_undegraded":"2024-04-26T10:42:52.734436+0000","last_fullsized":"2024-04-26T10:42:52.734436+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:55.043967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733832+0000","last_change":"2024-04-26T10:42:26.042954+0000","last_active":"2024-04-26T10:42:52.733832+0000","last_peered":"2024-04-26T10:42:52.733832+0000","last_clean":"2024-04-26T10:42:52.733832+0000","last_became_active":"2024-04-26T10:42:26.042544+0000","last_became_peered":"2024-04-26T10:42:26.042544+0000","last_unstale":"2024-04-26T10:42:52.733832+0000","last_undegraded":"2024-04-26T10:42:52.733832+0000","last_fullsized":"2024-04-26T10:42:52.733832+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:14.041039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.734020+0000","last_change":"2024-04-26T10:42:25.687201+0000","last_active":"2024-04-26T10:42:52.734020+0000","last_peered":"2024-04-26T10:42:52.734020+0000","last_clean":"2024-04-26T10:42:52.734020+0000","last_became_active":"2024-04-26T10:42:25.686641+0000","last_became_peered":"2024-04-26T10:42:25.686641+0000","last_unstale":"2024-04-26T10:42:52.734020+0000","last_undegraded":"2024-04-26T10:42:52.734020+0000","last_fullsized":"2024-04-26T10:42:52.734020+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:30.225098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733835+0000","last_change":"2024-04-26T10:42:21.405615+0000","last_active":"2024-04-26T10:42:52.733835+0000","last_peered":"2024-04-26T10:42:52.733835+0000","last_clean":"2024-04-26T10:42:52.733835+0000","last_became_active":"2024-04-26T10:42:21.405184+0000","last_became_peered":"2024-04-26T10:42:21.405184+0000","last_unstale":"2024-04-26T10:42:52.733835+0000","last_undegraded":"2024-04-26T10:42:52.733835+0000","last_fullsized":"2024-04-26T10:42:52.733835+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:52.378909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733374+0000","last_change":"2024-04-26T10:42:26.046832+0000","last_active":"2024-04-26T10:42:52.733374+0000","last_peered":"2024-04-26T10:42:52.733374+0000","last_clean":"2024-04-26T10:42:52.733374+0000","last_became_active":"2024-04-26T10:42:26.046484+0000","last_became_peered":"2024-04-26T10:42:26.046484+0000","last_unstale":"2024-04-26T10:42:52.733374+0000","last_undegraded":"2024-04-26T10:42:52.733374+0000","last_fullsized":"2024-04-26T10:42:52.733374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:28.856785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"17'2","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733835+0000","last_change":"2024-04-26T10:42:25.686262+0000","last_active":"2024-04-26T10:42:52.733835+0000","last_peered":"2024-04-26T10:42:52.733835+0000","last_clean":"2024-04-26T10:42:52.733835+0000","last_became_active":"2024-04-26T10:42:25.685528+0000","last_became_peered":"2024-04-26T10:42:25.685528+0000","last_unstale":"2024-04-26T10:42:52.733835+0000","last_undegraded":"2024-04-26T10:42:52.733835+0000","last_fullsized":"2024-04-26T10:42:52.733835+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:47.138273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733969+0000","last_change":"2024-04-26T10:42:21.405863+0000","last_active":"2024-04-26T10:42:52.733969+0000","last_peered":"2024-04-26T10:42:52.733969+0000","last_clean":"2024-04-26T10:42:52.733969+0000","last_became_active":"2024-04-26T10:42:21.405555+0000","last_became_peered":"2024-04-26T10:42:21.405555+0000","last_unstale":"2024-04-26T10:42:52.733969+0000","last_undegraded":"2024-04-26T10:42:52.733969+0000","last_fullsized":"2024-04-26T10:42:52.733969+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:39.259618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733486+0000","last_change":"2024-04-26T10:42:26.044818+0000","last_active":"2024-04-26T10:42:52.733486+0000","last_peered":"2024-04-26T10:42:52.733486+0000","last_clean":"2024-04-26T10:42:52.733486+0000","last_became_active":"2024-04-26T10:42:26.043969+0000","last_became_peered":"2024-04-26T10:42:26.043969+0000","last_unstale":"2024-04-26T10:42:52.733486+0000","last_undegraded":"2024-04-26T10:42:52.733486+0000","last_fullsized":"2024-04-26T10:42:52.733486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:50.646374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733620+0000","last_change":"2024-04-26T10:42:26.040224+0000","last_active":"2024-04-26T10:42:52.733620+0000","last_peered":"2024-04-26T10:42:52.733620+0000","last_clean":"2024-04-26T10:42:52.733620+0000","last_became_active":"2024-04-26T10:42:26.038590+0000","last_became_peered":"2024-04-26T10:42:26.038590+0000","last_unstale":"2024-04-26T10:42:52.733620+0000","last_undegraded":"2024-04-26T10:42:52.733620+0000","last_fullsized":"2024-04-26T10:42:52.733620+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'9","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733788+0000","last_change":"2024-04-26T10:42:25.684447+0000","last_active":"2024-04-26T10:42:52.733788+0000","last_peered":"2024-04-26T10:42:52.733788+0000","last_clean":"2024-04-26T10:42:52.733788+0000","last_became_active":"2024-04-26T10:42:25.684147+0000","last_became_peered":"2024-04-26T10:42:25.684147+0000","last_unstale":"2024-04-26T10:42:52.733788+0000","last_undegraded":"2024-04-26T10:42:52.733788+0000","last_fullsized":"2024-04-26T10:42:52.733788+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:38.873282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4838,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733349+0000","last_change":"2024-04-26T10:42:26.045459+0000","last_active":"2024-04-26T10:42:52.733349+0000","last_peered":"2024-04-26T10:42:52.733349+0000","last_clean":"2024-04-26T10:42:52.733349+0000","last_became_active":"2024-04-26T10:42:26.044972+0000","last_became_peered":"2024-04-26T10:42:26.044972+0000","last_unstale":"2024-04-26T10:42:52.733349+0000","last_undegraded":"2024-04-26T10:42:52.733349+0000","last_fullsized":"2024-04-26T10:42:52.733349+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:51.569898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.734301+0000","last_change":"2024-04-26T10:42:25.687956+0000","last_active":"2024-04-26T10:42:52.734301+0000","last_peered":"2024-04-26T10:42:52.734301+0000","last_clean":"2024-04-26T10:42:52.734301+0000","last_became_active":"2024-04-26T10:42:25.687533+0000","last_became_peered":"2024-04-26T10:42:25.687533+0000","last_unstale":"2024-04-26T10:42:52.734301+0000","last_undegraded":"2024-04-26T10:42:52.734301+0000","last_fullsized":"2024-04-26T10:42:52.734301+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:28.506897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733839+0000","last_change":"2024-04-26T10:42:25.685829+0000","last_active":"2024-04-26T10:42:52.733839+0000","last_peered":"2024-04-26T10:42:52.733839+0000","last_clean":"2024-04-26T10:42:52.733839+0000","last_became_active":"2024-04-26T10:42:25.685307+0000","last_became_peered":"2024-04-26T10:42:25.685307+0000","last_unstale":"2024-04-26T10:42:52.733839+0000","last_undegraded":"2024-04-26T10:42:52.733839+0000","last_fullsized":"2024-04-26T10:42:52.733839+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733145+0000","last_change":"2024-04-26T10:42:26.046196+0000","last_active":"2024-04-26T10:42:52.733145+0000","last_peered":"2024-04-26T10:42:52.733145+0000","last_clean":"2024-04-26T10:42:52.733145+0000","last_became_active":"2024-04-26T10:42:26.045762+0000","last_became_peered":"2024-04-26T10:42:26.045762+0000","last_unstale":"2024-04-26T10:42:52.733145+0000","last_undegraded":"2024-04-26T10:42:52.733145+0000","last_fullsized":"2024-04-26T10:42:52.733145+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733975+0000","last_change":"2024-04-26T10:42:25.685990+0000","last_active":"2024-04-26T10:42:52.733975+0000","last_peered":"2024-04-26T10:42:52.733975+0000","last_clean":"2024-04-26T10:42:52.733975+0000","last_became_active":"2024-04-26T10:42:25.684604+0000","last_became_peered":"2024-04-26T10:42:25.684604+0000","last_unstale":"2024-04-26T10:42:52.733975+0000","last_undegraded":"2024-04-26T10:42:52.733975+0000","last_fullsized":"2024-04-26T10:42:52.733975+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:02.874807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733278+0000","last_change":"2024-04-26T10:42:26.038545+0000","last_active":"2024-04-26T10:42:52.733278+0000","last_peered":"2024-04-26T10:42:52.733278+0000","last_clean":"2024-04-26T10:42:52.733278+0000","last_became_active":"2024-04-26T10:42:26.038099+0000","last_became_peered":"2024-04-26T10:42:26.038099+0000","last_unstale":"2024-04-26T10:42:52.733278+0000","last_undegraded":"2024-04-26T10:42:52.733278+0000","last_fullsized":"2024-04-26T10:42:52.733278+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:42.384663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.734293+0000","last_change":"2024-04-26T10:42:26.046506+0000","last_active":"2024-04-26T10:42:52.734293+0000","last_peered":"2024-04-26T10:42:52.734293+0000","last_clean":"2024-04-26T10:42:52.734293+0000","last_became_active":"2024-04-26T10:42:26.045904+0000","last_became_peered":"2024-04-26T10:42:26.045904+0000","last_unstale":"2024-04-26T10:42:52.734293+0000","last_undegraded":"2024-04-26T10:42:52.734293+0000","last_fullsized":"2024-04-26T10:42:52.734293+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:49.854080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733446+0000","last_change":"2024-04-26T10:42:25.683890+0000","last_active":"2024-04-26T10:42:52.733446+0000","last_peered":"2024-04-26T10:42:52.733446+0000","last_clean":"2024-04-26T10:42:52.733446+0000","last_became_active":"2024-04-26T10:42:25.683467+0000","last_became_peered":"2024-04-26T10:42:25.683467+0000","last_unstale":"2024-04-26T10:42:52.733446+0000","last_undegraded":"2024-04-26T10:42:52.733446+0000","last_fullsized":"2024-04-26T10:42:52.733446+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733663+0000","last_change":"2024-04-26T10:42:26.046384+0000","last_active":"2024-04-26T10:42:52.733663+0000","last_peered":"2024-04-26T10:42:52.733663+0000","last_clean":"2024-04-26T10:42:52.733663+0000","last_became_active":"2024-04-26T10:42:26.045860+0000","last_became_peered":"2024-04-26T10:42:26.045860+0000","last_unstale":"2024-04-26T10:42:52.733663+0000","last_undegraded":"2024-04-26T10:42:52.733663+0000","last_fullsized":"2024-04-26T10:42:52.733663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733227+0000","last_change":"2024-04-26T10:42:25.686972+0000","last_active":"2024-04-26T10:42:52.733227+0000","last_peered":"2024-04-26T10:42:52.733227+0000","last_clean":"2024-04-26T10:42:52.733227+0000","last_became_active":"2024-04-26T10:42:25.685903+0000","last_became_peered":"2024-04-26T10:42:25.685903+0000","last_unstale":"2024-04-26T10:42:52.733227+0000","last_undegraded":"2024-04-26T10:42:52.733227+0000","last_fullsized":"2024-04-26T10:42:52.733227+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:43.969731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733983+0000","last_change":"2024-04-26T10:42:26.046515+0000","last_active":"2024-04-26T10:42:52.733983+0000","last_peered":"2024-04-26T10:42:52.733983+0000","last_clean":"2024-04-26T10:42:52.733983+0000","last_became_active":"2024-04-26T10:42:26.045798+0000","last_became_peered":"2024-04-26T10:42:26.045798+0000","last_unstale":"2024-04-26T10:42:52.733983+0000","last_undegraded":"2024-04-26T10:42:52.733983+0000","last_fullsized":"2024-04-26T10:42:52.733983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:28.856785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.734002+0000","last_change":"2024-04-26T10:42:25.688221+0000","last_active":"2024-04-26T10:42:52.734002+0000","last_peered":"2024-04-26T10:42:52.734002+0000","last_clean":"2024-04-26T10:42:52.734002+0000","last_became_active":"2024-04-26T10:42:25.687829+0000","last_became_peered":"2024-04-26T10:42:25.687829+0000","last_unstale":"2024-04-26T10:42:52.734002+0000","last_undegraded":"2024-04-26T10:42:52.734002+0000","last_fullsized":"2024-04-26T10:42:52.734002+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:05.939715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733901+0000","last_change":"2024-04-26T10:42:26.042723+0000","last_active":"2024-04-26T10:42:52.733901+0000","last_peered":"2024-04-26T10:42:52.733901+0000","last_clean":"2024-04-26T10:42:52.733901+0000","last_became_active":"2024-04-26T10:42:26.041852+0000","last_became_peered":"2024-04-26T10:42:26.041852+0000","last_unstale":"2024-04-26T10:42:52.733901+0000","last_undegraded":"2024-04-26T10:42:52.733901+0000","last_fullsized":"2024-04-26T10:42:52.733901+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.734001+0000","last_change":"2024-04-26T10:42:25.688815+0000","last_active":"2024-04-26T10:42:52.734001+0000","last_peered":"2024-04-26T10:42:52.734001+0000","last_clean":"2024-04-26T10:42:52.734001+0000","last_became_active":"2024-04-26T10:42:25.688451+0000","last_became_peered":"2024-04-26T10:42:25.688451+0000","last_unstale":"2024-04-26T10:42:52.734001+0000","last_undegraded":"2024-04-26T10:42:52.734001+0000","last_fullsized":"2024-04-26T10:42:52.734001+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:17.143923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733487+0000","last_change":"2024-04-26T10:42:26.044040+0000","last_active":"2024-04-26T10:42:52.733487+0000","last_peered":"2024-04-26T10:42:52.733487+0000","last_clean":"2024-04-26T10:42:52.733487+0000","last_became_active":"2024-04-26T10:42:26.042629+0000","last_became_peered":"2024-04-26T10:42:26.042629+0000","last_unstale":"2024-04-26T10:42:52.733487+0000","last_undegraded":"2024-04-26T10:42:52.733487+0000","last_fullsized":"2024-04-26T10:42:52.733487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:23:05.308070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733736+0000","last_change":"2024-04-26T10:42:25.686442+0000","last_active":"2024-04-26T10:42:52.733736+0000","last_peered":"2024-04-26T10:42:52.733736+0000","last_clean":"2024-04-26T10:42:52.733736+0000","last_became_active":"2024-04-26T10:42:25.686029+0000","last_became_peered":"2024-04-26T10:42:25.686029+0000","last_unstale":"2024-04-26T10:42:52.733736+0000","last_undegraded":"2024-04-26T10:42:52.733736+0000","last_fullsized":"2024-04-26T10:42:52.733736+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:04.241132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733437+0000","last_change":"2024-04-26T10:42:26.042561+0000","last_active":"2024-04-26T10:42:52.733437+0000","last_peered":"2024-04-26T10:42:52.733437+0000","last_clean":"2024-04-26T10:42:52.733437+0000","last_became_active":"2024-04-26T10:42:26.041751+0000","last_became_peered":"2024-04-26T10:42:26.041751+0000","last_unstale":"2024-04-26T10:42:52.733437+0000","last_undegraded":"2024-04-26T10:42:52.733437+0000","last_fullsized":"2024-04-26T10:42:52.733437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.734150+0000","last_change":"2024-04-26T10:42:25.687977+0000","last_active":"2024-04-26T10:42:52.734150+0000","last_peered":"2024-04-26T10:42:52.734150+0000","last_clean":"2024-04-26T10:42:52.734150+0000","last_became_active":"2024-04-26T10:42:25.687402+0000","last_became_peered":"2024-04-26T10:42:25.687402+0000","last_unstale":"2024-04-26T10:42:52.734150+0000","last_undegraded":"2024-04-26T10:42:52.734150+0000","last_fullsized":"2024-04-26T10:42:52.734150+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:35.867262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733833+0000","last_change":"2024-04-26T10:42:26.041729+0000","last_active":"2024-04-26T10:42:52.733833+0000","last_peered":"2024-04-26T10:42:52.733833+0000","last_clean":"2024-04-26T10:42:52.733833+0000","last_became_active":"2024-04-26T10:42:26.040504+0000","last_became_peered":"2024-04-26T10:42:26.040504+0000","last_unstale":"2024-04-26T10:42:52.733833+0000","last_undegraded":"2024-04-26T10:42:52.733833+0000","last_fullsized":"2024-04-26T10:42:52.733833+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733754+0000","last_change":"2024-04-26T10:42:25.686861+0000","last_active":"2024-04-26T10:42:52.733754+0000","last_peered":"2024-04-26T10:42:52.733754+0000","last_clean":"2024-04-26T10:42:52.733754+0000","last_became_active":"2024-04-26T10:42:25.686149+0000","last_became_peered":"2024-04-26T10:42:25.686149+0000","last_unstale":"2024-04-26T10:42:52.733754+0000","last_undegraded":"2024-04-26T10:42:52.733754+0000","last_fullsized":"2024-04-26T10:42:52.733754+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:42.125386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733671+0000","last_change":"2024-04-26T10:42:26.045324+0000","last_active":"2024-04-26T10:42:52.733671+0000","last_peered":"2024-04-26T10:42:52.733671+0000","last_clean":"2024-04-26T10:42:52.733671+0000","last_became_active":"2024-04-26T10:42:26.044454+0000","last_became_peered":"2024-04-26T10:42:26.044454+0000","last_unstale":"2024-04-26T10:42:52.733671+0000","last_undegraded":"2024-04-26T10:42:52.733671+0000","last_fullsized":"2024-04-26T10:42:52.733671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T10:42:52.733949+0000","last_change":"2024-04-26T10:42:25.685528+0000","last_active":"2024-04-26T10:42:52.733949+0000","last_peered":"2024-04-26T10:42:52.733949+0000","last_clean":"2024-04-26T10:42:52.733949+0000","last_became_active":"2024-04-26T10:42:25.684508+0000","last_became_peered":"2024-04-26T10:42:25.684508+0000","last_unstale":"2024-04-26T10:42:52.733949+0000","last_undegraded":"2024-04-26T10:42:52.733949+0000","last_fullsized":"2024-04-26T10:42:52.733949+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.850118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5636,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738378,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31300,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340540,"statfs":{"total":96636764160,"available":96604712960,"internally_reserved":0,"allocated":180224,"data_stored":67747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]}]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":663135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738379,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35992,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335848,"statfs":{"total":96636764160,"available":96599908352,"internally_reserved":0,"allocated":794624,"data_stored":662519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:43:01.514 INFO:tasks.thrashosds.thrasher:Setting 4.1d to [2, 0, 1] 2024-04-26T10:43:01.514 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.1d', '2', '0', '1'] 2024-04-26T10:43:01.514 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.1d 2 0 1 2024-04-26T10:43:01.604 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:01.603+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:01.612 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:01.612 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:01.613 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:01.613 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:01.622 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:01.705 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:01.703+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:01.724 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:01.724 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:01.724 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:01.724 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:01.724 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:01.732 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:01.765 INFO:teuthology.orchestra.run.smithi049.stderr:nodeep-scrub is set 2024-04-26T10:43:01.816 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:01.815+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:01.826 INFO:teuthology.orchestra.run.smithi049.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-26T10:43:01.831 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T10:43:01.832 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-26T10:43:01.875 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:01.876 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:01.876 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:01.876 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:01.876 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.876 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:01.876 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:01.876 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 35.837119010000002, 2024-04-26T10:43:01.876 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:01.876 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:01.876 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.876 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:01.876 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.877 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:01.877 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:01.877 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.877 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.877 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.877 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:01.877 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:01.877 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.877 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.877 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.877 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:01.877 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:01.877 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.877 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.878 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.878 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:01.878 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:01.878 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:01.878 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.878 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.878 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:01.878 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:01.878 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:01.878 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.878 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.878 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.879 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:01.879 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:01.879 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.879 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.879 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:01.879 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:01.879 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:01.879 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.879 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.879 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:01.879 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:01.879 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:01.879 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.879 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.880 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:01.880 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:01.880 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:01.880 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.880 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.880 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:01.880 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:01.880 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:01.880 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.880 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:01.880 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.880 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.881 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.881 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:01.881 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:01.881 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 35.836248230000002, 2024-04-26T10:43:01.881 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:01.881 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:01.881 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.881 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:01.881 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.881 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:01.881 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:01.881 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.881 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.881 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.882 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:01.882 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:01.882 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.882 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.882 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.882 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:01.882 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:01.882 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.882 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.882 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.882 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:01.882 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:01.882 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:01.882 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.883 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.883 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:01.883 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:01.883 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:01.883 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.883 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.883 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.883 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:01.883 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:01.883 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.883 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.883 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:01.883 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:01.884 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:01.884 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.884 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.884 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:01.884 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:01.884 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:01.884 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.884 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.884 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:01.884 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:01.884 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:01.884 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.885 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.885 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:01.885 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:01.885 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:01.885 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.885 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:01.885 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.885 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.885 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.885 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:01.885 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:01.885 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 35.835260886999997, 2024-04-26T10:43:01.886 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:01.886 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:01.886 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.886 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:01.886 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.886 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:01.886 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:01.886 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.886 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.886 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.887 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:01.887 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:01.887 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.887 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.887 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.887 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:01.887 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:01.887 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:01.887 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.887 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.887 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:01.887 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:01.887 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:01.888 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.888 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.888 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:01.888 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:01.888 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:01.888 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.888 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.888 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.888 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:01.888 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:01.888 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.888 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.889 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:01.889 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:01.889 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:01.889 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.889 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.889 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:01.889 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:01.889 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:01.889 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.889 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.889 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:01.889 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:01.889 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:01.889 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.890 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.890 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:01.890 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:01.890 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:01.890 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.890 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:01.890 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.890 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.890 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.890 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:01.890 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:01.890 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 35.835055621999999, 2024-04-26T10:43:01.891 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:01.891 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:01.891 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.891 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:01.891 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.891 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:01.891 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:01.891 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.891 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.891 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.891 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:01.891 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:01.891 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.891 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.892 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.892 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:01.892 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:01.892 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.892 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.892 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.892 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:01.892 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:01.892 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:01.892 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.892 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.892 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:01.892 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:01.893 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:01.893 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.893 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.893 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.893 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:01.893 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:01.893 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.893 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.893 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:01.893 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:01.893 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:01.893 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.893 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.893 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:01.894 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:01.894 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:01.894 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.894 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.894 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:01.894 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:01.894 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:01.894 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.894 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.894 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:01.894 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:01.894 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:01.894 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.894 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:01.895 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.895 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.895 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.895 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.895 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:01.895 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 35.834734742999999, 2024-04-26T10:43:01.895 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:01.895 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:01.895 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.895 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:01.895 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.895 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:01.895 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:01.896 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.896 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.896 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.896 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:01.896 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:01.896 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.896 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.896 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.896 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:01.896 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:01.896 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:01.896 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.896 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.897 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:01.897 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:01.897 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:01.897 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.897 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.897 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:01.897 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:01.897 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:01.897 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.897 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.897 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.897 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:01.897 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:01.897 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.898 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.898 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:01.898 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:01.898 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:01.898 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.898 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.898 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:01.898 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:01.898 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:01.898 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.898 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.898 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:01.898 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:01.899 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:01.899 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.899 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.899 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:01.899 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:01.899 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:01.899 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.899 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.899 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.899 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:01.899 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:01.899 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.899 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.899 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:01.900 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:01.900 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:01.900 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.900 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.900 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:01.900 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:01.900 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:01.900 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.900 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:01.900 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.900 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.900 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.901 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.901 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:01.901 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 35.834682919000002, 2024-04-26T10:43:01.901 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:01.901 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:01.901 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.901 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:01.901 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.901 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:01.901 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:01.901 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.901 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.901 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.901 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:01.901 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:01.902 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.902 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.902 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.902 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:01.902 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:01.902 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.902 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.902 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.902 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:01.902 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:01.903 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:01.903 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.903 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.903 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:01.903 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:01.903 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:01.903 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.903 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.903 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.903 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:01.903 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:01.903 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.904 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.904 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:01.904 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:01.904 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:01.904 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.904 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.904 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:01.904 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:01.904 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:01.904 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.904 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.904 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:01.904 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:01.904 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:01.907 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 35.834629546999999, 2024-04-26T10:43:01.907 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:01.907 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:01.907 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.907 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:01.907 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.907 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:01.907 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:01.907 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.907 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.907 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.907 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:01.907 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:01.908 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.908 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.908 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.908 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:01.908 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:01.908 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.908 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.908 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.908 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:01.908 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:01.908 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:01.908 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.908 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.908 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:01.908 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:01.909 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:01.909 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.909 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.909 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.909 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:01.909 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:01.909 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.909 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.909 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:01.909 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:01.909 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:01.909 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.909 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.909 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:01.910 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:01.910 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:01.910 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.910 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.910 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:01.910 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:01.910 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:01.910 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.910 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.910 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:01.910 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:01.910 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:01.910 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 35.834585220000001, 2024-04-26T10:43:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.917 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.917 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:01.917 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:01.917 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:01.917 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.917 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.917 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:01.917 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:01.917 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:01.917 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.917 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:01.917 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.917 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.917 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.917 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.918 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:01.918 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 35.834561506999997, 2024-04-26T10:43:01.918 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:01.918 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:01.918 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.918 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:01.918 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.918 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:01.918 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:01.918 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.918 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.918 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.918 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:01.918 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:01.919 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.919 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.919 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.919 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:01.919 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:01.919 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.919 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.919 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.919 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:01.919 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:01.919 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:01.919 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.919 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.920 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:01.920 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:01.920 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:01.920 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.920 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.920 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.920 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:01.920 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:01.920 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.920 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.920 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:01.920 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:01.920 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:01.920 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.921 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.921 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:01.921 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:01.921 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:01.921 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.921 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.921 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:01.921 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:01.921 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:01.921 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.921 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.921 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:01.921 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:01.922 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:01.922 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.922 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.922 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.922 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:01.922 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:01.922 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.922 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.922 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:01.922 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:01.922 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:01.922 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.922 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.922 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:01.923 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:01.923 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:01.923 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.923 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:01.923 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.923 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.923 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.923 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.923 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:01.923 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 35.834527201999997, 2024-04-26T10:43:01.923 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:01.923 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:01.923 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.923 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:01.924 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.924 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:01.924 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:01.924 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.924 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.924 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.924 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:01.924 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:01.924 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.924 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.924 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.924 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:01.924 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:01.924 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.925 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.925 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.925 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:01.925 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:01.925 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:01.925 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.925 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.925 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:01.925 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:01.925 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:01.925 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.925 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.925 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.925 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:01.926 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:01.926 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.926 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.926 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:01.926 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:01.926 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:01.926 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.926 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.926 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:01.926 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:01.926 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:01.926 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.926 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.926 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:01.927 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:01.927 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:01.927 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.927 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.927 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:01.927 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:01.927 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:01.927 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.927 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.927 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.927 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:01.927 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:01.927 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.927 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.927 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:01.928 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:01.928 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:01.928 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.928 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.928 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:01.928 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:01.928 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:01.928 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.928 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:01.928 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.928 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.928 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.928 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.928 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:01.929 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 35.834190606, 2024-04-26T10:43:01.929 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:01.929 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:01.929 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:01.929 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:01.929 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.929 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:01.929 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:01.929 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.929 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.929 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.929 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:01.929 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:01.929 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.930 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.930 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.930 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:01.930 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:01.930 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:01.930 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.930 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.930 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:01.930 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:01.930 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:01.930 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.930 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.931 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:01.931 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:01.931 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:01.931 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.931 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.931 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.931 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:01.931 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:01.931 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.931 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.931 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:01.931 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:01.931 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:01.932 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.932 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.932 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:01.932 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:01.932 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:01.932 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.932 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.932 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:01.932 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:01.932 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:01.932 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.933 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:01.933 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.933 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.933 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.933 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.933 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:01.933 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 35.834148577999997, 2024-04-26T10:43:01.933 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:01.933 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:01.933 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:01.933 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:01.933 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.933 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:01.934 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:01.934 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.934 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.934 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.934 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:01.934 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:01.934 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.934 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.934 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.934 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:01.934 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:01.934 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.934 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.934 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.935 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:01.935 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:01.935 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:01.935 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.935 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.935 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:01.935 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:01.935 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:01.935 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.935 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.935 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.936 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:01.936 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:01.936 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.936 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.936 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:01.936 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:01.936 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:01.936 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.936 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.936 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:01.936 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:01.936 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:01.937 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.937 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.937 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:01.937 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:01.937 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:01.937 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.937 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:01.937 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.937 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.937 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.937 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:01.937 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:01.938 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 35.834095406000003, 2024-04-26T10:43:01.938 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:01.938 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:01.938 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:01.938 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:01.938 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.938 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:01.938 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:01.938 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.938 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.938 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.938 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:01.939 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:01.939 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.939 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.939 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.939 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:01.939 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:01.939 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.939 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.939 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.939 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:01.939 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:01.939 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:01.939 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.939 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.940 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:01.940 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:01.940 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:01.940 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.940 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.940 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.940 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:01.940 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:01.940 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.940 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.940 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:01.940 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:01.940 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:01.941 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.941 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.941 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:01.941 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:01.941 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:01.941 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.941 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.941 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:01.941 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:01.941 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:01.941 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.941 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:01.941 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.941 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.942 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.942 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:01.942 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:01.942 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 35.830688995999999, 2024-04-26T10:43:01.942 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:01.942 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:01.942 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:01.942 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:01.942 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.942 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:01.942 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:01.942 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.943 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.943 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.943 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:01.943 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:01.943 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.943 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.943 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.943 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:01.943 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:01.943 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.943 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.943 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.943 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:01.944 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:01.944 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:01.944 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.944 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.944 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:01.944 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:01.944 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:01.944 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.944 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.944 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.944 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:01.944 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:01.944 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.945 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.945 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:01.945 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:01.945 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:01.945 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.945 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.945 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:01.945 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:01.945 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:01.945 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.945 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:01.945 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.945 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.945 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.945 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:01.946 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:01.946 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 35.828217043000002, 2024-04-26T10:43:01.946 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:01.946 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:01.946 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:01.946 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:01.946 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.946 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:01.946 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:01.946 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.946 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.946 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.947 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:01.947 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:01.947 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.947 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.947 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.947 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:01.947 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:01.947 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.947 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.947 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.947 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:01.947 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:01.947 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:01.948 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.948 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.948 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:01.948 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:01.948 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:01.948 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.948 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.948 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.948 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:01.948 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:01.948 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.948 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.948 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:01.948 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:01.949 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:01.949 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.949 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.949 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:01.949 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:01.949 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:01.949 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.949 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.949 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:01.949 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:01.949 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:01.949 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.949 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:01.950 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.950 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.950 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.950 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:01.950 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:01.950 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 35.827563484999999, 2024-04-26T10:43:01.950 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:01.950 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:01.950 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:01.950 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:01.950 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.950 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:01.951 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:01.951 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.951 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.951 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.951 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:01.951 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:01.951 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.951 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.951 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.951 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:01.951 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:01.951 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.951 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.951 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.952 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:01.952 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:01.952 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:01.952 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.952 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.952 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:01.952 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:01.952 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:01.952 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.952 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.952 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.952 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:01.953 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:01.953 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.953 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.953 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:01.953 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:01.953 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:01.953 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.953 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.953 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:01.953 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:01.953 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:01.953 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.954 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.954 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:01.954 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:01.954 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:01.954 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.954 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:01.954 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.954 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.954 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.954 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:01.954 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:01.954 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 35.827487699999999, 2024-04-26T10:43:01.954 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:01.955 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:01.955 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:01.955 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:01.955 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.955 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:01.955 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:01.955 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.955 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.955 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.955 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:01.955 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:01.955 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.955 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.956 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.956 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:01.956 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:01.956 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.956 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.956 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.956 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:01.956 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:01.956 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:01.956 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.956 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.956 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:01.956 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:01.956 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:01.957 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.957 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.957 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.957 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:01.957 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:01.957 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.957 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.957 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:01.957 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:01.957 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:01.957 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.957 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.958 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:01.958 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:01.958 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:01.958 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.958 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.958 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:01.958 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:01.958 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:01.958 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.958 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:01.959 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.959 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.959 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.959 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:01.959 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:01.959 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 35.827274006000003, 2024-04-26T10:43:01.959 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:01.959 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:01.959 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:01.959 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:01.959 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.960 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:01.960 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:01.960 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.960 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.960 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.960 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:01.960 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:01.960 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.960 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.960 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.960 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:01.960 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:01.960 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:01.960 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.961 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.961 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:01.961 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:01.961 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:01.961 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.961 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.961 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:01.961 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:01.961 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:01.961 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.961 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.961 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.961 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:01.961 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:01.962 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.962 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.962 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:01.962 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:01.962 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:01.962 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.962 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.962 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:01.962 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:01.962 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:01.962 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.962 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:01.962 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.962 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.963 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.963 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:01.963 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:01.963 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 35.824830192999997, 2024-04-26T10:43:01.963 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:01.963 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:01.963 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:01.963 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:01.963 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.963 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:01.963 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:01.963 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.963 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.963 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.964 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:01.964 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:01.964 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.964 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.964 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.964 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:01.964 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:01.964 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:01.964 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.964 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.964 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:01.964 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:01.964 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:01.964 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.965 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.965 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:01.965 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:01.965 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:01.965 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.965 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.965 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.965 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:01.965 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:01.965 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.965 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.965 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:01.965 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:01.966 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:01.966 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.966 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.966 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:01.966 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:01.966 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:01.966 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.966 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.966 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:01.967 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:01.967 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:01.967 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.967 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:01.967 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.967 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.967 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.967 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:01.967 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:01.967 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 30.374767749, 2024-04-26T10:43:01.967 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:01.967 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:01.967 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:01.967 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:01.968 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.968 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:01.968 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:01.968 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.968 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.968 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.968 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:01.968 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:01.968 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:01.968 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.968 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.968 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:01.968 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:01.968 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:01.969 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.969 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.969 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:01.969 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:01.969 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:01.969 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.969 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.969 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:01.969 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:01.969 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:01.969 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.969 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.969 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:01.970 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:01.970 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:01.970 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.970 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.970 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:01.970 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:01.970 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:01.970 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.970 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.970 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:01.970 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:01.970 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:01.970 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.970 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.971 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:01.971 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:01.971 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:01.971 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.971 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.971 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:01.971 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:01.971 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:01.971 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.971 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.971 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:01.971 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:01.971 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:01.972 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.972 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.972 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:01.972 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:01.972 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:01.972 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:01.972 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:01.972 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:01.972 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:01.972 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:01.972 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.972 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:01.972 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.972 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:01.973 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:01.973 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:01.974 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:01.975 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:01.972+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:02.075 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:02.073+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:02.093 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:02.093 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:02.093 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:02.093 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:02.102 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:02.176 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:02.175+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:02.208 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:02.208 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:02.208 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:02.208 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:02.208 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:02.217 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:02.276 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:02.275+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:02.324 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:02.325 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:02.325 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:02.325 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:02.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.325 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:02.325 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:02.325 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.286651652000003, 2024-04-26T10:43:02.325 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:02.325 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:02.325 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.325 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:02.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.325 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:02.326 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:02.326 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.326 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.326 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:02.326 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:02.326 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.326 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.326 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:02.326 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:02.326 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.326 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.327 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:02.327 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:02.327 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:02.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.327 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.327 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:02.327 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:02.327 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:02.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.327 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.327 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.327 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:02.327 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:02.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.328 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.328 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:02.328 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:02.328 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:02.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.328 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.328 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:02.328 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:02.328 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:02.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.328 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.328 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:02.328 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:02.328 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:02.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.329 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:02.329 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:02.329 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:02.329 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.329 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:02.329 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.329 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.329 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:02.329 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.284901531000003, 2024-04-26T10:43:02.330 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:02.330 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:02.331 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.331 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:02.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.331 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:02.331 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:02.331 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.331 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:02.331 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:02.331 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.331 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:02.332 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:02.332 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:02.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.332 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:02.332 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:02.332 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:02.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.332 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:02.332 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:02.332 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:02.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.333 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.333 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:02.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:02.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.333 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:02.333 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:02.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:02.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.333 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:02.333 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:02.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:02.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.334 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:02.334 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:02.334 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:02.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.334 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:02.334 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:02.334 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:02.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.335 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.335 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:02.335 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:02.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.335 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:02.335 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:02.335 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:02.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.336 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:02.336 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:02.336 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:02.336 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.336 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:02.336 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.336 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.336 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:02.337 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.284848533000002, 2024-04-26T10:43:02.337 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:02.337 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:02.337 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.337 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:02.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.337 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:02.337 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:02.337 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.337 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:02.337 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:02.337 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.338 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.338 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:02.338 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:02.338 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.338 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.338 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:02.338 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:02.338 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:02.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.338 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.338 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:02.339 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:02.339 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:02.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.339 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.339 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:02.339 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:02.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.339 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:02.339 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:02.339 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:02.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.339 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:02.340 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:02.340 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:02.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.340 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:02.340 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:02.340 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:02.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.340 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:02.340 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:02.340 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:02.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.341 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.341 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:02.341 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:02.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.341 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:02.341 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:02.341 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:02.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.341 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:02.341 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:02.341 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:02.342 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.342 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:02.342 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.342 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.342 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:02.342 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.284770789, 2024-04-26T10:43:02.342 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:02.342 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:02.342 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.342 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:02.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.343 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:02.343 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:02.343 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.343 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:02.343 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:02.343 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.343 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:02.343 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:02.343 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:02.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.344 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:02.344 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:02.344 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:02.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.344 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:02.344 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:02.344 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:02.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.344 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.345 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:02.345 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:02.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.345 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:02.345 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:02.345 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:02.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.345 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:02.345 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:02.345 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:02.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.345 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:02.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:02.346 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:02.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.346 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:02.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:02.346 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:02.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.346 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:02.346 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:02.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.346 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:02.347 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:02.347 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:02.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.347 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:02.347 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:02.347 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:02.347 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.347 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:02.347 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.347 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.348 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:02.348 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.284731782999998, 2024-04-26T10:43:02.348 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:02.348 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:02.348 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.348 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:02.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.348 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:02.348 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:02.348 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.348 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:02.348 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:02.348 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.349 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:02.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:02.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:02.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.349 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:02.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:02.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:02.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.349 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:02.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:02.350 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:02.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.350 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.350 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:02.350 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:02.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.350 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:02.350 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:02.350 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:02.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.350 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:02.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:02.351 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:02.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:02.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:02.351 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:02.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:02.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:02.351 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:02.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:02.352 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:02.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:02.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:02.352 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:02.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:02.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:02.352 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:02.352 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.352 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:02.352 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.353 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.353 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:02.353 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.284712962, 2024-04-26T10:43:02.353 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:02.353 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:02.353 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.353 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:02.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.353 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:02.353 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:02.353 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.354 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:02.354 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:02.354 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.354 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:02.354 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:02.354 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:02.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:02.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:02.355 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:02.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:02.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:02.355 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:02.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:02.355 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:02.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:02.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:02.356 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:02.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:02.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:02.356 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:02.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:02.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:02.356 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:02.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.357 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:02.357 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:02.357 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:02.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.357 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.357 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:02.357 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:02.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.357 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:02.357 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:02.358 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:02.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.358 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:02.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:02.358 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:02.358 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.358 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:02.358 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.358 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.358 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:02.358 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.284680960000003, 2024-04-26T10:43:02.359 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:02.359 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:02.359 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.359 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:02.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.359 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:02.359 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:02.359 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.359 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:02.359 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:02.359 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:02.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:02.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:02.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:02.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:02.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:02.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:02.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:02.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:02.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:02.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:02.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:02.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:02.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:02.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:02.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:02.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:02.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:02.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:02.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:02.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:02.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:02.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:02.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:02.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:02.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:02.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:02.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:02.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:02.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:02.363 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.363 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:02.363 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.364 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.364 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:02.364 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.284472151999999, 2024-04-26T10:43:02.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:02.364 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:02.364 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.364 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:02.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.364 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:02.364 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:02.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:02.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:02.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:02.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:02.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:02.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:02.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:02.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:02.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:02.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:02.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:02.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:02.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:02.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:02.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:02.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:02.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:02.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:02.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:02.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:02.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:02.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:02.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:02.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:02.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:02.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:02.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:02.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:02.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:02.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:02.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:02.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:02.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:02.369 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.369 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:02.369 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.369 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.369 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:02.369 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.284440861, 2024-04-26T10:43:02.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:02.369 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:02.369 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:02.369 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:02.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:02.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:02.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:02.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:02.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:02.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:02.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:02.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:02.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:02.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:02.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:02.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:02.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:02.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:02.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:02.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:02.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:02.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:02.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:02.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:02.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:02.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:02.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:02.372 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.372 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:02.373 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.373 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.373 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:02.373 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.284413610999998, 2024-04-26T10:43:02.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:02.373 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:02.373 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:02.373 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:02.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:02.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:02.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:02.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:02.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:02.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:02.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:02.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:02.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:02.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:02.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:02.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:02.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:02.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:02.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:02.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:02.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:02.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:02.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:02.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:02.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:02.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:02.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:02.376 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.376 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:02.376 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.377 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:02.377 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:02.377 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.281636859999999, 2024-04-26T10:43:02.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:02.377 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:02.377 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:02.377 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:02.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:02.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:02.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:02.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:02.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:02.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:02.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:02.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:02.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:02.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:02.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:02.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:02.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:02.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:02.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:02.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:02.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:02.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.380 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:02.380 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:02.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:02.380 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.380 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:02.380 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.380 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:02.380 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:02.380 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.281586771000001, 2024-04-26T10:43:02.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:02.381 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:02.381 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.381 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:02.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:02.381 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:02.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:02.381 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:02.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:02.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:02.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:02.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:02.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:02.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:02.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:02.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:02.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:02.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:02.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:02.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:02.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:02.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:02.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:02.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:02.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:02.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:02.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:02.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:02.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:02.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:02.384 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.384 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:02.384 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.385 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:02.385 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:02.385 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.280694701999998, 2024-04-26T10:43:02.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:02.385 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:02.385 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.385 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:02.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:02.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:02.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:02.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:02.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.386 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:02.386 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:02.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.386 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:02.386 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:02.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:02.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.386 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:02.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:02.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:02.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:02.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:02.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:02.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:02.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:02.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:02.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:02.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:02.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:02.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:02.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:02.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:02.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:02.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:02.388 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.388 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:02.389 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.389 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:02.389 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:02.389 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.278506372999999, 2024-04-26T10:43:02.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:02.389 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:02.389 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.389 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:02.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:02.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:02.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:02.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:02.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:02.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:02.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:02.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:02.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:02.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:02.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:02.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:02.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:02.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:02.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:02.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:02.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:02.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:02.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:02.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:02.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:02.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:02.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:02.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:02.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:02.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:02.393 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.393 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:02.393 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.393 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:02.393 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:02.394 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.278371002999997, 2024-04-26T10:43:02.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:02.394 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:02.394 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.394 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:02.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:02.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:02.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:02.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:02.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:02.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:02.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:02.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:02.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:02.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:02.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:02.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:02.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:02.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:02.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:02.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:02.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:02.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.397 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:02.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:02.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:02.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.397 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:02.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:02.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:02.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:02.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:02.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:02.398 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.398 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:02.398 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.398 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:02.398 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:02.398 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.278156428999999, 2024-04-26T10:43:02.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:02.398 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:02.399 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.399 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:02.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:02.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:02.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:02.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:02.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:02.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:02.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:02.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:02.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:02.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:02.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:02.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:02.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:02.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:02.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:02.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:02.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:02.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:02.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:02.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:02.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:02.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:02.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:02.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:02.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:02.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:02.402 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.402 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:02.402 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.402 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:02.403 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:02.403 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.277817487999997, 2024-04-26T10:43:02.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:02.403 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:02.403 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.403 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:02.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:02.403 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:02.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:02.403 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:02.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:02.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:02.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:02.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:02.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:02.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:02.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:02.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:02.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.405 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:02.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:02.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.405 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:02.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:02.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:02.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.405 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:02.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:02.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:02.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:02.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:02.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:02.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:02.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:02.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:02.406 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.407 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:02.407 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.407 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:02.407 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:02.407 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.277708111000003, 2024-04-26T10:43:02.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:02.407 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:02.407 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:02.407 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:02.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:02.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:02.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:02.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:02.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:02.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:02.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:02.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:02.409 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:02.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:02.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.409 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:02.409 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:02.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:02.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.409 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.409 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:02.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:02.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.410 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:02.410 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:02.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:02.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.410 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:02.410 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:02.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:02.410 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.410 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:02.410 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.410 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:02.411 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:02.411 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.277668392000002, 2024-04-26T10:43:02.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:02.411 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:02.411 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.411 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:02.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:02.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:02.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:02.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:02.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:02.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:02.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:02.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:02.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:02.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:02.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:02.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:02.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:02.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:02.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:02.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:02.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:02.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:02.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:02.414 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:02.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:02.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.414 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:02.414 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:02.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:02.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.414 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:02.414 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:02.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:02.414 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.414 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:02.414 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.415 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:02.415 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:02.415 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.277330859000003, 2024-04-26T10:43:02.415 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:02.415 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:02.415 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.415 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:02.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.415 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:02.415 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:02.415 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:02.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:02.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:02.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:02.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:02.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:02.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:02.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:02.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:02.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:02.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:02.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:02.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:02.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:02.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:02.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:02.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.418 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:02.418 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:02.418 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:02.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.418 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:02.418 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:02.418 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:02.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:02.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:02.418 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:02.418 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:02.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:02.419 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.419 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:02.419 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.419 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:02.419 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:02.419 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:02.421 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:43:02.421 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:02.419+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:02.521 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:02.520+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:02.529 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-26T10:43:02.530 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-26T10:43:02.530 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-26T10:43:02.530 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-26T10:43:02.539 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:43:02.623 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:02.622+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:02.681 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-26T10:43:02.681 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-26T10:43:02.681 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-26T10:43:02.681 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-26T10:43:02.681 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-26T10:43:02.689 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:43:02.724 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:02.722+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:02.825 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:02.824+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:02.833 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-26T10:43:02.833 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-26T10:43:02.833 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-26T10:43:02.834 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-26T10:43:02.834 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.834 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:43:02.834 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:43:02.834 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.966724032999998, 2024-04-26T10:43:02.834 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086884530000000005, 2024-04-26T10:43:02.834 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:02.834 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.834 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:43:02.834 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:43:02.834 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:43:02.834 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 164 2024-04-26T10:43:02.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.835 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:02.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:02.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:43:02.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.835 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:02.835 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:43:02.835 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.835 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:02.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:43:02.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-26T10:43:02.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:02.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864858+0000", 2024-04-26T10:43:02.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3231e-05 2024-04-26T10:43:02.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.836 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.836 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:02.836 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864862+0000", 2024-04-26T10:43:02.836 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9280000000000003e-06 2024-04-26T10:43:02.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864865+0000", 2024-04-26T10:43:02.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8289999999999999e-06 2024-04-26T10:43:02.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:02.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869688+0000", 2024-04-26T10:43:02.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048234990000000002 2024-04-26T10:43:02.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.837 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.837 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:02.837 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869732+0000", 2024-04-26T10:43:02.837 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3232999999999998e-05 2024-04-26T10:43:02.837 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:02.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869804+0000", 2024-04-26T10:43:02.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2152999999999998e-05 2024-04-26T10:43:02.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.872812+0000", 2024-04-26T10:43:02.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003008372 2024-04-26T10:43:02.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.838 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.838 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:02.838 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873459+0000", 2024-04-26T10:43:02.838 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064655699999999997 2024-04-26T10:43:02.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:02.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873482+0000", 2024-04-26T10:43:02.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3419999999999999e-05 2024-04-26T10:43:02.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.839 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.839 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:02.839 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873504+0000", 2024-04-26T10:43:02.839 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1440000000000001e-05 2024-04-26T10:43:02.840 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.840 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:02.840 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.840 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.840 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:43:02.840 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:43:02.840 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.966671093999999, 2024-04-26T10:43:02.840 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0092811590000000006, 2024-04-26T10:43:02.840 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:02.840 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.841 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:43:02.841 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:43:02.841 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:43:02.841 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 165 2024-04-26T10:43:02.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.841 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:02.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:02.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:43:02.841 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.841 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.841 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:02.841 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:43:02.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:02.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:43:02.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.842 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:02.842 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864871+0000", 2024-04-26T10:43:02.842 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2200000000000001e-06 2024-04-26T10:43:02.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.842 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:02.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864875+0000", 2024-04-26T10:43:02.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.206e-06 2024-04-26T10:43:02.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864878+0000", 2024-04-26T10:43:02.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5799999999999999e-06 2024-04-26T10:43:02.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.843 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:02.843 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873137+0000", 2024-04-26T10:43:02.843 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082591609999999992 2024-04-26T10:43:02.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.843 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:02.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873186+0000", 2024-04-26T10:43:02.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8741e-05 2024-04-26T10:43:02.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:02.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873252+0000", 2024-04-26T10:43:02.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5877000000000006e-05 2024-04-26T10:43:02.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.844 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:02.844 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873708+0000", 2024-04-26T10:43:02.844 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00045660299999999998 2024-04-26T10:43:02.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874091+0000", 2024-04-26T10:43:02.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038295000000000001 2024-04-26T10:43:02.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:02.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874115+0000", 2024-04-26T10:43:02.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:02.845 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.845 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.845 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:02.845 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874149+0000", 2024-04-26T10:43:02.845 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4320999999999999e-05 2024-04-26T10:43:02.845 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.846 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:02.846 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.846 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.846 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:43:02.846 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:43:02.846 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.829573459000002, 2024-04-26T10:43:02.846 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010199138999999999, 2024-04-26T10:43:02.846 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:02.846 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.846 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:43:02.846 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:43:02.846 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:43:02.847 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 188 2024-04-26T10:43:02.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.847 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:02.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:02.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:43:02.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:02.847 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:43:02.847 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.847 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.847 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.847 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:02.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:43:02.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-26T10:43:02.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:02.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002024+0000", 2024-04-26T10:43:02.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8050999999999997e-05 2024-04-26T10:43:02.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.848 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.848 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:02.848 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002034+0000", 2024-04-26T10:43:02.848 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0217000000000001e-05 2024-04-26T10:43:02.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002039+0000", 2024-04-26T10:43:02.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6879999999999998e-06 2024-04-26T10:43:02.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:02.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006586+0000", 2024-04-26T10:43:02.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045473570000000001 2024-04-26T10:43:02.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.849 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:02.849 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006626+0000", 2024-04-26T10:43:02.849 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9688999999999999e-05 2024-04-26T10:43:02.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:02.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006689+0000", 2024-04-26T10:43:02.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3243000000000004e-05 2024-04-26T10:43:02.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007850+0000", 2024-04-26T10:43:02.850 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011607989999999999 2024-04-26T10:43:02.850 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.850 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.850 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:02.850 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012084+0000", 2024-04-26T10:43:02.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042340069999999997 2024-04-26T10:43:02.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:02.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012132+0000", 2024-04-26T10:43:02.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8112999999999998e-05 2024-04-26T10:43:02.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.851 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.851 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:02.851 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012165+0000", 2024-04-26T10:43:02.851 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3189999999999999e-05 2024-04-26T10:43:02.851 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.851 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:02.851 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.852 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.852 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:43:02.852 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:43:02.852 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.829496759000001, 2024-04-26T10:43:02.852 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010167136, 2024-04-26T10:43:02.852 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:02.852 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.852 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:43:02.852 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:43:02.852 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:43:02.852 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 189 2024-04-26T10:43:02.852 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.852 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:02.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:02.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:43:02.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:02.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:43:02.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.853 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.853 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:02.853 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:43:02.853 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:02.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002044+0000", 2024-04-26T10:43:02.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.119e-06 2024-04-26T10:43:02.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:02.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002047+0000", 2024-04-26T10:43:02.854 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0199999999999999e-06 2024-04-26T10:43:02.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.854 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.854 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.854 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002050+0000", 2024-04-26T10:43:02.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3360000000000002e-06 2024-04-26T10:43:02.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:02.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007165+0000", 2024-04-26T10:43:02.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051155879999999999 2024-04-26T10:43:02.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:02.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007209+0000", 2024-04-26T10:43:02.855 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4097000000000001e-05 2024-04-26T10:43:02.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.855 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.855 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:02.855 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007278+0000", 2024-04-26T10:43:02.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8663000000000003e-05 2024-04-26T10:43:02.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.008047+0000", 2024-04-26T10:43:02.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00076935299999999996 2024-04-26T10:43:02.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:02.856 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012171+0000", 2024-04-26T10:43:02.856 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004123219 2024-04-26T10:43:02.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.856 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.856 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:02.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012193+0000", 2024-04-26T10:43:02.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2169000000000001e-05 2024-04-26T10:43:02.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.857 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:02.857 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012210+0000", 2024-04-26T10:43:02.857 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6841999999999999e-05 2024-04-26T10:43:02.857 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.857 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:02.857 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.857 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.857 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:43:02.858 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.798033365999999, 2024-04-26T10:43:02.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010195469, 2024-04-26T10:43:02.858 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:02.858 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.858 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:02.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:02.858 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:43:02.858 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.858 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.858 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:02.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:43:02.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:02.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033504+0000", 2024-04-26T10:43:02.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:02.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.859 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.859 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:02.859 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033513+0000", 2024-04-26T10:43:02.859 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6829999999999997e-06 2024-04-26T10:43:02.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:02.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033525+0000", 2024-04-26T10:43:02.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2748000000000001e-05 2024-04-26T10:43:02.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.860 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.860 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.860 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033537+0000", 2024-04-26T10:43:02.860 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1243999999999999e-05 2024-04-26T10:43:02.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:02.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034018+0000", 2024-04-26T10:43:02.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048138899999999998 2024-04-26T10:43:02.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-04-26T10:43:02.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034025+0000", 2024-04-26T10:43:02.861 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8870000000000003e-06 2024-04-26T10:43:02.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.861 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.861 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:02.861 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035264+0000", 2024-04-26T10:43:02.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0012385370000000001 2024-04-26T10:43:02.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:02.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035372+0000", 2024-04-26T10:43:02.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010851199999999999 2024-04-26T10:43:02.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.862 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:02.862 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035473+0000", 2024-04-26T10:43:02.862 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000100967 2024-04-26T10:43:02.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.862 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043270+0000", 2024-04-26T10:43:02.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0077971869999999997 2024-04-26T10:43:02.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:02.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043620+0000", 2024-04-26T10:43:02.863 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034962099999999999 2024-04-26T10:43:02.863 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.863 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.863 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:02.863 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043665+0000", 2024-04-26T10:43:02.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5426999999999997e-05 2024-04-26T10:43:02.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.864 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:02.864 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043701+0000", 2024-04-26T10:43:02.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6072000000000003e-05 2024-04-26T10:43:02.864 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.864 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:02.864 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.864 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.864 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.864 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:43:02.864 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.797548286999998, 2024-04-26T10:43:02.864 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099286970000000002, 2024-04-26T10:43:02.865 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:02.865 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.865 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:02.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:02.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:43:02.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:02.865 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:43:02.865 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.865 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.865 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:02.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033990+0000", 2024-04-26T10:43:02.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-26T10:43:02.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:02.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033998+0000", 2024-04-26T10:43:02.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7970000000000001e-06 2024-04-26T10:43:02.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.866 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:02.866 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034010+0000", 2024-04-26T10:43:02.866 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2383e-05 2024-04-26T10:43:02.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.866 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034021+0000", 2024-04-26T10:43:02.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0824e-05 2024-04-26T10:43:02.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:02.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035774+0000", 2024-04-26T10:43:02.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017527479999999999 2024-04-26T10:43:02.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.867 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:02.867 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035929+0000", 2024-04-26T10:43:02.867 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000155735 2024-04-26T10:43:02.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.867 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:02.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036083+0000", 2024-04-26T10:43:02.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000153635 2024-04-26T10:43:02.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043369+0000", 2024-04-26T10:43:02.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0072854490000000003 2024-04-26T10:43:02.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.868 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:02.868 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043709+0000", 2024-04-26T10:43:02.868 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034039600000000003 2024-04-26T10:43:02.868 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:02.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043878+0000", 2024-04-26T10:43:02.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016924799999999999 2024-04-26T10:43:02.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.869 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:02.869 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043920+0000", 2024-04-26T10:43:02.869 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1471999999999999e-05 2024-04-26T10:43:02.869 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.869 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:02.869 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.869 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.869 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.870 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:43:02.870 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.797509009000002, 2024-04-26T10:43:02.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010011091999999999, 2024-04-26T10:43:02.870 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:02.870 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.870 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:02.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:02.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:43:02.870 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.870 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.870 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.870 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:02.870 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:43:02.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:02.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:43:02.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.871 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.871 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:02.871 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034040+0000", 2024-04-26T10:43:02.871 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8560000000000002e-06 2024-04-26T10:43:02.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:02.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034048+0000", 2024-04-26T10:43:02.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4139999999999994e-06 2024-04-26T10:43:02.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034054+0000", 2024-04-26T10:43:02.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8950000000000003e-06 2024-04-26T10:43:02.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.872 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.872 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:02.872 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036269+0000", 2024-04-26T10:43:02.872 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002215528 2024-04-26T10:43:02.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:02.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036364+0000", 2024-04-26T10:43:02.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4089e-05 2024-04-26T10:43:02.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:02.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036443+0000", 2024-04-26T10:43:02.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9666000000000006e-05 2024-04-26T10:43:02.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.873 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.873 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.873 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043451+0000", 2024-04-26T10:43:02.873 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0070081939999999997 2024-04-26T10:43:02.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:02.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043930+0000", 2024-04-26T10:43:02.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00047819799999999999 2024-04-26T10:43:02.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:02.874 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043999+0000", 2024-04-26T10:43:02.874 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9136999999999999e-05 2024-04-26T10:43:02.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.874 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.874 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:02.875 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044041+0000", 2024-04-26T10:43:02.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2624999999999999e-05 2024-04-26T10:43:02.875 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.875 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:02.875 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.875 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.875 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.875 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:43:02.875 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.797470042, 2024-04-26T10:43:02.875 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015256755, 2024-04-26T10:43:02.875 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:02.875 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.876 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:02.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:02.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:43:02.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:02.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:43:02.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.876 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.876 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:02.876 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:43:02.876 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:02.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034073+0000", 2024-04-26T10:43:02.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1099999999999996e-06 2024-04-26T10:43:02.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:02.877 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034081+0000", 2024-04-26T10:43:02.877 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0539999999999995e-06 2024-04-26T10:43:02.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.877 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.877 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034087+0000", 2024-04-26T10:43:02.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0240000000000003e-06 2024-04-26T10:43:02.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:02.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036668+0000", 2024-04-26T10:43:02.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002581014 2024-04-26T10:43:02.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.878 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.878 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:02.878 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036717+0000", 2024-04-26T10:43:02.878 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9299999999999999e-05 2024-04-26T10:43:02.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:02.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036846+0000", 2024-04-26T10:43:02.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012901000000000001 2024-04-26T10:43:02.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:02.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044050+0000", 2024-04-26T10:43:02.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007203816 2024-04-26T10:43:02.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.879 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.879 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.879 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049229+0000", 2024-04-26T10:43:02.879 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051792169999999998 2024-04-26T10:43:02.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:02.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049282+0000", 2024-04-26T10:43:02.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2605000000000002e-05 2024-04-26T10:43:02.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.880 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:02.880 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049326+0000", 2024-04-26T10:43:02.880 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4255000000000002e-05 2024-04-26T10:43:02.880 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.880 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:02.880 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.880 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.881 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.881 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:43:02.881 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.797445379999999, 2024-04-26T10:43:02.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01538838, 2024-04-26T10:43:02.881 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:02.881 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.881 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:02.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:02.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:43:02.881 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.881 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:02.881 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:43:02.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:02.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034093+0000", 2024-04-26T10:43:02.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:02.882 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034097+0000", 2024-04-26T10:43:02.882 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.213e-06 2024-04-26T10:43:02.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.882 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.882 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:02.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034104+0000", 2024-04-26T10:43:02.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9840000000000004e-06 2024-04-26T10:43:02.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034111+0000", 2024-04-26T10:43:02.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9199999999999998e-06 2024-04-26T10:43:02.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.883 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.883 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:02.883 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.037736+0000", 2024-04-26T10:43:02.883 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036257429999999998 2024-04-26T10:43:02.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:02.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:02.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034004 2024-04-26T10:43:02.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:02.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038526+0000", 2024-04-26T10:43:02.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00044924100000000002 2024-04-26T10:43:02.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.884 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.884 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:02.884 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044708+0000", 2024-04-26T10:43:02.884 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061823360000000001 2024-04-26T10:43:02.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:02.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046886159999999996 2024-04-26T10:43:02.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:02.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049446+0000", 2024-04-26T10:43:02.885 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.973e-05 2024-04-26T10:43:02.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.885 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.885 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:02.885 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049482+0000", 2024-04-26T10:43:02.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6004999999999998e-05 2024-04-26T10:43:02.886 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.886 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:02.886 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.886 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.886 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:43:02.886 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.797423858999998, 2024-04-26T10:43:02.886 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015480648, 2024-04-26T10:43:02.886 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:02.886 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.886 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:02.886 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:02.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:43:02.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:02.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:43:02.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.887 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.887 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:02.887 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:43:02.887 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:02.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034118+0000", 2024-04-26T10:43:02.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1769999999999998e-06 2024-04-26T10:43:02.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:02.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034126+0000", 2024-04-26T10:43:02.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7770000000000002e-06 2024-04-26T10:43:02.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.888 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.888 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.888 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034146+0000", 2024-04-26T10:43:02.888 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0579999999999999e-05 2024-04-26T10:43:02.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:02.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039740+0000", 2024-04-26T10:43:02.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0055940269999999997 2024-04-26T10:43:02.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:02.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039848+0000", 2024-04-26T10:43:02.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010775100000000001 2024-04-26T10:43:02.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.889 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.889 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:02.889 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040022+0000", 2024-04-26T10:43:02.889 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000173964 2024-04-26T10:43:02.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:02.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044721+0000", 2024-04-26T10:43:02.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046989099999999997 2024-04-26T10:43:02.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.890 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049541+0000", 2024-04-26T10:43:02.890 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048200789999999997 2024-04-26T10:43:02.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.890 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.890 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:02.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049574+0000", 2024-04-26T10:43:02.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2817000000000001e-05 2024-04-26T10:43:02.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.891 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:02.891 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049596+0000", 2024-04-26T10:43:02.891 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2011999999999999e-05 2024-04-26T10:43:02.891 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.891 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:02.891 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.891 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.891 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.892 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:43:02.892 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.797387899999997, 2024-04-26T10:43:02.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015538033, 2024-04-26T10:43:02.892 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:02.892 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.892 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:02.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:02.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:43:02.892 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.892 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.892 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:02.892 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:43:02.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:02.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:43:02.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:02.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034155+0000", 2024-04-26T10:43:02.893 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.177e-06 2024-04-26T10:43:02.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.893 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.893 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:02.893 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034161+0000", 2024-04-26T10:43:02.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0780000000000001e-06 2024-04-26T10:43:02.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034168+0000", 2024-04-26T10:43:02.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8689999999999998e-06 2024-04-26T10:43:02.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:02.894 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041069+0000", 2024-04-26T10:43:02.894 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069010440000000003 2024-04-26T10:43:02.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.894 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.894 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:02.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041221+0000", 2024-04-26T10:43:02.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015175 2024-04-26T10:43:02.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:02.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041350+0000", 2024-04-26T10:43:02.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012870899999999999 2024-04-26T10:43:02.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:02.895 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045386+0000", 2024-04-26T10:43:02.895 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040364789999999999 2024-04-26T10:43:02.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.895 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.895 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049641+0000", 2024-04-26T10:43:02.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042552120000000004 2024-04-26T10:43:02.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:02.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049669+0000", 2024-04-26T10:43:02.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7809000000000001e-05 2024-04-26T10:43:02.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.896 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.896 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:02.896 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049689+0000", 2024-04-26T10:43:02.896 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0336e-05 2024-04-26T10:43:02.896 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.896 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:02.896 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.897 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.897 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:43:02.897 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.797366070999999, 2024-04-26T10:43:02.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015595107, 2024-04-26T10:43:02.897 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:02.897 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.897 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:02.897 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.897 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:02.897 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:43:02.897 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:02.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:43:02.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:02.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:43:02.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.898 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.898 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:02.898 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034176+0000", 2024-04-26T10:43:02.898 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0089999999999999e-06 2024-04-26T10:43:02.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:02.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034182+0000", 2024-04-26T10:43:02.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4579999999999998e-06 2024-04-26T10:43:02.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034187+0000", 2024-04-26T10:43:02.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0880000000000002e-06 2024-04-26T10:43:02.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.899 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:02.899 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045564+0000", 2024-04-26T10:43:02.899 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011376475 2024-04-26T10:43:02.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:02.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045623+0000", 2024-04-26T10:43:02.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9388999999999997e-05 2024-04-26T10:43:02.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:02.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045713+0000", 2024-04-26T10:43:02.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0211999999999996e-05 2024-04-26T10:43:02.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.900 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.900 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:02.900 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046325+0000", 2024-04-26T10:43:02.900 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00061181699999999996 2024-04-26T10:43:02.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049722+0000", 2024-04-26T10:43:02.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033962380000000002 2024-04-26T10:43:02.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:02.901 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049750+0000", 2024-04-26T10:43:02.901 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8087000000000001e-05 2024-04-26T10:43:02.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.901 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.901 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:02.902 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049768+0000", 2024-04-26T10:43:02.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8681999999999998e-05 2024-04-26T10:43:02.902 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.902 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:02.902 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.902 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.902 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.902 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:43:02.902 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.797152547000003, 2024-04-26T10:43:02.902 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087543810000000003, 2024-04-26T10:43:02.902 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:02.902 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.902 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:02.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:02.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:43:02.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:02.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:43:02.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.903 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.903 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:02.903 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034386+0000", 2024-04-26T10:43:02.903 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-26T10:43:02.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:02.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034397+0000", 2024-04-26T10:43:02.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0878e-05 2024-04-26T10:43:02.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:02.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034408+0000", 2024-04-26T10:43:02.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1138000000000001e-05 2024-04-26T10:43:02.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.904 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.904 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.904 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034414+0000", 2024-04-26T10:43:02.904 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2910000000000004e-06 2024-04-26T10:43:02.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:02.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036009+0000", 2024-04-26T10:43:02.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0015952029999999999 2024-04-26T10:43:02.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:02.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036120+0000", 2024-04-26T10:43:02.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000110584 2024-04-26T10:43:02.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.905 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.905 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:43:02.905 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036225+0000", 2024-04-26T10:43:02.905 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010523599999999999 2024-04-26T10:43:02.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:02.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039276+0000", 2024-04-26T10:43:02.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003050404 2024-04-26T10:43:02.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:02.906 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037356099999999999 2024-04-26T10:43:02.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.906 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.906 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:02.906 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043079+0000", 2024-04-26T10:43:02.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8099e-05 2024-04-26T10:43:02.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.907 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:02.907 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043141+0000", 2024-04-26T10:43:02.907 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1655999999999994e-05 2024-04-26T10:43:02.907 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.907 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:02.907 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.907 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.907 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.907 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:43:02.907 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.797091989999998, 2024-04-26T10:43:02.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090131610000000004, 2024-04-26T10:43:02.908 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:02.908 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.908 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:02.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:02.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:43:02.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.908 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.908 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:02.908 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:43:02.908 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:02.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:43:02.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:02.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034451+0000", 2024-04-26T10:43:02.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9600000000000002e-06 2024-04-26T10:43:02.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.909 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.909 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:02.909 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034458+0000", 2024-04-26T10:43:02.909 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5820000000000004e-06 2024-04-26T10:43:02.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034463+0000", 2024-04-26T10:43:02.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0719999999999999e-06 2024-04-26T10:43:02.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:02.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036527+0000", 2024-04-26T10:43:02.910 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002063755 2024-04-26T10:43:02.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.910 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.910 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:02.910 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036610+0000", 2024-04-26T10:43:02.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2669000000000004e-05 2024-04-26T10:43:02.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:43:02.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036744+0000", 2024-04-26T10:43:02.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013412499999999999 2024-04-26T10:43:02.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:02.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040144+0000", 2024-04-26T10:43:02.911 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033999799999999999 2024-04-26T10:43:02.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.911 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.911 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.911 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043301+0000", 2024-04-26T10:43:02.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031572240000000001 2024-04-26T10:43:02.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:02.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043425+0000", 2024-04-26T10:43:02.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000123664 2024-04-26T10:43:02.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.912 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.912 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:02.912 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043460+0000", 2024-04-26T10:43:02.912 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5651000000000001e-05 2024-04-26T10:43:02.912 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.912 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:02.912 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.913 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.913 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:43:02.913 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.797067089999999, 2024-04-26T10:43:02.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086028210000000001, 2024-04-26T10:43:02.913 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:02.913 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.913 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:02.913 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.913 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:02.913 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:43:02.913 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.914 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:02.914 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:43:02.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.914 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:02.914 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:43:02.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.914 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.914 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:02.914 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034482+0000", 2024-04-26T10:43:02.914 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8630000000000003e-06 2024-04-26T10:43:02.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:02.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034494+0000", 2024-04-26T10:43:02.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-04-26T10:43:02.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034501+0000", 2024-04-26T10:43:02.915 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7050000000000002e-06 2024-04-26T10:43:02.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.915 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.915 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:02.915 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035138+0000", 2024-04-26T10:43:02.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00063744099999999998 2024-04-26T10:43:02.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:02.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035286+0000", 2024-04-26T10:43:02.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014766200000000001 2024-04-26T10:43:02.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:43:02.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035654+0000", 2024-04-26T10:43:02.916 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00036779100000000002 2024-04-26T10:43:02.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.916 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.916 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:02.916 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040833+0000", 2024-04-26T10:43:02.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051795640000000002 2024-04-26T10:43:02.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.042886+0000", 2024-04-26T10:43:02.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020531220000000001 2024-04-26T10:43:02.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:02.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043015+0000", 2024-04-26T10:43:02.917 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012824099999999999 2024-04-26T10:43:02.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.917 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.917 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:02.917 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043075+0000", 2024-04-26T10:43:02.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0262e-05 2024-04-26T10:43:02.918 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.918 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:02.918 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.918 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.918 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:43:02.918 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.797031126999997, 2024-04-26T10:43:02.918 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01482116, 2024-04-26T10:43:02.918 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:02.918 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.918 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:02.918 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:02.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:43:02.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:02.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:43:02.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.919 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.919 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:02.919 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:43:02.919 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:02.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034515+0000", 2024-04-26T10:43:02.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.391e-06 2024-04-26T10:43:02.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:02.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034522+0000", 2024-04-26T10:43:02.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7889999999999997e-06 2024-04-26T10:43:02.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.920 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.920 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.920 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034601+0000", 2024-04-26T10:43:02.920 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9547000000000003e-05 2024-04-26T10:43:02.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:02.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036510+0000", 2024-04-26T10:43:02.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019092289999999999 2024-04-26T10:43:02.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:02.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036642+0000", 2024-04-26T10:43:02.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013151100000000001 2024-04-26T10:43:02.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.921 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.921 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:02.921 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036766+0000", 2024-04-26T10:43:02.921 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012367300000000001 2024-04-26T10:43:02.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:02.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040749+0000", 2024-04-26T10:43:02.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039838419999999996 2024-04-26T10:43:02.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049262+0000", 2024-04-26T10:43:02.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085127789999999998 2024-04-26T10:43:02.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.922 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.922 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:02.922 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049301+0000", 2024-04-26T10:43:02.922 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8834000000000001e-05 2024-04-26T10:43:02.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.923 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:02.923 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049329+0000", 2024-04-26T10:43:02.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.817e-05 2024-04-26T10:43:02.923 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.923 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:02.923 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.923 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.923 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.923 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:43:02.923 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.796898429999999, 2024-04-26T10:43:02.923 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014796093999999999, 2024-04-26T10:43:02.924 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:02.924 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.924 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:02.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:02.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:43:02.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:02.924 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:43:02.924 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.924 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.924 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:02.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034640+0000", 2024-04-26T10:43:02.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:02.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034650+0000", 2024-04-26T10:43:02.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0064999999999999e-05 2024-04-26T10:43:02.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:02.925 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034660+0000", 2024-04-26T10:43:02.925 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.961e-06 2024-04-26T10:43:02.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.925 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.925 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034680+0000", 2024-04-26T10:43:02.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9219e-05 2024-04-26T10:43:02.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:02.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.037926+0000", 2024-04-26T10:43:02.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032460380000000001 2024-04-26T10:43:02.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.926 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:02.926 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038068+0000", 2024-04-26T10:43:02.926 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014236000000000001 2024-04-26T10:43:02.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.926 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:02.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038201+0000", 2024-04-26T10:43:02.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013345300000000001 2024-04-26T10:43:02.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:02.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043497+0000", 2024-04-26T10:43:02.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052952770000000001 2024-04-26T10:43:02.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.927 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.927 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.927 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049373+0000", 2024-04-26T10:43:02.927 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058762900000000002 2024-04-26T10:43:02.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.928 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:02.928 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049411+0000", 2024-04-26T10:43:02.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7737000000000001e-05 2024-04-26T10:43:02.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.928 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:02.928 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049437+0000", 2024-04-26T10:43:02.928 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6169999999999998e-05 2024-04-26T10:43:02.928 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.928 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:02.928 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.928 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.928 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.929 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:43:02.929 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.796853919999997, 2024-04-26T10:43:02.929 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0092140799999999995, 2024-04-26T10:43:02.929 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:02.929 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.929 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:02.929 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.929 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:02.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:43:02.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:02.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:43:02.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.930 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:02.930 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:43:02.930 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.930 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034688+0000", 2024-04-26T10:43:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5480000000000002e-06 2024-04-26T10:43:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034694+0000", 2024-04-26T10:43:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1310000000000003e-06 2024-04-26T10:43:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034700+0000", 2024-04-26T10:43:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4229999999999996e-06 2024-04-26T10:43:02.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:02.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036183+0000", 2024-04-26T10:43:02.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001482964 2024-04-26T10:43:02.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:02.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036297+0000", 2024-04-26T10:43:02.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113649 2024-04-26T10:43:02.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.932 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.932 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:43:02.932 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036426+0000", 2024-04-26T10:43:02.932 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012924900000000001 2024-04-26T10:43:02.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:02.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040839+0000", 2024-04-26T10:43:02.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044137079999999997 2024-04-26T10:43:02.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.933 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043679+0000", 2024-04-26T10:43:02.933 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028397850000000001 2024-04-26T10:43:02.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.933 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.933 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:02.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043725+0000", 2024-04-26T10:43:02.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5859999999999998e-05 2024-04-26T10:43:02.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.934 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:02.934 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043899+0000", 2024-04-26T10:43:02.934 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000174267 2024-04-26T10:43:02.934 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.934 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:02.934 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.934 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.934 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.934 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:43:02.935 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.796830986000003, 2024-04-26T10:43:02.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011493046999999999, 2024-04-26T10:43:02.935 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:02.935 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:02.935 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:02.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:02.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:43:02.935 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.935 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.935 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:02.935 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:43:02.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:02.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:43:02.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:02.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.936 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:02.936 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034711+0000", 2024-04-26T10:43:02.936 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4359999999999998e-06 2024-04-26T10:43:02.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.936 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:02.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034717+0000", 2024-04-26T10:43:02.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7939999999999999e-06 2024-04-26T10:43:02.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034723+0000", 2024-04-26T10:43:02.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6219999999999997e-06 2024-04-26T10:43:02.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.937 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.937 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:02.937 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035221+0000", 2024-04-26T10:43:02.937 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00049811199999999999 2024-04-26T10:43:02.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:02.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035351+0000", 2024-04-26T10:43:02.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013049200000000001 2024-04-26T10:43:02.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:02.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035467+0000", 2024-04-26T10:43:02.938 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115364 2024-04-26T10:43:02.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.938 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.938 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:02.938 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040085+0000", 2024-04-26T10:43:02.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046182300000000001 2024-04-26T10:43:02.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:02.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046133+0000", 2024-04-26T10:43:02.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060476059999999996 2024-04-26T10:43:02.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:02.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046165+0000", 2024-04-26T10:43:02.939 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2155e-05 2024-04-26T10:43:02.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.939 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.939 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:02.939 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046201+0000", 2024-04-26T10:43:02.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6566999999999997e-05 2024-04-26T10:43:02.940 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.940 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:02.940 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.940 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:02.940 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:43:02.940 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 36.796744576999998, 2024-04-26T10:43:02.940 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014742026, 2024-04-26T10:43:02.940 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:02.940 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-26T10:43:02.940 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:02.940 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:02.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:43:02.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:02.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:43:02.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:02.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.941 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:02.941 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034793+0000", 2024-04-26T10:43:02.941 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-26T10:43:02.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.941 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:02.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034802+0000", 2024-04-26T10:43:02.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.551e-06 2024-04-26T10:43:02.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:02.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034815+0000", 2024-04-26T10:43:02.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2706e-05 2024-04-26T10:43:02.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.942 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.942 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:02.942 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034824+0000", 2024-04-26T10:43:02.942 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5189999999999998e-06 2024-04-26T10:43:02.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:02.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039312+0000", 2024-04-26T10:43:02.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044874030000000001 2024-04-26T10:43:02.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:02.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039457+0000", 2024-04-26T10:43:02.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000145081 2024-04-26T10:43:02.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:02.943 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:02.943 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:02.943 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049537+0000", 2024-04-26T10:43:02.943 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010080053 2024-04-26T10:43:02.944 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.944 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:02.944 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.944 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:02.944 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:02.944 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-26T10:43:02.945 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:02.946 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:02.944+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:03.047 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:03.046+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:03.057 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:03.058 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:03.058 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:03.058 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:03.067 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:03.148 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:03.146+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:03.169 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:03.169 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:03.169 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:03.169 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:03.169 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:03.178 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:03.262 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:03.261+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:03.322 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:03.322 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:03.322 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:03.322 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:03.322 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.322 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:03.322 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:03.322 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 37.283239428000002, 2024-04-26T10:43:03.322 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:03.322 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:03.322 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:03.322 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:03.323 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.323 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:03.323 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:03.323 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.323 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.323 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.323 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:03.323 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:03.323 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.323 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.323 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.323 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:03.324 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:03.324 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:03.324 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.324 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.324 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:03.324 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:03.324 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:03.324 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.324 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.324 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:03.324 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:03.324 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:03.325 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.325 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.325 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:03.325 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:03.325 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:03.325 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.325 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.325 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:03.325 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:03.326 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:03.326 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.326 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.326 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:03.326 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:03.326 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:03.326 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.326 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.326 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:03.326 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:03.326 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:03.327 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.327 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.327 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:03.327 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:03.327 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:03.327 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.327 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:03.327 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.327 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.327 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.327 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:03.327 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:03.327 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 37.282368648000002, 2024-04-26T10:43:03.327 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:03.328 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:03.328 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:03.328 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:03.328 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.328 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:03.328 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:03.328 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.328 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.328 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.329 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:03.329 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:03.329 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.329 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.329 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.329 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:03.329 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:03.329 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:03.330 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.330 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.330 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:03.330 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:03.330 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:03.330 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.330 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.330 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:03.330 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:03.330 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:03.330 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.330 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.330 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:03.331 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:03.331 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:03.331 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.331 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.331 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:03.331 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:03.331 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:03.331 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.331 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.331 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:03.331 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:03.331 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:03.331 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.331 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.331 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:03.332 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:03.332 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:03.332 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.332 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.332 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:03.332 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:03.332 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:03.332 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.332 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:03.332 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.332 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.332 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.332 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:03.332 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:03.333 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 37.281381304999996, 2024-04-26T10:43:03.333 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:03.333 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:03.333 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:03.333 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:03.333 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.333 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:03.333 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:03.333 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.333 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.333 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.333 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:03.333 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:03.333 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.333 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.334 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.334 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:03.334 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:03.334 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:03.334 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.334 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.334 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:03.334 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:03.334 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:03.334 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.334 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.334 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:03.335 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:03.335 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:03.335 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.335 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.335 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:03.335 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:03.335 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:03.335 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.335 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.335 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:03.335 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:03.335 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:03.335 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.335 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.335 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:03.336 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:03.336 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:03.336 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.336 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.336 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:03.336 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:03.336 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:03.336 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.336 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.336 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:03.336 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:03.336 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:03.336 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.336 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:03.336 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.336 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.337 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.337 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:03.337 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:03.337 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 37.281176039999998, 2024-04-26T10:43:03.337 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:03.337 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:03.337 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:03.337 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:03.337 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.337 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:03.337 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:03.338 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.338 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.338 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.338 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:03.338 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:03.338 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.338 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.338 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.338 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:03.338 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:03.338 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:03.338 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.338 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.339 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:03.339 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:03.339 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:03.339 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.339 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.339 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:03.339 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:03.339 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:03.339 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.339 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.339 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:03.339 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:03.339 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:03.340 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.340 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.340 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:03.340 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:03.340 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:03.340 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.340 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.340 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:03.340 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:03.340 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:03.340 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.340 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.340 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:03.340 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:03.340 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:03.340 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.341 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.341 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:03.341 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:03.341 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:03.341 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.341 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:03.341 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.341 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.341 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.341 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:03.341 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:03.341 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 37.280855160999998, 2024-04-26T10:43:03.341 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:03.341 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:03.342 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:03.342 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:03.342 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.342 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:03.342 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:03.342 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.342 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.342 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.342 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:03.342 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:03.342 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.342 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.343 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.343 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:03.343 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:03.343 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:03.343 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.343 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.343 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:03.343 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:03.343 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:03.343 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.343 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.343 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:03.343 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:03.343 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:03.344 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.344 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.344 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:03.344 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:03.344 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:03.344 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.344 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.344 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:03.344 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:03.344 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:03.344 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.344 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.344 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:03.344 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:03.345 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:03.345 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.345 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.345 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:03.345 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:03.345 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:03.345 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.345 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.345 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:03.345 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:03.345 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:03.345 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.345 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.345 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:03.345 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:03.346 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:03.346 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.346 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.346 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:03.346 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:03.346 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:03.346 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.346 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.346 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:03.346 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:03.346 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:03.346 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.346 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:03.347 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.347 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.347 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.347 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:03.347 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:03.347 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 37.280803337000002, 2024-04-26T10:43:03.347 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:03.347 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:03.347 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:03.347 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:03.347 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.347 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:03.347 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:03.347 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.348 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.348 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.348 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:03.348 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:03.348 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.348 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.348 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.348 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:03.348 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:03.348 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:03.348 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.348 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.348 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:03.348 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:03.348 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:03.348 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.349 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.349 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:03.349 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:03.349 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:03.349 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.349 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.349 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:03.349 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:03.349 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:03.349 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.349 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.349 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:03.349 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:03.349 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:03.349 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.350 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.350 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:03.350 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:03.350 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:03.350 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.350 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.350 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:03.350 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:03.350 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:03.350 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.350 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.351 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:03.351 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:03.351 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:03.351 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.351 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.351 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:03.351 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:03.351 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:03.351 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.351 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.351 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:03.351 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:03.351 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:03.352 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.352 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.352 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:03.352 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:03.352 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:03.352 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.352 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:03.352 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.352 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.352 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.352 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:03.352 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:03.352 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 37.280749964999998, 2024-04-26T10:43:03.352 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:03.352 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:03.353 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:03.353 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:03.353 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.353 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:03.353 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:03.353 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.353 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.353 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.353 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:03.353 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:03.353 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.353 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.353 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.353 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:03.353 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:03.354 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:03.354 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.354 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.354 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:03.354 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:03.354 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:03.354 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.354 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.354 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:03.354 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:03.354 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:03.354 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.354 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.354 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:03.355 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:03.355 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:03.355 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.355 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.355 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:03.355 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:03.355 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:03.355 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.355 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.355 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:03.355 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:03.355 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:03.355 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.356 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.356 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:03.356 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:03.356 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:03.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.356 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.356 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:03.356 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:03.356 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:03.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.356 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.356 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:03.356 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:03.357 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:03.357 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.357 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.357 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:03.357 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:03.357 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:03.357 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.357 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.357 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:03.357 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:03.357 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:03.357 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.358 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:03.358 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.358 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.358 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.358 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:03.358 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:03.358 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 37.280705638000001, 2024-04-26T10:43:03.358 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:03.358 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:03.358 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:03.358 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:03.358 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.358 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:03.358 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:03.359 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.359 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.359 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.359 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:03.359 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:03.359 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.359 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.359 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.359 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:03.359 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:03.359 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:03.359 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.359 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.359 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:03.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:03.360 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:03.360 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.360 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:03.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:03.360 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:03.360 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.360 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:03.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:03.360 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:03.360 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.361 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:03.361 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:03.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:03.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.361 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.361 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:03.361 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:03.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:03.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.361 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.361 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:03.361 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:03.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:03.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.362 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.362 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:03.362 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:03.362 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:03.362 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.362 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.362 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:03.362 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:03.362 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:03.362 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.363 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.363 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:03.363 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:03.363 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:03.363 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.363 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.363 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:03.363 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:03.363 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:03.363 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.363 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:03.363 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.363 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.363 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.364 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:03.364 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:03.364 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 37.280681925000003, 2024-04-26T10:43:03.364 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:03.364 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:03.364 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:03.364 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:03.364 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.364 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:03.365 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:03.365 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.366 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.366 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.366 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:03.366 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:03.366 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.366 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.366 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.366 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:03.366 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:03.366 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:03.366 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.366 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.367 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:03.367 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:03.367 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:03.367 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.367 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.367 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:03.367 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:03.367 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:03.367 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.367 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.367 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:03.367 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:03.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:03.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.368 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:03.368 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:03.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:03.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.368 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:03.368 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:03.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:03.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:03.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:03.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:03.369 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.369 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:03.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:03.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:03.369 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.369 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:03.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:03.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:03.370 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.370 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.370 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:03.370 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:03.370 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:03.370 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.370 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.370 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:03.370 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:03.370 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:03.370 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.370 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:03.370 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.371 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.371 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.371 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:03.371 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:03.371 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 37.280647620000003, 2024-04-26T10:43:03.371 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:03.371 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:03.371 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:03.371 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:03.371 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.371 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:03.371 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:03.371 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.372 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.372 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.372 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:03.372 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:03.372 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.372 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.372 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.372 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:03.372 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:03.372 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:03.372 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.372 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.372 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:03.372 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:03.372 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:03.373 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.373 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.373 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:03.373 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:03.373 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:03.373 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.373 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.373 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:03.373 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:03.373 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:03.373 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.373 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.373 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:03.373 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:03.373 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:03.374 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.374 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.374 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:03.374 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:03.374 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:03.374 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.374 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.374 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:03.374 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:03.374 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:03.374 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.374 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.375 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:03.375 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:03.375 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:03.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.375 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.375 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:03.375 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:03.375 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:03.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.375 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.375 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:03.375 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:03.375 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:03.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.376 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.376 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:03.376 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:03.376 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:03.376 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.376 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:03.376 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.376 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.376 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.376 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:03.376 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:03.376 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 37.280311024, 2024-04-26T10:43:03.376 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:03.377 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:03.377 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:03.377 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:03.377 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.377 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:03.377 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:03.377 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.377 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.377 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.377 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:03.377 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:03.377 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.377 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.377 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.378 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:03.378 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:03.378 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:03.378 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.378 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.378 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:03.378 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:03.378 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:03.378 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.378 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.378 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:03.378 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:03.378 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:03.378 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.379 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.379 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:03.379 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:03.379 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:03.379 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.379 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.379 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:03.379 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:03.379 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:03.379 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.379 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:03.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:03.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:03.380 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:03.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:03.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:03.380 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.380 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:03.380 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.380 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.380 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:03.381 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:03.381 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 37.280268995999997, 2024-04-26T10:43:03.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:03.381 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:03.381 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:03.381 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:03.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:03.381 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:03.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:03.382 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:03.382 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.382 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.382 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.382 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:03.382 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:03.382 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:03.382 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.382 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.382 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:03.382 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:03.382 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:03.382 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.382 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.383 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:03.383 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:03.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:03.383 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.383 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:03.383 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:03.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:03.383 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.383 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:03.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:03.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:03.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.384 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:03.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:03.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:03.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.384 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:03.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:03.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:03.384 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.385 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:03.385 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.385 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:03.385 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:03.385 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 37.280215824000003, 2024-04-26T10:43:03.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:03.385 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:03.385 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:03.385 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:03.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:03.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:03.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:03.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:03.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:03.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:03.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:03.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:03.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:03.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:03.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:03.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:03.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:03.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:03.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:03.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:03.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.388 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:03.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:03.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:03.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.388 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:03.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:03.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:03.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.389 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:03.389 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:03.389 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:03.389 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.389 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:03.389 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.389 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.389 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:03.389 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:03.389 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 37.276809413999999, 2024-04-26T10:43:03.389 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:03.390 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:03.390 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:03.390 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:03.390 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.390 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:03.390 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:03.390 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.390 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.390 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.390 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:03.390 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:03.390 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.390 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.390 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:03.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:03.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:03.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:03.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:03.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:03.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:03.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:03.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:03.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:03.393 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.393 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:03.393 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.393 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:03.393 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:03.393 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 37.274337461000002, 2024-04-26T10:43:03.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:03.393 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:03.393 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:03.393 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:03.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:03.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:03.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:03.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:03.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:03.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:03.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:03.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:03.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:03.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:03.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:03.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:03.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:03.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:03.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:03.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:03.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:03.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:03.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:03.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:03.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:03.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:03.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:03.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:03.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:03.397 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.397 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:03.397 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.397 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:03.397 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:03.397 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 37.273683902999998, 2024-04-26T10:43:03.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:03.397 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:03.397 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:03.397 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:03.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:03.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:03.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:03.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:03.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:03.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:03.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:03.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:03.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:03.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:03.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:03.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:03.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:03.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:03.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:03.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:03.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:03.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:03.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:03.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:03.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:03.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:03.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.401 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:03.401 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:03.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:03.401 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.401 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:03.401 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.401 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:03.401 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:03.402 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 37.273608117999999, 2024-04-26T10:43:03.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:03.402 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:03.402 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:03.402 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:03.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:03.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:03.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:03.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:03.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:03.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:03.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:03.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:03.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:03.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:03.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:03.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:03.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:03.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:03.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:03.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:03.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:03.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:03.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:03.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:03.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:03.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:03.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:03.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:03.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:03.405 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.405 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:03.406 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.406 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.406 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:03.406 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:03.406 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 37.273394424000003, 2024-04-26T10:43:03.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:03.406 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:03.406 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:03.406 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:03.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.406 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:03.406 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:03.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.407 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:03.407 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:03.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.407 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:03.407 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:03.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:03.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.407 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:03.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:03.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:03.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:03.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:03.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:03.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:03.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:03.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:03.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:03.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:03.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:03.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:03.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:03.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:03.409 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.409 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:03.409 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.410 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:03.410 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:03.410 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 37.270950611000004, 2024-04-26T10:43:03.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:03.410 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:03.410 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:03.410 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:03.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.410 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:03.410 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:03.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.410 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:03.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:03.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:03.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:03.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:03.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:03.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:03.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:03.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:03.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:03.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:03.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:03.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:03.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:03.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:03.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:03.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:03.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:03.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:03.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:03.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:03.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:03.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:03.413 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.413 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:03.414 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.414 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.414 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:03.414 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:03.414 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 31.820888167, 2024-04-26T10:43:03.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:03.414 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:03.414 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:03.414 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:03.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.414 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:03.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:03.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:03.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:03.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:03.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:03.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:03.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:03.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:03.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:03.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:03.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:03.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:03.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:03.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:03.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:03.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:03.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:03.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:03.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:03.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:03.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:03.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:03.418 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.418 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.418 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:03.418 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:03.418 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:03.418 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.418 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.418 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:03.418 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:03.418 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:03.418 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.418 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.418 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:03.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:03.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:03.419 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:03.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:03.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:03.419 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:03.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:03.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:03.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:03.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:03.419 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.419 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:03.420 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.420 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:03.420 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:03.420 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:03.421 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:43:03.422 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:03.421+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:03.423 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:03.522 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:03.521+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:03.544 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:03.545 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:03.545 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:03.545 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:03.554 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:03.558 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:03.558 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:03.577 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1: {} 2024-04-26T10:43:03.577 INFO:teuthology.orchestra.run.smithi049.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:43:03.594 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:03.594 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:03.623 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:03.621+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:03.661 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:03.661 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:03.670 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:03.725 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:03.724+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:03.779 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:43:03.815 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:03.815 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:03.825 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:43:03.827 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:03.824+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:03.927 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:03.926+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:03.935 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:03.936 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:03.945 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:43:04.028 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:04.027+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:04.087 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:04.087 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:04.095 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:43:04.129 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:04.128+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:04.195 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:04.196 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:04.204 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:04.249 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:04.248+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:04.315 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:04.315 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:04.325 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:04.331 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:04.330+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:04.432 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:04.431+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:04.467 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:04.467 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:04.475 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:04.532 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:04.531+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:04.577 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:04.577 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:04.586 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:04.633 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:04.632+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:04.705 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:04.706 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:04.715 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:04.735 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:04.734+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:04.775 INFO:teuthology.orchestra.run.smithi049.stderr:noscrub is unset 2024-04-26T10:43:04.822 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:04.823 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:04.831 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:04.875 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:04.874+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:04.935 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:04.934+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:04.937 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:04.937 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:04.946 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:43:05.036 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:05.035+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:05.052 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:05.053 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:05.062 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:43:05.137 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:05.136+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:05.207 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:05.207 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:05.211 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:43:05.238 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:05.237+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:05.312 INFO:teuthology.orchestra.run.smithi087.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:05.312 INFO:teuthology.orchestra.run.smithi087.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:05.321 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:05.365 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:05.364+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:05.426 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:05.426 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:05.435 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:05.439 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:05.439+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:05.540 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:05.540+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:05.577 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:05.577 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:05.586 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:05.606 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:43:05.641 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:05.640+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:05.688 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:05.688 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:05.697 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:05.741 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:05.741 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:05.742 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:05.740+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:05.759 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1: {} 2024-04-26T10:43:05.759 INFO:teuthology.orchestra.run.smithi049.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:43:05.780 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:05.780 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:05.819 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:05.819 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:05.819 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:05.819 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:05.825 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:05.866 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:05.864+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:05.944 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:05.941+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:05.972 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:05.972 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:05.981 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:06.044 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:06.042+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:06.129 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:06.129 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:06.130 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:06.130 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:06.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.130 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:06.130 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:06.130 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.091839933999999, 2024-04-26T10:43:06.130 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:06.130 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:06.130 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.130 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:06.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.131 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:06.131 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:06.131 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.131 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.131 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:06.131 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:06.131 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.131 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.131 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:06.131 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:06.131 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.132 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:06.132 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:06.132 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:06.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.132 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:06.132 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:06.132 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:06.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.132 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.132 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:06.132 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:06.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.133 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:06.133 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:06.133 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:06.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.133 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:06.133 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:06.133 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:06.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.133 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:06.133 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:06.133 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:06.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.134 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:06.134 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:06.134 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:06.134 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.134 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:06.134 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.134 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.134 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:06.134 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.090089812999999, 2024-04-26T10:43:06.134 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:06.135 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:06.135 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.135 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:06.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.135 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:06.135 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:06.135 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.135 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:06.135 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:06.135 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.135 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:06.136 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:06.136 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:06.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.136 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:06.136 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:06.136 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:06.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.136 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:06.136 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:06.136 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:06.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.137 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.137 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:06.137 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:06.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.137 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.137 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:06.137 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:06.137 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:06.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.137 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.137 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:06.137 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:06.137 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:06.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.138 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:06.138 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:06.138 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:06.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.138 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:06.138 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:06.138 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:06.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.138 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.138 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:06.139 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:06.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.139 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:06.139 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:06.139 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:06.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.139 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:06.139 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:06.139 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:06.139 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.139 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:06.139 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.140 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.140 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.140 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:06.140 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.090036814999998, 2024-04-26T10:43:06.140 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:06.140 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:06.140 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.140 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:06.140 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.141 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:06.141 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:06.141 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.141 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:06.141 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:06.141 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.141 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:06.141 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:06.142 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.142 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:06.142 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:06.142 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:06.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.142 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:06.142 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:06.142 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:06.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.143 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.143 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:06.143 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:06.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.143 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.143 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:06.143 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:06.143 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:06.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.144 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.144 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:06.144 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:06.144 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:06.144 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.144 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.144 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:06.144 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:06.144 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:06.144 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.144 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.144 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:06.145 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:06.145 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:06.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.145 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.145 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.145 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:06.145 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:06.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.145 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.145 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:06.145 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:06.145 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:06.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.145 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.145 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:06.146 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:06.146 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:06.146 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.146 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:06.146 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.146 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.146 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.146 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.146 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:06.146 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.089959071000003, 2024-04-26T10:43:06.146 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:06.146 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:06.146 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.146 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:06.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.147 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:06.147 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:06.147 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.147 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:06.147 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:06.147 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.147 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:06.147 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:06.147 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:06.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.148 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:06.148 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:06.148 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:06.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.148 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:06.148 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:06.148 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:06.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.148 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.148 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:06.148 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:06.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.149 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:06.149 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:06.149 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:06.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.149 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:06.149 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:06.149 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:06.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.149 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:06.149 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:06.149 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:06.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.150 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.150 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:06.150 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:06.150 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:06.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.150 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.150 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.150 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:06.150 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:06.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.150 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.150 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:06.150 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:06.150 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:06.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.151 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:06.151 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:06.151 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:06.151 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.151 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:06.151 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.151 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.151 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:06.151 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.089920065000001, 2024-04-26T10:43:06.151 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:06.151 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:06.152 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.152 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:06.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.152 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:06.152 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:06.152 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.152 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:06.152 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:06.152 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.152 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:06.152 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:06.153 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:06.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.153 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:06.153 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:06.153 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:06.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.153 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:06.153 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:06.153 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:06.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.153 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.153 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:06.154 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:06.154 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.154 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:06.154 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:06.154 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:06.154 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.154 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:06.154 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:06.154 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:06.154 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.154 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:06.154 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:06.155 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:06.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.155 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:06.155 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:06.155 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:06.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.155 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.155 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:06.155 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:06.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.155 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:06.155 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:06.156 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:06.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.156 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.156 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:06.156 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:06.156 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:06.156 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.156 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:06.156 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.156 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.156 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.156 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:06.156 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.089901244000004, 2024-04-26T10:43:06.156 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:06.157 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:06.157 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.157 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:06.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.157 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:06.157 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:06.157 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.157 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:06.157 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:06.157 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.157 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:06.158 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:06.158 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:06.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.158 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:06.158 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:06.158 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:06.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.158 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:06.158 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:06.158 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:06.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.159 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.159 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:06.159 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:06.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.159 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:06.159 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:06.159 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:06.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.159 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:06.159 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:06.159 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:06.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.160 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:06.160 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:06.160 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:06.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.160 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:06.160 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:06.160 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:06.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.160 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.160 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:06.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:06.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.161 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:06.161 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:06.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:06.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.161 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:06.161 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:06.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:06.161 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.161 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:06.162 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.162 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.162 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:06.162 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.089869241999999, 2024-04-26T10:43:06.162 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:06.162 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:06.162 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.162 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:06.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.162 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:06.162 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:06.162 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.163 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:06.163 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:06.163 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.163 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:06.163 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:06.163 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.163 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:06.163 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:06.163 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:06.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.164 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:06.164 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:06.164 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:06.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.164 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.164 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:06.164 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:06.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.164 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:06.164 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:06.164 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:06.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.165 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:06.165 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:06.165 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:06.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.165 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:06.165 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:06.165 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:06.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.165 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:06.165 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:06.165 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:06.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.166 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.166 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:06.166 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:06.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.166 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:06.166 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:06.166 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:06.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.167 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:06.167 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:06.167 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:06.167 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.167 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:06.167 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.167 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.167 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:06.167 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.089660434000002, 2024-04-26T10:43:06.167 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:06.167 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:06.168 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.168 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:06.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.168 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:06.168 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:06.168 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.168 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:06.168 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:06.168 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.168 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:06.168 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:06.169 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:06.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.169 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.169 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:06.169 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:06.169 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:06.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.169 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.169 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:06.169 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:06.169 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:06.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.169 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.169 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.170 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:06.170 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:06.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.170 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.170 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:06.170 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:06.170 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:06.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.170 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.170 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:06.170 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:06.170 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:06.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.170 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.170 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:06.171 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:06.171 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:06.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.171 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:06.171 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:06.171 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:06.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.171 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.171 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:06.171 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:06.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.172 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.172 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:06.172 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:06.172 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:06.172 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.172 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.172 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:06.172 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:06.172 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:06.172 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.172 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:06.172 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.172 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.172 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.172 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.173 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:06.173 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.089629143000003, 2024-04-26T10:43:06.173 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:06.173 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:06.173 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:06.173 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:06.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.173 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:06.173 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:06.173 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.173 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:06.173 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:06.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.174 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:06.174 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:06.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.174 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:06.174 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:06.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:06.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.174 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:06.174 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:06.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:06.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.175 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.175 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:06.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:06.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.175 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:06.175 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:06.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:06.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.175 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:06.176 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:06.176 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:06.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.176 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:06.176 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:06.176 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:06.176 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.176 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:06.176 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.176 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.176 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:06.176 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.089601893000001, 2024-04-26T10:43:06.177 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:06.177 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:06.177 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:06.177 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:06.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.177 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:06.177 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:06.177 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.177 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:06.177 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:06.177 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.178 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:06.178 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:06.178 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.178 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:06.178 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:06.178 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:06.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.178 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:06.178 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:06.178 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:06.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.179 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.179 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:06.179 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:06.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.179 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:06.179 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:06.179 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:06.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.179 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:06.179 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:06.179 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:06.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.180 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:06.180 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:06.180 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:06.180 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.180 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:06.180 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.180 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:06.180 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:06.180 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.086825142000002, 2024-04-26T10:43:06.181 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:06.181 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:06.181 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:06.181 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:06.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.181 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:06.181 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:06.181 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.181 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:06.181 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:06.181 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.182 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:06.182 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:06.182 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.182 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:06.182 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:06.182 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:06.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.182 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:06.182 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:06.182 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:06.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.183 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.183 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:06.183 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:06.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.183 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:06.183 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:06.183 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:06.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.183 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:06.183 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:06.183 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:06.183 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.184 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:06.184 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.184 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.184 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:06.184 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:06.184 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.086775052999997, 2024-04-26T10:43:06.184 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:06.184 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:06.184 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.184 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:06.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.184 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:06.184 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:06.185 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.185 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:06.185 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:06.185 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.185 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:06.185 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:06.185 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.185 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:06.186 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:06.186 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:06.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:06.186 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:06.186 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:06.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.186 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:06.186 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:06.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:06.187 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:06.187 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:06.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.187 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:06.187 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:06.187 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:06.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.187 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:06.187 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:06.187 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:06.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.187 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:06.188 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:06.188 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:06.188 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.188 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:06.188 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.188 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:06.188 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:06.188 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.085882984000001, 2024-04-26T10:43:06.188 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:06.188 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:06.188 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.188 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:06.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.189 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:06.189 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:06.189 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.189 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.189 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:06.189 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:06.189 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.189 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.189 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:06.189 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:06.189 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.189 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.190 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:06.190 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:06.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:06.190 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.190 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:06.190 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:06.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:06.190 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.190 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.190 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:06.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:06.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:06.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:06.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:06.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:06.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:06.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:06.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:06.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:06.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:06.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.192 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:06.192 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:06.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:06.192 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.192 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:06.192 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.192 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:06.192 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:06.192 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.083694655000002, 2024-04-26T10:43:06.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:06.193 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:06.193 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.193 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:06.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.193 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:06.193 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:06.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.193 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:06.193 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:06.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.194 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:06.194 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:06.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.194 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:06.194 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:06.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:06.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.194 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:06.194 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:06.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:06.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.195 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.195 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:06.195 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:06.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.195 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:06.195 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:06.195 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:06.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.195 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:06.195 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:06.195 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:06.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:06.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:06.196 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:06.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:06.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:06.196 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:06.196 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.196 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:06.196 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.197 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:06.197 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:06.197 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.083559285, 2024-04-26T10:43:06.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:06.197 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:06.197 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.197 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:06.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.197 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:06.197 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:06.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.197 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:06.197 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:06.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.198 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:06.198 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:06.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.198 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:06.198 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:06.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:06.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.198 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:06.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:06.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:06.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:06.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:06.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:06.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:06.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:06.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:06.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:06.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:06.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:06.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:06.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:06.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:06.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:06.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:06.200 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.200 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:06.201 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.201 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:06.201 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:06.201 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.083344711000002, 2024-04-26T10:43:06.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:06.201 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:06.201 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.201 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:06.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:06.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:06.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.202 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:06.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:06.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.202 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:06.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:06.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.202 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:06.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:06.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:06.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:06.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:06.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:06.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:06.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:06.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:06.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:06.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:06.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:06.204 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:06.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:06.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:06.204 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:06.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:06.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:06.204 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:06.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:06.205 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.205 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:06.205 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.205 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:06.205 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:06.205 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.08300577, 2024-04-26T10:43:06.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:06.205 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:06.205 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.205 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:06.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:06.206 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:06.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:06.206 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:06.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:06.206 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:06.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:06.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:06.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:06.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:06.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:06.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:06.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:06.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:06.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:06.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:06.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:06.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:06.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:06.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:06.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:06.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:06.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:06.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.209 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:06.209 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:06.209 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:06.209 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.209 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:06.209 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.209 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:06.209 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:06.209 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.082896392999999, 2024-04-26T10:43:06.209 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:06.209 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:06.210 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:06.210 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:06.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.210 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:06.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:06.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.210 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:06.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:06.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.210 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:06.211 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:06.211 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:06.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.211 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:06.211 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:06.211 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:06.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.211 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:06.211 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:06.211 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:06.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:06.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:06.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:06.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:06.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:06.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:06.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:06.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:06.212 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.213 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:06.213 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.213 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:06.213 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:06.213 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.082856673999999, 2024-04-26T10:43:06.213 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:06.213 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:06.213 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.213 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:06.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.213 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:06.213 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:06.213 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.214 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:06.214 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:06.214 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.214 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:06.214 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:06.214 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:06.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.214 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:06.214 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:06.215 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:06.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.215 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:06.215 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:06.215 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:06.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.215 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.215 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:06.215 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:06.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.215 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:06.215 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:06.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:06.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.216 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:06.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:06.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:06.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.216 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:06.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:06.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:06.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.216 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:06.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:06.217 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:06.217 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.217 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:06.217 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.217 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:06.217 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:06.217 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.082519140999999, 2024-04-26T10:43:06.217 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:06.217 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:06.217 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.217 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:06.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.218 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:06.218 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:06.218 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.218 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:06.218 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:06.218 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:06.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.218 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:06.218 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:06.218 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:06.219 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:06.219 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:06.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:06.219 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:06.219 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:06.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.220 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:06.220 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:06.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.220 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:06.220 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:06.220 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:06.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.220 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:06.220 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:06.220 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:06.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.221 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:06.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:06.221 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:06.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:06.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:06.221 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:06.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:06.221 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:06.221 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.221 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:06.221 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.221 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:06.221 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:06.221 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:06.227 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:43:06.227 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:06.222+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:06.324 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:06.323+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:06.334 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-26T10:43:06.334 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-26T10:43:06.334 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-26T10:43:06.334 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-26T10:43:06.343 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:43:06.424 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:06.424+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:06.444 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-26T10:43:06.444 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-26T10:43:06.444 INFO:teuthology.orchestra.run.smithi087.stdout: "complaint_time": 30, 2024-04-26T10:43:06.444 INFO:teuthology.orchestra.run.smithi087.stdout: "num_blocked_ops": 0 2024-04-26T10:43:06.445 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-26T10:43:06.453 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:43:06.525 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:06.524+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:06.596 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-26T10:43:06.596 INFO:teuthology.orchestra.run.smithi087.stdout: "size": 20, 2024-04-26T10:43:06.596 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 600, 2024-04-26T10:43:06.596 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [ 2024-04-26T10:43:06.596 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.596 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:43:06.597 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:43:06.597 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.729185774000001, 2024-04-26T10:43:06.597 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086884530000000005, 2024-04-26T10:43:06.597 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:06.597 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.597 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:43:06.597 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:43:06.597 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:43:06.597 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 164 2024-04-26T10:43:06.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.597 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:06.597 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.597 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:06.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:43:06.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:06.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:43:06.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.598 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.598 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:06.598 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864815+0000", 2024-04-26T10:43:06.598 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-26T10:43:06.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:06.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864858+0000", 2024-04-26T10:43:06.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3231e-05 2024-04-26T10:43:06.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:06.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864862+0000", 2024-04-26T10:43:06.599 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9280000000000003e-06 2024-04-26T10:43:06.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.599 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.599 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.599 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864865+0000", 2024-04-26T10:43:06.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8289999999999999e-06 2024-04-26T10:43:06.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:06.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869688+0000", 2024-04-26T10:43:06.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048234990000000002 2024-04-26T10:43:06.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:06.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869732+0000", 2024-04-26T10:43:06.600 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.3232999999999998e-05 2024-04-26T10:43:06.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.600 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.600 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:06.600 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.869804+0000", 2024-04-26T10:43:06.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.2152999999999998e-05 2024-04-26T10:43:06.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.872812+0000", 2024-04-26T10:43:06.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003008372 2024-04-26T10:43:06.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:06.601 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873459+0000", 2024-04-26T10:43:06.601 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00064655699999999997 2024-04-26T10:43:06.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.601 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.601 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:06.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873482+0000", 2024-04-26T10:43:06.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3419999999999999e-05 2024-04-26T10:43:06.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.602 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:06.602 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873504+0000", 2024-04-26T10:43:06.602 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.1440000000000001e-05 2024-04-26T10:43:06.602 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.602 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:06.602 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.602 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.602 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:43:06.602 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:43:06.603 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.729132835000001, 2024-04-26T10:43:06.603 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0092811590000000006, 2024-04-26T10:43:06.603 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:06.603 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.603 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:43:06.603 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:43:06.603 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:43:06.603 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 165 2024-04-26T10:43:06.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.604 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:06.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:06.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:43:06.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:06.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:43:06.604 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.604 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.604 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:06.604 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864868+0000", 2024-04-26T10:43:06.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:06.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864871+0000", 2024-04-26T10:43:06.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2200000000000001e-06 2024-04-26T10:43:06.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:06.605 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864875+0000", 2024-04-26T10:43:06.605 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.206e-06 2024-04-26T10:43:06.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.605 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.605 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.864878+0000", 2024-04-26T10:43:06.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.5799999999999999e-06 2024-04-26T10:43:06.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:06.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873137+0000", 2024-04-26T10:43:06.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0082591609999999992 2024-04-26T10:43:06.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.606 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:06.606 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873186+0000", 2024-04-26T10:43:06.606 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8741e-05 2024-04-26T10:43:06.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.606 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:06.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873252+0000", 2024-04-26T10:43:06.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.5877000000000006e-05 2024-04-26T10:43:06.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:06.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.873708+0000", 2024-04-26T10:43:06.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00045660299999999998 2024-04-26T10:43:06.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.607 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.607 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874091+0000", 2024-04-26T10:43:06.607 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00038295000000000001 2024-04-26T10:43:06.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.607 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:06.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874115+0000", 2024-04-26T10:43:06.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:06.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.608 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.608 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:06.608 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:21.874149+0000", 2024-04-26T10:43:06.608 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4320999999999999e-05 2024-04-26T10:43:06.608 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.608 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:06.609 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.609 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.609 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:43:06.609 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:43:06.609 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.592035199999998, 2024-04-26T10:43:06.609 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010199138999999999, 2024-04-26T10:43:06.609 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:06.609 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.609 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:43:06.609 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:43:06.609 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:43:06.610 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 188 2024-04-26T10:43:06.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.610 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:06.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:06.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:43:06.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.610 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:06.610 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:43:06.610 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.610 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.611 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:06.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.001966+0000", 2024-04-26T10:43:06.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967296 2024-04-26T10:43:06.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.611 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:06.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002024+0000", 2024-04-26T10:43:06.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8050999999999997e-05 2024-04-26T10:43:06.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.611 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.611 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:06.611 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002034+0000", 2024-04-26T10:43:06.611 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0217000000000001e-05 2024-04-26T10:43:06.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002039+0000", 2024-04-26T10:43:06.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.6879999999999998e-06 2024-04-26T10:43:06.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:06.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006586+0000", 2024-04-26T10:43:06.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0045473570000000001 2024-04-26T10:43:06.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.612 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.612 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:06.612 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006626+0000", 2024-04-26T10:43:06.612 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9688999999999999e-05 2024-04-26T10:43:06.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:06.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.006689+0000", 2024-04-26T10:43:06.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.3243000000000004e-05 2024-04-26T10:43:06.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.613 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.613 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007850+0000", 2024-04-26T10:43:06.613 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0011607989999999999 2024-04-26T10:43:06.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.613 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:06.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012084+0000", 2024-04-26T10:43:06.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042340069999999997 2024-04-26T10:43:06.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.614 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.614 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:06.614 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012132+0000", 2024-04-26T10:43:06.614 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.8112999999999998e-05 2024-04-26T10:43:06.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.615 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:06.615 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012165+0000", 2024-04-26T10:43:06.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.3189999999999999e-05 2024-04-26T10:43:06.615 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.615 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:06.615 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.615 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.615 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(client.4150.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:43:06.615 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:43:06.615 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 44.591958499999997, 2024-04-26T10:43:06.615 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010167136, 2024-04-26T10:43:06.615 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:06.615 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.615 INFO:teuthology.orchestra.run.smithi087.stdout: "client_info": { 2024-04-26T10:43:06.616 INFO:teuthology.orchestra.run.smithi087.stdout: "client": "client.4150", 2024-04-26T10:43:06.616 INFO:teuthology.orchestra.run.smithi087.stdout: "client_addr": "172.21.15.49:0/1223504837", 2024-04-26T10:43:06.616 INFO:teuthology.orchestra.run.smithi087.stdout: "tid": 189 2024-04-26T10:43:06.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.616 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:06.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:06.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:43:06.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.616 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.616 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:06.616 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:43:06.616 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002042+0000", 2024-04-26T10:43:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002044+0000", 2024-04-26T10:43:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.119e-06 2024-04-26T10:43:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002047+0000", 2024-04-26T10:43:06.617 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0199999999999999e-06 2024-04-26T10:43:06.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.618 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.618 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.002050+0000", 2024-04-26T10:43:06.618 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.3360000000000002e-06 2024-04-26T10:43:06.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.618 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.619 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:06.619 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007165+0000", 2024-04-26T10:43:06.619 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051155879999999999 2024-04-26T10:43:06.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.619 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:06.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007209+0000", 2024-04-26T10:43:06.620 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4097000000000001e-05 2024-04-26T10:43:06.620 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.620 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.620 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:06.620 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.007278+0000", 2024-04-26T10:43:06.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8663000000000003e-05 2024-04-26T10:43:06.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.621 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.621 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.621 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.008047+0000", 2024-04-26T10:43:06.621 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00076935299999999996 2024-04-26T10:43:06.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.622 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:06.622 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012171+0000", 2024-04-26T10:43:06.622 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.004123219 2024-04-26T10:43:06.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.622 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:06.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012193+0000", 2024-04-26T10:43:06.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2169000000000001e-05 2024-04-26T10:43:06.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.623 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.623 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:06.623 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:22.012210+0000", 2024-04-26T10:43:06.623 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.6841999999999999e-05 2024-04-26T10:43:06.623 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.624 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:06.624 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.624 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.624 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.624 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:43:06.624 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.560495107000001, 2024-04-26T10:43:06.624 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010195469, 2024-04-26T10:43:06.624 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:06.625 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.625 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:06.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:06.625 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:43:06.625 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.625 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.625 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:06.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033506+0000", 2024-04-26T10:43:06.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.626 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.626 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:06.626 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033504+0000", 2024-04-26T10:43:06.626 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:06.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:06.627 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033513+0000", 2024-04-26T10:43:06.627 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.6829999999999997e-06 2024-04-26T10:43:06.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.627 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.627 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033525+0000", 2024-04-26T10:43:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2748000000000001e-05 2024-04-26T10:43:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033537+0000", 2024-04-26T10:43:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1243999999999999e-05 2024-04-26T10:43:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034018+0000", 2024-04-26T10:43:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00048138899999999998 2024-04-26T10:43:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.628 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op must wait for map", 2024-04-26T10:43:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034025+0000", 2024-04-26T10:43:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8870000000000003e-06 2024-04-26T10:43:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035264+0000", 2024-04-26T10:43:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0012385370000000001 2024-04-26T10:43:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035372+0000", 2024-04-26T10:43:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010851199999999999 2024-04-26T10:43:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.629 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035473+0000", 2024-04-26T10:43:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000100967 2024-04-26T10:43:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043270+0000", 2024-04-26T10:43:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0077971869999999997 2024-04-26T10:43:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:06.630 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043620+0000", 2024-04-26T10:43:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034962099999999999 2024-04-26T10:43:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043665+0000", 2024-04-26T10:43:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5426999999999997e-05 2024-04-26T10:43:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043701+0000", 2024-04-26T10:43:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6072000000000003e-05 2024-04-26T10:43:06.634 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:43:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.560010028000001, 2024-04-26T10:43:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0099286970000000002, 2024-04-26T10:43:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:43:06.635 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033991+0000", 2024-04-26T10:43:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033990+0000", 2024-04-26T10:43:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-26T10:43:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.033998+0000", 2024-04-26T10:43:06.636 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7970000000000001e-06 2024-04-26T10:43:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034010+0000", 2024-04-26T10:43:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2383e-05 2024-04-26T10:43:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034021+0000", 2024-04-26T10:43:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0824e-05 2024-04-26T10:43:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035774+0000", 2024-04-26T10:43:06.637 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0017527479999999999 2024-04-26T10:43:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035929+0000", 2024-04-26T10:43:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000155735 2024-04-26T10:43:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036083+0000", 2024-04-26T10:43:06.638 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000153635 2024-04-26T10:43:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043369+0000", 2024-04-26T10:43:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0072854490000000003 2024-04-26T10:43:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.639 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043709+0000", 2024-04-26T10:43:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034039600000000003 2024-04-26T10:43:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043878+0000", 2024-04-26T10:43:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00016924799999999999 2024-04-26T10:43:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043920+0000", 2024-04-26T10:43:06.640 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1471999999999999e-05 2024-04-26T10:43:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:43:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.559970749999998, 2024-04-26T10:43:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010011091999999999, 2024-04-26T10:43:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:06.641 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:43:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:43:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.642 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034030+0000", 2024-04-26T10:43:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034040+0000", 2024-04-26T10:43:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8560000000000002e-06 2024-04-26T10:43:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034048+0000", 2024-04-26T10:43:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.4139999999999994e-06 2024-04-26T10:43:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.643 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034054+0000", 2024-04-26T10:43:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.8950000000000003e-06 2024-04-26T10:43:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036269+0000", 2024-04-26T10:43:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002215528 2024-04-26T10:43:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036364+0000", 2024-04-26T10:43:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.4089e-05 2024-04-26T10:43:06.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036443+0000", 2024-04-26T10:43:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9666000000000006e-05 2024-04-26T10:43:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043451+0000", 2024-04-26T10:43:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0070081939999999997 2024-04-26T10:43:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043930+0000", 2024-04-26T10:43:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00047819799999999999 2024-04-26T10:43:06.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043999+0000", 2024-04-26T10:43:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9136999999999999e-05 2024-04-26T10:43:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044041+0000", 2024-04-26T10:43:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.2624999999999999e-05 2024-04-26T10:43:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:43:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.559931783000003, 2024-04-26T10:43:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015256755, 2024-04-26T10:43:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:43:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.647 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:43:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034069+0000", 2024-04-26T10:43:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034073+0000", 2024-04-26T10:43:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.1099999999999996e-06 2024-04-26T10:43:06.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034081+0000", 2024-04-26T10:43:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.0539999999999995e-06 2024-04-26T10:43:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034087+0000", 2024-04-26T10:43:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0240000000000003e-06 2024-04-26T10:43:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036668+0000", 2024-04-26T10:43:06.649 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002581014 2024-04-26T10:43:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036717+0000", 2024-04-26T10:43:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.9299999999999999e-05 2024-04-26T10:43:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:06.650 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036846+0000", 2024-04-26T10:43:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012901000000000001 2024-04-26T10:43:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044050+0000", 2024-04-26T10:43:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.007203816 2024-04-26T10:43:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049229+0000", 2024-04-26T10:43:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051792169999999998 2024-04-26T10:43:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049282+0000", 2024-04-26T10:43:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.2605000000000002e-05 2024-04-26T10:43:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049326+0000", 2024-04-26T10:43:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.4255000000000002e-05 2024-04-26T10:43:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.652 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:43:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.559907121000002, 2024-04-26T10:43:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01538838, 2024-04-26T10:43:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:43:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034094+0000", 2024-04-26T10:43:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034093+0000", 2024-04-26T10:43:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:06.654 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034097+0000", 2024-04-26T10:43:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.213e-06 2024-04-26T10:43:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034104+0000", 2024-04-26T10:43:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9840000000000004e-06 2024-04-26T10:43:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034111+0000", 2024-04-26T10:43:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.9199999999999998e-06 2024-04-26T10:43:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:06.655 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.037736+0000", 2024-04-26T10:43:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0036257429999999998 2024-04-26T10:43:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00034004 2024-04-26T10:43:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038526+0000", 2024-04-26T10:43:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00044924100000000002 2024-04-26T10:43:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.656 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044708+0000", 2024-04-26T10:43:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0061823360000000001 2024-04-26T10:43:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046886159999999996 2024-04-26T10:43:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049446+0000", 2024-04-26T10:43:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.973e-05 2024-04-26T10:43:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.657 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049482+0000", 2024-04-26T10:43:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6004999999999998e-05 2024-04-26T10:43:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:43:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.559885600000001, 2024-04-26T10:43:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015480648, 2024-04-26T10:43:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.658 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:43:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:43:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034115+0000", 2024-04-26T10:43:06.659 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034118+0000", 2024-04-26T10:43:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.1769999999999998e-06 2024-04-26T10:43:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034126+0000", 2024-04-26T10:43:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.7770000000000002e-06 2024-04-26T10:43:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034146+0000", 2024-04-26T10:43:06.660 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0579999999999999e-05 2024-04-26T10:43:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039740+0000", 2024-04-26T10:43:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0055940269999999997 2024-04-26T10:43:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039848+0000", 2024-04-26T10:43:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010775100000000001 2024-04-26T10:43:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:06.661 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040022+0000", 2024-04-26T10:43:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000173964 2024-04-26T10:43:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.044721+0000", 2024-04-26T10:43:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046989099999999997 2024-04-26T10:43:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049541+0000", 2024-04-26T10:43:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0048200789999999997 2024-04-26T10:43:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.662 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049574+0000", 2024-04-26T10:43:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2817000000000001e-05 2024-04-26T10:43:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049596+0000", 2024-04-26T10:43:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.2011999999999999e-05 2024-04-26T10:43:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:43:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.559849641, 2024-04-26T10:43:06.663 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015538033, 2024-04-26T10:43:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:43:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:43:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.664 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034151+0000", 2024-04-26T10:43:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034155+0000", 2024-04-26T10:43:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.177e-06 2024-04-26T10:43:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:06.665 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034161+0000", 2024-04-26T10:43:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0780000000000001e-06 2024-04-26T10:43:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034168+0000", 2024-04-26T10:43:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8689999999999998e-06 2024-04-26T10:43:06.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041069+0000", 2024-04-26T10:43:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0069010440000000003 2024-04-26T10:43:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041221+0000", 2024-04-26T10:43:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00015175 2024-04-26T10:43:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.041350+0000", 2024-04-26T10:43:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012870899999999999 2024-04-26T10:43:06.667 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045386+0000", 2024-04-26T10:43:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0040364789999999999 2024-04-26T10:43:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049641+0000", 2024-04-26T10:43:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0042552120000000004 2024-04-26T10:43:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049669+0000", 2024-04-26T10:43:06.668 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.7809000000000001e-05 2024-04-26T10:43:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049689+0000", 2024-04-26T10:43:06.669 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.0336e-05 2024-04-26T10:43:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:43:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.559827812000002, 2024-04-26T10:43:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.015595107, 2024-04-26T10:43:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:06.670 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:43:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:43:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034173+0000", 2024-04-26T10:43:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.671 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034176+0000", 2024-04-26T10:43:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.0089999999999999e-06 2024-04-26T10:43:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034182+0000", 2024-04-26T10:43:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.4579999999999998e-06 2024-04-26T10:43:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034187+0000", 2024-04-26T10:43:06.672 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0880000000000002e-06 2024-04-26T10:43:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045564+0000", 2024-04-26T10:43:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011376475 2024-04-26T10:43:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045623+0000", 2024-04-26T10:43:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.9388999999999997e-05 2024-04-26T10:43:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.045713+0000", 2024-04-26T10:43:06.673 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.0211999999999996e-05 2024-04-26T10:43:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046325+0000", 2024-04-26T10:43:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00061181699999999996 2024-04-26T10:43:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.674 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049722+0000", 2024-04-26T10:43:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033962380000000002 2024-04-26T10:43:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049750+0000", 2024-04-26T10:43:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.8087000000000001e-05 2024-04-26T10:43:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049768+0000", 2024-04-26T10:43:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.8681999999999998e-05 2024-04-26T10:43:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.675 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:43:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.559614287999999, 2024-04-26T10:43:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0087543810000000003, 2024-04-26T10:43:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:06.676 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:43:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034387+0000", 2024-04-26T10:43:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034386+0000", 2024-04-26T10:43:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.999999 2024-04-26T10:43:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.677 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034397+0000", 2024-04-26T10:43:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0878e-05 2024-04-26T10:43:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034408+0000", 2024-04-26T10:43:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.1138000000000001e-05 2024-04-26T10:43:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034414+0000", 2024-04-26T10:43:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.2910000000000004e-06 2024-04-26T10:43:06.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036009+0000", 2024-04-26T10:43:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0015952029999999999 2024-04-26T10:43:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036120+0000", 2024-04-26T10:43:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000110584 2024-04-26T10:43:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:43:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036225+0000", 2024-04-26T10:43:06.679 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00010523599999999999 2024-04-26T10:43:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039276+0000", 2024-04-26T10:43:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.003050404 2024-04-26T10:43:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0037356099999999999 2024-04-26T10:43:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:06.680 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043079+0000", 2024-04-26T10:43:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.8099e-05 2024-04-26T10:43:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043141+0000", 2024-04-26T10:43:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1655999999999994e-05 2024-04-26T10:43:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:43:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.559553731000001, 2024-04-26T10:43:06.681 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0090131610000000004, 2024-04-26T10:43:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:43:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:43:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.682 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034447+0000", 2024-04-26T10:43:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034451+0000", 2024-04-26T10:43:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.9600000000000002e-06 2024-04-26T10:43:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034458+0000", 2024-04-26T10:43:06.683 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.5820000000000004e-06 2024-04-26T10:43:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034463+0000", 2024-04-26T10:43:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.0719999999999999e-06 2024-04-26T10:43:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036527+0000", 2024-04-26T10:43:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.002063755 2024-04-26T10:43:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036610+0000", 2024-04-26T10:43:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.2669000000000004e-05 2024-04-26T10:43:06.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:43:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036744+0000", 2024-04-26T10:43:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013412499999999999 2024-04-26T10:43:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040144+0000", 2024-04-26T10:43:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0033999799999999999 2024-04-26T10:43:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043301+0000", 2024-04-26T10:43:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0031572240000000001 2024-04-26T10:43:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.685 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043425+0000", 2024-04-26T10:43:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000123664 2024-04-26T10:43:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043460+0000", 2024-04-26T10:43:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5651000000000001e-05 2024-04-26T10:43:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.686 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:43:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.559528831000002, 2024-04-26T10:43:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0086028210000000001, 2024-04-26T10:43:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:43:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:43:06.687 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034472+0000", 2024-04-26T10:43:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034482+0000", 2024-04-26T10:43:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.8630000000000003e-06 2024-04-26T10:43:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:06.688 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034494+0000", 2024-04-26T10:43:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2531000000000001e-05 2024-04-26T10:43:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034501+0000", 2024-04-26T10:43:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7050000000000002e-06 2024-04-26T10:43:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035138+0000", 2024-04-26T10:43:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00063744099999999998 2024-04-26T10:43:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.689 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035286+0000", 2024-04-26T10:43:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014766200000000001 2024-04-26T10:43:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:43:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035654+0000", 2024-04-26T10:43:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00036779100000000002 2024-04-26T10:43:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040833+0000", 2024-04-26T10:43:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0051795640000000002 2024-04-26T10:43:06.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.042886+0000", 2024-04-26T10:43:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0020531220000000001 2024-04-26T10:43:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043015+0000", 2024-04-26T10:43:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012824099999999999 2024-04-26T10:43:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043075+0000", 2024-04-26T10:43:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.0262e-05 2024-04-26T10:43:06.691 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:43:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.559492868, 2024-04-26T10:43:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.01482116, 2024-04-26T10:43:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:06.692 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:43:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:43:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034508+0000", 2024-04-26T10:43:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034515+0000", 2024-04-26T10:43:06.693 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.391e-06 2024-04-26T10:43:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034522+0000", 2024-04-26T10:43:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.7889999999999997e-06 2024-04-26T10:43:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034601+0000", 2024-04-26T10:43:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 7.9547000000000003e-05 2024-04-26T10:43:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036510+0000", 2024-04-26T10:43:06.694 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0019092289999999999 2024-04-26T10:43:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036642+0000", 2024-04-26T10:43:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013151100000000001 2024-04-26T10:43:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036766+0000", 2024-04-26T10:43:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012367300000000001 2024-04-26T10:43:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.695 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040749+0000", 2024-04-26T10:43:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0039838419999999996 2024-04-26T10:43:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049262+0000", 2024-04-26T10:43:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0085127789999999998 2024-04-26T10:43:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049301+0000", 2024-04-26T10:43:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.8834000000000001e-05 2024-04-26T10:43:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.696 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049329+0000", 2024-04-26T10:43:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.817e-05 2024-04-26T10:43:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:43:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.559360171000002, 2024-04-26T10:43:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014796093999999999, 2024-04-26T10:43:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.697 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:43:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034641+0000", 2024-04-26T10:43:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034640+0000", 2024-04-26T10:43:06.698 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034650+0000", 2024-04-26T10:43:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.0064999999999999e-05 2024-04-26T10:43:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034660+0000", 2024-04-26T10:43:06.699 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.961e-06 2024-04-26T10:43:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034680+0000", 2024-04-26T10:43:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.9219e-05 2024-04-26T10:43:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:06.700 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.037926+0000", 2024-04-26T10:43:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0032460380000000001 2024-04-26T10:43:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038068+0000", 2024-04-26T10:43:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00014236000000000001 2024-04-26T10:43:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.701 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.038201+0000", 2024-04-26T10:43:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013345300000000001 2024-04-26T10:43:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043497+0000", 2024-04-26T10:43:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0052952770000000001 2024-04-26T10:43:06.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049373+0000", 2024-04-26T10:43:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0058762900000000002 2024-04-26T10:43:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049411+0000", 2024-04-26T10:43:06.703 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.7737000000000001e-05 2024-04-26T10:43:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049437+0000", 2024-04-26T10:43:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 2.6169999999999998e-05 2024-04-26T10:43:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:43:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.559315660999999, 2024-04-26T10:43:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0092140799999999995, 2024-04-26T10:43:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:06.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:43:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:43:06.706 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034685+0000", 2024-04-26T10:43:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:06.707 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034688+0000", 2024-04-26T10:43:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.5480000000000002e-06 2024-04-26T10:43:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034694+0000", 2024-04-26T10:43:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 6.1310000000000003e-06 2024-04-26T10:43:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.708 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034700+0000", 2024-04-26T10:43:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.4229999999999996e-06 2024-04-26T10:43:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036183+0000", 2024-04-26T10:43:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.001482964 2024-04-26T10:43:06.709 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036297+0000", 2024-04-26T10:43:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000113649 2024-04-26T10:43:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 2", 2024-04-26T10:43:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.036426+0000", 2024-04-26T10:43:06.710 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00012924900000000001 2024-04-26T10:43:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040839+0000", 2024-04-26T10:43:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044137079999999997 2024-04-26T10:43:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.711 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043679+0000", 2024-04-26T10:43:06.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0028397850000000001 2024-04-26T10:43:06.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.712 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:06.712 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043725+0000", 2024-04-26T10:43:06.712 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4.5859999999999998e-05 2024-04-26T10:43:06.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.713 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:06.713 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.043899+0000", 2024-04-26T10:43:06.713 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000174267 2024-04-26T10:43:06.713 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.713 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:06.713 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.713 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.713 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.713 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.714 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:43:06.714 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.559292726999999, 2024-04-26T10:43:06.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.011493046999999999, 2024-04-26T10:43:06.714 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:06.714 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:06.714 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:06.714 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.714 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:06.714 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:43:06.714 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:43:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034708+0000", 2024-04-26T10:43:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034711+0000", 2024-04-26T10:43:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.4359999999999998e-06 2024-04-26T10:43:06.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:06.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034717+0000", 2024-04-26T10:43:06.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.7939999999999999e-06 2024-04-26T10:43:06.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034723+0000", 2024-04-26T10:43:06.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 5.6219999999999997e-06 2024-04-26T10:43:06.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.716 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.716 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:06.716 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035221+0000", 2024-04-26T10:43:06.716 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00049811199999999999 2024-04-26T10:43:06.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:06.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035351+0000", 2024-04-26T10:43:06.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.00013049200000000001 2024-04-26T10:43:06.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:06.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.035467+0000", 2024-04-26T10:43:06.717 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000115364 2024-04-26T10:43:06.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.717 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "op_commit", 2024-04-26T10:43:06.717 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.040085+0000", 2024-04-26T10:43:06.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0046182300000000001 2024-04-26T10:43:06.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:06.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046133+0000", 2024-04-26T10:43:06.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0060476059999999996 2024-04-26T10:43:06.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "commit_sent", 2024-04-26T10:43:06.718 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046165+0000", 2024-04-26T10:43:06.718 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.2155e-05 2024-04-26T10:43:06.718 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.718 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.718 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:06.719 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.046201+0000", 2024-04-26T10:43:06.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 3.6566999999999997e-05 2024-04-26T10:43:06.719 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.719 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:06.719 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.719 INFO:teuthology.orchestra.run.smithi087.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:06.719 INFO:teuthology.orchestra.run.smithi087.stdout: "initiated_at": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:43:06.719 INFO:teuthology.orchestra.run.smithi087.stdout: "age": 40.559206318000001, 2024-04-26T10:43:06.719 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.014742026, 2024-04-26T10:43:06.719 INFO:teuthology.orchestra.run.smithi087.stdout: "type_data": { 2024-04-26T10:43:06.719 INFO:teuthology.orchestra.run.smithi087.stdout: "flag_point": "started", 2024-04-26T10:43:06.719 INFO:teuthology.orchestra.run.smithi087.stdout: "events": [ 2024-04-26T10:43:06.719 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "initiated", 2024-04-26T10:43:06.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:43:06.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "throttled", 2024-04-26T10:43:06.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034795+0000", 2024-04-26T10:43:06.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0 2024-04-26T10:43:06.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.720 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.720 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "header_read", 2024-04-26T10:43:06.720 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034793+0000", 2024-04-26T10:43:06.720 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 4294967295.9999986 2024-04-26T10:43:06.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "all_read", 2024-04-26T10:43:06.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034802+0000", 2024-04-26T10:43:06.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 8.551e-06 2024-04-26T10:43:06.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "dispatched", 2024-04-26T10:43:06.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034815+0000", 2024-04-26T10:43:06.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 1.2706e-05 2024-04-26T10:43:06.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.721 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.721 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "queued_for_pg", 2024-04-26T10:43:06.721 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.034824+0000", 2024-04-26T10:43:06.721 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 9.5189999999999998e-06 2024-04-26T10:43:06.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "reached_pg", 2024-04-26T10:43:06.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039312+0000", 2024-04-26T10:43:06.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.0044874030000000001 2024-04-26T10:43:06.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "started", 2024-04-26T10:43:06.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.039457+0000", 2024-04-26T10:43:06.722 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.000145081 2024-04-26T10:43:06.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-04-26T10:43:06.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-04-26T10:43:06.722 INFO:teuthology.orchestra.run.smithi087.stdout: "event": "done", 2024-04-26T10:43:06.722 INFO:teuthology.orchestra.run.smithi087.stdout: "time": "2024-04-26T10:42:26.049537+0000", 2024-04-26T10:43:06.723 INFO:teuthology.orchestra.run.smithi087.stdout: "duration": 0.010080053 2024-04-26T10:43:06.723 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.723 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:06.723 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.723 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-04-26T10:43:06.723 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-04-26T10:43:06.723 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-26T10:43:06.725 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:06.725 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:43:06.723+0000 7fd9d3af9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28596) UID: 0 2024-04-26T10:43:06.791 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:43:06.826 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:06.824+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:06.833 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T10:43:06.833 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:43:06.834 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [0, 1, 2] 2024-04-26T10:43:06.834 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi087.front.sepia.ceph.com 2024-04-26T10:43:06.834 INFO:teuthology.orchestra.console.smithi087:Power off 2024-04-26T10:43:06.835 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T10:43:06.846 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:06.846 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:06.846 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:06.847 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:06.847 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:06.858 DEBUG:teuthology.orchestra.console.smithi087:power off output: Chassis Power Control: Down/Off 2024-04-26T10:43:06.858 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T10:43:06.881 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2024-04-26T10:43:06.930 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:06.929+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:06.988 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:06.989 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:06.989 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:06.989 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:06.989 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:06.999 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:07.039 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:07.038+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:07.129 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:07.128+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:07.141 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:07.142 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:07.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:07.142 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:07.142 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.142 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:07.142 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:07.142 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 41.103171502000002, 2024-04-26T10:43:07.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:07.142 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:07.142 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.142 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:07.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:07.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:07.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:07.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:07.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:07.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:07.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.144 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:07.144 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:07.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:07.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.144 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:07.144 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:07.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:07.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.144 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.144 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:07.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:07.145 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.145 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.145 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:07.145 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:07.145 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:07.145 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.145 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.145 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:07.145 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:07.145 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:07.145 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.145 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.145 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:07.145 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:07.145 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:07.146 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.146 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.146 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:07.146 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:07.146 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:07.146 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.146 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:07.146 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.146 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.146 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.146 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:07.146 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:07.146 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 41.102300722000003, 2024-04-26T10:43:07.147 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:07.147 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:07.147 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.147 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:07.147 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.147 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:07.147 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:07.147 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.147 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.147 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.147 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:07.147 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:07.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:07.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:07.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:07.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:07.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:07.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:07.149 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:07.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:07.149 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.149 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.149 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:07.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:07.149 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.149 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:07.149 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:07.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:07.149 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.150 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.150 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:07.150 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:07.150 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:07.150 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.150 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.150 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:07.150 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:07.150 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:07.150 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.150 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.150 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:07.150 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:07.151 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:07.151 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.151 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:07.151 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.151 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.151 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.151 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:07.151 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:07.151 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 41.101313378999997, 2024-04-26T10:43:07.151 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:07.151 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:07.151 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.151 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:07.152 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.152 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:07.152 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:07.152 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.152 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.152 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:07.152 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:07.152 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.152 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.152 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:07.152 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:07.152 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:07.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:07.153 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:07.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:07.153 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:07.153 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:07.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:07.153 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.153 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:07.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:07.154 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.154 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.154 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:07.154 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:07.154 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:07.154 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.154 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.154 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:07.154 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:07.154 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:07.154 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.154 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.154 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:07.154 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:07.155 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:07.155 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.155 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.155 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:07.155 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:07.155 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:07.155 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.155 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:07.155 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.155 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.155 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.155 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:07.155 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:07.155 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 41.101108113999999, 2024-04-26T10:43:07.156 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:07.156 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:07.156 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.156 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:07.156 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.156 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:07.156 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:07.156 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.156 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.156 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.156 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:07.156 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:07.156 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.156 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.157 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.157 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:07.157 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:07.157 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.157 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.157 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.157 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:07.157 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:07.157 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:07.157 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.157 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.157 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:07.157 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:07.157 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:07.157 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.158 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.158 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.158 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:07.158 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:07.158 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.158 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.158 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:07.158 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:07.158 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:07.158 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.158 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.158 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:07.158 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:07.159 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:07.159 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.159 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.159 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:07.159 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:07.159 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:07.159 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.159 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.159 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:07.159 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:07.159 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:07.159 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.159 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:07.159 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.160 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.160 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.160 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:07.160 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:07.160 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 41.100787234999999, 2024-04-26T10:43:07.160 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:07.160 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:07.160 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.160 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:07.160 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.160 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:07.160 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:07.160 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.160 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.161 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.161 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:07.161 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:07.161 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.161 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.161 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.161 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:07.161 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:07.161 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:07.161 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.161 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.161 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:07.162 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:07.162 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:07.162 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.162 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.162 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:07.162 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:07.162 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:07.162 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.162 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.162 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.162 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:07.162 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:07.162 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.162 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.163 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:07.163 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:07.163 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:07.163 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.163 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.163 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:07.163 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:07.163 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:07.163 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.163 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.163 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:07.163 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:07.163 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:07.163 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.164 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.164 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:07.164 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:07.164 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:07.164 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.164 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.164 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:07.164 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:07.164 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:07.164 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.164 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.164 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:07.164 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:07.165 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:07.165 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.165 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.165 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:07.165 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:07.165 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:07.165 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.165 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:07.165 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.165 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.165 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.165 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:07.165 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:07.165 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 41.100735411000002, 2024-04-26T10:43:07.166 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:07.166 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:07.166 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.166 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:07.166 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.166 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:07.166 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:07.166 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.166 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.166 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.166 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:07.166 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:07.166 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.166 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.167 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.167 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:07.167 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:07.167 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.167 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.167 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.167 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:07.167 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:07.167 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:07.167 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.167 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.167 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:07.167 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:07.167 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:07.168 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.168 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.168 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.168 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:07.168 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:07.168 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.168 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.168 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:07.168 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:07.168 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:07.168 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.168 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.168 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:07.168 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:07.169 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:07.169 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.169 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.169 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:07.169 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:07.169 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:07.169 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.169 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.169 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:07.169 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:07.169 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:07.169 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.169 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.170 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:07.170 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:07.170 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:07.170 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.170 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.170 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:07.170 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:07.170 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:07.170 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.170 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.170 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:07.170 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:07.170 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:07.171 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.171 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:07.171 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.171 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.171 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.171 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:07.171 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:07.171 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 41.100682038999999, 2024-04-26T10:43:07.171 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:07.171 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:07.171 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.171 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:07.172 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.172 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:07.172 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:07.172 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.172 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.172 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.172 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:07.172 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:07.172 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.172 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.173 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.173 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:07.173 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:07.173 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.173 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.173 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.173 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:07.173 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:07.173 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:07.173 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.173 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.173 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:07.173 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:07.173 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:07.173 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.174 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.174 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.174 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:07.174 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:07.174 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.174 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.174 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:07.174 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:07.174 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:07.174 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.174 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.174 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:07.174 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:07.175 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:07.175 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.175 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.175 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:07.175 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:07.175 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:07.175 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.175 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.175 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:07.175 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:07.175 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:07.175 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.175 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.175 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:07.176 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:07.176 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:07.176 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.176 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.176 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:07.176 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:07.176 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:07.176 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.176 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.176 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:07.176 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:07.176 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:07.176 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.176 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:07.176 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.177 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.177 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.177 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:07.177 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:07.177 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 41.100637712000001, 2024-04-26T10:43:07.177 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:07.177 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:07.177 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.177 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:07.177 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.177 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:07.177 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:07.177 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.177 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.177 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.178 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:07.178 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:07.178 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.178 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.178 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.178 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:07.178 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:07.178 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:07.178 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.178 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.178 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:07.178 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:07.178 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:07.178 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.179 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.179 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:07.179 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:07.179 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:07.179 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.179 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.179 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.179 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:07.179 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:07.179 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.179 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.179 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:07.179 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:07.179 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:07.179 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.180 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.180 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:07.180 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:07.180 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:07.180 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.180 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.180 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:07.180 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:07.180 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:07.180 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.180 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.180 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:07.180 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:07.180 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:07.181 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.181 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.181 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:07.181 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:07.181 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:07.181 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.181 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.181 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:07.181 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:07.181 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:07.181 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.181 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.181 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:07.181 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:07.182 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:07.182 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.182 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:07.182 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.182 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.182 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.182 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:07.182 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:07.182 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 41.100613998999997, 2024-04-26T10:43:07.182 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:07.182 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:07.182 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.182 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:07.182 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.183 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:07.183 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:07.183 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.183 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.183 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.183 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:07.183 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:07.183 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.183 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.183 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.183 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:07.183 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:07.183 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.183 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.184 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.184 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:07.184 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:07.184 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:07.184 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.184 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.184 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:07.184 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:07.184 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:07.184 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.184 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.185 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.185 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:07.185 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:07.185 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.186 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.186 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:07.186 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:07.186 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:07.186 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.186 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.186 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:07.186 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:07.186 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:07.186 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.186 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.186 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:07.187 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:07.187 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:07.187 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.187 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.187 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:07.187 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:07.187 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:07.187 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.187 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.187 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:07.187 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:07.187 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:07.187 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.187 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.187 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:07.188 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:07.188 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:07.188 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.188 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.188 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:07.188 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:07.188 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:07.188 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.188 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:07.188 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.188 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.188 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.188 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:07.188 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:07.189 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 41.100579693999997, 2024-04-26T10:43:07.189 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:07.189 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:07.189 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.189 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:07.189 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.189 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:07.189 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:07.189 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.189 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.189 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.189 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:07.189 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:07.189 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.190 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.190 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.190 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:07.190 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:07.190 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.190 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.190 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.190 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:07.190 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:07.190 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:07.190 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.190 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.190 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:07.190 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:07.191 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:07.191 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.191 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.191 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.191 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:07.191 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:07.191 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.191 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.191 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:07.191 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:07.191 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:07.191 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.191 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.191 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:07.192 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:07.192 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:07.192 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.192 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.192 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:07.192 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:07.192 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:07.192 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.192 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.192 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:07.192 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:07.192 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:07.192 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.192 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.192 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:07.193 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:07.193 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:07.193 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.193 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.193 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:07.193 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:07.193 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:07.193 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.193 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.193 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:07.193 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:07.193 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:07.193 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.193 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:07.193 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.194 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.194 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.194 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:07.194 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:07.194 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 41.100243098, 2024-04-26T10:43:07.194 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:07.194 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:07.194 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:07.194 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:07.194 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.194 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:07.194 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:07.194 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.194 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.195 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.195 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:07.195 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:07.195 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.195 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.195 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.195 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:07.195 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:07.195 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:07.195 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.195 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.195 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:07.195 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:07.195 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:07.196 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.196 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.196 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:07.196 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:07.196 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:07.196 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.196 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.196 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.196 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:07.196 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:07.196 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.196 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.196 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:07.196 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:07.197 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:07.197 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.197 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.197 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:07.197 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:07.197 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:07.197 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.197 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.197 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:07.197 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:07.197 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:07.197 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.197 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:07.197 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.197 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.198 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.198 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:07.198 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:07.198 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 41.100201069999997, 2024-04-26T10:43:07.198 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:07.198 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:07.198 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:07.198 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:07.198 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.198 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:07.198 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:07.198 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.198 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.199 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.199 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:07.199 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:07.199 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.199 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.199 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.199 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:07.199 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:07.199 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.199 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.199 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.199 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:07.199 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:07.199 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:07.200 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.200 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.200 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:07.200 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:07.200 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:07.200 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.200 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.200 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.200 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:07.200 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:07.200 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.200 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.200 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:07.200 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:07.200 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:07.201 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.201 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.201 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:07.201 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:07.201 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:07.201 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.201 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.201 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:07.201 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:07.201 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:07.201 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.201 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:07.201 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.201 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.202 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.202 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:07.202 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:07.202 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 41.100147898000003, 2024-04-26T10:43:07.202 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:07.202 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:07.202 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:07.202 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:07.203 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.203 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:07.203 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:07.203 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.203 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.203 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.203 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:07.203 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:07.203 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.203 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.203 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.203 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:07.203 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:07.203 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.204 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.204 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.204 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:07.204 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:07.204 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:07.204 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.204 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.204 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:07.204 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:07.204 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:07.205 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.205 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.205 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.205 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:07.205 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:07.205 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.205 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.205 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:07.205 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:07.206 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:07.206 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.206 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.206 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:07.206 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:07.206 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:07.206 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.206 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.206 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:07.206 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:07.206 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:07.206 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.206 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:07.206 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.207 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.207 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.207 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:07.207 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:07.207 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 41.096741487999999, 2024-04-26T10:43:07.207 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:07.207 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:07.207 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:07.207 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:07.207 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.207 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:07.207 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:07.207 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.207 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.207 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.208 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:07.208 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:07.208 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.208 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.208 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.208 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:07.208 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:07.208 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.208 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.208 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.208 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:07.208 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:07.208 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:07.208 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.208 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.209 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:07.209 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:07.209 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:07.209 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.209 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.209 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.209 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:07.209 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:07.209 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.209 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.210 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:07.210 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:07.210 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:07.210 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.210 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.210 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:07.210 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:07.210 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:07.210 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.210 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:07.210 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.210 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.210 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.210 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:07.211 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:07.211 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 41.094269535000002, 2024-04-26T10:43:07.211 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:07.211 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:07.211 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:07.211 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:07.211 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.211 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:07.211 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:07.211 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.211 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.211 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.212 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:07.212 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:07.212 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.212 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.212 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.212 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:07.212 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:07.212 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.212 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.212 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.212 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:07.212 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:07.212 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:07.212 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.213 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.213 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:07.213 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:07.213 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:07.213 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.213 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.213 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.213 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:07.213 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:07.213 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.213 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.213 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:07.213 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:07.213 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:07.214 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.214 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.214 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:07.214 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:07.214 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:07.214 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.214 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.214 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:07.214 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:07.214 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:07.214 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.214 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:07.214 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.214 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.215 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.215 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:07.215 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:07.215 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 41.093615976999999, 2024-04-26T10:43:07.215 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:07.215 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:07.215 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:07.215 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:07.215 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.215 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:07.215 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:07.215 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.215 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.215 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.215 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:07.216 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:07.216 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.216 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.216 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.216 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:07.216 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:07.216 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.216 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.216 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.216 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:07.216 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:07.216 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:07.216 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.216 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.216 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:07.217 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:07.217 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:07.217 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.217 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.217 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.217 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:07.217 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:07.217 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.217 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.217 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:07.217 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:07.217 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:07.217 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.217 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.218 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:07.218 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:07.218 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:07.218 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.218 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.218 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:07.218 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:07.218 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:07.218 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.218 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:07.218 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.218 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.218 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.218 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:07.219 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:07.219 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 41.093540191999999, 2024-04-26T10:43:07.219 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:07.219 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:07.219 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:07.219 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:07.219 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.219 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:07.219 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:07.219 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.219 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.219 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.219 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:07.219 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:07.219 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.220 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.220 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.220 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:07.220 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:07.220 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.220 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.220 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.220 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:07.220 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:07.220 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:07.220 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.220 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.220 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:07.220 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:07.221 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:07.221 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.221 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.221 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.221 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:07.221 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:07.221 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.221 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.221 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:07.221 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:07.221 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:07.221 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.221 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.221 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:07.221 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:07.222 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:07.222 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.222 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.222 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:07.222 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:07.222 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:07.222 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.222 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:07.222 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.222 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.222 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.222 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:07.222 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:07.222 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 41.093326498000003, 2024-04-26T10:43:07.222 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:07.223 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:07.223 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:07.223 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:07.223 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.223 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:07.223 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:07.223 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.223 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.223 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.223 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:07.223 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:07.223 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.223 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.223 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.223 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:07.224 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:07.224 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.224 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.224 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.224 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:07.224 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:07.224 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:07.224 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.224 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.224 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:07.224 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:07.224 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:07.224 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.224 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.225 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.225 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:07.225 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:07.225 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.225 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.225 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:07.225 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:07.225 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:07.225 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.225 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.225 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:07.225 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:07.225 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:07.225 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.225 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:07.226 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.226 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.226 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.226 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:07.226 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:07.226 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 41.090882684999997, 2024-04-26T10:43:07.226 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:07.226 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:07.226 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:07.226 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:07.226 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.226 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:07.226 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:07.226 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.227 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.227 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.227 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:07.227 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:07.227 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.227 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.227 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.227 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:07.228 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:07.228 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:07.228 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.229 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.229 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:07.229 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:07.229 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:07.229 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.229 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.229 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:07.229 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:07.229 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:07.229 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.229 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.229 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.230 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:07.230 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:07.230 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.230 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.230 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:07.230 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:07.230 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:07.230 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.230 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.230 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:07.230 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:07.230 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:07.230 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.230 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.231 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:07.231 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:07.231 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:07.231 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.231 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:07.231 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.231 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.231 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.231 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:07.231 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:07.231 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 35.640820241, 2024-04-26T10:43:07.231 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:07.231 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:07.231 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.232 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:07.232 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.232 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:07.232 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:07.232 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.232 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.232 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.232 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:07.232 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:07.232 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:07.232 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.232 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.232 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:07.232 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:07.232 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:07.233 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.233 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.233 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:07.233 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:07.233 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:07.233 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.233 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.233 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:07.233 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:07.233 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:07.233 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.233 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.233 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.233 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:07.233 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:07.234 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.234 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.234 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:07.234 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:07.234 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:07.234 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.234 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.234 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:07.234 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:07.234 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:07.234 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.234 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.234 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:07.234 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:07.235 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:07.235 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.235 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.235 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:07.235 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:07.235 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:07.235 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.235 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.235 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:07.235 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:07.235 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:07.235 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.235 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.235 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:07.236 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:07.236 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:07.236 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:07.236 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:07.236 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:07.236 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:07.236 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:07.236 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.236 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:07.236 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.236 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:07.236 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:07.236 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:07.238 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:07.239 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:07.236+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:07.339 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:07.338+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:07.356 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:07.356 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:07.356 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:07.356 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:07.366 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:07.439 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:07.439+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:07.473 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:07.473 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:07.473 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:07.473 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:07.473 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:07.482 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:07.540 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:07.539+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:07.589 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:07.589 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:07.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:07.589 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:07.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.589 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:07.590 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:07.590 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.551411039999998, 2024-04-26T10:43:07.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:07.590 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:07.590 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.590 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:07.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:07.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:07.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:07.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:07.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:07.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:07.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:07.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:07.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:07.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:07.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:07.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:07.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:07.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:07.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:07.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:07.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:07.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:07.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:07.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:07.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:07.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:07.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:07.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:07.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:07.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:07.594 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.594 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:07.594 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.594 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:07.594 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:07.594 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.549660918999997, 2024-04-26T10:43:07.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:07.594 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:07.594 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.594 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:07.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.595 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:07.595 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:07.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.595 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:07.595 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:07.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.595 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:07.595 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:07.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:07.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.596 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:07.596 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:07.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:07.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.596 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:07.596 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:07.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:07.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.596 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.596 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:07.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:07.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:07.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:07.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:07.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:07.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:07.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:07.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:07.598 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:07.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:07.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:07.598 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:07.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:07.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:07.598 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:07.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:07.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:07.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:07.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:07.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.599 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:07.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:07.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:07.599 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.599 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:07.599 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.599 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:07.599 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:07.599 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.549607921000003, 2024-04-26T10:43:07.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:07.600 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:07.600 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.600 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:07.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.600 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:07.600 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:07.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.600 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:07.600 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:07.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.601 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:07.601 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:07.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.601 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:07.601 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:07.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:07.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.601 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:07.601 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:07.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:07.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:07.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:07.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:07.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:07.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:07.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:07.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:07.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:07.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:07.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:07.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:07.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:07.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:07.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:07.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:07.604 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:07.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:07.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:07.604 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:07.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:07.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:07.604 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:07.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:07.604 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.605 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:07.605 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.605 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:07.605 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:07.605 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.549530177000001, 2024-04-26T10:43:07.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:07.605 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:07.605 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.605 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:07.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.605 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:07.605 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:07.606 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.606 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:07.606 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:07.606 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.606 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:07.606 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:07.606 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:07.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:07.607 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:07.607 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:07.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:07.607 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:07.607 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:07.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.607 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:07.607 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:07.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.608 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:07.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:07.608 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:07.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.608 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:07.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:07.608 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:07.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.608 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:07.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:07.608 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:07.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.609 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:07.609 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:07.609 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:07.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.609 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:07.609 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:07.609 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:07.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.609 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:07.609 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:07.609 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:07.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.610 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:07.610 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:07.610 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:07.610 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.610 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:07.610 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.610 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:07.610 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:07.610 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.549491171, 2024-04-26T10:43:07.610 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:07.610 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:07.611 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.611 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:07.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.611 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:07.611 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:07.611 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.611 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:07.611 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:07.611 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.612 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:07.612 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:07.612 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:07.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.612 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:07.612 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:07.612 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:07.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.613 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:07.613 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:07.613 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:07.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.613 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.613 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:07.613 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:07.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.613 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:07.614 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:07.614 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:07.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.614 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:07.614 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:07.614 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:07.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.614 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:07.614 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:07.614 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:07.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.615 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:07.615 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:07.615 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:07.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.615 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:07.615 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:07.615 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:07.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.616 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:07.616 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:07.616 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:07.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.616 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:07.616 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:07.616 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:07.616 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.616 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:07.616 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.617 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:07.617 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:07.617 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.549472350000002, 2024-04-26T10:43:07.617 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:07.617 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:07.617 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.617 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:07.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.617 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:07.617 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:07.617 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.618 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:07.618 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:07.618 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.618 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:07.618 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:07.618 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:07.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.618 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:07.619 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:07.619 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:07.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.619 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:07.619 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:07.619 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:07.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.619 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.619 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:07.619 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:07.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.620 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.620 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:07.620 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:07.620 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:07.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.620 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.620 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:07.620 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:07.620 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:07.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.620 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.620 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:07.621 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:07.621 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:07.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.621 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.621 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:07.621 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:07.621 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:07.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.621 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.621 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:07.621 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:07.621 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:07.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.621 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.622 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:07.622 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:07.622 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:07.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.622 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:07.622 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:07.622 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:07.622 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.622 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:07.622 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.623 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:07.623 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:07.623 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.549440347999997, 2024-04-26T10:43:07.623 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:07.623 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:07.623 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.623 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:07.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.623 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:07.623 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:07.623 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.624 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:07.624 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:07.624 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.624 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:07.624 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:07.624 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.624 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:07.624 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:07.625 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:07.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.625 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:07.625 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:07.625 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:07.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.625 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.625 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:07.625 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:07.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.625 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:07.626 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:07.626 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:07.626 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.626 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.626 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:07.626 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:07.626 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:07.626 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.626 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.626 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:07.626 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:07.626 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:07.626 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.627 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:07.627 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:07.627 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:07.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.627 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:07.627 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:07.627 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:07.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.627 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:07.628 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:07.628 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:07.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.628 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:07.628 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:07.628 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:07.628 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.628 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:07.628 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.628 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:07.628 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:07.629 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.549231540000001, 2024-04-26T10:43:07.629 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:07.629 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:07.629 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.629 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:07.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.629 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:07.629 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:07.629 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.629 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:07.629 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:07.630 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.630 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:07.630 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:07.630 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:07.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.630 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:07.630 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:07.630 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:07.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.631 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:07.631 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:07.631 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:07.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.631 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.631 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:07.631 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:07.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.631 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:07.631 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:07.631 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:07.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.632 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:07.632 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:07.632 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:07.632 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.632 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:07.632 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:07.632 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:07.632 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.632 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:07.632 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:07.632 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:07.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.633 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:07.633 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:07.633 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:07.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.633 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:07.633 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:07.633 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:07.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.633 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:07.633 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:07.633 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:07.634 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.634 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:07.634 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.634 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:07.634 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:07.634 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.549200249000002, 2024-04-26T10:43:07.634 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:07.634 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:07.634 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:07.634 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:07.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.635 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:07.635 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:07.635 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.635 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:07.635 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:07.635 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.635 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:07.635 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:07.635 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.636 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:07.636 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:07.636 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:07.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.636 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:07.636 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:07.636 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:07.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.636 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.636 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:07.636 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:07.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.637 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.637 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:07.637 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:07.637 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:07.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.637 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.637 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:07.637 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:07.637 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:07.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.637 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.638 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:07.638 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:07.638 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:07.638 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.638 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:07.638 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.638 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.638 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.638 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:07.638 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:07.638 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.549172999, 2024-04-26T10:43:07.638 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:07.638 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:07.638 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:07.639 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:07.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.639 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:07.639 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:07.639 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.639 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:07.639 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:07.639 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.640 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:07.640 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:07.640 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.640 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.640 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.640 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:07.640 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:07.640 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:07.640 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.640 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.640 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:07.640 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:07.640 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:07.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.641 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.641 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.641 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:07.641 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:07.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.641 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.641 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:07.641 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:07.641 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:07.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.641 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.642 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:07.642 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:07.642 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:07.642 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.642 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.642 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:07.642 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:07.642 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:07.642 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.642 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:07.642 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.643 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:07.643 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:07.643 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.546396248000001, 2024-04-26T10:43:07.643 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:07.643 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:07.643 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:07.643 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:07.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.643 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:07.643 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:07.643 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.644 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:07.644 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:07.644 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.644 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.644 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:07.644 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:07.644 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.645 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:07.645 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:07.645 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:07.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.645 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:07.645 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:07.645 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:07.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.645 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.646 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:07.646 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:07.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.646 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:07.646 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:07.646 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:07.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.646 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:07.646 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:07.646 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:07.646 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.647 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:07.647 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.647 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:07.647 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:07.647 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.546346159000002, 2024-04-26T10:43:07.647 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:07.647 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:07.647 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.647 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:07.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.648 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:07.648 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:07.648 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.648 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:07.648 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:07.648 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.648 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:07.648 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:07.648 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.649 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:07.649 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:07.649 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:07.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.649 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:07.649 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:07.649 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:07.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.649 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.649 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:07.649 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:07.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.650 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:07.650 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:07.650 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:07.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.650 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:07.650 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:07.650 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:07.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.650 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:07.651 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:07.651 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:07.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.651 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.651 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:07.651 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:07.651 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:07.651 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.651 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:07.651 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.651 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.651 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:07.651 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:07.652 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.54545409, 2024-04-26T10:43:07.652 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:07.652 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:07.652 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.652 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:07.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.652 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:07.652 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:07.652 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.652 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:07.652 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:07.652 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.653 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:07.653 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:07.653 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.653 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:07.653 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:07.653 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:07.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.653 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:07.653 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:07.653 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:07.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.654 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.654 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:07.654 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:07.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.654 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:07.654 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:07.654 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:07.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.654 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:07.654 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:07.654 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.655 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.543265761000001, 2024-04-26T10:43:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:07.656 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.658 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.543130390999998, 2024-04-26T10:43:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:07.661 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.662 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.664 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.542915817000001, 2024-04-26T10:43:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:07.665 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.667 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:07.667 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:07.667 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.667 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:07.667 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:07.667 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:07.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.667 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:07.667 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:07.668 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:07.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.668 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.668 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:07.668 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:07.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.668 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:07.668 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:07.668 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:07.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.669 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:07.669 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:07.669 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:07.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.669 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:07.669 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:07.669 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:07.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.669 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:07.669 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:07.669 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:07.670 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.670 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:07.670 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.670 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:07.670 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:07.670 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.542576875999998, 2024-04-26T10:43:07.670 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:07.670 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:07.670 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.670 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:07.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.671 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:07.671 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:07.671 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.671 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:07.671 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:07.671 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.671 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:07.671 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:07.671 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.672 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:07.672 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:07.672 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:07.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.672 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:07.672 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:07.672 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:07.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.672 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.673 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:07.673 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:07.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.673 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:07.673 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:07.673 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:07.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.673 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:07.673 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:07.673 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:07.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.674 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:07.674 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:07.674 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:07.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.674 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:07.674 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:07.674 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:07.674 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.674 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:07.675 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.675 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:07.675 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:07.675 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.542467498999997, 2024-04-26T10:43:07.675 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:07.675 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:07.675 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:07.675 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:07.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.675 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:07.675 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:07.676 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.676 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:07.676 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:07.676 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.676 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:07.676 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:07.676 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:07.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.677 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:07.677 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:07.677 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:07.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.677 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:07.677 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:07.677 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:07.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.677 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.677 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:07.677 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:07.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.678 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:07.678 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:07.678 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:07.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.678 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:07.678 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:07.678 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:07.678 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.678 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:07.679 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.679 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:07.679 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:07.679 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.542427779999997, 2024-04-26T10:43:07.679 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:07.679 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:07.679 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.679 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:07.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.680 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:07.680 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:07.680 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.680 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:07.680 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:07.680 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.680 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:07.680 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:07.680 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:07.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.681 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:07.681 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:07.681 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:07.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.681 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:07.681 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:07.681 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:07.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.682 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.682 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:07.682 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:07.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.682 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:07.682 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:07.682 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:07.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.682 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:07.682 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:07.682 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:07.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.683 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:07.683 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:07.683 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:07.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.683 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:07.683 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:07.683 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:07.683 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.683 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:07.683 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.684 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:07.684 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:07.684 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.542090246999997, 2024-04-26T10:43:07.684 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:07.684 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:07.684 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:07.684 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:07.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.684 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:07.684 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:07.684 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.685 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:07.685 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:07.685 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:07.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.685 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:07.685 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:07.685 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:07.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.685 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:07.685 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:07.686 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:07.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.686 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:07.686 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:07.686 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:07.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.686 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:07.686 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:07.686 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:07.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.687 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:07.687 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:07.687 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:07.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.687 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:07.687 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:07.687 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:07.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.687 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:07.687 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:07.687 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:07.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:07.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:07.688 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:07.688 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:07.688 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:07.688 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.688 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:07.688 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.688 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:07.688 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:07.688 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:07.690 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:07.690 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:07.688+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:07.781 INFO:teuthology.orchestra.run.smithi049.stderr:nodeep-scrub is unset 2024-04-26T10:43:07.790 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:07.789+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:07.793 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:43:07.797 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:07.797 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:07.797 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:07.797 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:07.805 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:07.892 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:07.890+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:07.919 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:07.919 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:07.937 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1: {} 2024-04-26T10:43:07.937 INFO:teuthology.orchestra.run.smithi049.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:43:07.947 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:07.947 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:07.947 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:07.947 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:07.947 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:07.954 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:07.954 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:07.956 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:07.992 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:07.991+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:08.093 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:08.091+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:08.098 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:08.098 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:08.108 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:08.193 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:08.193+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:08.223 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:08.223 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:08.233 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:08.296 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:08.295+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:08.338 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:08.339 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:08.348 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:08.396 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:08.395+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:08.454 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:08.454 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:08.464 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:08.497 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:08.495+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:08.566 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:08.566 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:08.575 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:08.619 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:08.618+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:08.677 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:08.677 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:08.686 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:08.727 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:08.726+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:08.800 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:08.798+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:08.828 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:08.828 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:08.838 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:08.901 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:08.900+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:08.948 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:08.948 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:08.957 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:09.002 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:09.001+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:09.063 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:09.063 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:09.072 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:09.103 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:09.101+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:09.177 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:09.177 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:09.187 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:09.204 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:09.202+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:09.289 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:09.289 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:09.298 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:09.304 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:09.303+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:09.399 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:09.399 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:09.405 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:09.404+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:09.408 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:09.506 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:09.504+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:09.509 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:09.509 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:09.518 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:09.607 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:09.606+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:09.626 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:09.627 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:09.635 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:09.708 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:09.706+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:09.741 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:09.741 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:09.749 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:09.797 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:43:09.834 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:09.832+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:09.896 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:09.896 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:09.905 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:09.946 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:09.944+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:09.965 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:43:10.007 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:10.007 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:10.012 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:10.010+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:10.015 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:10.089 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:10.089 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:10.107 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1: {} 2024-04-26T10:43:10.108 INFO:teuthology.orchestra.run.smithi049.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:43:10.115 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:10.113+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:10.124 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:10.124 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:10.158 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:10.158 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:10.158 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:10.158 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:10.158 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:10.167 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:10.252 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:10.251+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:10.310 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:10.310 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:10.311 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:10.311 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:10.311 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.311 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:10.311 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:10.311 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 44.271946399999997, 2024-04-26T10:43:10.311 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:10.311 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:10.311 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.311 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:10.311 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.311 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:10.311 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:10.311 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.312 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.312 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.312 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:10.312 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:10.312 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.312 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.312 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.312 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:10.312 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:10.312 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.312 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.312 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.312 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:10.312 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:10.313 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:10.313 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.313 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.313 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:10.313 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:10.313 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:10.313 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.313 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.313 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.313 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:10.313 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:10.313 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.313 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.313 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:10.314 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:10.314 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:10.314 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.314 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.314 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:10.314 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:10.314 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:10.314 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.314 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.314 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:10.314 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:10.314 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:10.315 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.315 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.315 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:10.315 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:10.315 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:10.315 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.315 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:10.315 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.316 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.316 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.316 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:10.316 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:10.316 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 44.271075619999998, 2024-04-26T10:43:10.316 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:10.316 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:10.316 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.317 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:10.317 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.317 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:10.317 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:10.317 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.317 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.318 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.318 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:10.318 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:10.318 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.318 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.318 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.319 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:10.319 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:10.319 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.319 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.319 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.319 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:10.320 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:10.320 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:10.320 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.320 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.320 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:10.320 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:10.320 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:10.320 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.321 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.321 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.321 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:10.321 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:10.321 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.321 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.321 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:10.321 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:10.322 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:10.322 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.322 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.322 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:10.322 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:10.322 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:10.322 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.323 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.323 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:10.323 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:10.323 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:10.323 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.323 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.324 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:10.324 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:10.324 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:10.324 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.324 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:10.324 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.325 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.325 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.325 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:10.325 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:10.325 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 44.270088276999999, 2024-04-26T10:43:10.325 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:10.325 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:10.325 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.326 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:10.326 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.326 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:10.326 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:10.326 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.326 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.326 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.326 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:10.326 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:10.326 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.326 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.326 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.326 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:10.327 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:10.327 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:10.327 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.327 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.327 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:10.327 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:10.327 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:10.327 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.327 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.327 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:10.327 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:10.327 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:10.327 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.327 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.328 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.328 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:10.328 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:10.328 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.328 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.328 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:10.328 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:10.328 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:10.328 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.328 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.328 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:10.328 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:10.328 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:10.328 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.328 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.329 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:10.329 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:10.329 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:10.329 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.329 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.329 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:10.329 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:10.329 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:10.329 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.329 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:10.329 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.329 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.329 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.329 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:10.330 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:10.330 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 44.269883012000001, 2024-04-26T10:43:10.330 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:10.330 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:10.330 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.330 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:10.330 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.330 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:10.330 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:10.330 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.330 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.330 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.331 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:10.331 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:10.331 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.331 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.331 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.331 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:10.331 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:10.331 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.331 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.331 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.331 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:10.331 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:10.331 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:10.332 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.332 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.332 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:10.332 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:10.332 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:10.332 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.332 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.332 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.332 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:10.332 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:10.333 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.333 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.333 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:10.333 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:10.333 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:10.333 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.333 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.333 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:10.333 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:10.333 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:10.333 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.333 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.333 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:10.333 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:10.334 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:10.334 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.334 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.334 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:10.334 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:10.334 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:10.334 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.334 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:10.334 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.334 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.334 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.334 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:10.334 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:10.335 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 44.269562133000001, 2024-04-26T10:43:10.335 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:10.335 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:10.335 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.335 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:10.335 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.335 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:10.335 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:10.335 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.335 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.335 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.335 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:10.335 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:10.335 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.336 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.336 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.336 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:10.336 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:10.336 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:10.336 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.336 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.336 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:10.336 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:10.336 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:10.336 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.336 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.336 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:10.336 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:10.336 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:10.337 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.337 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.337 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.337 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:10.337 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:10.337 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.337 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.337 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:10.337 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:10.337 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:10.337 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.337 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.337 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:10.337 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:10.338 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:10.338 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.338 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.338 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:10.338 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:10.338 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:10.338 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.338 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.338 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:10.338 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:10.338 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:10.338 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.339 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.339 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:10.339 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:10.339 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:10.339 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.339 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.339 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:10.339 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:10.339 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:10.339 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.339 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.339 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:10.339 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:10.339 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:10.339 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.340 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:10.340 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.340 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.340 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.340 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:10.340 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:10.340 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 44.269510308999998, 2024-04-26T10:43:10.340 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:10.340 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:10.340 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.340 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:10.341 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.341 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:10.341 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:10.341 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.341 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.341 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.341 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:10.341 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:10.341 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.341 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.341 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.341 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:10.341 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:10.341 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.342 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.342 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.342 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:10.342 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:10.342 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:10.342 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.342 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.342 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:10.342 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:10.342 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:10.343 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.343 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.343 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.343 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:10.343 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:10.343 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.343 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.343 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:10.343 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:10.343 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:10.344 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.344 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.344 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:10.344 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:10.344 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:10.344 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.344 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.344 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:10.344 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:10.344 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:10.344 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.344 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.344 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:10.345 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:10.345 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:10.345 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.345 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.345 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:10.345 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:10.345 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:10.345 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.345 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.345 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:10.346 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:10.346 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:10.346 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.346 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.346 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:10.346 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:10.347 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:10.347 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.347 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:10.347 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.347 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.347 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.348 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:10.348 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:10.348 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 44.269456937000001, 2024-04-26T10:43:10.348 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:10.348 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:10.348 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.349 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:10.349 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.349 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:10.349 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:10.349 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.349 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.349 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.350 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:10.350 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:10.350 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.350 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.350 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.350 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:10.350 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:10.350 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.351 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.351 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.351 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:10.351 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:10.351 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:10.351 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.351 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.351 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:10.352 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:10.352 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:10.352 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.352 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.352 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.352 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:10.352 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:10.352 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.353 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.353 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:10.353 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:10.353 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:10.353 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.353 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.353 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:10.353 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:10.353 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:10.354 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.354 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.354 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:10.354 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:10.354 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:10.354 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.354 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.355 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:10.355 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:10.355 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:10.355 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.355 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.355 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:10.355 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:10.355 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:10.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.356 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.356 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:10.356 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:10.356 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:10.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.356 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.356 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:10.356 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:10.356 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:10.357 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.357 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:10.357 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.357 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.357 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.357 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:10.357 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:10.357 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 44.269412610000003, 2024-04-26T10:43:10.357 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:10.357 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:10.357 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.357 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:10.358 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.358 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:10.358 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:10.358 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.358 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.358 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.358 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:10.358 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:10.358 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.358 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.358 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.358 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:10.358 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:10.358 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:10.359 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.359 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.359 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:10.359 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:10.359 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:10.359 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.359 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.359 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:10.359 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:10.359 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:10.359 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.359 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.359 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.359 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:10.360 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:10.360 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.360 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:10.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:10.360 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:10.360 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.360 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:10.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:10.360 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:10.360 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.360 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:10.361 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:10.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:10.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.361 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.361 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:10.361 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:10.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:10.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.361 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.361 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:10.361 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:10.362 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:10.362 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.363 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.363 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:10.363 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:10.363 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:10.363 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.363 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.363 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:10.363 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:10.363 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:10.363 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.363 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:10.363 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.363 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.364 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.364 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:10.364 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:10.364 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 44.269388896999999, 2024-04-26T10:43:10.364 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:10.364 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:10.364 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.364 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:10.364 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.364 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:10.364 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:10.364 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.364 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.365 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.365 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:10.365 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:10.365 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.365 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.365 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.365 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:10.365 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:10.365 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.365 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.365 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.365 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:10.365 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:10.366 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:10.366 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.366 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.366 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:10.366 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:10.366 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:10.366 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.366 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.366 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.366 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:10.366 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:10.366 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.366 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.367 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:10.367 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:10.367 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:10.367 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.367 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.367 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:10.367 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:10.367 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:10.367 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.367 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.367 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:10.367 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:10.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:10.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.368 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:10.368 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:10.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:10.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:10.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:10.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:10.369 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.369 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:10.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:10.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:10.370 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.370 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.370 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:10.370 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:10.370 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:10.370 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.370 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:10.370 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.370 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.370 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.370 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:10.370 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:10.370 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 44.269354591999999, 2024-04-26T10:43:10.371 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:10.371 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:10.371 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.371 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:10.371 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.371 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:10.371 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:10.371 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.371 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.371 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.371 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:10.371 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:10.371 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.371 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.372 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.372 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:10.372 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:10.372 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.372 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.372 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.372 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:10.372 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:10.372 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:10.372 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.372 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.372 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:10.372 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:10.373 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:10.373 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.373 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.373 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.373 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:10.373 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:10.373 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.373 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.374 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:10.374 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:10.374 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:10.374 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.374 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.374 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:10.374 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:10.374 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:10.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.375 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.375 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:10.375 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:10.375 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:10.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.375 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.376 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:10.376 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:10.376 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:10.376 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.376 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.376 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:10.377 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:10.377 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:10.377 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.377 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.377 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:10.377 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:10.377 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:10.378 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.378 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.378 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:10.378 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:10.378 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:10.378 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.378 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:10.379 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.379 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.379 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.379 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:10.379 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:10.379 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 44.269017996000002, 2024-04-26T10:43:10.379 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:10.379 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:10.380 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:10.380 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:10.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:10.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:10.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.380 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:10.381 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:10.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:10.382 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:10.382 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:10.382 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.382 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.382 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:10.382 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:10.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:10.383 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.383 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:10.383 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:10.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:10.383 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.384 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:10.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:10.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.384 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:10.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:10.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:10.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.384 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:10.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:10.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:10.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:10.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:10.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:10.385 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.385 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:10.385 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.385 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:10.386 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:10.386 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 44.268975967999999, 2024-04-26T10:43:10.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:10.386 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:10.386 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:10.387 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:10.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:10.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:10.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:10.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:10.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.388 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:10.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:10.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.389 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:10.389 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:10.389 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:10.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.389 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.390 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:10.390 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:10.390 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:10.390 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.390 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.390 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:10.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:10.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:10.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:10.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:10.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:10.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:10.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:10.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:10.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:10.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:10.392 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.392 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:10.392 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.393 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:10.393 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:10.393 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 44.268922795999998, 2024-04-26T10:43:10.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:10.393 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:10.393 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:10.393 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:10.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:10.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:10.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:10.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:10.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:10.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:10.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:10.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:10.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:10.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:10.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:10.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:10.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.397 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:10.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:10.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.397 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:10.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:10.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:10.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:10.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:10.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:10.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:10.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:10.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:10.400 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.400 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:10.400 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.401 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:10.401 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:10.401 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 44.265516386000002, 2024-04-26T10:43:10.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:10.401 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:10.402 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:10.402 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:10.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:10.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:10.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:10.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:10.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:10.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:10.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:10.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:10.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:10.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:10.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:10.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:10.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:10.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:10.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:10.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:10.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:10.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:10.406 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:10.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:10.406 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.406 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:10.406 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.406 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.407 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:10.407 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:10.407 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 44.263044432999997, 2024-04-26T10:43:10.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:10.407 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:10.408 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:10.408 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:10.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:10.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:10.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:10.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:10.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.410 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.410 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:10.410 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:10.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:10.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:10.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:10.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:10.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:10.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:10.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:10.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:10.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:10.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:10.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:10.414 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.414 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:10.414 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:10.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:10.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:10.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:10.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:10.415 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.416 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:10.416 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.416 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:10.416 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:10.417 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 44.262390875000001, 2024-04-26T10:43:10.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:10.417 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:10.417 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:10.417 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:10.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:10.418 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:10.418 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.418 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.418 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.418 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:10.418 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:10.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.419 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:10.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:10.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:10.420 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:10.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:10.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:10.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:10.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:10.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.422 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:10.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:10.422 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.422 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.422 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:10.422 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:10.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:10.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:10.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:10.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:10.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:10.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:10.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:10.425 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.425 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:10.425 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.425 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:10.426 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:10.426 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 44.262315090000001, 2024-04-26T10:43:10.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:10.426 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:10.426 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:10.426 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:10.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:10.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:10.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:10.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:10.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.427 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:10.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:10.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.427 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:10.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:10.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:10.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:10.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:10.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:10.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:10.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:10.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:10.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:10.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:10.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.429 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:10.429 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:10.429 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:10.429 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.429 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:10.429 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:10.429 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:10.429 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.429 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:10.429 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.429 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.430 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:10.430 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:10.430 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 44.262101395999998, 2024-04-26T10:43:10.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:10.430 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:10.430 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:10.430 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:10.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:10.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:10.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:10.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:10.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:10.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:10.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:10.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:10.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:10.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.432 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:10.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:10.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:10.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.432 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:10.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:10.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.432 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:10.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:10.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:10.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.433 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:10.433 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:10.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:10.433 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.433 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:10.433 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.433 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.433 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:10.433 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:10.433 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 44.259657582999999, 2024-04-26T10:43:10.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:10.433 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:10.433 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:10.434 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:10.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.434 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:10.434 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:10.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.434 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.434 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:10.434 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:10.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.434 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.434 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:10.434 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:10.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:10.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:10.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:10.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:10.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:10.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:10.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:10.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:10.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:10.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:10.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:10.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:10.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:10.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:10.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:10.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.437 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:10.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:10.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:10.437 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.437 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:10.437 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.437 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.437 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:10.437 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:10.437 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 38.809595139000002, 2024-04-26T10:43:10.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:10.437 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:10.437 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.438 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:10.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.438 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:10.438 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:10.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.438 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.438 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:10.438 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:10.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:10.438 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.438 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:10.438 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:10.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:10.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:10.439 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:10.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:10.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:10.439 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:10.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:10.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.440 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:10.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:10.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:10.440 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:10.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:10.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:10.440 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:10.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:10.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:10.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:10.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:10.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:10.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:10.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:10.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:10.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:10.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:10.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.442 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:10.442 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:10.442 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:10.442 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:10.442 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:10.442 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:10.442 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:10.442 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:10.442 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.442 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:10.442 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.442 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:10.442 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:10.442 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:10.444 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:10.443+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:10.445 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:10.545 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:10.543+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:10.553 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:10.553 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:10.553 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:10.553 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:10.562 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:10.647 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:10.646+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:10.708 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:10.708 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:10.708 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:10.708 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:10.708 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:10.717 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:10.748 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:10.747+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:10.785 INFO:teuthology.orchestra.run.smithi049.stderr:noscrub is set 2024-04-26T10:43:10.827 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:10.827 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:10.827 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:10.827 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:10.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.828 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:10.828 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:10.828 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 44.789499202000002, 2024-04-26T10:43:10.828 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:10.828 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:10.828 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.828 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:10.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.828 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:10.828 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:10.828 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.828 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:10.829 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:10.829 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.829 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:10.829 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:10.829 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.829 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:10.829 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:10.829 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:10.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.830 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:10.830 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:10.830 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:10.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.830 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.830 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:10.830 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:10.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.830 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:10.830 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:10.830 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:10.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.831 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:10.831 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:10.831 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:10.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.831 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:10.831 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:10.831 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:10.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.831 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:10.831 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:10.831 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:10.831 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.832 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:10.832 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.832 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:10.832 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:10.832 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 44.787749081000001, 2024-04-26T10:43:10.832 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:10.832 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:10.832 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.832 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:10.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.832 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:10.833 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:10.833 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.833 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:10.833 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:10.833 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.833 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:10.833 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:10.833 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:10.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.833 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:10.834 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:10.834 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:10.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.834 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:10.834 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:10.834 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:10.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.834 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.834 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:10.834 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:10.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.835 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:10.835 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:10.835 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:10.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.835 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:10.835 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:10.835 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:10.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.835 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:10.835 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:10.835 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:10.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.836 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:10.836 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:10.836 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:10.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.836 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:10.836 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:10.836 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:10.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.836 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:10.836 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:10.836 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:10.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.837 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.837 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:10.837 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:10.837 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:10.837 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.837 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:10.837 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.837 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.837 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:10.837 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:10.837 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 44.787696083, 2024-04-26T10:43:10.837 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:10.837 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:10.838 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.838 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:10.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.838 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:10.838 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:10.838 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.838 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:10.838 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:10.838 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.839 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:10.839 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:10.839 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.839 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:10.839 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:10.839 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:10.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.839 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:10.839 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:10.839 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:10.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.840 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.840 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:10.840 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:10.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.840 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:10.840 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:10.840 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:10.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.840 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:10.840 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:10.840 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:10.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.841 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:10.841 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:10.841 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:10.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.841 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:10.841 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:10.841 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:10.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.841 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:10.841 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:10.842 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:10.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.842 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:10.842 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:10.842 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:10.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.842 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:10.842 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:10.842 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:10.842 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.842 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:10.842 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.843 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:10.843 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:10.843 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 44.787618338999998, 2024-04-26T10:43:10.843 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:10.843 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:10.843 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.843 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:10.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.843 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:10.843 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:10.843 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.844 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:10.844 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:10.844 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.844 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:10.844 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:10.844 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:10.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.844 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:10.844 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:10.844 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:10.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.845 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:10.845 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:10.845 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:10.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.845 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.845 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:10.845 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:10.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.845 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:10.845 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:10.845 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:10.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.846 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:10.846 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:10.846 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:10.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.846 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:10.846 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:10.846 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:10.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.847 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:10.847 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:10.847 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:10.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.847 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:10.847 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:10.847 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:10.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.847 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:10.847 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:10.847 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:10.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.848 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:10.848 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:10.848 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:10.848 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.848 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:10.848 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.848 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:10.848 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:10.848 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 44.787579332999996, 2024-04-26T10:43:10.848 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:10.848 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:10.848 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.849 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:10.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.849 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:10.849 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:10.849 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.849 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:10.849 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:10.849 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.849 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:10.849 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:10.850 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:10.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.850 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:10.850 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:10.850 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:10.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.850 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:10.850 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:10.850 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:10.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.850 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.851 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:10.851 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:10.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.851 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:10.851 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:10.851 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:10.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.851 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:10.851 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:10.851 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:10.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.851 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:10.852 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:10.852 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:10.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.852 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:10.852 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:10.852 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:10.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.852 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:10.852 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:10.852 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:10.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.853 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:10.853 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:10.853 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:10.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.853 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:10.853 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:10.853 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:10.853 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.853 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:10.853 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.853 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:10.853 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:10.854 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 44.787560511999999, 2024-04-26T10:43:10.854 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:10.854 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:10.854 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.854 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:10.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.854 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:10.854 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:10.854 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.854 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:10.854 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:10.855 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.855 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:10.855 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:10.855 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:10.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.855 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:10.855 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:10.855 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:10.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.855 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:10.855 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:10.856 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:10.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.856 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.856 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:10.856 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:10.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.856 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:10.856 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:10.856 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:10.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.856 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:10.856 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:10.857 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:10.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.857 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:10.857 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:10.857 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:10.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.857 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:10.857 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:10.857 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:10.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.857 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:10.858 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:10.858 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:10.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.858 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:10.858 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:10.858 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:10.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.858 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:10.858 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:10.858 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:10.858 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.858 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:10.859 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.859 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:10.859 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:10.859 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 44.787528510000001, 2024-04-26T10:43:10.859 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:10.859 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:10.859 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.859 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:10.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.859 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:10.859 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:10.859 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.860 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:10.860 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:10.860 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.860 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:10.860 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:10.860 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.860 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:10.860 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:10.860 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:10.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.861 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:10.861 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:10.861 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:10.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.861 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.861 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:10.861 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:10.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.861 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:10.861 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:10.862 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:10.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.862 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:10.862 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:10.862 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:10.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.862 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:10.862 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:10.862 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:10.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.862 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:10.863 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:10.863 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:10.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.863 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:10.863 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:10.863 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:10.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.863 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:10.863 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:10.863 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:10.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.863 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:10.864 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:10.864 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:10.864 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.864 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:10.864 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.864 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:10.864 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:10.864 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 44.787319701999998, 2024-04-26T10:43:10.864 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:10.864 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:10.864 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.864 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:10.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.865 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:10.865 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:10.865 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.865 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:10.865 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:10.865 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.865 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:10.865 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:10.865 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:10.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.866 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:10.866 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:10.866 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:10.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.866 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:10.866 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:10.866 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:10.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.866 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.866 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:10.866 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:10.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.867 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:10.867 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:10.867 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:10.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.867 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:10.867 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:10.867 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:10.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.867 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:10.867 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:10.868 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:10.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.868 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:10.868 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:10.868 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:10.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.868 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:10.868 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:10.868 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:10.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.869 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:10.869 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:10.869 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:10.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.869 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:10.869 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:10.869 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:10.869 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.869 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:10.869 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.869 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:10.869 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:10.870 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 44.787288410999999, 2024-04-26T10:43:10.870 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:10.870 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:10.870 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:10.870 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:10.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.870 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:10.870 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:10.870 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.870 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:10.870 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:10.871 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.871 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:10.871 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:10.871 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.871 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:10.871 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:10.871 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:10.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.871 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:10.871 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:10.872 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:10.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.872 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.872 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:10.872 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:10.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.872 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:10.872 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:10.872 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:10.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.872 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:10.872 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:10.873 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:10.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.873 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:10.873 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:10.873 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:10.873 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.873 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:10.873 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.873 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:10.873 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:10.873 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 44.787261161000004, 2024-04-26T10:43:10.874 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:10.874 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:10.874 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:10.874 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:10.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.874 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:10.874 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:10.874 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.874 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:10.874 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:10.874 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:10.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:10.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:10.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:10.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:10.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:10.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:10.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:10.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.876 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.876 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:10.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:10.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.876 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:10.876 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:10.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:10.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.876 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:10.876 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:10.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:10.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.877 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:10.877 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:10.877 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:10.877 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.877 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:10.877 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.877 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:10.877 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:10.877 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 44.784484409999997, 2024-04-26T10:43:10.877 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:10.877 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:10.878 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:10.878 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:10.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.878 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:10.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:10.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.878 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:10.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:10.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.878 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:10.879 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:10.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:10.879 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:10.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:10.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:10.879 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:10.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:10.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.880 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.880 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:10.880 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:10.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.880 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:10.880 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:10.880 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:10.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.880 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:10.880 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:10.880 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:10.880 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.880 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:10.881 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.881 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:10.881 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:10.881 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 44.784434320999999, 2024-04-26T10:43:10.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:10.881 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:10.881 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.881 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:10.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:10.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:10.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.882 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:10.882 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:10.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.882 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:10.882 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:10.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.882 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:10.882 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:10.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:10.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:10.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:10.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:10.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:10.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:10.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:10.884 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:10.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:10.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.884 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:10.884 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:10.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:10.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.884 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:10.884 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:10.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:10.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.884 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:10.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:10.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:10.885 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.885 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:10.885 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.885 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:10.885 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:10.885 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 44.783542251999997, 2024-04-26T10:43:10.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:10.885 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:10.885 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.885 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:10.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:10.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:10.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:10.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:10.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:10.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:10.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:10.887 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:10.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:10.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:10.887 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:10.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:10.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:10.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:10.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:10.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:10.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:10.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:10.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:10.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:10.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.889 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:10.889 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:10.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:10.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.889 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:10.889 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:10.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:10.889 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.889 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:10.889 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.890 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:10.890 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:10.890 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 44.781353922999998, 2024-04-26T10:43:10.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:10.890 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:10.890 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.890 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:10.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:10.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:10.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:10.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:10.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:10.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:10.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:10.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:10.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:10.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:10.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:10.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:10.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:10.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:10.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:10.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:10.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:10.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:10.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:10.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:10.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:10.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:10.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:10.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:10.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:10.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:10.894 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.894 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:10.894 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.894 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:10.894 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:10.894 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 44.781218553000002, 2024-04-26T10:43:10.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:10.894 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:10.894 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.894 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:10.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:10.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:10.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:10.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:10.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:10.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:10.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:10.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:10.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:10.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:10.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:10.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:10.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:10.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:10.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:10.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:10.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:10.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:10.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:10.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:10.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:10.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:10.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:10.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:10.898 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:10.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:10.898 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.898 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:10.898 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.898 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:10.898 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:10.898 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 44.781003978999998, 2024-04-26T10:43:10.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:10.898 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:10.899 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.899 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:10.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:10.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:10.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:10.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:10.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:10.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:10.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:10.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:10.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:10.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:10.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:10.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:10.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:10.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:10.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:10.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:10.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:10.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:10.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:10.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:10.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:10.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:10.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:10.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:10.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:10.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:10.903 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.903 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:10.903 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.903 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:10.903 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:10.903 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 44.780665038000002, 2024-04-26T10:43:10.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:10.903 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:10.903 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.903 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:10.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:10.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:10.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:10.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:10.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:10.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:10.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:10.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:10.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:10.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:10.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:10.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:10.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:10.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:10.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:10.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:10.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:10.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:10.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:10.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:10.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:10.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:10.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:10.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:10.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:10.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:10.907 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.907 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:10.907 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.907 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:10.907 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:10.908 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 44.780555661000001, 2024-04-26T10:43:10.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:10.908 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:10.908 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:10.908 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:10.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:10.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:10.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:10.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:10.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:10.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:10.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:10.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:10.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:10.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:10.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:10.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:10.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:10.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:10.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:10.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:10.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:10.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:10.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:10.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:10.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:10.911 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.911 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:10.911 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.911 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:10.911 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:10.911 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 44.780515942000001, 2024-04-26T10:43:10.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:10.911 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:10.911 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.911 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:10.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:10.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:10.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:10.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:10.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:10.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:10.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:10.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:10.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:10.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:10.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:10.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:10.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:10.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:10.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:10.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:10.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:10.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:10.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:10.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:10.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:10.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:10.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:10.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:10.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:10.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:10.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:10.915 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.915 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:10.915 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.915 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:10.916 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:10.916 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 44.780178409000001, 2024-04-26T10:43:10.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:10.916 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:10.916 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:10.916 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:10.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:10.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:10.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:10.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:10.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:10.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:10.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:10.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:10.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:10.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:10.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:10.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:10.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:10.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:10.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:10.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:10.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:10.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:10.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:10.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:10.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:10.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:10.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:10.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:10.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:10.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:10.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:10.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:10.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:10.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:10.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:10.919 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.919 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:10.920 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.920 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:10.920 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:10.920 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:10.920 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T10:43:10.930 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:10.934 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:10.920+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:11.022 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:11.021+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:11.030 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2024-04-26T10:43:11.038 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:11.038 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:11.038 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:11.038 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:11.047 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:11.124 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:11.123+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:11.191 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:11.191 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:11.191 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:11.191 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:11.191 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:11.200 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:11.225 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:11.224+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:11.303 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:11.303 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:11.304 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:11.304 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:11.304 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.304 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:11.304 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:11.304 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 45.265001001999998, 2024-04-26T10:43:11.304 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:11.304 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:11.304 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.304 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:11.304 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.304 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:11.305 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:11.305 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.305 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.305 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.305 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:11.305 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:11.305 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.305 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.305 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.305 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:11.305 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:11.305 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.305 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.305 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.305 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:11.306 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:11.306 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:11.306 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.306 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.306 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:11.306 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:11.306 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:11.306 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.306 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.306 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.306 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:11.306 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:11.306 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.306 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.307 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:11.307 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:11.307 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:11.307 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.307 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.307 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:11.307 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:11.307 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:11.307 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.307 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.307 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:11.307 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:11.307 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:11.307 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.308 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.308 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:11.308 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:11.308 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:11.308 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.308 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:11.308 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.308 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.308 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.308 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:11.308 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:11.309 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 45.264130221999999, 2024-04-26T10:43:11.309 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:11.309 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:11.309 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.309 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:11.309 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.309 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:11.309 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:11.309 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.309 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.309 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.309 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:11.309 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:11.309 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.310 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.310 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.310 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:11.310 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:11.310 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.310 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.310 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.310 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:11.310 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:11.310 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:11.310 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.310 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.311 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:11.311 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:11.311 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:11.311 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.311 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.311 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.311 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:11.311 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:11.311 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.311 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.311 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:11.311 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:11.311 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:11.311 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.312 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.312 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:11.312 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:11.312 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:11.312 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.312 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.312 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:11.312 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:11.312 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:11.312 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.312 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.312 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:11.313 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:11.313 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:11.313 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.313 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:11.313 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.313 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.313 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.313 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:11.313 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:11.313 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 45.263142879, 2024-04-26T10:43:11.314 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:11.314 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:11.314 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.314 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:11.314 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.314 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:11.314 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:11.314 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.314 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.314 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.314 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:11.314 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:11.314 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.314 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.315 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.315 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:11.315 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:11.315 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:11.315 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.315 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.315 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:11.315 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:11.315 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:11.315 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.315 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.315 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:11.315 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:11.315 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:11.315 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.316 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.316 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.316 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:11.316 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:11.316 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.316 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.316 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:11.316 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:11.316 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:11.316 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.316 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.316 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:11.316 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:11.316 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:11.316 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.317 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.317 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:11.317 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:11.317 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:11.317 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.317 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.317 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:11.317 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:11.317 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:11.317 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.317 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:11.317 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.317 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.317 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.318 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:11.318 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:11.318 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 45.262937614000002, 2024-04-26T10:43:11.318 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:11.318 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:11.318 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.318 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:11.318 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.318 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:11.318 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:11.319 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.319 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.319 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.319 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:11.319 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:11.319 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.319 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.319 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.319 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:11.319 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:11.319 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.319 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.319 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.319 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:11.320 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:11.320 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:11.320 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.320 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.320 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:11.320 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:11.320 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:11.320 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.320 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.320 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.320 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:11.320 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:11.320 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.320 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.321 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:11.321 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:11.321 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:11.321 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.321 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.321 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:11.321 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:11.321 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:11.321 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.321 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.321 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:11.321 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:11.322 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:11.322 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.322 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.322 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:11.322 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:11.322 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:11.322 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.322 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:11.322 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.322 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.322 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.322 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:11.322 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:11.322 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 45.262616735000002, 2024-04-26T10:43:11.323 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:11.323 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:11.323 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.323 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:11.323 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.323 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:11.323 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:11.323 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.323 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.323 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.323 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:11.323 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:11.323 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.323 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.324 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.324 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:11.324 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:11.324 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:11.324 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.324 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.324 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:11.324 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:11.324 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:11.324 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.324 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.324 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:11.324 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:11.324 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:11.324 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.325 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.325 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.325 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:11.325 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:11.325 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.325 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.325 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:11.325 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:11.325 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:11.325 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.325 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.325 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:11.325 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:11.325 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:11.325 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.326 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.326 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:11.326 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:11.326 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:11.326 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.326 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.326 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:11.326 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:11.326 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:11.326 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.326 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.326 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:11.326 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:11.326 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:11.326 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.327 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.327 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:11.327 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:11.327 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:11.327 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.327 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.327 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:11.327 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:11.327 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:11.327 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.327 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:11.327 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.327 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.327 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.327 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:11.328 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:11.328 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 45.262564910999998, 2024-04-26T10:43:11.328 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:11.328 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:11.328 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.328 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:11.328 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.328 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:11.328 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:11.328 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.328 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.328 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.328 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:11.329 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:11.329 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.330 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.330 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.330 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:11.330 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:11.330 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.330 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.330 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.330 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:11.330 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:11.330 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:11.330 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.330 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.331 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:11.331 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:11.331 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:11.331 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.331 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.331 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.332 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:11.332 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:11.332 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.332 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.332 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:11.332 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:11.332 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:11.332 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.332 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.332 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:11.332 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:11.332 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:11.332 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.332 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.333 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:11.333 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:11.333 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:11.333 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.333 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.333 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:11.333 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:11.333 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:11.333 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.333 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.333 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:11.333 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:11.333 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:11.333 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.333 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.334 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:11.334 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:11.334 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:11.334 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.334 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.334 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:11.334 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:11.334 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:11.334 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.334 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:11.334 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.334 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.334 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.335 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:11.335 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:11.335 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 45.262511539000002, 2024-04-26T10:43:11.335 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:11.335 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:11.335 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.335 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:11.335 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.335 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:11.335 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:11.335 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.335 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.335 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.335 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:11.335 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:11.336 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.336 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.336 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.336 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:11.336 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:11.336 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.336 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.336 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.336 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:11.336 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:11.336 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:11.336 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.336 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.336 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:11.337 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:11.337 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:11.337 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.337 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.337 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.337 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:11.337 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:11.337 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.337 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.337 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:11.337 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:11.337 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:11.337 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.337 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.337 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:11.338 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:11.338 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:11.338 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.342 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.343 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:11.343 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:11.343 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:11.343 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.343 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.343 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:11.343 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:11.343 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:11.343 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.343 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.344 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:11.344 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:11.344 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:11.344 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.344 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.344 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:11.344 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:11.344 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:11.344 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.344 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.344 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:11.345 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:11.345 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:11.345 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.345 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:11.345 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.345 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.345 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.345 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:11.346 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:11.346 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 45.262467211999997, 2024-04-26T10:43:11.346 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:11.346 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:11.346 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.346 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:11.346 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.346 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:11.346 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:11.346 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.347 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.347 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.347 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:11.347 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:11.347 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.347 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.347 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.347 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:11.347 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:11.347 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:11.347 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.347 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.348 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:11.348 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:11.348 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:11.348 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.348 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.348 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:11.348 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:11.348 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:11.348 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.348 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.348 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.348 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:11.349 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:11.349 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.349 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.349 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:11.349 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:11.349 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:11.349 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.349 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.349 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:11.349 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:11.349 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:11.349 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.349 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.350 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:11.350 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:11.350 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:11.350 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.350 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.350 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:11.350 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:11.350 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:11.350 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.350 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.350 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:11.350 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:11.351 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:11.351 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.351 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.351 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:11.351 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:11.351 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:11.351 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.351 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.352 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:11.352 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:11.352 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:11.352 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.352 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:11.352 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.353 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.353 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.353 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:11.353 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:11.353 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 45.262443499, 2024-04-26T10:43:11.353 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:11.353 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:11.353 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.353 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:11.353 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.354 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:11.354 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:11.354 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.354 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.354 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.354 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:11.354 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:11.354 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.354 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.354 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.354 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:11.354 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:11.355 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.355 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.355 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.355 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:11.355 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:11.355 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:11.355 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.355 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.355 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:11.355 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:11.355 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:11.355 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.356 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.356 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.356 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:11.356 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:11.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.356 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.356 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:11.356 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:11.356 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:11.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.356 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.356 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:11.357 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:11.357 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:11.357 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.357 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.357 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:11.357 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:11.357 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:11.357 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.357 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.357 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:11.357 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:11.357 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:11.357 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.358 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.358 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:11.358 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:11.358 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:11.358 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.358 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.358 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:11.358 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:11.358 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:11.358 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.358 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.359 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:11.359 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:11.359 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:11.359 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.359 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:11.359 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.359 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.359 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.359 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:11.359 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:11.359 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 45.262409194, 2024-04-26T10:43:11.360 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:11.360 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:11.360 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.360 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:11.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.360 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:11.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:11.360 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.360 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.360 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:11.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:11.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.361 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.361 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:11.361 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:11.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.361 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.361 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:11.361 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:11.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:11.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.362 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.362 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:11.362 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:11.362 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:11.362 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.362 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.362 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.362 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:11.362 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:11.362 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.362 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.362 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:11.363 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:11.363 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:11.363 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.363 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.364 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:11.364 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:11.364 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:11.364 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.364 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.364 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:11.364 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:11.364 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:11.364 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.364 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.364 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:11.364 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:11.365 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:11.365 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.365 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.365 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:11.365 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:11.365 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:11.366 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.366 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.366 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:11.366 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:11.366 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:11.366 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.366 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.366 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:11.366 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:11.366 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:11.366 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.367 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:11.367 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.367 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.367 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.367 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:11.367 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:11.367 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 45.262072598000003, 2024-04-26T10:43:11.367 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:11.367 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:11.367 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:11.368 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:11.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.368 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:11.368 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:11.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.368 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:11.368 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:11.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.369 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:11.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:11.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:11.369 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.369 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:11.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:11.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:11.369 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.369 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.370 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:11.370 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:11.370 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:11.370 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.370 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.370 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.370 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:11.370 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:11.370 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.370 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.371 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:11.371 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:11.371 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:11.371 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.371 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.371 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:11.371 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:11.371 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:11.371 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.371 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.372 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:11.372 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:11.372 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:11.372 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.372 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:11.372 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.372 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.372 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.372 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:11.373 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:11.373 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 45.26203057, 2024-04-26T10:43:11.373 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:11.373 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:11.373 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:11.373 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:11.373 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.373 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:11.374 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:11.374 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.374 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.374 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.374 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:11.374 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:11.374 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.374 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.375 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.375 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:11.375 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:11.375 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.375 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.375 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:11.375 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:11.375 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:11.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.375 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.376 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:11.376 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:11.376 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:11.376 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.376 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.376 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.376 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:11.376 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:11.376 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.376 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.377 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:11.377 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:11.377 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:11.377 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.377 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.377 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:11.377 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:11.377 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:11.377 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.377 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.377 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:11.377 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:11.378 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:11.378 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.378 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:11.378 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.378 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.378 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.378 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:11.378 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:11.379 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 45.261977397999999, 2024-04-26T10:43:11.379 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:11.379 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:11.379 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:11.379 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:11.379 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.379 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:11.379 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:11.379 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.379 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.379 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.379 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:11.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:11.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.380 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:11.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:11.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.380 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:11.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:11.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:11.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:11.381 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:11.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:11.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.381 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:11.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:11.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.382 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:11.382 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:11.382 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:11.382 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.382 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.382 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:11.382 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:11.382 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:11.382 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.382 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.382 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:11.383 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:11.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:11.383 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.383 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:11.383 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.383 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.383 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:11.383 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:11.383 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 45.258570988000002, 2024-04-26T10:43:11.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:11.384 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:11.384 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:11.384 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:11.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.384 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:11.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:11.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:11.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:11.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:11.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:11.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:11.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:11.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:11.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:11.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:11.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:11.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:11.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:11.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:11.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:11.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:11.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:11.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:11.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:11.387 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.387 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:11.387 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.388 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:11.388 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:11.388 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 45.256099034999998, 2024-04-26T10:43:11.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:11.388 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:11.388 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:11.388 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:11.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.388 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:11.389 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:11.389 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.389 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.389 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:11.390 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:11.390 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.390 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.390 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.390 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:11.390 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:11.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:11.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:11.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:11.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:11.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:11.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:11.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:11.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:11.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:11.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:11.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:11.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:11.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:11.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:11.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:11.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:11.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:11.393 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.393 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:11.393 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.393 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:11.393 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:11.393 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 45.255445477000002, 2024-04-26T10:43:11.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:11.394 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:11.394 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:11.394 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:11.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:11.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:11.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:11.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:11.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:11.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:11.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:11.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:11.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:11.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:11.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:11.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:11.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:11.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:11.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:11.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:11.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:11.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:11.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:11.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:11.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.397 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:11.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:11.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:11.397 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.397 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:11.397 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.397 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:11.397 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:11.397 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 45.255369692000002, 2024-04-26T10:43:11.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:11.397 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:11.397 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:11.398 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:11.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:11.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:11.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:11.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:11.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:11.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:11.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:11.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:11.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:11.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:11.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:11.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:11.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:11.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:11.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:11.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:11.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:11.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:11.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:11.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:11.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:11.401 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:11.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:11.401 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.401 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:11.401 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.401 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:11.401 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:11.401 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 45.255155997999999, 2024-04-26T10:43:11.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:11.401 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:11.401 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:11.401 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:11.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:11.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:11.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:11.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:11.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:11.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:11.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:11.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:11.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:11.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:11.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:11.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:11.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:11.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:11.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:11.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:11.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:11.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:11.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:11.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:11.404 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.404 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:11.404 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.404 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:11.405 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:11.405 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 45.252712185, 2024-04-26T10:43:11.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:11.405 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:11.405 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:11.405 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:11.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:11.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:11.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:11.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:11.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.406 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.406 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:11.406 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:11.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:11.406 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.406 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:11.406 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:11.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:11.406 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.406 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:11.406 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:11.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:11.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.407 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.407 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:11.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:11.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.407 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:11.407 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:11.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:11.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.407 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:11.407 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:11.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:11.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:11.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:11.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:11.408 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.408 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:11.408 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.408 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:11.408 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:11.408 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 39.802649741000003, 2024-04-26T10:43:11.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:11.409 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:11.409 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.409 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:11.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:11.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:11.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:11.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:11.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:11.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:11.410 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:11.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:11.410 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.410 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:11.410 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:11.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:11.410 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.410 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:11.410 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:11.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:11.410 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:11.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:11.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:11.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:11.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:11.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:11.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:11.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:11.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:11.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:11.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:11.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:11.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:11.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:11.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:11.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:11.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:11.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:11.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:11.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:11.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:11.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:11.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:11.414 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:11.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:11.414 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.414 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:11.414 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.414 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:11.414 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:11.414 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:11.416 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:11.416 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:11.414+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:11.516 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:11.515+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:11.531 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:11.531 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:11.531 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:11.532 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:11.547 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:11.616 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:11.615+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:11.654 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:11.654 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:11.654 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:11.654 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:11.654 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:11.663 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:11.717 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:11.716+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:11.813 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:11.813 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:11.814 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:11.814 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:11.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.814 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:11.814 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:11.814 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.775804876000002, 2024-04-26T10:43:11.814 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:11.814 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:11.814 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.814 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:11.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.814 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:11.814 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:11.814 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.815 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:11.815 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:11.815 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.815 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:11.815 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:11.815 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.815 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:11.815 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:11.816 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:11.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.816 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:11.816 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:11.816 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:11.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.816 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.816 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:11.816 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:11.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.816 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:11.816 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:11.817 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:11.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.817 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:11.817 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:11.817 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:11.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.817 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:11.817 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:11.817 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:11.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.817 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:11.817 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:11.818 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:11.818 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.818 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:11.818 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.818 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:11.818 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:11.818 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.774054755000002, 2024-04-26T10:43:11.818 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:11.818 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:11.818 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.818 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:11.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.819 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:11.819 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:11.819 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.819 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:11.819 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:11.819 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.819 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:11.819 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:11.819 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:11.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.820 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:11.820 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:11.820 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:11.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.820 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:11.820 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:11.820 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:11.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.820 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.820 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:11.820 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:11.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.821 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:11.821 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:11.821 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:11.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.821 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:11.821 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:11.821 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:11.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.821 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:11.821 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:11.821 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:11.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.822 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:11.822 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:11.822 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:11.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.822 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:11.822 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:11.822 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:11.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.822 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:11.822 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:11.822 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:11.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.823 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:11.823 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:11.823 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:11.823 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.823 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:11.823 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.823 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:11.823 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:11.823 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.774001757000001, 2024-04-26T10:43:11.823 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:11.823 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:11.824 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.824 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:11.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.824 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:11.824 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:11.824 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.824 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:11.824 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:11.824 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.824 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:11.824 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:11.825 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.825 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.825 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:11.825 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:11.825 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:11.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.825 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.825 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:11.825 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:11.825 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:11.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.825 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.825 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.825 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:11.826 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:11.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.826 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:11.826 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:11.826 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:11.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.826 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:11.826 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:11.826 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:11.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.826 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:11.826 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:11.827 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:11.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.827 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:11.827 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:11.827 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:11.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.827 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:11.828 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:11.828 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:11.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.828 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:11.828 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:11.828 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:11.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.828 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:11.828 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:11.828 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:11.828 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.829 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:11.829 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.829 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:11.829 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:11.829 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.773924012999998, 2024-04-26T10:43:11.829 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:11.829 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:11.829 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.829 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:11.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.829 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:11.829 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:11.830 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.830 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:11.830 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:11.830 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.830 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:11.830 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:11.830 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:11.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.830 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:11.831 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:11.831 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:11.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.831 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:11.831 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:11.831 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:11.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.831 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.831 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:11.831 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:11.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.832 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:11.832 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:11.832 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:11.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.832 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:11.832 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:11.832 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:11.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.833 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:11.833 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:11.833 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:11.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.833 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:11.833 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:11.833 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:11.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.833 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:11.833 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:11.833 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:11.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.834 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:11.834 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:11.834 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:11.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.834 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:11.834 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:11.834 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:11.834 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.834 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:11.834 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.835 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:11.835 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:11.835 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.773885006999997, 2024-04-26T10:43:11.835 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:11.835 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:11.835 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.835 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:11.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.835 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:11.835 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:11.835 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.835 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:11.836 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:11.836 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.836 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:11.836 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:11.836 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:11.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.836 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:11.836 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:11.836 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:11.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.836 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:11.837 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:11.837 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:11.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.837 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.837 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.837 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:11.837 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:11.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.837 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.837 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:11.837 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:11.837 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:11.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.837 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.837 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:11.838 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:11.838 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:11.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.838 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:11.838 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:11.838 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:11.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.838 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:11.838 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:11.838 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:11.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.838 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:11.839 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:11.839 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:11.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.839 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:11.839 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:11.839 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:11.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.839 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:11.839 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:11.840 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:11.840 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.840 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:11.840 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.840 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:11.840 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:11.840 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.773866185999999, 2024-04-26T10:43:11.840 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:11.840 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:11.840 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.840 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:11.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.840 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:11.841 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:11.841 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.841 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:11.841 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:11.841 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.841 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:11.841 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:11.841 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:11.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.842 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:11.842 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:11.842 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:11.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.842 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:11.842 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:11.842 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:11.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.842 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.842 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:11.842 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:11.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.843 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:11.843 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:11.843 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:11.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.843 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:11.843 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:11.843 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:11.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.843 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:11.843 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:11.843 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:11.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.844 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:11.844 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:11.844 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:11.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.844 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:11.844 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:11.844 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:11.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.844 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:11.844 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:11.844 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:11.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.845 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:11.845 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:11.845 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:11.845 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.845 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:11.845 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.845 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:11.845 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:11.845 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.773834184000002, 2024-04-26T10:43:11.845 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:11.845 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:11.845 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.845 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:11.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.846 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:11.846 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:11.846 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.846 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:11.846 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:11.846 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.846 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:11.846 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:11.846 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.847 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:11.847 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:11.847 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:11.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.847 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:11.847 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:11.847 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:11.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.847 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.847 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:11.847 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:11.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.848 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:11.848 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:11.848 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:11.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.848 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:11.848 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:11.848 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:11.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.848 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:11.848 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:11.848 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:11.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.849 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:11.849 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:11.849 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:11.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.849 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:11.849 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:11.849 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:11.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.849 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:11.849 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:11.849 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:11.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.850 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:11.850 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:11.850 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:11.850 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.850 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:11.850 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.850 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:11.850 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:11.850 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.773625375999998, 2024-04-26T10:43:11.850 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:11.851 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:11.851 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.851 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:11.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.851 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:11.851 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:11.851 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.851 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:11.851 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:11.851 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.852 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:11.852 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:11.852 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:11.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.852 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:11.852 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:11.852 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:11.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.853 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:11.853 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:11.853 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:11.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.853 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.853 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:11.853 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:11.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.854 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:11.854 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:11.854 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:11.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.854 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:11.854 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:11.854 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:11.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.854 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:11.854 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:11.855 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:11.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.855 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:11.855 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:11.855 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:11.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.855 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:11.855 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:11.855 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:11.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.856 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:11.856 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:11.856 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:11.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.856 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:11.856 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:11.856 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:11.856 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.856 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:11.856 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.857 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:11.857 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:11.857 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.773594084999999, 2024-04-26T10:43:11.857 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:11.857 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:11.857 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:11.857 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:11.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.857 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:11.857 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:11.857 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.858 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:11.858 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:11.858 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.858 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:11.858 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:11.858 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.858 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:11.858 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:11.858 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:11.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.859 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:11.859 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:11.859 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:11.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.859 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.859 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:11.859 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:11.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.859 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:11.859 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:11.859 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:11.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.860 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:11.860 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:11.860 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:11.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.860 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:11.860 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:11.860 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:11.860 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.860 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:11.860 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.861 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:11.861 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:11.861 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.773566834999997, 2024-04-26T10:43:11.861 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:11.861 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:11.861 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:11.861 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:11.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.861 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:11.861 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:11.861 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.862 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:11.862 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:11.862 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.862 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:11.862 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:11.862 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.862 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:11.862 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:11.862 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:11.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.863 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:11.863 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:11.863 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:11.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.863 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.863 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:11.863 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:11.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.864 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:11.864 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:11.864 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:11.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.864 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:11.864 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:11.864 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:11.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.864 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:11.865 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:11.865 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:11.865 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.865 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:11.865 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.865 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:11.865 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:11.865 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.770790083999998, 2024-04-26T10:43:11.865 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:11.865 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:11.865 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:11.865 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:11.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.866 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:11.866 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:11.866 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.866 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:11.866 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:11.866 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.866 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:11.866 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:11.866 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.867 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:11.867 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:11.867 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:11.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.867 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:11.867 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:11.867 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:11.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.867 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.867 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:11.868 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:11.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.868 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:11.868 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:11.868 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:11.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.868 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:11.868 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:11.868 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:11.868 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.868 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:11.868 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.869 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:11.869 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:11.869 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.770739995, 2024-04-26T10:43:11.869 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:11.869 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:11.869 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.869 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:11.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.869 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:11.869 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:11.869 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.870 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:11.870 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:11.870 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.870 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:11.870 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:11.870 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.870 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:11.870 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:11.870 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:11.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.871 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:11.871 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:11.871 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:11.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.871 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.872 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:11.872 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:11.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.872 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:11.872 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:11.872 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:11.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.872 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:11.872 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:11.873 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:11.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.873 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:11.873 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:11.873 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:11.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.873 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:11.873 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:11.873 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:11.873 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.873 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:11.874 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.874 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:11.874 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:11.874 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.769847925999997, 2024-04-26T10:43:11.874 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:11.874 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:11.874 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.874 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:11.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.874 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:11.874 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:11.874 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:11.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:11.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:11.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:11.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:11.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:11.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:11.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.876 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:11.876 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:11.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:11.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.876 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.876 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:11.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:11.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.877 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:11.877 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:11.877 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:11.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.877 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:11.877 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:11.877 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:11.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.877 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:11.877 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:11.877 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:11.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.878 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:11.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:11.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:11.878 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.878 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:11.878 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.878 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:11.878 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:11.878 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.767659596999998, 2024-04-26T10:43:11.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:11.879 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:11.879 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.879 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:11.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:11.879 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:11.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:11.879 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:11.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:11.880 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:11.880 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.880 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:11.880 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:11.880 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:11.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.880 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:11.880 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:11.880 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:11.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:11.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:11.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:11.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:11.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:11.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:11.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:11.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:11.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.882 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:11.882 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:11.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:11.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.882 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:11.882 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:11.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:11.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.882 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:11.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.882 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:11.883 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:11.883 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.767524227000003, 2024-04-26T10:43:11.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:11.883 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:11.883 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.883 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:11.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:11.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:11.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:11.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:11.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.884 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:11.884 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:11.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.884 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:11.884 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:11.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:11.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.884 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:11.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:11.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:11.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:11.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:11.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:11.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:11.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:11.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:11.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:11.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:11.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:11.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:11.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:11.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:11.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:11.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:11.886 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.887 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:11.887 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.887 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:11.887 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:11.887 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.767309652999998, 2024-04-26T10:43:11.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:11.887 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:11.887 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.887 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:11.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:11.887 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:11.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:11.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:11.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:11.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:11.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:11.889 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:11.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:11.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.889 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:11.889 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:11.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:11.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.889 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.889 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:11.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:11.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.889 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:11.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:11.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:11.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:11.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:11.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:11.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:11.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:11.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:11.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:11.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:11.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:11.891 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.891 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:11.891 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.891 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:11.891 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:11.891 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.766970712000003, 2024-04-26T10:43:11.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:11.891 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:11.891 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.892 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:11.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:11.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:11.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:11.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:11.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:11.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:11.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:11.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:11.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:11.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:11.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:11.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:11.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:11.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:11.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:11.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:11.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:11.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:11.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:11.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:11.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:11.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:11.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:11.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:11.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:11.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:11.895 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.895 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:11.895 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.895 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:11.895 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:11.896 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.766861335000002, 2024-04-26T10:43:11.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:11.896 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:11.896 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:11.896 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:11.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:11.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:11.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:11.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:11.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:11.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:11.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:11.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:11.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:11.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:11.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:11.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:11.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:11.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.898 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:11.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:11.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:11.898 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:11.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:11.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:11.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:11.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:11.899 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.899 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:11.899 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.899 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:11.899 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:11.899 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.766821616000001, 2024-04-26T10:43:11.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:11.899 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:11.899 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.899 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:11.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:11.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:11.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:11.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:11.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:11.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:11.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:11.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:11.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:11.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:11.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:11.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:11.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:11.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:11.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:11.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:11.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:11.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:11.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:11.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:11.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:11.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:11.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:11.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:11.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:11.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:11.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:11.903 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.903 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:11.903 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.903 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:11.903 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:11.903 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.766484083000002, 2024-04-26T10:43:11.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:11.904 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:11.904 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:11.904 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:11.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:11.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:11.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:11.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:11.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:11.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:11.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:11.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:11.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:11.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:11.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:11.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:11.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:11.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:11.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:11.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:11.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:11.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:11.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:11.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:11.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:11.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:11.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:11.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:11.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:11.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:11.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:11.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:11.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:11.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:11.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:11.907 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.907 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:11.907 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.907 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:11.908 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:11.908 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:11.909 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:11.908+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:11.910 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:12.010 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:12.009+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:12.011 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:12.011 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:12.011 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:12.011 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:12.020 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:12.111 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:12.110+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:12.136 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:43:12.160 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:12.161 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:12.161 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:12.161 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:12.161 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:12.169 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:12.213 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:12.211+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:12.272 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:12.272 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:12.273 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:12.273 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:12.273 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.273 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:12.273 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:12.273 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 46.234103861000001, 2024-04-26T10:43:12.273 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:12.273 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:12.273 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:12.273 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:12.273 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.273 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:12.274 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:12.274 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.274 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.274 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.274 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:12.274 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:12.274 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.274 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.274 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.274 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:12.274 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:12.274 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:12.274 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.274 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.275 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:12.275 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:12.275 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:12.275 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.275 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.275 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:12.275 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:12.275 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:12.275 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.275 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.275 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:12.275 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:12.275 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:12.275 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.276 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.276 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:12.276 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:12.276 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:12.276 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.276 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.276 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:12.277 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:12.277 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:12.277 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.277 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.277 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:12.277 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:12.277 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:12.277 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.277 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.277 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:12.277 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:12.277 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:12.277 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.277 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:12.278 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.278 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.278 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.278 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:12.278 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:12.278 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 46.233233081000002, 2024-04-26T10:43:12.278 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:12.278 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:12.278 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:12.278 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:12.278 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.278 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:12.278 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:12.279 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.279 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.279 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.279 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:12.279 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:12.279 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.279 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.279 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.279 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:12.279 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:12.279 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:12.279 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.279 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.279 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:12.279 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:12.279 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:12.280 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.280 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.280 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:12.280 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:12.280 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:12.280 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.280 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.280 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:12.280 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:12.280 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:12.280 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.280 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.280 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:12.280 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:12.280 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:12.281 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.281 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.281 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:12.281 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:12.281 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:12.281 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.281 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.281 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:12.281 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:12.281 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:12.281 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.281 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.281 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:12.281 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:12.281 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:12.281 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.282 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:12.282 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.282 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.282 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.282 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:12.282 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:12.282 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 46.232245738000003, 2024-04-26T10:43:12.282 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:12.282 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:12.282 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:12.282 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:12.282 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.282 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:12.282 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:12.282 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.283 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.283 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.283 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:12.283 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:12.283 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.283 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.283 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.283 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:12.283 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:12.283 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:12.283 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.283 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.283 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:12.283 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:12.283 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:12.283 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.284 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.284 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:12.284 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:12.284 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:12.284 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.284 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.284 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:12.284 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:12.284 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:12.284 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.284 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.284 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:12.284 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:12.284 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:12.284 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.285 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.285 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:12.285 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:12.285 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:12.285 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.285 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.285 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:12.285 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:12.285 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:12.285 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.285 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.285 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:12.285 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:12.285 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:12.285 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.286 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:12.286 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.286 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.286 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.286 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:12.286 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:12.286 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 46.232040472999998, 2024-04-26T10:43:12.286 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:12.286 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:12.286 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:12.286 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:12.286 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.286 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:12.287 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:12.287 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.287 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.287 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.287 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:12.287 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:12.287 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.287 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.287 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.287 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:12.287 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:12.287 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:12.287 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.287 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.288 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:12.288 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:12.288 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:12.288 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.288 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.288 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:12.288 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:12.288 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:12.288 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.288 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.288 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:12.288 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:12.289 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:12.289 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.289 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.289 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:12.289 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:12.289 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:12.289 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.289 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.289 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:12.289 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:12.289 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:12.289 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.289 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.290 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:12.290 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:12.290 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:12.290 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.290 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.290 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:12.290 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:12.290 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:12.290 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.290 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:12.290 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.290 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.290 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.290 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:12.291 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:12.291 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 46.231719593999998, 2024-04-26T10:43:12.291 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:12.291 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:12.291 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:12.291 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:12.291 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.291 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:12.291 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:12.291 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.291 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.291 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.291 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:12.291 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:12.292 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.292 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.292 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.292 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:12.292 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:12.292 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:12.292 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.292 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.292 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:12.292 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:12.292 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:12.292 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.292 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.292 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:12.292 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:12.293 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:12.293 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.293 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.293 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:12.293 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:12.293 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:12.293 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.293 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.293 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:12.293 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:12.293 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:12.293 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.293 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.293 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:12.294 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:12.294 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:12.294 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.294 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.294 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:12.294 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:12.294 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:12.294 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.294 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.294 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:12.294 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:12.294 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:12.294 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.294 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.294 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:12.295 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:12.295 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:12.295 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.295 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.295 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:12.295 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:12.295 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:12.295 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.295 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.295 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:12.295 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:12.295 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:12.295 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.296 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:12.296 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.296 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.296 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.296 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:12.296 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:12.296 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 46.231667770000001, 2024-04-26T10:43:12.296 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:12.296 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:12.296 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:12.296 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:12.296 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.296 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:12.296 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:12.296 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.297 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.297 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.297 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:12.297 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:12.297 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.297 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.297 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.297 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:12.297 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:12.297 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:12.297 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.297 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.297 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:12.297 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:12.297 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:12.298 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.298 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.298 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:12.298 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:12.298 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:12.298 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.298 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.298 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:12.298 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:12.298 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:12.298 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.298 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.298 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:12.298 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:12.299 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:12.299 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.299 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.299 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:12.299 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:12.299 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:12.299 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.299 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.299 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:12.299 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:12.299 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:12.299 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.299 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.299 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:12.299 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:12.300 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:12.300 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.300 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.300 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:12.300 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:12.300 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:12.300 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.300 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.300 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:12.300 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:12.300 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:12.300 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.300 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.300 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:12.300 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:12.301 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:12.301 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.301 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:12.301 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.301 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.301 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.301 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:12.301 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:12.301 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 46.231614397999998, 2024-04-26T10:43:12.301 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:12.301 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:12.301 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:12.301 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:12.301 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.302 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:12.302 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:12.302 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.302 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.302 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.302 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:12.302 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:12.302 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.302 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.302 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.302 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:12.302 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:12.302 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:12.302 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.303 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.303 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:12.303 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:12.303 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:12.303 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.303 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.303 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:12.303 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:12.303 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:12.303 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.303 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.303 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:12.303 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:12.304 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:12.304 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.304 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.304 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:12.304 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:12.304 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:12.304 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.304 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.304 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:12.304 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:12.304 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:12.304 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.304 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.304 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:12.304 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:12.305 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:12.305 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.305 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.305 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:12.305 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:12.305 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:12.305 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.305 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.305 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:12.305 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:12.305 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:12.305 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.305 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.305 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:12.305 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:12.306 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:12.306 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.306 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.306 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:12.306 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:12.306 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:12.306 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.306 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:12.306 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.306 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.306 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.306 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:12.306 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:12.306 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 46.231570071, 2024-04-26T10:43:12.307 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:12.307 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:12.307 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:12.307 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:12.307 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.307 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:12.307 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:12.307 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.307 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.307 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.307 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:12.307 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:12.307 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.307 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.308 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.308 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:12.308 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:12.308 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:12.308 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.308 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.308 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:12.308 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:12.308 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:12.308 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.308 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.308 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:12.308 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:12.308 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:12.309 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.309 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.309 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:12.309 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:12.309 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:12.309 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.309 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.309 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:12.309 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:12.309 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:12.309 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.309 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.309 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:12.309 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:12.309 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:12.310 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.310 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.310 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:12.310 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:12.310 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:12.310 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.310 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.310 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:12.310 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:12.310 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:12.310 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.310 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.310 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:12.310 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:12.311 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:12.311 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.311 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.311 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:12.311 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:12.311 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:12.311 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.311 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.311 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:12.311 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:12.311 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:12.311 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.311 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:12.311 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.312 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.312 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.312 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:12.312 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:12.312 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 46.231546358000003, 2024-04-26T10:43:12.312 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:12.312 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:12.312 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:12.312 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:12.312 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.312 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:12.312 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:12.312 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.312 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.313 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.313 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:12.313 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:12.313 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.313 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.313 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.313 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:12.313 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:12.313 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:12.313 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.313 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.313 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:12.313 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:12.313 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:12.313 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.314 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.314 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:12.314 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:12.314 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:12.314 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.314 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.314 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:12.314 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:12.314 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:12.314 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.314 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.314 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:12.314 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:12.314 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:12.315 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.315 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.315 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:12.315 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:12.315 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:12.315 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.315 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.315 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:12.315 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:12.315 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:12.315 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.315 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.315 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:12.315 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:12.316 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:12.316 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.316 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.316 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:12.316 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:12.316 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:12.316 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.316 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.316 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:12.316 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:12.316 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:12.316 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.316 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.316 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:12.317 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:12.317 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:12.317 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.317 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:12.317 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.317 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.317 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.317 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:12.317 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:12.317 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 46.231512053000003, 2024-04-26T10:43:12.317 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:12.317 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:12.317 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:12.317 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:12.317 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.317 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:12.318 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:12.318 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.318 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.318 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.318 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:12.318 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:12.318 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.318 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.318 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.318 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:12.318 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:12.318 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:12.318 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.318 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.318 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:12.319 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:12.319 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:12.319 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.319 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.319 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:12.319 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:12.319 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:12.319 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.319 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.319 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:12.319 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:12.319 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:12.319 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.319 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.319 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:12.320 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:12.320 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:12.320 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.320 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.320 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:12.320 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:12.320 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:12.320 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.320 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.320 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:12.320 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:12.323 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:12.323 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.323 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.323 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:12.323 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:12.323 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:12.323 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.323 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.324 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:12.324 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:12.324 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:12.324 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.324 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.324 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:12.324 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:12.324 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:12.324 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.324 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.324 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:12.324 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:12.324 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:12.324 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.325 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:12.325 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.325 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.325 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.325 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:12.325 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:12.325 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 46.231175456999999, 2024-04-26T10:43:12.325 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:12.325 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:12.325 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:12.325 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:12.325 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.325 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:12.325 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:12.326 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.326 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.326 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.326 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:12.326 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:12.326 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.326 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.326 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.326 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:12.326 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:12.326 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:12.326 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.326 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.326 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:12.327 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:12.327 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:12.327 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.327 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.327 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:12.327 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:12.327 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:12.327 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.327 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.327 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:12.327 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:12.327 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:12.327 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.327 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.327 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:12.328 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:12.328 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:12.328 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.328 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.328 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:12.328 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:12.328 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:12.328 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.328 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.328 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:12.328 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:12.328 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:12.328 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.328 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:12.328 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.329 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.329 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.329 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:12.329 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:12.329 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 46.231133429000003, 2024-04-26T10:43:12.329 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:12.329 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:12.329 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:12.329 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:12.329 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.329 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:12.329 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:12.329 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.329 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.329 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.329 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:12.330 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:12.330 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.330 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.330 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.330 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:12.330 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:12.330 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:12.330 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.330 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.330 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:12.330 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:12.330 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:12.330 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.330 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.331 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:12.331 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:12.331 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:12.331 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.331 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.331 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:12.331 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:12.331 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:12.331 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.331 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.331 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:12.331 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:12.331 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:12.331 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.331 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.331 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:12.331 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:12.332 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:12.332 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.332 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.332 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:12.332 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:12.332 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:12.332 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.332 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:12.332 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.332 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.332 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.332 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:12.332 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:12.332 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 46.231080257000002, 2024-04-26T10:43:12.332 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:12.333 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:12.333 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:12.333 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:12.333 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.333 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:12.333 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:12.333 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.333 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.333 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.333 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:12.333 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:12.333 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.333 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.333 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.334 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:12.334 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:12.334 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:12.334 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.334 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.334 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:12.334 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:12.334 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:12.334 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.334 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.334 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:12.334 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:12.334 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:12.335 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.335 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.335 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:12.335 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:12.335 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:12.335 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.335 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.335 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:12.335 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:12.335 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:12.335 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.335 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.335 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:12.335 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:12.335 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:12.335 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.336 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.336 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:12.336 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:12.336 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:12.336 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.336 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:12.336 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.336 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.336 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.336 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:12.336 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:12.336 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 46.227673846999998, 2024-04-26T10:43:12.336 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:12.336 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:12.336 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:12.337 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:12.337 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.337 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:12.337 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:12.337 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.337 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.337 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.337 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:12.337 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:12.337 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.337 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.337 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.337 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:12.337 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:12.337 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:12.338 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.338 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.338 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:12.338 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:12.338 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:12.338 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.338 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.338 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:12.338 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:12.338 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:12.338 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.338 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.338 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:12.338 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:12.338 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:12.339 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.339 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.339 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:12.339 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:12.339 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:12.339 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.339 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.339 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:12.339 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:12.339 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:12.339 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.339 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:12.339 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.339 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.339 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.340 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:12.340 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:12.340 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 46.225201894000001, 2024-04-26T10:43:12.340 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:12.340 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:12.340 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:12.340 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:12.340 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.340 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:12.340 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:12.340 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.340 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.340 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.340 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:12.340 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:12.340 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.341 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.341 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.341 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:12.341 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:12.341 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:12.341 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.341 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.341 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:12.341 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:12.341 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:12.341 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.341 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.341 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:12.341 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:12.341 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:12.342 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.342 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.342 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:12.342 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:12.342 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:12.342 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.342 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.342 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:12.342 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:12.342 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:12.342 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.342 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.342 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:12.343 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:12.343 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:12.343 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.343 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.343 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:12.343 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:12.343 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:12.343 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.343 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:12.343 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.343 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.343 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.343 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:12.343 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:12.343 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 46.224548335999998, 2024-04-26T10:43:12.343 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:12.344 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:12.344 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:12.344 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:12.344 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.344 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:12.344 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:12.344 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.344 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.344 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.344 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:12.344 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:12.344 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.344 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.344 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.345 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:12.345 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:12.345 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:12.345 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.345 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.345 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:12.345 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:12.345 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:12.345 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.345 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.345 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:12.345 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:12.345 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:12.345 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.345 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.346 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:12.346 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:12.346 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:12.346 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.346 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.346 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:12.346 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:12.346 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:12.346 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.346 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.346 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:12.346 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:12.346 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:12.347 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.347 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.347 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:12.347 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:12.347 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:12.347 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.347 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:12.347 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.347 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.347 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.347 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:12.347 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:12.347 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 46.224472550999998, 2024-04-26T10:43:12.347 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:12.347 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:12.348 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:12.348 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:12.348 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.348 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:12.348 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:12.348 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.348 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.348 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.348 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:12.348 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:12.348 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.348 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.348 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.348 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:12.348 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:12.348 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:12.349 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.349 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.349 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:12.349 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:12.349 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:12.349 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.349 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.349 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:12.349 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:12.349 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:12.349 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.349 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.349 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:12.349 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:12.349 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:12.349 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.350 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.350 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:12.350 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:12.350 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:12.350 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.350 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.350 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:12.350 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:12.350 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:12.350 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.350 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.350 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:12.350 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:12.350 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:12.350 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.351 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:12.351 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.351 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.351 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.351 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:12.351 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:12.351 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 46.224258857000002, 2024-04-26T10:43:12.351 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:12.351 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:12.351 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:12.351 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:12.351 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.351 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:12.352 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:12.352 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.352 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.352 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.352 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:12.352 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:12.352 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.352 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.352 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.352 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:12.352 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:12.352 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:12.352 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.352 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.352 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:12.353 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:12.353 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:12.353 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.353 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.353 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:12.353 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:12.353 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:12.353 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.353 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.353 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:12.353 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:12.353 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:12.353 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.353 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.353 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:12.354 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:12.354 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:12.354 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.354 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.354 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:12.354 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:12.354 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:12.354 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.354 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:12.354 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.354 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.354 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.354 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:12.354 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:12.355 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 46.221815044000003, 2024-04-26T10:43:12.355 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:12.355 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:12.355 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:12.355 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:12.355 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.355 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:12.355 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:12.355 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.355 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.355 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.355 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:12.355 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:12.355 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.355 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.356 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.356 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:12.356 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:12.356 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:12.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.356 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.356 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:12.356 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:12.356 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:12.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.356 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.356 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:12.356 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:12.356 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:12.357 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.357 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.357 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:12.357 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:12.357 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:12.357 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.357 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.357 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:12.357 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:12.357 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:12.357 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.357 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.357 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:12.357 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:12.357 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:12.358 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.358 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.358 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:12.358 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:12.358 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:12.358 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.358 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:12.358 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.358 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.358 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.358 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:12.358 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:12.358 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 40.771752599999999, 2024-04-26T10:43:12.358 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:12.359 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:12.359 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:12.359 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:12.359 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.359 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:12.359 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:12.359 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.359 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.359 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.359 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:12.359 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:12.359 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:12.359 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.360 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:12.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:12.360 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:12.360 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.360 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:12.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:12.360 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:12.360 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.360 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:12.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:12.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:12.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.361 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.361 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:12.361 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:12.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:12.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.361 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.361 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:12.361 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:12.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:12.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.361 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.361 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:12.361 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:12.362 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:12.362 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.362 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.362 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:12.362 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:12.362 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:12.362 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.362 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.362 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:12.362 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:12.362 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:12.362 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.362 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.363 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:12.363 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:12.363 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:12.363 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.363 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.363 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:12.363 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:12.363 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:12.363 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:12.363 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:12.363 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:12.363 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:12.363 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:12.363 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.363 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:12.364 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.364 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:12.364 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:12.364 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:12.365 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:12.365 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:12.364+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:12.366 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:12.366 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:43:12.366 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:12.367 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:12.368 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:43:12.368 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:12.368 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:43:12.466 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:12.465+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:12.483 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:12.483 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:12.493 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:12.571 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:12.566+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:12.639 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:12.639 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:12.648 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:12.693 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:12.691+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:12.753 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:12.754 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:12.762 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:12.799 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:43:12.803 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:12.802+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:12.865 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:12.865 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:12.870 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:12.869+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:12.874 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:12.971 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:12.969+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:13.015 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:13.016 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:13.025 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:13.072 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:13.070+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:13.126 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:13.126 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:13.135 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:13.177 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:13.175+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:13.246 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:13.246 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:13.255 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:13.299 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:13.297+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:13.360 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:13.361 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:13.370 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:13.411 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:13.409+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:13.476 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:13.475+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:13.515 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:13.516 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:13.525 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:13.578 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:13.576+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:13.629 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:13.629 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:13.638 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:13.678 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:13.677+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:13.779 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:13.778+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:13.780 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:13.780 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:13.789 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:13.795 INFO:teuthology.orchestra.run.smithi049.stderr:nodeep-scrub is set 2024-04-26T10:43:13.880 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:13.879+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:13.891 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:13.891 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:13.900 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:13.981 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:13.981+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:14.014 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:14.014 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:14.024 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:14.083 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:14.081+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:14.130 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:14.130 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:14.140 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:14.183 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:14.182+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:14.246 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:14.246 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:14.255 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:14.299 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:14.298+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:14.359 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:14.360 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:14.368 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:14.369 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:43:14.385 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:14.383+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:14.486 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:14.485+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:14.504 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:14.505 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:43:14.510 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:14.510 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:14.519 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:14.522 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:14.523 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:14.526 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:43:14.526 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:43:14.587 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:14.585+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:14.663 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:14.663 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:14.663 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:14.663 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:14.663 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.663 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:14.663 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:14.663 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 48.624652095999998, 2024-04-26T10:43:14.664 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:14.664 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:14.664 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:14.664 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:14.664 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.664 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:14.664 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:14.664 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.664 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.664 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.664 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:14.664 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:14.664 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.665 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.665 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.665 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:14.665 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:14.665 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:14.665 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.665 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.665 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:14.665 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:14.665 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:14.665 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.665 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.665 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:14.665 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:14.666 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:14.666 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.666 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.666 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:14.666 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:14.666 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:14.666 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.666 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.666 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:14.666 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:14.666 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:14.666 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.666 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.667 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:14.667 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:14.667 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:14.667 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.667 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.667 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:14.667 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:14.667 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:14.667 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.667 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.667 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:14.667 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:14.667 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:14.668 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.668 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:14.668 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.668 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.668 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.668 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:14.668 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:14.668 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 48.623781315999999, 2024-04-26T10:43:14.668 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:14.668 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:14.668 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:14.668 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:14.668 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.668 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:14.668 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:14.669 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.669 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.669 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.669 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:14.669 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:14.669 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.669 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.669 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.670 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:14.670 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:14.670 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:14.670 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.670 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.670 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:14.670 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:14.670 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:14.671 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.671 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.671 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:14.671 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:14.671 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:14.671 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.671 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.671 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:14.671 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:14.671 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:14.671 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.671 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.671 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:14.672 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:14.672 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:14.672 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.672 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.672 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:14.672 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:14.672 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:14.672 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.672 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.672 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:14.672 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:14.672 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:14.673 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.673 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.673 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:14.673 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:14.673 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:14.673 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.673 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:14.673 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.673 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.673 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.673 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:14.673 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:14.674 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 48.622793973, 2024-04-26T10:43:14.674 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:14.674 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:14.674 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:14.674 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:14.674 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.674 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:14.674 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:14.674 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.674 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.674 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.674 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:14.674 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:14.675 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.675 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.675 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.675 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:14.675 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:14.675 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:14.675 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.675 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.675 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:14.675 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:14.675 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:14.675 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.675 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.675 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:14.676 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:14.676 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:14.676 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.676 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.676 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:14.676 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:14.676 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:14.676 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.676 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.676 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:14.676 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:14.676 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:14.676 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.676 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.676 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:14.677 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:14.677 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:14.677 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.677 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.677 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:14.677 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:14.677 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:14.677 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.677 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.677 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:14.677 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:14.677 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:14.677 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.677 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:14.678 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.678 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.678 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.678 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:14.678 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:14.678 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 48.622588708000002, 2024-04-26T10:43:14.678 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:14.678 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:14.678 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:14.678 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:14.678 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.678 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:14.678 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:14.679 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.679 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.679 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.679 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:14.679 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:14.679 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.679 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.679 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.679 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:14.679 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:14.679 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:14.679 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.679 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.680 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:14.680 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:14.680 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:14.680 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.680 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.680 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:14.680 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:14.680 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:14.680 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.680 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.680 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:14.680 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:14.680 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:14.680 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.681 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.681 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:14.681 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:14.681 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:14.681 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.681 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.681 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:14.681 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:14.681 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:14.681 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.681 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.681 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:14.681 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:14.682 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:14.682 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.682 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.682 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:14.682 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:14.682 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:14.682 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.682 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:14.682 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.682 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.682 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.682 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:14.682 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:14.682 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 48.622267829000002, 2024-04-26T10:43:14.683 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:14.683 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:14.683 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:14.683 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:14.683 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.683 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:14.683 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:14.683 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.683 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.683 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.683 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:14.683 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:14.683 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.683 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.684 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.684 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:14.684 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:14.684 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:14.684 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.684 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.684 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:14.684 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:14.684 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:14.684 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.684 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.684 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:14.684 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:14.685 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:14.685 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.685 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.685 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:14.685 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:14.685 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:14.685 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.685 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.685 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:14.685 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:14.685 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:14.685 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.685 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.685 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:14.685 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:14.686 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:14.686 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.686 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.686 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:14.686 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:14.686 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:14.686 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.686 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.686 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:14.686 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:14.686 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:14.686 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.686 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.686 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:14.687 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:14.687 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:14.687 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.687 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.687 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:14.687 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:14.687 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:14.687 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.687 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.687 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:14.687 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:14.687 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:14.687 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.687 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:14.687 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.688 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.688 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.688 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:14.688 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:14.688 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 48.622216004999999, 2024-04-26T10:43:14.688 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:14.688 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:14.688 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:14.688 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:14.688 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.688 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:14.688 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:14.688 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.688 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.689 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.689 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:14.689 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:14.689 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.689 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.689 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.689 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:14.689 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:14.689 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:14.689 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.689 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.689 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:14.689 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:14.689 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:14.689 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.690 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.690 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:14.690 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:14.690 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:14.690 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.690 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.690 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:14.690 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:14.690 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:14.690 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.690 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.690 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:14.690 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:14.691 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:14.691 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.691 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.691 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:14.691 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:14.691 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:14.691 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.691 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.691 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:14.691 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:14.691 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:14.691 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.691 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.691 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:14.692 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:14.692 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:14.692 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.692 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.692 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:14.692 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:14.692 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:14.692 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.692 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.692 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:14.692 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:14.692 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:14.692 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.692 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.693 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:14.693 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:14.693 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:14.693 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.693 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:14.693 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.693 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.693 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.693 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:14.693 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:14.693 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 48.622162633000002, 2024-04-26T10:43:14.693 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:14.693 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:14.693 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:14.694 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:14.694 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.694 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:14.694 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:14.694 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.694 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.694 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.694 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:14.694 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:14.694 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.694 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.694 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.694 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:14.695 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:14.695 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:14.695 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.695 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.695 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:14.695 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:14.695 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:14.695 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.695 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.695 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:14.695 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:14.695 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:14.695 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.696 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.696 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:14.696 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:14.696 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:14.696 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.696 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.696 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:14.696 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:14.696 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:14.696 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.696 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.696 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:14.696 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:14.696 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:14.697 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.697 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.697 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:14.697 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:14.697 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:14.697 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.697 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.697 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:14.697 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:14.697 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:14.697 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.697 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.697 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:14.697 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:14.697 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:14.698 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.698 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.698 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:14.698 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:14.698 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:14.698 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.698 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.698 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:14.698 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:14.698 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:14.698 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.698 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:14.698 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.698 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.699 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.699 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:14.699 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:14.699 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 48.622118305999997, 2024-04-26T10:43:14.699 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:14.699 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:14.699 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:14.699 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:14.699 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.699 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:14.699 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:14.699 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.699 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.699 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.700 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:14.700 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:14.700 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.700 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.700 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.700 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:14.700 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:14.700 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:14.700 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.700 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.700 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:14.700 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:14.700 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:14.700 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.701 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.701 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:14.701 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:14.701 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:14.701 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.701 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.701 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:14.701 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:14.701 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:14.701 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.701 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.701 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:14.701 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:14.701 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:14.701 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.702 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.702 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:14.702 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:14.702 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:14.702 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.702 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.702 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:14.702 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:14.702 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:14.702 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.702 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.702 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:14.702 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:14.703 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:14.703 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.703 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.703 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:14.703 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:14.703 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:14.703 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.703 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.703 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:14.703 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:14.703 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:14.703 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.703 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.703 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:14.704 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:14.704 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:14.704 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.704 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:14.704 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.704 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.704 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.704 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:14.704 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:14.704 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 48.622094593, 2024-04-26T10:43:14.704 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:14.704 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:14.704 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:14.704 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:14.704 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.705 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:14.705 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:14.705 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.705 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.705 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.705 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:14.705 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:14.705 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.705 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.705 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.705 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:14.705 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:14.705 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:14.705 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.705 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.706 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:14.706 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:14.706 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:14.706 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.706 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.706 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:14.706 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:14.706 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:14.706 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.706 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.706 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:14.706 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:14.706 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:14.707 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.707 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.707 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:14.707 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:14.707 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:14.707 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.707 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.707 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:14.707 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:14.707 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:14.707 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.707 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.707 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:14.707 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:14.707 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:14.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.708 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.708 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:14.708 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:14.708 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:14.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.708 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.708 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:14.708 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:14.708 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:14.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.708 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.708 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:14.708 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:14.709 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:14.709 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.709 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.709 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:14.709 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:14.709 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:14.709 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.709 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:14.709 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.709 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.709 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.709 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:14.709 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:14.709 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 48.622060288, 2024-04-26T10:43:14.709 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:14.710 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:14.710 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:14.710 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:14.710 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.710 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:14.710 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:14.710 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.710 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.710 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.710 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:14.710 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:14.710 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.710 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.710 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.711 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:14.711 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:14.711 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:14.711 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.711 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.711 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:14.711 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:14.711 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:14.711 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.711 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.711 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:14.711 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:14.711 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:14.711 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.712 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.712 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:14.712 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:14.712 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:14.712 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.712 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.712 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:14.712 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:14.712 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:14.712 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.712 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.712 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:14.712 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:14.712 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:14.712 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.713 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.713 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:14.713 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:14.713 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:14.713 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.713 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.713 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:14.713 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:14.713 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:14.713 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.713 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.713 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:14.713 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:14.713 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:14.714 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.714 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.714 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:14.714 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:14.714 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:14.714 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.714 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.714 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:14.714 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:14.714 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:14.714 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.714 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:14.714 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.714 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.715 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.715 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:14.715 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:14.715 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 48.621723692000003, 2024-04-26T10:43:14.715 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:14.715 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:14.715 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:14.715 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:14.715 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.715 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:14.715 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:14.715 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.715 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.715 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.716 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:14.716 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:14.716 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.716 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.716 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.716 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:14.716 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:14.716 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:14.716 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.716 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.716 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:14.716 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:14.716 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:14.716 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.716 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.717 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:14.717 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:14.717 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:14.717 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.717 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.717 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:14.717 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:14.717 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:14.717 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.717 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.717 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:14.717 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:14.717 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:14.717 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.718 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.718 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:14.718 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:14.718 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:14.718 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.718 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.718 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:14.718 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:14.718 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:14.718 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.718 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:14.718 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.718 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.718 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.719 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:14.719 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:14.719 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 48.621681664, 2024-04-26T10:43:14.719 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:14.719 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:14.719 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:14.719 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:14.719 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.719 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:14.719 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:14.719 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.719 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.719 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.720 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:14.720 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:14.720 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.720 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.720 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.720 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:14.720 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:14.720 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:14.720 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.720 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.720 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:14.720 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:14.720 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:14.720 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.721 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.721 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:14.721 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:14.721 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:14.721 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.721 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.721 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:14.721 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:14.721 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:14.721 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.721 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.721 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:14.721 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:14.721 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:14.722 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.722 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.722 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:14.722 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:14.722 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:14.722 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.722 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.722 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:14.722 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:14.722 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:14.722 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.722 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:14.722 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.722 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.723 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.723 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:14.723 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:14.723 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 48.621628491999999, 2024-04-26T10:43:14.723 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:14.723 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:14.723 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:14.723 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:14.723 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.723 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:14.723 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:14.723 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.723 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.723 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.724 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:14.724 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:14.724 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.724 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.724 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.724 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:14.724 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:14.724 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:14.724 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.724 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.724 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:14.724 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:14.724 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:14.724 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.724 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.725 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:14.725 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:14.725 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:14.725 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.725 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.725 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:14.725 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:14.725 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:14.725 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.725 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.725 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:14.725 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:14.725 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:14.725 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.726 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.726 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:14.726 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:14.726 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:14.726 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.726 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.726 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:14.726 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:14.726 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:14.726 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.726 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:14.726 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.726 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.726 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.727 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:14.727 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:14.727 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 48.618222082000003, 2024-04-26T10:43:14.727 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:14.727 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:14.727 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:14.727 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:14.727 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.727 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:14.727 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:14.727 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.727 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.727 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.727 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:14.728 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:14.728 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.728 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.728 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.728 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:14.728 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:14.728 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:14.728 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.728 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.728 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:14.728 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:14.728 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:14.728 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.728 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.728 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:14.729 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:14.729 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:14.729 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.729 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.729 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:14.729 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:14.729 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:14.729 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.729 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.729 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:14.729 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:14.729 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:14.729 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.729 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.730 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:14.730 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:14.730 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:14.730 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.730 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:14.730 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.730 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.730 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.730 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:14.730 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:14.730 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 48.615750128999998, 2024-04-26T10:43:14.730 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:14.730 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:14.730 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:14.730 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:14.731 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.731 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:14.731 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:14.731 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.731 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.731 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.731 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:14.731 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:14.731 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.731 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.731 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.731 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:14.731 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:14.731 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:14.731 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.732 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.732 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:14.732 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:14.732 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:14.732 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.732 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.732 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:14.732 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:14.732 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:14.732 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.732 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.732 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:14.732 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:14.732 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:14.733 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.733 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.733 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:14.733 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:14.733 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:14.733 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.733 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.733 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:14.733 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:14.733 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:14.733 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.733 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.733 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:14.733 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:14.734 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:14.734 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.734 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:14.734 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.734 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.734 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.734 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:14.734 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:14.734 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 48.615096571000002, 2024-04-26T10:43:14.734 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:14.734 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:14.734 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:14.734 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:14.734 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.735 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:14.735 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:14.735 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.735 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.735 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.735 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:14.735 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:14.735 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.735 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.735 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.735 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:14.735 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:14.735 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:14.735 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.736 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.736 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:14.736 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:14.736 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:14.736 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.736 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.736 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:14.736 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:14.736 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:14.736 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.736 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.736 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:14.736 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:14.736 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:14.737 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.737 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.737 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:14.737 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:14.737 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:14.737 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.737 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.737 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:14.737 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:14.737 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:14.737 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.737 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.737 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:14.737 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:14.737 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:14.738 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.738 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:14.738 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.738 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.738 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.738 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:14.738 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:14.738 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 48.615020786000002, 2024-04-26T10:43:14.738 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:14.738 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:14.738 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:14.738 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:14.738 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.738 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:14.739 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:14.739 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.739 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.739 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.739 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:14.739 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:14.739 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.739 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.739 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.739 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:14.739 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:14.739 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:14.739 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.739 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.740 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:14.740 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:14.740 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:14.740 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.740 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.740 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:14.740 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:14.740 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:14.740 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.740 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.740 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:14.740 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:14.740 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:14.740 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.740 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.741 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:14.741 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:14.741 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:14.741 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.741 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.741 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:14.741 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:14.741 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:14.741 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.741 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.741 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:14.741 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:14.741 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:14.741 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.741 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:14.742 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.742 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.742 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.742 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:14.742 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:14.742 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 48.614807091999999, 2024-04-26T10:43:14.742 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:14.742 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:14.742 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:14.742 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:14.742 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.742 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:14.742 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:14.743 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.743 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.743 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.743 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:14.743 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:14.743 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.743 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.743 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.743 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:14.743 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:14.743 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:14.743 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.743 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.743 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:14.743 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:14.744 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:14.744 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.744 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.744 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:14.744 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:14.744 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:14.744 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.744 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.744 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:14.744 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:14.744 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:14.744 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.744 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.744 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:14.745 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:14.745 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:14.745 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.745 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.745 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:14.745 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:14.745 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:14.745 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.745 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:14.745 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.745 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.745 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.745 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:14.745 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:14.746 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 48.612363279, 2024-04-26T10:43:14.746 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:14.746 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:14.746 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:14.746 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:14.746 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.746 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:14.746 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:14.746 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.746 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.746 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.746 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:14.746 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:14.746 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.746 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.747 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.747 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:14.747 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:14.747 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:14.747 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.747 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.747 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:14.747 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:14.747 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:14.747 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.747 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.747 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:14.747 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:14.747 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:14.748 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.748 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.748 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:14.748 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:14.748 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:14.748 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.748 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.748 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:14.748 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:14.748 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:14.748 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.748 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.748 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:14.748 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:14.749 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:14.749 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.749 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.749 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:14.749 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:14.749 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:14.749 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.749 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:14.749 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.749 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.749 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.749 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:14.749 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:14.749 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 43.162300835000003, 2024-04-26T10:43:14.749 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:14.750 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:14.750 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:14.750 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:14.750 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.750 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:14.750 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:14.750 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.750 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.750 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.750 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:14.750 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:14.750 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:14.750 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.750 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.751 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:14.751 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:14.751 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:14.751 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.751 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.751 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:14.751 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:14.751 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:14.751 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.751 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.751 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:14.751 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:14.751 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:14.751 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.752 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.752 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:14.752 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:14.752 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:14.752 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.752 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.752 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:14.752 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:14.752 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:14.752 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.752 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.752 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:14.752 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:14.752 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:14.753 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.753 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.753 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:14.753 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:14.753 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:14.753 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.753 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.753 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:14.753 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:14.753 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:14.753 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.753 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.753 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:14.753 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:14.754 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:14.754 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.754 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.754 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:14.754 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:14.754 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:14.754 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:14.754 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:14.754 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:14.754 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:14.754 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:14.754 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.754 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:14.754 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.755 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:14.755 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:14.755 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:14.756 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:14.755+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:14.756 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:14.857 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:14.855+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:14.872 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:14.872 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:14.872 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:14.872 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:14.881 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:14.966 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:14.964+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:15.031 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:15.031 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:15.031 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:15.031 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:15.031 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:15.031 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T10:43:15.042 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:15.059 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:15.057+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:15.142 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2024-04-26T10:43:15.159 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:15.158+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:15.189 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:15.189 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:15.189 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:15.189 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:15.189 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.190 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:15.190 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:15.190 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 49.151498699000001, 2024-04-26T10:43:15.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:15.190 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:15.190 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.190 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:15.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.190 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:15.190 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:15.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.190 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.190 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:15.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:15.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:15.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:15.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:15.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:15.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:15.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.192 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:15.192 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:15.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:15.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.192 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.192 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:15.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:15.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.192 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:15.193 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:15.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:15.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.193 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:15.193 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:15.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:15.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.193 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:15.193 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:15.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:15.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.194 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:15.194 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:15.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:15.194 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.194 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:15.194 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.194 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:15.194 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:15.194 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 49.149748578000001, 2024-04-26T10:43:15.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:15.195 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:15.195 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.195 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:15.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.195 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:15.195 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:15.195 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.195 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:15.195 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:15.195 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:15.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:15.196 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:15.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:15.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:15.196 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:15.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:15.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:15.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:15.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.197 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.197 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:15.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:15.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.197 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:15.197 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:15.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:15.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.197 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:15.198 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:15.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:15.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.198 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:15.198 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:15.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:15.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.198 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:15.198 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:15.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:15.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:15.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:15.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:15.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:15.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:15.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:15.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:15.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:15.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:15.199 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.199 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:15.200 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.200 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:15.200 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:15.200 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 49.149695579999999, 2024-04-26T10:43:15.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:15.200 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:15.200 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.200 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:15.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:15.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:15.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:15.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:15.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:15.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:15.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:15.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:15.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:15.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.202 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:15.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:15.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:15.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.202 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:15.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:15.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:15.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:15.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:15.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:15.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:15.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:15.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:15.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:15.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:15.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:15.204 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:15.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:15.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:15.204 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:15.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:15.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:15.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:15.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:15.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.205 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:15.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:15.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:15.205 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.205 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:15.205 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.205 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:15.206 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:15.206 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 49.149617835999997, 2024-04-26T10:43:15.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:15.206 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:15.206 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.206 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:15.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:15.206 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:15.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:15.206 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:15.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:15.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:15.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:15.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:15.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:15.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:15.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:15.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:15.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:15.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:15.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:15.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:15.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:15.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:15.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.209 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:15.209 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:15.209 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:15.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.209 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:15.209 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:15.209 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:15.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.209 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:15.209 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:15.209 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:15.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.210 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:15.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:15.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:15.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.210 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:15.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:15.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:15.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.210 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:15.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:15.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:15.211 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.211 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:15.211 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.211 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:15.211 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:15.211 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 49.149578830000003, 2024-04-26T10:43:15.211 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:15.211 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:15.211 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.211 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:15.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.211 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:15.211 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:15.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:15.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:15.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:15.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:15.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:15.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:15.213 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:15.213 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:15.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.213 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:15.213 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:15.213 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:15.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.213 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.213 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:15.213 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:15.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.214 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:15.214 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:15.214 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:15.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.214 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:15.214 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:15.214 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:15.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.214 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:15.214 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:15.214 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:15.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.215 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:15.215 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:15.215 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:15.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.215 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:15.215 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:15.215 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:15.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.215 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:15.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:15.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:15.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.216 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:15.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:15.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:15.216 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.216 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:15.216 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.216 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:15.216 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:15.217 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 49.149560008999998, 2024-04-26T10:43:15.217 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:15.217 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:15.217 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.217 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:15.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.217 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:15.217 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:15.217 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.217 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:15.217 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:15.218 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.218 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:15.218 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:15.218 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:15.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.218 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:15.218 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:15.218 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:15.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:15.219 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:15.219 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:15.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.219 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:15.219 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:15.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:15.219 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:15.219 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:15.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.220 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:15.220 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:15.220 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:15.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.220 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:15.220 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:15.220 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:15.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.220 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:15.220 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:15.220 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:15.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.221 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:15.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:15.221 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:15.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.221 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:15.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:15.221 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:15.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.221 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:15.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:15.221 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:15.222 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.222 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:15.222 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.222 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:15.222 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:15.222 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 49.149528007000001, 2024-04-26T10:43:15.222 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:15.222 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:15.222 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.222 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:15.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.223 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:15.223 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:15.223 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.223 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.223 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:15.223 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:15.223 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.223 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.223 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:15.223 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:15.223 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.224 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:15.224 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:15.224 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:15.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.224 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:15.224 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:15.224 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:15.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.224 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.224 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:15.224 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:15.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:15.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:15.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:15.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:15.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:15.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:15.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:15.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:15.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:15.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.226 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:15.226 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:15.226 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:15.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.226 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:15.226 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:15.226 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:15.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.226 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:15.226 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:15.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:15.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.227 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:15.227 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:15.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:15.227 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.227 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:15.227 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.227 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:15.227 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:15.227 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 49.149319198999997, 2024-04-26T10:43:15.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:15.228 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:15.228 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.228 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:15.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.228 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:15.228 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:15.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.228 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:15.228 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:15.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.229 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:15.229 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:15.229 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:15.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.229 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:15.229 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:15.229 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:15.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.229 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:15.229 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:15.229 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:15.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.230 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.230 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:15.230 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:15.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.230 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:15.230 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:15.233 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:15.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.234 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:15.234 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:15.234 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:15.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.235 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:15.235 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:15.235 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:15.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.235 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:15.235 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:15.235 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:15.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.235 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:15.236 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:15.236 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:15.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.236 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:15.236 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:15.236 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:15.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.236 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:15.236 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:15.236 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:15.236 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.236 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:15.237 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.237 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:15.237 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:15.237 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 49.149287907999998, 2024-04-26T10:43:15.237 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:15.237 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:15.237 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:15.237 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:15.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.237 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:15.237 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:15.237 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.238 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:15.238 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:15.238 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.238 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:15.238 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:15.238 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.238 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:15.239 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:15.239 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:15.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.239 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:15.239 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:15.239 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:15.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.239 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.239 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:15.239 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:15.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.240 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:15.240 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:15.240 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:15.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.240 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:15.240 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:15.240 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:15.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.240 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:15.240 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:15.240 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:15.240 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.241 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:15.241 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.241 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:15.241 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:15.241 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 49.149260658000003, 2024-04-26T10:43:15.241 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:15.241 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:15.241 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:15.241 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:15.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.241 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:15.241 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:15.242 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.242 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:15.242 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:15.242 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.242 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:15.242 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:15.242 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.242 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:15.243 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:15.243 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:15.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.243 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:15.243 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:15.243 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:15.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.243 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.243 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:15.243 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:15.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.244 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:15.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:15.244 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:15.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.244 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:15.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:15.244 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:15.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.244 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:15.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:15.244 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:15.244 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.245 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:15.245 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.245 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:15.245 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:15.245 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 49.146483906999997, 2024-04-26T10:43:15.245 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:15.245 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:15.245 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:15.245 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:15.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.245 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:15.245 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:15.246 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.246 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:15.246 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:15.246 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.246 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:15.246 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:15.246 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.246 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:15.247 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:15.247 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:15.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.247 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:15.247 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:15.247 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:15.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.247 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.247 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:15.247 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:15.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.248 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:15.248 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:15.248 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:15.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.248 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:15.248 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:15.248 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:15.248 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.248 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:15.248 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.248 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:15.249 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:15.249 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 49.146433817999998, 2024-04-26T10:43:15.249 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:15.249 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:15.249 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.249 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:15.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.249 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:15.249 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:15.249 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.249 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:15.249 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:15.250 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.250 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:15.250 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:15.250 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.250 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:15.250 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:15.250 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:15.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.250 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:15.251 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:15.251 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:15.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.251 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.251 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:15.251 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:15.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.251 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:15.251 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:15.251 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:15.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.252 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:15.252 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:15.252 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:15.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.252 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.252 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:15.252 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:15.252 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:15.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.252 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.252 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:15.252 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:15.252 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:15.252 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.252 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:15.253 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.253 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.253 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.253 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:15.253 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:15.253 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 49.145541749000003, 2024-04-26T10:43:15.253 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:15.253 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:15.253 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.253 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:15.253 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.253 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:15.253 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:15.253 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.253 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.254 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.254 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:15.254 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:15.254 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.254 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.254 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:15.254 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:15.254 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.254 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.254 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:15.254 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:15.254 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:15.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.255 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.255 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:15.255 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:15.255 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:15.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.255 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.255 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.255 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:15.255 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:15.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.255 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.255 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:15.255 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:15.256 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:15.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.256 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.256 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:15.256 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:15.256 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:15.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.256 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.256 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:15.256 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:15.256 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:15.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.256 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.256 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:15.257 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:15.257 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:15.257 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.257 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:15.257 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.257 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.257 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:15.257 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:15.257 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 49.143353419999997, 2024-04-26T10:43:15.257 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:15.257 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:15.257 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.257 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:15.258 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.258 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:15.258 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:15.258 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.258 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.258 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:15.258 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:15.258 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.258 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.258 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:15.258 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:15.258 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.259 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:15.259 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:15.259 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:15.259 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.259 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:15.259 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:15.259 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:15.259 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.259 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.259 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:15.259 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:15.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.260 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:15.260 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:15.260 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:15.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.260 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:15.260 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:15.260 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:15.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.260 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:15.260 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:15.260 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:15.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.261 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:15.261 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:15.261 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:15.261 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.261 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:15.261 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.261 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:15.261 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:15.261 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 49.143218050000002, 2024-04-26T10:43:15.261 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:15.261 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:15.262 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.262 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:15.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.262 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:15.262 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:15.262 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.262 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:15.262 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:15.262 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.262 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:15.263 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:15.263 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.263 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.263 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:15.263 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:15.263 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:15.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.263 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.263 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:15.263 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:15.263 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:15.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.263 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.264 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.264 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:15.264 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:15.264 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.264 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.264 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:15.264 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:15.264 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:15.264 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.264 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.264 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:15.264 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:15.264 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:15.264 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.265 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:15.265 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:15.265 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:15.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.265 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:15.265 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:15.265 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:15.265 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.265 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:15.265 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.265 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:15.266 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:15.266 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 49.143003475999997, 2024-04-26T10:43:15.266 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:15.266 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:15.266 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.266 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:15.266 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.266 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:15.266 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:15.266 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.266 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.266 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.266 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:15.266 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:15.267 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.267 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.267 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.267 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:15.267 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:15.267 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.267 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.267 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.267 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:15.267 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:15.267 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:15.267 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.267 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.267 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:15.267 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:15.268 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:15.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.268 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.268 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:15.268 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:15.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.268 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:15.268 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:15.268 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:15.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.268 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:15.269 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:15.269 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:15.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.269 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.269 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:15.269 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:15.269 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:15.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.269 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.269 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:15.269 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:15.269 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:15.269 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.269 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:15.269 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.270 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.270 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.270 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:15.270 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:15.270 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 49.142664535000002, 2024-04-26T10:43:15.270 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:15.270 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:15.270 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.270 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:15.270 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.270 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:15.270 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:15.270 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.271 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.271 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:15.271 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:15.271 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.271 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.271 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:15.271 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:15.271 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.271 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.271 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:15.271 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:15.271 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:15.272 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.272 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.272 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:15.272 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:15.272 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:15.272 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.272 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.272 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.272 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:15.272 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:15.272 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.272 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.272 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:15.272 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:15.272 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:15.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.273 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:15.273 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:15.273 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:15.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.273 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:15.273 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:15.273 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:15.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.273 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:15.273 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:15.274 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:15.274 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.274 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:15.274 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.274 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:15.274 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:15.274 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 49.142555158, 2024-04-26T10:43:15.274 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:15.274 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:15.274 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:15.274 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:15.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.275 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:15.275 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:15.275 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.275 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:15.275 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:15.275 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.275 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:15.275 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:15.275 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:15.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.276 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:15.276 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:15.276 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:15.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.276 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:15.276 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:15.276 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:15.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.276 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.276 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:15.276 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:15.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.277 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:15.277 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:15.277 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:15.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.277 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:15.277 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:15.277 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:15.277 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.277 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:15.277 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.278 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:15.278 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:15.278 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 49.142515439, 2024-04-26T10:43:15.278 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:15.278 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:15.278 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.278 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:15.278 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.278 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:15.278 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:15.278 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.278 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.278 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:15.279 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:15.279 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.279 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:15.279 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:15.279 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:15.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.279 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:15.279 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:15.279 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:15.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.279 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:15.280 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:15.280 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:15.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.280 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.280 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:15.280 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:15.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.280 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:15.280 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:15.280 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:15.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.281 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:15.281 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:15.281 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:15.281 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.281 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.281 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:15.281 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:15.281 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:15.281 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.281 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.281 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:15.281 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:15.281 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:15.281 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.282 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:15.282 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.282 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.282 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.282 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:15.282 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:15.282 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 49.142177906000001, 2024-04-26T10:43:15.282 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:15.282 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:15.282 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.282 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:15.282 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.282 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:15.283 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:15.283 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.283 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.283 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:15.283 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:15.283 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:15.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.283 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.283 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:15.283 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:15.283 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.283 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.284 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:15.284 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:15.284 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:15.284 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.284 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.284 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:15.284 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:15.284 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:15.284 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.284 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.284 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.284 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:15.284 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:15.284 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.285 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.285 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:15.285 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:15.285 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:15.285 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.285 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.285 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:15.285 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:15.285 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:15.285 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.285 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.285 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:15.285 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:15.285 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:15.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:15.286 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:15.286 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:15.286 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:15.286 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:15.286 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.286 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:15.286 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.286 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:15.286 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:15.286 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:15.288 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:15.288 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:15.286+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:15.389 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:15.388+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:15.393 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:15.394 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:15.394 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:15.394 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:15.403 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:15.489 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:15.488+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:15.504 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:15.504 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:15.504 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:15.504 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:15.504 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:15.513 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:15.597 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:15.596+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:15.601 INFO:tasks.ceph.mgr.x.smithi049.stderr:2024-04-26T10:43:15.600+0000 7fe1516ee640 -1 calc_pg_upmaps abort due to max <= 0 2024-04-26T10:43:15.658 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:15.658 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:15.658 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:15.658 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:15.658 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.658 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:15.658 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:15.658 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 49.619562436999999, 2024-04-26T10:43:15.659 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:15.659 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:15.659 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.659 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:15.659 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.659 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:15.659 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:15.659 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.659 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.659 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.659 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:15.659 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:15.659 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.659 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.659 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.660 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:15.660 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:15.660 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.660 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.660 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.660 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:15.660 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:15.660 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:15.660 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.660 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.660 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:15.660 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:15.660 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:15.660 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.661 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.661 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.661 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:15.661 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:15.661 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.661 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.661 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:15.661 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:15.661 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:15.661 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.661 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.661 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:15.661 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:15.662 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:15.662 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.662 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.662 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:15.662 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:15.662 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:15.662 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.662 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.662 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:15.662 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:15.662 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:15.662 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.662 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:15.662 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.663 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.663 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.663 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:15.663 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:15.663 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 49.618691656999999, 2024-04-26T10:43:15.663 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:15.663 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:15.663 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.663 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:15.663 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.663 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:15.663 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:15.663 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.663 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.664 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.664 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:15.664 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:15.664 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.664 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.664 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.664 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:15.664 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:15.664 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.664 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.664 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.664 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:15.664 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:15.664 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:15.664 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.665 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.665 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:15.665 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:15.665 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:15.665 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.665 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.665 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.665 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:15.665 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:15.665 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.665 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.665 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:15.665 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:15.665 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:15.666 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.666 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.666 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:15.666 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:15.666 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:15.666 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.666 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.666 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:15.666 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:15.666 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:15.666 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.666 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.666 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:15.666 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:15.667 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:15.667 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.667 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:15.667 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.667 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.667 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.667 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:15.667 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:15.667 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 49.617704314000001, 2024-04-26T10:43:15.667 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:15.667 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:15.667 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.667 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:15.667 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.668 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:15.668 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:15.668 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.668 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.668 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.668 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:15.668 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:15.668 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.668 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.668 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.668 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:15.668 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:15.668 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:15.668 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.669 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.669 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:15.669 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:15.669 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:15.669 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.669 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.669 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:15.669 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:15.669 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:15.669 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.669 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.669 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.669 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:15.669 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:15.670 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.670 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.670 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:15.670 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:15.670 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:15.670 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.670 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.670 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:15.670 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:15.670 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:15.670 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.670 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.670 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:15.670 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:15.671 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:15.671 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.671 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.671 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:15.671 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:15.671 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:15.671 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.671 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:15.671 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.671 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.671 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.671 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:15.671 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:15.671 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 49.617499049000003, 2024-04-26T10:43:15.671 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:15.672 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:15.672 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.672 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:15.672 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.672 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:15.672 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:15.672 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.672 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.672 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.672 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:15.672 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:15.672 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.672 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.673 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.673 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:15.673 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:15.673 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.673 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.673 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.673 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:15.673 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:15.673 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:15.673 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.673 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.673 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:15.673 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:15.674 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:15.674 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.674 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.674 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.674 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:15.674 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:15.676 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.676 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.676 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:15.676 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:15.676 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:15.676 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.676 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.676 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:15.676 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:15.676 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:15.676 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.677 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.677 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:15.677 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:15.677 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:15.677 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.677 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.677 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:15.677 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:15.677 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:15.677 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.677 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:15.677 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.677 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.678 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.678 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:15.678 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:15.678 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 49.617178170000003, 2024-04-26T10:43:15.678 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:15.678 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:15.678 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.678 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:15.678 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.678 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:15.678 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:15.678 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.678 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.678 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.679 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:15.679 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:15.679 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.679 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.679 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.679 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:15.679 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:15.679 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:15.679 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.679 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.679 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:15.679 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:15.679 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:15.679 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.679 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.680 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:15.680 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:15.680 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:15.680 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.680 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.680 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.680 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:15.680 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:15.680 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.680 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.680 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:15.680 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:15.680 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:15.680 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.681 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.681 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:15.681 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:15.681 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:15.681 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.681 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.681 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:15.681 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:15.681 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:15.681 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.681 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.681 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:15.681 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:15.681 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:15.681 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.682 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.682 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:15.682 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:15.682 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:15.682 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.682 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.682 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:15.682 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:15.682 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:15.682 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.682 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.682 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:15.682 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:15.682 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:15.683 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.683 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:15.683 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.683 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.683 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.683 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:15.683 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:15.683 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 49.617126345999999, 2024-04-26T10:43:15.683 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:15.683 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:15.683 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.683 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:15.683 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.683 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:15.684 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:15.684 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.684 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.684 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.684 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:15.684 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:15.684 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.684 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.684 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.684 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:15.684 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:15.684 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.684 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.684 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.684 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:15.685 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:15.685 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:15.685 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.685 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.685 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:15.685 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:15.685 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:15.685 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.685 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.685 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.685 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:15.685 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:15.685 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.685 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.685 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:15.686 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:15.686 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:15.686 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.686 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.686 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:15.686 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:15.686 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:15.686 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.686 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.686 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:15.686 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:15.686 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:15.686 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.686 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.686 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:15.687 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:15.687 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:15.687 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.687 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.687 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:15.687 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:15.687 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:15.687 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.687 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.687 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:15.687 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:15.687 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:15.687 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.687 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.688 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:15.688 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:15.688 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:15.688 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.688 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:15.688 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.688 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.688 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.688 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:15.688 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:15.688 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 49.617072974000003, 2024-04-26T10:43:15.688 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:15.688 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:15.688 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.688 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:15.689 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.689 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:15.689 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:15.689 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.689 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.689 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.689 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:15.689 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:15.689 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.689 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.689 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.689 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:15.689 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:15.689 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.689 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.690 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.690 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:15.690 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:15.690 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:15.690 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.690 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.690 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:15.690 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:15.690 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:15.690 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.690 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.690 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.690 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:15.690 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:15.691 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.691 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.691 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:15.691 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:15.691 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:15.691 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.691 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.691 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:15.691 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:15.691 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:15.691 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.691 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.691 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:15.691 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:15.691 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:15.692 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.692 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.692 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:15.692 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:15.692 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:15.692 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.692 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.692 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:15.692 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:15.692 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:15.692 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.692 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.692 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:15.692 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:15.692 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:15.693 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.693 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.693 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:15.693 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:15.693 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:15.693 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.693 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:15.693 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.693 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.693 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.693 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:15.693 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:15.693 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 49.617028646999998, 2024-04-26T10:43:15.693 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:15.694 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:15.694 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.694 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:15.694 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.694 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:15.694 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:15.694 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.694 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.694 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.694 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:15.694 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:15.694 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.694 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.694 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.695 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:15.695 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:15.695 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:15.695 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.695 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.695 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:15.695 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:15.695 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:15.695 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.695 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.695 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:15.695 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:15.695 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:15.695 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.696 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.696 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.696 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:15.696 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:15.696 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.696 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.696 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:15.696 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:15.696 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:15.696 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.696 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.696 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:15.696 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:15.696 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:15.696 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.697 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.697 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:15.697 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:15.697 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:15.697 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.697 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.697 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:15.697 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:15.697 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:15.697 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.697 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.697 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:15.697 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:15.697 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:15.698 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.698 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.698 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:15.698 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:15.698 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:15.698 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.698 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.698 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:15.698 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:15.698 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:15.698 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.698 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:15.698 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.698 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.699 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.699 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:15.699 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:15.699 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 49.617004934000001, 2024-04-26T10:43:15.699 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:15.699 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:15.699 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.699 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:15.699 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.699 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:15.699 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:15.699 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.699 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.699 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.699 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:15.700 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:15.700 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.700 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.700 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.700 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:15.700 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:15.700 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.700 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.700 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.700 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:15.700 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:15.700 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:15.700 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.700 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.701 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.702 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:15.702 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:15.702 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:15.702 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.702 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.702 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:15.702 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:15.702 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:15.702 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.702 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.702 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:15.702 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:15.702 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:15.703 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.703 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.703 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:15.703 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:15.703 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:15.703 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.703 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.703 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:15.703 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:15.703 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:15.703 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.703 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.703 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:15.703 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:15.703 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:15.704 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.704 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:15.704 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.704 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.704 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.704 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:15.704 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:15.704 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 49.616970629000001, 2024-04-26T10:43:15.704 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:15.704 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:15.704 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.704 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:15.704 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.704 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:15.705 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:15.705 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.705 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.705 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.705 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:15.705 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:15.705 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.705 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.705 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.705 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:15.705 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:15.705 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.705 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.705 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.705 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:15.706 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:15.706 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:15.706 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.706 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.706 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:15.706 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:15.706 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:15.706 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.706 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.706 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.706 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:15.706 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:15.706 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.706 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.707 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:15.707 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:15.707 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:15.707 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.707 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.707 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:15.707 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:15.707 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:15.707 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.707 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.707 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:15.707 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:15.707 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:15.707 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.708 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.708 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:15.708 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:15.708 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:15.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.708 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.708 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:15.708 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:15.708 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:15.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.708 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.708 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:15.708 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:15.708 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:15.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.709 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.709 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:15.709 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:15.709 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:15.709 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.709 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:15.709 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.709 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.709 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.709 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:15.709 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:15.709 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 49.616634032999997, 2024-04-26T10:43:15.709 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:15.709 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:15.709 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:15.710 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:15.710 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.710 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:15.710 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:15.710 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.710 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.710 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.710 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:15.710 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:15.710 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.710 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.710 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.710 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:15.711 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:15.711 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:15.711 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.711 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.711 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:15.711 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:15.711 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:15.711 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.711 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.711 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:15.711 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:15.711 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:15.711 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.711 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.711 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.712 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:15.712 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:15.712 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.712 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.712 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:15.712 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:15.712 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:15.712 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.712 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.712 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:15.712 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:15.712 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:15.712 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.712 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.712 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:15.713 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:15.713 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:15.713 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.713 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:15.713 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.713 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.713 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.713 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:15.713 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:15.713 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 49.616592005000001, 2024-04-26T10:43:15.713 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:15.713 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:15.713 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:15.713 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:15.713 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.714 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:15.714 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:15.714 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.714 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.714 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.714 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:15.714 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:15.714 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.714 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.714 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.714 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:15.714 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:15.714 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.714 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.715 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.715 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:15.715 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:15.715 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:15.715 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.715 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.715 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:15.715 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:15.715 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:15.715 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.715 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.715 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.715 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:15.715 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:15.715 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.716 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.716 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:15.716 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:15.716 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:15.716 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.716 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.716 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:15.716 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:15.716 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:15.716 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.716 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.716 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:15.716 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:15.716 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:15.716 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.717 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:15.717 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.717 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.717 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.717 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:15.717 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:15.717 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 49.616538833, 2024-04-26T10:43:15.717 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:15.717 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:15.717 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:15.717 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:15.717 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.717 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:15.717 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:15.718 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.718 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.718 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.718 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:15.718 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:15.718 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.718 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.718 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.718 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:15.718 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:15.718 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.718 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.718 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.718 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:15.718 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:15.719 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:15.719 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.719 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.719 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:15.719 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:15.719 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:15.719 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.719 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.719 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.719 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:15.719 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:15.719 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.719 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.719 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:15.719 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:15.720 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:15.720 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.720 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.720 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:15.720 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:15.720 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:15.720 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.720 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.720 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:15.720 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:15.720 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:15.720 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.720 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:15.720 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.721 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.721 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.721 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:15.721 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:15.721 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 49.613132423000003, 2024-04-26T10:43:15.721 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:15.721 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:15.721 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:15.721 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:15.721 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.721 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:15.721 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:15.721 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.722 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.722 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.722 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:15.722 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:15.722 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.722 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.722 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.722 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:15.722 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:15.722 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.722 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.722 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.722 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:15.723 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:15.723 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:15.723 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.723 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.723 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:15.723 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:15.723 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:15.723 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.723 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.723 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.723 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:15.723 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:15.723 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.723 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.723 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:15.724 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:15.724 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:15.724 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.724 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.724 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:15.724 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:15.724 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:15.724 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.724 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:15.724 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.724 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.724 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.724 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:15.724 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:15.724 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 49.610660469999999, 2024-04-26T10:43:15.725 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:15.725 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:15.725 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:15.725 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:15.725 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.725 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:15.725 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:15.725 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.725 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.725 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.725 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:15.725 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:15.725 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.725 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.726 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.726 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:15.726 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:15.726 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.726 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.726 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.726 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:15.726 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:15.726 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:15.726 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.726 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.726 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:15.726 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:15.726 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:15.726 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.727 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.727 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.727 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:15.727 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:15.727 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.727 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.727 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:15.727 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:15.727 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:15.727 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.727 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.727 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:15.727 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:15.727 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:15.728 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.728 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.728 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:15.728 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:15.728 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:15.728 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.728 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:15.728 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.728 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.728 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.728 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:15.728 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:15.728 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 49.610006912000003, 2024-04-26T10:43:15.728 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:15.728 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:15.729 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:15.729 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:15.729 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.729 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:15.729 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:15.729 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.729 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.729 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.729 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:15.729 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:15.729 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.729 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.729 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.729 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:15.729 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:15.730 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.730 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.730 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.730 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:15.730 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:15.730 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:15.730 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.730 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.730 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:15.730 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:15.730 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:15.730 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.730 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.731 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.731 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:15.731 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:15.731 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.731 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.731 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:15.731 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:15.731 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:15.731 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.731 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.731 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:15.731 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:15.731 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:15.731 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.731 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.732 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:15.732 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:15.732 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:15.732 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.732 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:15.732 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.732 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.732 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.732 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:15.732 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:15.732 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 49.609931127000003, 2024-04-26T10:43:15.732 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:15.732 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:15.732 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:15.732 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:15.733 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.733 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:15.733 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:15.733 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.733 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.733 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.733 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:15.733 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:15.733 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.733 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.733 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.733 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:15.733 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:15.733 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.733 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.734 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.734 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:15.734 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:15.734 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:15.734 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.734 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.734 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:15.734 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:15.734 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:15.734 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.734 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.734 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.734 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:15.735 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:15.735 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.735 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.735 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:15.735 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:15.735 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:15.735 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.735 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.735 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:15.735 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:15.735 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:15.735 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.735 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.735 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:15.735 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:15.736 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:15.736 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.736 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:15.736 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.736 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.736 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.736 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:15.736 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:15.736 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 49.609717433, 2024-04-26T10:43:15.736 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:15.736 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:15.736 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:15.736 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:15.736 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.737 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:15.737 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:15.737 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.737 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.737 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.737 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:15.737 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:15.737 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.737 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.737 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.737 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:15.737 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:15.737 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:15.737 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.738 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.738 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:15.738 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:15.738 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:15.738 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.738 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.738 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:15.738 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:15.738 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:15.738 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.738 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.738 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.738 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:15.738 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:15.739 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.739 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.739 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:15.739 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:15.739 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:15.739 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.739 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.739 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:15.739 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:15.739 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:15.739 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.739 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:15.739 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.739 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.740 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.740 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:15.740 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:15.740 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 49.607273620000001, 2024-04-26T10:43:15.740 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:15.740 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:15.740 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:15.740 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:15.740 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.740 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:15.740 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:15.740 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.740 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.740 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.741 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:15.741 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:15.741 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.741 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.741 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.741 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:15.741 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:15.741 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:15.741 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.741 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.741 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:15.741 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:15.741 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:15.741 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.742 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.742 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:15.742 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:15.742 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:15.742 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.742 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.742 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.742 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:15.742 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:15.742 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.742 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.742 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:15.742 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:15.742 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:15.742 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.743 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.743 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:15.743 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:15.743 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:15.743 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.743 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.743 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:15.743 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:15.743 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:15.743 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.743 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:15.743 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.743 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 44.157211175999997, 2024-04-26T10:43:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:15.744 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:15.745 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:15.745 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.745 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.745 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:15.745 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:15.745 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:15.745 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.745 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.745 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:15.745 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:15.745 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:15.745 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.745 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.745 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:15.746 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:15.746 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:15.746 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.746 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.746 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:15.746 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:15.746 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:15.746 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.746 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.746 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:15.746 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:15.746 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:15.746 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.746 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.746 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:15.747 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:15.747 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:15.747 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.747 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.747 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:15.747 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:15.747 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:15.747 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.747 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.747 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:15.747 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:15.747 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:15.747 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.747 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.748 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:15.748 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:15.748 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:15.748 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.748 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.748 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:15.748 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:15.748 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:15.748 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:15.748 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:15.748 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:15.748 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:15.748 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:15.748 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.748 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:15.749 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.749 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:15.749 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:15.749 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:15.750 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:15.751 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:15.749+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:15.811 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:43:15.851 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:15.849+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:15.870 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:15.871 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:15.880 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:15.951 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:15.950+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:16.028 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:16.029 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:16.029 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:16.029 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:16.029 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:16.038 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:16.052 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:16.052+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:16.135 INFO:teuthology.orchestra.run.smithi049.stderr:noscrub is unset 2024-04-26T10:43:16.147 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:16.147 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:16.147 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:16.147 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:16.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.147 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:16.147 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:16.147 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.109194785, 2024-04-26T10:43:16.147 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:16.147 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:16.148 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.148 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:16.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.148 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:16.148 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:16.148 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.148 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:16.148 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:16.148 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.148 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:16.149 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:16.149 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.149 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:16.149 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:16.149 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:16.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.149 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:16.149 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:16.149 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:16.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.150 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.150 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:16.150 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:16.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.150 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.150 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:16.150 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:16.150 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:16.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.150 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.150 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:16.150 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:16.150 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:16.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.151 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:16.151 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:16.151 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:16.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.151 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:16.151 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:16.151 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:16.151 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.151 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:16.151 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.152 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:16.152 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:16.152 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.107444663999999, 2024-04-26T10:43:16.152 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:16.152 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:16.152 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.152 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:16.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.152 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:16.152 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:16.152 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:16.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:16.154 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:16.155 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.156 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.107391665999998, 2024-04-26T10:43:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:16.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.159 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:16.161 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:16.162 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.107313922000003, 2024-04-26T10:43:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:16.163 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:16.164 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.165 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:16.166 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:16.166 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:16.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.166 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:16.166 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:16.166 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:16.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.166 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:16.166 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:16.166 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:16.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.167 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:16.167 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:16.167 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:16.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.167 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:16.167 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:16.167 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:16.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.167 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:16.167 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:16.167 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:16.167 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.168 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:16.168 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.168 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:16.168 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:16.168 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.107274916000001, 2024-04-26T10:43:16.168 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:16.168 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:16.168 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.168 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:16.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.168 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:16.168 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:16.168 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.169 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.169 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:16.169 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:16.169 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.169 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.169 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:16.169 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:16.169 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:16.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.169 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.169 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:16.169 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:16.169 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:16.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.170 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.170 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:16.170 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:16.170 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:16.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.170 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.170 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.170 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:16.170 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:16.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.170 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.170 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:16.170 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:16.171 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:16.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.171 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:16.171 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:16.171 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:16.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.171 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:16.171 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:16.171 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:16.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.171 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:16.171 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:16.172 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:16.172 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.172 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.172 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:16.172 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:16.172 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:16.172 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.172 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.172 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:16.172 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:16.172 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:16.172 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.172 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.172 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:16.172 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:16.173 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:16.173 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.173 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:16.173 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.173 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:16.173 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:16.173 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.107256094999997, 2024-04-26T10:43:16.173 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:16.173 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:16.173 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.173 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:16.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.173 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:16.174 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:16.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.174 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:16.174 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:16.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.174 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:16.174 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:16.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:16.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.175 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:16.175 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:16.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:16.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.175 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:16.175 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:16.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:16.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.175 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.175 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:16.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:16.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.176 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:16.176 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:16.176 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:16.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.176 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:16.176 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:16.176 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:16.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.176 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:16.176 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:16.176 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:16.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.177 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:16.177 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:16.177 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:16.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.177 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:16.177 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:16.177 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:16.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.177 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:16.177 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:16.177 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:16.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.178 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:16.178 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:16.178 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:16.178 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.178 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:16.178 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.178 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:16.178 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:16.178 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.107224092999999, 2024-04-26T10:43:16.179 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:16.179 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:16.179 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.179 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:16.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.179 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:16.179 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:16.179 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.179 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:16.179 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:16.179 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.180 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:16.180 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:16.180 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.180 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:16.180 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:16.180 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:16.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.180 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:16.181 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:16.181 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:16.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.181 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.181 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:16.181 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:16.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.181 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:16.181 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:16.181 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:16.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.182 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:16.182 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:16.182 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:16.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.182 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:16.182 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:16.182 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:16.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.182 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:16.182 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:16.183 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:16.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.183 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:16.183 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:16.183 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:16.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.183 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:16.183 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:16.183 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:16.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.183 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:16.184 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:16.184 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:16.184 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.184 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:16.184 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.184 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.184 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:16.184 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:16.184 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.107015285000003, 2024-04-26T10:43:16.184 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:16.184 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:16.185 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.185 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:16.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.185 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:16.185 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:16.185 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.185 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:16.185 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:16.185 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:16.186 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:16.186 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:16.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:16.186 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:16.186 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:16.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:16.186 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:16.186 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:16.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.187 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.187 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:16.187 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:16.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.187 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:16.187 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:16.187 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:16.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.187 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:16.188 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:16.188 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:16.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.188 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:16.188 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:16.188 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:16.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.188 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:16.188 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:16.188 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:16.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:16.189 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.106983993999997, 2024-04-26T10:43:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:16.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:16.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:16.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:16.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:16.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:16.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:16.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.192 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:16.192 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:16.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:16.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.192 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:16.192 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:16.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:16.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.192 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.192 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:16.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:16.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.193 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:16.193 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:16.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:16.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.193 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:16.193 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:16.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:16.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.193 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:16.194 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:16.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:16.194 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.194 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:16.194 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.194 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:16.194 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:16.194 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.106956744000001, 2024-04-26T10:43:16.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:16.194 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:16.194 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:16.194 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:16.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.195 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:16.195 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:16.195 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.195 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:16.195 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:16.195 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.195 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:16.195 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:16.195 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:16.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:16.196 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:16.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:16.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:16.196 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:16.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:16.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:16.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.197 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:16.197 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:16.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:16.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.197 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:16.197 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:16.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:16.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.197 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:16.198 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:16.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:16.198 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.198 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:16.198 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.198 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:16.198 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:16.198 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.104179993000002, 2024-04-26T10:43:16.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:16.198 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:16.198 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:16.199 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:16.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:16.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:16.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:16.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:16.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:16.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:16.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:16.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:16.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:16.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:16.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:16.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:16.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:16.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:16.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:16.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:16.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:16.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:16.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:16.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:16.201 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.201 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:16.201 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.202 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:16.202 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:16.202 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.104129903999997, 2024-04-26T10:43:16.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:16.202 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:16.202 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.202 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:16.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.202 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:16.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:16.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:16.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:16.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:16.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:16.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:16.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:16.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:16.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:16.204 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:16.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:16.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.204 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:16.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:16.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:16.204 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:16.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:16.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.205 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:16.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:16.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:16.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.205 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:16.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:16.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:16.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.205 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:16.206 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:16.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:16.206 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.206 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:16.206 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.206 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:16.206 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:16.206 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.103237835000002, 2024-04-26T10:43:16.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:16.206 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:16.206 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.206 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:16.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:16.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:16.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:16.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:16.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:16.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:16.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:16.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:16.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:16.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:16.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:16.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:16.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:16.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:16.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.209 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:16.209 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:16.209 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:16.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.209 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:16.209 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:16.209 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:16.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.209 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:16.209 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:16.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:16.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.210 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:16.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:16.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:16.210 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.210 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:16.210 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.210 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:16.210 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:16.210 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.101049506000003, 2024-04-26T10:43:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:16.211 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:16.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:16.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.213 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.213 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:16.213 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:16.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.213 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:16.213 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:16.213 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:16.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.213 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:16.213 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:16.214 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.100914136, 2024-04-26T10:43:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:16.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.217 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.100699562000003, 2024-04-26T10:43:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.219 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:16.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.220 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:16.220 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:16.220 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.220 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:16.220 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:16.220 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.220 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:16.220 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:16.222 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:16.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.222 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:16.222 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:16.222 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:16.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.222 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:16.222 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:16.222 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:16.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.223 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:16.223 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:16.223 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:16.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.223 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.223 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:16.223 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:16.223 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:16.223 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.223 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:16.223 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.223 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.223 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:16.224 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:16.224 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.100360621, 2024-04-26T10:43:16.224 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:16.224 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:16.224 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.224 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:16.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.224 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:16.224 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:16.224 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.224 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:16.224 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:16.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:16.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:16.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:16.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:16.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:16.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:16.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:16.226 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:16.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.226 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.226 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:16.226 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:16.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.226 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:16.226 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:16.226 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:16.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.227 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:16.227 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:16.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:16.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.227 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:16.227 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:16.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:16.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.227 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:16.227 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:16.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:16.227 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.227 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:16.228 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.228 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:16.228 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:16.228 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.100251243999999, 2024-04-26T10:43:16.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:16.228 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:16.228 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:16.228 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:16.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.228 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:16.228 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:16.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.229 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:16.229 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:16.229 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.229 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:16.229 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:16.229 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:16.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.229 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:16.229 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:16.230 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:16.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.230 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:16.230 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:16.230 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:16.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.230 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.230 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:16.230 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:16.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.230 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:16.231 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:16.231 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:16.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.231 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:16.231 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:16.231 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:16.231 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.231 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:16.231 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.231 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:16.231 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:16.232 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.100211524999999, 2024-04-26T10:43:16.232 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:16.232 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:16.232 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.232 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:16.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.232 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:16.232 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:16.232 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.232 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:16.232 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:16.232 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.233 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:16.233 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:16.233 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:16.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.233 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:16.233 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:16.233 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:16.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.233 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:16.233 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:16.233 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:16.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.234 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.234 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:16.234 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:16.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.234 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:16.234 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:16.234 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:16.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.234 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:16.235 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:16.235 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:16.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.235 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:16.235 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:16.235 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:16.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.235 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:16.235 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:16.235 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:16.235 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.235 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:16.236 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.236 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:16.236 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:16.236 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.099873991999999, 2024-04-26T10:43:16.236 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:16.236 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:16.236 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.236 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:16.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.236 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:16.236 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:16.236 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.237 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:16.237 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:16.237 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:16.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.237 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:16.237 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:16.237 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.237 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:16.238 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:16.238 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:16.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.238 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:16.238 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:16.238 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:16.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.238 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.238 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:16.239 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:16.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.239 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:16.239 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:16.239 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:16.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.239 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:16.239 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:16.239 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:16.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.239 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:16.239 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:16.240 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:16.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:16.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:16.240 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:16.240 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:16.240 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:16.240 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.240 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:16.240 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.240 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:16.240 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:16.240 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:16.242 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:16.241+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:16.243 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:16.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-26T10:43:16.342 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:16.341+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:16.347 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:16.347 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:16.347 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:16.347 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:16.356 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:16.444 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:16.442+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:16.496 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:16.497 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:16.497 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:16.497 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:16.497 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:16.506 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:16.527 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:43:16.547 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:16.546+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:16.645 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:16.644+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:16.649 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:16.649 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:16.649 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:16.649 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:16.649 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.649 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:16.649 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:16.650 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 50.610995903000003, 2024-04-26T10:43:16.650 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:16.650 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:16.650 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.650 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:16.650 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.650 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:16.650 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:16.650 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.650 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.650 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.650 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:16.650 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:16.650 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.651 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.651 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.651 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:16.651 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:16.651 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.651 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.651 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.651 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:16.651 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:16.651 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:16.651 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.651 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.651 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:16.651 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:16.652 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:16.652 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.652 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.652 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.652 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:16.652 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:16.652 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.652 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.652 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:16.652 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:16.652 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:16.653 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.653 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.653 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:16.653 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:16.653 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:16.653 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.653 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.653 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:16.653 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:16.653 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:16.653 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.653 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.653 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:16.654 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:16.654 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:16.654 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.654 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:16.654 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.654 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.654 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.654 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:16.654 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:16.654 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 50.610125123000003, 2024-04-26T10:43:16.654 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:16.654 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:16.654 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.654 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:16.655 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.655 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:16.655 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:16.655 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.655 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.655 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.655 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:16.655 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:16.655 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.656 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.656 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.656 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:16.656 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:16.656 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.656 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.656 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.656 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:16.656 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:16.656 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:16.656 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.656 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.656 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:16.657 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:16.657 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:16.657 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.657 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.657 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.657 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:16.657 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:16.657 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.657 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.657 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:16.657 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:16.657 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:16.657 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.657 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.658 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:16.658 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:16.658 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:16.658 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.658 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.658 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:16.658 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:16.658 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:16.658 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.658 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.658 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:16.658 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:16.658 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:16.658 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.659 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:16.659 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.659 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.659 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.659 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:16.659 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:16.659 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 50.609137779999998, 2024-04-26T10:43:16.659 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:16.659 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:16.659 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.659 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:16.659 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.659 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:16.659 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:16.660 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.660 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.660 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.660 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:16.660 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:16.660 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.660 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.660 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.660 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:16.660 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:16.660 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:16.660 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.660 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.661 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:16.661 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:16.661 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:16.661 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.661 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.661 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:16.661 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:16.661 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:16.661 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.661 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.661 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.661 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:16.661 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:16.661 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.661 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.661 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:16.662 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:16.662 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:16.662 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.662 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.662 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:16.662 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:16.662 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:16.662 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.662 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.662 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:16.662 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:16.662 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:16.662 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.663 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.663 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:16.663 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:16.663 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:16.663 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.663 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:16.663 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.663 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.663 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.663 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:16.663 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:16.663 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 50.608932514999999, 2024-04-26T10:43:16.663 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:16.663 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:16.663 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.664 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:16.664 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.664 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:16.664 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:16.664 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.664 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.664 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.664 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:16.664 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:16.664 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.664 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.664 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.664 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:16.665 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:16.665 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.665 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.665 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.665 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:16.665 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:16.665 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:16.665 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.665 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.665 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:16.665 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:16.665 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:16.665 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.665 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.666 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.666 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:16.666 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:16.666 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.666 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.666 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:16.666 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:16.666 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:16.666 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.667 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.667 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:16.667 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:16.667 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:16.667 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.668 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.668 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:16.668 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:16.668 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:16.668 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.668 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.668 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:16.668 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:16.668 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:16.669 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.669 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:16.669 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.669 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.669 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.669 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:16.669 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:16.669 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 50.608611635999999, 2024-04-26T10:43:16.669 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:16.669 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:16.669 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.669 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:16.669 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.669 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:16.670 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:16.670 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.670 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.670 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.670 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:16.670 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:16.670 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.670 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.670 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.670 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:16.670 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:16.670 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:16.670 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.670 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.671 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:16.671 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:16.671 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:16.671 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.671 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.671 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:16.671 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:16.671 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:16.671 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.671 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.671 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.671 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:16.671 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:16.671 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.671 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.672 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:16.672 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:16.672 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:16.672 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.672 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.672 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:16.672 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:16.672 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:16.672 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.672 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.672 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:16.673 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:16.673 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:16.673 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.673 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.673 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:16.673 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:16.673 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:16.673 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.673 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.673 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:16.673 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:16.673 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:16.673 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.673 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.673 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:16.674 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:16.674 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:16.674 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.674 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.674 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:16.674 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:16.674 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:16.674 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.674 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:16.674 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.674 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.674 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.674 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:16.674 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:16.674 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 50.608559812000003, 2024-04-26T10:43:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.675 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.676 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:16.676 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:16.676 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.676 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.676 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.677 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:16.677 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:16.677 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:16.677 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.677 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.677 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:16.677 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:16.677 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:16.677 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.677 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.677 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.678 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.679 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:16.679 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:16.679 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:16.679 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.679 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.679 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:16.679 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:16.679 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:16.679 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.679 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.679 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:16.679 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:16.679 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:16.679 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.679 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.680 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:16.680 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:16.680 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:16.680 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.680 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.680 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:16.680 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:16.680 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:16.680 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.680 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:16.680 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.680 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.680 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.680 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:16.681 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:16.681 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 50.608506439999999, 2024-04-26T10:43:16.681 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:16.681 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:16.681 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.681 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:16.681 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.681 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:16.681 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:16.681 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.681 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.681 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.681 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:16.681 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:16.682 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.682 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.682 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.682 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:16.682 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:16.682 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.682 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.682 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.682 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:16.682 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:16.682 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:16.682 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.682 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.682 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:16.682 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:16.683 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:16.683 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.683 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.683 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.683 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:16.683 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:16.683 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.683 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.683 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:16.683 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:16.683 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:16.683 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.683 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.683 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:16.684 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:16.684 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:16.684 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.684 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.684 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:16.684 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:16.684 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:16.684 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.684 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.684 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:16.684 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:16.684 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:16.684 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.684 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.685 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:16.685 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:16.685 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:16.685 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.685 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.685 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:16.685 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:16.685 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:16.685 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.685 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.685 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:16.685 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:16.685 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:16.686 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.686 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:16.686 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.686 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.686 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.686 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:16.686 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:16.686 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 50.608462113000002, 2024-04-26T10:43:16.686 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:16.687 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:16.687 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.687 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:16.687 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.687 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:16.687 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:16.687 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.687 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.687 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.687 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:16.687 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:16.687 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.687 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.688 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.688 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:16.688 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:16.688 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:16.688 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.688 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.688 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:16.688 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:16.688 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:16.688 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.688 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.688 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:16.688 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:16.688 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:16.688 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.689 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.689 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.689 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:16.689 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:16.689 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.689 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.689 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:16.689 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:16.689 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:16.689 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.689 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.689 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:16.689 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:16.689 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:16.690 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.690 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.690 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:16.690 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:16.690 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:16.690 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.690 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.690 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:16.690 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:16.690 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:16.690 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.690 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.690 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:16.690 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:16.691 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:16.691 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.691 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.691 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:16.691 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:16.691 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:16.691 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.691 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.691 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:16.691 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:16.691 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:16.691 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.691 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:16.691 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.691 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.692 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.692 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:16.692 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:16.692 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 50.608438399999997, 2024-04-26T10:43:16.692 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:16.692 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:16.692 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.692 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:16.692 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.692 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:16.692 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:16.692 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.692 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.692 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.692 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:16.693 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:16.693 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.693 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.693 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.693 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:16.693 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:16.693 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.693 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.693 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.693 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:16.693 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:16.693 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:16.693 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.693 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.694 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:16.694 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:16.694 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:16.694 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.694 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.694 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.694 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:16.694 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:16.694 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.694 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.694 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:16.694 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:16.694 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:16.694 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.695 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.695 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:16.695 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:16.695 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:16.695 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.695 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.695 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:16.695 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:16.695 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:16.695 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.695 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.695 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:16.695 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:16.695 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:16.696 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.696 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.696 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:16.696 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:16.696 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:16.696 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.696 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.696 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:16.696 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:16.696 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:16.696 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.696 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.696 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:16.696 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:16.697 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:16.697 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.697 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:16.697 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.697 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.697 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.697 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:16.697 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:16.697 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 50.608404094999997, 2024-04-26T10:43:16.697 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:16.697 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:16.697 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.697 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:16.697 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.698 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:16.698 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:16.698 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.698 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.698 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.698 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:16.698 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:16.698 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.698 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.698 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.699 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:16.699 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:16.699 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.699 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.699 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.699 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:16.699 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:16.699 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:16.699 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.699 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.699 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:16.699 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:16.699 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:16.699 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.699 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.700 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.700 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:16.700 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:16.700 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.700 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.700 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:16.700 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:16.700 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:16.700 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.700 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.700 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:16.700 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:16.700 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:16.700 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.700 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.701 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:16.701 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:16.701 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:16.701 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.701 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.701 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:16.701 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:16.701 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:16.701 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.701 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.701 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:16.701 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:16.701 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:16.701 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.702 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.702 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:16.702 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:16.702 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:16.702 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.702 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.702 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:16.702 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:16.702 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:16.702 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.702 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:16.702 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.702 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.702 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.702 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:16.703 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:16.703 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 50.608067499000001, 2024-04-26T10:43:16.703 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:16.703 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:16.703 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:16.703 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:16.703 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.703 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:16.703 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:16.703 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.703 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.703 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.703 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:16.703 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:16.704 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.704 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.704 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.704 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:16.704 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:16.704 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:16.704 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.704 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.704 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:16.704 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:16.704 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:16.704 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.704 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.704 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:16.705 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:16.705 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:16.705 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.705 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.705 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.705 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:16.705 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:16.705 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.705 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.705 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:16.705 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:16.705 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:16.705 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.706 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.706 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:16.706 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:16.706 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:16.706 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.706 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.706 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:16.706 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:16.706 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:16.706 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.706 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:16.706 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.706 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.706 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.706 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:16.707 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:16.707 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 50.608025470999998, 2024-04-26T10:43:16.707 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:16.707 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:16.707 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:16.707 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:16.707 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.707 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:16.707 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:16.707 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.707 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.707 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.707 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:16.707 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:16.708 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.708 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.708 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:16.708 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:16.708 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.708 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.708 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:16.708 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:16.708 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:16.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.708 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.708 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:16.709 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:16.709 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:16.709 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.709 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.709 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.709 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:16.709 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:16.709 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.709 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.709 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:16.709 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:16.709 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:16.709 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.710 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.710 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:16.710 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:16.710 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:16.710 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.710 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.710 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:16.710 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:16.710 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:16.710 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.710 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:16.710 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.710 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.710 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.711 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:16.711 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:16.711 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 50.607972298999996, 2024-04-26T10:43:16.711 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:16.711 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:16.711 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:16.711 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:16.711 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.711 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:16.711 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:16.711 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.711 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.711 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.711 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:16.712 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:16.712 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.712 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.712 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.712 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:16.712 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:16.712 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.712 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.712 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.712 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:16.712 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:16.712 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:16.712 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.713 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.713 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:16.713 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:16.713 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:16.713 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.713 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.713 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.713 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:16.713 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:16.713 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.713 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.713 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:16.713 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:16.713 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:16.713 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.714 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.714 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:16.714 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:16.714 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:16.714 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.714 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.714 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:16.714 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:16.714 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:16.714 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.714 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:16.714 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.714 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.714 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.715 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:16.715 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:16.715 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 50.604565889, 2024-04-26T10:43:16.715 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:16.715 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:16.715 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:16.715 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:16.715 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.715 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:16.715 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:16.715 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.715 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.715 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.715 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:16.716 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:16.716 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.716 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.716 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.716 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:16.716 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:16.716 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.716 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.716 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.716 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:16.716 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:16.716 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:16.716 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.716 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.717 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:16.717 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:16.717 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:16.717 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.717 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.717 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.717 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:16.717 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:16.717 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.717 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.717 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:16.717 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:16.717 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:16.718 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.718 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.718 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:16.718 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:16.718 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:16.718 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.718 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:16.718 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.718 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.718 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.718 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:16.718 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:16.718 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 50.602093936000003, 2024-04-26T10:43:16.719 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:16.719 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:16.719 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:16.719 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:16.719 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.719 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:16.719 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:16.719 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.719 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.719 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.719 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:16.719 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:16.719 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.719 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.720 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.720 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:16.720 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:16.720 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.720 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.720 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.720 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:16.720 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:16.720 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:16.720 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.720 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.720 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:16.720 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:16.720 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:16.721 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.721 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.721 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.721 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:16.721 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:16.721 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.721 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.721 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:16.721 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:16.721 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:16.721 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.721 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.721 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:16.721 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:16.722 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:16.722 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.722 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.722 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:16.722 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:16.722 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:16.722 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.722 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:16.722 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.722 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.722 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.722 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:16.722 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:16.722 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 50.601440377999999, 2024-04-26T10:43:16.723 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:16.723 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:16.723 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:16.723 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:16.723 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.723 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:16.723 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:16.723 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.723 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.723 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.723 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:16.723 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:16.723 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.723 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.724 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.724 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:16.724 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:16.724 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.724 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.724 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.724 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:16.724 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:16.724 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:16.724 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.724 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.724 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:16.724 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:16.724 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:16.724 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.725 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.725 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.725 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:16.725 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:16.725 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.725 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.725 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:16.725 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:16.725 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:16.725 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.725 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.725 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:16.725 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:16.725 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:16.725 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.726 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.726 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:16.726 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:16.726 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:16.726 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.726 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:16.726 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.726 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.726 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.726 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:16.726 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:16.726 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 50.601364593, 2024-04-26T10:43:16.726 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:16.726 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:16.727 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:16.727 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:16.727 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.727 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:16.727 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:16.727 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.727 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.727 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.727 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:16.727 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:16.727 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.727 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.727 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.727 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:16.727 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:16.728 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.728 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.728 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.728 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:16.728 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:16.728 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:16.728 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.728 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.728 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:16.728 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:16.728 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:16.728 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.728 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.728 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.728 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:16.729 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:16.729 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.729 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.729 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:16.729 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:16.729 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:16.730 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.730 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.730 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:16.730 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:16.730 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:16.730 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.730 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.730 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:16.730 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:16.730 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:16.730 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.730 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:16.730 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.730 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.731 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.731 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:16.731 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:16.731 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 50.601150898999997, 2024-04-26T10:43:16.731 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:16.731 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:16.731 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:16.731 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:16.731 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.731 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:16.731 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:16.731 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.731 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.731 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.731 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:16.732 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:16.732 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.732 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.732 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.732 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:16.732 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:16.732 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:16.732 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.732 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.732 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:16.732 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:16.732 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:16.732 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.732 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.732 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:16.733 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:16.733 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:16.733 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.733 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.733 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.733 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:16.733 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:16.733 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.733 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.733 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:16.733 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:16.733 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:16.733 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.733 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.734 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:16.734 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:16.734 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:16.734 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.734 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:16.734 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.734 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.734 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.734 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:16.734 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:16.734 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 50.598707085999997, 2024-04-26T10:43:16.734 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:16.734 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:16.734 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:16.734 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:16.735 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.735 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:16.735 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:16.735 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.735 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.735 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.735 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:16.735 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:16.735 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.735 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.735 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.735 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:16.735 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:16.735 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:16.735 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.736 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.736 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:16.736 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:16.736 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:16.736 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.736 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.736 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:16.736 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:16.736 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:16.736 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.736 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.736 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.736 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:16.736 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:16.737 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.737 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.737 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:16.737 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:16.737 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:16.737 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.737 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.737 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:16.737 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:16.737 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:16.737 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.737 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.737 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:16.738 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:16.738 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:16.738 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.738 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:16.738 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.738 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.738 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.738 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:16.738 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:16.738 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 45.148644642000001, 2024-04-26T10:43:16.738 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:16.738 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:16.739 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:16.739 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:16.739 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.739 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:16.739 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:16.739 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.739 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.739 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.739 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:16.739 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:16.740 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:16.740 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.740 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.740 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:16.740 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:16.740 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:16.740 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.740 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.740 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:16.740 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:16.740 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:16.740 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.740 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.741 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:16.741 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:16.741 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:16.741 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.741 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.741 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:16.741 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:16.741 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:16.741 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.741 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.741 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:16.741 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:16.741 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:16.741 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.741 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.742 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:16.742 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:16.742 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:16.742 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.742 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.742 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:16.742 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:16.742 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:16.742 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.742 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.742 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:16.742 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:16.742 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:16.742 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.743 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.743 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:16.743 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:16.743 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:16.743 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.743 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.743 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:16.743 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:16.743 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:16.743 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:16.743 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:16.743 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:16.743 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:16.743 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:16.743 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.744 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:16.744 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.744 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:16.744 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:16.744 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:16.744 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:16.745 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:16.745 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:43:16.746 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:16.746 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:16.747 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:43:16.747 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:16.747 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:43:16.749 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:16.747+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:16.849 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:16.847+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:16.859 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:16.860 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:16.870 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:16.949 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:16.948+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:16.975 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:16.976 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:16.984 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:17.070 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:17.068+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:17.131 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:17.131 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:17.141 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:17.182 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:17.180+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:17.245 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:17.245 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:17.252 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:17.251+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:17.254 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:17.354 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:17.353+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:17.354 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:17.354 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:17.362 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:17.455 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:17.453+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:17.464 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:17.464 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:17.473 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:17.556 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:17.555+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:17.584 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:17.585 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:17.594 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:17.657 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:17.657+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:17.699 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:17.699 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:17.708 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:17.758 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:17.756+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:17.814 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:17.814 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:17.823 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:17.867 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:17.866+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:17.927 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:17.927 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:17.936 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:17.960 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:17.959+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:18.061 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:18.060+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:18.076 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:18.076 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:18.085 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:18.169 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:18.168+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:18.227 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:18.227 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:18.236 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:18.243 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:43:18.277 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:18.276+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:18.350 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:18.350 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:18.359 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:18.403 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:18.401+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:18.465 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:18.466 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:18.466 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:18.465+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:18.475 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:18.567 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:18.566+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:18.621 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:18.621 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:18.630 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:18.674 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:18.673+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:18.735 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:18.735 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:18.744 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:18.749 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:43:18.786 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:18.784+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:18.870 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:18.869+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:18.884 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:18.884 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:18.885 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:43:18.886 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:18.886 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:18.897 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:18.903 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:18.903 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:18.906 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:43:18.906 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:43:18.971 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:18.969+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:19.042 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:19.042 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:19.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:19.042 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:19.042 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.042 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:19.042 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:19.042 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.003421459000002, 2024-04-26T10:43:19.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:19.042 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.043 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.043 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.043 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.043 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.043 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:19.043 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.043 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.043 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.043 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.043 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:19.043 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.043 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.043 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.044 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.044 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:19.044 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.044 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.044 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.044 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.044 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:19.044 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:19.044 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.044 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.044 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.044 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:19.044 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:19.044 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.045 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.045 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.045 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:19.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:19.045 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.045 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.045 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.045 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:19.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:19.045 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.045 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.045 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:19.045 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:19.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:19.045 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.046 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.046 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:19.046 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:19.046 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:19.046 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.046 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.046 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.046 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:19.046 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:19.046 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.046 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.046 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.046 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.047 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.047 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:19.047 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:19.047 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.002550679000002, 2024-04-26T10:43:19.047 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:19.047 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.047 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.047 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.047 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.047 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.047 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:19.047 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.047 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.047 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.048 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.048 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:19.048 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.048 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.048 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.048 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.048 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:19.048 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.048 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.048 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.048 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.048 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:19.048 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:19.048 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.049 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.049 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.049 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:19.049 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:19.049 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.049 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.049 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.049 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:19.049 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:19.049 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.049 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.049 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.049 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:19.049 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:19.049 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.050 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:19.050 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:19.050 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:19.050 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.050 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:19.050 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:19.050 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:19.050 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.050 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.050 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:19.051 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:19.051 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.051 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.051 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.051 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.051 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.051 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:19.051 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:19.051 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.001563335999997, 2024-04-26T10:43:19.051 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:19.051 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.051 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.051 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.051 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.052 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.052 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:19.052 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.052 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.052 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.052 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.052 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:19.052 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.052 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.052 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.052 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.052 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:19.052 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:19.053 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.053 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.053 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.053 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:19.053 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:19.053 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.053 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.053 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.053 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:19.053 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:19.053 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.053 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.053 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.053 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:19.053 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:19.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.054 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.054 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:19.054 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:19.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.054 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:19.054 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:19.054 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:19.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.054 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:19.054 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:19.055 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:19.055 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.055 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.055 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.055 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:19.055 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:19.055 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.055 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.055 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.055 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.055 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.055 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:19.055 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:19.056 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.001358070999999, 2024-04-26T10:43:19.056 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:19.056 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.056 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.056 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.056 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.056 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:19.056 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.056 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.056 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.057 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:19.057 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.057 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.057 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.057 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.057 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:19.057 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.057 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.057 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.057 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.057 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:19.057 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:19.057 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.057 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.057 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.058 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:19.058 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:19.058 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.058 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.058 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.058 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:19.058 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:19.058 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.058 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.058 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.058 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:19.058 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:19.058 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.059 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.059 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:19.059 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:19.059 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:19.059 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.059 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.059 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:19.060 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:19.060 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:19.060 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.060 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.060 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.060 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:19.060 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:19.060 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.060 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.060 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.060 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.060 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.060 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:19.061 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:19.061 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.001037191999998, 2024-04-26T10:43:19.061 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:19.061 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.061 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.061 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.061 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.061 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.061 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:19.061 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.061 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.061 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.061 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.062 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:19.062 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.062 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.062 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.062 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.062 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:19.062 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:19.062 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.062 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.062 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.062 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:19.062 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:19.063 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.063 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.063 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.063 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:19.063 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:19.063 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.063 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.063 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.063 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:19.063 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:19.063 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.063 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.063 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.063 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:19.064 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:19.064 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.064 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.064 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:19.064 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:19.064 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:19.064 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.064 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.064 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:19.064 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:19.064 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:19.064 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.064 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.064 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:19.064 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:19.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:19.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:19.065 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:19.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:19.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:19.065 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:19.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:19.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.065 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:19.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:19.066 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.066 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.066 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.066 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.066 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:19.066 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:19.066 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.000985368000002, 2024-04-26T10:43:19.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:19.066 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.066 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.066 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.067 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.067 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.067 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:19.067 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.067 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.067 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.067 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:19.067 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.067 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.067 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.067 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:19.067 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.068 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.068 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.068 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:19.068 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:19.068 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.068 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.068 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.068 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:19.068 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:19.068 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.068 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.068 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.068 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:19.068 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:19.069 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.069 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.069 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.069 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:19.069 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:19.069 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.069 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.069 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:19.069 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:19.069 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:19.069 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.069 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.069 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:19.069 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:19.070 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:19.070 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.070 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.070 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:19.070 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:19.070 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:19.070 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.070 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.070 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:19.070 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:19.070 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:19.071 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.071 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.071 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:19.071 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:19.071 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:19.071 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.071 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.071 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.071 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:19.072 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:19.072 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.072 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.072 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.072 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.072 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.072 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:19.072 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:19.072 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.000931995999998, 2024-04-26T10:43:19.072 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:19.072 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.073 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.073 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.073 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.073 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.073 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:19.073 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.073 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.073 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.073 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.073 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:19.073 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.073 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.073 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.073 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.073 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:19.074 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.074 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.074 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.074 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.074 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:19.074 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:19.074 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.074 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.074 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.075 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:19.075 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:19.075 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.075 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.075 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.075 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:19.075 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:19.076 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.076 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.076 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.076 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:19.076 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:19.076 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.076 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.076 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:19.077 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:19.077 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:19.077 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.077 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.077 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:19.077 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:19.078 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:19.078 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.078 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.078 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:19.078 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:19.078 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:19.079 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.079 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.079 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:19.079 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:19.079 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:19.079 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.079 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.080 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:19.080 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:19.080 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:19.080 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.080 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.080 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.080 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:19.081 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:19.081 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.081 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.081 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.081 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.081 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.081 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:19.081 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:19.082 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.000887669000001, 2024-04-26T10:43:19.082 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:19.082 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.082 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.082 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.082 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.083 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.083 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:19.083 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.083 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.083 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.083 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.084 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:19.084 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.084 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.084 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.084 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.084 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:19.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:19.085 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.085 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.085 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.085 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:19.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:19.085 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.085 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.086 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.086 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:19.086 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:19.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.086 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.086 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.086 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:19.086 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:19.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.086 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.086 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.087 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:19.087 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:19.087 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.087 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.087 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:19.087 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:19.087 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:19.087 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.087 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.087 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:19.087 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:19.087 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:19.087 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.088 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.088 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:19.088 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:19.088 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:19.088 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.088 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.088 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:19.088 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:19.088 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:19.088 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.088 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.088 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:19.089 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:19.089 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:19.089 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.089 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.089 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.089 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:19.089 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:19.089 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.089 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.089 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.090 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.090 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.090 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:19.090 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:19.090 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.000863956000003, 2024-04-26T10:43:19.090 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:19.090 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.090 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.090 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.090 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.090 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.091 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:19.091 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.091 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.091 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.091 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.091 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:19.091 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.091 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.091 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.091 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.091 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:19.091 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.091 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.092 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.092 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.092 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:19.092 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:19.092 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.092 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.092 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.092 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:19.092 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:19.092 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.092 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.092 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.092 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:19.092 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:19.093 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.093 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.093 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.093 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:19.093 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:19.093 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.093 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.093 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:19.093 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:19.093 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:19.093 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.093 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.093 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:19.093 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:19.094 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:19.094 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.094 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.094 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:19.094 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:19.095 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:19.095 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.095 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.095 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:19.095 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:19.095 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:19.095 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.095 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.095 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:19.095 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:19.095 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:19.096 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.096 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.096 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.096 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:19.096 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:19.096 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.096 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.096 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.096 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.096 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.096 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:19.096 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:19.096 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.000829650999997, 2024-04-26T10:43:19.097 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:19.097 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.097 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.097 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.097 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.097 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.097 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:19.097 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.097 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.097 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.097 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.097 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:19.097 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.097 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.098 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.098 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.098 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:19.098 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.098 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.098 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.098 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.098 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:19.098 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:19.099 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.099 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.099 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.099 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:19.099 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:19.099 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.099 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.099 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.099 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:19.099 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:19.099 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.099 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.099 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.099 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:19.099 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:19.100 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.100 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.100 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:19.100 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:19.100 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:19.100 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.100 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.100 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:19.100 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:19.100 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:19.100 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.100 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.100 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:19.100 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:19.101 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:19.101 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.101 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.101 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:19.101 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:19.101 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:19.101 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.101 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.101 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:19.101 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:19.101 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:19.101 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.102 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.102 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.102 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:19.102 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:19.102 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.102 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.102 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.102 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.102 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.102 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:19.102 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:19.102 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.000493055, 2024-04-26T10:43:19.102 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:19.103 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.103 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:19.103 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.103 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.103 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.103 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:19.103 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.103 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.104 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.104 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.104 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:19.104 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.104 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.104 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.105 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.105 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:19.105 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:19.105 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.105 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.105 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.106 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:19.106 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:19.106 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.106 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.106 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.106 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:19.106 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:19.106 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.106 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.106 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.107 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:19.107 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:19.107 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.107 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.107 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.107 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:19.107 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:19.108 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.108 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.108 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:19.108 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:19.108 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:19.108 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.108 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.108 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.108 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:19.108 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:19.109 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.109 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.109 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.109 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.109 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.109 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:19.109 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:19.109 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.000451026999997, 2024-04-26T10:43:19.109 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:19.109 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.109 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:19.109 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.109 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.109 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.110 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:19.110 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.110 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.110 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.110 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.110 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:19.110 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.110 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.110 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.110 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.111 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:19.111 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.111 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.111 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.111 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.111 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:19.111 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:19.111 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.111 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.111 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.111 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:19.111 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:19.111 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.112 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.112 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.112 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:19.112 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:19.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.112 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.112 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.112 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:19.112 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:19.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.112 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.112 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:19.112 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:19.113 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:19.113 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.113 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.113 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.113 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:19.113 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:19.113 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.113 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.113 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.113 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.113 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.113 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:19.113 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:19.113 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.000397855000003, 2024-04-26T10:43:19.114 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:19.114 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.114 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:19.114 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.114 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.114 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.114 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:19.114 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.114 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.114 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.114 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.115 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:19.115 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.115 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.115 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.115 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.115 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:19.115 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.116 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.116 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.116 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.116 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:19.116 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:19.116 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.116 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.116 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.116 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:19.117 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:19.117 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.117 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.117 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.117 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:19.117 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:19.118 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.118 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.118 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.118 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:19.118 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:19.118 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.119 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.119 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:19.119 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:19.119 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:19.119 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.119 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.120 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.120 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:19.120 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:19.120 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.120 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.120 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.120 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.120 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.120 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:19.120 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:19.121 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 52.996991444999999, 2024-04-26T10:43:19.121 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:19.121 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.121 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:19.121 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.121 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.121 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.121 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:19.121 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.121 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.121 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.121 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.121 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:19.122 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.122 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.122 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.122 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.122 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:19.122 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.122 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.122 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.122 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.122 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:19.122 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:19.123 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.123 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.123 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.123 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:19.123 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:19.123 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.123 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.123 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.123 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:19.123 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:19.123 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.123 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.123 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.123 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:19.124 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:19.124 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.124 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.124 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.124 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:19.124 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:19.124 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.124 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.124 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.124 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.124 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.124 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:19.124 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:19.124 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 52.994519492000002, 2024-04-26T10:43:19.125 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:19.125 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.125 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:19.125 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.125 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.125 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.125 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:19.125 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.125 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.125 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.125 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.125 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:19.125 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.125 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.126 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.126 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.126 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:19.126 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.126 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.126 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.126 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.126 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:19.126 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:19.126 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.126 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.126 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.126 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:19.126 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:19.127 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.127 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.127 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.127 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:19.127 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:19.127 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.127 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.127 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.127 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:19.127 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:19.127 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.127 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.128 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:19.128 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:19.128 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:19.128 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.128 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.128 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.128 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:19.128 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:19.129 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.129 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.129 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.129 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.129 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:19.129 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:19.130 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 52.993865933999999, 2024-04-26T10:43:19.130 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:19.130 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.130 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:19.130 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.130 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.130 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.130 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:19.130 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.130 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.130 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.130 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.130 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:19.131 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.131 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.131 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.131 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.131 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:19.131 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.131 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.131 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.131 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.131 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:19.131 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:19.131 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.131 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.131 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.132 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:19.132 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:19.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.132 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.132 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.132 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:19.132 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:19.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.132 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.132 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.132 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:19.132 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:19.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.132 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.132 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:19.133 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:19.133 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:19.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.133 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.133 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:19.133 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:19.133 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.133 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.133 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.133 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:19.133 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:19.134 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 52.993790148999999, 2024-04-26T10:43:19.134 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:19.134 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.134 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:19.134 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.134 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.134 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.134 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:19.134 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.134 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.134 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.134 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.134 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:19.134 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.135 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.135 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.135 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:19.135 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.135 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.135 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.135 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:19.135 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:19.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.135 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.135 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.135 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:19.135 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:19.136 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.136 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.136 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.136 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:19.136 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:19.136 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.136 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.136 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.136 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:19.136 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:19.136 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.136 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.136 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:19.136 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:19.136 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:19.137 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.137 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.137 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.137 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:19.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:19.137 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.137 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.137 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.137 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.137 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.137 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:19.137 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:19.137 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 52.993576455000003, 2024-04-26T10:43:19.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:19.137 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.138 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:19.138 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.138 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.138 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.138 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:19.138 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.138 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.138 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.138 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.138 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:19.138 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.138 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.138 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.138 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.138 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:19.139 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.139 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.139 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.139 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.139 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:19.139 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:19.139 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.139 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.139 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.139 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:19.139 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:19.139 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.139 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.139 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.139 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:19.139 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:19.140 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.140 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.140 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:19.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:19.140 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.140 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.140 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:19.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:19.140 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.140 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.140 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.141 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.141 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.141 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:19.141 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:19.141 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 52.991132641999997, 2024-04-26T10:43:19.141 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:19.141 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.141 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:19.141 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.141 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.141 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.141 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:19.141 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.141 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.142 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.142 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.142 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:19.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.142 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.142 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.142 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.142 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:19.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:19.142 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.142 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.142 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.142 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:19.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:19.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:19.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:19.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:19.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:19.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:19.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:19.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.144 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:19.144 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:19.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:19.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.144 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.144 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:19.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:19.144 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.144 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.144 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.145 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:19.145 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:19.145 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 47.541070198, 2024-04-26T10:43:19.145 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:19.145 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.145 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.145 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.145 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.145 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.145 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:19.145 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.145 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.145 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.145 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.146 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:19.146 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.146 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.146 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.146 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.146 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:19.146 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:19.146 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.146 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.146 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.146 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:19.146 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:19.146 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.146 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.147 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.147 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:19.147 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:19.147 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.147 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.147 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.147 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:19.147 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:19.147 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.147 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.147 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.147 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:19.147 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:19.147 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:19.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:19.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:19.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:19.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:19.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:19.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:19.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:19.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:19.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.149 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:19.149 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:19.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:19.149 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.149 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:19.149 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:19.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:19.149 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.149 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.149 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:19.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:19.150 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.150 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.150 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.150 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.150 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.150 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:19.150 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T10:43:19.160 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:19.149+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:19.161 INFO:teuthology.orchestra.run.smithi049.stderr:nodeep-scrub is unset 2024-04-26T10:43:19.162 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:19.253 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:19.252+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:19.260 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2024-04-26T10:43:19.277 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:19.277 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:19.277 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:19.277 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:19.286 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:19.353 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:19.352+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:19.362 INFO:teuthology.orchestra.console.smithi087:Power off completed 2024-04-26T10:43:19.393 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:19.393 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:19.393 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:19.393 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:19.393 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:19.402 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:19.454 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:19.452+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:19.509 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:19.509 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:19.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:19.509 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:19.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.509 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:19.509 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 53.471170207, 2024-04-26T10:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 53.469420086, 2024-04-26T10:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 53.469367087999998, 2024-04-26T10:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 53.469289344000003, 2024-04-26T10:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 53.469250338000002, 2024-04-26T10:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 53.469231516999997, 2024-04-26T10:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:19.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:19.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.539 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:19.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:19.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:19.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 53.469199515, 2024-04-26T10:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:19.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:19.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:19.546 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:19.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:19.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:19.546 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:19.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:19.547 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:19.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:19.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:19.547 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:19.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:19.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:19.547 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:19.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:19.547 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.548 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:19.548 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.548 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:19.548 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:19.548 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 53.468990707000003, 2024-04-26T10:43:19.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:19.548 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:19.548 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.548 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:19.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.548 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:19.548 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:19.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.549 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:19.549 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:19.549 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.549 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:19.549 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:19.549 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:19.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.549 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:19.549 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:19.550 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:19.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.550 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:19.550 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:19.550 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:19.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.550 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.550 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:19.550 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:19.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:19.551 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:19.551 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:19.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:19.551 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:19.551 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:19.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:19.551 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:19.551 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:19.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.552 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:19.552 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:19.552 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:19.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.552 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:19.552 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:19.552 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:19.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.552 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:19.552 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:19.553 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:19.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.553 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:19.553 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:19.553 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:19.553 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.553 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:19.553 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.554 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:19.555 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:19.556 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 53.468959415999997, 2024-04-26T10:43:19.556 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:19.556 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:19.556 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:19.556 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:19.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.556 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:19.556 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:19.556 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.556 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:19.556 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:19.557 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.557 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:19.557 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:19.557 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.557 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:19.557 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:19.557 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:19.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.557 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:19.557 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:19.558 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:19.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.558 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.558 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:19.558 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:19.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.558 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:19.558 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:19.558 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:19.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.558 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:19.559 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:19.559 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:19.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.559 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:19.559 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:19.559 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:19.559 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.559 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:19.559 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.559 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:19.559 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:19.560 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 53.468932166000002, 2024-04-26T10:43:19.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:19.560 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:19.560 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:19.560 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:19.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.560 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:19.560 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:19.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.560 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:19.560 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:19.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.561 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:19.561 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:19.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.561 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:19.561 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:19.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:19.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.561 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:19.561 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:19.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:19.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.562 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.562 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:19.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:19.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.562 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:19.562 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:19.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:19.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.562 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:19.562 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:19.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:19.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.563 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:19.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:19.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:19.563 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.563 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:19.563 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.563 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:19.563 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:19.563 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 53.466155415000003, 2024-04-26T10:43:19.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:19.564 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:19.564 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:19.564 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:19.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.564 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:19.564 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:19.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.564 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:19.564 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:19.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:19.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:19.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:19.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:19.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:19.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:19.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:19.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:19.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:19.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:19.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:19.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:19.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:19.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:19.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:19.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:19.567 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.567 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:19.567 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.567 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:19.567 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:19.567 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 53.466105325999997, 2024-04-26T10:43:19.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:19.567 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:19.567 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.567 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:19.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:19.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:19.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:19.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:19.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:19.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:19.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:19.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:19.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:19.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.569 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:19.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:19.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:19.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.569 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:19.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:19.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:19.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:19.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:19.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:19.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:19.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:19.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:19.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:19.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:19.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:19.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:19.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:19.571 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.571 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:19.571 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.571 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:19.571 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:19.571 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 53.465213257000002, 2024-04-26T10:43:19.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:19.572 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:19.572 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.572 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:19.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:19.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:19.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:19.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:19.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:19.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:19.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:19.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:19.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:19.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:19.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:19.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:19.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.574 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:19.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:19.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.574 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:19.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:19.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:19.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.574 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:19.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:19.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:19.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:19.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:19.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:19.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:19.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:19.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:19.575 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.575 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:19.575 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.575 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:19.576 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:19.576 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 53.463024928000003, 2024-04-26T10:43:19.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:19.576 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:19.576 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.576 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:19.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:19.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:19.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:19.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:19.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:19.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:19.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:19.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:19.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:19.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:19.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:19.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:19.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:19.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:19.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:19.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:19.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:19.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:19.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:19.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:19.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:19.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:19.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:19.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:19.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:19.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:19.579 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.579 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:19.579 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.580 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:19.580 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:19.580 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 53.462889558000001, 2024-04-26T10:43:19.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:19.580 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:19.580 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.580 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:19.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.580 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:19.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:19.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:19.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:19.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:19.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:19.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:19.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:19.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:19.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:19.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:19.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:19.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:19.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:19.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:19.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:19.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:19.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:19.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:19.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:19.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:19.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:19.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:19.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:19.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:19.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:19.584 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.584 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:19.584 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.584 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:19.584 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:19.584 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 53.462674984000003, 2024-04-26T10:43:19.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:19.584 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:19.584 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.584 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:19.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:19.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:19.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:19.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:19.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:19.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:19.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:19.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:19.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:19.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:19.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:19.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:19.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:19.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:19.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:19.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:19.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:19.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:19.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:19.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:19.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:19.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:19.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:19.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.588 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:19.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:19.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:19.588 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.588 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:19.588 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.588 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:19.588 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:19.588 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 53.462336043000001, 2024-04-26T10:43:19.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:19.589 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:19.589 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.589 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:19.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:19.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:19.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:19.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:19.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:19.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:19.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:19.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:19.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:19.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:19.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:19.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:19.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:19.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:19.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:19.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:19.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:19.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:19.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:19.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:19.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:19.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:19.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:19.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:19.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:19.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:19.592 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.592 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:19.592 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.593 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:19.593 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:19.593 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 53.462226665999999, 2024-04-26T10:43:19.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:19.593 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:19.593 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:19.593 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:19.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:19.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:19.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:19.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:19.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:19.594 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:19.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:19.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:19.594 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:19.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:19.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.595 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:19.595 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:19.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:19.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.595 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.596 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:19.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:19.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.596 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:19.596 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:19.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:19.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.596 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:19.596 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:19.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:19.596 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.596 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:19.597 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.597 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:19.597 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:19.597 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 53.462186946999999, 2024-04-26T10:43:19.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:19.597 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:19.597 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.597 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:19.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:19.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:19.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:19.598 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:19.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:19.598 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:19.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:19.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:19.598 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:19.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:19.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.599 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:19.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:19.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:19.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.599 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:19.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:19.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.599 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:19.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:19.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:19.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.600 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:19.600 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:19.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:19.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.600 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:19.600 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:19.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:19.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.600 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:19.600 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:19.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:19.601 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.601 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:19.601 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.601 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:19.601 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:19.601 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 53.461849414, 2024-04-26T10:43:19.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:19.601 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:19.601 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.601 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:19.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.601 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:19.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:19.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:19.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:19.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:19.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:19.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:19.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:19.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:19.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:19.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:19.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:19.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:19.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:19.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:19.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:19.604 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:19.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:19.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:19.604 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:19.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:19.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:19.604 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:19.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:19.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:19.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:19.605 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:19.605 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:19.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:19.605 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.605 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:19.605 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.605 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:19.605 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:19.605 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:19.607 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:19.607 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:19.605+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:19.707 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:19.705+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:19.713 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:19.713 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:19.713 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:19.713 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:19.722 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:19.808 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:19.807+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:19.862 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:19.863 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:19.863 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:19.863 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:19.863 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:19.872 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:19.915 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:19.914+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:19.974 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:19.974 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:19.974 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:19.974 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:19.975 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.975 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:19.975 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:19.975 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.935925619000002, 2024-04-26T10:43:19.975 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:19.975 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.975 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.975 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.975 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.975 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.975 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:19.975 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.975 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.976 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.976 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.976 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:19.976 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.976 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.976 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.976 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.976 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:19.976 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.976 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.976 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.976 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.976 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:19.976 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:19.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.977 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.977 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:19.977 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:19.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.977 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.977 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:19.977 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:19.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.977 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.977 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:19.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:19.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.978 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.978 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:19.978 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:19.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:19.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.978 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.978 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:19.978 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:19.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:19.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.978 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.978 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.979 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:19.979 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:19.979 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.979 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.979 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.979 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.979 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.979 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:19.979 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:19.979 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.935054839000003, 2024-04-26T10:43:19.979 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:19.979 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.979 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.979 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.979 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.980 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.980 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:19.980 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.980 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.980 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.980 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.980 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:19.980 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.980 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.980 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.980 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.980 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:19.981 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.981 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.981 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.981 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.981 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:19.981 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:19.981 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.981 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.981 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.981 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:19.981 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:19.981 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.981 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.981 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.982 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:19.982 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:19.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.982 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.982 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.982 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:19.982 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:19.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.982 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.982 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:19.982 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:19.982 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:19.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.982 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.983 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:19.983 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:19.983 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:19.983 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.983 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.983 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.983 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:19.983 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:19.983 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.983 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.983 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.983 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.983 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.983 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:19.984 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:19.984 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.934067495999997, 2024-04-26T10:43:19.984 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:19.984 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.984 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.984 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.984 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.984 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.984 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:19.984 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.984 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.984 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.984 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.984 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:19.984 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.985 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.985 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.985 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.985 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:19.985 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:19.985 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.985 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.985 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.985 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:19.985 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:19.985 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.985 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.985 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.985 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:19.986 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:19.986 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.986 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.986 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.986 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:19.986 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:19.986 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.986 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.986 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.986 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:19.986 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:19.986 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.986 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.986 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:19.987 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:19.987 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:19.987 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.987 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.987 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:19.987 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:19.987 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:19.987 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.987 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.987 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.987 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:19.987 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:19.987 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.987 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.988 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.988 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.988 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.988 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:19.988 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:19.988 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.933862230999999, 2024-04-26T10:43:19.988 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:19.988 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.988 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.988 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.988 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.988 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.988 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:19.988 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.989 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.989 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.989 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.989 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:19.989 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.989 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.989 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.989 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.989 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:19.989 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:19.989 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.989 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.989 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.989 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:19.990 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:19.990 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.990 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.990 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.990 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:19.990 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:19.990 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.990 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.990 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.990 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:19.990 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:19.990 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.990 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.990 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.991 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:19.991 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:19.991 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.991 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.991 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:19.991 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:19.991 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:19.991 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.991 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.991 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:19.992 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:19.992 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:19.992 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.992 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.992 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.992 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:19.992 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:19.992 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.992 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.992 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.992 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.992 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.992 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:19.992 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:19.993 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.933541351999999, 2024-04-26T10:43:19.993 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:19.993 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.993 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.993 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.993 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.993 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.993 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:19.993 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.993 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.993 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.993 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.993 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:19.993 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.994 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.994 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.994 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.994 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:19.994 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:19.994 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.994 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.994 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:19.994 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:19.994 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:19.994 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.994 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.994 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:19.995 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:19.995 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:19.995 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.995 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.995 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:19.995 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:19.995 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:19.995 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.995 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.995 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:19.995 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:19.995 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:19.995 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.996 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.996 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:19.996 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:19.996 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:19.996 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.996 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.996 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:19.996 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:19.996 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:19.996 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.996 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.996 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:19.996 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:19.996 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:19.996 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.997 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.997 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:19.997 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:19.997 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:19.997 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.997 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.997 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:19.997 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:19.997 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:19.997 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.997 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.997 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:19.997 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:19.997 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:19.998 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.998 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:19.998 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:19.998 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.998 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.998 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:19.998 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:19.998 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.933489528000003, 2024-04-26T10:43:19.998 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:19.998 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:19.998 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:19.998 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:19.998 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.999 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:19.999 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:19.999 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.999 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.999 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.999 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:19.999 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:19.999 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:19.999 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:19.999 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:19.999 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:19.999 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:19.999 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.000 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.000 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.000 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:20.000 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:20.000 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:20.000 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.000 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.000 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:20.000 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:20.000 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:20.000 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.000 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.000 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.000 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:20.000 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:20.001 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.001 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.001 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:20.001 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:20.001 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:20.001 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.001 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.001 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:20.001 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:20.001 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:20.001 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.001 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.001 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:20.001 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:20.002 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:20.002 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.002 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.002 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:20.002 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:20.002 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:20.002 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.002 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.002 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:20.002 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:20.002 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:20.002 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.002 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.002 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:20.003 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:20.003 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:20.003 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.003 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.003 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:20.003 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:20.003 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:20.003 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.003 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:20.003 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.003 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.003 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.003 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:20.004 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:20.004 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.933436155999999, 2024-04-26T10:43:20.004 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:20.004 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:20.004 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.004 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:20.004 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.004 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:20.004 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:20.004 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.004 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.004 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.004 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:20.005 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:20.005 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.005 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.005 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.005 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:20.005 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:20.005 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.005 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.005 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.005 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:20.005 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:20.005 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:20.005 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.005 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.005 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:20.006 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:20.006 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:20.006 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.006 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.006 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.006 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:20.006 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:20.006 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.006 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.006 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:20.006 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:20.006 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:20.006 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.007 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.007 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:20.007 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:20.007 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:20.007 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.007 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.007 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:20.007 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:20.007 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:20.007 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.007 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.007 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:20.007 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:20.007 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:20.007 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.008 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.008 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:20.008 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:20.008 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:20.008 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.008 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.008 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:20.008 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:20.008 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:20.008 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.008 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.008 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:20.008 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:20.008 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:20.009 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.009 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:20.009 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.009 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.009 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.009 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:20.009 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:20.009 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.933391829000001, 2024-04-26T10:43:20.009 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:20.009 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:20.009 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.009 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:20.009 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.009 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:20.010 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:20.010 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.010 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.010 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.010 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:20.010 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:20.010 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.010 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.010 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.010 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:20.010 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:20.010 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:20.010 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.010 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.011 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:20.011 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:20.011 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:20.011 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.011 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.011 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:20.011 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:20.011 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:20.011 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.011 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.011 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.011 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:20.011 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:20.011 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.012 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.012 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:20.012 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:20.012 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:20.012 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.012 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.012 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:20.012 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:20.012 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:20.012 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.012 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.012 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:20.012 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:20.012 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:20.012 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.013 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.013 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:20.013 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:20.013 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:20.013 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.013 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.013 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:20.013 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:20.013 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:20.013 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.013 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.013 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:20.013 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:20.013 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:20.013 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.013 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.014 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:20.014 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:20.014 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:20.014 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.014 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:20.014 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.014 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.014 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.014 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:20.014 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:20.014 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.933368115999997, 2024-04-26T10:43:20.014 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:20.014 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:20.014 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.014 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:20.015 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.015 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:20.015 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:20.015 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.015 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.015 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.015 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:20.015 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:20.015 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.015 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.015 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.015 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:20.015 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:20.015 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.016 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.016 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.016 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:20.016 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:20.016 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:20.016 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.016 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.016 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:20.016 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:20.016 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:20.016 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.016 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.016 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.017 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:20.017 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:20.017 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.017 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.017 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:20.017 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:20.017 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:20.017 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.017 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.017 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:20.017 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:20.017 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:20.017 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.017 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.018 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:20.018 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:20.018 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:20.018 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.018 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.018 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:20.018 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:20.018 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:20.018 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.018 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.018 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:20.018 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:20.018 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:20.018 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.019 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.019 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:20.019 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:20.019 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:20.019 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.019 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.019 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:20.019 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:20.019 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:20.019 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.019 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:20.019 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.019 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.020 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.020 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:20.020 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:20.020 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.933333810999997, 2024-04-26T10:43:20.020 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:20.020 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:20.020 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.020 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:20.020 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.020 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:20.020 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:20.020 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.020 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.020 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.021 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:20.021 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:20.021 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.021 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.021 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.021 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:20.021 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:20.021 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.021 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.021 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.021 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:20.021 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:20.021 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:20.022 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.022 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.022 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:20.022 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:20.022 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:20.022 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.022 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.022 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.022 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:20.022 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:20.022 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.022 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.022 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:20.022 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:20.023 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:20.023 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.023 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.023 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:20.023 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:20.023 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:20.023 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.023 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.023 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:20.023 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:20.023 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:20.023 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.023 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.023 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:20.024 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:20.024 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:20.024 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.024 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.024 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:20.024 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:20.024 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:20.024 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.024 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.024 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:20.024 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:20.024 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:20.024 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.024 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.025 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:20.025 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:20.025 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:20.025 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.025 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:20.025 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.025 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.025 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.025 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:20.025 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:20.025 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.932997215, 2024-04-26T10:43:20.025 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:20.025 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:20.025 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:20.026 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:20.026 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.026 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:20.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:20.026 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.026 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.026 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.026 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:20.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:20.026 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.026 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.026 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.026 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:20.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:20.027 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:20.027 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.027 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.027 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:20.027 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:20.027 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:20.027 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.027 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.027 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:20.027 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:20.027 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:20.027 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.027 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.027 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.028 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:20.028 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:20.028 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.028 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.028 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:20.028 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:20.028 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:20.028 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.028 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.028 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:20.028 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:20.028 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:20.028 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.028 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.029 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:20.029 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:20.029 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:20.029 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.029 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:20.029 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.029 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.029 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.029 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:20.029 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:20.029 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.932955186999997, 2024-04-26T10:43:20.029 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:20.029 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:20.029 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:20.030 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:20.030 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.030 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:20.030 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:20.030 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.030 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.030 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.030 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:20.030 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:20.030 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.030 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.030 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.031 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:20.031 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:20.031 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.031 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.031 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:20.031 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:20.031 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:20.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.031 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.031 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:20.031 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:20.031 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:20.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.032 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.032 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:20.032 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:20.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.032 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:20.032 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:20.032 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:20.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.032 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:20.032 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:20.032 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:20.033 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.033 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.033 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:20.033 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:20.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:20.033 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.033 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:20.033 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.033 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.033 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.033 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:20.033 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:20.033 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.932902015000003, 2024-04-26T10:43:20.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:20.034 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:20.034 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:20.034 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:20.034 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.034 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:20.034 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:20.034 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.034 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.034 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.034 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:20.034 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:20.034 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.034 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.035 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.035 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:20.035 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:20.035 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.035 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.035 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.035 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:20.035 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:20.035 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:20.035 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.035 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.035 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:20.035 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:20.036 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:20.036 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.036 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.036 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.036 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:20.036 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:20.036 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.036 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.036 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:20.036 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:20.036 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:20.036 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.036 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.036 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:20.037 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:20.037 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:20.037 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.037 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.037 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:20.037 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:20.037 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:20.037 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.037 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:20.037 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.037 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.037 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.037 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:20.038 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:20.038 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.929495605, 2024-04-26T10:43:20.038 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:20.038 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:20.038 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:20.038 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:20.038 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.038 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:20.038 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:20.038 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.038 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.038 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.038 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:20.038 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:20.039 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.039 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:20.039 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:20.039 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.039 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:20.039 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:20.039 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:20.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.039 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:20.040 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:20.040 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:20.040 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.040 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.040 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.040 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:20.040 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:20.040 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.040 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.040 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:20.040 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:20.040 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:20.040 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.040 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.040 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:20.041 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:20.041 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:20.041 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.041 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:20.041 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.041 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.041 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.041 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:20.041 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:20.041 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.927023652000003, 2024-04-26T10:43:20.041 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:20.041 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:20.041 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:20.041 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:20.042 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:20.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:20.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.042 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.042 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:20.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:20.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.042 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.042 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:20.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:20.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.043 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.043 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.043 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:20.043 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:20.043 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:20.043 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.043 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.043 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:20.043 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:20.043 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:20.043 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.043 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.043 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.043 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:20.043 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:20.044 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.044 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.044 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:20.044 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:20.044 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:20.044 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.044 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.044 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:20.044 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:20.044 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:20.044 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.044 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.044 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:20.045 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:20.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:20.045 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.045 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:20.045 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.045 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.045 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.045 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:20.045 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:20.045 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.926370093999999, 2024-04-26T10:43:20.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:20.045 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:20.045 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:20.045 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:20.046 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.046 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:20.046 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:20.046 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.046 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.046 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.046 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:20.046 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:20.046 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.046 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.046 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.046 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:20.046 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:20.047 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.047 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.047 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.047 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:20.047 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:20.047 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:20.047 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.047 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.047 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:20.047 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:20.047 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:20.047 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.047 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.047 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.048 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:20.048 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:20.048 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.048 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.048 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:20.048 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:20.048 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:20.048 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.048 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.048 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:20.048 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:20.048 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:20.048 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.049 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.049 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:20.049 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:20.049 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:20.049 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.049 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:20.049 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.049 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.049 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.049 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:20.049 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:20.049 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.926294308999999, 2024-04-26T10:43:20.049 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:20.049 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:20.050 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:20.050 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:20.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.050 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:20.050 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:20.050 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.050 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.050 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:20.050 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:20.050 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.050 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.050 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:20.051 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:20.051 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.051 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.051 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.051 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:20.051 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:20.051 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:20.051 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.051 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.051 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:20.051 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:20.051 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:20.051 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.051 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.052 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.052 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:20.052 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:20.052 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.052 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.052 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:20.052 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:20.052 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:20.052 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.052 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.052 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:20.052 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:20.052 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:20.053 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.053 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.053 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:20.053 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:20.053 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:20.053 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.053 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:20.053 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.053 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.053 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.053 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:20.053 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:20.053 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.926080615000004, 2024-04-26T10:43:20.053 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:20.054 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:20.054 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:20.054 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:20.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.054 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:20.054 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:20.054 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.054 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:20.054 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:20.054 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.055 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:20.055 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:20.055 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.055 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.055 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.055 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:20.055 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:20.055 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:20.055 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.055 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.055 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:20.055 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:20.055 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:20.055 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.056 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.056 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:20.056 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:20.056 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.056 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:20.056 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:20.056 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:20.056 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.056 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:20.056 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:20.056 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:20.057 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.057 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:20.057 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.057 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.057 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.057 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:20.057 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:20.057 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.923636801999997, 2024-04-26T10:43:20.057 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:20.057 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:20.057 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:20.057 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:20.057 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.057 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:20.057 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:20.057 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.058 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.058 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.058 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:20.058 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:20.058 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.058 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.058 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.058 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:20.058 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:20.058 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:20.058 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.058 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.058 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:20.059 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:20.059 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:20.059 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.059 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.059 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:20.059 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:20.059 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:20.059 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.059 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.059 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.059 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:20.059 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:20.059 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.059 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.059 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:20.060 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:20.060 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:20.060 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.060 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.060 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:20.060 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:20.060 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:20.060 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.060 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.060 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:20.060 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:20.060 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:20.060 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.060 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:20.061 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.061 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.061 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.061 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:20.061 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:20.061 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 48.473574358, 2024-04-26T10:43:20.061 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:20.061 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:20.061 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.061 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:20.061 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.061 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:20.061 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:20.061 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.062 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.062 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.062 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:20.062 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:20.062 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.062 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.062 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.062 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:20.062 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:20.062 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:20.062 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.062 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.062 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:20.063 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:20.063 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:20.063 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.063 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.063 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:20.063 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:20.063 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:20.063 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.063 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.063 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.063 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:20.063 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:20.063 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.064 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.064 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:20.064 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:20.064 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:20.064 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.064 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.064 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:20.064 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:20.064 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:20.064 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.064 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.064 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:20.064 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:20.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:20.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:20.065 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:20.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:20.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:20.065 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:20.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:20.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:20.066 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:20.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:20.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.066 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.066 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:20.066 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:20.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:20.066 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.066 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:20.066 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.066 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.066 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:20.066 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:20.068 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:20.067+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:20.069 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:20.168 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:20.167+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:20.182 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:20.182 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:20.182 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:20.183 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:20.191 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:20.276 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:20.274+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:20.338 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:20.339 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:20.339 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:20.339 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:20.339 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:20.347 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:20.370 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:20.369+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:20.471 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:20.469+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:20.497 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:20.497 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:20.497 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:20.497 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:20.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.497 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:20.497 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:20.497 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 54.459159757000002, 2024-04-26T10:43:20.497 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:20.497 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 54.457409636000001, 2024-04-26T10:43:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:20.507 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.507 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:20.507 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 54.457356638, 2024-04-26T10:43:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 54.457278893999998, 2024-04-26T10:43:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 54.457239887999997, 2024-04-26T10:43:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 54.457221066999999, 2024-04-26T10:43:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 54.457189065000001, 2024-04-26T10:43:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 54.456980256999998, 2024-04-26T10:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 54.456948965999999, 2024-04-26T10:43:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 54.456921715999997, 2024-04-26T10:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 54.454144964999998, 2024-04-26T10:43:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 54.454094875999999, 2024-04-26T10:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 54.453202806999997, 2024-04-26T10:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 54.451014477999998, 2024-04-26T10:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 54.450879108000002, 2024-04-26T10:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 54.450664533999998, 2024-04-26T10:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 54.450325593000002, 2024-04-26T10:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 54.450216216000001, 2024-04-26T10:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 54.450176497000001, 2024-04-26T10:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 54.449838964000001, 2024-04-26T10:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:20.594 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:20.594 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:20.593+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:20.695 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:20.693+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:20.709 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:20.710 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:20.710 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:20.710 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:20.719 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:20.796 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:20.795+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:20.862 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:20.862 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:20.862 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:20.862 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:20.862 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:20.871 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:20.908 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:43:20.915 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:20.915+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:20.974 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:20.974 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:20.974 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:20.974 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:20.974 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.974 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:20.974 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 54.935560864999999, 2024-04-26T10:43:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 54.934690085, 2024-04-26T10:43:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 54.933702742000001, 2024-04-26T10:43:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 54.933497477000003, 2024-04-26T10:43:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 54.933176598000003, 2024-04-26T10:43:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 54.933124773999999, 2024-04-26T10:43:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 54.933071402000003, 2024-04-26T10:43:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 54.933027074999998, 2024-04-26T10:43:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 54.933003362000001, 2024-04-26T10:43:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:21.020 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.020 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.020 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:21.020 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:21.020 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:21.020 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.020 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.020 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:21.020 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:21.020 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:21.020 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.020 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.020 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:21.020 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 54.932969057000001, 2024-04-26T10:43:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 54.932632460999997, 2024-04-26T10:43:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 54.932590433000001, 2024-04-26T10:43:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 54.932537261, 2024-04-26T10:43:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:21.038 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:21.038 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.038 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.038 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:21.038 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:21.038 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:21.038 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.038 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.038 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:21.038 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:21.038 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:21.038 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.038 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:21.039 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:21.039 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:21.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.039 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:21.039 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:21.039 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:21.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.039 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:21.039 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:21.040 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:21.040 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.040 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:21.040 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.040 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.040 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.040 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:21.040 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:21.040 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 54.929130850999996, 2024-04-26T10:43:21.040 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:21.040 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:21.040 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:21.040 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:21.040 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.041 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:21.041 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:21.041 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.041 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.041 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.041 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:21.041 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:21.041 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.041 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.041 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.041 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:21.041 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:21.041 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:21.041 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.041 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:21.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:21.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:21.042 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.042 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:21.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:21.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:21.042 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.042 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:21.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:21.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:21.042 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.043 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.043 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:21.043 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:21.043 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:21.043 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.043 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.043 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:21.043 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:21.043 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:21.043 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.043 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:21.043 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.043 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.043 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.043 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:21.044 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:21.044 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 54.926658897999999, 2024-04-26T10:43:21.044 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:21.044 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:21.044 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:21.044 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:21.044 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.044 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:21.044 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:21.044 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.044 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.044 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.044 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:21.044 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:21.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.045 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.045 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.045 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:21.045 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:21.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:21.045 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.045 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.045 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:21.045 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:21.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:21.045 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.045 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.045 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:21.045 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:21.046 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:21.046 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.046 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.046 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:21.046 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:21.046 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:21.046 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.046 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.046 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:21.046 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:21.046 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:21.046 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.046 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.046 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:21.047 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:21.047 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:21.047 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.047 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.047 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:21.047 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:21.047 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:21.047 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.047 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:21.047 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.047 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.047 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.047 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:21.047 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:21.048 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 54.926005340000003, 2024-04-26T10:43:21.048 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:21.048 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:21.048 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:21.048 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:21.048 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.048 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:21.048 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:21.048 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.048 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.048 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.048 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:21.048 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:21.048 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.048 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.049 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.049 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:21.049 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:21.049 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:21.049 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.049 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.049 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:21.049 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:21.049 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:21.049 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.049 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.049 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:21.049 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:21.049 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:21.050 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.050 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:21.050 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:21.050 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:21.050 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.050 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:21.050 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:21.050 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:21.050 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.051 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:21.051 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:21.051 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:21.051 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.051 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.051 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:21.051 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:21.051 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:21.051 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.051 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:21.051 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.051 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.051 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.051 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:21.052 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:21.052 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 54.925929555000003, 2024-04-26T10:43:21.052 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:21.052 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:21.052 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:21.052 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:21.052 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.052 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:21.052 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:21.052 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.052 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.052 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.052 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:21.052 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:21.052 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.053 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.053 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.053 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:21.053 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:21.053 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:21.053 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.053 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.053 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:21.053 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:21.053 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:21.053 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.053 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.053 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:21.053 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:21.054 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:21.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.054 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:21.054 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:21.054 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:21.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.054 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:21.054 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:21.054 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:21.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.054 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:21.055 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:21.055 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:21.055 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.055 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.055 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:21.055 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:21.055 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:21.055 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.055 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:21.055 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.055 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.055 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.055 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:21.055 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:21.055 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 54.925715861, 2024-04-26T10:43:21.056 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:21.056 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:21.056 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:21.056 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:21.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.056 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:21.056 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:21.056 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.056 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.056 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:21.056 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:21.056 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.056 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.057 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:21.057 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:21.057 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:21.057 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.057 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.057 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:21.057 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:21.057 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:21.057 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.057 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.057 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:21.057 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:21.057 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:21.057 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.058 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.058 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:21.058 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:21.058 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:21.058 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.058 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.058 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:21.058 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:21.058 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:21.058 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.058 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.058 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:21.058 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:21.058 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:21.059 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.059 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:21.059 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.059 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.059 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.059 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:21.059 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:21.059 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 54.923272048000001, 2024-04-26T10:43:21.059 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:21.059 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:21.059 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:21.059 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:21.059 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.059 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:21.059 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:21.060 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.060 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.060 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.060 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:21.060 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:21.060 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.060 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.060 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.060 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:21.060 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:21.061 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:21.061 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.061 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.061 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:21.061 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:21.061 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:21.061 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.061 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.061 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:21.061 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:21.061 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:21.061 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.061 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.061 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:21.062 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:21.062 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:21.062 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.062 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.062 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:21.062 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:21.062 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:21.062 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.062 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.062 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:21.062 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:21.062 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:21.062 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.063 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.063 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:21.063 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:21.063 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:21.063 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.063 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:21.063 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.063 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.063 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.063 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:21.063 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:21.063 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 49.473209603999997, 2024-04-26T10:43:21.063 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:21.063 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:21.064 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:21.064 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:21.064 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.064 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:21.064 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:21.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:21.065 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:21.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:21.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:21.065 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:21.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:21.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.066 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.066 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:21.066 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:21.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:21.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.066 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.066 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:21.066 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:21.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:21.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.066 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.066 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:21.066 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:21.067 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:21.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.067 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.067 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:21.067 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:21.067 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:21.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.067 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.067 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:21.067 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:21.067 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:21.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.067 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.067 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:21.068 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:21.068 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:21.068 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.068 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.068 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:21.068 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:21.068 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:21.068 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.068 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.068 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:21.068 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:21.068 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:21.069 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.069 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.069 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:21.069 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:21.069 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:21.069 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:21.069 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:21.069 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:21.069 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:21.069 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:21.069 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.069 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:21.069 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.069 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:21.070 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:21.070 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:21.071 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:21.071 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:21.071 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:43:21.072 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:21.072 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:21.070+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:21.073 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:21.073 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:43:21.074 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:21.074 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:43:21.163 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:43:21.172 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:21.170+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:21.192 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:21.192 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:21.201 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:21.272 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:21.272+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:21.350 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:21.350 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:21.359 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:21.403 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:21.401+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:21.465 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:21.465 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:21.474 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:21.475 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:21.475+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:21.576 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:21.575+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:21.581 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:21.581 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:21.590 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:21.678 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:21.676+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:21.692 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:21.692 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:21.701 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:21.778 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:21.777+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:21.803 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:21.803 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:21.812 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:21.880 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:21.879+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:21.924 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:21.924 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:21.933 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:21.981 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:21.979+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:22.038 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:22.039 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:22.047 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:22.082 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:22.082+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:22.146 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~6s 2024-04-26T10:43:22.151 INFO:teuthology.orchestra.run.smithi049.stderr:noscrub is set 2024-04-26T10:43:22.183 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:22.181+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:22.195 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:22.195 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:22.206 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:22.284 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:22.283+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:22.312 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:22.312 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:22.321 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:22.406 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:22.406+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:22.463 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:22.463 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:22.472 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:22.513 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:22.512+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:22.586 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:22.585+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:22.614 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:22.615 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:22.624 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:22.687 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:22.687+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:22.735 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:22.735 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:22.744 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:22.788 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:22.787+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:22.849 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:22.850 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:22.859 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:22.889 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:22.889+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:22.965 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:22.965 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:22.974 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:23.018 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:23.017+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:23.075 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:43:23.076 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:23.076 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:23.085 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:23.092 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:23.090+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:23.192 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:23.192+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:23.203 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:23.204 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:23.204 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:43:23.222 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:23.222 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:23.227 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:43:23.227 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:43:23.228 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:23.228 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:23.228 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:23.228 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:23.228 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:23.237 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:23.320 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:23.320+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:23.379 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:23.379 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:23.379 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:23.380 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:23.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.380 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:23.380 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:23.380 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 57.340947946, 2024-04-26T10:43:23.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:23.380 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:23.380 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:23.380 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:23.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:23.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:23.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:23.381 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:23.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:23.381 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:23.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:23.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:23.382 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:23.382 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:23.382 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.382 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.382 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:23.382 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:23.382 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:23.382 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.382 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.382 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.382 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:23.382 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:23.382 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.383 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:23.383 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:23.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:23.383 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.383 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:23.383 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:23.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:23.383 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.383 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:23.383 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:23.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:23.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.384 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:23.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:23.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:23.384 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.384 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:23.384 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.384 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:23.384 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:23.384 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 57.340077166, 2024-04-26T10:43:23.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:23.384 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:23.385 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:23.385 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:23.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:23.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:23.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:23.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:23.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:23.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:23.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:23.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:23.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:23.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:23.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:23.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:23.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:23.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:23.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:23.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.388 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:23.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:23.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:23.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.388 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:23.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:23.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:23.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.388 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:23.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:23.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:23.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.389 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.389 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:23.389 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:23.389 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:23.389 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.389 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:23.389 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.390 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.390 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:23.390 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:23.390 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 57.339089823000002, 2024-04-26T10:43:23.390 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:23.390 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:23.390 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:23.390 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:23.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:23.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:23.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:23.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:23.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:23.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:23.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:23.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:23.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:23.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:23.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:23.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:23.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:23.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:23.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:23.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:23.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:23.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:23.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:23.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:23.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:23.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:23.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:23.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:23.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:23.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:23.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:23.394 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.394 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:23.394 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.394 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:23.394 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:23.394 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 57.338884557999997, 2024-04-26T10:43:23.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:23.395 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:23.395 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:23.395 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:23.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:23.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:23.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:23.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:23.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:23.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:23.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:23.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.397 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:23.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:23.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:23.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.397 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:23.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:23.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:23.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.397 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:23.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:23.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:23.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:23.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:23.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:23.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:23.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:23.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:23.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:23.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:23.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:23.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:23.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:23.399 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.399 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:23.399 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.399 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:23.399 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:23.400 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 57.338563679000004, 2024-04-26T10:43:23.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:23.400 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:23.400 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:23.400 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:23.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:23.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:23.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:23.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:23.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.401 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:23.401 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:23.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:23.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.401 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:23.401 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:23.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:23.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.401 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:23.401 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:23.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:23.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:23.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:23.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:23.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:23.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:23.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:23.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:23.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:23.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:23.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:23.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:23.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:23.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:23.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:23.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:23.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:23.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:23.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:23.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:23.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:23.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:23.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:23.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:23.404 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.404 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:23.404 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.405 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:23.405 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:23.405 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 57.338511855, 2024-04-26T10:43:23.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:23.405 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:23.405 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:23.405 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:23.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:23.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:23.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:23.406 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:23.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.406 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.406 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:23.406 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:23.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:23.406 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.406 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:23.406 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:23.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:23.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.407 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:23.407 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:23.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:23.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:23.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:23.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:23.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:23.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:23.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:23.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:23.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:23.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:23.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:23.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:23.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:23.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:23.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:23.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:23.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:23.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:23.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.410 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:23.410 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:23.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:23.410 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.410 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:23.410 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:23.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:23.410 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.410 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:23.410 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.410 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.410 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:23.411 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:23.411 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 57.338458482999997, 2024-04-26T10:43:23.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:23.411 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:23.411 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:23.411 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:23.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:23.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:23.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:23.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:23.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:23.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:23.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:23.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:23.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:23.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:23.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:23.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:23.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:23.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:23.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:23.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:23.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:23.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:23.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:23.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:23.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:23.414 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.414 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:23.414 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:23.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:23.414 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.414 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:23.414 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:23.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:23.414 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:23.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:23.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:23.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:23.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:23.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:23.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:23.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:23.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:23.416 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.416 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:23.416 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.416 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:23.416 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:23.416 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 57.338414155999999, 2024-04-26T10:43:23.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:23.416 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:23.416 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:23.417 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:23.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:23.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:23.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:23.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:23.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.418 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.418 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.418 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:23.418 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:23.418 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:23.418 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.418 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:23.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:23.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:23.419 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:23.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:23.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:23.419 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:23.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:23.419 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:23.420 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:23.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:23.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:23.420 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:23.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:23.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:23.420 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:23.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:23.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:23.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:23.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:23.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:23.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:23.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:23.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:23.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:23.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:23.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.422 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:23.422 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:23.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:23.422 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.422 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:23.422 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.422 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.422 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.422 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:23.422 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:23.422 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 57.338390443000002, 2024-04-26T10:43:23.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:23.422 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:23.422 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:23.423 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:23.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:23.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:23.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:23.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:23.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:23.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:23.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:23.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:23.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:23.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:23.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:23.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:23.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:23.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:23.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:23.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:23.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:23.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:23.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:23.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:23.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:23.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:23.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:23.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:23.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:23.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:23.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:23.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:23.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:23.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:23.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:23.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:23.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:23.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.427 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:23.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:23.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:23.427 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.427 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:23.427 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.429 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:23.429 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:23.429 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 57.338356138000002, 2024-04-26T10:43:23.429 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:23.429 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:23.429 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:23.429 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:23.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.429 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:23.429 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:23.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:23.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:23.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:23.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:23.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:23.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:23.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:23.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:23.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:23.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:23.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:23.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:23.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:23.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:23.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:23.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:23.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.432 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:23.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:23.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:23.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.432 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:23.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:23.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:23.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.432 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:23.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:23.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:23.433 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.433 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:23.433 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:23.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:23.433 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.433 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:23.433 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:23.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:23.433 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.433 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:23.433 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:23.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:23.434 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.434 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:23.434 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.434 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.434 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:23.434 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:23.434 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 57.338019541999998, 2024-04-26T10:43:23.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:23.434 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:23.434 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:23.434 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:23.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:23.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:23.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:23.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:23.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:23.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:23.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:23.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:23.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:23.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:23.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:23.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:23.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:23.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:23.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:23.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:23.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:23.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:23.437 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.437 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:23.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:23.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:23.437 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.437 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:23.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:23.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:23.437 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.438 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:23.438 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.438 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.438 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:23.438 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:23.438 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 57.337977514000002, 2024-04-26T10:43:23.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:23.439 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:23.439 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:23.439 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:23.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:23.439 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:23.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:23.440 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:23.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:23.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:23.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:23.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:23.442 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:23.442 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:23.442 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.442 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.442 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:23.442 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:23.443 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:23.443 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.443 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.443 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.443 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:23.443 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:23.443 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.444 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.444 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:23.444 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:23.444 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:23.444 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.444 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.444 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:23.444 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:23.444 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:23.445 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.445 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.445 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:23.445 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:23.445 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:23.445 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.445 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:23.446 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.446 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.446 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.446 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:23.446 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:23.446 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 57.337924342000001, 2024-04-26T10:43:23.447 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:23.447 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:23.447 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:23.447 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:23.447 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.447 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:23.447 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:23.448 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.448 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.448 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.448 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:23.448 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:23.448 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.448 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.448 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.448 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:23.449 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:23.449 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:23.449 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.449 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.449 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:23.449 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:23.449 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:23.449 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.449 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.449 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:23.449 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:23.449 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:23.449 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.449 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.449 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.450 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:23.450 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:23.450 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.450 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.450 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:23.450 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:23.450 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:23.450 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.451 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.451 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:23.451 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:23.451 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:23.451 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.451 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.452 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:23.452 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:23.452 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:23.452 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.452 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:23.452 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.453 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.453 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.453 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:23.453 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:23.453 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 57.334517931999997, 2024-04-26T10:43:23.453 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:23.454 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:23.454 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:23.454 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:23.454 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.454 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:23.454 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:23.455 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.455 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.455 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.455 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:23.455 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:23.455 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.456 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.456 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.456 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:23.456 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:23.456 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:23.456 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.457 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.457 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:23.457 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:23.457 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:23.457 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.457 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.458 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:23.458 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:23.458 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:23.458 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.458 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.458 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.459 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:23.459 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:23.459 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.459 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.459 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:23.459 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:23.460 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:23.460 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.460 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.460 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:23.460 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:23.460 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:23.461 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.461 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:23.461 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.461 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.461 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.461 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:23.462 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:23.462 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 57.332045979, 2024-04-26T10:43:23.462 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:23.462 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:23.462 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:23.462 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:23.463 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.463 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:23.463 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:23.463 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.463 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.463 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.464 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:23.464 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:23.464 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.464 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.464 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.465 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:23.465 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:23.465 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:23.465 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.465 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.465 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:23.466 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:23.466 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:23.466 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.466 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.466 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:23.466 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:23.467 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:23.467 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.467 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.467 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.467 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:23.467 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:23.468 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.468 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.468 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:23.468 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:23.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:23.468 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.469 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:23.469 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:23.469 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:23.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.470 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:23.470 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:23.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:23.470 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.470 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:23.471 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.471 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:23.471 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:23.471 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 57.331392420999997, 2024-04-26T10:43:23.472 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:23.472 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:23.472 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:23.472 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:23.472 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.472 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:23.473 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:23.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.473 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.473 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.473 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:23.473 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:23.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:23.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:23.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:23.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.475 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:23.475 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:23.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:23.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.476 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.476 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:23.476 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:23.476 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:23.476 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.476 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.477 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.477 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:23.477 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:23.477 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.477 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.477 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:23.478 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:23.478 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:23.478 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.478 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.478 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:23.478 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:23.479 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:23.479 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.479 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.479 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:23.479 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:23.479 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:23.480 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.480 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:23.480 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.480 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.480 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.480 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:23.481 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:23.481 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 57.331316635999997, 2024-04-26T10:43:23.481 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:23.481 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:23.481 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:23.481 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:23.482 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.482 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:23.482 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:23.482 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.482 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.482 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.483 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:23.483 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:23.483 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.483 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.483 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.483 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:23.484 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:23.484 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:23.484 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.484 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.484 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:23.484 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:23.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:23.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.485 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.485 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:23.485 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:23.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:23.486 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.486 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.486 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.486 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:23.486 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:23.486 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.487 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.487 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:23.487 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:23.487 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:23.487 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.487 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.488 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:23.488 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:23.488 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:23.488 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.488 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.488 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:23.489 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:23.489 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:23.489 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.489 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:23.489 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.489 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.490 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.490 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:23.490 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:23.490 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 57.331102942000001, 2024-04-26T10:43:23.490 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:23.491 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:23.491 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:23.491 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:23.491 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.491 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:23.491 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:23.492 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.492 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.492 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.492 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:23.492 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:23.492 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.492 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.493 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.493 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:23.493 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:23.493 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:23.493 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.493 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.494 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:23.494 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:23.494 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:23.494 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.494 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.494 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:23.495 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:23.495 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:23.495 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.495 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.495 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.496 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:23.496 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:23.496 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.496 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.496 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:23.496 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:23.497 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:23.497 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.497 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.497 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:23.497 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:23.497 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:23.498 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.498 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:23.498 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.498 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.498 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.498 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:23.499 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:23.499 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 57.328659129000002, 2024-04-26T10:43:23.499 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:23.499 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:23.499 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:23.500 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:23.501 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.502 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:23.503 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 51.878596684999998, 2024-04-26T10:43:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:23.504 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.505 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:23.506 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:23.507 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:23.508 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:23.509 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:23.510 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:23.509+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:23.510 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:23.611 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:23.609+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:23.649 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:23.649 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:23.649 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:23.649 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:23.650 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:23.734 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:23.732+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:23.795 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:23.795 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:23.795 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:23.795 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:23.796 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:23.804 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:23.812 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:23.812+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:23.914 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:23.912+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:23.952 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:23.952 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:23.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:23.952 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:23.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.952 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:23.952 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:23.952 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.913807011000003, 2024-04-26T10:43:23.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:23.953 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:23.953 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:23.953 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:23.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:23.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:23.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:23.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:23.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:23.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:23.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:23.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:23.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:23.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:23.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:23.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:23.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:23.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:23.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:23.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:23.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:23.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:23.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:23.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:23.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:23.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:23.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:23.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:23.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:23.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:23.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:23.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:23.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:23.957 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:23.957 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:23.957 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:23.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.957 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:23.957 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:23.958 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.912056890000002, 2024-04-26T10:43:23.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:23.958 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:23.958 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:23.958 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:23.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:23.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:23.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:23.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:23.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:23.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:23.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:23.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:23.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:23.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:23.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:23.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:23.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:23.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:23.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:23.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:23.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:23.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:23.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:23.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:23.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:23.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:23.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:23.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:23.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:23.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:23.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:23.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:23.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:23.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:23.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:23.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:23.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:23.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:23.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:23.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:23.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:23.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:23.964 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:23.964 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:23.964 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:23.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.964 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:23.964 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:23.964 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.912003892000001, 2024-04-26T10:43:23.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:23.964 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:23.964 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:23.964 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:23.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:23.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:23.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:23.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:23.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:23.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:23.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:23.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:23.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:23.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:23.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:23.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:23.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:23.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:23.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:23.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:23.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:23.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:23.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:23.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:23.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:23.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:23.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:23.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:23.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:23.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:23.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:23.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:23.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:23.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:23.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:23.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:23.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:23.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:23.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:23.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:23.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:23.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:23.969 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:23.969 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:23.969 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:23.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.969 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:23.969 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:23.970 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.911926147999999, 2024-04-26T10:43:23.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:23.970 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:23.970 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:23.970 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:23.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:23.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:23.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:23.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:23.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:23.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:23.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:23.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:23.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:23.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:23.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:23.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:23.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:23.972 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:23.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:23.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.972 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:23.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:23.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:23.972 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:23.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:23.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:23.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:23.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:23.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:23.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:23.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:23.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:23.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:23.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:23.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:23.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:23.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:23.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:23.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:23.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:23.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:23.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:23.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:23.975 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:23.975 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:23.975 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:23.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.975 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:23.975 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:23.975 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.911887141999998, 2024-04-26T10:43:23.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:23.975 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:23.975 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:23.976 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:23.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:23.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:23.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:23.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:23.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:23.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:23.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:23.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:23.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:23.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:23.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:23.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:23.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:23.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:23.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:23.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:23.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:23.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:23.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:23.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:23.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:23.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:23.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:23.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:23.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:23.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:23.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:23.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:23.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:23.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:23.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:23.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:23.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:23.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:23.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:23.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:23.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:23.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:23.980 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:23.980 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:23.980 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:23.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.981 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:23.981 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:23.981 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.911868321, 2024-04-26T10:43:23.981 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:23.981 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:23.981 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:23.981 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:23.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.981 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:23.981 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:23.981 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:23.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.982 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:23.982 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:23.982 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:23.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.982 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:23.982 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:23.982 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:23.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.982 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:23.982 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:23.982 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:23.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.983 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:23.983 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:23.983 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:23.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.983 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.983 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:23.983 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:23.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.983 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:23.984 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:23.984 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:23.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.984 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:23.984 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:23.984 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:23.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.984 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:23.985 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:23.985 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:23.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.985 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:23.985 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:23.985 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:23.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.985 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:23.985 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:23.985 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:23.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.986 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:23.986 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:23.986 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:23.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.986 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:23.986 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:23.986 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:23.986 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:23.986 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:23.986 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:23.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.986 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:23.987 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:23.987 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.911836319000003, 2024-04-26T10:43:23.987 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:23.987 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:23.987 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:23.987 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:23.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.987 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:23.987 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:23.987 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:23.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.987 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:23.987 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:23.988 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:23.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.988 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:23.988 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:23.988 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:23.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.988 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:23.988 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:23.988 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:23.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.988 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:23.989 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:23.989 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:23.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.989 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.989 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:23.989 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:23.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.990 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:23.990 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:23.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:23.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.990 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:23.990 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:23.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:23.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.990 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:23.991 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:23.991 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:23.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.991 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:23.991 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:23.991 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:23.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.991 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:23.991 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:23.991 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:23.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.992 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:23.992 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:23.992 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:23.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.992 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:23.992 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:23.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:23.993 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:23.993 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:23.993 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:23.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.993 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:23.993 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:23.993 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.911627510999999, 2024-04-26T10:43:23.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:23.993 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:23.993 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:23.994 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:23.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.994 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:23.994 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:23.994 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:23.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.994 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:23.994 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:23.994 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:23.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.994 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:23.995 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:23.995 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:23.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.995 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:23.995 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:23.995 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:23.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.995 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:23.995 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:23.995 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:23.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.996 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:23.996 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:23.996 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:23.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.996 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:23.997 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:23.997 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:23.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.997 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:23.997 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:23.997 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:23.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.997 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:23.997 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:23.998 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:23.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.998 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:23.998 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:23.998 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:23.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.998 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:23.998 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:23.998 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:23.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.999 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:23.999 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:23.999 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:23.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:23.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:23.999 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:23.999 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:23.999 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:23.999 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.000 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.000 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.000 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:24.000 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:24.000 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.91159622, 2024-04-26T10:43:24.000 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:24.000 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.000 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:24.000 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.001 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.001 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:24.001 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.001 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.001 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:24.001 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.001 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.001 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:24.001 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.002 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.002 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:24.002 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:24.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.002 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.002 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:24.002 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:24.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.002 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.002 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:24.002 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:24.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.003 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.003 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:24.003 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:24.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.003 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.003 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:24.003 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:24.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.003 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.003 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:24.004 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:24.004 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.004 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.004 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.004 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:24.004 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:24.004 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.911568969999998, 2024-04-26T10:43:24.004 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:24.004 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.004 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:24.004 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.005 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.005 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.005 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:24.005 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.005 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.005 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.005 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:24.005 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.005 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.005 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.006 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:24.006 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.006 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.006 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.006 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:24.006 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:24.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.006 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.006 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.006 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:24.006 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:24.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.007 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.007 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:24.007 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:24.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.007 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.007 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:24.007 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:24.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.007 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.007 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:24.008 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:24.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.008 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.008 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.008 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:24.008 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:24.008 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.008 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.008 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.008 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.008 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:24.008 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:24.008 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.908792218999999, 2024-04-26T10:43:24.009 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:24.009 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.009 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:24.009 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.009 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.009 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.009 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:24.009 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.009 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.009 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.009 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:24.009 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.010 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.010 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.010 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:24.010 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.010 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.010 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.010 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:24.010 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:24.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.010 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.010 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.010 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:24.011 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:24.011 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.011 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.011 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.011 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:24.011 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:24.011 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.011 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.011 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.011 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:24.011 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:24.011 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.011 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.011 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.012 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:24.012 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:24.012 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.012 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.012 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.012 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.012 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.012 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:24.012 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:24.012 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.90874213, 2024-04-26T10:43:24.012 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:24.012 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.012 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.012 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.013 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.013 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.013 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:24.013 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.013 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.013 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.013 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:24.013 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.013 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.013 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.013 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:24.014 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.014 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.014 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.014 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:24.014 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:24.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.014 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.014 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.014 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:24.014 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:24.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.014 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.015 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.015 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:24.015 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:24.015 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.015 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.015 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.015 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:24.015 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:24.015 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.015 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.015 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.015 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:24.015 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:24.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.016 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.016 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:24.016 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:24.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.016 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.016 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:24.016 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:24.016 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.016 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.016 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.017 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:24.017 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:24.017 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.907850060999998, 2024-04-26T10:43:24.017 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:24.017 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.017 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.017 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.017 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.017 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:24.017 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:24.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:24.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.019 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:24.019 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:24.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.019 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.019 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:24.019 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:24.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.019 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.019 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:24.019 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:24.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.020 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.020 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:24.020 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:24.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.020 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.020 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:24.020 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:24.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.020 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.020 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:24.020 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:24.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.021 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.021 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:24.021 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:24.021 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.021 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.021 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.021 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:24.021 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:24.021 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.905661731999999, 2024-04-26T10:43:24.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:24.022 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.022 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.022 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.022 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.022 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:24.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.022 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.022 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:24.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.023 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:24.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.023 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:24.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:24.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.024 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:24.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:24.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.024 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.024 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:24.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:24.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.024 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.024 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:24.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:24.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.025 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.025 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:24.025 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:24.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.025 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.025 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:24.025 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:24.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.026 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.026 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:24.026 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:24.026 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.026 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.026 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.026 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:24.026 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:24.026 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.905526362000003, 2024-04-26T10:43:24.026 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:24.026 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.026 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.027 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:24.027 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:24.027 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.028 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:24.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.028 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.028 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:24.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:24.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.028 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.028 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:24.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:24.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.029 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.029 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:24.029 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:24.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.029 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.029 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:24.029 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:24.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.029 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.029 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:24.029 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:24.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.030 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.030 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:24.030 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:24.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.030 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.030 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:24.030 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:24.030 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.030 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.030 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.031 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.031 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:24.031 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:24.031 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.905311787999999, 2024-04-26T10:43:24.031 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:24.031 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.031 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.031 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.031 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.031 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.032 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:24.032 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.032 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.032 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:24.032 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.032 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.032 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:24.032 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.033 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.033 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:24.033 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:24.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.033 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.033 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:24.033 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:24.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.033 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.033 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:24.033 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:24.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.034 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.034 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:24.034 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:24.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.034 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.034 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:24.034 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:24.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.034 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.035 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:24.035 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:24.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.035 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.035 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:24.035 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:24.035 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.035 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.035 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.035 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:24.036 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:24.036 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.904972847000003, 2024-04-26T10:43:24.036 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:24.036 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.036 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.036 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.036 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.036 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.036 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:24.036 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.036 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.036 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.036 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:24.037 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.037 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.037 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:24.037 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.037 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.037 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:24.037 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:24.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.037 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.038 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:24.038 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:24.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.038 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.038 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:24.038 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:24.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.038 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.038 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:24.038 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:24.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.039 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.039 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:24.039 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:24.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.039 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.039 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:24.039 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:24.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.040 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.040 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:24.040 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:24.040 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.040 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.040 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.040 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:24.040 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:24.040 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.904863470000002, 2024-04-26T10:43:24.040 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:24.041 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.041 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:24.041 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.041 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.041 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:24.041 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.041 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.041 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:24.041 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.042 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.042 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.042 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:24.042 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:24.042 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.042 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.045 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.045 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:24.045 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:24.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.045 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.045 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.045 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:24.045 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:24.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.045 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.045 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.046 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:24.046 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:24.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.046 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.046 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.046 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:24.046 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:24.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.046 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.046 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.046 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:24.046 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:24.046 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.047 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.047 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.047 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.047 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.047 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:24.047 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:24.047 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.904823751000002, 2024-04-26T10:43:24.047 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:24.047 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.047 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.047 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.047 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.047 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.047 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:24.048 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.048 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.048 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:24.048 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.048 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.048 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:24.048 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:24.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.048 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.049 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:24.049 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:24.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.049 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.049 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:24.049 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:24.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.049 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.049 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:24.049 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:24.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.049 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.050 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:24.050 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:24.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.050 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.050 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:24.050 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:24.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.050 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.050 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:24.050 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:24.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.051 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.051 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:24.051 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:24.051 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.051 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.051 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.051 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:24.051 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:24.051 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.904486218000002, 2024-04-26T10:43:24.051 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:24.052 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.052 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.052 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.052 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.052 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.052 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:24.052 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.052 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.052 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.052 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.052 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:24.052 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.052 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.053 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.053 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.053 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:24.053 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.053 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.053 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.053 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:24.053 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:24.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.053 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.053 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.053 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:24.054 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:24.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.054 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.054 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.054 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:24.054 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:24.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.054 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.054 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.054 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:24.054 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:24.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.054 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.054 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.055 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:24.055 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:24.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.055 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.055 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.055 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:24.055 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:24.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.055 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.055 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.055 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:24.055 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:24.055 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.056 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.056 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.056 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.056 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.056 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:24.058 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:24.058 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:24.056+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:24.158 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:24.157+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:24.165 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:43:24.170 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:24.170 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:24.170 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:24.170 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:24.180 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:24.258 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:24.257+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:24.281 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:24.281 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:24.281 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:24.281 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:24.281 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:24.290 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:24.360 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:24.359+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:24.392 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:24.393 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:24.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:24.393 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:24.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.393 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:24.393 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:24.393 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 58.354365526000002, 2024-04-26T10:43:24.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:24.393 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:24.393 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.393 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:24.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:24.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:24.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:24.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:24.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:24.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:24.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:24.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:24.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:24.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:24.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:24.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:24.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:24.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:24.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:24.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:24.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:24.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:24.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:24.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:24.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.397 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:24.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:24.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:24.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.397 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:24.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:24.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:24.397 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.397 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:24.397 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.398 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:24.398 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:24.398 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 58.353494746000003, 2024-04-26T10:43:24.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:24.398 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:24.398 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.398 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:24.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:24.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:24.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:24.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:24.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:24.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:24.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:24.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:24.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:24.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:24.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:24.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:24.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:24.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:24.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.401 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:24.401 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:24.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:24.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.401 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:24.401 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:24.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:24.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.401 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:24.401 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:24.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:24.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:24.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:24.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:24.402 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.402 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:24.402 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.402 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:24.402 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:24.402 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 58.352507402999997, 2024-04-26T10:43:24.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:24.403 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:24.403 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.403 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:24.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:24.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:24.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:24.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:24.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:24.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:24.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:24.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:24.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:24.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:24.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:24.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:24.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:24.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:24.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:24.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:24.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:24.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:24.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.406 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:24.406 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:24.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:24.406 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.406 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:24.406 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:24.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:24.406 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.406 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:24.406 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:24.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:24.407 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.407 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:24.407 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.407 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:24.407 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:24.407 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 58.352302137999999, 2024-04-26T10:43:24.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:24.407 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:24.407 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.407 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:24.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:24.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:24.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:24.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:24.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:24.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:24.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:24.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:24.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:24.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:24.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:24.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:24.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.410 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:24.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:24.410 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.410 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:24.410 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:24.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:24.410 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.410 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:24.410 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:24.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:24.410 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:24.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:24.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:24.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:24.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:24.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:24.411 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.411 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:24.411 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.412 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:24.412 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:24.412 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 58.351981258999999, 2024-04-26T10:43:24.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:24.412 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:24.412 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.412 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:24.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:24.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:24.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:24.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:24.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:24.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:24.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:24.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:24.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:24.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:24.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.414 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:24.414 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:24.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:24.414 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.414 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.414 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:24.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:24.414 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.414 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:24.414 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:24.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:24.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:24.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:24.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:24.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:24.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:24.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:24.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:24.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:24.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:24.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:24.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:24.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:24.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.418 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:24.418 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:24.418 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:24.418 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.418 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.418 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:24.418 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:24.418 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:24.418 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.418 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:24.418 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.418 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.418 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.418 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:24.419 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:24.419 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 58.351929435000002, 2024-04-26T10:43:24.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:24.419 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:24.419 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.419 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:24.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:24.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:24.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.419 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:24.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:24.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:24.420 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:24.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:24.420 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:24.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:24.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:24.420 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:24.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:24.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:24.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:24.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:24.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:24.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:24.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:24.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:24.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:24.422 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.422 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.422 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:24.422 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:24.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:24.422 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.422 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.422 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:24.422 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:24.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:24.422 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.422 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.422 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:24.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:24.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:24.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:24.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:24.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:24.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:24.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:24.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:24.423 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.423 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:24.424 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.424 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:24.424 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:24.424 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 58.351876062999999, 2024-04-26T10:43:24.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:24.424 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:24.424 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.424 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:24.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:24.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:24.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:24.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:24.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:24.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:24.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:24.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:24.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:24.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:24.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:24.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:24.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:24.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:24.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:24.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:24.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:24.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.427 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:24.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:24.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:24.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.427 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:24.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:24.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:24.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.427 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:24.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:24.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:24.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:24.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:24.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:24.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:24.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:24.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:24.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:24.429 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:24.429 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:24.429 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.429 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:24.429 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.429 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.429 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:24.429 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:24.429 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 58.351831736000001, 2024-04-26T10:43:24.429 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:24.429 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:24.429 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.429 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:24.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:24.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:24.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:24.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:24.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:24.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:24.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:24.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:24.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:24.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:24.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:24.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:24.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:24.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:24.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:24.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.432 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:24.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:24.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:24.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.432 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:24.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:24.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:24.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.432 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:24.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:24.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:24.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.433 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:24.433 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:24.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:24.433 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.433 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:24.433 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:24.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:24.433 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.433 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:24.433 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:24.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:24.433 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.434 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:24.434 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:24.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:24.434 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.434 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:24.434 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.434 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.434 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:24.434 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:24.434 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 58.351808022999997, 2024-04-26T10:43:24.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:24.434 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:24.435 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.435 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:24.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:24.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:24.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:24.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:24.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:24.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:24.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:24.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:24.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:24.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:24.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:24.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:24.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.437 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:24.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:24.437 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.437 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:24.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:24.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:24.437 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.437 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:24.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:24.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:24.437 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.438 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:24.438 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:24.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:24.438 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.438 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:24.438 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:24.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:24.438 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.438 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:24.438 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:24.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:24.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:24.439 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:24.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:24.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:24.439 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:24.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:24.439 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.439 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:24.439 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.440 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:24.440 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:24.440 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 58.351773717999997, 2024-04-26T10:43:24.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:24.440 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:24.440 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.440 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:24.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:24.440 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:24.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:24.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:24.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:24.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:24.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:24.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:24.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:24.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:24.442 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:24.442 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:24.442 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.442 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.442 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.442 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:24.442 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:24.442 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.442 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.442 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:24.442 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:24.442 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:24.442 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.442 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.443 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:24.443 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:24.443 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:24.443 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.443 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.443 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:24.443 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:24.443 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:24.443 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.443 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.443 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:24.443 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:24.443 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:24.443 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.443 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.444 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:24.444 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:24.444 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:24.444 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.444 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.444 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:24.444 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:24.444 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:24.444 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.444 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.444 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:24.444 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:24.444 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:24.444 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.444 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:24.445 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.445 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.445 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.445 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:24.445 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:24.445 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 58.351437122, 2024-04-26T10:43:24.445 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:24.445 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:24.445 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:24.445 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:24.445 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.445 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:24.445 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:24.445 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.445 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.446 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.446 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:24.446 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:24.446 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.446 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.446 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.446 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:24.446 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:24.446 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:24.446 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.446 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.446 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:24.446 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:24.447 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:24.447 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.447 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.447 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:24.447 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:24.447 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:24.447 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.447 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.447 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.447 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:24.447 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:24.448 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.448 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.448 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:24.448 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:24.448 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:24.448 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.448 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.448 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:24.448 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:24.448 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:24.448 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.448 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.448 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:24.448 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:24.449 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:24.449 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.449 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:24.449 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.449 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.449 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.449 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:24.449 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:24.449 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 58.351395093999997, 2024-04-26T10:43:24.449 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:24.449 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:24.449 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:24.449 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:24.450 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.450 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:24.450 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:24.450 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.450 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.450 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.450 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:24.450 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:24.450 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.450 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.450 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.451 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:24.451 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:24.451 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.451 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.451 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.451 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:24.451 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:24.451 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:24.451 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.451 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.451 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:24.451 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:24.452 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:24.452 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.452 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.452 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.452 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:24.452 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:24.452 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.452 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.452 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:24.452 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:24.452 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:24.452 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.452 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.452 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:24.452 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:24.453 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:24.453 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.453 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.453 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:24.453 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:24.453 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:24.453 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.453 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:24.453 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.453 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.453 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.453 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:24.453 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:24.453 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 58.351341922000003, 2024-04-26T10:43:24.454 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:24.454 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:24.454 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:24.454 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:24.454 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.454 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:24.454 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:24.454 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.454 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.454 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.454 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:24.454 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:24.454 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.454 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.455 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.455 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:24.455 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:24.455 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.455 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.455 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.455 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:24.455 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:24.455 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:24.455 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.455 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.455 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:24.455 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:24.455 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:24.455 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.456 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.456 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.456 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:24.456 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:24.456 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.456 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.456 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:24.456 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:24.456 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:24.456 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.456 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.456 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:24.456 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:24.456 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:24.456 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.457 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.457 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:24.457 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:24.457 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:24.457 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.457 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:24.457 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.457 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.457 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.457 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:24.457 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:24.457 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 58.347935511999999, 2024-04-26T10:43:24.457 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:24.457 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:24.458 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:24.458 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:24.458 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.458 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:24.458 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:24.458 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.458 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.458 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.458 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:24.458 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:24.458 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.458 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.458 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.458 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:24.459 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:24.459 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.459 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.459 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.459 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:24.459 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:24.459 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:24.459 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.459 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.459 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:24.459 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:24.459 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:24.459 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.459 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.460 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.460 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:24.460 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:24.460 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.460 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.460 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:24.460 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:24.460 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:24.460 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.460 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.460 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:24.460 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:24.460 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:24.460 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.461 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:24.461 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.461 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.461 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.461 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:24.461 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:24.461 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 58.345463559000002, 2024-04-26T10:43:24.461 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:24.461 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:24.461 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:24.461 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:24.461 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.461 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:24.461 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:24.461 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.462 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.462 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.462 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:24.462 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:24.462 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.462 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.462 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.462 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:24.462 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:24.462 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.462 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.462 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.462 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:24.462 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:24.463 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:24.463 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.463 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.463 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:24.463 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:24.463 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:24.463 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.463 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.463 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.463 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:24.463 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:24.463 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.463 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.463 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:24.464 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:24.464 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:24.464 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.464 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.464 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:24.464 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:24.464 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:24.464 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.464 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.464 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:24.464 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:24.464 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:24.464 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.465 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:24.465 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.465 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.465 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.465 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:24.465 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:24.465 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 58.344810000999999, 2024-04-26T10:43:24.465 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:24.465 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:24.465 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:24.465 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:24.465 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.465 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:24.465 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:24.466 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.466 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.466 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.466 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:24.466 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:24.466 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.466 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.466 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.466 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:24.466 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:24.466 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.466 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.466 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.466 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:24.467 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:24.467 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:24.467 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.467 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.467 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:24.467 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:24.467 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:24.467 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.467 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.467 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.467 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:24.467 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:24.467 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.467 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.467 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:24.468 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:24.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:24.468 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.468 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.468 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:24.468 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:24.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:24.468 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.468 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.468 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:24.468 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:24.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:24.468 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.468 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:24.468 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.469 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:24.469 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:24.469 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 58.344734215999999, 2024-04-26T10:43:24.469 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:24.469 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:24.469 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:24.469 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:24.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.469 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:24.469 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:24.469 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.470 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.470 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:24.470 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:24.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.470 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.470 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.470 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:24.470 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:24.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.470 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.470 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.470 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:24.470 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:24.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:24.470 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:24.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:24.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:24.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:24.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:24.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:24.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:24.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:24.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.472 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.472 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:24.472 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:24.472 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:24.472 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.472 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.472 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:24.473 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:24.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:24.473 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.473 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:24.473 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.473 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.473 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.473 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:24.473 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:24.473 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 58.344520522000003, 2024-04-26T10:43:24.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:24.473 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:24.473 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:24.473 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:24.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:24.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:24.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:24.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:24.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:24.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:24.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.475 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:24.475 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:24.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:24.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.475 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:24.475 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:24.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:24.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.475 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.475 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:24.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:24.476 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.476 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.476 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:24.476 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:24.476 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:24.476 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.476 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.476 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:24.476 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:24.476 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:24.476 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.476 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:24.476 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.476 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.476 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.477 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:24.477 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:24.477 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 58.342076708999997, 2024-04-26T10:43:24.477 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:24.477 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:24.477 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:24.477 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:24.477 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.477 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:24.477 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:24.477 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.477 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.477 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.477 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:24.477 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:24.478 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.478 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.478 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.478 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:24.478 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:24.478 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:24.478 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.478 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.478 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:24.478 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:24.478 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:24.478 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.478 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.478 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:24.479 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:24.479 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:24.479 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.479 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.479 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.479 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:24.479 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:24.479 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.479 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.479 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:24.479 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:24.479 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:24.479 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.480 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.480 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:24.480 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:24.480 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:24.480 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.480 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.480 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:24.480 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:24.480 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:24.480 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.480 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:24.480 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.480 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.480 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.480 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:24.481 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:24.481 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 52.892014265, 2024-04-26T10:43:24.481 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:24.481 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:24.481 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.481 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:24.481 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.481 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:24.481 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:24.481 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.481 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.481 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.481 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:24.481 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:24.481 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:24.482 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.482 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.482 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:24.482 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:24.482 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:24.482 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.482 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.482 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:24.482 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:24.482 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:24.482 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.482 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.482 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:24.482 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:24.483 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:24.483 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.483 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.483 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.483 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:24.483 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:24.483 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.483 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.483 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:24.483 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:24.483 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:24.483 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.483 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.483 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:24.483 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:24.484 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:24.484 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.484 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.484 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:24.484 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:24.484 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:24.484 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.484 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.484 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:24.484 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:24.484 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:24.484 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.484 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.484 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:24.484 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:24.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:24.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.485 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.485 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:24.485 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:24.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:24.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:24.485 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:24.485 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:24.485 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:24.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:24.485 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.485 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:24.485 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.486 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:24.486 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:24.486 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:24.486 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-26T10:43:24.486 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:43:24.486 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-26T10:43:24.487 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T10:43:24.487 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T10:43:24.487 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-26T10:43:24.488 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:24.486+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:24.489 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:24.588 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:24.588+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:24.600 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:24.600 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "" 2024-04-26T10:43:24.601 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:24.601 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:24.602 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:24.602 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:24.602 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:24.611 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:24.689 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:24.687+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:24.716 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:24.717 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:24.717 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:24.717 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:24.717 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:24.726 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:24.790 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:24.790+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:24.874 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 58.836084196000002, 2024-04-26T10:43:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:24.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.876 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.876 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:24.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:24.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.876 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.876 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:24.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:24.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.876 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.876 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:24.877 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:24.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.877 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.877 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:24.877 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:24.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.877 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.877 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:24.877 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:24.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.877 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 58.834334075000001, 2024-04-26T10:43:24.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:24.879 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.879 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.879 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.879 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:24.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.879 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:24.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.880 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.880 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:24.880 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:24.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.880 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.880 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:24.880 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:24.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.880 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.880 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.882 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:24.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:24.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.882 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:24.882 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:24.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:24.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.882 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:24.882 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:24.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:24.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:24.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:24.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:24.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:24.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:24.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:24.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:24.883 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.884 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.884 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.884 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:24.884 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:24.884 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 58.834281077, 2024-04-26T10:43:24.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:24.884 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.884 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.884 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.884 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.884 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:24.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:24.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:24.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:24.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:24.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:24.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:24.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:24.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:24.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.887 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:24.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:24.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.887 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:24.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:24.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:24.887 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:24.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:24.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:24.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:24.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:24.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:24.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:24.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:24.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:24.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:24.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.889 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.889 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:24.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:24.889 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.889 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.889 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.889 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:24.889 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:24.889 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 58.834203332999998, 2024-04-26T10:43:24.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:24.889 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.890 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.890 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:24.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:24.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 58.834164327000003, 2024-04-26T10:43:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:24.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:24.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:24.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:24.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:24.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:24.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.898 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:24.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:24.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:24.898 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:24.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:24.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:24.898 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:24.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:24.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:24.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:24.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:24.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:24.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:24.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:24.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:24.900 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.900 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.900 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.900 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:24.900 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:24.900 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 58.834145505999999, 2024-04-26T10:43:24.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:24.900 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.900 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.900 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:24.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:24.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:24.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:24.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:24.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:24.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:24.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:24.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:24.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:24.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:24.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:24.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:24.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:24.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:24.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:24.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:24.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 58.834113504000001, 2024-04-26T10:43:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 58.833904695999998, 2024-04-26T10:43:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 58.833873404999999, 2024-04-26T10:43:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 58.833846155000003, 2024-04-26T10:43:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 58.831069403999997, 2024-04-26T10:43:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 58.831019314999999, 2024-04-26T10:43:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 58.830127246000004, 2024-04-26T10:43:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 58.827938916999997, 2024-04-26T10:43:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 58.827803547000002, 2024-04-26T10:43:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 58.827588972999997, 2024-04-26T10:43:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 58.827250032000002, 2024-04-26T10:43:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 58.827140655000001, 2024-04-26T10:43:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 58.827100936000001, 2024-04-26T10:43:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 58.826763403000001, 2024-04-26T10:43:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:24.967 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:24.967 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:24.968 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:24.969 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:24.967+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:25.068 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:25.067+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:25.076 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:25.076 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:25.077 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:25.077 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:25.085 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:25.157 INFO:teuthology.orchestra.run.smithi049.stderr:nodeep-scrub is set 2024-04-26T10:43:25.169 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:25.169+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:25.187 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:25.188 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:25.188 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:25.188 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:25.188 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:25.197 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:25.228 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:43:25.281 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:25.281+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:25.340 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:25.341 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:25.341 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:25.341 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:25.341 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.341 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:25.341 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:25.341 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 59.302265794999997, 2024-04-26T10:43:25.341 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:25.341 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:25.341 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:25.341 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:25.341 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.342 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:25.342 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:25.342 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.342 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.342 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.342 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:25.342 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:25.342 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.342 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.342 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.342 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:25.342 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:25.342 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:25.342 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.343 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.343 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:25.343 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:25.343 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:25.343 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.343 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.343 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:25.343 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:25.343 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:25.343 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.343 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.343 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:25.343 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:25.343 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:25.344 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.344 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.344 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:25.344 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:25.344 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:25.344 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.344 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.344 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:25.344 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:25.344 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:25.344 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.344 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.344 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:25.344 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:25.345 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:25.345 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.345 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.345 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:25.345 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:25.345 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:25.345 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.345 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:25.345 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.345 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.345 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.345 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:25.345 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:25.345 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 59.301395014999997, 2024-04-26T10:43:25.345 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:25.346 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:25.346 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:25.346 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:25.346 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.346 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:25.346 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:25.346 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.346 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.346 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.346 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:25.346 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:25.346 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.346 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.347 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.347 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:25.347 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:25.347 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:25.347 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.347 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.347 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:25.347 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:25.348 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:25.348 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.348 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.348 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:25.348 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:25.348 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:25.348 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.348 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.348 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:25.348 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:25.348 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:25.348 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.348 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.349 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:25.349 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:25.349 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:25.349 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.349 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.349 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:25.349 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:25.349 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:25.349 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.349 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.349 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:25.349 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:25.349 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:25.350 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.350 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.350 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:25.350 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:25.350 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:25.350 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.350 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:25.350 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.350 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.350 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.350 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:25.350 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:25.350 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 59.300407671999999, 2024-04-26T10:43:25.350 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:25.351 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:25.351 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:25.351 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:25.351 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.351 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:25.351 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:25.351 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.351 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.351 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.351 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:25.351 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:25.351 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.351 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.351 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.351 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:25.352 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:25.352 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:25.352 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.352 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.352 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:25.352 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:25.352 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:25.352 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.352 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.352 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:25.352 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:25.352 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:25.352 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.352 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.353 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:25.353 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:25.353 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:25.353 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.353 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.353 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:25.353 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:25.353 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:25.353 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.353 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.353 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:25.353 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:25.353 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:25.354 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.354 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.354 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:25.354 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:25.354 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:25.354 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.354 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.354 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:25.354 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:25.354 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:25.354 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.354 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:25.354 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.354 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.354 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.355 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:25.355 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:25.355 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 59.300202407, 2024-04-26T10:43:25.355 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:25.355 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:25.355 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:25.355 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:25.355 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.355 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:25.355 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:25.355 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.355 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.355 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.356 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:25.356 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:25.356 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.356 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.356 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:25.356 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:25.356 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:25.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.356 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.356 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:25.356 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:25.356 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:25.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.357 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.357 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:25.357 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:25.357 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:25.357 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.357 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.357 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:25.357 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:25.357 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:25.357 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.357 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.357 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:25.357 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:25.357 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:25.358 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.358 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.358 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:25.358 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:25.358 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:25.358 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.358 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.358 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:25.358 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:25.358 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:25.358 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.358 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.358 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:25.358 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:25.359 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:25.359 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.359 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:25.359 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.359 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.359 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.359 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:25.359 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:25.359 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 59.299881528, 2024-04-26T10:43:25.359 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:25.359 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:25.359 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:25.359 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:25.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.360 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:25.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:25.360 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.360 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.360 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:25.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:25.360 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.360 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.360 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:25.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:25.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:25.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.361 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.361 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:25.361 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:25.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:25.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.361 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.361 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:25.362 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:25.362 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:25.362 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.362 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.362 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:25.362 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:25.363 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:25.363 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.363 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.363 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:25.363 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:25.363 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:25.363 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.363 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.363 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:25.363 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:25.363 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:25.363 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.363 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.364 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:25.364 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:25.364 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:25.364 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.364 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.364 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:25.364 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:25.364 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:25.364 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.364 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.364 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:25.364 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:25.364 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:25.364 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.365 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.365 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:25.365 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:25.365 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:25.365 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.365 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.365 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:25.365 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:25.365 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:25.365 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.365 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:25.365 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.365 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.365 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.365 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:25.366 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:25.366 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 59.299829703999997, 2024-04-26T10:43:25.366 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:25.366 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:25.366 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:25.366 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:25.366 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.366 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:25.366 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:25.366 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.366 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.366 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.366 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:25.366 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:25.367 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.367 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.367 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.367 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:25.367 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:25.367 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:25.367 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.367 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.367 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:25.367 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:25.367 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:25.367 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.367 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.367 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:25.367 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:25.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:25.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.368 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:25.368 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:25.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:25.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.368 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:25.368 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:25.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:25.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.368 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:25.368 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:25.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:25.369 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.369 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:25.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:25.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:25.369 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.369 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:25.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:25.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:25.369 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.369 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:25.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:25.370 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:25.370 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.370 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.370 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:25.370 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:25.370 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:25.370 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.370 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.370 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:25.370 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:25.370 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:25.370 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.370 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:25.371 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.371 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.371 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.371 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:25.371 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:25.371 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 59.299776332, 2024-04-26T10:43:25.371 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:25.371 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:25.371 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:25.371 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:25.371 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.371 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:25.371 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:25.371 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.371 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.372 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.372 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:25.372 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:25.372 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.372 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.372 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.372 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:25.372 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:25.372 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:25.372 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.372 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.372 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:25.372 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:25.372 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:25.373 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.373 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.373 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:25.373 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:25.373 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:25.373 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.373 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.373 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:25.373 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:25.373 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:25.373 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.373 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.373 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:25.373 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:25.374 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:25.374 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.374 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.374 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:25.374 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:25.374 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:25.374 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.374 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.374 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:25.374 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:25.374 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:25.374 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.374 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.374 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:25.375 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:25.375 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:25.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.375 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.375 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:25.375 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:25.375 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:25.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.375 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.375 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:25.375 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:25.375 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:25.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.375 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.376 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:25.376 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:25.376 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:25.376 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.376 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:25.376 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.376 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.376 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.376 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:25.376 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:25.376 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 59.299732005000003, 2024-04-26T10:43:25.376 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:25.376 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:25.376 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:25.376 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:25.377 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.377 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:25.377 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:25.377 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.377 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.377 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.377 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:25.377 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:25.377 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.377 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.377 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.378 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:25.378 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:25.378 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:25.378 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.378 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.378 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:25.378 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:25.378 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:25.378 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.378 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.378 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:25.379 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:25.379 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:25.379 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.379 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.379 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:25.379 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:25.379 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:25.379 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.379 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.379 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:25.379 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:25.379 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:25.379 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.379 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.379 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:25.379 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:25.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:25.380 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:25.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:25.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:25.380 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:25.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:25.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:25.380 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:25.381 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:25.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:25.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:25.381 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:25.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:25.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:25.381 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:25.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:25.381 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.381 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:25.381 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.382 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.382 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.382 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:25.382 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:25.382 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 59.299708291999998, 2024-04-26T10:43:25.382 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:25.382 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:25.382 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:25.382 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:25.382 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.382 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:25.382 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:25.382 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.382 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.383 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:25.383 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:25.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.383 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.383 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:25.383 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:25.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:25.383 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.383 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:25.383 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:25.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:25.383 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.384 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:25.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:25.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:25.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.384 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:25.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:25.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:25.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.384 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:25.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:25.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:25.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:25.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:25.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:25.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:25.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:25.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:25.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:25.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:25.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:25.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:25.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:25.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:25.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:25.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:25.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:25.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:25.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:25.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:25.387 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.387 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:25.387 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.387 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:25.387 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:25.387 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 59.299673986999998, 2024-04-26T10:43:25.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:25.387 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:25.387 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:25.387 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:25.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:25.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:25.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.388 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:25.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:25.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.388 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:25.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:25.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:25.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.389 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:25.389 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:25.389 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:25.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.389 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.389 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:25.389 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:25.389 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:25.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.389 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.389 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:25.389 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:25.389 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:25.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.389 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.390 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:25.390 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:25.390 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:25.390 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.390 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.390 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:25.390 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:25.390 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:25.390 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.390 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.390 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:25.390 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:25.390 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:25.390 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.390 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:25.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:25.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:25.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:25.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:25.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:25.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:25.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:25.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:25.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:25.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:25.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:25.392 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.392 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:25.392 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.392 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:25.392 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:25.392 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 59.299337391000002, 2024-04-26T10:43:25.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:25.392 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:25.392 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:25.392 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:25.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:25.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:25.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:25.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:25.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:25.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:25.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:25.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:25.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:25.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:25.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:25.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:25.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:25.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:25.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:25.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:25.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:25.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:25.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:25.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:25.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:25.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:25.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:25.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:25.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:25.395 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.395 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:25.395 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.395 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:25.395 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:25.396 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 59.299295362999999, 2024-04-26T10:43:25.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:25.396 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:25.396 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:25.396 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:25.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:25.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:25.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:25.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:25.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.397 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:25.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:25.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:25.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.397 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:25.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:25.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:25.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.397 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:25.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:25.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:25.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:25.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:25.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:25.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:25.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:25.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:25.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:25.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:25.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:25.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:25.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:25.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:25.399 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.399 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:25.399 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.399 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:25.399 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:25.399 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 59.299242190999998, 2024-04-26T10:43:25.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:25.399 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:25.399 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:25.399 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:25.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:25.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:25.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:25.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:25.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:25.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:25.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:25.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.401 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:25.401 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:25.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:25.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.401 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:25.401 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:25.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:25.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.401 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:25.401 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:25.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:25.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:25.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:25.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:25.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:25.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:25.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:25.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:25.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:25.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:25.403 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.403 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:25.403 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.403 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:25.403 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:25.403 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 59.295835781000001, 2024-04-26T10:43:25.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:25.403 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:25.403 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:25.403 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:25.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:25.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:25.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:25.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:25.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:25.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:25.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:25.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:25.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:25.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:25.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:25.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:25.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:25.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:25.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:25.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:25.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:25.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:25.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:25.406 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.406 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:25.406 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:25.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:25.406 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.406 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:25.406 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.406 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.406 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:25.406 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:25.406 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 59.293363827999997, 2024-04-26T10:43:25.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:25.407 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:25.407 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:25.407 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:25.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.407 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:25.407 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:25.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.407 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:25.407 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:25.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.407 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:25.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:25.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:25.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:25.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:25.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:25.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:25.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:25.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:25.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:25.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:25.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:25.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:25.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:25.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:25.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:25.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:25.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:25.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.410 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:25.410 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:25.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:25.410 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.410 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:25.410 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.410 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.410 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:25.410 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:25.410 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 59.292710270000001, 2024-04-26T10:43:25.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:25.410 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:25.410 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:25.411 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:25.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:25.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:25.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:25.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:25.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:25.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:25.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:25.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:25.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:25.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:25.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:25.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:25.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:25.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:25.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:25.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:25.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:25.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:25.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:25.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:25.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:25.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:25.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:25.414 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:25.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:25.414 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.414 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:25.414 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.414 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.414 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:25.414 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:25.414 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 59.292634485000001, 2024-04-26T10:43:25.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:25.414 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:25.414 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:25.414 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:25.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:25.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:25.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:25.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:25.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:25.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:25.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:25.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:25.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:25.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:25.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:25.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:25.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:25.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:25.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:25.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:25.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:25.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:25.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:25.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:25.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:25.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:25.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:25.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:25.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:25.418 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.418 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:25.418 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.418 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.418 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.418 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:25.418 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:25.418 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 59.292420790999998, 2024-04-26T10:43:25.418 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:25.418 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:25.418 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:25.418 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:25.418 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.418 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:25.418 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:25.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.419 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:25.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:25.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.419 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:25.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:25.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:25.419 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:25.420 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:25.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:25.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:25.420 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:25.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:25.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:25.420 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:25.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:25.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:25.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:25.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:25.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:25.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:25.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:25.421 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.421 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:25.421 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.421 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:25.421 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:25.422 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 59.289976977999999, 2024-04-26T10:43:25.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:25.422 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:25.422 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:25.422 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:25.422 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.422 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:25.422 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:25.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.422 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.422 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.422 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:25.422 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:25.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:25.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:25.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:25.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:25.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:25.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:25.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:25.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:25.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:25.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:25.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:25.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:25.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:25.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:25.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:25.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:25.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:25.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:25.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:25.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:25.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:25.425 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.425 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:25.425 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.425 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:25.425 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:25.425 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 53.839914534000002, 2024-04-26T10:43:25.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:25.426 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:25.426 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:25.426 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:25.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:25.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:25.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:25.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:25.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:25.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.427 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:25.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:25.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:25.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.427 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:25.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:25.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:25.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.427 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:25.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:25.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:25.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:25.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:25.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:25.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:25.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:25.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:25.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:25.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:25.429 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:25.429 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.429 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:25.429 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:25.429 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:25.429 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.429 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:25.429 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:25.429 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:25.429 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.429 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:25.429 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:25.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:25.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:25.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:25.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:25.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:25.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:25.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:25.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:25.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:25.430 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.430 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:25.430 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.431 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:25.431 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:25.431 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:25.432 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:25.432 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:25.432 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:43:25.433 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:25.433 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:25.434 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:43:25.434 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:25.435 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:43:25.435 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:25.431+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:25.534 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:25.533+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:25.548 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:25.548 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:25.557 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:25.634 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:25.633+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:25.662 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:25.663 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:25.671 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:25.755 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:25.754+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:25.818 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:25.818 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:25.827 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:25.871 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:25.871+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:25.932 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:25.932 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:25.937 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:25.937+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:25.942 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:26.038 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:26.037+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:26.083 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:26.083 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:26.092 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:26.140 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:26.139+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:26.192 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:26.193 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:26.201 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:26.246 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:26.244+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:26.310 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:26.310 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:26.319 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:26.342 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:26.341+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:26.443 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:26.442+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:26.465 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:26.465 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:26.474 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:26.544 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:26.544+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:26.579 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:26.579 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:26.588 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:26.645 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:26.643+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:26.693 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:26.693 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:26.702 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:26.745 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:26.744+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:26.804 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:26.804 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:26.813 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:26.856 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:26.856+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:26.915 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:26.915 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:26.924 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:26.969 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:26.967+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:27.032 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:27.032 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:27.041 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:27.083 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:27.081+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:27.148 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:27.146+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:27.171 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:43:27.187 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:27.187 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:27.196 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:27.280 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:27.278+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:27.342 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:27.342 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:27.349 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:27.349+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:27.351 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:27.436 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:43:27.450 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:27.449+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:27.455 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:27.456 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:27.465 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:27.550 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:27.550+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:27.566 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:27.566 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:27.571 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:27.571 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:27.572 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:43:27.575 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:27.589 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:27.590 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:27.592 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:43:27.593 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:43:27.651 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:27.650+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:27.677 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:27.677 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:27.677 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:27.677 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:27.677 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.677 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:27.677 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:27.678 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 61.638473173999998, 2024-04-26T10:43:27.678 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:27.678 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:27.678 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:27.678 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:27.678 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.678 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:27.678 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:27.678 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.678 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.678 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.678 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:27.679 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:27.679 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.679 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.679 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.679 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:27.679 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:27.679 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:27.679 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.679 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.679 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:27.679 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:27.679 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:27.679 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.679 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.680 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:27.680 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:27.680 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:27.680 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.680 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.680 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:27.680 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:27.680 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:27.680 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.680 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.680 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:27.680 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:27.680 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:27.680 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.680 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.681 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:27.681 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:27.681 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:27.681 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.681 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.681 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:27.681 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:27.681 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:27.681 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.681 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.681 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:27.681 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:27.681 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:27.681 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.682 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:27.682 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.682 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.682 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.682 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:27.682 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:27.682 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 61.637602393999998, 2024-04-26T10:43:27.682 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:27.682 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:27.682 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:27.682 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:27.682 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.682 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:27.682 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:27.683 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.683 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.683 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.683 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:27.683 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:27.683 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.683 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.683 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.683 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:27.683 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:27.683 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:27.683 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.683 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.684 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:27.684 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:27.684 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:27.684 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.684 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.684 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:27.684 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:27.684 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:27.684 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.684 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.684 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:27.685 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:27.685 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:27.685 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.685 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.685 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:27.685 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:27.685 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:27.685 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.685 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.685 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:27.685 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:27.685 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:27.686 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.686 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.686 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:27.686 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:27.686 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:27.686 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.687 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.687 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:27.687 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:27.687 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:27.687 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.687 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:27.687 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.687 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.687 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.687 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:27.687 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:27.687 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 61.636615051, 2024-04-26T10:43:27.687 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:27.687 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:27.687 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:27.687 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:27.688 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.688 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:27.688 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:27.688 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.688 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.688 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.688 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:27.688 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:27.688 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.688 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.688 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.688 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:27.688 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:27.688 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:27.688 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.688 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.689 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:27.689 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:27.689 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:27.689 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.689 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.689 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:27.689 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:27.689 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:27.689 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.689 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.689 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:27.689 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:27.689 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:27.690 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.690 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.690 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:27.690 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:27.690 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:27.690 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.690 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.690 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:27.690 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:27.690 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:27.690 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.690 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.690 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:27.691 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:27.691 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:27.691 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.691 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.691 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:27.691 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:27.691 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:27.691 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.691 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:27.691 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.691 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.691 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.691 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:27.691 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:27.691 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 61.636409786000002, 2024-04-26T10:43:27.692 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:27.692 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:27.692 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:27.692 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:27.692 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.692 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:27.692 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:27.692 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.692 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.692 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.692 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:27.692 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:27.692 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.693 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.693 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.693 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:27.693 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:27.693 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:27.693 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.693 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.693 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:27.693 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:27.693 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:27.693 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.693 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.693 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:27.693 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:27.694 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:27.694 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.694 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.694 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:27.694 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:27.694 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:27.694 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.694 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.694 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:27.694 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:27.694 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:27.694 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.694 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.694 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:27.695 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:27.695 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:27.695 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.695 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.695 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:27.695 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:27.695 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:27.695 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.695 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.695 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:27.695 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:27.695 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:27.695 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.695 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:27.696 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.696 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.696 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.696 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:27.696 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:27.696 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 61.636088907000001, 2024-04-26T10:43:27.696 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:27.696 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:27.696 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:27.696 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:27.696 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.696 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:27.696 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:27.697 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.697 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.697 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.697 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:27.697 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:27.697 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.697 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.697 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.697 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:27.697 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:27.697 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:27.697 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.697 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.698 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:27.698 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:27.698 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:27.698 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.698 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.698 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:27.698 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:27.698 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:27.698 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.698 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.698 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:27.698 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:27.698 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:27.698 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.699 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.699 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:27.699 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:27.699 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:27.699 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.699 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.699 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:27.699 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:27.699 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:27.699 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.699 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.699 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:27.699 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:27.699 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:27.700 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.700 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.700 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:27.700 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:27.700 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:27.700 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.700 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.700 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:27.700 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:27.700 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:27.700 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.700 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.700 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:27.700 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:27.700 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:27.701 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.701 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.701 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:27.701 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:27.701 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:27.701 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.701 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:27.701 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.701 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.701 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.701 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:27.701 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:27.701 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 61.636037082999998, 2024-04-26T10:43:27.701 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:27.702 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:27.702 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:27.702 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:27.702 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.702 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:27.702 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:27.702 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.702 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.702 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.702 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:27.702 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:27.702 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.702 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.702 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.703 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:27.703 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:27.703 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:27.703 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.703 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.703 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:27.703 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:27.703 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:27.703 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.703 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.703 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:27.703 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:27.703 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:27.704 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.704 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.704 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:27.704 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:27.704 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:27.704 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.704 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.704 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:27.704 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:27.704 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:27.704 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.704 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.704 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:27.704 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:27.705 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:27.705 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.705 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.705 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:27.705 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:27.705 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:27.705 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.705 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.705 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:27.705 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:27.705 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:27.705 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.705 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.705 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:27.705 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:27.706 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:27.706 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.706 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.706 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:27.706 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:27.706 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:27.706 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.706 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.706 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:27.706 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:27.706 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:27.706 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.706 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:27.706 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.707 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.707 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.707 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:27.707 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:27.707 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 61.635983711000002, 2024-04-26T10:43:27.707 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:27.707 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:27.707 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:27.707 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:27.707 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.707 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:27.707 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:27.707 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.707 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.707 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.708 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:27.708 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:27.708 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.708 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.708 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:27.708 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:27.708 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:27.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.708 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.708 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:27.708 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:27.708 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:27.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.709 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.709 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:27.709 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:27.709 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:27.709 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.709 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.709 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:27.709 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:27.709 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:27.709 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.709 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.709 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:27.709 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:27.709 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:27.710 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.710 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.710 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:27.710 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:27.710 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:27.710 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.710 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.710 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:27.710 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:27.710 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:27.710 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.710 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.710 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:27.710 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:27.711 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:27.711 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.711 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.711 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:27.711 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:27.711 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:27.711 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.711 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.711 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:27.711 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:27.711 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:27.711 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.711 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.711 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:27.711 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:27.711 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:27.712 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.712 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:27.712 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.712 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.712 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.712 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:27.712 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:27.712 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 61.635939383999997, 2024-04-26T10:43:27.712 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:27.712 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:27.712 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:27.712 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:27.712 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.712 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:27.712 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:27.712 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.713 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.713 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.713 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:27.713 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:27.713 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.713 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.713 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.713 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:27.713 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:27.713 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:27.713 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.713 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.713 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:27.713 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:27.713 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:27.714 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.714 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.714 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:27.714 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:27.714 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:27.714 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.714 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.714 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:27.714 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:27.714 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:27.714 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.714 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.714 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:27.714 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:27.715 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:27.715 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.715 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.715 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:27.715 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:27.715 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:27.715 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.715 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.715 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:27.715 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:27.715 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:27.715 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.715 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.715 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:27.716 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:27.716 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:27.716 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.716 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.716 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:27.716 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:27.716 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:27.716 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.716 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.716 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:27.716 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:27.716 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:27.716 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.716 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.716 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:27.717 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:27.717 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:27.717 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.717 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:27.717 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.717 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.717 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.717 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:27.717 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:27.717 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 61.635915670999999, 2024-04-26T10:43:27.717 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:27.717 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:27.717 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:27.717 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:27.718 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.718 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:27.718 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:27.718 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.718 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.718 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.718 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:27.718 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:27.718 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.718 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.718 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.718 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:27.718 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:27.718 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:27.719 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.719 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.719 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:27.719 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:27.719 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:27.719 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.719 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.719 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:27.719 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:27.719 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:27.719 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.719 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.719 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:27.719 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:27.720 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:27.720 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.720 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.720 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:27.720 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:27.720 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:27.720 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.720 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.720 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:27.720 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:27.720 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:27.720 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.720 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.720 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:27.721 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:27.721 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:27.721 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.721 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.721 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:27.721 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:27.721 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:27.721 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.721 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.721 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:27.721 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:27.721 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:27.721 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.722 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.722 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:27.722 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:27.722 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:27.722 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.722 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.722 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:27.722 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:27.722 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:27.722 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.722 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:27.722 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.722 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.722 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.723 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:27.723 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:27.723 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 61.635881366, 2024-04-26T10:43:27.723 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:27.723 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:27.723 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:27.723 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:27.723 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.723 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:27.723 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:27.723 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.723 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.723 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.723 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:27.723 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:27.724 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.724 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.724 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.724 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:27.724 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:27.724 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:27.724 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.724 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.724 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:27.724 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:27.724 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:27.724 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.724 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.724 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:27.725 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:27.725 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:27.725 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.725 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.725 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:27.725 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:27.725 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:27.725 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.725 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.725 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:27.725 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:27.725 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:27.725 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.725 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.725 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:27.726 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:27.726 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:27.726 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.726 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.726 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:27.726 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:27.726 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:27.726 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.726 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.726 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:27.726 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:27.726 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:27.726 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.726 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.727 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:27.727 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:27.727 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:27.727 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.727 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.727 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:27.727 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:27.727 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:27.729 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.729 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.729 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:27.729 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:27.729 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:27.729 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.729 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:27.729 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.729 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.729 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.729 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:27.730 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:27.730 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 61.635544770000003, 2024-04-26T10:43:27.730 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:27.730 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:27.730 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:27.730 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:27.730 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.730 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:27.730 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:27.730 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.730 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.730 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.730 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:27.731 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:27.731 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.731 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.731 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.731 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:27.731 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:27.731 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:27.731 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.731 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.731 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:27.731 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:27.731 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:27.731 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.731 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.731 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:27.732 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:27.732 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:27.732 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.732 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.732 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:27.732 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:27.732 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:27.732 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.732 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.732 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:27.732 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:27.732 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:27.732 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.732 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.733 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:27.733 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:27.733 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:27.733 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.733 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.733 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:27.733 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:27.733 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:27.733 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.733 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:27.733 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.733 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.733 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.733 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:27.733 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:27.734 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 61.635502742, 2024-04-26T10:43:27.734 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:27.734 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:27.734 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:27.734 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:27.734 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.734 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:27.734 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:27.734 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.734 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.734 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.734 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:27.734 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:27.734 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.735 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.735 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.735 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:27.735 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:27.735 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:27.735 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.735 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.735 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:27.735 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:27.735 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:27.735 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.735 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.735 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:27.736 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:27.736 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:27.736 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.736 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.736 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:27.736 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:27.736 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:27.736 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.736 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.736 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:27.736 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:27.736 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:27.736 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.736 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.737 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:27.737 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:27.737 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:27.737 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.737 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.737 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:27.737 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:27.737 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:27.737 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.737 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:27.737 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.737 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.737 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.737 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:27.737 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:27.738 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 61.635449569999999, 2024-04-26T10:43:27.738 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:27.738 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:27.738 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:27.738 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:27.738 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.738 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:27.738 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:27.738 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.738 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.738 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.738 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:27.738 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:27.738 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.739 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.739 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.739 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:27.739 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:27.739 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:27.739 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.739 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.739 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:27.739 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:27.739 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:27.739 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.739 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.740 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:27.740 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:27.740 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:27.740 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.740 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.740 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:27.740 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:27.740 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:27.740 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.740 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.740 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:27.740 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:27.740 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:27.741 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.741 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.741 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:27.741 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:27.741 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:27.741 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.741 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.741 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:27.741 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:27.741 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:27.741 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.741 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:27.741 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.741 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.742 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.742 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:27.742 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:27.742 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 61.632043160000002, 2024-04-26T10:43:27.742 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:27.742 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:27.742 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:27.742 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:27.742 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.742 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:27.742 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:27.742 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.742 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.743 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.743 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:27.743 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:27.743 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.743 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.743 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.743 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:27.743 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:27.743 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:27.743 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.743 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.743 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:27.743 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:27.743 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:27.743 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.744 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.744 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:27.744 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:27.744 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:27.744 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.744 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.744 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:27.744 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:27.744 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:27.744 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.744 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.744 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:27.744 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:27.744 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:27.744 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.745 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.745 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:27.745 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:27.745 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:27.745 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.745 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:27.745 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.745 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.745 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.745 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:27.745 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:27.745 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 61.629571206999998, 2024-04-26T10:43:27.745 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:27.746 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:27.746 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:27.746 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:27.746 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.746 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:27.746 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:27.746 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.746 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.746 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.746 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:27.746 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:27.746 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.746 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.746 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.747 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:27.747 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:27.747 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:27.747 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.747 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.747 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:27.747 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:27.747 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:27.747 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.747 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.747 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:27.747 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:27.747 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:27.747 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.747 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.748 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:27.748 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:27.748 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:27.748 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.748 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.748 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:27.748 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:27.748 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:27.748 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.748 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.748 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:27.748 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:27.748 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:27.748 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.749 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.749 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:27.749 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:27.749 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:27.749 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.749 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:27.749 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.749 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.749 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.749 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:27.749 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:27.749 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 61.628917649000002, 2024-04-26T10:43:27.749 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:27.749 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:27.750 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:27.750 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:27.750 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.750 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:27.750 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:27.750 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.750 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.750 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.750 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:27.750 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:27.750 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.750 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.750 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.751 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:27.751 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:27.751 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:27.751 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.751 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.751 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:27.751 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:27.751 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:27.751 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.751 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.751 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:27.751 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:27.751 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:27.752 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.752 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.752 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:27.752 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:27.752 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:27.752 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.752 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.752 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:27.752 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:27.752 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:27.752 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.752 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.752 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:27.752 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:27.752 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:27.753 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.753 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.753 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:27.753 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:27.753 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:27.753 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.753 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:27.753 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.753 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.753 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.753 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:27.753 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:27.753 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 61.628841864000002, 2024-04-26T10:43:27.753 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:27.754 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:27.754 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:27.754 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:27.754 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.754 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:27.754 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:27.754 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.754 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.754 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.754 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:27.754 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:27.754 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.754 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.754 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.755 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:27.755 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:27.755 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:27.755 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.755 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.755 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:27.755 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:27.755 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:27.755 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.755 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.755 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:27.755 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:27.755 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:27.755 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.756 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.756 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:27.756 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:27.756 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:27.756 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.756 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.756 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:27.756 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:27.756 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:27.756 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.756 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.756 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:27.756 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:27.756 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:27.756 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.757 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.757 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:27.757 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:27.757 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:27.757 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.757 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:27.757 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.757 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.757 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.757 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:27.757 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:27.757 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 61.628628169999999, 2024-04-26T10:43:27.757 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:27.757 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:27.758 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:27.758 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:27.758 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.758 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:27.758 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:27.758 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.758 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.758 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.758 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:27.758 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:27.758 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.758 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.758 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.758 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:27.758 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:27.759 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:27.759 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.759 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.759 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:27.759 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:27.759 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:27.759 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.759 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.759 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:27.759 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:27.759 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:27.759 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.759 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.759 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:27.760 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:27.760 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:27.760 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.760 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.760 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:27.760 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:27.760 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:27.760 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.760 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.760 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:27.760 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:27.760 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:27.760 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.760 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:27.760 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.761 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.761 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.761 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:27.761 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:27.761 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 61.626184357, 2024-04-26T10:43:27.761 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:27.761 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:27.761 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:27.761 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:27.761 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.761 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:27.761 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:27.761 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.761 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.761 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.761 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:27.762 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:27.762 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.762 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.762 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.762 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:27.762 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:27.762 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:27.762 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.762 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.762 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:27.762 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:27.762 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:27.762 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.762 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.763 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:27.763 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:27.763 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:27.763 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.763 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.763 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:27.763 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:27.763 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:27.763 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.763 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.763 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:27.763 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:27.763 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:27.763 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.764 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.764 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:27.764 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:27.764 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:27.764 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.764 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.764 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:27.764 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:27.764 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:27.764 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.764 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:27.764 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.764 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.764 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.764 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:27.765 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:27.765 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 56.176121913000003, 2024-04-26T10:43:27.765 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:27.765 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:27.765 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:27.765 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:27.765 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.765 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:27.765 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:27.765 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.765 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.765 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.765 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:27.765 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:27.766 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:27.766 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.766 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.766 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:27.766 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:27.766 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:27.766 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.766 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.766 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:27.766 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:27.766 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:27.766 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.766 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.766 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:27.767 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:27.767 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:27.767 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.767 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.767 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:27.767 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:27.767 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:27.767 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.767 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.767 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:27.767 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:27.767 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:27.767 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.767 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.768 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:27.768 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:27.768 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:27.768 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.768 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.768 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:27.768 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:27.768 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:27.768 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.768 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.768 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:27.768 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:27.768 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:27.768 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.768 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.769 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:27.769 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:27.769 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:27.769 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.769 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.769 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:27.769 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:27.769 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:27.769 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:27.769 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:27.769 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:27.769 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:27.769 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:27.769 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.769 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:27.770 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.770 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:27.770 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:27.770 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:27.771 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:27.772 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:27.770+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:27.872 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:27.870+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:27.883 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:27.883 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:27.883 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:27.883 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:27.892 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:27.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~12s 2024-04-26T10:43:27.973 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:27.972+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:28.037 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:28.038 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:28.038 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:28.038 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:28.038 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:28.046 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:28.090 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:28.089+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:28.154 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:28.154 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:28.154 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:28.154 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:28.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.154 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:28.154 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:28.154 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 62.115898082999998, 2024-04-26T10:43:28.154 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:28.154 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:28.154 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.155 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:28.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.155 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:28.155 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:28.155 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.155 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:28.155 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:28.155 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.155 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:28.155 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:28.156 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.156 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.156 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:28.156 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:28.156 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:28.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.156 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.156 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:28.156 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:28.156 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:28.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.156 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.156 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.156 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:28.156 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:28.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.157 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:28.157 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:28.157 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:28.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.157 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:28.157 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:28.157 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:28.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.157 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:28.157 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:28.158 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:28.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.158 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:28.158 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:28.158 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:28.158 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.158 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:28.158 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.158 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:28.158 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:28.159 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 62.114147961999997, 2024-04-26T10:43:28.159 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:28.159 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:28.159 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.159 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:28.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.159 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:28.159 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:28.159 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.159 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:28.159 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:28.160 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.160 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:28.160 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:28.160 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:28.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.161 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:28.161 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:28.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:28.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.161 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:28.161 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:28.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:28.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.161 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.161 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:28.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:28.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.162 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:28.162 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:28.162 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:28.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.162 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:28.162 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:28.162 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:28.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.162 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:28.162 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:28.163 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:28.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.163 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:28.163 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:28.163 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:28.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.163 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:28.163 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:28.163 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:28.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.163 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:28.163 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:28.164 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:28.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.164 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:28.164 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:28.164 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:28.164 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.164 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:28.164 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.164 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:28.164 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:28.164 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 62.114094964000003, 2024-04-26T10:43:28.164 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:28.165 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:28.165 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.165 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:28.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.165 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:28.165 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:28.165 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.165 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:28.165 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:28.165 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.165 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:28.166 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:28.166 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.166 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:28.166 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:28.166 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:28.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.166 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:28.166 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:28.166 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:28.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.167 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.167 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:28.167 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:28.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.167 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:28.167 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:28.167 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:28.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.167 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:28.167 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:28.167 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:28.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.168 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:28.168 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:28.168 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:28.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.168 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:28.168 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:28.168 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:28.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.168 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:28.168 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:28.169 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:28.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.169 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.169 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:28.169 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:28.169 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:28.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.169 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.169 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:28.169 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:28.169 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:28.169 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.169 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:28.170 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.170 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.170 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:28.170 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:28.170 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 62.114017220000001, 2024-04-26T10:43:28.170 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:28.170 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:28.170 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.170 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:28.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.171 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:28.171 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:28.171 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.172 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:28.172 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:28.172 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.172 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.172 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.172 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:28.172 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:28.172 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:28.172 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.172 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.172 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:28.172 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:28.172 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:28.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.173 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:28.173 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:28.173 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:28.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.173 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.173 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:28.173 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:28.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.173 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:28.173 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:28.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:28.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.174 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:28.174 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:28.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:28.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.174 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:28.174 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:28.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:28.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.175 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:28.175 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:28.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:28.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.175 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:28.175 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:28.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:28.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.175 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:28.175 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:28.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:28.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.176 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:28.176 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:28.176 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:28.176 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.176 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:28.176 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.176 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:28.176 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:28.176 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 62.113978213999999, 2024-04-26T10:43:28.176 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:28.176 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:28.177 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.177 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:28.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.177 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:28.177 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:28.177 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.177 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:28.177 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:28.177 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.177 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.180 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:28.180 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:28.180 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:28.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.180 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:28.180 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:28.180 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:28.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.180 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:28.180 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:28.180 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:28.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.181 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:28.181 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:28.181 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:28.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.181 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:28.181 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:28.181 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:28.181 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.181 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:28.181 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.181 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:28.181 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:28.182 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 62.113959393000002, 2024-04-26T10:43:28.182 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:28.182 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:28.182 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.182 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:28.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.182 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:28.182 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:28.182 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.182 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:28.182 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:28.183 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.183 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:28.183 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:28.183 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:28.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.183 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:28.183 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:28.183 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:28.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.183 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:28.184 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:28.184 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:28.184 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.184 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.184 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:28.184 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:28.184 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.184 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:28.184 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:28.184 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:28.184 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.184 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:28.185 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:28.185 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:28.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.185 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:28.185 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:28.185 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:28.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.185 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:28.185 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:28.185 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:28.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:28.186 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:28.186 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:28.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:28.186 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:28.186 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:28.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:28.186 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:28.186 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:28.187 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.187 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:28.187 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.187 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:28.187 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:28.187 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 62.113927390999997, 2024-04-26T10:43:28.187 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:28.187 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:28.187 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.187 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:28.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.187 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:28.188 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:28.188 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.188 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:28.188 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:28.188 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.188 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:28.188 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:28.188 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.189 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:28.189 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:28.189 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:28.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.189 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.189 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:28.189 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:28.189 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:28.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.189 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.189 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.189 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:28.189 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:28.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.190 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:28.190 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:28.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:28.190 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.190 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:28.190 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:28.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:28.190 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.190 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:28.190 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:28.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:28.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:28.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:28.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:28.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:28.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:28.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:28.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:28.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:28.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:28.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.192 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:28.192 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:28.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:28.192 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.192 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:28.192 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.192 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:28.192 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:28.192 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 62.113718583000001, 2024-04-26T10:43:28.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:28.193 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:28.193 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.193 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:28.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.193 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:28.193 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:28.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.193 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:28.193 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:28.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.194 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:28.194 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:28.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:28.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.194 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:28.194 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:28.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:28.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.194 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:28.194 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:28.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:28.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.195 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.195 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:28.195 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:28.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.195 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:28.195 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:28.195 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:28.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.195 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:28.195 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:28.195 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:28.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:28.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:28.196 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:28.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:28.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:28.196 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:28.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:28.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:28.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:28.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.197 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:28.197 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:28.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:28.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.197 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:28.197 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:28.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:28.197 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.197 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:28.197 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.198 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:28.198 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:28.198 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 62.113687292000002, 2024-04-26T10:43:28.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:28.198 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:28.198 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:28.198 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:28.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.198 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:28.198 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:28.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:28.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:28.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:28.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:28.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:28.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:28.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:28.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:28.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:28.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:28.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:28.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:28.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:28.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:28.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:28.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:28.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:28.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:28.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:28.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:28.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:28.201 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.201 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:28.202 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.202 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:28.202 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:28.202 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 62.113660041999999, 2024-04-26T10:43:28.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:28.202 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:28.202 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:28.202 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:28.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.202 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:28.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:28.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:28.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:28.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:28.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:28.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:28.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:28.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:28.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:28.204 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:28.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:28.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.204 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:28.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:28.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:28.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:28.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:28.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.205 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:28.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:28.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:28.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.205 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:28.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:28.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:28.205 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.205 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:28.206 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.206 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:28.206 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:28.206 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 62.110883291, 2024-04-26T10:43:28.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:28.206 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:28.206 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:28.206 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:28.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:28.206 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:28.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:28.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:28.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:28.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:28.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:28.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:28.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:28.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:28.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:28.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:28.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:28.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:28.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:28.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:28.209 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:28.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.209 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:28.209 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:28.209 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:28.209 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.209 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:28.209 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.209 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:28.209 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:28.209 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 62.110833202000002, 2024-04-26T10:43:28.209 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:28.210 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:28.210 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.210 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:28.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.210 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:28.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:28.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.210 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:28.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:28.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.211 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:28.211 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:28.211 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.211 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:28.211 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:28.211 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:28.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.211 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:28.211 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:28.211 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:28.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:28.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:28.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:28.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:28.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:28.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:28.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:28.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:28.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.213 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:28.213 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:28.213 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:28.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.213 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:28.213 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:28.213 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:28.213 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.213 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:28.213 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.214 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:28.214 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:28.214 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 62.109941133, 2024-04-26T10:43:28.214 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:28.214 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:28.214 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.214 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:28.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.214 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:28.214 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:28.214 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.215 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:28.215 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:28.215 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.215 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:28.215 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:28.215 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.215 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:28.215 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:28.215 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:28.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.216 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:28.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:28.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:28.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.216 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:28.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:28.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.216 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:28.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:28.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:28.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.217 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:28.217 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:28.217 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:28.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.217 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:28.217 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:28.217 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:28.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.217 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:28.217 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:28.217 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:28.217 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.218 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:28.218 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.218 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:28.218 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:28.218 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 62.107752804, 2024-04-26T10:43:28.218 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:28.218 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:28.218 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.218 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:28.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.218 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:28.218 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:28.219 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:28.219 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:28.219 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:28.219 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:28.219 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:28.220 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:28.220 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:28.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.220 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:28.220 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:28.220 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:28.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.220 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.220 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:28.220 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:28.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.220 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:28.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:28.221 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:28.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.221 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:28.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:28.221 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:28.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.221 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:28.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:28.221 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:28.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.222 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:28.222 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:28.222 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:28.222 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.222 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:28.222 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.222 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:28.222 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:28.222 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 62.107617433999998, 2024-04-26T10:43:28.222 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:28.222 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:28.223 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.223 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:28.223 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.223 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:28.223 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:28.223 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.223 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.223 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:28.223 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:28.223 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.223 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.223 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:28.224 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:28.224 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.224 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:28.224 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:28.224 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:28.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.224 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:28.224 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:28.224 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:28.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:28.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:28.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:28.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:28.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:28.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:28.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:28.226 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:28.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.226 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:28.226 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:28.226 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:28.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.226 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:28.226 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:28.226 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:28.226 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.226 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:28.227 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.227 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:28.227 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:28.227 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 62.107402860000001, 2024-04-26T10:43:28.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:28.227 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:28.227 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.227 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:28.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.227 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:28.227 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:28.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.228 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:28.228 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:28.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.228 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:28.228 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:28.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.228 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:28.228 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:28.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:28.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.229 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:28.229 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:28.229 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:28.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.229 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.229 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:28.229 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:28.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.229 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:28.230 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:28.230 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:28.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.230 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:28.230 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:28.230 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:28.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.230 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:28.230 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:28.230 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:28.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.231 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:28.231 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:28.231 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:28.231 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.231 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:28.231 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.231 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:28.231 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:28.231 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 62.107063918999998, 2024-04-26T10:43:28.231 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:28.231 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:28.231 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.232 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:28.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.232 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:28.232 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:28.232 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.232 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:28.232 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:28.232 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.232 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:28.232 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:28.233 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.233 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:28.233 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:28.233 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:28.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.233 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:28.233 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:28.233 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:28.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.233 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.233 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:28.234 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:28.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.234 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:28.234 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:28.234 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:28.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.234 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:28.234 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:28.234 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:28.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.234 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:28.235 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:28.235 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:28.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.235 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:28.235 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:28.235 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:28.235 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.235 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:28.235 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.235 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:28.235 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:28.235 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 62.106954541999997, 2024-04-26T10:43:28.236 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:28.236 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:28.236 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:28.236 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:28.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.236 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:28.236 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:28.236 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.236 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:28.236 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:28.236 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.237 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:28.237 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:28.237 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:28.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.237 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:28.237 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:28.237 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:28.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.237 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:28.237 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:28.237 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:28.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.238 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.238 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:28.238 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:28.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.238 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:28.238 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:28.238 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:28.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.238 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:28.238 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:28.238 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:28.239 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.239 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:28.239 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.239 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:28.239 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:28.239 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 62.106914822999997, 2024-04-26T10:43:28.239 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:28.239 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:28.239 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.239 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:28.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.239 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:28.240 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:28.240 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.240 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:28.240 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:28.240 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.240 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:28.240 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:28.240 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:28.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.241 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:28.241 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:28.241 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:28.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.241 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:28.241 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:28.241 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:28.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.241 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.241 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:28.241 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:28.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.242 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:28.242 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:28.242 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:28.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.242 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:28.242 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:28.242 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:28.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.242 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:28.242 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:28.242 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:28.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.243 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:28.243 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:28.243 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:28.243 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.243 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:28.243 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.243 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:28.243 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:28.243 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 62.106577289999997, 2024-04-26T10:43:28.243 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:28.243 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:28.244 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.244 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:28.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.244 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:28.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:28.244 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.244 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:28.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:28.244 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:28.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.244 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:28.245 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:28.245 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.245 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:28.245 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:28.245 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:28.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.245 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:28.245 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:28.245 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:28.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.245 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.245 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:28.246 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:28.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.246 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:28.246 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:28.246 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:28.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.246 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:28.246 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:28.246 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:28.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.246 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:28.247 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:28.247 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:28.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:28.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:28.247 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:28.247 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:28.247 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:28.247 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.247 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:28.247 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.247 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:28.247 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:28.247 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:28.249 INFO:teuthology.orchestra.run.smithi049.stderr:noscrub is unset 2024-04-26T10:43:28.250 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:28.250 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:28.247+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:28.350 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:28.349+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:28.353 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:28.353 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:28.354 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:28.354 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:28.362 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:28.450 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:28.450+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:28.463 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:28.464 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:28.464 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:28.464 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:28.464 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:28.473 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:28.557 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:28.557+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:28.616 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:28.616 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:28.616 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:28.617 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:28.617 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.617 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:28.617 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:28.617 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 62.577831529999997, 2024-04-26T10:43:28.617 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:28.617 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:28.617 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.617 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:28.617 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.617 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:28.617 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:28.617 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.617 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.618 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.618 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:28.618 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:28.618 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.618 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.618 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.618 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:28.618 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:28.618 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.618 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.618 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.618 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:28.618 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:28.619 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:28.619 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.619 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.619 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:28.619 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:28.619 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:28.619 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.619 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.619 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.619 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:28.619 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:28.619 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.619 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.619 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:28.620 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:28.620 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:28.620 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.620 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.620 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:28.620 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:28.620 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:28.620 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.620 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.620 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:28.620 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:28.620 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:28.620 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.620 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.621 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:28.621 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:28.621 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:28.621 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.621 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:28.621 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.621 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.621 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.621 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:28.621 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:28.621 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 62.576960749999998, 2024-04-26T10:43:28.621 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:28.621 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:28.621 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.621 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:28.622 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.622 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:28.622 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:28.622 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.622 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.622 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.622 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:28.622 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:28.622 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.622 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.622 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.622 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:28.622 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:28.623 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.623 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.623 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.623 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:28.623 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:28.623 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:28.623 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.623 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.623 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:28.623 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:28.623 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:28.623 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.623 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.623 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.624 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:28.624 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:28.624 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.624 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.624 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:28.624 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:28.624 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:28.624 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.624 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.624 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:28.624 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:28.624 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:28.624 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.624 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.624 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:28.625 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:28.625 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:28.625 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.625 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.625 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:28.625 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:28.625 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:28.625 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.625 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:28.625 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.625 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.625 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.625 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:28.625 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:28.626 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 62.575973406999999, 2024-04-26T10:43:28.626 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:28.626 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:28.626 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.626 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:28.626 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.626 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:28.626 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:28.626 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.626 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.626 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.626 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:28.626 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:28.626 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.627 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.627 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.627 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:28.627 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:28.627 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:28.627 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.627 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.627 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:28.627 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:28.627 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:28.627 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.627 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.627 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:28.627 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:28.628 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:28.628 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.628 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.628 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.628 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:28.628 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:28.628 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.628 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.628 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:28.628 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:28.628 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:28.628 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.628 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.628 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:28.628 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:28.629 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:28.629 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.629 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.629 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:28.629 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:28.629 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:28.629 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.629 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.629 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:28.629 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:28.629 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:28.629 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.629 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:28.629 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.629 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.630 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.630 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:28.630 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:28.630 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 62.575768142000001, 2024-04-26T10:43:28.630 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:28.630 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:28.630 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.630 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:28.630 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.630 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:28.630 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:28.630 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.630 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.631 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.631 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:28.631 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:28.631 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.631 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.631 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.631 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:28.631 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:28.631 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.631 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.631 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.631 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:28.631 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:28.631 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:28.631 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.632 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.632 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:28.632 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:28.632 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:28.632 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.632 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.632 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.632 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:28.632 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:28.632 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.632 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.632 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:28.632 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:28.633 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:28.633 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.633 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.633 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:28.633 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:28.633 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:28.633 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.633 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.633 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:28.633 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:28.633 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:28.633 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.633 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.633 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:28.634 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:28.634 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:28.634 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.634 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:28.634 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.634 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.634 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.634 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:28.634 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:28.634 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 62.575447263000001, 2024-04-26T10:43:28.634 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:28.634 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:28.634 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.634 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:28.635 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.635 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:28.635 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:28.635 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.635 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.635 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.635 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:28.635 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:28.635 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.635 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.635 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.635 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:28.635 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:28.635 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:28.636 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.636 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.636 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:28.636 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:28.636 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:28.636 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.636 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.636 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:28.636 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:28.636 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:28.636 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.636 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.636 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.636 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:28.637 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:28.637 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.637 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.637 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:28.637 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:28.637 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:28.637 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.637 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.637 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:28.637 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:28.637 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:28.637 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.637 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.637 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:28.637 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:28.638 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:28.638 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.638 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.638 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:28.638 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:28.638 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:28.638 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.638 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.638 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:28.638 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:28.638 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:28.638 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.638 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.638 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:28.639 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:28.639 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:28.639 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.639 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.639 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:28.639 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:28.639 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:28.639 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.639 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:28.639 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.639 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.639 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.639 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:28.639 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:28.639 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 62.575395438999998, 2024-04-26T10:43:28.640 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:28.640 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:28.640 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.640 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:28.640 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.640 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:28.640 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:28.640 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.640 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.640 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.640 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:28.640 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:28.640 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.640 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.640 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.641 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:28.641 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:28.641 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.641 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.641 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.641 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:28.641 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:28.641 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:28.641 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.641 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.641 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:28.641 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:28.641 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:28.642 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.642 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.642 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.642 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:28.642 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:28.642 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.642 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.642 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:28.642 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:28.642 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:28.642 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.642 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.642 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:28.642 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:28.643 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:28.643 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.643 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.643 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:28.643 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:28.643 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:28.643 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.643 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.643 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:28.643 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:28.643 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:28.643 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.643 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.643 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:28.643 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:28.644 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:28.644 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.644 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.644 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:28.644 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:28.644 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:28.644 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.644 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.644 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:28.644 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:28.644 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:28.644 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.644 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:28.645 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.645 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.645 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.645 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:28.645 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:28.645 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 62.575342067000001, 2024-04-26T10:43:28.645 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:28.645 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:28.645 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.645 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:28.645 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.645 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:28.645 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:28.645 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.646 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.646 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.646 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:28.646 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:28.646 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.646 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.646 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.646 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:28.646 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:28.646 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.646 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.646 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.646 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:28.646 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:28.647 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:28.647 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.647 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.647 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:28.647 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:28.647 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:28.647 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.647 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.647 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.647 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:28.647 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:28.647 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.647 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.647 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:28.648 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:28.648 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:28.648 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.648 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.648 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:28.648 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:28.648 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:28.648 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.648 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.648 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:28.648 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:28.648 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:28.648 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.648 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.648 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:28.649 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:28.649 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:28.649 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.649 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.649 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:28.649 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:28.649 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:28.649 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.649 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.649 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:28.649 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:28.649 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:28.649 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.649 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.649 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:28.650 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:28.650 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:28.650 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.650 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:28.650 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.650 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.650 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.650 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:28.650 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:28.650 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 62.575297740000003, 2024-04-26T10:43:28.650 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:28.650 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:28.650 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.650 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:28.651 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.651 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:28.651 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:28.651 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.651 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.651 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.651 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:28.651 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:28.651 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.651 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.651 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.651 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:28.651 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:28.651 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:28.651 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.652 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.652 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:28.652 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:28.652 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:28.652 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.652 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.652 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:28.652 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:28.652 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:28.652 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.652 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.652 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.652 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:28.652 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:28.653 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.653 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.653 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:28.653 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:28.653 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:28.653 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.653 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.653 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:28.653 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:28.653 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:28.653 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.653 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.653 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:28.653 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:28.653 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:28.654 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.654 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.654 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:28.654 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:28.654 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:28.654 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.654 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.654 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:28.654 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:28.654 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:28.654 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.654 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.654 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:28.654 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:28.655 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:28.655 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.655 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.655 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:28.655 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:28.655 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:28.655 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.655 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:28.655 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.655 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.655 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.655 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:28.655 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:28.655 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 62.575274026999999, 2024-04-26T10:43:28.656 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:28.656 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:28.656 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.656 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:28.656 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.656 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:28.656 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:28.656 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.656 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.656 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.656 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:28.656 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:28.656 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.656 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.656 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.657 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:28.657 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:28.657 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.657 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.657 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.657 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:28.657 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:28.657 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:28.657 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.657 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.657 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:28.657 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:28.657 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:28.657 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.658 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.658 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.658 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:28.658 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:28.658 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.658 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.658 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:28.658 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:28.658 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:28.658 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.658 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.658 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:28.658 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:28.658 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:28.659 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.659 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.659 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:28.659 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:28.659 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:28.659 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.659 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.659 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:28.659 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:28.659 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:28.659 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.659 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.659 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:28.659 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:28.660 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:28.660 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.660 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.660 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:28.660 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:28.660 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:28.660 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.660 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.660 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:28.660 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:28.660 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:28.660 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.660 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:28.660 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.661 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.661 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.661 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:28.661 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:28.661 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 62.575239721999999, 2024-04-26T10:43:28.661 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:28.661 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:28.661 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.661 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:28.661 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.661 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:28.661 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:28.661 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.661 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.662 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.662 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:28.662 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:28.662 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.662 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.662 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.662 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:28.662 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:28.662 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.662 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.662 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.662 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:28.662 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:28.662 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:28.663 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.663 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.663 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:28.663 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:28.663 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:28.663 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.663 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.663 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.663 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:28.663 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:28.663 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.663 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.663 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:28.663 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:28.663 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:28.664 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.664 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.664 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:28.664 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:28.664 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:28.664 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.664 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.664 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:28.664 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:28.664 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:28.664 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.664 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.664 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:28.664 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:28.664 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:28.665 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.665 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.665 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:28.665 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:28.665 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:28.665 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.665 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.665 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:28.665 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:28.665 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:28.665 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.665 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.665 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:28.665 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:28.666 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:28.666 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.666 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:28.666 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.666 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.666 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.666 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:28.666 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:28.666 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 62.574903126000002, 2024-04-26T10:43:28.666 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:28.666 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:28.666 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:28.666 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:28.666 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.667 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:28.667 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:28.667 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.667 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.667 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.667 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:28.667 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:28.667 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.667 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.667 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.667 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:28.667 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:28.667 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:28.667 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.667 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.668 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:28.668 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:28.668 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:28.668 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.668 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.668 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:28.668 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:28.668 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:28.668 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.668 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.668 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.668 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:28.668 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:28.668 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.668 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.669 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:28.669 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:28.669 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:28.669 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.669 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.669 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:28.669 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:28.669 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:28.669 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.669 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.669 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:28.669 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:28.669 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:28.669 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.670 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:28.670 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.670 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.670 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.670 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:28.670 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:28.670 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 62.574861098, 2024-04-26T10:43:28.670 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:28.670 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:28.670 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:28.670 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:28.670 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.670 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:28.671 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:28.671 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.671 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.671 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.671 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:28.671 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:28.671 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.671 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.671 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.671 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:28.671 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:28.671 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.671 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.671 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.671 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:28.672 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:28.672 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:28.672 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.672 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.672 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:28.672 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:28.672 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:28.672 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.672 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.672 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.672 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:28.672 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:28.672 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.672 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.673 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:28.673 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:28.673 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:28.673 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.673 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.673 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:28.673 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:28.673 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:28.673 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.673 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.673 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:28.673 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:28.673 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:28.673 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.674 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:28.674 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.674 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.674 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.674 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:28.674 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:28.674 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 62.574807925999998, 2024-04-26T10:43:28.674 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:28.674 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:28.674 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:28.674 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:28.674 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.674 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:28.674 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:28.675 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.675 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.675 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.675 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:28.675 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:28.675 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.675 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.675 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.675 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:28.675 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:28.675 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.675 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.675 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.675 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:28.676 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:28.676 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:28.676 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.676 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.676 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:28.676 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:28.676 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:28.676 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.676 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.676 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.676 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:28.676 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:28.676 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.676 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.676 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:28.677 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:28.677 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:28.677 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.677 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.677 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:28.677 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:28.677 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:28.677 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.677 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.677 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:28.677 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:28.677 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:28.677 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.677 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:28.677 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.678 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.678 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.678 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:28.678 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:28.678 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 62.571401516000002, 2024-04-26T10:43:28.678 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:28.678 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:28.678 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:28.678 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:28.678 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.678 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:28.678 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:28.678 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.678 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.679 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.679 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:28.679 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:28.679 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.679 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.679 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.679 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:28.679 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:28.679 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.679 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.679 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.679 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:28.679 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:28.679 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:28.679 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.680 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.680 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:28.680 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:28.680 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:28.680 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.680 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.680 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.680 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:28.680 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:28.680 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.680 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.680 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:28.680 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:28.680 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:28.680 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.681 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.681 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:28.681 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:28.681 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:28.681 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.681 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:28.681 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.681 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.681 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.681 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:28.681 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:28.681 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 62.568929562999998, 2024-04-26T10:43:28.681 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:28.681 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:28.681 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:28.682 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:28.682 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.682 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:28.682 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:28.682 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.682 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.682 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.682 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:28.682 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:28.682 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.682 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.682 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.682 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:28.682 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:28.683 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.683 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.683 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.683 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:28.683 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:28.683 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:28.683 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.683 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.683 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:28.683 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:28.683 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:28.683 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.683 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.683 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.683 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:28.684 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:28.684 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.684 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.684 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:28.684 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:28.684 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:28.684 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.684 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.684 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:28.684 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:28.684 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:28.684 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.684 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.684 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:28.684 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:28.685 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:28.685 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.685 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:28.685 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.685 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.685 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.685 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:28.685 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:28.685 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 62.568276005000001, 2024-04-26T10:43:28.685 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:28.685 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:28.685 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:28.685 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:28.685 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.686 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:28.686 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:28.686 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.686 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.686 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.686 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:28.686 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:28.686 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.686 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.686 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.686 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:28.686 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:28.686 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.686 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.686 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.687 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:28.687 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:28.687 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:28.687 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.687 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.687 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:28.687 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:28.687 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:28.687 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.687 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.687 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.687 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:28.687 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:28.687 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.688 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.688 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:28.688 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:28.688 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:28.688 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.688 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.688 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:28.688 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:28.688 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:28.688 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.688 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.688 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:28.688 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:28.688 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:28.689 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.689 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:28.689 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.689 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.689 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.689 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:28.689 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:28.689 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 62.568200220000001, 2024-04-26T10:43:28.689 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:28.689 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:28.689 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:28.689 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:28.689 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.689 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:28.689 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:28.690 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.690 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.690 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.690 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:28.690 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:28.690 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.690 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.690 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.690 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:28.690 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:28.690 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.690 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.690 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.690 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:28.691 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:28.691 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:28.691 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.691 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.691 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:28.691 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:28.691 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:28.691 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.691 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.691 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.691 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:28.691 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:28.691 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.691 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.692 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:28.692 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:28.692 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:28.692 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.692 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.692 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:28.692 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:28.692 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:28.692 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.692 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.692 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:28.692 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:28.692 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:28.692 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.692 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:28.693 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.693 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.693 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.693 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:28.693 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:28.693 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 62.567986525999999, 2024-04-26T10:43:28.693 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:28.693 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:28.693 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:28.693 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:28.693 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.693 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:28.693 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:28.693 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.693 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.694 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.694 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:28.694 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:28.694 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.694 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.694 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.694 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:28.694 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:28.694 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:28.694 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.694 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.694 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:28.694 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:28.694 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:28.695 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.695 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.695 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:28.695 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:28.695 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:28.695 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.695 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.695 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.695 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:28.695 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:28.695 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.695 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.695 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:28.695 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:28.696 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:28.696 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.696 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.696 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:28.696 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:28.696 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:28.696 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.696 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:28.696 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.696 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.696 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.696 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:28.696 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:28.696 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 62.565542712999999, 2024-04-26T10:43:28.696 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:28.697 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:28.697 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:28.697 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:28.697 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.697 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:28.697 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:28.697 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.697 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.697 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.697 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:28.697 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:28.697 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.697 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.697 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.697 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:28.698 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:28.698 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:28.698 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.698 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.698 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:28.698 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:28.698 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:28.698 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.698 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.698 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:28.698 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:28.698 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:28.698 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.698 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.699 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.699 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:28.699 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:28.699 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.699 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.699 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:28.699 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:28.699 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:28.699 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.699 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.699 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:28.699 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:28.699 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:28.699 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.699 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.700 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:28.700 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:28.700 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:28.700 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.700 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:28.700 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.700 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.700 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.700 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:28.700 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:28.700 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 57.115480269000003, 2024-04-26T10:43:28.700 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:28.700 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:28.700 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:28.701 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:28.701 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.701 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:28.701 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:28.701 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.701 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.701 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.701 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:28.701 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:28.701 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:28.701 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.701 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.701 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:28.701 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:28.701 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:28.702 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.702 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.702 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:28.702 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:28.702 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:28.702 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.702 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.702 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:28.702 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:28.702 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:28.702 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.702 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.702 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:28.702 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:28.703 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:28.703 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.703 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.703 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:28.703 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:28.703 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:28.703 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.703 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.703 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:28.703 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:28.703 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:28.703 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.703 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.703 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:28.704 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:28.704 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:28.704 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.704 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.704 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:28.704 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:28.704 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:28.704 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.704 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.704 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:28.704 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:28.704 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:28.704 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.704 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.705 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:28.705 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:28.705 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:28.705 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:28.705 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:28.705 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:28.705 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:28.705 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:28.705 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.705 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:28.705 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.705 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:28.705 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:28.706 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:28.707 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:28.706+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:28.707 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:28.809 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:28.806+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:28.821 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:28.822 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:28.822 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:28.822 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:28.831 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:28.915 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:28.913+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:28.977 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:28.978 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:28.978 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:28.978 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:28.978 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:28.986 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:29.028 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:29.026+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:29.112 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:29.111+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:29.135 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:29.135 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:29.135 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:29.135 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:29.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.135 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:29.135 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:29.136 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 63.097484471999998, 2024-04-26T10:43:29.136 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:29.136 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:29.136 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.136 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:29.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.136 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:29.136 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:29.136 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.136 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:29.136 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:29.137 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.137 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.137 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:29.137 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:29.137 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.137 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.137 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:29.137 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:29.137 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:29.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.137 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.137 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:29.138 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:29.138 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:29.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.138 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.138 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:29.138 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:29.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.138 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:29.138 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:29.138 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:29.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.139 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:29.139 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:29.139 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:29.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.139 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:29.139 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:29.139 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:29.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.139 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:29.139 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:29.139 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:29.140 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.140 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:29.140 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.140 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.140 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:29.140 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:29.140 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 63.095734350999997, 2024-04-26T10:43:29.140 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:29.140 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:29.140 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.140 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:29.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.141 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:29.141 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:29.141 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.141 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:29.141 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:29.141 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.141 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:29.141 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:29.142 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:29.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.142 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:29.142 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:29.142 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:29.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.142 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:29.142 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:29.142 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:29.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.142 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.143 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:29.143 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:29.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.143 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.143 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:29.143 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:29.143 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:29.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.143 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.143 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:29.143 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:29.143 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:29.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.144 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.144 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:29.144 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:29.144 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:29.144 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.144 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.144 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:29.144 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:29.144 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:29.144 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.144 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.144 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:29.144 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:29.144 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:29.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.145 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.145 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:29.145 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:29.145 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:29.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.145 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.145 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:29.145 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:29.145 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:29.145 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.145 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:29.146 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.146 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.146 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.146 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:29.146 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:29.146 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 63.095681353000003, 2024-04-26T10:43:29.146 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:29.146 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:29.146 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.146 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:29.146 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.146 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:29.146 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:29.147 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.147 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:29.147 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:29.147 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.147 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:29.147 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:29.147 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.147 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:29.148 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:29.148 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:29.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.148 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:29.148 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:29.148 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:29.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.148 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.148 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:29.148 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:29.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.148 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:29.149 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:29.149 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:29.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.149 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:29.149 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:29.149 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:29.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.149 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:29.149 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:29.149 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:29.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.150 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.150 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:29.150 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:29.150 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:29.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.150 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.150 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:29.150 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:29.150 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:29.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.150 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.150 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:29.151 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:29.151 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:29.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.151 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:29.151 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:29.151 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:29.151 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.151 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:29.151 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.151 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:29.152 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:29.152 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 63.095603609000001, 2024-04-26T10:43:29.152 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:29.152 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:29.152 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.152 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:29.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.152 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:29.152 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:29.152 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.153 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:29.153 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:29.153 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.153 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:29.153 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:29.153 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:29.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.153 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:29.153 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:29.153 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:29.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.154 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:29.154 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:29.154 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:29.154 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.154 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.154 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:29.154 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:29.154 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.154 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:29.155 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:29.155 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:29.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.155 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:29.155 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:29.155 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:29.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.155 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:29.155 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:29.155 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:29.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.157 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:29.157 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:29.157 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:29.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.157 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:29.157 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:29.157 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:29.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.158 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:29.158 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:29.158 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:29.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.158 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:29.158 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:29.158 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:29.158 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.158 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:29.158 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.159 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:29.159 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:29.159 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 63.095564603, 2024-04-26T10:43:29.159 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:29.159 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:29.159 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.159 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:29.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.159 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:29.159 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:29.159 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.160 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:29.160 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:29.160 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.160 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:29.160 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:29.160 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:29.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.160 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:29.160 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:29.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:29.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.161 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:29.161 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:29.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:29.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.161 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.161 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:29.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:29.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.161 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:29.162 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:29.162 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:29.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.162 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:29.162 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:29.162 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:29.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.162 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:29.162 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:29.162 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:29.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.163 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:29.163 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:29.163 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:29.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.163 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:29.163 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:29.163 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:29.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.163 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:29.163 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:29.163 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:29.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.164 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:29.164 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:29.164 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:29.164 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.164 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:29.164 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.164 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:29.164 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:29.164 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 63.095545782000002, 2024-04-26T10:43:29.165 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:29.165 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:29.165 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.165 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:29.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.165 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:29.165 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:29.165 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.165 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:29.165 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:29.165 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.166 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:29.166 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:29.166 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:29.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.166 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:29.166 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:29.166 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:29.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.166 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:29.166 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:29.167 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:29.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.167 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.167 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:29.167 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:29.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.167 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:29.167 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:29.167 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:29.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.167 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:29.167 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:29.168 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:29.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.168 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:29.168 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:29.168 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:29.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.168 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:29.168 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:29.168 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:29.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.168 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:29.169 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:29.169 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:29.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.169 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.169 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:29.169 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:29.169 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:29.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.169 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.169 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:29.169 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:29.169 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:29.169 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.169 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:29.170 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.170 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.170 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:29.170 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:29.170 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 63.095513779999997, 2024-04-26T10:43:29.170 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:29.170 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:29.170 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.170 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:29.170 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.170 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:29.171 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:29.171 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.171 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:29.171 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:29.171 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.171 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:29.171 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:29.171 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.172 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.172 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:29.172 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:29.172 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:29.172 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.172 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.172 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:29.172 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:29.172 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:29.172 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.172 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.172 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.172 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:29.173 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:29.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.173 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:29.173 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:29.173 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:29.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.173 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:29.173 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:29.173 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:29.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.173 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:29.174 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:29.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:29.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.174 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:29.174 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:29.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:29.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.174 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:29.174 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:29.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:29.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.175 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:29.175 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:29.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:29.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.175 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:29.175 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:29.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:29.175 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.175 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:29.175 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.175 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:29.176 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:29.176 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 63.095304972000001, 2024-04-26T10:43:29.176 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:29.176 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:29.176 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.176 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:29.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.176 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:29.176 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:29.176 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.176 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:29.177 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:29.177 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.177 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:29.177 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:29.177 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:29.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.177 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:29.177 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:29.177 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:29.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.177 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:29.178 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:29.178 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:29.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.178 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.178 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:29.178 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:29.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.178 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:29.178 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:29.178 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:29.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.179 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:29.179 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:29.179 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:29.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.179 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:29.179 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:29.179 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:29.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.179 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:29.179 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:29.179 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:29.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.180 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:29.180 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:29.180 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:29.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.180 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:29.180 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:29.180 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:29.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.180 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:29.180 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:29.180 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:29.181 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.181 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:29.181 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.181 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:29.181 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:29.181 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 63.095273681000002, 2024-04-26T10:43:29.181 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:29.181 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:29.181 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:29.181 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:29.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.181 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:29.182 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:29.182 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.182 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:29.182 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:29.182 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.182 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:29.182 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:29.182 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.183 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:29.183 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:29.183 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:29.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.183 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:29.183 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:29.183 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:29.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.183 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.183 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:29.183 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:29.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.184 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:29.184 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:29.184 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:29.184 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.184 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:29.184 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:29.184 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:29.184 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.184 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:29.184 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:29.184 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:29.184 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.185 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:29.185 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.185 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:29.185 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:29.185 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 63.095246431, 2024-04-26T10:43:29.185 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:29.185 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:29.185 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:29.185 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:29.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.185 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:29.185 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:29.185 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:29.186 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:29.186 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:29.186 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:29.186 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:29.186 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:29.187 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:29.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.187 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:29.187 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:29.187 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:29.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.187 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.187 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:29.187 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:29.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.187 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:29.188 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:29.188 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:29.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.188 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:29.188 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:29.188 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:29.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.188 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:29.188 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:29.188 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:29.188 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.188 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:29.189 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.189 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.189 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:29.189 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:29.189 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 63.092469680000001, 2024-04-26T10:43:29.189 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:29.189 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:29.189 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:29.189 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:29.189 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.189 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:29.189 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:29.189 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.190 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:29.190 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:29.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.190 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.190 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:29.190 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:29.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.190 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.190 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:29.190 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:29.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:29.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:29.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:29.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:29.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:29.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:29.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:29.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:29.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:29.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.192 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:29.192 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:29.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:29.192 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.192 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:29.192 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.192 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:29.192 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:29.192 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 63.092419591000002, 2024-04-26T10:43:29.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:29.193 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:29.193 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.193 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:29.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.193 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:29.193 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:29.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.193 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:29.193 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:29.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.194 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:29.194 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:29.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.194 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:29.194 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:29.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:29.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.195 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:29.195 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:29.195 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:29.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.195 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.195 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:29.195 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:29.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.195 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:29.195 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:29.195 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:29.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:29.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:29.196 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:29.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:29.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:29.196 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:29.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:29.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:29.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:29.197 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.197 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:29.197 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.197 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:29.197 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:29.197 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 63.091527522, 2024-04-26T10:43:29.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:29.197 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:29.197 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.197 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:29.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.198 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:29.198 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:29.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.198 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:29.198 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:29.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.198 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:29.198 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:29.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:29.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:29.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:29.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:29.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:29.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:29.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:29.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:29.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:29.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:29.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:29.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:29.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:29.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:29.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:29.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:29.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:29.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:29.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:29.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:29.201 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.201 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:29.201 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.201 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:29.201 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:29.201 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 63.089339193000001, 2024-04-26T10:43:29.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:29.202 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:29.202 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.202 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:29.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.202 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:29.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:29.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.202 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:29.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:29.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:29.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:29.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:29.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:29.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:29.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:29.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:29.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:29.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.204 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:29.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:29.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:29.204 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:29.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:29.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:29.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:29.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:29.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.205 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:29.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:29.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:29.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.205 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:29.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:29.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:29.205 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.205 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:29.206 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.206 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:29.206 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:29.206 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 63.089203822999998, 2024-04-26T10:43:29.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:29.206 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:29.206 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.206 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:29.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:29.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:29.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:29.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:29.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:29.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:29.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:29.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:29.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:29.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:29.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:29.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:29.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.209 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.209 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:29.209 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:29.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.209 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:29.209 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:29.209 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:29.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.209 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:29.209 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:29.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:29.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.210 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:29.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:29.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:29.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.210 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:29.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:29.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:29.210 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.210 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:29.211 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.211 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:29.211 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:29.211 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 63.088989249000001, 2024-04-26T10:43:29.211 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:29.211 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:29.211 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.211 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:29.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.211 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:29.211 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:29.211 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:29.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:29.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:29.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:29.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:29.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:29.213 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:29.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.213 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:29.213 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:29.213 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:29.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.213 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.213 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:29.213 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:29.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.214 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:29.214 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:29.214 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:29.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.214 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:29.214 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:29.214 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:29.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.214 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:29.214 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:29.214 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:29.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.215 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:29.215 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:29.215 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:29.215 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.215 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:29.215 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.215 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:29.215 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:29.215 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 63.088650307999998, 2024-04-26T10:43:29.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:29.216 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:29.216 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.216 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:29.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.216 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:29.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:29.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.216 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:29.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:29.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.217 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:29.217 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:29.217 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.217 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:29.217 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:29.217 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:29.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.217 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:29.217 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:29.218 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:29.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.218 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.218 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:29.218 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:29.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.218 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:29.218 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:29.218 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:29.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:29.219 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:29.219 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:29.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:29.219 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:29.219 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:29.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:29.219 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:29.220 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:29.220 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.220 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:29.220 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.220 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:29.220 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:29.220 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 63.088540930999997, 2024-04-26T10:43:29.220 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:29.220 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:29.220 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:29.220 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:29.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.221 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:29.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:29.221 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.221 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:29.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:29.221 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.221 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:29.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:29.222 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:29.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.222 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:29.222 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:29.222 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:29.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.222 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:29.222 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:29.222 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:29.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.223 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.223 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.223 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:29.223 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:29.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.223 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.223 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:29.223 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:29.223 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:29.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.223 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.223 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:29.224 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:29.224 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:29.224 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.224 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:29.224 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.224 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:29.224 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:29.224 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 63.088501211999997, 2024-04-26T10:43:29.224 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:29.225 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:29.225 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.225 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:29.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:29.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:29.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:29.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:29.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.226 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:29.226 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:29.226 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:29.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.226 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:29.226 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:29.226 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:29.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.226 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:29.227 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:29.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:29.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.227 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.227 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:29.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:29.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.227 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:29.227 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:29.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:29.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.228 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:29.228 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:29.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:29.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.228 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:29.228 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:29.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:29.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.228 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:29.228 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:29.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:29.228 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.229 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:29.229 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.229 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:29.229 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:29.229 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 63.088163678999997, 2024-04-26T10:43:29.229 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:29.229 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:29.229 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.229 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:29.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.229 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:29.230 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:29.230 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.230 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:29.230 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:29.230 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:29.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.230 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:29.230 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:29.230 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.231 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:29.231 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:29.231 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:29.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.231 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:29.231 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:29.231 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:29.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.231 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.231 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:29.232 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:29.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.232 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:29.232 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:29.232 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:29.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.232 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:29.232 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:29.232 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:29.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.233 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:29.233 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:29.233 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:29.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:29.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:29.233 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:29.233 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:29.233 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:29.233 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.233 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:29.233 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.233 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:29.233 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:29.233 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:29.235 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:29.236 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:29.234+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:29.336 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:29.335+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:29.338 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:29.338 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:29.338 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:29.338 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:29.347 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:29.437 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:29.436+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:29.448 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:29.448 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:29.448 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:29.448 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:29.448 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:29.457 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:29.541 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:29.541+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:29.594 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:43:29.600 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:29.600 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:29.600 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:29.600 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:29.600 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.601 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:29.601 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:29.601 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 63.562080197, 2024-04-26T10:43:29.601 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:29.601 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:29.601 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.601 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:29.601 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.601 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:29.601 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:29.601 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.601 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.601 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.601 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:29.602 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:29.602 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.602 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.602 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.602 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:29.602 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:29.602 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.602 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.602 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.602 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:29.602 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:29.602 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:29.602 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.603 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.603 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:29.603 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:29.603 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:29.603 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.603 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.603 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.603 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:29.603 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:29.603 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.603 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.603 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:29.603 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:29.603 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:29.603 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.604 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.604 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:29.604 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:29.604 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:29.604 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.604 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.604 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:29.604 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:29.604 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:29.604 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.604 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.604 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:29.604 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:29.604 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:29.605 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.605 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:29.605 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.605 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.605 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.605 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:29.605 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:29.605 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 63.561209417000001, 2024-04-26T10:43:29.605 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:29.605 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:29.605 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.605 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:29.605 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.605 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:29.605 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:29.606 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.606 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.606 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.606 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:29.606 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:29.606 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.606 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.606 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.606 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:29.606 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:29.606 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.606 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.606 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.606 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:29.606 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:29.607 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:29.607 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.607 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.607 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:29.607 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:29.607 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:29.607 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.607 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.607 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.607 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:29.607 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:29.607 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.607 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.607 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:29.607 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:29.608 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:29.608 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.608 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.608 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:29.608 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:29.608 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:29.608 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.608 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.608 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:29.608 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:29.608 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:29.608 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.608 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.608 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:29.609 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:29.609 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:29.609 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.609 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:29.609 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.609 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.609 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.609 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:29.609 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:29.609 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 63.560222074000002, 2024-04-26T10:43:29.609 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:29.609 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:29.609 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.609 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:29.609 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.609 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:29.610 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:29.610 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.610 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.610 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.610 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:29.610 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:29.610 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.610 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.610 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.610 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:29.610 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:29.610 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:29.610 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.610 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.611 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:29.611 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:29.611 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:29.611 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.611 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.611 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:29.611 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:29.611 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:29.611 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.611 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.611 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.611 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:29.611 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:29.611 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.611 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.612 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:29.612 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:29.612 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:29.612 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.612 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.612 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:29.612 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:29.612 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:29.612 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.612 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.612 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:29.612 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:29.612 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:29.612 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.612 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.613 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:29.613 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:29.613 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:29.613 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.613 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:29.613 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.613 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.613 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.613 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:29.613 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:29.613 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 63.560016808999997, 2024-04-26T10:43:29.613 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:29.613 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:29.614 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.614 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:29.614 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.614 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:29.614 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:29.614 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.614 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.614 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.614 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:29.614 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:29.614 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.614 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.614 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.615 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:29.615 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:29.615 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.615 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.615 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.615 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:29.615 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:29.615 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:29.615 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.615 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.615 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:29.615 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:29.615 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:29.615 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.616 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.616 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.616 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:29.616 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:29.616 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.616 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.616 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:29.616 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:29.616 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:29.616 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.616 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.616 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:29.616 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:29.616 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:29.616 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.617 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.617 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:29.617 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:29.617 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:29.617 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.617 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.617 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:29.617 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:29.617 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:29.617 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.617 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:29.617 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.617 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.617 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.617 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:29.618 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:29.618 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 63.559695929999997, 2024-04-26T10:43:29.618 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:29.618 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:29.618 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.618 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:29.618 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.618 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:29.618 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:29.618 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.618 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.618 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.618 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:29.618 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:29.619 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.619 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.619 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.619 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:29.619 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:29.619 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:29.619 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.619 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.619 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:29.619 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:29.619 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:29.619 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.619 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.619 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:29.620 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:29.620 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:29.620 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.620 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.620 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.620 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:29.620 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:29.620 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.620 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.620 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:29.620 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:29.620 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:29.620 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.620 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.621 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:29.621 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:29.621 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:29.621 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.621 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.621 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:29.621 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:29.621 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:29.621 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.621 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.621 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:29.621 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:29.621 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:29.621 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.622 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.622 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:29.622 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:29.622 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:29.622 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.622 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.622 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:29.622 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:29.622 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:29.622 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.622 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.622 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:29.622 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:29.623 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:29.623 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.623 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:29.623 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.623 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.623 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.623 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:29.623 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:29.623 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 63.559644106, 2024-04-26T10:43:29.623 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:29.623 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:29.623 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.623 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:29.623 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.624 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:29.624 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:29.624 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.624 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.624 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.624 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:29.624 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:29.624 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.624 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.624 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.624 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:29.624 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:29.624 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.624 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.625 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.625 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:29.625 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:29.625 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:29.625 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.625 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.625 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:29.625 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:29.625 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:29.625 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.625 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.625 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.625 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:29.625 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:29.625 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.626 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.626 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:29.626 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:29.626 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:29.626 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.626 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.626 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:29.626 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:29.626 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:29.626 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.626 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.626 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:29.626 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:29.626 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:29.626 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.627 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.627 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:29.627 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:29.627 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:29.627 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.627 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.627 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:29.627 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:29.627 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:29.627 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.627 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.627 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:29.627 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:29.627 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:29.628 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.628 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.628 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:29.628 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:29.628 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:29.628 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.628 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:29.628 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.628 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.628 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.628 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:29.628 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:29.628 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 63.559590733999997, 2024-04-26T10:43:29.628 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:29.629 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:29.629 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.629 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:29.629 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.629 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:29.629 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:29.629 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.629 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.629 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.629 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:29.629 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:29.629 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.629 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.629 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.630 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:29.630 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:29.630 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.630 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.630 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.630 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:29.630 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:29.630 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:29.630 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.630 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.630 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:29.630 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:29.630 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:29.630 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.631 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.631 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.631 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:29.631 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:29.631 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.631 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.631 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:29.631 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:29.631 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:29.631 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.631 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.631 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:29.631 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:29.631 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:29.632 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.632 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.632 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:29.632 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:29.632 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:29.632 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.632 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.632 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:29.632 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:29.632 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:29.632 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.632 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.632 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:29.632 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:29.632 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:29.633 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.633 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.633 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:29.633 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:29.633 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:29.633 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.633 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.633 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:29.633 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:29.633 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:29.633 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.633 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:29.633 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.633 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.634 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.634 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:29.634 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:29.634 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 63.559546406999999, 2024-04-26T10:43:29.634 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:29.634 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:29.634 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.634 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:29.634 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.634 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:29.634 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:29.634 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.634 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.634 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.635 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:29.635 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:29.635 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.635 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.635 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.635 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:29.635 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:29.635 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:29.635 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.635 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.635 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:29.635 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:29.635 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:29.635 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.635 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.636 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:29.636 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:29.636 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:29.636 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.636 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.636 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.636 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:29.636 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:29.636 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.636 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.636 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:29.636 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:29.636 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:29.636 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.637 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.637 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:29.637 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:29.637 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:29.637 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.637 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.637 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:29.637 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:29.637 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:29.637 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.637 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.637 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:29.637 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:29.637 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:29.637 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.638 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.638 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:29.638 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:29.638 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:29.638 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.638 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.638 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:29.638 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:29.638 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:29.638 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.638 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.638 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:29.638 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:29.638 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:29.639 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.639 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:29.639 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.639 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.639 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.639 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:29.639 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:29.639 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 63.559522694000002, 2024-04-26T10:43:29.639 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:29.639 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:29.639 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.639 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:29.639 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.639 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:29.639 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:29.640 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.640 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.640 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.640 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:29.640 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:29.640 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.640 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.640 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.640 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:29.640 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:29.640 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.640 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.640 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.640 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:29.640 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:29.641 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:29.641 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.641 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.641 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:29.641 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:29.641 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:29.641 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.641 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.641 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.641 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:29.641 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:29.641 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.641 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.642 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:29.642 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:29.642 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:29.642 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.642 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.642 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:29.642 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:29.642 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:29.642 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.642 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.642 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:29.642 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:29.642 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:29.642 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.643 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.643 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:29.643 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:29.643 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:29.643 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.643 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.643 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:29.643 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:29.643 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:29.643 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.643 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.643 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:29.643 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:29.643 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:29.643 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.644 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.644 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:29.644 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:29.644 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:29.644 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.644 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:29.644 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.644 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.644 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.644 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:29.644 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:29.644 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 63.559488389000002, 2024-04-26T10:43:29.644 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:29.644 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:29.644 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.645 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:29.645 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.645 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:29.645 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:29.645 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.645 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.645 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.645 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:29.645 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:29.645 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.645 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.645 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.645 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:29.645 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:29.645 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.646 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.646 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.646 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:29.646 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:29.646 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:29.646 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.646 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.646 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:29.646 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:29.646 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:29.646 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.646 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.646 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.646 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:29.647 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:29.647 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.647 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.647 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:29.647 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:29.647 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:29.647 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.647 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.647 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:29.647 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:29.647 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:29.647 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.647 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.647 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:29.648 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:29.648 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:29.648 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.648 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.648 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:29.648 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:29.648 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:29.648 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.648 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.648 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:29.648 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:29.648 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:29.648 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.648 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.648 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:29.649 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:29.649 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:29.649 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.649 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.649 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:29.649 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:29.649 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:29.649 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.649 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:29.649 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.649 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.649 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.649 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:29.649 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:29.650 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 63.559151792999998, 2024-04-26T10:43:29.650 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:29.650 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:29.650 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:29.650 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:29.650 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.650 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:29.650 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:29.650 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.650 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.650 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.650 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:29.650 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:29.650 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.650 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.651 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.651 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:29.651 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:29.651 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:29.651 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.651 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.651 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:29.651 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:29.651 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:29.651 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.651 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.651 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:29.651 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:29.651 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:29.652 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.652 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.652 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.652 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:29.652 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:29.652 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.652 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.652 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:29.652 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:29.652 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:29.652 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.652 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.652 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:29.652 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:29.653 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:29.653 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.653 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.653 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:29.653 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:29.653 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:29.653 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.653 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:29.653 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.653 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.653 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.653 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:29.653 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:29.653 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 63.559109765000002, 2024-04-26T10:43:29.654 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:29.654 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:29.654 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:29.654 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:29.654 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.654 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:29.654 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:29.654 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.654 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.654 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.654 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:29.654 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:29.654 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.654 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.655 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.655 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:29.655 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:29.655 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.655 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.655 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.655 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:29.655 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:29.655 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:29.655 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.655 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.655 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:29.655 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:29.655 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:29.656 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.656 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.656 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.656 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:29.656 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:29.656 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.656 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.656 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:29.656 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:29.656 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:29.656 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.656 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.656 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:29.656 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:29.657 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:29.657 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.657 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.657 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:29.657 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:29.657 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:29.657 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.657 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:29.657 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.657 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.657 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.657 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:29.657 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:29.658 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 63.559056593000001, 2024-04-26T10:43:29.658 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:29.658 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:29.658 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:29.658 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:29.658 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.658 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:29.658 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:29.658 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.658 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.658 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.658 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:29.658 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:29.658 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.658 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.659 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.659 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:29.659 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:29.659 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.659 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.659 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.659 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:29.659 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:29.659 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:29.659 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.659 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.659 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:29.659 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:29.659 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:29.660 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.660 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.660 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.660 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:29.660 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:29.660 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.660 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.660 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:29.660 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:29.660 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:29.660 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.660 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.660 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:29.660 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:29.661 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:29.661 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.661 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.661 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:29.661 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:29.661 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:29.661 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.661 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:29.661 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.661 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.661 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.661 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:29.661 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:29.661 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 63.555650182999997, 2024-04-26T10:43:29.661 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:29.662 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:29.662 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:29.662 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:29.662 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.662 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:29.662 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:29.662 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.662 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.662 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.662 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:29.662 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:29.662 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.662 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.662 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.662 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:29.663 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:29.663 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.663 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.663 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.663 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:29.663 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:29.663 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:29.663 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.663 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.663 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:29.663 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:29.663 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:29.663 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.663 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.664 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.664 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:29.664 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:29.664 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.664 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.664 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:29.664 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:29.664 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:29.664 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.664 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.664 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:29.664 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:29.664 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:29.664 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.664 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:29.665 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.665 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.665 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.665 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:29.665 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:29.665 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 63.55317823, 2024-04-26T10:43:29.665 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:29.665 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:29.665 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:29.665 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:29.665 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.665 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:29.665 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:29.665 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.665 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.666 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.666 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:29.666 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:29.666 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.666 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.666 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.666 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:29.666 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:29.666 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.666 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.666 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.666 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:29.666 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:29.666 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:29.667 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.667 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.667 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:29.667 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:29.667 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:29.667 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.667 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.667 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.667 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:29.667 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:29.667 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.667 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.667 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:29.667 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:29.667 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:29.668 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.668 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.668 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:29.668 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:29.668 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:29.668 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.668 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.668 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:29.668 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:29.668 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:29.668 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.668 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:29.668 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.668 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.669 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.669 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:29.669 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:29.669 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 63.552524671999997, 2024-04-26T10:43:29.669 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:29.669 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:29.669 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:29.669 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:29.669 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.669 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:29.669 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:29.669 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.669 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.669 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.670 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:29.670 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:29.670 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.670 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.670 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.670 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:29.670 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:29.670 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.670 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.670 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.670 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:29.670 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:29.670 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:29.670 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.671 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.671 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:29.671 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:29.671 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:29.671 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.671 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.671 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.671 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:29.671 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:29.671 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.671 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.671 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:29.671 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:29.671 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:29.671 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.672 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.672 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:29.672 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:29.672 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:29.672 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.672 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.672 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:29.672 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:29.672 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:29.672 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.672 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:29.672 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.672 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.672 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.673 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:29.673 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:29.673 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 63.552448886999997, 2024-04-26T10:43:29.673 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:29.673 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:29.673 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:29.673 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:29.673 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.673 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:29.673 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:29.673 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.673 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.673 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.673 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:29.673 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:29.674 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.674 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.674 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.674 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:29.674 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:29.674 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.674 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.674 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.674 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:29.674 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:29.674 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:29.674 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.674 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.674 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:29.675 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:29.675 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:29.675 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.675 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.675 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.675 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:29.675 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:29.675 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.675 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.675 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:29.675 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:29.675 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:29.675 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.675 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.676 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:29.676 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:29.676 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:29.676 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.676 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.676 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:29.676 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:29.676 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:29.676 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.676 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:29.676 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.676 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.676 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.676 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:29.676 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:29.676 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 63.552235193000001, 2024-04-26T10:43:29.677 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:29.677 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:29.677 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:29.677 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:29.677 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.677 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:29.677 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:29.677 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.677 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.677 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.677 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:29.677 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:29.677 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.677 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.677 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.677 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:29.678 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:29.678 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:29.678 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.678 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.678 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:29.678 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:29.678 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:29.678 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.678 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.678 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:29.678 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:29.678 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:29.678 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.678 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.678 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.679 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:29.679 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:29.679 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.679 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.679 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:29.679 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:29.679 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:29.679 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.679 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.679 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:29.679 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:29.679 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:29.679 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.679 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:29.679 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.679 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.680 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.680 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:29.680 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:29.680 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 63.549791380000002, 2024-04-26T10:43:29.680 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:29.680 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:29.680 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:29.680 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:29.680 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.680 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:29.680 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:29.680 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.680 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.680 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.680 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:29.681 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:29.681 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.681 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.681 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.681 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:29.681 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:29.681 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:29.681 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.681 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.681 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:29.681 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:29.681 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:29.681 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.681 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.682 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:29.682 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:29.682 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:29.682 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.682 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.682 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.682 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:29.682 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:29.682 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.682 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.682 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:29.682 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:29.682 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:29.682 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.683 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.683 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:29.683 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:29.683 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:29.683 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.683 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.683 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:29.683 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:29.683 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:29.683 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.683 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:29.683 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.683 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.683 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.683 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:29.684 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:29.684 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 58.099728935999998, 2024-04-26T10:43:29.684 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:29.684 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:29.684 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:29.684 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:29.684 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.684 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:29.684 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:29.684 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.684 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.684 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.684 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:29.684 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:29.684 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:29.685 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.685 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.685 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:29.685 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:29.685 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:29.685 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.685 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.685 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:29.685 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:29.685 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:29.685 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.685 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.685 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:29.685 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:29.685 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:29.686 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.686 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.686 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:29.686 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:29.686 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:29.686 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.686 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.686 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:29.686 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:29.686 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:29.686 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.686 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.686 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:29.686 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:29.686 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:29.687 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.687 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.687 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:29.687 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:29.687 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:29.687 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.687 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.687 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:29.687 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:29.687 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:29.687 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.687 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.687 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:29.687 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:29.688 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:29.688 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.688 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.688 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:29.688 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:29.688 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:29.688 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:29.688 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:29.688 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:29.688 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:29.688 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:29.688 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.688 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:29.688 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.688 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:29.689 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:29.689 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:29.689 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-26T10:43:29.689 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:43:29.689 INFO:tasks.thrashosds.thrasher:Reweighting osd 2 to 0.5399684005998987 2024-04-26T10:43:29.689 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 0.5399684005998987 2024-04-26T10:43:29.691 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:29.692 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:29.690+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:29.724 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:29.725 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:29.725 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:43:29.744 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:29.744 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:29.748 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:43:29.748 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:43:29.792 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:29.791+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:29.808 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:29.809 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:29.818 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:29.892 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:29.891+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:29.923 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:29.924 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:29.932 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:30.017 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:30.015+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:30.078 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:30.079 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:30.087 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:30.129 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:30.128+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:30.169 INFO:teuthology.orchestra.run.smithi049.stderr:reweighted osd.2 to 0.539968 (8a3b) 2024-04-26T10:43:30.195 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:30.194+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:30.195 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:30.195 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:30.205 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:30.251 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:43:30.295 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:30.295+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:30.307 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:30.307 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:30.316 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:30.396 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:30.396+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:30.418 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:30.418 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:30.427 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:30.496 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:30.495+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:30.538 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:30.538 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:30.547 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:30.598 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:30.597+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:30.692 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:30.693 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:30.699 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:30.697+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:30.702 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:30.800 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:30.800+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:30.848 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:30.848 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:30.857 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:30.901 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:30.901+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:30.963 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:30.963 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:30.972 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:31.002 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:31.001+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:31.103 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:31.102+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:31.113 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:31.114 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:31.122 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:31.138 INFO:teuthology.orchestra.run.smithi049.stderr:nodeep-scrub is unset 2024-04-26T10:43:31.206 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:31.205+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:31.226 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:31.226 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:31.235 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:31.307 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:31.307+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:31.343 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:31.343 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:31.352 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:31.408 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:31.407+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:31.457 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:31.458 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:31.467 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:31.509 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:31.508+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:31.573 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:31.573 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:31.582 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:31.610 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:31.609+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:31.686 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:31.686 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:31.695 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:31.710 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:31.709+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:31.749 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:43:31.797 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:31.797 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:31.806 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:31.850 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:31.850+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:31.878 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:31.879 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:31.879 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:43:31.910 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:31.910 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:31.912 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:31.912 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:31.912 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:31.913 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:31.913 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.913 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:31.913 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:31.913 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 65.872889784999998, 2024-04-26T10:43:31.913 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:31.913 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:31.914 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:31.914 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:31.914 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.914 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:31.914 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:31.915 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.915 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.915 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.915 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:31.915 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:31.915 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.915 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.915 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.916 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:31.916 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:31.916 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:31.916 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.916 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.916 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:31.916 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:31.916 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:31.916 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.916 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.917 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:31.917 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:31.917 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:31.917 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.917 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.917 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:31.917 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:31.917 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:31.917 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.917 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.917 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:31.917 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:31.917 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:31.917 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.918 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.918 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:31.918 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:31.918 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:31.918 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.918 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.918 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:31.918 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:31.918 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:31.919 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.919 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.919 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:31.919 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:31.919 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:31.919 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.919 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:31.919 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.919 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.919 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.920 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:31.920 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:31.920 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 65.872019004999999, 2024-04-26T10:43:31.920 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:31.920 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:31.920 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:31.920 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:31.920 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.920 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:31.920 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:31.920 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.920 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.920 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.920 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:31.921 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:31.921 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.921 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.921 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.921 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:31.921 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:31.921 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:31.921 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.921 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.921 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:31.921 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:31.921 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:31.922 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.922 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.922 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:31.922 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:31.922 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:31.922 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.922 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.922 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:31.922 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:31.922 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:31.922 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.922 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.922 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:31.923 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:31.923 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:31.923 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.923 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.923 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:31.923 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:31.923 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:31.923 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.923 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.923 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:31.923 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:31.923 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:31.923 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.923 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.924 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:31.924 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:31.924 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:31.924 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.924 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:31.924 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.924 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.924 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.924 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:31.924 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:31.924 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 65.871031662000007, 2024-04-26T10:43:31.924 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:31.924 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:31.924 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:31.925 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:31.925 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.925 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:31.925 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:31.925 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.925 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.925 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.925 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:31.925 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:31.925 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.925 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.925 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.925 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:31.925 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:31.926 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:31.926 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.926 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.926 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:31.926 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:31.926 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:31.926 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.926 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.926 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:31.926 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:31.926 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:31.926 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.926 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.926 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:31.927 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:31.927 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:31.927 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.927 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.927 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:31.927 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:31.927 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:31.927 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.927 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.927 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:31.927 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:31.927 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:31.927 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.927 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.927 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:31.928 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:31.928 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:31.928 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.928 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.928 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:31.928 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:31.928 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:31.928 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.928 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:31.928 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.928 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.928 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.928 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:31.929 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:31.929 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 65.870826397000002, 2024-04-26T10:43:31.929 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:31.929 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:31.929 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:31.929 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:31.929 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.930 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:31.930 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:31.930 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.930 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.930 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.930 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:31.930 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:31.930 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.930 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.930 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.930 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:31.930 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:31.930 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:31.931 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.931 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.931 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:31.931 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:31.931 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:31.931 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.931 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.931 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:31.931 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:31.931 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:31.931 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.931 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.931 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:31.932 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:31.932 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:31.932 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.932 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.932 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:31.932 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:31.932 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:31.932 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.932 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.932 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:31.932 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:31.932 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:31.932 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.932 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.932 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:31.933 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:31.933 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:31.933 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.933 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.933 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:31.933 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:31.933 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:31.933 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.933 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:31.933 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.933 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.933 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.933 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:31.934 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:31.934 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 65.870505518000002, 2024-04-26T10:43:31.934 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:31.934 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:31.934 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:31.934 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:31.934 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.934 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:31.934 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:31.934 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.934 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.934 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.935 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:31.935 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:31.935 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.935 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.935 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.935 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:31.935 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:31.935 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:31.935 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.935 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.935 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:31.935 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:31.935 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:31.936 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.936 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.936 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:31.936 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:31.936 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:31.936 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.936 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.936 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:31.936 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:31.936 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:31.936 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.936 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.937 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:31.937 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:31.937 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:31.937 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.937 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.937 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:31.937 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:31.937 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:31.937 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.938 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.938 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:31.938 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:31.938 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:31.938 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.938 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.938 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:31.938 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:31.939 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:31.939 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.939 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.939 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:31.939 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:31.939 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:31.939 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.939 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.940 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:31.940 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:31.940 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:31.940 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.940 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.940 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:31.940 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:31.940 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:31.941 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.941 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:31.941 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.941 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.941 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.941 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:31.941 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:31.941 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 65.870453694000005, 2024-04-26T10:43:31.941 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:31.941 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:31.941 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:31.941 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:31.941 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.942 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:31.942 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:31.942 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.942 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.942 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.942 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:31.942 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:31.942 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.942 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.942 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.942 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:31.942 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:31.942 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:31.942 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.943 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.943 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:31.943 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:31.943 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:31.943 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.943 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.943 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:31.943 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:31.943 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:31.943 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.943 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.943 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:31.943 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:31.944 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:31.944 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.944 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.944 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:31.944 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:31.944 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:31.944 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.944 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.944 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:31.944 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:31.944 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:31.944 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.945 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.945 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:31.945 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:31.945 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:31.945 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.945 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.945 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:31.945 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:31.945 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:31.946 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.946 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.946 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:31.946 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:31.946 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:31.946 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.946 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.946 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:31.946 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:31.946 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:31.946 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.947 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.947 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:31.947 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:31.947 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:31.947 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.947 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:31.947 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.947 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.947 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.947 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:31.947 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:31.947 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 65.870400321999995, 2024-04-26T10:43:31.947 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:31.947 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:31.947 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:31.948 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:31.948 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.948 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:31.948 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:31.948 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.948 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.948 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.948 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:31.948 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:31.948 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.948 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.948 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.948 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:31.948 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:31.949 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:31.949 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.949 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.949 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:31.949 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:31.949 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:31.949 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.949 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.949 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:31.949 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:31.949 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:31.949 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.949 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.949 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:31.950 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:31.950 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:31.950 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.950 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.950 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:31.950 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:31.950 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:31.950 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.950 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.950 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:31.951 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:31.951 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:31.951 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.951 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.951 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:31.951 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:31.951 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:31.951 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.951 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.951 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:31.952 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:31.952 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:31.952 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.952 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.952 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:31.952 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:31.952 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:31.952 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.952 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.952 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:31.952 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:31.952 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:31.952 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.952 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.952 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:31.953 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:31.953 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:31.953 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.953 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:31.953 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.953 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.953 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.953 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:31.953 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:31.953 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 65.870355994999997, 2024-04-26T10:43:31.953 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:31.953 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:31.953 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:31.953 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:31.954 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.954 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:31.954 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:31.954 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.954 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.954 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.954 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:31.954 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:31.954 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.954 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.954 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.954 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:31.954 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:31.955 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:31.955 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.955 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.955 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:31.955 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:31.955 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:31.955 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.955 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.955 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:31.955 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:31.955 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:31.955 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.955 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.955 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:31.956 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:31.956 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:31.956 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.956 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.956 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:31.956 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:31.956 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:31.956 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.956 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.956 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:31.956 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:31.956 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:31.956 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.956 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.956 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:31.957 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:31.957 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:31.957 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.957 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.957 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:31.957 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:31.957 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:31.957 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.957 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.957 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:31.957 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:31.957 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:31.958 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.958 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.958 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:31.958 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:31.958 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:31.958 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.958 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.958 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:31.958 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:31.958 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:31.958 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.958 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:31.958 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.959 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.959 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.959 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:31.959 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:31.959 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 65.870332282000007, 2024-04-26T10:43:31.959 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:31.959 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:31.959 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:31.959 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:31.959 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.959 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:31.959 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:31.959 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.959 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.959 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.960 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:31.960 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:31.960 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.960 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.960 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.960 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:31.960 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:31.960 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:31.960 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.960 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.960 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:31.960 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:31.961 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:31.961 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.961 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.961 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:31.961 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:31.961 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:31.961 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.961 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.962 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:31.962 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:31.962 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:31.962 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.962 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.962 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:31.962 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:31.962 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:31.962 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.962 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.962 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:31.963 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:31.963 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:31.963 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.963 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.963 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:31.963 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:31.963 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:31.963 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.963 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.963 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:31.963 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:31.963 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:31.963 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.964 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.964 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:31.964 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:31.964 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:31.964 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.964 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.964 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:31.964 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:31.964 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:31.964 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.964 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.964 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:31.964 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:31.964 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:31.965 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.965 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:31.965 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.965 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.965 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.965 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:31.965 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:31.965 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 65.870297977000007, 2024-04-26T10:43:31.965 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:31.965 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:31.965 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:31.965 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:31.965 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.965 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:31.965 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:31.966 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.966 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.966 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.966 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:31.966 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:31.966 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.966 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.966 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.966 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:31.966 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:31.966 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:31.966 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.966 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.966 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:31.967 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:31.967 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:31.967 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.967 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.967 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:31.967 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:31.967 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:31.967 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.967 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.967 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:31.967 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:31.967 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:31.967 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.967 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.967 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:31.968 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:31.968 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:31.968 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.968 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.968 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:31.968 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:31.968 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:31.968 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.968 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.968 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:31.968 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:31.968 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:31.968 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.968 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.969 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:31.969 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:31.969 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:31.969 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.969 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.969 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:31.969 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:31.969 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:31.969 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.969 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.969 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:31.969 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:31.969 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:31.969 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.970 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.970 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:31.970 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:31.970 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:31.970 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.970 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:31.970 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.970 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.970 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.970 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:31.970 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:31.970 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 65.869961380999996, 2024-04-26T10:43:31.970 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:31.970 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:31.971 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:31.971 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:31.971 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.971 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:31.971 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:31.971 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.971 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.971 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.971 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:31.971 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:31.971 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.971 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.971 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.971 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:31.971 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:31.972 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:31.972 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.972 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.972 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:31.972 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:31.972 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:31.972 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.972 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.973 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:31.973 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:31.973 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:31.973 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.973 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.973 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:31.973 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:31.973 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:31.973 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.973 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.973 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:31.973 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:31.973 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:31.974 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.974 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.974 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:31.974 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:31.974 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:31.974 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.974 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.974 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:31.974 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:31.974 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:31.974 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.974 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:31.974 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.975 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.975 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.975 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:31.975 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:31.975 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 65.869919353, 2024-04-26T10:43:31.975 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:31.975 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:31.975 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:31.975 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:31.975 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.975 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:31.975 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:31.975 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.975 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.976 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.976 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:31.976 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:31.976 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.976 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.976 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.976 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:31.976 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:31.976 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:31.976 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.976 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.976 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:31.976 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:31.976 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:31.976 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.977 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:31.977 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:31.977 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:31.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.977 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:31.977 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:31.977 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:31.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.977 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:31.977 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:31.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:31.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.978 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.978 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:31.978 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:31.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:31.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.978 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.978 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:31.978 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:31.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:31.978 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.978 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:31.978 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.979 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.979 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.979 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:31.979 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:31.979 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 65.869866181000006, 2024-04-26T10:43:31.979 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:31.979 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:31.979 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:31.979 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:31.979 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.979 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:31.979 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:31.979 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.979 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.979 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.980 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:31.980 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:31.980 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.980 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.980 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.980 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:31.980 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:31.980 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:31.980 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.980 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.980 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:31.980 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:31.980 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:31.980 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.981 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.981 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:31.981 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:31.981 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:31.981 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.981 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.981 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:31.981 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:31.981 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:31.981 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.981 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.981 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:31.981 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:31.981 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:31.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.982 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.982 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:31.982 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:31.982 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:31.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.982 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.982 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:31.982 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:31.982 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:31.982 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.982 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:31.982 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.983 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.983 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.983 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:31.983 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:31.983 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 65.866459770999995, 2024-04-26T10:43:31.983 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:31.983 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:31.983 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:31.984 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:31.984 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.984 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:31.984 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:31.984 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.984 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.984 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.984 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:31.984 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:31.984 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.984 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.984 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.984 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:31.984 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:31.985 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:31.985 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.985 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.985 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:31.985 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:31.985 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:31.985 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.985 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.985 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:31.985 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:31.985 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:31.985 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.985 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.985 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:31.985 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:31.986 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:31.986 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.986 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.986 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:31.986 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:31.986 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:31.986 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.986 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.986 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:31.986 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:31.986 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:31.986 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.986 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:31.987 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.987 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.987 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.987 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:31.987 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:31.987 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 65.863987817999998, 2024-04-26T10:43:31.987 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:31.987 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:31.987 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:31.987 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:31.987 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.987 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:31.987 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:31.987 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.987 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.988 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.988 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:31.988 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:31.988 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.988 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.988 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.988 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:31.988 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:31.988 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:31.989 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.989 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.989 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:31.989 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:31.989 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:31.989 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.989 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.989 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:31.989 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:31.989 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:31.990 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.990 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.990 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:31.990 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:31.990 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:31.990 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.990 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.990 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:31.990 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:31.990 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:31.990 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.990 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.990 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:31.991 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:31.991 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:31.991 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.991 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.991 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:31.991 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:31.991 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:31.991 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.991 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:31.991 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.991 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.991 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.991 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:31.991 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:31.992 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 65.863334260000002, 2024-04-26T10:43:31.992 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:31.992 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:31.992 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:31.992 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:31.992 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.992 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:31.992 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:31.992 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.992 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.992 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.992 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:31.992 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:31.993 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.993 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.993 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.993 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:31.993 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:31.993 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:31.993 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.993 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.993 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:31.993 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:31.993 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:31.993 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.994 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.994 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:31.994 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:31.994 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:31.994 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.994 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.995 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:31.995 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:31.995 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:31.995 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.995 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.995 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:31.995 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:31.995 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:31.995 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.995 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.995 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:31.996 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:31.996 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:31.996 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.996 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.996 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:31.996 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:31.996 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:31.996 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.996 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:31.996 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:31.996 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.996 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.996 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:31.996 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:31.997 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 65.863258474999995, 2024-04-26T10:43:31.997 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:31.997 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:31.997 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:31.997 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:31.997 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.997 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:31.997 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:31.997 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.997 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.997 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.997 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:31.997 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:31.997 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:31.998 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.998 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.998 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:31.998 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:31.998 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:31.998 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.998 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.998 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:31.998 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:31.998 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:31.998 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.998 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.998 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:31.999 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:31.999 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:31.999 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.999 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.999 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:31.999 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:31.999 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:31.999 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.999 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:31.999 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:31.999 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:31.999 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:31.999 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:31.999 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.000 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:32.000 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:32.000 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:32.000 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.000 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.000 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.000 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:32.000 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:32.000 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.000 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.000 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.000 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.000 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.000 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:32.001 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:32.001 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 65.863044780999999, 2024-04-26T10:43:32.001 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:32.001 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:32.001 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:32.001 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:32.001 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.002 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:32.002 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:32.002 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.002 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.002 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.003 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:32.003 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:32.003 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.003 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.003 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.003 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:32.004 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:32.004 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.004 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.004 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.004 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:32.004 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:32.005 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:32.005 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.005 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.005 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:32.005 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:32.005 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:32.006 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.006 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.006 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.006 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:32.006 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:32.006 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.007 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.007 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:32.007 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:32.007 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:32.007 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.008 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.008 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.008 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:32.008 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:32.008 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.008 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.009 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.009 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.009 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.009 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:32.009 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:32.009 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 65.860600968, 2024-04-26T10:43:32.010 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:32.010 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:32.010 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:32.010 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:32.010 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.011 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:32.011 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:32.011 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.011 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.011 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.011 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:32.012 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:32.012 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.012 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.012 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.012 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:32.012 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:32.013 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:32.013 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.013 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.013 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:32.013 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:32.013 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:32.014 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.014 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.014 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:32.014 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:32.014 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:32.015 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.015 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.015 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.015 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:32.015 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:32.015 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.016 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.016 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:32.016 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:32.016 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:32.016 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.016 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.017 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:32.017 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:32.017 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:32.017 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.017 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.018 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.018 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:32.018 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:32.018 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.018 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.018 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.019 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.019 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.019 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:32.019 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:32.019 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 60.410538524000003, 2024-04-26T10:43:32.021 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:32.021 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:32.021 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.021 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:32.022 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.022 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:32.022 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:32.022 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.022 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.022 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.023 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:32.023 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:32.023 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.023 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.023 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.023 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:32.024 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:32.024 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:32.024 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.024 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.024 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:32.024 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:32.024 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:32.024 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.024 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.024 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:32.025 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:32.025 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:32.025 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.025 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.025 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.025 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:32.025 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:32.025 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.025 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.025 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:32.025 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:32.025 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:32.025 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.026 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.026 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:32.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:32.026 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:32.026 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.026 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.026 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:32.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:32.026 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:32.026 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.026 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.026 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:32.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:32.026 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:32.027 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.027 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.027 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:32.027 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:32.027 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:32.027 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.027 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.027 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:32.027 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:32.027 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:32.027 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.027 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.027 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.027 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:32.028 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:32.028 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.028 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.028 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.028 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.028 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.028 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:32.029 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:43:32.030 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:43:32.030 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:32.029+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:32.031 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:32.130 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:32.129+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:32.149 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:32.149 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:32.149 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:32.149 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:32.160 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:32.231 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:32.231+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:32.306 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:32.306 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:32.306 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:32.306 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:32.306 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:32.315 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:32.332 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:32.332+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:32.422 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:32.422 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:32.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:32.423 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:32.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.423 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:32.423 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:32.423 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 66.384471841000007, 2024-04-26T10:43:32.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:32.423 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:32.423 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.423 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:32.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.423 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:32.423 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:32.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:32.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:32.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:32.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:32.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:32.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:32.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:32.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:32.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:32.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:32.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:32.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:32.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:32.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:32.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:32.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.426 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:32.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:32.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:32.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.426 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:32.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:32.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:32.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.426 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:32.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:32.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 66.382721720000006, 2024-04-26T10:43:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:32.428 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:32.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.432 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:32.432 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:32.432 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:32.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.432 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:32.432 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 66.382668722000005, 2024-04-26T10:43:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.438 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:32.438 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:32.438 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:32.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.438 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:32.438 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:32.438 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:32.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.439 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:32.439 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:32.439 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:32.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.439 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:32.439 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:32.439 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:32.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.439 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:32.440 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:32.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:32.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.440 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:32.440 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:32.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:32.440 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.440 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:32.440 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.441 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:32.441 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:32.441 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 66.382590977999996, 2024-04-26T10:43:32.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:32.441 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:32.441 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.441 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:32.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:32.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:32.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:32.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:32.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:32.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:32.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:32.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:32.443 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:32.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:32.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:32.443 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:32.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:32.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:32.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:32.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:32.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:32.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:32.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:32.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:32.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:32.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:32.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:32.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:32.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:32.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:32.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:32.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:32.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:32.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:32.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:32.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:32.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:32.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:32.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:32.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:32.447 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.447 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:32.447 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.448 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:32.448 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:32.448 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 66.382551972000002, 2024-04-26T10:43:32.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:32.448 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:32.448 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.448 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:32.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:32.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:32.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:32.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:32.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:32.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:32.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:32.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:32.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:32.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:32.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:32.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:32.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:32.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:32.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:32.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:32.451 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:32.451 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:32.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:32.451 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:32.451 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:32.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:32.452 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:32.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:32.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.452 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:32.452 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:32.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:32.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.452 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:32.452 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:32.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:32.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.453 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:32.453 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:32.453 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:32.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.453 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:32.453 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:32.453 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:32.453 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.453 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:32.454 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.454 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:32.454 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:32.454 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 66.382533151000004, 2024-04-26T10:43:32.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:32.454 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:32.454 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.454 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:32.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:32.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:32.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:32.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:32.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:32.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:32.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:32.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:32.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:32.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:32.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:32.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:32.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:32.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.457 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.457 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:32.457 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:32.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.457 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:32.457 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:32.457 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:32.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.457 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:32.458 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:32.458 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:32.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.458 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:32.458 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:32.458 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:32.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.458 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:32.458 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:32.458 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:32.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.459 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:32.459 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:32.459 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:32.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.459 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:32.459 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:32.459 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:32.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.459 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:32.460 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:32.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:32.460 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.460 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:32.460 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.460 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:32.460 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:32.460 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 66.382501149000007, 2024-04-26T10:43:32.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:32.461 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:32.461 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.461 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:32.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:32.461 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:32.461 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:32.461 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:32.461 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.462 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:32.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:32.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.462 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:32.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:32.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:32.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.463 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:32.463 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:32.463 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:32.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.463 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.463 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:32.463 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:32.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.463 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:32.463 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:32.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:32.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.464 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:32.464 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:32.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:32.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.464 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:32.464 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:32.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:32.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:32.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:32.465 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:32.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:32.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:32.465 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:32.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:32.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:32.466 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:32.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.466 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:32.466 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:32.466 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:32.466 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.466 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:32.466 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.467 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:32.467 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:32.467 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 66.382292340999996, 2024-04-26T10:43:32.467 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:32.467 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:32.467 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.467 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:32.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.467 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:32.467 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:32.467 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.468 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:32.468 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:32.468 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.468 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:32.468 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:32.468 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:32.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.469 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:32.469 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:32.469 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:32.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.469 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:32.469 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:32.469 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:32.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.470 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.470 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:32.470 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:32.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.470 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:32.470 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:32.470 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:32.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.470 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:32.471 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:32.471 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:32.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.471 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:32.471 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:32.471 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:32.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.471 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:32.471 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:32.471 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:32.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.472 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:32.472 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:32.472 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:32.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.472 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:32.472 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:32.472 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:32.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.473 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:32.473 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:32.473 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:32.473 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.473 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:32.473 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.473 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:32.473 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:32.474 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 66.382261049999997, 2024-04-26T10:43:32.474 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:32.474 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:32.474 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:32.474 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:32.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.474 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:32.474 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:32.474 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.475 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:32.475 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:32.475 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.475 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:32.475 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:32.475 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.475 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:32.476 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:32.476 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:32.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.476 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:32.476 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:32.476 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:32.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.476 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.476 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:32.476 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:32.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.477 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:32.477 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:32.477 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:32.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.477 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:32.477 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:32.477 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:32.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.478 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:32.478 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:32.478 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:32.478 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.478 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:32.478 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.478 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:32.478 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:32.478 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 66.382233799999995, 2024-04-26T10:43:32.479 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:32.479 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:32.479 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:32.479 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:32.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.479 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:32.479 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:32.479 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.479 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:32.479 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:32.480 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.480 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:32.480 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:32.480 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.480 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:32.480 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:32.481 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:32.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.481 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:32.481 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:32.481 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:32.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.481 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.481 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:32.481 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:32.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.482 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:32.482 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:32.482 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:32.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.482 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:32.482 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:32.482 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:32.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.482 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:32.482 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:32.483 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:32.483 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.483 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:32.483 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.483 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:32.483 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:32.483 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 66.379457048999996, 2024-04-26T10:43:32.483 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:32.483 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:32.484 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:32.484 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:32.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.484 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:32.484 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:32.484 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.484 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:32.484 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:32.484 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.485 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:32.485 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:32.485 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.485 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:32.485 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:32.485 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:32.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.486 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:32.486 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:32.486 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:32.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.486 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.486 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:32.486 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:32.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.486 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:32.487 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:32.487 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:32.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.487 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:32.487 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:32.487 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:32.487 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.487 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:32.487 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.488 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:32.488 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:32.488 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 66.379406959999997, 2024-04-26T10:43:32.488 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:32.488 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:32.488 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.488 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:32.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.488 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:32.488 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:32.488 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.489 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:32.489 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:32.489 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.489 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:32.489 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:32.489 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.490 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.490 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:32.490 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:32.490 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:32.490 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.490 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.490 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:32.490 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:32.490 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:32.490 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.490 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.490 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.491 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:32.491 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:32.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.491 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:32.491 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:32.491 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:32.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.491 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:32.492 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:32.492 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:32.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.492 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:32.492 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:32.492 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:32.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.492 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:32.492 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:32.493 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:32.493 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.493 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:32.493 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.493 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:32.493 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:32.493 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 66.378514890999995, 2024-04-26T10:43:32.493 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:32.493 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:32.493 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.494 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:32.494 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.494 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:32.494 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:32.494 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.494 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.494 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:32.494 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:32.494 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.495 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:32.496 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:32.496 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:32.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.496 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.496 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:32.496 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:32.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.496 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:32.496 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:32.496 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:32.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.497 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:32.497 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:32.497 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:32.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.497 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:32.497 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:32.497 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:32.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.498 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:32.498 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:32.498 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:32.498 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.498 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:32.498 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.498 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:32.498 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:32.498 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 66.376326562000003, 2024-04-26T10:43:32.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:32.499 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:32.499 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.499 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:32.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.499 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:32.499 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:32.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.499 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:32.499 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:32.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.500 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:32.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:32.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.500 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:32.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:32.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:32.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:32.501 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:32.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:32.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.501 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:32.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:32.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.502 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:32.502 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:32.502 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:32.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.502 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:32.502 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:32.502 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:32.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.502 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:32.502 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:32.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:32.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.503 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:32.503 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:32.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:32.503 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.503 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:32.503 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.503 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:32.504 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:32.504 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 66.376191191999993, 2024-04-26T10:43:32.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:32.504 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:32.504 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.504 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:32.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:32.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:32.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.505 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:32.505 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:32.505 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.505 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:32.505 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:32.505 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.505 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:32.506 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:32.506 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:32.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.506 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:32.506 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:32.506 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:32.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.506 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.506 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:32.507 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:32.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.507 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:32.507 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:32.507 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:32.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.507 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:32.507 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:32.507 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:32.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.508 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:32.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:32.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:32.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.508 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:32.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:32.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:32.508 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.508 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:32.509 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.509 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:32.509 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:32.509 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 66.375976617999996, 2024-04-26T10:43:32.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:32.509 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:32.509 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.509 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:32.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:32.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:32.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:32.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:32.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.511 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:32.511 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:32.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.511 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:32.511 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:32.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:32.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:32.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:32.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:32.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:32.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:32.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:32.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:32.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:32.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:32.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:32.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:32.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:32.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:32.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:32.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:32.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:32.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:32.514 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.514 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:32.514 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.515 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:32.515 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:32.515 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 66.375637677, 2024-04-26T10:43:32.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:32.515 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:32.515 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.515 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:32.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:32.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:32.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:32.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:32.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:32.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:32.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:32.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:32.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:32.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:32.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:32.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:32.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:32.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:32.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:32.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:32.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:32.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:32.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:32.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:32.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:32.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:32.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:32.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:32.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:32.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:32.519 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.519 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:32.519 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.520 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:32.520 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:32.520 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 66.375528299999999, 2024-04-26T10:43:32.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:32.520 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:32.520 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:32.520 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:32.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:32.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:32.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:32.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:32.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:32.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:32.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:32.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:32.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:32.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:32.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.522 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:32.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:32.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:32.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.522 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:32.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:32.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:32.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:32.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:32.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:32.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:32.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:32.523 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.524 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:32.524 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.524 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:32.524 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:32.524 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 66.375488580999999, 2024-04-26T10:43:32.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:32.524 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:32.524 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.524 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:32.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:32.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:32.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:32.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:32.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:32.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:32.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:32.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:32.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:32.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:32.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:32.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:32.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:32.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.527 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:32.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:32.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.527 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:32.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:32.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:32.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:32.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:32.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:32.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:32.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:32.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:32.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:32.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:32.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:32.529 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.529 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:32.529 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.529 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:32.529 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:32.529 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 66.375151048000006, 2024-04-26T10:43:32.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:32.529 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:32.529 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.530 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:32.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.530 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:32.530 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:32.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.530 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:32.530 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:32.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:32.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:32.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:32.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:32.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:32.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:32.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:32.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:32.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:32.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.532 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:32.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:32.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.532 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:32.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:32.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:32.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:32.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:32.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:32.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:32.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:32.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:32.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:32.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:32.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:32.534 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:32.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:32.534 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.534 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:32.534 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.534 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:32.534 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:32.534 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:32.536 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:32.536 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:32.535+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:32.637 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:32.636+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:32.642 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:32.643 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:32.643 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:32.643 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:32.652 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:32.738 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:32.737+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:32.753 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:32.753 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:32.753 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:32.753 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:32.753 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:32.762 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:32.840 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:32.839+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:32.866 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:32.866 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:32.866 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:32.867 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:32.867 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.867 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:32.867 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:32.867 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 66.827301837999997, 2024-04-26T10:43:32.867 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:32.868 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:32.868 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.868 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:32.868 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.868 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:32.868 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:32.869 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.869 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.869 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.869 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:32.869 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:32.869 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.870 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.870 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.870 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:32.870 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:32.870 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.870 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.871 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.871 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:32.871 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:32.871 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:32.871 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.871 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.872 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:32.872 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:32.872 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:32.872 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.872 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.872 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.873 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:32.873 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:32.873 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.873 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.873 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:32.873 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:32.874 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:32.874 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.874 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.874 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:32.874 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:32.874 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:32.875 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.875 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.875 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:32.875 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:32.875 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:32.875 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.876 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.876 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.876 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:32.876 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:32.876 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.876 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.877 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.877 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.877 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.877 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:32.877 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:32.878 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 66.826431057999997, 2024-04-26T10:43:32.878 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:32.878 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:32.878 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.878 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:32.878 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.879 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:32.879 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:32.879 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.879 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.879 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.879 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:32.880 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:32.880 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.880 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.880 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.880 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:32.880 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:32.881 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.881 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.881 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.881 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:32.881 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:32.881 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:32.882 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.882 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.882 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:32.882 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:32.882 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:32.883 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.883 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.883 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.883 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:32.883 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:32.883 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.884 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.884 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:32.884 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:32.884 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:32.884 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.884 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.885 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:32.885 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:32.885 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:32.885 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.885 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.885 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:32.886 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:32.886 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:32.886 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.886 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.886 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.886 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:32.887 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:32.887 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.887 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.887 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.887 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.887 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.888 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:32.888 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:32.888 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 66.825443715000006, 2024-04-26T10:43:32.888 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:32.888 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:32.888 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.889 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:32.889 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.889 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:32.889 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:32.889 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.889 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.890 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.890 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:32.890 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:32.890 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.890 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.890 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.891 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:32.891 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:32.891 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:32.891 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.891 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.892 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:32.892 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:32.892 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:32.892 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.892 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.892 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:32.893 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:32.893 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:32.893 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.893 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.893 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.893 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:32.893 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:32.894 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.894 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.894 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:32.894 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:32.894 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:32.895 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.895 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.895 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:32.895 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:32.895 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:32.895 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.896 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.896 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:32.896 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:32.896 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:32.896 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.896 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.897 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.897 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:32.897 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:32.897 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.897 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.897 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.898 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.898 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.898 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:32.898 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:32.898 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 66.825238450000001, 2024-04-26T10:43:32.898 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:32.899 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:32.899 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.899 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:32.899 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.899 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:32.899 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:32.900 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.900 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.900 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.900 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:32.900 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:32.901 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.901 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.901 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.901 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:32.901 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:32.901 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.902 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.902 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.902 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:32.902 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:32.902 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:32.902 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.903 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.903 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:32.903 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:32.903 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:32.903 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.903 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.904 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.904 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:32.904 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:32.904 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.904 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.904 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:32.905 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:32.905 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:32.905 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.905 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.905 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:32.905 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:32.906 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:32.906 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.906 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.906 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:32.906 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:32.907 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:32.907 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.907 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.907 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.907 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:32.907 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:32.908 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.908 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.908 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.908 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.908 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.908 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:32.909 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:32.909 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 66.824917571, 2024-04-26T10:43:32.909 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:32.909 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:32.909 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.909 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:32.910 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.910 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:32.910 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:32.910 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.910 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.911 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.911 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:32.911 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:32.911 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.911 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.911 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.912 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:32.912 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:32.912 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:32.912 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.912 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.912 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:32.912 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:32.913 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:32.913 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.913 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.913 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:32.913 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:32.913 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:32.914 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.914 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.914 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.914 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:32.914 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:32.915 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.915 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.915 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:32.915 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:32.915 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:32.915 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.916 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.916 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:32.916 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:32.916 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:32.916 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.916 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.917 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:32.917 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:32.917 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:32.917 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.917 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.917 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:32.918 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:32.918 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:32.918 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.918 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.918 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:32.918 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:32.918 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:32.918 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.918 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.919 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:32.919 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:32.919 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:32.919 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.919 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.919 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.919 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:32.919 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:32.919 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.919 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.919 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.919 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.919 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.919 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:32.920 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:32.920 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 66.824865747000004, 2024-04-26T10:43:32.920 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:32.920 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:32.920 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.920 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:32.920 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.920 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:32.920 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:32.920 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.920 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.920 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.920 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:32.920 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:32.921 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.921 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.921 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.921 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:32.921 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:32.921 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.921 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.921 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.921 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:32.921 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:32.921 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:32.921 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.921 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.921 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:32.922 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:32.922 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:32.922 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.922 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.922 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.922 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:32.922 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:32.922 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.922 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.922 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:32.922 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:32.922 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:32.922 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.922 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.922 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:32.923 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:32.923 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:32.923 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.923 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.923 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:32.923 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:32.923 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:32.923 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.923 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.923 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:32.923 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:32.923 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:32.923 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.923 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.924 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:32.924 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:32.924 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:32.924 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.924 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.924 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:32.924 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:32.924 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:32.924 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.924 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.924 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.924 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:32.924 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:32.924 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.924 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.925 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.925 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.925 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.925 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:32.925 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:32.925 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 66.824812374999993, 2024-04-26T10:43:32.925 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:32.925 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:32.925 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.925 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:32.925 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.925 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:32.925 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:32.925 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.926 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.926 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.926 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:32.926 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:32.926 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.926 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.926 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.926 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:32.926 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:32.926 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.926 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.926 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.926 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:32.926 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:32.927 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:32.927 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.927 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.927 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:32.927 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:32.927 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:32.927 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.927 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.927 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.927 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:32.927 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:32.927 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.927 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.927 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:32.927 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:32.928 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:32.928 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.928 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.928 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:32.928 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:32.928 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:32.928 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.928 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.928 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:32.928 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:32.928 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:32.928 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.928 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.928 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:32.929 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:32.929 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:32.929 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.929 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.929 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:32.929 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:32.929 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:32.929 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.929 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.929 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:32.929 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:32.929 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:32.929 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.929 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.929 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.930 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:32.930 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:32.930 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.930 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.930 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.930 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.930 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.930 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:32.930 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:32.930 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 66.824768047999996, 2024-04-26T10:43:32.930 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:32.930 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:32.930 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.930 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:32.931 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.931 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:32.931 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:32.931 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.931 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.931 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.931 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:32.931 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:32.931 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.931 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.931 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.931 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:32.931 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:32.931 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:32.931 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.932 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.932 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:32.932 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:32.932 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:32.932 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.932 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.932 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:32.932 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:32.932 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:32.932 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.932 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.932 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.932 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:32.932 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:32.932 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.933 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.933 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:32.933 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:32.933 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:32.933 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.933 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.933 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:32.933 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:32.933 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:32.933 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.933 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.933 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:32.933 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:32.933 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:32.934 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.934 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.934 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:32.934 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:32.934 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:32.934 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.934 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.934 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:32.934 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:32.934 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:32.934 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.934 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.934 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:32.934 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:32.934 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:32.935 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.935 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.935 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.935 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:32.935 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:32.935 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.935 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.935 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.935 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.935 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.935 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:32.935 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:32.935 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 66.824744335000005, 2024-04-26T10:43:32.935 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:32.936 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:32.936 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.936 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:32.936 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.936 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:32.936 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:32.936 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.936 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.936 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.936 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:32.936 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:32.936 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.936 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.936 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.937 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:32.937 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:32.937 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.937 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.937 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.937 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:32.937 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:32.937 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:32.937 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.937 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.937 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:32.937 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:32.937 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:32.938 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.938 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.938 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.938 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:32.938 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:32.938 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.938 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.938 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:32.938 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:32.938 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:32.938 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.938 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.938 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:32.938 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:32.939 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:32.939 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.939 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.939 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:32.939 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:32.939 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:32.939 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.939 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.939 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:32.939 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:32.939 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:32.939 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.939 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.939 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:32.940 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:32.940 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:32.940 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.940 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.940 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:32.940 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:32.940 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:32.940 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.940 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.940 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.940 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:32.940 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:32.940 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.940 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.940 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.941 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.941 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.941 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:32.941 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:32.941 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 66.824710030000006, 2024-04-26T10:43:32.941 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:32.941 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:32.941 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.941 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:32.941 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.941 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:32.941 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:32.941 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.941 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.942 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.942 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:32.942 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:32.942 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.942 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.942 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.942 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:32.942 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:32.942 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.942 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.942 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.942 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:32.942 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:32.942 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:32.943 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.943 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.943 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:32.943 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:32.943 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:32.943 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.943 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.943 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.943 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:32.943 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:32.943 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.943 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.943 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:32.943 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:32.944 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:32.944 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.944 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.944 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:32.944 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:32.944 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:32.944 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.944 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.944 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:32.944 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:32.944 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:32.944 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.944 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.944 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:32.944 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:32.945 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:32.945 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.945 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.945 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:32.945 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:32.945 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:32.945 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.945 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.945 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:32.945 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:32.945 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:32.945 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.945 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.945 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.945 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:32.946 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:32.946 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.946 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.946 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.946 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.946 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.946 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:32.946 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:32.946 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 66.824373433999995, 2024-04-26T10:43:32.946 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:32.946 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:32.946 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:32.946 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:32.946 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.947 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:32.947 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:32.947 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.947 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.947 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.947 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:32.947 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:32.947 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.947 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.947 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.947 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:32.947 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:32.947 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:32.947 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.947 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.948 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:32.948 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:32.948 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:32.948 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.948 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.948 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:32.948 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:32.948 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:32.948 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.948 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.948 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.948 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:32.948 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:32.948 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.949 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.949 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:32.949 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:32.949 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:32.949 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.949 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.949 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:32.949 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:32.949 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:32.949 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.949 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.949 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.949 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:32.949 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:32.949 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.950 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.950 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.950 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.950 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.950 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:32.950 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:32.950 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 66.824331405999999, 2024-04-26T10:43:32.950 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:32.950 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:32.950 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:32.950 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:32.950 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.950 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:32.951 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:32.951 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.951 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.951 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.951 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:32.951 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:32.951 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.951 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.951 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.951 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:32.951 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:32.951 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.951 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.951 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.952 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:32.952 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:32.952 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:32.952 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.952 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.952 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:32.952 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:32.952 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:32.952 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.952 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.952 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.952 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:32.952 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:32.952 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.952 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.953 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:32.953 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:32.953 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:32.953 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.953 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.953 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:32.953 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:32.953 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:32.953 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.953 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.953 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.953 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:32.953 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:32.953 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.954 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.954 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.954 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.954 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.954 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:32.954 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:32.954 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 66.824278234000005, 2024-04-26T10:43:32.954 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:32.954 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:32.954 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:32.954 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:32.954 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.954 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:32.954 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:32.955 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.955 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.955 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.955 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:32.955 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:32.955 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.955 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.955 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.955 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:32.955 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:32.955 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.955 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.955 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.955 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:32.956 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:32.956 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:32.956 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.956 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.956 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:32.956 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:32.956 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:32.956 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.956 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.956 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.956 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:32.956 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:32.956 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.956 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.956 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:32.957 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:32.957 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:32.957 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.957 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.957 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:32.957 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:32.957 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:32.957 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.957 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.957 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.957 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:32.957 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:32.957 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.957 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.957 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.958 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.958 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.958 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:32.958 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:32.958 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 66.820871823999994, 2024-04-26T10:43:32.958 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:32.958 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:32.958 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:32.958 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:32.958 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.958 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:32.958 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:32.958 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.958 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.959 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.959 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:32.959 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:32.959 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.959 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.959 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.959 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:32.959 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:32.959 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.959 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.959 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.959 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:32.959 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:32.959 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:32.960 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.960 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.960 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:32.960 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:32.960 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:32.960 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.960 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.960 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.960 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:32.960 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:32.960 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.960 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.960 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:32.960 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:32.960 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:32.961 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.961 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.961 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.961 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:32.961 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:32.961 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.961 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.961 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.961 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.961 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.961 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:32.961 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:32.961 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 66.818399870999997, 2024-04-26T10:43:32.961 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:32.961 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:32.962 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:32.962 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:32.962 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.962 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:32.962 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:32.962 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.962 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.962 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.962 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:32.962 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:32.962 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.962 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.962 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.962 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:32.963 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:32.963 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.963 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.963 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.963 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:32.963 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:32.963 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:32.963 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.963 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.963 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:32.963 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:32.963 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:32.963 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.963 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.963 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.964 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:32.964 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:32.964 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.964 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.964 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:32.964 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:32.964 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:32.964 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.964 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.964 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:32.964 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:32.964 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:32.964 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.964 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.965 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.965 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:32.965 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:32.965 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.965 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.965 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.965 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.965 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.965 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:32.965 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:32.965 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 66.817746313000001, 2024-04-26T10:43:32.965 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:32.965 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:32.965 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:32.965 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:32.966 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.966 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:32.966 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:32.966 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.966 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.966 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.966 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:32.966 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:32.966 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.966 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.966 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.966 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:32.966 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:32.966 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.967 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.967 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.967 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:32.967 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:32.967 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:32.967 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.967 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.967 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:32.967 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:32.967 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:32.967 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.967 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.967 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.967 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:32.968 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:32.968 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.968 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.968 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:32.968 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:32.968 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:32.968 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.968 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.968 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:32.968 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:32.968 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:32.968 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.968 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.968 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.968 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:32.969 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:32.969 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.969 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.969 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.969 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.969 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.969 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:32.969 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:32.969 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 66.817670527999994, 2024-04-26T10:43:32.969 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:32.969 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:32.969 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:32.969 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:32.969 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.969 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:32.970 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:32.970 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.970 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.970 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.970 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:32.970 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:32.970 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.970 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.970 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.970 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:32.970 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:32.970 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.970 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.971 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.971 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:32.971 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:32.971 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:32.971 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.971 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.971 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:32.971 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:32.971 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:32.971 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.971 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.971 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.971 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:32.971 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:32.972 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.972 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.972 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:32.972 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:32.972 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:32.972 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.972 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.972 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:32.972 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:32.972 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:32.972 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.972 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.972 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.972 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:32.972 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:32.973 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.973 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.973 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.973 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.973 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.973 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:32.973 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:32.973 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 66.817456833999998, 2024-04-26T10:43:32.973 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:32.973 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:32.973 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:32.973 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:32.973 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.973 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:32.973 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:32.974 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.974 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.974 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.974 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:32.974 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:32.974 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.974 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.974 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.974 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:32.974 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:32.974 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:32.974 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.974 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.974 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:32.975 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:32.975 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:32.975 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.975 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.975 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:32.975 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:32.975 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:32.975 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.975 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.975 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.975 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:32.975 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:32.975 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.975 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.975 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:32.976 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:32.976 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:32.976 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.976 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.976 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.976 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:32.976 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:32.976 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.976 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.976 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.976 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.976 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.976 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:32.976 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:32.976 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 66.815013020999999, 2024-04-26T10:43:32.977 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:32.977 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:32.977 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:32.977 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:32.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.977 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:32.977 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:32.977 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.977 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:32.977 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:32.977 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.978 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:32.978 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:32.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:32.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.978 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.978 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:32.978 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:32.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:32.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.978 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.978 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:32.978 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:32.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:32.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.979 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.979 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.979 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:32.979 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:32.979 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.979 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.979 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:32.979 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:32.979 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:32.979 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.979 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.979 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:32.979 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:32.979 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:32.980 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.980 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.980 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.980 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:32.980 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:32.980 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.980 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.980 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.980 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.980 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.980 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:32.980 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:32.980 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 61.364950577000002, 2024-04-26T10:43:32.980 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:32.980 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:32.981 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:32.981 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:32.981 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.981 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:32.981 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:32.981 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.981 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.981 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.981 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:32.981 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:32.981 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:32.981 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.981 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.981 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:32.981 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:32.982 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:32.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.982 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.982 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:32.982 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:32.982 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:32.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.982 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.982 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:32.982 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:32.982 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:32.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.982 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.982 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:32.983 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:32.983 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:32.983 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.983 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.983 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:32.983 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:32.983 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:32.983 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.983 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.983 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:32.983 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:32.983 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:32.983 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.983 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.983 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:32.984 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:32.984 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:32.984 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.984 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.984 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:32.984 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:32.984 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:32.984 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.984 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.984 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:32.984 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:32.984 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:32.984 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.984 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.985 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:32.985 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:32.985 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:32.985 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:32.985 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:32.985 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:32.985 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:32.985 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:32.985 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.985 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.985 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.985 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:32.985 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:32.985 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:32.987 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:32.987 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:32.986+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:33.088 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:33.087+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:33.100 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:33.100 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:33.100 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:33.100 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:33.109 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:33.154 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:43:33.188 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:33.187+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:33.254 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:33.255 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:33.255 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:33.255 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:33.255 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:33.264 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:33.308 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:33.307+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:33.371 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:33.371 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:33.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:33.371 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:33.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.371 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:33.372 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:33.372 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 67.333167922000001, 2024-04-26T10:43:33.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:33.372 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:33.372 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.372 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:33.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:33.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:33.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:33.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:33.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:33.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:33.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:33.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:33.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:33.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:33.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:33.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:33.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:33.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:33.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:33.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:33.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:33.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:33.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:33.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:33.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:33.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:33.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:33.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:33.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:33.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:33.375 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.376 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:33.376 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.376 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:33.376 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:33.376 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 67.331417801000001, 2024-04-26T10:43:33.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:33.376 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:33.376 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.376 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:33.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:33.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:33.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:33.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:33.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:33.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:33.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:33.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:33.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:33.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:33.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:33.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:33.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:33.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:33.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:33.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:33.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:33.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:33.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:33.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:33.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:33.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:33.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:33.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:33.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.380 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:33.380 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:33.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:33.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.380 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:33.380 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:33.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:33.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:33.381 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:33.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:33.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:33.381 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:33.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:33.381 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.381 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:33.381 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.381 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:33.382 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:33.382 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 67.331364803, 2024-04-26T10:43:33.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:33.382 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:33.382 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.382 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:33.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:33.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:33.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:33.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:33.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:33.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:33.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:33.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:33.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:33.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:33.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:33.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:33.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:33.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:33.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:33.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:33.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:33.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:33.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:33.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:33.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:33.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:33.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:33.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:33.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:33.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:33.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.386 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:33.386 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:33.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:33.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.386 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:33.386 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:33.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:33.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.386 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:33.386 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:33.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:33.386 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.387 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:33.387 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.387 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:33.387 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:33.387 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 67.331287059000005, 2024-04-26T10:43:33.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:33.387 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:33.387 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.387 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:33.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:33.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:33.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:33.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:33.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:33.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:33.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:33.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:33.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:33.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:33.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:33.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:33.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:33.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:33.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:33.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:33.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:33.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:33.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:33.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:33.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:33.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:33.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:33.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:33.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:33.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:33.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:33.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:33.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:33.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:33.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:33.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:33.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 67.331248052999996, 2024-04-26T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:33.392 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:33.393 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.393 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:33.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:33.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:33.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:33.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:33.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:33.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:33.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:33.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:33.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:33.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:33.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:33.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:33.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:33.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:33.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:33.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:33.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:33.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:33.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:33.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:33.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:33.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:33.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:33.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.397 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:33.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:33.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:33.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.397 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:33.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:33.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:33.397 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.397 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:33.397 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.398 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:33.398 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:33.398 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 67.331229231999998, 2024-04-26T10:43:33.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:33.398 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:33.398 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.398 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:33.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:33.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:33.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:33.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:33.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:33.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:33.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:33.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:33.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:33.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:33.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:33.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:33.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:33.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:33.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:33.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:33.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:33.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:33.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:33.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:33.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:33.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:33.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:33.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:33.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:33.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:33.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:33.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:33.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:33.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:33.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:33.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:33.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:33.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:33.403 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:33.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:33.403 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.403 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:33.403 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.403 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:33.403 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:33.403 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 67.331197230000001, 2024-04-26T10:43:33.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:33.404 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:33.404 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.404 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:33.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:33.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:33.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:33.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:33.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:33.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:33.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.405 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:33.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:33.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:33.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.405 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:33.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:33.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:33.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:33.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:33.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:33.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:33.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:33.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:33.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:33.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:33.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:33.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:33.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:33.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:33.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:33.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:33.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:33.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:33.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:33.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:33.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:33.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:33.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:33.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:33.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:33.408 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.408 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:33.408 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.409 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:33.409 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:33.409 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 67.330988422000004, 2024-04-26T10:43:33.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:33.409 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:33.409 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.409 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:33.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.409 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:33.409 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:33.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.410 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:33.410 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:33.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.410 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:33.410 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:33.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:33.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.410 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:33.410 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:33.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:33.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:33.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:33.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:33.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:33.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:33.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:33.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:33.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:33.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:33.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:33.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:33.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:33.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:33.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:33.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:33.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:33.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:33.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:33.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:33.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:33.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:33.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:33.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:33.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:33.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:33.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:33.414 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.414 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:33.414 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.414 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:33.414 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:33.414 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 67.330957131000005, 2024-04-26T10:43:33.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:33.414 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:33.414 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:33.415 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:33.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.415 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:33.415 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:33.415 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.415 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:33.415 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:33.415 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.415 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:33.415 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:33.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:33.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:33.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:33.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:33.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:33.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:33.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:33.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:33.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:33.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:33.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:33.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:33.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:33.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:33.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.418 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:33.418 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:33.418 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:33.418 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.418 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:33.418 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.418 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:33.418 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:33.418 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 67.330929881000003, 2024-04-26T10:43:33.418 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:33.419 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:33.419 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:33.419 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:33.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.419 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:33.419 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:33.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.419 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:33.419 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:33.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:33.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:33.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:33.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:33.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:33.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:33.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:33.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:33.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.421 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.421 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:33.421 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:33.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.421 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:33.421 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:33.421 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:33.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.421 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:33.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:33.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:33.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:33.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:33.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:33.422 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.422 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:33.422 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.422 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:33.422 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:33.423 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 67.328153130000004, 2024-04-26T10:43:33.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:33.423 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:33.423 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:33.423 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:33.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.423 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:33.423 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:33.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.423 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:33.423 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:33.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:33.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:33.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:33.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:33.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:33.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:33.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:33.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:33.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:33.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:33.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:33.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:33.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:33.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:33.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:33.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:33.425 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.425 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:33.426 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.426 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:33.426 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:33.426 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 67.328103041000006, 2024-04-26T10:43:33.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:33.426 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:33.426 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.426 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:33.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.426 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:33.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:33.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.427 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:33.427 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:33.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.427 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:33.427 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:33.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.427 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:33.427 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:33.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:33.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.428 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:33.428 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:33.428 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:33.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.428 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.428 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:33.428 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:33.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.428 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:33.428 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:33.428 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:33.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:33.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:33.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:33.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:33.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:33.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:33.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:33.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:33.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:33.430 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.430 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:33.430 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.430 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:33.430 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:33.430 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 67.327210972000003, 2024-04-26T10:43:33.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:33.430 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:33.430 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.430 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:33.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:33.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:33.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:33.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:33.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:33.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:33.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.432 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:33.432 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:33.432 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:33.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.432 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:33.432 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:33.432 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:33.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.432 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.432 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:33.432 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:33.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.433 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:33.433 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:33.433 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:33.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.433 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:33.433 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:33.433 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:33.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.433 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:33.433 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:33.434 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:33.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.434 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:33.434 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:33.434 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:33.434 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.434 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:33.434 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.434 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:33.434 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:33.434 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 67.325022642999997, 2024-04-26T10:43:33.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:33.435 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:33.435 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.435 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:33.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:33.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:33.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:33.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:33.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:33.436 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:33.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:33.436 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:33.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:33.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:33.436 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:33.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:33.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:33.437 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:33.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:33.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:33.437 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:33.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:33.438 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:33.438 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:33.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.438 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:33.438 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:33.438 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:33.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.438 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:33.438 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:33.438 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:33.438 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.438 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:33.439 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.439 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:33.439 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:33.439 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 67.324887273000002, 2024-04-26T10:43:33.439 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:33.439 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:33.439 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.439 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:33.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.439 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:33.439 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:33.439 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.440 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:33.440 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:33.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.440 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:33.440 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:33.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.440 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:33.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:33.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:33.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:33.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:33.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:33.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:33.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:33.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:33.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:33.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:33.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:33.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:33.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:33.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:33.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:33.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:33.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:33.443 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:33.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:33.443 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.443 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:33.443 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.443 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:33.443 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:33.443 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 67.324672699000004, 2024-04-26T10:43:33.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:33.443 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:33.444 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.444 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:33.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:33.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:33.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:33.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:33.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:33.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:33.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:33.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:33.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:33.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:33.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:33.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:33.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:33.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:33.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:33.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:33.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:33.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:33.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:33.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:33.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:33.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:33.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:33.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:33.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:33.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:33.447 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.447 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:33.447 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.448 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:33.448 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:33.448 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 67.324333757999995, 2024-04-26T10:43:33.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:33.448 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:33.448 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.448 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:33.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:33.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:33.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:33.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:33.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:33.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:33.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:33.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:33.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:33.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:33.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:33.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:33.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:33.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:33.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:33.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:33.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:33.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.453 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:33.453 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:33.453 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:33.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.453 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:33.453 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:33.453 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:33.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.454 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:33.454 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:33.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:33.454 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.454 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:33.454 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.454 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:33.454 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:33.454 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 67.324224380999993, 2024-04-26T10:43:33.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:33.455 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:33.455 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:33.455 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:33.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:33.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:33.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:33.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:33.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:33.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:33.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:33.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:33.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:33.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:33.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:33.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:33.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:33.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:33.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.457 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 67.324184661999993, 2024-04-26T10:43:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.458 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:33.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:33.461 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 67.323847129000001, 2024-04-26T10:43:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.462 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:33.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:33.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:33.466 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:33.466 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:33.468 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:33.469 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:33.466+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:33.569 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:33.568+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:33.575 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:33.575 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:33.575 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:33.575 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:33.585 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:33.670 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:33.668+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:33.687 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:33.688 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:33.688 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:33.688 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:33.688 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:33.697 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:33.771 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:33.770+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:33.840 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:33.840 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:33.840 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:33.840 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:33.840 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.840 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:33.840 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:33.840 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 67.801538800000003, 2024-04-26T10:43:33.840 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:33.841 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:33.841 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.841 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:33.841 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.841 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:33.841 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:33.841 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.841 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.841 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.841 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:33.841 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:33.841 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.841 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.841 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.842 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:33.842 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:33.842 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.842 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.842 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.842 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:33.842 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:33.842 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:33.842 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.842 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.842 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:33.842 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:33.842 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:33.843 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.843 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.843 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.843 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:33.843 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:33.843 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.843 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.843 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:33.843 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:33.843 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:33.843 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.843 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.843 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:33.843 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:33.844 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:33.844 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.844 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.844 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:33.844 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:33.844 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:33.844 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.844 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.844 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:33.844 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:33.844 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:33.844 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.844 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:33.844 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.845 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.845 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.845 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:33.845 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:33.845 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 67.800668020000003, 2024-04-26T10:43:33.845 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:33.845 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:33.845 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.845 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:33.845 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.845 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:33.845 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:33.845 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.846 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.846 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.846 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:33.846 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:33.846 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.846 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.847 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.847 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:33.847 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:33.847 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.847 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.847 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.847 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:33.847 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:33.847 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:33.847 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.847 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.847 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:33.848 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:33.848 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:33.848 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.848 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.848 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.848 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:33.848 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:33.848 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.848 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.848 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:33.848 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:33.848 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:33.848 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.848 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.849 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:33.849 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:33.849 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:33.849 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.849 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.849 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:33.849 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:33.849 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:33.849 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.849 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.849 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:33.849 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:33.849 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:33.849 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.850 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:33.850 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.850 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.850 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.850 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:33.850 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:33.850 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 67.799680676999998, 2024-04-26T10:43:33.850 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:33.850 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:33.850 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.850 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:33.850 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.850 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:33.850 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:33.851 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.851 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.851 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.851 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:33.851 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:33.851 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.851 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.851 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.851 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:33.851 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:33.851 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:33.851 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.851 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.851 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:33.851 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:33.852 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:33.852 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.852 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.852 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:33.852 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:33.852 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:33.852 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.852 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.852 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.852 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:33.852 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:33.852 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.852 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.852 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:33.853 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:33.853 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:33.853 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.853 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.853 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:33.853 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:33.853 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:33.853 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.853 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.853 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:33.853 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:33.853 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:33.853 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.853 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.853 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:33.854 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:33.854 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:33.854 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.854 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:33.854 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.854 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.854 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.854 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:33.854 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:33.854 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 67.799475412000007, 2024-04-26T10:43:33.854 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:33.854 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:33.854 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.854 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:33.855 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.855 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:33.855 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:33.855 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.855 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.855 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.855 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:33.855 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:33.855 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.855 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.855 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.855 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:33.855 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:33.856 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.856 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.856 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.856 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:33.856 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:33.856 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:33.856 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.856 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.856 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:33.856 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:33.856 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:33.856 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.856 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.857 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.857 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:33.857 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:33.857 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.857 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.857 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:33.858 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:33.858 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:33.858 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.858 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.858 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:33.858 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:33.858 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:33.858 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.858 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.858 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:33.858 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:33.858 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:33.858 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.859 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.859 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:33.859 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:33.859 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:33.859 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.859 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:33.859 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.859 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.859 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.859 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:33.859 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:33.859 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 67.799154533000006, 2024-04-26T10:43:33.859 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:33.860 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:33.860 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.860 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:33.860 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.860 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:33.861 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:33.861 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.861 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.861 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.861 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:33.861 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:33.861 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.861 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.861 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.861 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:33.862 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:33.862 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:33.862 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.862 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.862 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:33.862 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:33.862 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:33.862 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.862 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.862 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:33.862 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:33.862 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:33.862 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.863 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.863 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.863 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:33.863 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:33.863 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.863 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.863 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:33.863 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:33.863 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:33.863 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.863 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.863 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:33.863 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:33.863 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:33.864 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.864 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.864 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:33.864 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:33.864 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:33.864 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.864 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.864 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:33.864 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:33.864 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:33.864 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.864 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.864 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:33.865 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:33.865 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:33.865 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.865 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.865 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:33.865 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:33.865 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:33.865 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.865 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.865 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:33.865 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:33.865 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:33.865 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.865 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:33.866 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.866 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.866 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.866 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:33.866 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:33.866 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 67.799102708999996, 2024-04-26T10:43:33.866 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:33.866 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:33.866 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.866 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:33.866 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.866 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:33.866 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:33.867 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.867 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.867 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.867 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:33.867 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:33.867 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.867 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.867 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.867 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:33.867 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:33.867 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.867 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.867 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.868 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:33.868 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:33.868 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:33.868 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.868 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.868 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:33.869 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:33.869 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:33.869 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.869 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.869 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.869 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:33.869 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:33.869 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.869 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.869 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:33.869 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:33.869 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:33.869 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.869 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.870 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:33.870 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:33.870 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:33.870 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.870 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.870 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:33.870 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:33.870 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:33.870 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.870 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.870 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:33.870 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:33.870 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:33.870 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.871 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.871 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:33.871 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:33.871 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:33.871 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.871 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.871 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:33.871 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:33.871 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:33.871 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.871 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.871 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:33.871 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:33.871 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:33.872 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.872 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:33.872 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.872 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.872 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.872 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:33.872 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:33.872 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 67.799049337, 2024-04-26T10:43:33.872 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:33.872 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:33.872 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.872 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:33.872 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.872 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:33.873 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:33.873 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.873 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.873 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.873 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:33.873 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:33.873 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.873 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.873 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.873 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:33.873 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:33.873 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.873 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.873 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.874 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:33.874 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:33.874 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:33.874 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.874 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.874 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:33.874 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:33.874 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:33.874 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.874 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.874 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.874 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:33.874 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:33.874 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.875 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.875 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:33.875 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:33.875 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:33.875 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.875 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.875 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:33.875 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:33.875 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:33.875 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.875 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.875 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:33.875 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:33.875 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:33.875 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.876 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.876 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:33.876 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:33.876 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:33.876 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.876 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.876 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:33.876 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:33.876 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:33.876 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.876 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.876 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:33.876 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:33.876 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:33.876 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.877 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.877 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:33.877 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:33.877 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:33.877 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.877 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:33.877 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.877 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.877 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.877 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:33.877 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:33.877 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 67.799005010000002, 2024-04-26T10:43:33.877 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:33.877 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:33.878 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.878 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:33.878 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.878 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:33.878 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:33.878 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.878 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.878 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.878 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:33.878 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:33.878 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.878 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.878 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.878 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:33.879 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:33.879 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:33.879 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.879 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.879 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:33.879 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:33.879 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:33.879 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.879 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.879 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:33.879 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:33.879 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:33.879 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.879 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.880 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.880 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:33.880 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:33.880 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.880 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.880 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:33.880 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:33.880 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:33.880 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.880 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.880 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:33.880 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:33.880 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:33.880 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.880 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.881 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:33.881 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:33.881 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:33.881 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.881 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.881 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:33.881 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:33.881 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:33.881 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.881 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.881 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:33.881 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:33.881 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:33.881 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.882 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.882 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:33.882 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:33.882 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:33.882 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.882 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.882 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:33.882 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:33.882 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:33.882 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.882 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:33.882 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.882 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.882 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.883 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:33.883 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:33.883 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 67.798981296999997, 2024-04-26T10:43:33.883 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:33.883 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:33.883 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.883 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:33.883 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.883 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:33.883 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:33.883 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.883 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.883 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.883 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:33.883 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:33.884 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.884 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.884 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.884 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:33.884 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:33.884 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.884 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.884 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.884 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:33.884 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:33.884 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:33.884 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.884 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.884 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:33.885 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:33.885 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:33.885 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.885 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.885 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.885 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:33.885 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:33.885 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.885 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.885 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:33.885 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:33.885 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:33.885 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.885 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.885 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:33.886 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:33.886 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:33.886 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.886 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.886 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:33.886 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:33.886 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:33.886 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.886 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.886 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:33.886 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:33.886 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:33.886 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.886 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.887 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:33.887 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:33.887 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:33.887 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.887 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.887 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:33.887 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:33.887 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:33.887 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.887 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.887 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:33.887 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:33.887 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:33.888 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.888 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:33.888 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.888 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.888 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.888 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:33.888 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:33.888 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 67.798946991999998, 2024-04-26T10:43:33.888 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:33.888 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:33.888 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.888 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:33.888 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.889 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:33.889 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:33.889 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.889 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.889 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.889 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:33.889 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:33.889 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.889 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.889 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.889 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:33.889 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:33.889 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.889 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.890 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.890 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:33.890 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:33.890 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:33.890 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.890 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.890 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:33.890 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:33.890 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:33.890 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.890 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.890 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.890 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:33.890 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:33.891 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.891 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.891 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:33.891 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:33.891 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:33.891 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.891 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.891 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:33.891 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:33.891 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:33.891 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.891 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.891 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:33.891 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:33.892 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:33.892 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.892 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.892 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:33.892 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:33.892 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:33.892 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.892 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.892 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:33.892 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:33.892 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:33.892 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.892 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.892 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:33.892 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:33.893 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:33.893 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.893 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.893 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:33.893 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:33.893 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:33.893 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.893 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:33.893 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.893 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.893 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.893 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:33.893 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:33.893 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 67.798610396000001, 2024-04-26T10:43:33.893 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:33.894 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:33.894 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:33.894 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:33.894 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.894 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:33.894 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:33.894 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.894 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.894 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.894 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:33.894 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:33.894 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.894 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.894 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.895 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:33.895 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:33.895 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:33.895 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.895 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.895 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:33.895 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:33.895 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:33.895 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.895 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.895 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:33.895 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:33.895 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:33.895 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.895 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.896 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.896 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:33.896 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:33.896 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.896 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.896 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:33.896 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:33.896 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:33.896 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.896 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.896 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:33.896 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:33.896 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:33.896 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.897 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.897 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:33.897 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:33.897 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:33.897 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.897 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:33.897 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.897 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.897 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.897 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:33.897 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:33.897 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 67.798568368000005, 2024-04-26T10:43:33.897 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:33.897 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:33.897 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:33.898 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:33.898 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.898 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:33.898 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:33.898 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.898 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.898 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.898 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:33.898 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:33.898 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.898 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.898 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.898 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:33.899 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:33.899 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.899 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.899 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.899 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:33.899 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:33.899 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:33.899 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.899 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.899 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:33.899 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:33.899 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:33.899 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.900 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.900 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.900 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:33.900 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:33.900 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.900 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.900 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:33.900 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:33.900 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:33.901 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.901 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.901 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:33.901 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:33.901 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:33.901 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.901 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.901 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:33.901 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:33.901 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:33.901 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.901 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:33.901 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.902 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.902 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.902 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:33.902 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:33.902 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 67.798515195999997, 2024-04-26T10:43:33.902 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:33.902 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:33.902 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:33.902 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:33.902 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.902 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:33.902 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:33.902 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.902 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.903 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.903 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:33.903 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:33.903 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.903 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.903 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.903 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:33.903 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:33.903 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.903 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.903 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.903 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:33.903 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:33.903 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:33.904 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.904 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.904 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:33.904 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:33.904 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:33.904 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.904 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.904 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.904 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:33.904 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:33.904 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.904 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.904 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:33.904 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:33.904 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:33.905 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.905 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.905 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:33.905 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:33.905 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:33.905 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.905 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.905 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:33.905 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:33.905 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:33.905 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.905 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:33.905 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.905 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.906 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.906 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:33.906 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:33.906 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 67.795108786, 2024-04-26T10:43:33.906 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:33.906 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:33.906 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:33.906 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:33.906 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.906 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:33.906 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:33.906 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.906 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.906 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.907 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:33.907 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:33.907 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.907 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.907 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.907 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:33.907 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:33.907 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.907 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.907 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.907 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:33.907 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:33.907 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:33.907 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.908 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.908 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:33.908 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:33.908 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:33.908 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.908 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.908 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.908 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:33.908 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:33.908 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.908 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.908 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:33.908 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:33.908 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:33.909 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.909 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.909 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:33.909 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:33.909 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:33.909 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.909 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:33.909 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.909 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.909 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.909 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:33.909 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:33.909 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 67.792636833000003, 2024-04-26T10:43:33.909 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:33.910 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:33.910 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:33.910 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:33.910 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.910 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:33.910 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:33.910 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.910 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.910 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.910 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:33.910 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:33.910 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.910 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.910 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.911 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:33.911 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:33.911 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.911 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.911 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.911 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:33.911 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:33.911 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:33.911 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.911 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.911 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:33.911 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:33.911 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:33.911 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.911 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.912 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.912 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:33.912 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:33.912 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.912 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.912 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:33.912 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:33.912 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:33.912 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.912 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.912 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:33.912 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:33.912 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:33.912 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.913 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.913 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:33.913 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:33.913 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:33.913 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.913 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:33.913 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.913 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.913 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.913 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:33.913 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:33.913 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 67.791983275000007, 2024-04-26T10:43:33.913 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:33.913 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:33.914 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:33.914 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:33.914 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.914 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:33.914 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:33.914 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.914 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.914 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.914 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:33.914 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:33.914 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.914 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.914 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.914 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:33.915 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:33.915 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.915 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.915 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.915 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:33.915 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:33.915 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:33.915 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.915 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.915 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:33.915 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:33.915 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:33.915 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.915 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.916 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.916 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:33.916 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:33.916 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.916 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.916 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:33.916 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:33.916 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:33.916 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.916 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.916 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:33.916 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:33.916 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:33.916 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.917 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.917 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:33.917 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:33.917 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:33.917 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.917 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:33.917 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.917 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.917 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.917 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:33.917 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:33.917 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 67.79190749, 2024-04-26T10:43:33.917 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:33.917 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:33.917 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:33.918 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:33.918 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.918 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:33.918 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:33.918 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.918 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.918 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.918 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:33.918 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:33.918 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.918 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.918 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.918 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:33.918 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:33.918 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.919 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.919 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.919 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:33.919 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:33.919 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:33.919 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.919 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.919 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:33.919 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:33.919 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:33.919 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.919 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.919 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.919 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:33.920 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:33.920 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.920 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.920 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:33.920 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:33.920 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:33.920 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.920 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.920 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:33.920 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:33.920 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:33.920 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.920 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.920 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:33.921 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:33.921 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:33.921 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.921 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:33.921 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.921 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.921 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.921 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:33.921 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:33.921 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 67.791693796000004, 2024-04-26T10:43:33.921 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:33.921 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:33.921 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:33.921 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:33.921 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.922 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:33.922 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:33.922 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.922 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.922 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.922 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:33.922 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:33.922 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.922 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.922 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.922 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:33.922 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:33.922 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:33.923 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.923 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.923 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:33.923 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:33.923 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:33.923 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.923 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.923 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:33.923 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:33.923 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:33.923 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.923 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.923 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.923 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:33.924 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:33.924 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.924 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.924 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:33.924 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:33.924 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:33.924 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.924 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.924 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:33.924 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:33.924 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:33.924 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.924 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:33.924 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.924 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.925 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.925 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:33.925 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:33.925 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 67.789249983000005, 2024-04-26T10:43:33.925 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:33.925 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:33.925 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:33.925 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:33.925 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.925 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:33.925 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:33.925 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.925 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.925 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.926 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:33.926 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:33.926 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.926 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.926 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.926 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:33.926 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:33.926 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:33.926 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.926 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.926 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:33.926 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:33.926 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:33.926 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.927 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.927 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:33.927 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:33.927 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:33.927 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.927 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.927 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.927 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:33.927 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:33.927 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.927 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.927 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:33.927 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:33.927 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:33.927 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.928 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.928 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:33.928 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:33.928 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:33.928 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.928 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.928 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:33.928 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:33.928 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:33.928 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.928 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:33.928 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.928 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.928 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.928 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:33.929 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:33.929 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 62.339187539000001, 2024-04-26T10:43:33.929 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:33.929 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:33.929 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:33.929 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:33.929 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.929 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:33.929 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:33.929 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.929 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.929 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.929 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:33.929 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:33.930 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:33.930 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.930 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.930 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:33.930 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:33.930 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:33.930 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.930 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.930 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:33.930 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:33.930 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:33.930 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.930 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.930 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:33.931 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:33.931 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:33.931 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.931 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.931 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:33.931 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:33.931 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:33.931 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.931 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.931 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:33.931 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:33.931 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:33.931 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.931 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.932 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:33.932 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:33.932 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:33.932 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.932 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.932 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:33.932 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:33.932 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:33.932 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.932 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.932 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:33.932 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:33.932 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:33.932 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.932 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.933 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:33.933 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:33.933 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:33.933 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.933 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.933 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:33.933 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:33.933 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:33.933 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:33.933 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:33.933 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:33.933 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:33.933 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:33.933 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.933 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:33.934 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.934 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:33.934 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:33.934 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:33.934 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~18s 2024-04-26T10:43:33.935 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:33.934+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:33.936 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:34.031 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:43:34.035 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:34.035+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:34.052 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:34.052 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:34.052 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:34.052 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:34.061 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:34.137 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:34.135+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:34.170 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:34.171 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:34.171 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:43:34.183 INFO:teuthology.orchestra.run.smithi049.stderr:noscrub is set 2024-04-26T10:43:34.201 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:34.201 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:34.205 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:43:34.206 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:43:34.211 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:34.211 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:34.220 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:34.238 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:34.236+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:34.326 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:34.326 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:34.335 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:34.338 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:34.336+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:34.439 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:34.438+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:34.441 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:34.441 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:34.450 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:34.541 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:34.539+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:34.591 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:34.591 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:34.600 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:34.642 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:34.640+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:34.742 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:34.742 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:34.742 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:34.741+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:34.750 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:34.843 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:34.842+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:34.863 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:34.863 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:34.872 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:34.944 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:34.943+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:34.978 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:34.978 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:34.988 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:35.072 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:35.071+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:35.133 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:35.133 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:35.142 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:35.183 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:35.182+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:35.184 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [1] live_osds: [0, 2] 2024-04-26T10:43:35.184 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:43:35.185 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2024-04-26T10:43:35.185 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi087.front.sepia.ceph.com 2024-04-26T10:43:35.185 INFO:teuthology.orchestra.console.smithi087:Power on 2024-04-26T10:43:35.185 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-26T10:43:35.208 DEBUG:teuthology.orchestra.console.smithi087:power on output: Chassis Power Control: Up/On 2024-04-26T10:43:35.208 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T10:43:35.231 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2024-04-26T10:43:35.246 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:35.247 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:35.247 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:35.245+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:35.255 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:35.348 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:35.346+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:35.396 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:35.396 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:35.405 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:35.449 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:35.447+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:35.545 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:35.546 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:35.549 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:35.548+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:35.554 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:35.650 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:35.649+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:35.662 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:35.663 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:35.672 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:35.752 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:35.750+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:35.779 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:35.779 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:35.788 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:35.852 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:35.851+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:35.894 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:35.894 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:35.903 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:35.953 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:35.952+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:36.008 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:36.008 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:36.017 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:36.053 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:36.053+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:36.118 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:36.118 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:36.127 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:36.170 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:36.169+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:36.201 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:43:36.207 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:43:36.228 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:36.228 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:36.237 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:36.281 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:36.280+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:36.347 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:36.347 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:36.356 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:36.356 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:36.355+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:36.397 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:36.397 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:36.397 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:43:36.415 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:36.416 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:36.418 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:43:36.419 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:43:36.456 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:36.455+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:36.501 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:36.501 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:36.501 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:36.501 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:36.501 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:36.510 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:36.595 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:36.594+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:36.657 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:36.657 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:36.657 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:36.658 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:36.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.658 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:36.658 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:36.658 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 70.619461208000004, 2024-04-26T10:43:36.658 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:36.658 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:36.658 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:36.658 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:36.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.658 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:36.658 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:36.658 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.659 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:36.659 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:36.659 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.659 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:36.659 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:36.659 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:36.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.659 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:36.659 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:36.659 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:36.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.660 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:36.660 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:36.660 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:36.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.660 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:36.660 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:36.660 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:36.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.660 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:36.660 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:36.660 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:36.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.661 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:36.661 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:36.661 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:36.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.661 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:36.661 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:36.661 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:36.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.661 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:36.661 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:36.662 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:36.662 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.662 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:36.662 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.662 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.662 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:36.662 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:36.662 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 70.617711087000004, 2024-04-26T10:43:36.662 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:36.662 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:36.662 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:36.662 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:36.662 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.662 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:36.663 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:36.663 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.663 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:36.663 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:36.663 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.663 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:36.663 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:36.663 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:36.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.664 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:36.664 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:36.664 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:36.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.664 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:36.664 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:36.664 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:36.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.664 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:36.664 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:36.664 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:36.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.665 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:36.665 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:36.665 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:36.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.665 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:36.665 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:36.665 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:36.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.665 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:36.665 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:36.665 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:36.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.666 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:36.666 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:36.666 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:36.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.666 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:36.666 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:36.666 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:36.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.666 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:36.666 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:36.666 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:36.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.667 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:36.667 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:36.667 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:36.667 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.667 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:36.667 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.667 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:36.667 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:36.667 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 70.617658089000003, 2024-04-26T10:43:36.667 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:36.667 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:36.667 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:36.668 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:36.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.668 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:36.668 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:36.668 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.668 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:36.668 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:36.668 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.668 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:36.668 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:36.668 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:36.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.669 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:36.669 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:36.669 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:36.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.669 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:36.669 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:36.669 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:36.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.669 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:36.669 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:36.669 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:36.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.670 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:36.670 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:36.670 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:36.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.670 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:36.670 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:36.670 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:36.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.670 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:36.670 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:36.671 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:36.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.671 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:36.671 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:36.671 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:36.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.671 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:36.671 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:36.671 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:36.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.671 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:36.672 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:36.672 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:36.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.672 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:36.672 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:36.672 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:36.672 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.672 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:36.672 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.672 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:36.672 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:36.672 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 70.617580344999993, 2024-04-26T10:43:36.673 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:36.673 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:36.673 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:36.673 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:36.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.673 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:36.673 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:36.673 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.673 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:36.673 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:36.673 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.674 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:36.674 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:36.674 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:36.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.674 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:36.674 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:36.674 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:36.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.674 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:36.674 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:36.674 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:36.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.675 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:36.675 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:36.675 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:36.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.675 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:36.675 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:36.675 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:36.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.675 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:36.675 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:36.675 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:36.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.676 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:36.676 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:36.676 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:36.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.676 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:36.676 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:36.676 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:36.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.676 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:36.676 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:36.676 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:36.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.677 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:36.677 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:36.677 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:36.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.677 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:36.677 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:36.677 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:36.677 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.677 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:36.677 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.678 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:36.678 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:36.678 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 70.617541338999999, 2024-04-26T10:43:36.678 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:36.678 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:36.678 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:36.678 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:36.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.678 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:36.678 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:36.678 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.678 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:36.679 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:36.679 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.679 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:36.679 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:36.679 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:36.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.679 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:36.679 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:36.679 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:36.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.679 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:36.680 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:36.680 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:36.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.680 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:36.680 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:36.680 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:36.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.680 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:36.680 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:36.680 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:36.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.680 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:36.681 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:36.681 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:36.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.681 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:36.681 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:36.681 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:36.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.681 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:36.681 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:36.681 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:36.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.681 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:36.682 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:36.682 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:36.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.682 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:36.682 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:36.682 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:36.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.682 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:36.682 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:36.682 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:36.682 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.682 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:36.683 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.683 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:36.683 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:36.683 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 70.617522518000001, 2024-04-26T10:43:36.683 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:36.683 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:36.683 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:36.683 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:36.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.683 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:36.683 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:36.683 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.684 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:36.684 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:36.684 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.684 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:36.684 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:36.684 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:36.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.684 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:36.684 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:36.684 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:36.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.685 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:36.685 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:36.685 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:36.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.685 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:36.685 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:36.685 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:36.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.685 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:36.685 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:36.686 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:36.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.686 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:36.686 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:36.686 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:36.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.686 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:36.686 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:36.686 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:36.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.686 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:36.687 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:36.687 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:36.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.687 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:36.687 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:36.687 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:36.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.687 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:36.687 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:36.687 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:36.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.688 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:36.688 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:36.688 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:36.688 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.688 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:36.688 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.688 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:36.688 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:36.688 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 70.617490516000004, 2024-04-26T10:43:36.688 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:36.688 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:36.688 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:36.688 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:36.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.689 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:36.689 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:36.689 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.689 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:36.689 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:36.689 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.689 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:36.689 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:36.689 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:36.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.690 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:36.690 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:36.690 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:36.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.690 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:36.690 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:36.690 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:36.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.690 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:36.690 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:36.690 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:36.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.691 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:36.691 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:36.691 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:36.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.691 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:36.691 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:36.691 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:36.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.691 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:36.691 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:36.692 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:36.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.692 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:36.692 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:36.692 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:36.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.692 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:36.692 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:36.692 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:36.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.692 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:36.692 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:36.693 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:36.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.693 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:36.693 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:36.693 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:36.693 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.693 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:36.693 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.693 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:36.693 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:36.693 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 70.617281707999993, 2024-04-26T10:43:36.694 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:36.694 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:36.694 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:36.694 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:36.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.694 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:36.694 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:36.694 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.694 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:36.694 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:36.694 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.695 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:36.695 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:36.695 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:36.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.695 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:36.695 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:36.695 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:36.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.695 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:36.695 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:36.695 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:36.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:36.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:36.697 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:36.698 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 70.617250416999994, 2024-04-26T10:43:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:36.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:36.701 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 70.617223167000006, 2024-04-26T10:43:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.703 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:36.706 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:36.707 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 70.614446416000007, 2024-04-26T10:43:36.707 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:36.707 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:36.707 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:36.707 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:36.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.707 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:36.707 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:36.707 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.707 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:36.707 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:36.707 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.708 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:36.708 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:36.708 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:36.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.708 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:36.708 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:36.708 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:36.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.708 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:36.708 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:36.708 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:36.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:36.709 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.710 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:36.710 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.710 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:36.710 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:36.710 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 70.614396326999994, 2024-04-26T10:43:36.710 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:36.710 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:36.710 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:36.710 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:36.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.710 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:36.710 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:36.711 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.711 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:36.711 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:36.711 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.711 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:36.711 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:36.711 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:36.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.711 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:36.711 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:36.712 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:36.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.712 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:36.712 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:36.712 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:36.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.712 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:36.712 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:36.712 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:36.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.712 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:36.712 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:36.713 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:36.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.713 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:36.713 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:36.713 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:36.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.713 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:36.713 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:36.713 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:36.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.713 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:36.714 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:36.714 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:36.714 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.714 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:36.714 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.714 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:36.714 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:36.714 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 70.613504258000006, 2024-04-26T10:43:36.714 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:36.714 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:36.714 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:36.714 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:36.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.715 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:36.715 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:36.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.715 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:36.715 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:36.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.715 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:36.715 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:36.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:36.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:36.716 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:36.716 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:36.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:36.716 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:36.716 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:36.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:36.716 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:36.716 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:36.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.717 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:36.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:36.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:36.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.717 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:36.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:36.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:36.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.717 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:36.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:36.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:36.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.718 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:36.718 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:36.718 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:36.718 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.718 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:36.718 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.718 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:36.718 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:36.718 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 70.611315929, 2024-04-26T10:43:36.718 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:36.719 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:36.719 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:36.719 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:36.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.719 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:36.719 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:36.719 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.719 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:36.719 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:36.719 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.719 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:36.720 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:36.720 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:36.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.720 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:36.720 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:36.720 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:36.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.720 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:36.720 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:36.720 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:36.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.720 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:36.721 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:36.721 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:36.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.721 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:36.721 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:36.721 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:36.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.721 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:36.721 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:36.721 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:36.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.721 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:36.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:36.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:36.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:36.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:36.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:36.722 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.722 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:36.722 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.722 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:36.722 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:36.723 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 70.611180559000005, 2024-04-26T10:43:36.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:36.723 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:36.723 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:36.723 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:36.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.723 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:36.723 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:36.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.723 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:36.723 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:36.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.724 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:36.724 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:36.724 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:36.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.724 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.724 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:36.724 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:36.724 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:36.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.724 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.724 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:36.724 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:36.724 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:36.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.725 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:36.725 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:36.725 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:36.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.725 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:36.725 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:36.725 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:36.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.725 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:36.725 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:36.725 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:36.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.726 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:36.726 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:36.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:36.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.726 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:36.726 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:36.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:36.726 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.726 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:36.726 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.727 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:36.727 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:36.727 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 70.610965985000007, 2024-04-26T10:43:36.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:36.727 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:36.727 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:36.727 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:36.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:36.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:36.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:36.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:36.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:36.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:36.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:36.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:36.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:36.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:36.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:36.729 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:36.729 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:36.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.729 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:36.729 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:36.729 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:36.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.729 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:36.729 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:36.729 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:36.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.729 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:36.730 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:36.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:36.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.730 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:36.730 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:36.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:36.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.730 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:36.730 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:36.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:36.730 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.730 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:36.731 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.731 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:36.731 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:36.731 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 70.610627043999997, 2024-04-26T10:43:36.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:36.731 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:36.731 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:36.731 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:36.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:36.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:36.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.732 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:36.732 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:36.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.732 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:36.732 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:36.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:36.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.732 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:36.732 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:36.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:36.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.733 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:36.733 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:36.733 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:36.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.733 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:36.733 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:36.733 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:36.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.733 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:36.733 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:36.733 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:36.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.734 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:36.734 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:36.734 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:36.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.734 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:36.734 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:36.734 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:36.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.734 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:36.734 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:36.734 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:36.734 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.735 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:36.735 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.735 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:36.735 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:36.735 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 70.610517666999996, 2024-04-26T10:43:36.735 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:36.735 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:36.735 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:36.735 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:36.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.735 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:36.735 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:36.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.736 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:36.736 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:36.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.736 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:36.736 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:36.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:36.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.736 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:36.736 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:36.737 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:36.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.737 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:36.737 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:36.737 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:36.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.737 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:36.737 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:36.737 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:36.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.737 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:36.738 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:36.738 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:36.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.738 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:36.738 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:36.738 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:36.738 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.738 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:36.738 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.738 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:36.738 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:36.739 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 70.610477947999996, 2024-04-26T10:43:36.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:36.739 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:36.739 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:36.739 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:36.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.739 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:36.739 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:36.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.739 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:36.739 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:36.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.740 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:36.740 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:36.740 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:36.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.740 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:36.740 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:36.740 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:36.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.740 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:36.740 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:36.740 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:36.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.741 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:36.741 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:36.741 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:36.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.741 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:36.741 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:36.741 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:36.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.741 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:36.741 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:36.742 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:36.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.742 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:36.742 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:36.742 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:36.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.742 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:36.742 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:36.742 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:36.742 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.742 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:36.742 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.743 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:36.743 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:36.743 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 70.610140415000004, 2024-04-26T10:43:36.743 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:36.743 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:36.743 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:36.743 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:36.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.743 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:36.743 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:36.743 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.744 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:36.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:36.744 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:36.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.744 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:36.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:36.744 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:36.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.744 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:36.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:36.744 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:36.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.745 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:36.745 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:36.745 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:36.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.745 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:36.745 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:36.745 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:36.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.745 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:36.745 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:36.745 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:36.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.746 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:36.746 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:36.746 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:36.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.746 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:36.746 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:36.746 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:36.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:36.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:36.746 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:36.746 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:36.746 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:36.746 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.747 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:36.747 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.747 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:36.747 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:36.747 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:36.748 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:36.749 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:36.747+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:36.849 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:36.849+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:36.854 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:36.854 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:36.854 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:36.854 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:36.863 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:36.950 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:36.949+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:36.965 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:36.965 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:36.965 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:36.965 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:36.965 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:36.973 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:37.050 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:37.049+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:37.077 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:37.077 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:37.077 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:37.077 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:37.078 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.078 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:37.078 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:37.078 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 71.038723150999999, 2024-04-26T10:43:37.078 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:37.078 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:37.078 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.078 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:37.078 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.078 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:37.078 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:37.078 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.078 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.078 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.079 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:37.079 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:37.079 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.079 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.079 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.079 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:37.079 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:37.079 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.079 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.079 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.079 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:37.079 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:37.079 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:37.079 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.079 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.080 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:37.080 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:37.080 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:37.080 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.080 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.080 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.080 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:37.080 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:37.080 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.080 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.080 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:37.080 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:37.080 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:37.080 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.081 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.081 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:37.081 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:37.081 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:37.081 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.081 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.081 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:37.081 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:37.081 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:37.081 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.081 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.081 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:37.081 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:37.081 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:37.081 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.082 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:37.082 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.082 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.082 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.082 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:37.082 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:37.082 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 71.037852371, 2024-04-26T10:43:37.082 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:37.082 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:37.082 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.082 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:37.083 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.083 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:37.083 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:37.083 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.083 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.083 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.083 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:37.083 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:37.083 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.083 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.083 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.083 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:37.083 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:37.083 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.083 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.084 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.084 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:37.084 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:37.084 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:37.084 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.084 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.084 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:37.084 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:37.084 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:37.084 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.084 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.084 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.084 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:37.084 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:37.084 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.085 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.085 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:37.085 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:37.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:37.085 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.085 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.085 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:37.085 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:37.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:37.085 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.085 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.085 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:37.085 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:37.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:37.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.086 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.086 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:37.086 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:37.086 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:37.086 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.086 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:37.086 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.086 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.086 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:37.086 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:37.086 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 71.036865027999994, 2024-04-26T10:43:37.086 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:37.087 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:37.087 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.087 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:37.087 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.087 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:37.087 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:37.087 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.087 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.087 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.087 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:37.087 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:37.087 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.087 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.087 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.088 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:37.088 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:37.088 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:37.088 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.088 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.088 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:37.088 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:37.088 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:37.088 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.088 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.088 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:37.088 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:37.088 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:37.088 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.089 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.089 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.089 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:37.089 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:37.089 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.089 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.089 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:37.089 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:37.089 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:37.089 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.089 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.089 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:37.089 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:37.089 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:37.090 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.090 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.090 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:37.090 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:37.090 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:37.090 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.090 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.090 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:37.090 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:37.090 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:37.090 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.090 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:37.090 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.090 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.090 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.091 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:37.091 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:37.091 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 71.036659763000003, 2024-04-26T10:43:37.091 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:37.091 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:37.091 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.091 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:37.091 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.091 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:37.091 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:37.091 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.091 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.091 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.092 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:37.092 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:37.092 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.092 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.092 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.092 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:37.092 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:37.092 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.092 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.092 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.092 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:37.092 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:37.092 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:37.092 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.093 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.093 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:37.093 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:37.093 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:37.093 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.093 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.093 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.093 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:37.093 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:37.093 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.093 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.093 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:37.093 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:37.093 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:37.093 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.094 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.094 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:37.094 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:37.094 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:37.094 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.094 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.094 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:37.094 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:37.094 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:37.094 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.094 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.094 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:37.094 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:37.095 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:37.095 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.095 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:37.095 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.095 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.095 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.095 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:37.095 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:37.095 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 71.036338884000003, 2024-04-26T10:43:37.095 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:37.095 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:37.095 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.095 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:37.095 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.095 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:37.096 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:37.096 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.096 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.096 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.096 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:37.096 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:37.096 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.096 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.096 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.096 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:37.096 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:37.096 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:37.096 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.096 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.097 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:37.097 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:37.097 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:37.097 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.097 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.097 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:37.097 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:37.097 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:37.097 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.097 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.097 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.097 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:37.097 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:37.097 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.097 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.098 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:37.098 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:37.098 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:37.098 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.098 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.098 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:37.098 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:37.098 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:37.098 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.098 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.098 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:37.098 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:37.098 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:37.099 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.099 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.099 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:37.099 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:37.099 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:37.099 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.099 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.099 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:37.099 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:37.099 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:37.099 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.099 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.099 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:37.099 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:37.100 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:37.100 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.100 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.100 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:37.100 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:37.100 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:37.100 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.100 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:37.100 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.100 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.100 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.100 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:37.100 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:37.100 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 71.036287060000006, 2024-04-26T10:43:37.100 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:37.100 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:37.101 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.101 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:37.101 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.101 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:37.101 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:37.101 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.101 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.101 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.101 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:37.101 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:37.101 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.101 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.101 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.101 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:37.102 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:37.102 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.102 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.102 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.102 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:37.102 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:37.102 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:37.102 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.102 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.102 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:37.102 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:37.102 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:37.102 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.102 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.102 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.103 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:37.103 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:37.103 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.103 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.103 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:37.103 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:37.103 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:37.103 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.103 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.103 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:37.103 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:37.103 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:37.103 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.103 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.103 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:37.104 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:37.104 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:37.104 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.104 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.104 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:37.104 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:37.104 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:37.104 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.104 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.104 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:37.104 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:37.104 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:37.104 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.104 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.104 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:37.105 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:37.105 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:37.105 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.105 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.105 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:37.105 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:37.105 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:37.105 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.105 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:37.105 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.105 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.105 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.105 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:37.105 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:37.106 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 71.036233687999996, 2024-04-26T10:43:37.106 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:37.106 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:37.106 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.106 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:37.106 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.106 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:37.106 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:37.106 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.106 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.106 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.106 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:37.106 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:37.106 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.106 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.107 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.107 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:37.107 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:37.107 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.107 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.107 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.107 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:37.107 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:37.107 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:37.107 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.107 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.107 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:37.107 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:37.107 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:37.108 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.108 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.108 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.108 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:37.108 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:37.108 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.108 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.108 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:37.108 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:37.108 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:37.108 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.108 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.108 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:37.108 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:37.108 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:37.109 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.109 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.109 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:37.109 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:37.109 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:37.109 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.109 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.109 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:37.109 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:37.109 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:37.109 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.109 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.109 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:37.110 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:37.110 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:37.110 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.110 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.110 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:37.110 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:37.110 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:37.110 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.110 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.110 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:37.110 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:37.110 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:37.110 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.110 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:37.111 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.111 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.111 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.111 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:37.111 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:37.111 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 71.036189360999998, 2024-04-26T10:43:37.111 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:37.111 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:37.111 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.111 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:37.111 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.111 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:37.111 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:37.111 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.111 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.112 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.112 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:37.112 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:37.112 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.112 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.112 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:37.112 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:37.112 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:37.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.112 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.112 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:37.112 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:37.112 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:37.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.113 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.113 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:37.113 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:37.113 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:37.113 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.113 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.113 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.113 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:37.113 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:37.113 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.113 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.113 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:37.113 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:37.113 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:37.114 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.114 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.114 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:37.114 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:37.114 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:37.114 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.114 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.114 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:37.114 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:37.114 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:37.114 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.114 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.114 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:37.114 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:37.114 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:37.115 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.115 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.115 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:37.115 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:37.115 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:37.115 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.115 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.115 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:37.115 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:37.115 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:37.115 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.115 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.115 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:37.115 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:37.115 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:37.116 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.116 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:37.116 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.116 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.116 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.116 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:37.116 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:37.116 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 71.036165647999994, 2024-04-26T10:43:37.116 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:37.116 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:37.116 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.116 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:37.116 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.116 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:37.116 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:37.117 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.117 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.117 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.117 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:37.117 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:37.117 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.117 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.117 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.117 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:37.117 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:37.117 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.117 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.117 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.117 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:37.117 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:37.118 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:37.118 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.118 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.118 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:37.118 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:37.118 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:37.118 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.118 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.118 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.118 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:37.118 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:37.118 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.118 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.119 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:37.119 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:37.119 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:37.119 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.119 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.119 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:37.119 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:37.119 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:37.119 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.119 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.119 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:37.119 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:37.119 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:37.119 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.119 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.120 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:37.120 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:37.120 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:37.120 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.120 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.120 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:37.120 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:37.120 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:37.120 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.120 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.120 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:37.120 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:37.120 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:37.120 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.120 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.121 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:37.121 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:37.121 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:37.121 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.121 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:37.121 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.121 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.121 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.121 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:37.121 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:37.121 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 71.036131342999994, 2024-04-26T10:43:37.121 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:37.121 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:37.121 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.122 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:37.122 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.122 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:37.122 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:37.122 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.122 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.122 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.122 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:37.122 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:37.122 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.122 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.122 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.122 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:37.122 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:37.123 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.123 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.123 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.123 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:37.123 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:37.123 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:37.123 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.123 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.123 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:37.123 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:37.123 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:37.123 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.123 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.123 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.123 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:37.124 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:37.124 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.124 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.124 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:37.124 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:37.124 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:37.124 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.124 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.124 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:37.124 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:37.124 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:37.124 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.124 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.124 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:37.125 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:37.125 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:37.125 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.125 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.125 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:37.125 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:37.125 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:37.125 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.125 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.125 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:37.125 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:37.125 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:37.125 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.125 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.125 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:37.126 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:37.126 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:37.126 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.126 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.126 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:37.126 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:37.126 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:37.126 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.126 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:37.126 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.126 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.126 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.126 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:37.126 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:37.126 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 71.035794746999997, 2024-04-26T10:43:37.127 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:37.127 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:37.127 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:37.127 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:37.127 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.127 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:37.127 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:37.127 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.127 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.127 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.127 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:37.127 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:37.127 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.127 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.128 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.128 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:37.128 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:37.128 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:37.128 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.128 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.128 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:37.128 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:37.128 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:37.128 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.128 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.128 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:37.128 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:37.128 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:37.128 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.129 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.129 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.129 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:37.129 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:37.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.129 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.129 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:37.129 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:37.129 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:37.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.129 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.129 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:37.129 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:37.129 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:37.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.130 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.130 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:37.130 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:37.130 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:37.130 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.130 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:37.130 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.130 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.130 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.130 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:37.130 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:37.130 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 71.035752719000001, 2024-04-26T10:43:37.130 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:37.130 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:37.130 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:37.130 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:37.131 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.131 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:37.131 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:37.131 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.131 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.131 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.131 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:37.131 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:37.131 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.131 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.131 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.131 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:37.131 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:37.132 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.132 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.132 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:37.132 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:37.132 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:37.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.132 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.132 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:37.132 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:37.132 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:37.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.132 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.132 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.133 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:37.133 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:37.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.133 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:37.133 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:37.133 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:37.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.133 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:37.133 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:37.133 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:37.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.133 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:37.134 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:37.134 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:37.134 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.134 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:37.134 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.134 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.134 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.134 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:37.134 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:37.134 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 71.035699546999993, 2024-04-26T10:43:37.134 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:37.134 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:37.134 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:37.134 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:37.135 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.135 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:37.135 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:37.135 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.135 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.135 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:37.135 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:37.135 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.135 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.135 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:37.135 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:37.135 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.136 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.136 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:37.136 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:37.136 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:37.136 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.136 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.136 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:37.136 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:37.136 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:37.136 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.136 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.136 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.136 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:37.136 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:37.136 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.137 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.137 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:37.137 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:37.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:37.137 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.137 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.137 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:37.137 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:37.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:37.137 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.137 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.137 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:37.137 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:37.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:37.137 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.138 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:37.138 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.138 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.138 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.138 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:37.138 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:37.138 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 71.032293136999996, 2024-04-26T10:43:37.138 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:37.138 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:37.138 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:37.138 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:37.138 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.138 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:37.138 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:37.139 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.139 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.139 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.139 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:37.139 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:37.139 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.139 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.139 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.139 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:37.139 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:37.139 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.139 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.139 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.139 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:37.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:37.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:37.140 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.140 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.140 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:37.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:37.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:37.140 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.140 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.140 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:37.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:37.140 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.140 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.140 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:37.141 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:37.141 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:37.141 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.141 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.141 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:37.141 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:37.141 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:37.141 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.141 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:37.141 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.141 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.141 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.141 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:37.141 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:37.142 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 71.029821183999999, 2024-04-26T10:43:37.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:37.142 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:37.142 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:37.142 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:37.142 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.142 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:37.142 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:37.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.142 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.142 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.142 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:37.142 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:37.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:37.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:37.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:37.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:37.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:37.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:37.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:37.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:37.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.144 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.144 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:37.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:37.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.144 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:37.144 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:37.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:37.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.145 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:37.145 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:37.145 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:37.145 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.145 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.145 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:37.145 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:37.145 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:37.145 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.145 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:37.145 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.145 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.145 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.146 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:37.146 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:37.146 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 71.029167626000003, 2024-04-26T10:43:37.146 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:37.146 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:37.146 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:37.146 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:37.146 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.146 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:37.146 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:37.146 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.146 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.146 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.147 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:37.147 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:37.147 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.147 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.147 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.147 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:37.147 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:37.147 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.147 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.147 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.147 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:37.147 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:37.147 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:37.147 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:37.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:37.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:37.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:37.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:37.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:37.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:37.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:37.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.149 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:37.149 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:37.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:37.149 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.149 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:37.149 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:37.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:37.149 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.149 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:37.149 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.149 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.150 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:37.150 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:37.150 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 71.029091840999996, 2024-04-26T10:43:37.150 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:37.150 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:37.150 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:37.150 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:37.150 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.150 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:37.150 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:37.150 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.150 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.150 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.151 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:37.151 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:37.151 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.151 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.151 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.151 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:37.151 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:37.151 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.151 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.151 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.151 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:37.151 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:37.151 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:37.151 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:37.153 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:37.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:37.153 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.153 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:37.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:37.153 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.154 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:37.154 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:37.154 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:37.154 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.154 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.154 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:37.154 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:37.154 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:37.154 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.154 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.154 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:37.154 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:37.154 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:37.154 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.154 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:37.155 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.155 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.155 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.155 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:37.155 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:37.155 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 71.028878147, 2024-04-26T10:43:37.155 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:37.155 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:37.155 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:37.155 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:37.155 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.155 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:37.155 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:37.155 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.155 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.156 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.156 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:37.156 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:37.156 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.156 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.156 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.156 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:37.156 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:37.156 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.156 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.156 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.156 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:37.156 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:37.156 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:37.157 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.157 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.157 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:37.157 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:37.157 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:37.157 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.157 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.157 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.157 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:37.157 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:37.157 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.157 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.157 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:37.157 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:37.157 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:37.158 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.158 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.158 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:37.158 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:37.158 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:37.158 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.158 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:37.158 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.158 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.158 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.158 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:37.158 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:37.158 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 71.026434334000001, 2024-04-26T10:43:37.158 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:37.158 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:37.159 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:37.159 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:37.159 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.159 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:37.159 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:37.159 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.159 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.159 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.159 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:37.159 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:37.159 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.159 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.159 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.159 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:37.159 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:37.160 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:37.160 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.160 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.160 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:37.160 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:37.160 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:37.160 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.160 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.160 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:37.160 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:37.160 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:37.160 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.160 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.161 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.161 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:37.161 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:37.161 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.161 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.161 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:37.161 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:37.161 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:37.161 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.161 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.161 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:37.161 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:37.161 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:37.161 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.161 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.162 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:37.162 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:37.162 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:37.162 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.162 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:37.162 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.162 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.162 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.162 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:37.162 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:37.162 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 65.576371890000004, 2024-04-26T10:43:37.162 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:37.162 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:37.163 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.163 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:37.163 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.163 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:37.163 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:37.163 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.163 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.163 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.163 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:37.163 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:37.163 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:37.163 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.163 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.163 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:37.163 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:37.164 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:37.164 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.164 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.164 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:37.164 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:37.164 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:37.164 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.164 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.164 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:37.164 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:37.164 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:37.164 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.164 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.164 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.165 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:37.165 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:37.165 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.165 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.165 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:37.165 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:37.165 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:37.165 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.165 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.165 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:37.165 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:37.165 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:37.165 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.165 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.165 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:37.165 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:37.166 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:37.166 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.166 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.166 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:37.166 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:37.166 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:37.166 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.166 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.166 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:37.166 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:37.166 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:37.166 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.166 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.166 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:37.167 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:37.167 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:37.167 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:37.167 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:37.167 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:37.167 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:37.167 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:37.167 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.167 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:37.167 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.167 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:37.167 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:37.167 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:37.169 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:37.167+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:37.169 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:37.237 INFO:teuthology.orchestra.run.smithi049.stderr:nodeep-scrub is set 2024-04-26T10:43:37.269 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:37.268+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:37.287 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:37.287 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:37.287 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:37.287 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:37.296 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:37.369 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:37.368+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:37.444 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:37.444 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:37.444 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:37.444 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:37.444 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:37.453 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:37.471 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:37.470+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:37.560 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:37.560 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:37.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:37.560 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:37.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.560 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:37.560 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:37.560 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 71.522065170000005, 2024-04-26T10:43:37.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:37.560 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:37.560 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.560 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:37.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.561 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:37.561 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:37.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.561 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:37.561 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:37.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.561 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:37.561 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:37.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.562 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:37.562 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:37.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:37.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.562 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:37.562 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:37.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:37.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.562 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.562 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:37.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:37.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.563 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:37.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:37.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:37.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.563 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:37.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:37.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:37.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:37.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:37.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:37.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:37.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:37.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:37.566 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.566 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:37.566 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.566 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:37.566 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:37.566 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 71.520315049000004, 2024-04-26T10:43:37.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:37.567 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:37.567 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.567 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:37.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:37.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:37.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:37.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:37.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:37.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:37.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:37.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:37.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:37.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:37.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:37.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:37.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:37.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.569 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:37.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:37.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.569 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:37.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:37.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:37.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.569 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:37.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:37.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:37.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:37.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:37.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:37.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:37.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:37.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:37.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:37.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:37.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:37.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:37.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:37.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:37.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:37.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:37.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:37.571 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.571 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:37.571 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.572 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:37.572 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:37.572 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 71.520262051000003, 2024-04-26T10:43:37.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:37.572 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:37.572 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.572 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:37.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:37.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:37.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:37.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:37.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:37.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:37.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:37.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:37.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:37.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.574 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:37.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:37.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:37.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.574 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:37.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:37.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.574 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:37.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:37.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:37.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:37.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:37.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:37.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:37.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:37.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:37.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:37.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:37.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:37.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:37.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:37.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:37.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:37.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:37.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:37.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:37.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:37.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:37.577 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.577 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:37.577 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.577 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:37.577 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:37.577 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 71.520184306999994, 2024-04-26T10:43:37.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:37.577 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:37.577 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.577 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:37.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:37.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:37.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:37.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:37.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:37.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:37.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:37.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:37.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:37.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:37.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:37.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:37.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:37.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:37.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:37.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.580 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:37.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:37.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:37.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.580 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:37.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:37.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:37.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.580 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:37.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:37.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:37.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:37.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:37.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:37.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:37.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:37.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:37.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:37.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:37.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:37.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:37.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:37.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:37.582 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.582 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:37.582 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.582 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:37.582 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:37.582 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 71.520145300999999, 2024-04-26T10:43:37.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:37.583 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:37.583 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.583 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:37.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:37.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:37.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:37.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:37.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:37.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:37.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:37.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:37.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:37.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:37.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:37.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:37.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:37.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:37.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:37.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:37.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:37.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:37.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:37.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:37.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:37.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:37.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:37.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:37.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:37.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:37.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:37.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:37.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:37.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:37.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:37.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:37.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:37.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:37.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:37.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:37.587 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.587 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:37.587 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.588 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:37.588 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:37.588 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 71.520126480000002, 2024-04-26T10:43:37.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:37.588 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:37.588 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.588 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:37.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.588 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:37.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:37.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.588 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:37.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:37.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:37.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:37.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:37.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:37.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:37.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:37.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:37.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:37.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:37.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:37.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:37.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:37.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:37.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:37.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:37.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:37.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:37.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:37.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:37.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:37.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:37.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:37.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:37.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:37.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:37.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:37.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:37.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:37.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:37.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:37.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:37.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:37.593 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.593 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:37.593 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.593 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:37.593 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:37.593 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 71.520094478000004, 2024-04-26T10:43:37.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:37.593 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:37.593 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.593 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:37.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:37.594 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:37.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:37.594 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:37.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:37.594 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:37.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.595 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:37.595 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:37.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:37.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.595 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:37.595 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:37.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:37.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.595 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.595 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:37.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:37.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.596 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:37.596 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:37.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:37.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.596 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:37.596 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:37.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:37.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.596 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:37.596 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:37.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:37.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:37.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:37.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:37.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:37.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:37.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:37.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:37.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:37.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:37.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:37.598 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:37.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:37.598 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.598 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:37.598 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.598 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:37.598 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:37.598 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 71.519885669999994, 2024-04-26T10:43:37.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:37.599 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:37.599 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.599 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:37.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.599 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:37.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:37.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.599 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:37.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:37.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.600 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:37.600 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:37.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:37.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.600 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:37.600 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:37.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:37.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.600 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:37.600 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:37.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:37.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.601 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.601 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:37.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:37.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.601 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:37.601 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:37.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:37.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.601 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:37.601 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:37.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:37.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:37.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:37.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:37.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:37.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:37.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:37.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:37.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:37.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:37.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:37.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:37.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:37.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:37.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:37.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:37.603 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.603 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:37.603 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.604 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:37.604 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:37.604 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 71.519854378999995, 2024-04-26T10:43:37.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:37.604 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:37.604 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:37.604 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:37.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:37.604 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:37.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.605 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:37.605 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:37.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.605 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:37.605 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:37.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.605 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:37.605 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:37.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:37.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.606 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:37.606 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:37.606 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:37.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.606 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.606 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:37.606 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:37.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.606 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:37.606 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:37.607 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:37.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:37.607 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:37.607 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:37.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:37.607 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:37.607 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:37.607 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.607 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:37.607 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.608 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:37.608 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:37.608 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 71.519827129000006, 2024-04-26T10:43:37.608 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:37.608 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:37.608 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:37.608 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:37.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.608 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:37.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:37.608 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.609 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:37.609 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:37.609 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.609 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:37.609 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:37.609 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.609 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:37.609 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:37.609 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:37.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.610 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:37.610 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:37.610 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:37.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.610 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.610 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:37.610 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:37.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.610 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:37.611 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:37.611 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:37.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.611 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:37.611 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:37.611 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:37.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.611 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:37.611 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:37.611 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:37.611 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.611 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:37.612 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.612 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:37.612 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:37.612 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 71.517050377999993, 2024-04-26T10:43:37.612 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:37.612 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:37.612 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:37.612 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:37.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.612 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:37.612 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:37.612 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.613 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:37.613 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:37.613 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.613 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:37.613 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:37.613 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.613 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:37.613 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:37.613 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:37.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.614 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:37.614 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:37.614 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:37.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.614 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.614 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:37.614 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:37.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.614 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:37.614 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:37.615 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:37.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.615 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:37.615 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:37.615 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:37.615 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.615 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:37.615 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.615 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:37.615 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:37.615 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 71.517000288999995, 2024-04-26T10:43:37.616 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:37.616 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:37.616 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.616 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:37.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.616 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:37.616 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:37.616 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.616 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:37.616 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:37.616 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.617 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:37.617 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:37.617 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.617 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:37.617 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:37.617 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:37.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.617 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:37.617 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:37.617 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:37.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.618 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.618 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:37.618 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:37.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.618 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:37.618 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:37.618 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:37.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.618 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:37.618 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:37.618 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:37.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.619 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:37.619 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:37.619 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:37.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.619 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:37.619 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:37.619 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:37.619 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.619 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:37.619 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.620 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:37.620 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:37.620 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 71.516108220000007, 2024-04-26T10:43:37.620 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:37.620 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:37.620 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.620 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:37.620 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.620 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:37.620 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:37.620 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.620 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.620 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:37.620 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:37.621 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.621 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.621 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:37.621 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:37.621 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.621 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.621 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:37.621 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:37.621 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:37.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.621 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.621 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:37.622 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:37.622 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:37.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.622 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.622 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:37.622 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:37.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.622 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:37.622 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:37.622 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:37.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.623 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:37.623 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:37.623 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:37.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.623 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:37.623 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:37.623 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:37.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.623 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:37.623 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:37.623 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:37.623 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.623 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:37.624 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.624 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:37.624 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:37.624 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 71.513919891, 2024-04-26T10:43:37.624 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:37.624 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:37.624 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.624 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:37.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.624 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:37.624 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:37.624 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.625 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:37.625 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:37.625 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.625 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:37.625 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:37.625 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.625 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:37.625 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:37.625 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:37.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.626 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.626 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:37.626 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:37.626 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:37.626 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.626 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.626 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.626 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:37.626 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:37.626 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.626 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.626 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:37.626 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:37.626 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:37.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.627 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:37.627 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:37.627 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:37.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.627 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:37.627 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:37.627 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:37.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.627 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:37.627 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:37.627 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:37.627 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.628 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:37.628 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.628 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:37.628 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:37.628 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 71.513784521000005, 2024-04-26T10:43:37.628 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:37.628 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:37.628 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.628 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:37.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.628 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:37.628 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:37.628 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.629 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:37.629 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:37.629 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.629 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:37.629 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:37.629 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.629 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:37.629 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:37.630 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:37.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.630 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:37.630 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:37.630 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:37.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.630 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.630 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:37.630 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:37.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.630 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:37.630 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:37.631 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:37.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.631 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:37.631 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:37.631 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:37.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.631 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:37.631 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:37.631 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:37.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.631 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:37.632 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:37.632 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:37.632 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.632 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:37.632 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.632 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.632 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:37.632 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:37.632 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 71.513569946999993, 2024-04-26T10:43:37.632 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:37.632 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:37.632 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.632 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:37.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.633 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:37.633 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:37.633 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.633 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:37.633 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:37.633 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.633 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:37.633 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:37.633 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.634 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:37.634 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:37.634 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:37.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.634 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:37.634 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:37.634 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:37.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.634 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.634 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:37.634 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:37.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.635 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:37.635 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:37.635 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:37.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.635 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:37.635 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:37.635 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:37.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.635 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:37.635 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:37.635 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:37.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.636 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:37.636 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:37.636 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:37.636 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.636 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:37.636 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.636 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:37.636 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:37.636 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 71.513231005999998, 2024-04-26T10:43:37.636 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:37.636 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:37.636 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.636 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:37.637 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.637 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:37.637 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:37.637 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.637 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.637 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:37.637 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:37.637 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.637 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.637 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:37.637 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:37.637 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.638 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.638 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:37.638 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:37.638 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:37.638 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.638 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.638 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:37.638 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:37.638 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:37.638 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.638 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.638 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.638 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:37.638 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:37.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.639 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:37.639 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:37.639 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:37.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.639 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:37.639 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:37.639 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:37.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.639 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:37.639 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:37.639 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:37.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.640 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.640 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:37.640 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:37.640 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:37.640 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.640 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:37.640 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.640 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.640 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.640 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:37.640 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:37.640 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 71.513121628999997, 2024-04-26T10:43:37.640 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:37.640 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:37.640 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:37.641 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:37.641 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.641 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:37.641 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:37.641 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.641 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.641 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:37.641 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:37.641 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.641 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.641 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:37.641 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:37.641 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:37.642 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.642 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.642 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:37.642 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:37.642 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:37.642 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.642 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.642 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:37.642 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:37.642 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:37.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.643 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.643 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:37.643 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:37.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.643 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:37.643 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:37.643 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:37.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.643 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:37.643 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:37.643 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:37.644 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.644 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:37.644 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.644 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.644 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:37.644 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:37.644 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 71.513081909999997, 2024-04-26T10:43:37.644 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:37.644 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:37.644 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.644 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:37.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.645 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:37.645 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:37.645 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.645 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:37.645 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:37.645 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.645 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:37.645 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:37.645 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:37.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.646 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:37.646 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:37.646 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:37.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.646 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:37.646 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:37.646 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:37.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.646 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.646 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:37.646 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:37.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.647 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:37.647 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:37.647 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:37.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.647 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:37.647 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:37.647 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:37.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.647 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:37.647 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:37.647 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:37.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.648 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:37.648 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:37.648 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:37.648 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.648 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:37.648 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.648 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:37.648 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:37.648 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 71.512744377000004, 2024-04-26T10:43:37.649 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:37.649 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:37.649 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:37.649 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:37.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.649 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:37.649 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:37.649 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.649 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:37.649 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:37.649 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:37.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.650 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:37.650 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:37.650 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:37.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.650 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:37.650 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:37.650 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:37.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.650 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:37.650 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:37.650 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:37.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.651 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.651 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:37.651 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:37.651 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:37.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.651 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.651 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:37.651 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:37.651 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:37.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.651 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.651 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:37.651 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:37.651 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:37.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.652 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:37.652 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:37.652 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:37.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:37.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:37.652 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:37.652 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:37.652 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:37.652 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.652 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:37.652 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.652 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:37.652 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:37.652 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:37.654 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:37.654 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:37.652+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:37.755 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:37.753+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:37.760 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:37.760 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:37.760 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:37.760 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:37.769 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:37.855 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:37.854+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:37.912 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:37.912 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:37.912 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:37.912 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:37.912 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:37.921 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:37.956 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:37.956+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:38.057 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:38.055+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:38.065 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:38.065 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:38.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:38.065 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:38.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.065 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:38.065 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:38.065 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 72.026763797000001, 2024-04-26T10:43:38.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:38.065 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:38.065 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.066 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:38.066 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.066 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:38.066 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:38.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.066 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.066 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:38.066 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:38.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.066 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 72.025893017000001, 2024-04-26T10:43:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 72.024905673999996, 2024-04-26T10:43:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 72.024700409000005, 2024-04-26T10:43:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 72.024379530000004, 2024-04-26T10:43:38.083 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:38.083 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:38.083 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.083 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:38.083 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.083 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:38.083 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:38.083 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.083 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.083 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.083 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:38.083 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:38.083 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.083 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 72.024327705999994, 2024-04-26T10:43:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 72.024274333999998, 2024-04-26T10:43:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:38.096 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.096 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.096 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.096 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:38.096 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:38.096 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.096 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.096 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:38.096 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:38.096 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:38.096 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.096 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.096 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:38.096 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:38.096 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 72.024230007, 2024-04-26T10:43:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 72.024206293999995, 2024-04-26T10:43:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 72.024171988999996, 2024-04-26T10:43:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 72.023835392999999, 2024-04-26T10:43:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 72.023793365000003, 2024-04-26T10:43:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 72.023740192999995, 2024-04-26T10:43:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 72.020333782999998, 2024-04-26T10:43:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 72.017861830000001, 2024-04-26T10:43:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 72.017208272000005, 2024-04-26T10:43:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 72.017132486999998, 2024-04-26T10:43:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 72.016918793000002, 2024-04-26T10:43:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.144 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:38.144 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:38.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:38.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.144 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:38.144 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:38.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:38.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.144 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.144 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:38.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:38.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.145 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.145 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:38.145 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:38.145 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:38.145 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.145 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.145 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:38.145 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:38.145 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:38.145 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.145 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:38.145 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.145 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.145 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.146 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:38.146 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:38.146 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 72.014474980000003, 2024-04-26T10:43:38.146 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:38.146 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:38.146 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:38.146 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:38.146 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.146 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:38.146 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:38.146 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.146 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.146 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.146 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:38.147 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:38.147 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.147 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.147 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.147 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:38.147 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:38.147 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:38.147 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.147 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.147 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:38.147 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:38.147 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:38.147 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.147 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:38.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:38.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:38.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:38.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:38.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:38.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:38.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:38.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.149 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:38.149 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:38.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:38.149 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.149 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:38.149 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:38.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:38.149 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.149 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:38.149 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.149 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.150 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:38.150 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:38.150 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 66.564412536000006, 2024-04-26T10:43:38.150 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:38.150 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:38.150 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.150 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:38.150 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.150 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:38.150 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:38.150 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.150 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.150 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.150 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:38.150 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:38.151 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:38.151 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.151 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.151 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:38.151 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:38.151 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:38.151 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.151 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.151 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:38.151 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:38.151 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:38.151 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.151 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.152 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:38.152 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:38.152 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:38.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.152 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.152 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.152 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:38.152 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:38.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.152 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.152 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:38.152 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:38.152 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:38.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.152 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.152 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:38.153 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:38.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:38.153 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:38.153 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:38.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:38.153 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:38.153 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:38.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:38.153 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:38.154 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:38.154 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:38.154 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.154 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.154 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:38.154 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:38.154 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:38.154 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:38.154 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:38.154 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:38.154 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:38.154 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:38.154 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.154 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:38.155 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.155 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:38.155 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:38.155 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:38.156 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:38.198 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:38.196+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:38.258 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:38.257+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:38.269 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:38.270 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:38.270 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:38.270 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:38.278 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:38.359 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:38.357+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:38.383 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:38.384 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:38.384 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:38.384 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:38.384 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:38.392 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:38.419 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:43:38.460 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:38.459+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:38.500 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:38.500 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:38.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:38.500 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:38.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.500 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:38.500 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:38.500 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 72.462247259999998, 2024-04-26T10:43:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 72.460497138999997, 2024-04-26T10:43:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 72.460444140999996, 2024-04-26T10:43:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 72.460366397000001, 2024-04-26T10:43:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 72.460327391000007, 2024-04-26T10:43:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:38.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:38.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:38.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:38.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:38.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:38.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:38.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:38.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:38.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:38.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:38.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:38.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:38.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:38.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:38.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:38.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:38.526 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.526 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:38.526 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.527 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:38.527 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:38.527 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 72.460308569999995, 2024-04-26T10:43:38.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:38.527 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:38.527 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.527 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:38.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.527 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:38.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:38.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:38.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:38.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:38.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:38.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:38.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:38.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:38.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:38.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:38.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:38.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:38.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:38.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:38.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:38.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:38.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:38.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.530 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:38.530 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:38.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:38.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.530 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:38.530 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:38.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:38.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:38.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:38.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:38.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:38.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:38.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:38.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:38.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:38.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:38.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:38.534 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:38.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:38.534 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.534 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:38.534 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.534 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:38.534 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:38.534 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 72.460276567999998, 2024-04-26T10:43:38.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:38.535 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:38.535 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.535 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:38.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:38.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:38.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:38.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:38.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.536 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:38.536 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:38.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.536 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:38.536 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:38.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:38.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.536 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:38.536 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:38.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:38.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:38.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:38.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:38.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:38.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:38.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:38.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:38.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:38.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:38.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:38.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:38.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:38.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:38.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:38.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:38.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:38.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:38.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.539 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:38.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:38.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:38.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.539 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:38.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:38.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:38.539 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.539 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:38.539 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.540 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:38.540 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:38.540 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 72.460067760000001, 2024-04-26T10:43:38.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:38.540 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:38.540 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.540 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:38.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:38.540 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:38.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.541 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:38.541 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:38.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.541 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:38.541 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:38.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:38.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.541 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:38.541 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:38.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:38.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:38.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:38.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:38.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:38.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:38.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:38.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:38.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:38.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:38.543 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:38.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:38.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:38.543 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:38.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:38.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:38.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:38.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:38.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:38.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:38.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:38.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:38.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:38.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:38.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.545 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:38.545 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:38.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:38.545 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.545 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:38.545 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.545 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:38.545 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:38.545 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 72.460036469000002, 2024-04-26T10:43:38.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:38.545 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:38.545 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:38.546 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:38.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:38.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:38.546 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:38.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:38.546 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:38.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:38.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:38.547 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:38.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:38.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:38.547 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:38.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:38.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.548 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:38.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:38.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.548 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:38.548 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:38.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:38.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.548 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:38.548 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:38.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:38.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.548 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:38.549 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:38.549 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:38.549 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.549 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:38.549 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.549 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:38.549 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:38.549 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 72.460009219, 2024-04-26T10:43:38.549 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:38.550 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:38.550 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:38.550 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:38.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.550 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:38.550 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:38.550 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.550 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:38.550 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:38.550 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:38.551 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:38.551 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:38.551 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:38.551 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:38.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:38.551 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:38.551 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:38.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.552 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.552 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:38.552 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:38.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.552 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:38.552 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:38.552 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:38.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.552 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:38.552 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:38.552 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:38.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.553 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:38.553 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:38.553 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:38.553 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.553 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:38.553 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.553 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:38.553 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:38.553 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 72.457232468000001, 2024-04-26T10:43:38.553 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:38.553 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:38.554 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:38.554 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:38.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.554 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:38.554 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:38.554 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.554 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:38.554 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:38.554 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.555 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:38.555 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:38.555 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.555 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:38.555 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:38.555 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:38.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.555 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:38.555 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:38.555 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:38.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.556 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.556 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:38.556 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:38.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.556 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:38.556 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:38.556 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:38.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.556 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:38.556 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:38.556 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:38.557 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.557 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:38.557 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.557 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:38.557 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:38.557 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 72.457182379000002, 2024-04-26T10:43:38.557 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:38.557 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:38.557 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.557 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:38.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.557 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:38.557 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:38.558 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.558 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:38.558 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:38.558 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.558 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:38.558 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:38.558 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.559 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:38.559 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:38.559 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:38.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.559 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:38.559 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:38.559 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:38.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.559 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.559 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:38.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:38.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.560 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:38.560 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:38.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:38.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.560 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:38.560 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:38.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:38.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.561 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:38.561 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:38.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:38.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.561 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:38.561 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:38.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:38.561 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.561 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:38.561 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.561 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:38.562 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:38.562 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 72.45629031, 2024-04-26T10:43:38.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:38.562 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:38.562 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.562 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:38.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.562 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:38.562 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:38.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.562 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:38.562 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:38.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.563 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:38.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:38.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.563 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:38.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:38.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:38.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.563 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:38.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:38.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:38.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.564 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.564 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:38.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:38.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.564 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:38.564 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:38.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:38.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.564 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:38.564 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:38.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 72.454101980999994, 2024-04-26T10:43:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 72.453966610999998, 2024-04-26T10:43:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 72.453752037000001, 2024-04-26T10:43:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 72.453413096000006, 2024-04-26T10:43:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.580 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:38.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:38.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.580 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:38.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:38.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.580 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:38.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:38.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 72.453303719000004, 2024-04-26T10:43:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 72.453264000000004, 2024-04-26T10:43:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 72.452926466999998, 2024-04-26T10:43:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:38.595 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:38.597 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:38.597 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:38.595+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:38.613 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:38.614 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:38.614 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:43:38.646 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:38.647 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:38.651 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:43:38.651 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:43:38.697 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:38.696+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:38.701 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:38.701 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:38.710 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:38.799 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:38.797+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:38.853 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:38.853 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:38.862 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:38.902 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:38.901+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:39.002 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:39.003 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:39.003 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:39.002+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:39.012 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:39.103 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:39.102+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:39.124 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:39.125 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:39.133 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:39.204 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:39.202+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:39.232 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T10:43:39.257 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:43:39.280 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:39.280 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:39.288 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:39.304 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:39.303+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:39.343 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2024-04-26T10:43:39.394 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:39.394 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:39.403 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:39.405 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:39.404+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:39.505 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:39.505 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:39.506 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:39.505+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:39.514 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:39.606 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:39.605+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:39.618 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:39.618 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:39.623 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:39.707 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:39.706+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:39.725 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:39.726 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:39.734 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:39.745 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~23s 2024-04-26T10:43:39.808 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:39.806+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:39.844 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:39.844 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:39.853 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:39.908 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:39.907+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:39.958 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:39.958 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:39.967 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:40.009 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:40.008+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:40.072 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:40.073 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:40.081 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:40.125 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:40.124+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:40.186 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:40.186 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:40.195 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:40.210 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:40.210+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:40.253 INFO:teuthology.orchestra.run.smithi049.stderr:noscrub is unset 2024-04-26T10:43:40.311 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:40.310+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:40.338 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:40.338 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:40.347 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:40.413 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:40.412+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:40.490 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:40.490 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:40.499 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:40.546 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:40.542+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:40.611 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:40.611 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:40.614 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:40.612+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:40.620 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:40.652 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:43:40.714 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:40.713+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:40.766 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:40.766 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:40.775 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:40.815 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:40.814+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:40.840 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:40.841 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:43:40.874 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:40.874 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:40.877 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:43:40.878 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:43:40.882 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:40.882 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:40.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:40.882 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:40.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.883 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:40.883 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:40.883 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 74.844447356000003, 2024-04-26T10:43:40.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:40.883 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:40.883 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:40.883 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:40.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:40.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:40.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.884 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:40.884 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:40.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.884 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:40.884 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:40.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:40.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:40.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:40.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:40.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:40.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:40.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:40.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:40.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:40.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:40.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:40.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:40.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:40.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:40.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:40.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:40.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:40.887 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:40.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:40.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:40.887 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:40.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:40.887 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.887 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:40.887 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.888 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:40.888 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:40.888 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 74.842697235000003, 2024-04-26T10:43:40.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:40.888 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:40.888 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:40.888 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:40.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:40.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:40.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.889 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:40.889 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:40.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.889 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:40.889 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:40.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:40.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.889 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:40.889 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:40.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:40.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:40.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:40.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:40.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:40.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:40.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:40.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:40.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:40.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:40.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:40.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:40.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:40.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:40.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:40.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:40.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:40.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:40.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:40.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:40.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:40.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:40.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:40.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:40.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:40.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:40.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:40.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:40.893 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.893 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:40.893 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.893 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:40.893 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:40.894 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 74.842644237000002, 2024-04-26T10:43:40.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:40.894 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:40.894 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:40.894 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:40.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:40.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:40.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:40.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:40.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:40.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:40.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:40.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:40.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:40.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:40.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:40.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:40.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:40.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:40.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:40.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:40.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:40.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:40.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:40.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:40.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:40.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:40.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:40.898 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:40.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:40.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:40.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:40.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:40.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:40.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:40.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:40.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:40.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:40.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:40.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:40.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:40.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:40.900 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.901 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:40.901 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.901 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:40.901 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:40.901 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 74.842566493000007, 2024-04-26T10:43:40.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:40.901 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:40.901 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:40.901 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:40.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:40.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:40.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:40.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:40.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:40.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:40.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:40.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:40.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:40.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:40.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:40.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:40.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:40.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:40.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:40.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:40.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:40.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:40.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:40.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:40.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:40.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:40.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:40.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:40.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:40.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:40.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:40.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:40.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:40.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:40.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:40.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:40.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:40.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:40.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:40.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:40.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:40.906 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.906 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:40.906 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.907 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:40.907 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:40.907 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 74.842527486999998, 2024-04-26T10:43:40.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:40.907 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:40.907 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:40.907 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:40.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:40.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:40.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:40.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:40.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:40.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:40.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:40.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:40.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:40.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:40.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:40.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:40.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:40.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:40.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:40.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:40.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:40.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:40.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:40.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:40.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:40.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:40.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:40.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:40.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:40.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:40.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:40.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:40.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:40.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:40.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:40.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:40.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:40.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:40.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:40.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:40.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:40.912 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.912 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:40.912 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.912 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:40.912 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:40.912 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 74.842508666000001, 2024-04-26T10:43:40.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:40.912 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:40.912 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:40.913 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:40.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:40.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:40.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:40.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:40.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:40.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:40.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:40.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:40.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:40.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:40.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:40.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:40.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:40.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:40.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:40.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:40.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:40.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:40.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:40.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:40.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:40.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:40.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:40.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:40.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:40.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:40.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:40.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:40.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:40.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:40.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:40.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:40.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:40.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:40.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:40.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:40.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:40.917 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.917 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:40.917 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.918 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:40.918 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:40.918 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 74.842476664000003, 2024-04-26T10:43:40.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:40.918 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:40.918 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:40.918 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:40.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:40.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:40.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:40.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:40.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:40.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:40.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:40.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:40.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:40.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:40.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:40.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:40.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:40.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:40.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:40.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:40.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:40.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:40.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:40.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:40.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:40.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:40.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:40.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:40.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:40.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:40.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:40.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:40.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:40.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:40.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:40.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:40.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:40.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:40.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:40.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:40.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:40.923 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.923 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:40.923 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.923 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:40.923 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:40.923 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 74.842267856000007, 2024-04-26T10:43:40.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:40.923 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:40.923 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:40.923 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:40.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:40.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:40.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:40.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:40.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:40.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:40.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:40.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:40.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:40.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:40.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:40.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:40.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:40.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:40.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:40.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:40.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:40.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:40.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:40.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:40.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:40.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:40.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:40.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:40.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:40.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:40.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:40.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:40.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:40.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:40.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:40.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:40.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:40.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:40.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:40.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:40.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:40.928 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.928 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:40.928 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.928 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:40.928 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:40.929 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 74.842236564999993, 2024-04-26T10:43:40.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:40.929 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:40.929 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:40.929 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:40.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:40.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:40.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:40.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:40.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:40.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:40.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:40.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:40.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:40.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:40.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:40.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:40.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:40.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:40.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:40.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:40.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:40.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:40.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:40.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:40.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:40.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:40.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:40.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:40.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:40.932 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.932 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:40.932 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.932 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:40.933 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:40.933 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 74.842209315000005, 2024-04-26T10:43:40.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:40.933 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:40.933 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:40.933 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:40.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:40.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:40.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:40.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:40.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:40.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:40.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:40.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:40.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:40.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:40.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:40.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:40.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:40.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:40.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:40.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:40.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:40.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:40.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:40.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:40.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:40.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:40.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:40.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:40.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:40.937 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.937 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:40.937 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.937 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:40.937 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:40.937 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 74.839432564000006, 2024-04-26T10:43:40.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:40.937 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:40.938 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:40.938 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:40.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:40.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:40.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:40.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:40.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:40.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:40.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:40.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:40.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:40.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:40.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:40.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:40.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:40.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:40.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:40.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:40.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:40.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:40.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:40.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:40.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:40.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:40.941 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.941 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:40.941 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.941 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:40.941 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:40.941 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 74.839382474999994, 2024-04-26T10:43:40.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:40.941 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:40.941 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:40.942 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:40.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:40.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:40.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:40.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:40.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:40.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:40.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:40.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:40.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:40.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:40.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:40.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:40.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:40.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:40.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:40.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:40.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:40.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:40.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:40.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:40.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:40.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:40.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:40.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:40.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:40.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:40.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:40.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:40.945 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.945 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:40.945 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.946 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:40.946 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:40.946 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 74.838490406000005, 2024-04-26T10:43:40.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:40.946 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:40.946 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:40.946 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:40.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:40.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:40.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:40.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:40.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:40.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:40.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:40.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:40.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:40.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:40.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:40.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:40.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:40.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:40.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:40.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:40.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:40.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:40.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:40.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:40.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:40.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:40.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:40.950 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:40.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:40.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.950 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:40.950 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:40.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:40.950 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.950 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:40.950 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.950 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:40.950 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:40.951 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 74.836302076999999, 2024-04-26T10:43:40.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:40.951 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:40.951 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:40.951 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:40.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:40.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:40.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:40.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:40.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:40.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:40.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:40.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:40.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:40.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:40.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:40.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:40.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:40.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:40.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:40.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:40.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:40.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:40.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:40.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:40.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:40.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:40.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:40.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:40.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:40.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:40.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:40.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:40.955 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.955 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:40.955 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.955 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:40.955 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:40.955 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 74.836166707000004, 2024-04-26T10:43:40.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:40.955 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:40.955 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:40.955 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:40.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:40.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:40.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:40.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:40.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:40.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:40.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:40.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:40.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:40.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:40.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:40.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:40.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:40.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:40.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:40.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:40.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:40.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:40.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:40.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:40.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:40.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:40.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:40.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:40.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:40.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:40.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:40.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:40.959 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.959 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:40.959 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.959 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:40.959 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:40.959 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 74.835952133000006, 2024-04-26T10:43:40.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:40.960 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:40.960 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:40.960 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:40.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:40.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:40.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:40.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:40.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:40.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:40.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:40.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:40.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:40.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:40.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:40.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:40.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:40.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:40.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:40.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:40.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:40.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:40.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:40.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:40.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:40.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:40.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:40.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:40.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:40.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:40.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:40.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:40.963 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.963 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:40.963 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.964 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:40.964 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:40.964 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 74.835613191999997, 2024-04-26T10:43:40.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:40.964 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:40.964 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:40.964 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:40.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:40.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:40.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:40.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:40.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:40.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:40.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:40.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:40.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:40.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:40.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:40.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:40.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:40.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:40.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:40.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:40.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:40.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:40.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:40.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:40.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:40.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:40.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:40.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:40.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:40.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:40.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:40.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:40.968 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.968 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:40.968 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.968 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:40.968 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:40.968 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 74.835503814999996, 2024-04-26T10:43:40.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:40.968 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:40.968 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:40.968 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:40.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:40.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:40.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:40.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:40.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:40.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:40.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:40.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:40.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:40.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:40.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:40.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:40.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:40.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:40.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:40.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:40.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:40.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:40.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:40.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:40.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:40.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:40.971 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.971 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:40.971 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.972 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:40.972 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:40.972 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 74.835464095999995, 2024-04-26T10:43:40.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:40.972 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:40.972 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:40.972 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:40.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:40.972 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:40.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:40.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:40.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:40.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:40.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:40.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:40.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:40.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:40.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:40.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:40.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:40.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:40.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:40.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:40.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:40.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:40.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:40.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:40.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:40.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:40.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:40.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:40.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:40.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:40.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:40.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:40.976 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.976 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:40.976 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.976 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:40.976 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:40.976 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 74.835126563000003, 2024-04-26T10:43:40.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:40.977 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:40.977 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:40.977 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:40.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:40.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:40.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:40.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:40.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:40.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:40.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:40.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:40.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:40.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:40.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:40.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:40.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:40.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:40.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:40.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:40.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:40.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:40.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:40.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:40.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:40.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:40.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:40.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:40.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:40.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:40.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:40.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:40.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:40.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:40.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:40.980 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.980 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:40.980 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.981 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:40.981 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:40.981 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:40.982 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:40.983 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:40.981+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:41.083 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:41.082+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:41.086 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:41.086 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:41.086 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:41.087 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:41.095 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:41.184 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:41.183+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:41.238 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:41.238 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:41.238 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:41.238 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:41.238 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:41.247 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:41.289 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:41.287+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:41.387 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:41.386+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:41.391 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:41.391 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:41.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:41.392 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:41.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.392 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:41.392 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:41.392 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 75.352412275999995, 2024-04-26T10:43:41.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:41.392 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:41.392 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.392 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:41.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:41.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:41.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:41.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:41.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:41.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:41.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:41.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:41.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:41.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:41.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:41.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:41.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:41.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:41.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:41.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:41.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:41.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:41.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:41.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:41.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.397 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:41.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:41.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:41.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.397 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:41.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:41.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:41.397 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.397 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:41.398 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.398 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:41.398 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:41.398 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 75.351541495999996, 2024-04-26T10:43:41.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:41.398 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:41.398 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.398 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:41.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:41.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:41.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:41.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:41.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:41.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:41.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:41.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:41.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:41.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:41.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:41.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:41.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:41.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:41.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.401 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:41.401 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:41.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:41.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.401 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:41.401 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:41.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:41.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.401 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:41.401 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:41.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:41.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:41.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:41.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:41.402 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.403 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:41.403 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.403 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:41.403 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:41.404 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 75.350554153000004, 2024-04-26T10:43:41.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:41.404 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:41.404 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.404 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:41.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:41.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:41.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:41.406 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:41.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.406 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.406 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:41.406 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:41.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:41.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.407 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:41.407 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:41.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:41.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:41.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:41.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:41.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:41.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:41.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:41.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:41.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:41.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.410 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:41.410 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:41.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:41.410 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:41.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:41.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:41.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:41.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:41.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:41.412 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.412 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:41.412 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.413 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:41.413 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:41.413 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 75.350348887999999, 2024-04-26T10:43:41.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:41.413 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:41.413 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.414 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:41.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.414 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:41.414 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:41.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.414 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:41.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:41.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:41.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:41.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:41.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:41.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:41.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:41.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:41.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:41.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.418 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.418 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:41.418 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:41.418 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.418 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.418 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:41.418 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:41.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:41.419 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:41.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:41.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:41.419 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:41.420 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:41.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:41.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:41.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:41.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:41.421 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.421 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:41.421 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.422 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.422 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:41.422 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:41.422 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 75.350028008999999, 2024-04-26T10:43:41.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:41.422 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:41.422 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.423 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:41.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:41.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:41.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:41.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:41.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:41.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:41.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:41.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:41.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:41.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:41.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:41.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:41.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:41.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:41.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:41.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:41.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:41.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:41.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:41.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:41.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:41.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:41.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:41.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:41.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:41.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:41.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:41.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:41.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:41.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:41.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:41.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:41.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:41.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.427 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:41.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:41.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:41.427 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.427 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:41.427 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.427 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:41.427 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:41.427 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 75.349976185000003, 2024-04-26T10:43:41.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:41.428 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:41.428 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.428 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:41.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:41.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:41.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:41.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:41.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.429 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:41.429 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:41.429 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.429 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.429 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:41.429 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:41.429 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:41.429 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.429 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:41.429 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:41.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:41.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:41.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:41.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:41.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:41.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:41.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:41.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:41.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:41.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:41.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:41.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:41.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:41.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:41.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:41.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:41.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:41.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:41.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.432 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:41.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:41.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:41.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.432 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:41.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:41.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:41.432 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.432 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:41.432 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.433 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.433 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:41.433 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:41.433 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 75.349922813000006, 2024-04-26T10:43:41.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:41.433 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:41.433 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.433 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:41.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.433 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:41.433 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:41.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.433 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.434 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:41.434 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:41.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.434 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.434 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:41.434 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:41.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.434 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.434 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:41.434 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:41.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:41.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:41.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:41.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:41.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:41.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:41.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:41.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:41.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:41.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:41.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:41.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:41.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:41.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:41.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:41.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:41.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:41.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:41.437 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.437 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:41.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:41.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:41.437 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.437 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:41.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:41.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:41.437 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.438 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:41.438 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:41.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:41.438 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.438 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:41.438 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.438 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.438 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:41.438 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:41.438 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 75.349878485999994, 2024-04-26T10:43:41.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:41.438 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:41.438 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.439 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:41.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:41.439 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:41.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:41.439 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:41.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:41.439 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:41.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:41.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:41.440 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:41.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:41.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:41.440 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:41.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:41.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:41.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:41.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:41.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:41.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:41.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:41.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:41.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:41.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.442 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.442 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:41.442 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:41.442 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:41.442 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.442 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.442 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:41.442 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:41.442 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:41.442 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.442 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.442 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:41.442 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:41.443 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:41.443 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.443 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.443 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:41.443 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:41.443 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:41.443 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.443 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.443 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:41.443 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:41.443 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:41.443 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.443 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:41.444 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.444 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.444 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.444 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:41.444 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:41.444 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 75.349854773000004, 2024-04-26T10:43:41.444 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:41.444 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:41.444 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.444 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:41.444 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.444 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:41.444 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:41.444 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.445 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.445 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.445 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:41.445 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:41.445 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.445 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.445 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.445 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:41.445 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:41.445 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.445 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.445 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.445 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:41.445 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:41.445 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:41.446 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.446 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.446 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:41.446 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:41.446 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:41.446 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.446 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.446 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.446 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:41.446 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:41.446 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.446 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.446 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:41.446 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:41.447 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:41.447 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.447 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.447 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:41.447 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:41.447 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:41.447 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.447 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.447 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:41.447 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:41.447 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:41.447 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.447 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.448 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:41.448 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:41.448 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:41.448 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.448 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.448 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:41.448 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:41.448 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:41.448 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.448 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.448 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:41.448 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:41.448 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:41.448 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.448 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.449 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:41.449 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:41.449 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:41.449 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.449 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:41.449 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.449 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.449 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.449 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:41.449 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:41.449 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 75.349820468000004, 2024-04-26T10:43:41.449 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:41.449 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:41.449 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.450 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:41.450 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.450 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:41.450 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:41.450 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.450 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.450 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.450 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:41.450 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:41.450 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.450 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.450 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.450 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:41.450 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:41.451 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.451 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.451 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.451 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:41.451 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:41.451 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:41.451 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.451 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.451 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:41.451 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:41.451 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:41.451 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.451 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.451 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.451 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:41.452 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:41.452 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.452 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.452 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:41.452 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:41.452 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:41.452 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.452 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.452 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:41.452 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:41.452 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:41.452 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.452 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.452 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:41.452 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:41.453 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:41.453 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.453 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.453 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:41.453 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:41.453 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:41.453 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.453 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.453 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:41.453 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:41.453 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:41.453 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.453 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.453 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:41.454 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:41.454 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:41.454 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.454 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.454 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:41.454 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:41.454 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:41.454 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.454 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:41.454 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.454 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.454 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.454 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:41.455 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:41.455 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 75.349483871999993, 2024-04-26T10:43:41.455 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:41.455 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:41.455 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:41.455 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:41.455 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.455 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:41.455 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:41.455 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.455 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.455 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.455 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:41.455 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:41.455 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.456 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.456 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.456 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:41.456 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:41.456 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:41.456 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.456 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.456 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:41.456 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:41.456 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:41.456 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.456 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.456 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:41.456 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:41.456 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:41.457 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.457 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.457 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.457 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:41.457 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:41.457 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.457 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.457 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:41.457 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:41.457 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:41.457 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.457 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.457 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:41.457 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:41.457 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:41.458 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.458 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.458 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:41.458 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:41.458 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:41.458 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.458 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:41.458 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.458 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.458 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.458 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:41.458 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:41.458 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 75.349441843999998, 2024-04-26T10:43:41.458 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:41.459 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:41.459 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:41.459 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:41.459 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.459 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:41.459 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:41.459 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.459 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.459 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.459 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:41.459 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:41.459 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.459 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.459 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.460 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:41.461 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:41.462 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.462 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.462 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.462 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:41.462 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:41.462 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:41.462 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.462 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.462 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:41.462 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:41.462 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:41.462 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.462 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.462 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.463 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:41.463 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:41.463 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.463 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.463 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:41.463 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:41.463 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:41.463 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.463 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.463 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:41.463 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:41.463 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:41.463 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.463 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.464 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:41.464 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:41.464 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:41.464 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.464 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:41.464 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.464 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.464 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.464 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:41.464 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:41.464 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 75.349388672000003, 2024-04-26T10:43:41.464 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:41.464 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:41.464 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:41.465 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:41.465 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.465 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:41.465 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:41.465 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.465 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.465 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.465 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:41.465 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:41.465 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.465 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.465 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.465 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:41.465 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:41.465 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.466 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.466 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.466 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:41.466 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:41.466 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:41.466 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.466 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.466 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:41.466 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:41.466 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:41.466 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.466 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.466 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.466 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:41.467 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:41.467 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.467 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.467 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:41.467 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:41.467 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:41.467 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.467 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.467 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:41.467 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:41.467 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:41.467 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.467 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.467 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:41.468 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:41.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:41.468 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.468 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:41.468 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.468 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.468 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.468 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:41.468 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:41.468 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 75.345982262000007, 2024-04-26T10:43:41.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:41.468 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:41.468 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:41.468 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:41.468 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.469 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:41.469 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:41.469 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.469 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:41.469 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:41.469 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.469 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:41.469 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:41.469 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.470 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.470 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:41.470 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:41.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:41.470 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.470 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.470 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:41.470 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:41.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:41.470 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.470 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.470 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.470 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:41.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:41.470 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:41.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:41.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:41.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:41.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:41.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:41.471 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.471 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:41.471 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.471 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:41.472 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:41.472 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 75.343510308999996, 2024-04-26T10:43:41.472 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:41.472 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:41.472 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:41.472 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:41.472 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.472 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:41.472 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:41.472 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.472 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.472 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.472 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:41.472 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:41.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.473 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.473 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.473 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:41.473 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:41.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.473 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.473 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.473 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:41.473 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:41.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:41.473 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.473 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.473 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:41.473 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:41.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:41.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:41.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:41.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:41.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:41.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:41.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:41.475 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:41.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:41.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.475 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:41.475 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:41.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:41.475 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.475 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:41.475 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.475 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:41.475 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:41.476 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 75.342856750999999, 2024-04-26T10:43:41.476 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:41.476 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:41.476 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:41.476 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:41.476 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.476 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:41.476 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:41.476 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.476 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.476 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.476 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:41.476 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:41.476 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.476 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.477 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.477 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:41.477 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:41.477 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.477 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.477 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.477 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:41.477 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:41.477 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:41.477 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.477 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.477 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:41.477 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:41.477 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:41.478 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.478 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.478 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.478 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:41.478 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:41.478 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.478 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.478 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:41.478 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:41.478 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:41.478 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.478 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.478 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:41.478 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:41.478 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:41.479 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.479 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.479 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:41.479 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:41.479 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:41.479 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.479 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:41.479 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.479 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.479 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.479 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:41.479 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:41.479 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 75.342780966000007, 2024-04-26T10:43:41.479 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:41.480 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:41.480 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:41.480 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:41.480 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.480 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:41.480 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:41.480 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.480 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.480 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.480 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:41.480 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:41.480 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.480 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.480 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.480 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:41.481 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:41.481 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.481 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.481 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.481 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:41.481 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:41.481 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:41.481 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.481 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.481 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:41.481 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:41.481 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:41.481 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.481 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.481 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.482 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:41.482 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:41.482 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.482 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.482 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:41.482 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:41.482 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:41.482 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.482 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.482 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:41.482 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:41.482 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:41.482 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.482 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.483 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:41.483 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:41.483 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:41.483 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.483 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:41.483 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.483 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.483 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.483 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:41.483 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:41.483 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 75.342567271999997, 2024-04-26T10:43:41.483 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:41.483 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:41.483 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:41.483 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:41.484 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.484 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:41.484 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:41.484 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.484 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.484 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.484 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:41.484 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:41.484 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.484 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.484 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.484 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:41.484 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:41.484 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.485 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.485 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:41.485 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:41.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:41.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.485 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.485 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:41.485 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:41.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:41.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.485 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.485 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.485 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:41.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:41.486 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.486 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.486 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:41.486 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:41.486 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:41.486 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.486 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.486 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:41.486 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:41.486 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:41.486 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.486 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:41.486 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.486 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.486 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.487 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:41.487 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:41.487 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 75.340123458999997, 2024-04-26T10:43:41.487 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:41.487 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:41.487 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:41.487 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:41.487 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.487 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:41.487 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:41.487 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.487 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.487 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.487 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:41.488 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:41.488 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.488 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.488 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.488 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:41.488 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:41.488 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:41.488 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.488 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.488 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:41.488 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:41.488 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:41.488 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.488 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.488 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:41.489 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:41.489 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:41.489 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.489 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.489 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.489 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:41.489 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:41.489 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.489 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.489 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:41.489 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:41.489 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:41.489 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.489 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.489 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:41.490 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:41.490 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:41.490 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.490 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.490 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:41.490 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:41.490 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:41.490 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.490 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:41.490 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.490 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.490 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.490 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:41.490 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:41.491 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 69.890061015000001, 2024-04-26T10:43:41.491 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:41.491 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:41.491 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.491 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:41.491 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.491 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:41.491 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:41.491 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.491 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.491 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.491 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:41.491 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:41.491 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:41.491 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.492 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.492 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:41.492 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:41.492 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:41.492 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.492 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.492 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:41.492 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:41.492 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:41.492 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.492 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.492 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:41.492 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:41.492 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:41.492 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.493 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.493 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.493 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:41.493 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:41.493 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.493 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.493 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:41.493 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:41.493 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:41.493 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.493 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.493 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:41.493 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:41.493 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:41.493 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.494 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.494 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:41.494 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:41.494 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:41.494 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.494 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.494 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:41.494 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:41.494 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:41.494 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.494 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.494 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:41.494 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:41.494 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:41.495 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.495 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.495 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:41.495 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:41.495 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:41.495 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:41.495 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:41.495 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:41.495 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:41.495 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:41.495 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.495 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:41.495 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.495 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:41.495 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:41.496 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:41.497 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:41.498 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:41.496+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:41.598 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:41.597+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:41.607 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:41.607 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:41.607 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:41.607 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:41.616 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:41.699 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:41.698+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:41.722 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:41.722 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:41.722 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:41.722 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:41.722 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:41.730 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:41.800 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:41.799+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:41.838 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:41.838 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:41.838 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:41.838 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:41.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.838 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:41.838 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 75.800231882000006, 2024-04-26T10:43:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:41.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:41.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 75.798481761000005, 2024-04-26T10:43:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.843 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.844 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.845 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:41.847 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:41.848 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:41.848 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.848 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:41.848 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.848 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:41.848 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:41.848 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 75.798428763000004, 2024-04-26T10:43:41.848 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:41.848 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:41.848 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.848 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:41.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:41.851 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:41.852 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 75.798351018999995, 2024-04-26T10:43:41.853 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:41.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:41.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.858 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 75.798312013, 2024-04-26T10:43:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:41.859 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:41.860 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:41.861 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.862 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:41.863 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 75.798293192000003, 2024-04-26T10:43:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:41.865 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:41.866 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:41.867 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.868 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 75.798261190000005, 2024-04-26T10:43:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:41.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:41.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.873 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.873 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:41.873 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:41.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:41.874 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:41.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 75.798052381999995, 2024-04-26T10:43:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:41.876 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.877 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.878 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:41.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 75.798021090999995, 2024-04-26T10:43:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.882 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.884 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:41.885 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 75.797993840999993, 2024-04-26T10:43:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:41.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:41.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 75.795217089999994, 2024-04-26T10:43:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:41.889 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:41.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:41.892 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 75.795167000999996, 2024-04-26T10:43:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:41.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:41.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 75.794274931999993, 2024-04-26T10:43:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.897 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:41.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:41.901 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 75.792086603000001, 2024-04-26T10:43:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:41.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:41.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 75.791951233000006, 2024-04-26T10:43:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:41.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.909 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 75.791736658999994, 2024-04-26T10:43:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:41.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:41.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:41.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:41.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 75.791397717999999, 2024-04-26T10:43:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:41.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:41.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:41.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 75.791288340999998, 2024-04-26T10:43:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:41.918 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:41.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:41.921 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 75.791248621999998, 2024-04-26T10:43:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:41.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:41.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:41.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 75.790911089000005, 2024-04-26T10:43:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:41.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:41.930 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:41.930 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:41.932 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:41.932 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:41.930+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:42.032 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:42.032+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:42.034 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:42.035 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:42.035 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:42.035 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:42.043 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:42.133 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:42.133+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:42.144 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:42.144 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:42.144 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:42.144 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:42.145 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:42.153 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:42.234 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:42.233+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:42.257 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:42.257 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:42.257 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:42.257 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:42.257 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.257 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:42.257 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:42.258 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 76.218678777999997, 2024-04-26T10:43:42.258 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:42.258 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:42.258 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.258 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:42.258 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.258 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:42.258 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:42.258 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.258 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.258 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.258 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:42.258 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:42.259 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.259 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.259 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.259 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:42.259 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:42.259 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.259 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.259 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.259 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:42.259 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:42.259 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:42.259 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.259 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.259 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:42.260 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:42.260 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:42.260 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.260 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.260 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.260 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:42.260 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:42.260 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.260 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.260 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:42.260 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:42.260 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:42.260 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.260 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.260 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:42.261 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:42.261 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:42.261 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.261 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.261 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:42.261 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:42.261 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:42.261 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.261 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.261 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:42.261 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:42.261 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:42.261 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.261 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:42.262 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.262 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.262 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.262 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:42.262 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:42.262 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 76.217807997999998, 2024-04-26T10:43:42.262 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:42.262 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:42.262 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.262 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:42.262 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.262 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:42.262 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:42.262 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.262 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.263 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.263 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:42.263 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:42.263 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.263 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.263 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.263 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:42.263 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:42.263 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.263 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.263 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.263 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:42.264 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:42.264 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:42.264 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.264 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.264 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:42.264 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:42.264 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:42.264 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.264 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.264 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.264 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:42.264 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:42.264 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.264 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.265 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:42.265 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:42.265 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:42.265 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.265 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.265 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:42.265 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:42.265 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:42.265 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.265 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.265 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:42.265 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:42.265 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:42.265 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.265 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.266 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:42.266 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:42.266 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:42.266 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.266 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:42.266 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.266 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.266 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.266 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:42.266 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:42.266 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 76.216820655000006, 2024-04-26T10:43:42.266 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:42.266 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:42.266 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.266 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:42.267 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.267 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:42.267 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:42.267 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.267 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.267 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.267 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:42.267 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:42.267 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.267 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.267 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.267 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:42.267 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:42.267 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:42.267 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.268 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.268 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:42.268 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:42.268 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:42.268 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.268 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.268 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:42.268 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:42.268 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:42.268 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.268 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.268 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.268 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:42.268 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:42.268 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.269 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.269 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:42.269 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:42.269 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:42.269 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.269 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.269 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:42.269 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:42.269 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:42.269 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.269 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.269 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:42.269 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:42.269 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:42.270 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.270 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.270 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:42.270 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:42.270 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:42.270 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.270 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:42.270 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.270 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.270 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.270 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:42.270 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:42.270 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 76.216615390000001, 2024-04-26T10:43:42.270 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:42.270 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:42.271 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.271 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:42.271 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.271 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:42.271 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:42.271 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.271 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.271 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.271 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:42.271 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:42.271 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.271 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.271 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.271 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:42.272 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:42.272 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.272 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.272 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.272 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:42.272 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:42.272 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:42.272 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.272 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.272 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:42.272 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:42.272 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:42.272 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.272 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.273 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.273 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:42.273 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:42.273 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.273 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.273 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:42.273 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:42.273 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:42.273 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.273 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.273 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:42.273 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:42.273 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:42.273 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.273 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.274 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:42.274 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:42.274 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:42.274 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.274 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.274 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:42.274 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:42.274 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:42.274 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.274 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:42.274 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.274 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.274 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.274 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:42.275 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:42.275 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 76.216294511000001, 2024-04-26T10:43:42.275 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:42.275 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:42.275 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.275 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:42.275 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.275 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:42.275 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:42.275 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.275 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.275 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.275 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:42.275 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:42.275 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.276 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.276 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.276 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:42.276 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:42.276 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:42.276 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.276 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.276 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:42.276 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:42.276 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:42.276 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.276 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.276 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:42.276 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:42.276 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:42.277 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.277 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.277 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.277 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:42.277 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:42.277 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.277 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.277 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:42.277 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:42.277 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:42.277 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.277 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.277 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:42.277 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:42.277 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:42.278 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.278 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.278 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:42.278 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:42.278 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:42.278 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.278 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.278 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:42.278 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:42.278 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:42.278 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.278 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.278 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:42.278 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:42.278 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:42.279 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.279 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.279 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:42.279 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:42.279 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:42.279 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.279 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.279 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:42.279 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:42.279 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:42.279 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.279 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:42.279 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.279 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.279 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.280 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:42.280 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:42.280 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 76.216242687000005, 2024-04-26T10:43:42.280 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:42.280 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:42.280 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.280 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:42.280 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.280 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:42.280 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:42.280 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.280 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.280 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.280 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:42.280 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:42.281 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.281 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.281 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.281 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:42.281 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:42.281 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.281 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.281 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.281 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:42.281 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:42.281 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:42.281 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.281 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.281 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:42.281 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:42.282 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:42.282 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.282 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.282 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.282 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:42.282 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:42.282 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.282 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.282 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:42.282 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:42.282 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:42.282 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.282 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.282 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:42.283 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:42.283 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:42.283 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.283 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.283 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:42.283 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:42.283 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:42.283 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.283 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.283 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:42.283 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:42.286 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:42.286 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.286 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.286 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:42.286 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:42.286 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:42.286 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.286 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.286 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:42.286 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:42.286 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:42.286 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.286 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.287 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:42.287 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:42.287 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:42.287 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.287 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:42.287 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.287 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.287 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.287 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:42.287 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:42.287 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 76.216189314999994, 2024-04-26T10:43:42.287 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:42.287 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:42.287 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.288 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:42.288 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.288 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:42.288 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:42.288 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.288 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.288 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.288 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:42.288 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:42.288 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.288 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.288 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.288 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:42.288 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:42.289 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.289 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.289 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.289 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:42.289 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:42.289 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:42.289 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.289 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.289 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:42.289 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:42.289 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:42.289 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.289 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.289 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.290 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:42.290 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:42.290 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.290 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.290 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:42.290 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:42.290 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:42.290 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.290 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.290 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:42.290 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:42.290 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:42.290 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.290 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.291 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:42.291 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:42.291 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:42.291 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.291 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.291 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:42.291 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:42.291 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:42.291 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.291 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.291 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:42.291 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:42.291 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:42.291 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.292 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.292 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:42.292 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:42.292 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:42.292 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.292 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.292 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:42.292 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:42.292 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:42.292 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.292 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:42.292 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.292 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.292 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.292 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:42.293 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:42.293 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 76.216144987999996, 2024-04-26T10:43:42.293 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:42.293 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:42.293 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.293 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:42.293 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.293 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:42.293 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:42.293 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.293 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.293 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.293 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:42.293 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:42.293 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.294 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.294 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.294 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:42.294 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:42.294 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:42.294 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.294 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.294 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:42.294 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:42.294 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:42.294 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.294 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.294 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:42.294 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:42.295 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:42.295 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.295 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.295 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.295 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:42.295 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:42.295 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.295 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.295 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:42.295 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:42.295 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:42.295 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.295 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.295 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:42.295 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:42.296 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:42.296 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.296 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.296 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:42.296 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:42.296 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:42.296 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.296 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.296 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:42.296 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:42.296 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:42.296 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.296 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.296 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:42.296 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:42.297 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:42.297 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.297 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.297 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:42.297 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:42.297 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:42.297 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.297 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.297 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:42.297 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:42.297 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:42.297 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.297 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:42.297 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.297 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.298 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.298 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:42.298 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:42.298 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 76.216121275000006, 2024-04-26T10:43:42.298 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:42.298 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:42.298 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.298 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:42.298 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.298 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:42.298 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:42.298 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.298 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.298 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.298 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:42.299 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:42.299 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.299 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.299 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.299 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:42.299 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:42.299 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.299 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.299 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.299 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:42.299 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:42.299 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:42.299 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.300 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.300 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:42.300 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:42.300 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:42.300 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.300 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.300 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.300 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:42.300 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:42.300 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.300 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.300 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:42.300 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:42.300 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:42.301 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.301 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.301 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:42.301 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:42.301 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:42.301 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.301 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.301 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:42.301 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:42.301 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:42.301 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.301 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.301 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:42.301 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:42.301 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:42.302 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.302 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.302 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:42.302 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:42.302 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:42.302 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.302 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.302 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:42.302 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:42.302 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:42.302 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.302 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.302 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:42.302 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:42.303 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:42.303 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.303 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:42.303 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.303 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.303 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.303 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:42.303 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:42.303 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 76.216086970000006, 2024-04-26T10:43:42.303 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:42.303 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:42.303 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.303 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:42.303 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.303 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:42.304 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:42.304 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.304 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.304 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.304 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:42.304 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:42.304 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.304 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.304 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.304 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:42.304 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:42.304 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.304 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.304 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.304 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:42.305 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:42.305 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:42.305 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.305 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.305 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:42.305 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:42.305 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:42.305 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.305 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.305 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.305 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:42.305 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:42.305 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.305 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.305 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:42.306 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:42.306 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:42.306 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.306 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.306 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:42.306 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:42.306 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:42.306 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.306 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.306 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:42.306 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:42.306 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:42.306 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.306 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.306 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:42.307 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:42.307 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:42.307 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.307 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.307 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:42.307 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:42.307 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:42.307 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.307 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.307 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:42.307 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:42.307 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:42.307 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.307 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.307 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:42.308 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:42.308 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:42.308 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.308 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:42.308 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.308 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.308 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.308 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:42.308 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:42.308 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 76.215750373999995, 2024-04-26T10:43:42.308 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:42.308 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:42.308 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:42.308 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:42.308 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.309 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:42.309 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:42.309 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.309 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.309 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.309 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:42.309 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:42.309 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.309 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.309 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.309 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:42.309 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:42.309 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:42.309 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.309 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.310 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:42.310 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:42.310 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:42.310 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.310 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.310 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:42.310 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:42.310 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:42.310 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.310 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.310 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.310 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:42.310 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:42.310 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.310 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.311 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:42.311 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:42.311 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:42.311 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.311 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.311 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:42.311 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:42.311 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:42.311 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.311 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.311 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:42.311 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:42.311 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:42.311 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.311 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:42.311 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.312 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.312 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.312 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:42.312 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:42.312 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 76.215708346, 2024-04-26T10:43:42.312 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:42.312 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:42.312 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:42.312 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:42.312 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.312 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:42.312 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:42.312 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.312 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.313 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.313 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:42.313 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:42.313 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.313 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.313 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.313 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:42.313 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:42.313 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.313 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.313 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.313 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:42.313 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:42.313 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:42.313 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.314 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.314 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:42.314 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:42.314 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:42.314 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.314 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.314 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.314 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:42.314 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:42.314 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.314 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.314 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:42.314 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:42.314 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:42.315 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.315 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.315 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:42.315 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:42.315 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:42.315 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.315 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.315 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:42.315 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:42.315 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:42.315 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.315 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:42.315 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.315 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.315 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.316 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:42.316 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:42.316 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 76.215655174000005, 2024-04-26T10:43:42.316 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:42.316 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:42.316 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:42.316 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:42.316 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.316 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:42.316 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:42.316 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.316 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.316 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.316 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:42.316 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:42.317 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.317 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.317 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.317 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:42.317 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:42.317 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.317 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.317 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.317 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:42.317 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:42.317 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:42.317 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.317 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.317 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:42.318 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:42.318 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:42.318 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.318 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.318 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.318 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:42.318 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:42.318 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.318 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.318 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:42.318 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:42.318 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:42.318 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.318 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.319 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:42.319 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:42.319 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:42.319 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.319 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.319 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:42.319 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:42.319 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:42.319 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.319 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:42.319 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.319 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.319 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.319 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:42.319 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:42.320 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 76.212248763999995, 2024-04-26T10:43:42.320 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:42.320 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:42.320 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:42.320 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:42.320 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.320 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:42.320 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:42.320 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.320 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.320 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.320 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:42.320 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:42.320 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.321 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.321 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.321 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:42.321 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:42.321 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.321 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.321 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.321 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:42.321 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:42.321 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:42.321 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.321 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.321 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:42.321 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:42.321 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:42.322 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.322 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.322 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.322 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:42.322 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:42.322 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.322 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.322 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:42.322 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:42.322 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:42.322 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.322 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.322 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:42.322 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:42.323 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:42.323 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.323 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:42.323 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.323 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.323 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.323 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:42.323 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:42.323 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 76.209776810999998, 2024-04-26T10:43:42.323 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:42.323 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:42.323 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:42.323 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:42.323 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.323 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:42.324 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:42.324 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.324 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.324 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.324 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:42.324 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:42.324 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.324 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.324 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.324 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:42.324 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:42.324 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.324 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.324 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.324 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:42.325 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:42.325 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:42.325 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.325 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.325 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:42.325 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:42.325 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:42.325 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.325 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.325 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.325 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:42.325 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:42.325 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.325 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.325 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:42.326 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:42.326 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:42.326 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.326 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.326 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:42.326 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:42.326 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:42.326 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.326 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.326 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:42.326 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:42.326 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:42.326 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.326 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:42.326 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.327 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.327 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.327 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:42.327 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:42.327 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 76.209123253000001, 2024-04-26T10:43:42.327 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:42.327 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:42.327 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:42.327 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:42.327 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.327 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:42.327 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:42.327 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.327 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.328 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.328 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:42.328 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:42.328 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.328 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.328 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.328 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:42.328 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:42.328 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.328 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.328 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.328 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:42.328 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:42.328 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:42.328 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.329 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.329 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:42.329 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:42.329 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:42.329 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.329 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.329 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.329 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:42.329 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:42.329 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.329 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.329 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:42.329 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:42.329 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:42.329 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.330 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.330 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:42.330 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:42.330 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:42.330 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.330 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.330 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:42.330 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:42.330 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:42.330 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.330 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:42.330 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.330 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.330 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.331 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:42.331 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:42.331 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 76.209047467999994, 2024-04-26T10:43:42.331 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:42.331 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:42.331 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:42.331 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:42.331 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.331 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:42.331 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:42.331 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.331 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.331 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.331 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:42.331 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:42.332 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.332 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.332 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.332 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:42.332 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:42.332 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.332 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.332 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.332 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:42.332 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:42.332 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:42.332 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.332 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.332 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:42.332 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:42.333 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:42.333 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.333 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.333 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.333 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:42.333 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:42.333 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.333 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.333 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:42.333 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:42.333 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:42.333 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.333 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.333 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:42.333 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:42.334 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:42.334 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.334 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.334 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:42.334 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:42.334 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:42.334 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.334 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:42.334 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.334 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.334 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.334 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:42.334 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:42.335 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 76.208833773999999, 2024-04-26T10:43:42.335 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:42.335 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:42.335 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:42.335 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:42.335 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.335 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:42.335 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:42.335 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.335 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.335 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.335 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:42.335 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:42.335 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.335 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.336 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.336 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:42.336 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:42.336 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.336 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.336 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.336 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:42.336 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:42.336 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:42.336 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.336 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.336 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:42.336 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:42.336 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:42.336 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.337 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.337 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.337 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:42.337 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:42.337 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.337 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.337 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:42.337 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:42.337 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:42.337 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.337 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.337 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:42.337 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:42.337 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:42.337 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.338 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:42.338 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.338 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.338 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.338 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:42.338 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:42.338 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 76.206389960999999, 2024-04-26T10:43:42.338 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:42.338 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:42.338 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:42.338 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:42.338 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.338 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:42.338 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:42.339 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.339 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.339 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.339 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:42.339 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:42.339 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.339 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.339 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.339 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:42.339 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:42.339 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:42.339 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.339 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.339 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:42.340 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:42.340 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:42.340 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.340 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.340 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:42.340 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:42.340 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:42.340 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.340 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.340 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.340 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:42.340 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:42.340 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.340 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.340 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:42.341 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:42.341 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:42.341 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.341 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.341 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:42.341 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:42.341 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:42.341 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.341 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.341 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:42.341 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:42.341 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:42.341 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.341 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:42.341 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.342 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.342 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.342 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:42.342 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:42.342 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 70.756327517000003, 2024-04-26T10:43:42.342 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:42.342 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:42.342 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.342 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:42.342 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.342 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:42.342 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:42.342 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.342 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.343 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.343 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:42.343 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:42.343 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:42.343 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.343 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.343 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:42.343 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:42.343 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:42.343 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.343 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.343 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:42.343 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:42.343 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:42.343 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.344 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.344 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:42.344 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:42.344 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:42.344 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.344 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.344 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.344 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:42.344 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:42.344 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.344 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.344 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:42.344 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:42.344 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:42.345 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.345 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.345 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:42.345 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:42.345 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:42.345 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.345 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.345 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:42.345 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:42.345 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:42.345 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.345 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.345 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:42.345 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:42.345 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:42.346 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.346 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.346 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:42.346 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:42.346 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:42.346 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.346 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.346 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:42.346 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:42.346 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:42.346 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:42.346 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:42.346 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:42.346 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:42.346 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:42.347 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.347 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:42.347 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.347 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:42.347 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:42.347 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:42.347 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:43:42.349 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:42.347+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:42.349 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:42.450 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:42.448+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:42.464 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:42.465 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:42.465 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:42.465 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:42.474 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:42.551 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:42.550+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:42.580 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:42.580 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:42.580 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:42.580 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:42.580 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:42.588 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:42.652 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:42.651+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:42.696 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:42.696 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:42.696 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:42.696 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:42.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.696 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:42.696 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:42.696 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 76.658015214000002, 2024-04-26T10:43:42.696 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:42.698 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:42.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.699 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.699 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:42.699 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:42.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.699 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:42.699 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:42.699 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:42.700 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 76.656265093000002, 2024-04-26T10:43:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.701 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:42.702 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:42.702 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.702 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:42.702 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:42.702 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.702 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:42.702 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:42.702 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:42.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:42.703 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:42.704 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:42.705 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 76.656212095000001, 2024-04-26T10:43:42.706 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:42.710 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:42.711 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 76.656134351000006, 2024-04-26T10:43:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:42.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:42.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.714 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.715 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:42.716 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.718 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:42.718 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:42.718 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 76.656095344999997, 2024-04-26T10:43:42.718 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:42.718 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:42.718 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.718 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:42.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.718 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:42.718 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:42.718 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:42.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:42.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:42.721 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:42.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 76.656076523999999, 2024-04-26T10:43:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:42.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.724 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:42.724 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:42.724 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.724 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.724 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:42.724 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:42.724 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:42.725 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:42.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:42.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.726 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.726 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:42.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:42.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.726 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:42.726 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:42.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:42.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:42.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:42.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:42.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:42.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:42.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:42.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:42.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:42.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:42.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:42.728 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 76.656044522000002, 2024-04-26T10:43:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:42.729 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.730 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 76.655835714000006, 2024-04-26T10:43:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:42.734 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:42.738 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 76.655804423000006, 2024-04-26T10:43:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.740 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:42.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.743 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 76.655777173000004, 2024-04-26T10:43:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:42.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.745 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:42.746 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:42.746 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:42.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.746 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.746 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:42.746 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:42.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.746 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:42.746 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:42.746 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:42.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.747 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 76.653000422000005, 2024-04-26T10:43:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:42.748 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:42.749 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 76.652950333000007, 2024-04-26T10:43:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:42.751 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:42.752 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.753 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.754 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:42.755 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 76.652058264000004, 2024-04-26T10:43:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:42.757 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.758 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:42.759 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:42.759 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:42.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.759 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:42.759 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:42.759 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:42.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.759 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:42.759 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:42.759 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:42.759 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.759 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:42.760 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.760 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:42.760 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:42.760 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 76.649869934999998, 2024-04-26T10:43:42.760 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:42.760 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:42.760 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.760 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:42.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.760 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:42.760 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:42.760 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:42.761 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.762 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 76.649734565000003, 2024-04-26T10:43:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:42.764 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:42.765 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.766 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 76.649519991000005, 2024-04-26T10:43:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 76.649181049999996, 2024-04-26T10:43:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 76.649071672999995, 2024-04-26T10:43:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 76.649031953999994, 2024-04-26T10:43:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 76.648694421000002, 2024-04-26T10:43:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:42.789 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:42.790 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:42.791 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:42.789+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:42.879 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:43:42.891 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:42.889+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:42.897 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:42.898 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:42.898 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:42.898 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:42.905 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:42.992 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:42.990+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:43.005 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:43.006 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:43.006 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:43:43.024 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:43.024 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:43.027 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:43:43.027 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:43:43.047 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:43.048 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:43.057 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:43.092 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:43.092+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:43.193 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:43.192+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:43.200 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:43.200 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:43.209 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:43.256 INFO:teuthology.orchestra.run.smithi049.stderr:nodeep-scrub is unset 2024-04-26T10:43:43.294 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:43.293+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:43.322 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:43.322 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:43.331 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:43.345 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T10:43:43.395 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:43.393+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:43.456 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2024-04-26T10:43:43.477 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:43.477 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:43.485 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:43.530 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:43.529+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:43.557 INFO:teuthology.orchestra.console.smithi087:Power on completed 2024-04-26T10:43:43.591 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:43.591 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:43.596 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:43.594+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:43.600 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:43.659 DEBUG:teuthology.orchestra.console.smithi087:Waiting for login prompt 2024-04-26T10:43:43.659 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi087 2024-04-26T10:43:43.698 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:43.697+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:43.703 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:43.703 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:43.712 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:43.798 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:43.798+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:43.815 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:43.815 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:43.824 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:43.899 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:43.898+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:43.925 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:43.925 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:43.935 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:44.000 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:43.999+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:44.046 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:44.047 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:44.056 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:44.101 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:44.100+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:44.161 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:44.162 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:44.170 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:44.202 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:44.201+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:44.277 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:44.277 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:44.286 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:44.330 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:44.329+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:44.392 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:44.392 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:44.401 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:44.443 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:44.441+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:44.507 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:44.507+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:44.543 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:44.543 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:44.552 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:44.608 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:44.606+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:44.653 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:44.653 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:44.661 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:44.710 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:44.708+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:44.772 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:44.772 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:44.781 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:44.826 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:44.825+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:44.887 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:44.887 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:44.895 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:44.911 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:44.910+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:45.013 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:45.011+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:45.028 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:43:45.042 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:45.042 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:45.051 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:45.113 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:45.112+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:45.156 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:45.156 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:45.165 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:45.213 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:45.214 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:45.214 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:43:45.240 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:45.240 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:45.243 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:43:45.243 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:43:45.249 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:45.248+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:45.275 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:43:45.307 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:45.308 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:45.308 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:45.308 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:45.308 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:45.315 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:45.313+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:45.316 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:45.416 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:45.415+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:45.459 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:45.459 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:45.459 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:45.459 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:45.459 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.460 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:45.460 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:45.460 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 79.420805229999999, 2024-04-26T10:43:45.460 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:45.460 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:45.460 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:45.460 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:45.460 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.460 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:45.460 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:45.460 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.460 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.460 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.460 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:45.460 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:45.461 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.461 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.461 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.461 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:45.461 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:45.461 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:45.461 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.461 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.461 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:45.461 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:45.461 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:45.461 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.461 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.461 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:45.461 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:45.462 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:45.462 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.462 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.462 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.462 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:45.462 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:45.462 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.462 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.462 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:45.462 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:45.462 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:45.462 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.462 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.462 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:45.463 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:45.463 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:45.463 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.463 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.463 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:45.463 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:45.463 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:45.463 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.463 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.463 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:45.463 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:45.463 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:45.463 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.463 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:45.464 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.464 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.464 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.464 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:45.464 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:45.464 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 79.41993445, 2024-04-26T10:43:45.464 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:45.464 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:45.464 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:45.464 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:45.464 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.464 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:45.464 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:45.464 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.464 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.465 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.465 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:45.465 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:45.465 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.465 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.465 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.465 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:45.465 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:45.465 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:45.465 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.465 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.465 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:45.465 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:45.465 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:45.465 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.466 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.466 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:45.466 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:45.466 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:45.466 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.466 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.466 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.466 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:45.466 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:45.466 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.466 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.466 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:45.466 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:45.466 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:45.467 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.467 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.467 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:45.467 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:45.467 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:45.467 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.467 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.467 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:45.467 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:45.467 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:45.467 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.467 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.467 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:45.467 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:45.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:45.468 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.468 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:45.468 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.468 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.468 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.468 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:45.468 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:45.468 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 79.418947106999994, 2024-04-26T10:43:45.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:45.468 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:45.468 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:45.468 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:45.468 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.468 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:45.469 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:45.469 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.469 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:45.469 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:45.469 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.469 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:45.469 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:45.469 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:45.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.470 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:45.470 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:45.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:45.470 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.470 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.470 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:45.470 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:45.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:45.470 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.470 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.470 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.470 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:45.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:45.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:45.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:45.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:45.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:45.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:45.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:45.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:45.472 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:45.472 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:45.472 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.472 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.472 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:45.472 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:45.472 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:45.472 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.472 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:45.472 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.472 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.472 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.472 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:45.473 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:45.473 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 79.418741842000003, 2024-04-26T10:43:45.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:45.473 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:45.473 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:45.473 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:45.473 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.473 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:45.473 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:45.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.473 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.473 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:45.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:45.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:45.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:45.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:45.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:45.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:45.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:45.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.475 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:45.475 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:45.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:45.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.475 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.475 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:45.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:45.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.476 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:45.476 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:45.476 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:45.476 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.476 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.476 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:45.476 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:45.476 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:45.476 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.476 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.476 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:45.476 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:45.476 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:45.477 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.477 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.477 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:45.477 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:45.477 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:45.477 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.477 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:45.477 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.477 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.477 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.477 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:45.477 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:45.477 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 79.418420963000003, 2024-04-26T10:43:45.477 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:45.478 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:45.478 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:45.478 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:45.478 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.478 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:45.478 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:45.478 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.478 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.478 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.478 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:45.478 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:45.478 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.479 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.479 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.479 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:45.479 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:45.479 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:45.479 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.479 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.479 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:45.479 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:45.479 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:45.479 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.479 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.479 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:45.479 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:45.479 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:45.479 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.480 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.480 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.480 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:45.480 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:45.480 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.480 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.480 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:45.480 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:45.480 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:45.480 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.480 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.480 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:45.480 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:45.480 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:45.481 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.481 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.481 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:45.481 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:45.481 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:45.481 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.481 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.481 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:45.481 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:45.481 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:45.481 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.481 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.481 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:45.481 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:45.481 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:45.481 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.482 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.482 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:45.482 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:45.482 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:45.482 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.482 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.482 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:45.482 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:45.482 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:45.482 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.482 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:45.482 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.482 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.482 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.483 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:45.483 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:45.483 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 79.418369139000006, 2024-04-26T10:43:45.483 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:45.483 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:45.483 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:45.483 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:45.483 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.483 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:45.483 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:45.483 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.483 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.483 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.483 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:45.483 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:45.484 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.484 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.484 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.484 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:45.484 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:45.484 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:45.484 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.484 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.484 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:45.484 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:45.484 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:45.484 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.484 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.484 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:45.484 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:45.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:45.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.485 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.485 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.485 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:45.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:45.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.485 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.485 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:45.485 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:45.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:45.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.485 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.485 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:45.486 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:45.486 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:45.486 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.486 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.486 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:45.486 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:45.486 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:45.486 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.486 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.486 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:45.486 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:45.486 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:45.486 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.486 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.487 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:45.487 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:45.487 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:45.487 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.487 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.487 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:45.487 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:45.487 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:45.487 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.487 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.487 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:45.487 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:45.487 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:45.487 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.488 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:45.488 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.488 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.488 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.488 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:45.488 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:45.488 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 79.418315766999996, 2024-04-26T10:43:45.488 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:45.488 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:45.488 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:45.488 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:45.488 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.488 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:45.488 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:45.488 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.489 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.489 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.489 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:45.489 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:45.489 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.489 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.489 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.489 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:45.489 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:45.489 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:45.489 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.489 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.489 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:45.489 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:45.489 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:45.490 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.490 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.490 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:45.490 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:45.490 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:45.490 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.490 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.490 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.490 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:45.490 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:45.490 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.490 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.490 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:45.490 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:45.491 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:45.491 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.491 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.491 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:45.491 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:45.491 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:45.491 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.491 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.491 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:45.491 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:45.491 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:45.491 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.491 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.491 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:45.492 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:45.492 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:45.492 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.492 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.492 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:45.492 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:45.492 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:45.492 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.492 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.492 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:45.492 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:45.492 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:45.492 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.492 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.492 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:45.493 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:45.493 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:45.493 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.493 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:45.493 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.493 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.493 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.493 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:45.493 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:45.493 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 79.418271439999998, 2024-04-26T10:43:45.493 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:45.493 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:45.493 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:45.493 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:45.493 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.494 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:45.494 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:45.494 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.494 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.494 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.494 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:45.494 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:45.494 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.494 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.494 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.494 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:45.494 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:45.494 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:45.494 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.495 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.495 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:45.495 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:45.495 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:45.495 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.495 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.495 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:45.495 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:45.495 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:45.495 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.495 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.495 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.495 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:45.495 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:45.495 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.496 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.496 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:45.496 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:45.496 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:45.496 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.496 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.496 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:45.496 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:45.496 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:45.496 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.496 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.496 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:45.496 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:45.496 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:45.496 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.496 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.497 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:45.497 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:45.497 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:45.497 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.497 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.497 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:45.497 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:45.497 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:45.497 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.497 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.497 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:45.497 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:45.497 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:45.497 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.498 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.498 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:45.498 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:45.498 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:45.498 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.498 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:45.498 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.498 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.498 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.498 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:45.498 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:45.499 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 79.418247726999994, 2024-04-26T10:43:45.499 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:45.499 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:45.499 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:45.499 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:45.499 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.499 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:45.499 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:45.499 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.500 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.500 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.500 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:45.500 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:45.500 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.500 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.500 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.500 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:45.500 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:45.500 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:45.500 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.501 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.501 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:45.501 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:45.501 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:45.501 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.501 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.501 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:45.501 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:45.501 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:45.501 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.502 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.502 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.502 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:45.502 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:45.502 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.502 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.502 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:45.502 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:45.502 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:45.502 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.502 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.503 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:45.503 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:45.503 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:45.503 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.503 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.503 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:45.503 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:45.503 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:45.503 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.503 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.503 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:45.504 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:45.504 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:45.504 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.504 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.504 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:45.504 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:45.504 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:45.504 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.504 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.504 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:45.504 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:45.504 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:45.504 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.504 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.505 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:45.505 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:45.505 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:45.505 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.505 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:45.505 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.505 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.505 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.505 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:45.505 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:45.505 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 79.418213421999994, 2024-04-26T10:43:45.505 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:45.505 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:45.505 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:45.506 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:45.506 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.506 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:45.506 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:45.506 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.506 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.506 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.506 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:45.506 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:45.506 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.506 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.506 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.506 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:45.506 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:45.506 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:45.507 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.507 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.507 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:45.507 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:45.507 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:45.507 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.507 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.507 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:45.507 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:45.507 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:45.507 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.507 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.507 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.508 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:45.508 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:45.508 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.508 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.508 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:45.508 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:45.508 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:45.508 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.508 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.508 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:45.508 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:45.508 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:45.508 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.508 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.509 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:45.509 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:45.509 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:45.509 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.509 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.509 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:45.509 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:45.509 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:45.509 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.509 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.509 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:45.509 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:45.509 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:45.509 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.509 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.510 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:45.510 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:45.510 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:45.510 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.510 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.510 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:45.510 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:45.510 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:45.510 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.510 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:45.510 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.510 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.510 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.511 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:45.511 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:45.511 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 79.417876825999997, 2024-04-26T10:43:45.511 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:45.511 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:45.511 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:45.511 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:45.511 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.511 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:45.511 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:45.511 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.511 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.511 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.511 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:45.511 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:45.512 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.512 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.512 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:45.512 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:45.512 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:45.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.512 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.512 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:45.512 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:45.512 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:45.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.512 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.512 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:45.513 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:45.513 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:45.513 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.513 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.513 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.513 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:45.513 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:45.513 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.513 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.513 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:45.513 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:45.513 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:45.513 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.514 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.514 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:45.514 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:45.514 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:45.514 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.514 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.514 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:45.514 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:45.515 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:45.515 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.515 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:45.515 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.515 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.515 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.515 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:45.515 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:45.515 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 79.417834798000001, 2024-04-26T10:43:45.515 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:45.515 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:45.515 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:45.515 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:45.515 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.516 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:45.516 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:45.516 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.516 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.516 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.516 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:45.516 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:45.516 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.516 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.516 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.516 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:45.516 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:45.516 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:45.517 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.517 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.517 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:45.517 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:45.517 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:45.517 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.517 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.517 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:45.517 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:45.517 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:45.517 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.517 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.517 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.517 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:45.517 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:45.518 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.518 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.518 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:45.518 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:45.518 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:45.518 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.518 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.518 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:45.518 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:45.518 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:45.518 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.518 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.518 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:45.519 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:45.519 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:45.519 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.519 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:45.519 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.519 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.519 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.519 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:45.519 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:45.519 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 79.417781625999993, 2024-04-26T10:43:45.519 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:45.519 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:45.519 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:45.519 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:45.519 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.520 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:45.520 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:45.520 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.520 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.520 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.520 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:45.520 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:45.520 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.520 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.520 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.520 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:45.520 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:45.520 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:45.520 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.520 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.521 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:45.521 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:45.521 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:45.521 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.521 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.521 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:45.521 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:45.521 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:45.521 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.521 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.521 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.521 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:45.521 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:45.521 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.521 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.522 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:45.522 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:45.522 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:45.522 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.522 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.522 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:45.522 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:45.522 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:45.522 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.522 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.522 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:45.522 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:45.522 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:45.522 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.523 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:45.523 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.523 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.523 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.523 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:45.523 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:45.523 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 79.414375215999996, 2024-04-26T10:43:45.523 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:45.523 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:45.523 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:45.523 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:45.523 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.523 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:45.523 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:45.523 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.524 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.524 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.524 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:45.524 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:45.524 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.524 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.524 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.524 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:45.524 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:45.524 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:45.524 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.524 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.524 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:45.524 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:45.524 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:45.525 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.525 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.525 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:45.525 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:45.525 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:45.525 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.525 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.525 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.525 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:45.525 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:45.525 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.525 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.525 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:45.525 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:45.525 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:45.526 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.526 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.526 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:45.526 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:45.526 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:45.526 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.526 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:45.526 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.526 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.526 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.526 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:45.526 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:45.526 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 79.411903262999999, 2024-04-26T10:43:45.526 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:45.526 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:45.527 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:45.527 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:45.527 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.527 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:45.527 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:45.527 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.527 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.527 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.527 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:45.527 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:45.527 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.527 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.527 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.527 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:45.527 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:45.528 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:45.528 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.528 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.528 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:45.528 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:45.528 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:45.528 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.528 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.528 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:45.528 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:45.528 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:45.528 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.528 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.528 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.528 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:45.529 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:45.529 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.529 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.529 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:45.529 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:45.529 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:45.529 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.529 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.529 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:45.529 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:45.529 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:45.529 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.529 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.529 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:45.530 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:45.530 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:45.530 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.530 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:45.530 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.530 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.530 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.530 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:45.530 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:45.530 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 79.411249705000003, 2024-04-26T10:43:45.530 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:45.530 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:45.530 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:45.530 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:45.531 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.531 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:45.531 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:45.531 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.531 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.531 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.531 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:45.531 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:45.531 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.531 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.531 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.531 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:45.531 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:45.531 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:45.531 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.531 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.532 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:45.532 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:45.532 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:45.532 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.532 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.532 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:45.532 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:45.532 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:45.532 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.532 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.532 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.532 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:45.532 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:45.532 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.532 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.533 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:45.533 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:45.533 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:45.533 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.533 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.533 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:45.533 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:45.533 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:45.533 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.533 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.533 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:45.533 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:45.533 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:45.533 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.533 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:45.534 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.534 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.534 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:45.534 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:45.534 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 79.411173919999996, 2024-04-26T10:43:45.534 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:45.534 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:45.534 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:45.534 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:45.534 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.534 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:45.534 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:45.534 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.535 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.535 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:45.535 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:45.535 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.535 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.535 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:45.535 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:45.535 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:45.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.535 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.535 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:45.535 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:45.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:45.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.536 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.536 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:45.536 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:45.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:45.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.536 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.536 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.536 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:45.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:45.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.536 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.536 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:45.537 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:45.537 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:45.537 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.537 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.537 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:45.537 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:45.537 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:45.537 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.537 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.537 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:45.537 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:45.537 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:45.537 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.537 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:45.538 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.538 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.538 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.538 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:45.538 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:45.538 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 79.410960226, 2024-04-26T10:43:45.538 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:45.538 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:45.538 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:45.538 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:45.538 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.538 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:45.538 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:45.538 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.539 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.539 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.539 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:45.539 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:45.539 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.539 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.539 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.539 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:45.539 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:45.539 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:45.539 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.539 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.539 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:45.539 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:45.539 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:45.540 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.540 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.540 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:45.540 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:45.540 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:45.540 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.540 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.540 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.540 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:45.540 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:45.540 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.540 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.540 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:45.540 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:45.540 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:45.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.541 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:45.541 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:45.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:45.541 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.541 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:45.541 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.541 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:45.541 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:45.541 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 79.408516413000001, 2024-04-26T10:43:45.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:45.541 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:45.542 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:45.542 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:45.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.542 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:45.542 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:45.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.542 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.542 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:45.542 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:45.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.542 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.542 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:45.543 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:45.543 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:45.543 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.543 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.543 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:45.543 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:45.543 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:45.543 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.543 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.543 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:45.543 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:45.543 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:45.543 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.543 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:45.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:45.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:45.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:45.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:45.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:45.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:45.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:45.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.545 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:45.545 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:45.545 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:45.545 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.545 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:45.545 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.545 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.545 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:45.545 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:45.545 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 73.958453969000004, 2024-04-26T10:43:45.545 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:45.545 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:45.545 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:45.546 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:45.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.546 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:45.546 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:45.546 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.546 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:45.546 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:45.546 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:45.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:45.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:45.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:45.547 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:45.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:45.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:45.547 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:45.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:45.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:45.547 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.548 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.548 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:45.548 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:45.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.548 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.548 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:45.548 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:45.548 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:45.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.548 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.548 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:45.548 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:45.548 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:45.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.549 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:45.549 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:45.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:45.549 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.549 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:45.549 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:45.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:45.549 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.549 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:45.549 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:45.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:45.550 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:45.550 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:45.550 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:45.550 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:45.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:45.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:45.550 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:45.550 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:45.550 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.550 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:45.550 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.550 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:45.550 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:45.551 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:45.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~29s 2024-04-26T10:43:45.552 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:45.551+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:45.553 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:45.653 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:45.651+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:45.664 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:45.664 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:45.664 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:45.664 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:45.673 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:45.753 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:45.753+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:45.778 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:45.779 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:45.779 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:45.779 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:45.779 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:45.787 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:45.872 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:45.871+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:45.936 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 79.897934336000006, 2024-04-26T10:43:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 79.896184215000005, 2024-04-26T10:43:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 79.896131217000004, 2024-04-26T10:43:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:45.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:45.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:45.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:45.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:45.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:45.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:45.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 79.896053472999995, 2024-04-26T10:43:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:45.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:45.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:45.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:45.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:45.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 79.896014467000001, 2024-04-26T10:43:45.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:45.960 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:45.960 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:45.960 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:45.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:45.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:45.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:45.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:45.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:45.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:45.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:45.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:45.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:45.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:45.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:45.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:45.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:45.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:45.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:45.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:45.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:45.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:45.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:45.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:45.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:45.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:45.968 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:45.968 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:45.968 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:45.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.968 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:45.969 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:45.969 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 79.895995646000003, 2024-04-26T10:43:45.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:45.969 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:45.970 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:45.970 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:45.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:45.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:45.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:45.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 79.895963644000005, 2024-04-26T10:43:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:45.981 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:45.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.981 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.981 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:45.982 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:45.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.982 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:45.982 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:45.982 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:45.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.982 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:45.983 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:45.983 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:45.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.983 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:45.983 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:45.983 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:45.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.983 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:45.984 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:45.984 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:45.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.984 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:45.984 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:45.984 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:45.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.984 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:45.984 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:45.984 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:45.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.985 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:45.985 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:45.985 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:45.985 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:45.985 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:45.985 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:45.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.985 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:45.985 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:45.985 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 79.895754835999995, 2024-04-26T10:43:45.985 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:45.985 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:45.985 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:45.985 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:45.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.986 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:45.986 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:45.986 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:45.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.986 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:45.986 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:45.986 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:45.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.986 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:45.986 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:45.986 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:45.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.987 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:45.987 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:45.987 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:45.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.987 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:45.987 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:45.987 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:45.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.987 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.987 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:45.988 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:45.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.988 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:45.988 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:45.988 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:45.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.988 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:45.988 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:45.988 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:45.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.988 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:45.988 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:45.989 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:45.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.989 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:45.989 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:45.989 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:45.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.989 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:45.989 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:45.989 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:45.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.990 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:45.990 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:45.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:45.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.990 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:45.990 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:45.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:45.990 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:45.990 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:45.990 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:45.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.990 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:45.991 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:45.991 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 79.895723544999996, 2024-04-26T10:43:45.991 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:45.991 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:45.991 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:45.991 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:45.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.991 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:45.991 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:45.991 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:45.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.991 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:45.991 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:45.992 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:45.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.992 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:45.992 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:45.992 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:45.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.992 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:45.992 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:45.992 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:45.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.992 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.993 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:45.994 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 79.895696294999993, 2024-04-26T10:43:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:45.995 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:45.996 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:45.997 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:45.998 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 79.892919543999994, 2024-04-26T10:43:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.000 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.000 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:46.000 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.000 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.000 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:46.000 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:46.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:46.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 79.892869454999996, 2024-04-26T10:43:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:46.002 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:46.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.005 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.005 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.005 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:46.005 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:46.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.005 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.005 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.005 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:46.005 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:46.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.005 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.005 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.005 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:46.005 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.007 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:46.007 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:46.007 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 79.891977385999994, 2024-04-26T10:43:46.007 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:46.007 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.007 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.007 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.007 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.007 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:46.007 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.008 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.008 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:46.008 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.008 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.008 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.008 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:46.008 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.008 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.008 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.008 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:46.008 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:46.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.009 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.009 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.009 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:46.009 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:46.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.009 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.009 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.009 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:46.009 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:46.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.009 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.009 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.009 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:46.009 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:46.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.010 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.010 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.010 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:46.010 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:46.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.010 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.010 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.010 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:46.010 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:46.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.010 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.010 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.010 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:46.011 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:46.011 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.011 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.011 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.011 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.011 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.011 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:46.011 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:46.011 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 79.889789057000002, 2024-04-26T10:43:46.011 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:46.011 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.011 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.011 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.011 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.012 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.012 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:46.012 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.012 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.012 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.012 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.012 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:46.012 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.012 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.012 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.012 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.012 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:46.012 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.012 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.013 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.013 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.013 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:46.013 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:46.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.013 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.013 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.013 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:46.013 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:46.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.013 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.013 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.013 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:46.013 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:46.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.014 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.014 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.014 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:46.014 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:46.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.014 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.014 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.014 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:46.014 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:46.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.014 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.014 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.014 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:46.015 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:46.015 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.015 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.015 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.015 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:46.015 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:46.015 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.015 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.015 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.015 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.015 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.015 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:46.015 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:46.015 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 79.889653687000006, 2024-04-26T10:43:46.016 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:46.016 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.016 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.016 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.016 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.016 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:46.016 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.016 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.016 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:46.016 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.017 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.017 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:46.017 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.017 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.017 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:46.017 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:46.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.017 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:46.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:46.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:46.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:46.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:46.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:46.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.019 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.019 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:46.019 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:46.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.019 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.019 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:46.019 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:46.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.019 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.019 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:46.019 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:46.019 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.020 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.020 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.020 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:46.020 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:46.020 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 79.889439112999995, 2024-04-26T10:43:46.020 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:46.020 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.020 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.020 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.020 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.020 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:46.020 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.021 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.021 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:46.021 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.021 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.021 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:46.021 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.021 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.021 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:46.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:46.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.022 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.022 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:46.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:46.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.022 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.022 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:46.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:46.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.022 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.023 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:46.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:46.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.023 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:46.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:46.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.023 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:46.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:46.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.024 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.024 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:46.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:46.024 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.024 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.024 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.024 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:46.024 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:46.024 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 79.889100171999999, 2024-04-26T10:43:46.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:46.025 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.025 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.025 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.025 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.025 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:46.025 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.025 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.025 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:46.025 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.026 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.026 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:46.026 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.026 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.026 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:46.026 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:46.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.026 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.026 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:46.026 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:46.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:46.027 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:46.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:46.027 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:46.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:46.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:46.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.028 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.028 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:46.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:46.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.028 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.028 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:46.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:46.028 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.028 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.029 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.029 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:46.029 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:46.029 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 79.888990794999998, 2024-04-26T10:43:46.029 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:46.029 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.029 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:46.029 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.029 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.029 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:46.030 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.030 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.030 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:46.030 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.030 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.030 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:46.030 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:46.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.031 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.031 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:46.031 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:46.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.031 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.031 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.031 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:46.031 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:46.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.031 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.031 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.031 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:46.031 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:46.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.032 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.032 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:46.032 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:46.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.032 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.032 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:46.032 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:46.032 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.032 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.032 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.033 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:46.033 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:46.033 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 79.888951075999998, 2024-04-26T10:43:46.033 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:46.033 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.033 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.033 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.033 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.033 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:46.033 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.034 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.034 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:46.034 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.034 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.034 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:46.034 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:46.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.034 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.034 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:46.034 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:46.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.035 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.035 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:46.035 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:46.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.035 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.035 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:46.035 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:46.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.036 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.036 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.036 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:46.036 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:46.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.036 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.036 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.036 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:46.036 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:46.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.036 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.036 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.036 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:46.036 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:46.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.037 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.037 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:46.037 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:46.037 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.037 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.037 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.037 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:46.037 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:46.037 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 79.888613543000005, 2024-04-26T10:43:46.037 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:46.037 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.038 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.038 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.038 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.038 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:46.038 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.038 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.038 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:46.038 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.039 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.039 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:46.039 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.039 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.039 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:46.039 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:46.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.039 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.039 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:46.039 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:46.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.040 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.040 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:46.040 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:46.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.040 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.040 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:46.040 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:46.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.040 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.040 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:46.040 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:46.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.041 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.041 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:46.041 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:46.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.041 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.041 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:46.041 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:46.041 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.041 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.041 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.041 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.041 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.041 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:46.043 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:46.041+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:46.043 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:46.144 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:46.143+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:46.146 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:46.146 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:46.146 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:46.146 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:46.155 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:46.245 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:46.245+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:46.263 INFO:teuthology.orchestra.run.smithi049.stderr:noscrub is set 2024-04-26T10:43:46.298 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:46.298 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:46.298 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:46.298 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:46.298 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:46.306 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:46.346 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:46.345+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:46.409 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:46.409 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:46.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:46.410 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:46.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.410 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:46.410 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:46.410 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 80.370868243000004, 2024-04-26T10:43:46.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:46.410 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:46.410 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.410 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:46.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.410 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:46.410 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:46.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:46.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:46.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:46.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:46.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:46.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:46.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:46.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:46.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:46.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:46.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:46.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:46.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:46.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:46.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:46.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:46.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:46.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:46.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:46.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:46.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:46.414 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.414 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:46.414 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:46.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:46.414 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.414 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:46.414 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.414 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.414 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:46.414 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:46.415 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 80.369997463000004, 2024-04-26T10:43:46.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:46.415 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:46.415 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.415 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:46.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:46.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:46.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:46.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:46.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:46.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:46.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:46.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:46.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:46.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:46.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:46.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:46.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:46.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:46.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:46.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:46.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:46.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:46.418 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:46.418 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:46.418 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.418 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.418 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:46.418 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:46.418 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:46.418 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.418 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.418 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:46.418 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:46.418 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:46.418 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.420 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:46.420 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.420 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:46.420 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:46.420 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 80.369010119999999, 2024-04-26T10:43:46.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:46.420 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:46.421 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.421 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:46.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:46.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:46.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:46.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:46.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:46.422 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:46.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:46.422 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.422 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.422 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:46.422 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:46.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:46.422 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.422 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.422 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:46.422 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:46.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:46.422 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.422 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.422 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:46.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:46.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:46.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:46.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:46.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:46.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:46.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:46.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:46.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:46.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:46.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:46.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:46.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:46.424 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.424 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:46.424 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.424 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:46.424 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:46.425 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 80.368804854999993, 2024-04-26T10:43:46.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:46.425 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:46.425 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.425 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:46.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:46.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:46.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:46.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:46.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:46.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:46.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:46.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:46.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:46.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:46.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:46.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:46.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.427 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:46.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:46.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.427 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:46.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:46.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:46.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:46.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:46.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:46.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:46.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:46.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:46.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:46.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:46.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:46.428 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.428 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:46.429 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.429 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.429 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:46.429 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:46.429 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 80.368483975999993, 2024-04-26T10:43:46.429 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:46.429 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:46.429 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.429 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:46.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.429 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:46.429 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:46.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:46.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:46.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:46.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:46.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:46.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:46.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:46.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:46.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:46.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:46.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:46.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:46.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:46.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.432 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:46.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:46.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:46.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.432 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:46.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:46.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:46.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.432 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:46.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:46.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:46.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.433 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:46.433 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:46.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:46.433 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.433 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:46.433 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:46.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:46.433 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.433 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:46.433 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:46.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:46.433 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.434 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:46.434 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:46.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:46.434 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.434 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:46.434 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.434 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.434 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:46.434 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:46.434 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 80.368432151999997, 2024-04-26T10:43:46.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:46.435 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:46.435 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.435 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:46.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:46.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:46.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:46.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:46.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:46.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:46.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:46.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:46.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:46.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:46.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:46.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:46.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.437 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:46.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:46.437 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.437 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:46.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:46.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:46.437 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.437 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:46.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:46.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:46.437 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.438 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:46.438 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:46.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:46.438 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.438 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:46.438 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:46.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:46.438 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.438 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:46.438 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:46.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:46.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:46.439 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:46.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:46.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:46.439 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:46.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:46.439 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.439 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:46.439 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.440 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:46.440 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:46.440 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 80.36837878, 2024-04-26T10:43:46.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:46.440 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:46.440 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.440 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:46.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:46.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:46.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:46.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:46.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:46.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:46.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.442 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.442 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:46.442 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:46.442 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:46.442 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.442 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.442 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:46.442 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:46.442 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:46.442 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.442 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.442 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.442 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:46.442 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:46.443 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.443 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.443 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:46.443 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:46.443 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:46.443 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.443 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.443 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:46.443 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:46.443 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:46.443 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.443 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.443 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:46.443 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:46.443 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:46.444 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.444 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.444 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:46.444 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:46.444 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:46.444 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.444 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.444 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:46.444 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:46.444 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:46.444 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.444 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.444 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:46.444 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:46.445 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:46.445 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.445 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.445 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:46.445 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:46.445 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:46.445 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.445 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:46.445 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.445 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.445 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.445 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:46.445 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:46.445 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 80.368334453000003, 2024-04-26T10:43:46.445 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:46.446 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:46.446 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.446 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:46.446 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.446 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:46.446 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:46.446 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.446 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.446 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.446 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:46.446 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:46.446 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.446 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.446 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.447 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:46.447 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:46.447 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:46.447 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.447 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.447 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:46.447 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:46.447 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:46.447 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.447 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.447 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:46.447 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:46.447 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:46.447 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.448 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.448 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.448 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:46.448 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:46.448 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.448 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.448 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:46.448 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:46.448 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:46.448 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.448 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.448 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:46.448 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:46.448 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:46.449 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.449 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.449 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:46.449 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:46.449 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:46.449 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.449 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.449 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:46.449 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:46.449 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:46.449 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.449 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.449 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:46.449 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:46.449 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:46.450 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.450 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.450 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:46.450 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:46.450 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:46.450 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.450 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.450 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:46.450 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:46.450 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:46.450 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.450 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:46.450 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.450 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.451 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.451 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:46.451 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:46.451 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 80.368310739999998, 2024-04-26T10:43:46.451 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:46.451 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:46.451 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.451 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:46.451 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.451 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:46.451 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:46.451 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.451 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.451 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.452 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:46.452 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:46.452 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.452 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.452 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.452 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:46.452 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:46.452 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.452 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.452 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.452 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:46.452 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:46.452 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:46.452 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.453 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.453 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:46.453 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:46.453 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:46.453 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.453 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.453 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.453 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:46.453 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:46.453 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.453 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.453 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:46.453 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:46.453 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:46.454 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.454 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.454 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:46.454 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:46.454 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:46.454 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.454 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.454 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:46.454 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:46.454 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:46.454 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.454 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.454 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:46.454 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:46.455 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:46.455 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.455 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.455 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:46.455 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:46.455 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:46.455 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.455 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.455 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:46.455 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:46.455 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:46.455 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.455 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.455 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:46.455 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:46.456 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:46.456 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.456 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:46.456 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.456 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.456 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.456 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:46.456 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:46.456 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 80.368276434999999, 2024-04-26T10:43:46.456 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:46.456 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:46.456 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.456 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:46.456 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.456 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:46.457 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:46.457 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.457 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.457 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.457 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:46.457 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:46.457 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.457 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.457 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.457 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:46.457 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:46.457 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.457 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.457 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.458 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:46.458 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:46.458 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:46.458 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.458 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.458 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:46.458 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:46.458 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:46.458 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.458 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.458 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.458 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:46.458 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:46.458 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.459 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.459 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:46.459 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:46.459 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:46.459 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.459 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.459 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:46.459 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:46.459 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:46.459 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.459 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.459 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:46.459 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:46.459 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:46.459 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.460 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.460 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:46.460 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:46.460 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:46.460 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.460 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.460 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:46.460 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:46.460 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:46.460 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.460 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.460 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:46.460 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:46.460 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:46.461 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.461 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.461 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:46.461 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:46.461 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:46.461 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.461 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:46.461 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.461 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.461 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.461 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:46.461 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:46.461 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 80.367939839000002, 2024-04-26T10:43:46.461 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:46.461 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:46.462 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:46.462 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:46.462 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.462 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:46.462 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:46.462 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.462 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.462 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.462 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:46.462 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:46.462 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.462 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.462 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.462 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:46.463 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:46.463 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:46.463 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.463 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.463 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:46.463 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:46.463 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:46.463 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.463 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.463 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:46.463 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:46.463 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:46.463 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.463 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.463 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.464 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:46.464 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:46.464 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.464 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.464 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:46.464 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:46.464 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:46.464 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.464 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.464 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:46.464 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:46.464 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:46.464 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.464 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.464 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:46.465 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:46.465 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:46.465 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.465 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:46.465 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.465 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.465 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.465 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:46.465 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:46.465 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 80.367897811000006, 2024-04-26T10:43:46.465 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:46.465 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:46.465 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:46.465 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:46.465 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.466 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:46.466 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:46.466 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.466 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.466 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.466 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:46.466 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:46.466 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.466 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.466 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.466 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:46.466 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:46.466 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.466 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.467 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.467 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:46.467 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:46.467 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:46.467 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.467 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.467 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:46.467 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:46.467 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:46.467 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.467 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.467 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.467 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:46.467 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:46.468 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.468 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.468 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:46.468 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:46.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:46.468 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.468 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.468 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:46.468 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:46.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:46.468 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.468 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.468 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:46.468 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:46.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:46.469 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.469 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:46.469 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.469 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:46.469 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:46.469 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 80.367844638999998, 2024-04-26T10:43:46.469 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:46.469 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:46.469 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:46.469 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:46.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.469 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:46.470 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:46.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.470 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.470 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.470 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:46.470 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:46.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.470 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.470 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.470 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:46.470 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:46.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.470 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.470 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.470 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:46.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:46.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:46.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:46.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:46.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:46.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:46.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:46.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.472 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:46.472 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:46.472 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:46.472 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.472 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.472 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:46.472 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:46.472 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:46.472 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.472 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.472 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:46.472 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:46.472 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:46.472 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.472 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:46.473 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.473 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.473 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.473 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:46.473 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:46.473 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 80.364438229000001, 2024-04-26T10:43:46.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:46.473 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:46.473 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:46.473 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:46.473 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.473 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:46.473 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:46.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:46.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:46.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:46.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:46.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:46.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:46.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:46.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.475 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:46.475 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:46.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:46.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.475 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.475 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:46.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:46.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.475 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:46.475 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:46.476 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:46.476 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.476 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.476 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:46.476 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:46.476 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:46.476 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.476 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:46.476 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.476 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.476 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.476 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:46.476 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:46.476 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 80.361966276000004, 2024-04-26T10:43:46.476 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:46.477 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:46.477 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:46.477 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:46.477 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.477 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:46.477 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:46.477 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.477 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.477 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.477 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:46.477 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:46.477 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.477 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.477 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.478 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:46.478 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:46.478 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.478 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.478 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.478 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:46.478 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:46.478 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:46.478 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.478 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.478 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:46.478 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:46.478 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:46.478 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.479 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.479 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.479 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:46.479 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:46.479 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.479 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.479 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:46.479 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:46.479 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:46.479 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.479 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.479 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:46.479 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:46.479 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:46.480 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.480 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.480 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:46.480 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:46.480 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:46.480 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.480 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:46.480 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.480 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.480 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.480 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:46.480 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:46.480 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 80.361312717999994, 2024-04-26T10:43:46.480 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:46.480 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:46.481 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:46.481 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:46.481 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.481 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:46.481 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:46.481 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.481 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.481 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.481 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:46.481 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:46.481 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.481 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.481 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.481 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:46.481 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:46.482 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.482 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.482 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.482 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:46.482 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:46.482 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:46.482 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.482 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.482 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:46.482 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:46.482 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:46.482 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.482 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.482 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.483 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:46.483 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:46.483 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.483 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.483 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:46.483 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:46.483 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:46.483 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.483 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.483 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:46.483 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:46.483 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:46.483 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.483 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.484 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:46.484 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:46.484 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:46.484 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.484 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:46.484 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.484 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.484 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.484 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:46.484 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:46.484 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 80.361236933000001, 2024-04-26T10:43:46.484 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:46.484 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:46.484 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:46.484 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:46.485 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.485 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:46.485 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:46.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.485 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.485 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:46.485 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:46.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.485 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.485 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:46.485 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:46.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.486 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.486 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:46.486 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:46.486 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:46.486 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.486 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.486 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:46.486 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:46.486 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:46.486 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.486 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.486 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.486 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:46.486 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:46.487 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.487 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.487 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:46.487 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:46.487 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:46.487 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.487 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.487 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:46.487 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:46.487 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:46.487 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.487 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.487 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:46.487 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:46.488 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:46.488 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.488 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:46.488 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.488 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.488 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.488 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:46.488 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:46.488 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 80.361023239000005, 2024-04-26T10:43:46.488 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:46.488 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:46.488 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:46.488 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:46.488 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.488 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.489 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:46.490 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:46.490 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:46.490 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.490 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.490 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:46.490 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:46.490 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:46.490 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.490 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.490 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.490 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:46.490 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:46.490 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.490 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.491 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 80.358579426000006, 2024-04-26T10:43:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:46.492 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.493 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.494 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.495 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:46.495 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:46.495 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:46.495 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.495 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.495 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:46.495 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:46.495 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:46.495 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.495 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:46.495 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.495 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.495 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.495 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:46.496 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:46.496 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 74.908516981999995, 2024-04-26T10:43:46.496 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:46.496 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:46.496 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.496 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:46.496 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.496 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:46.496 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:46.496 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.496 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.496 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.496 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:46.496 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:46.496 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:46.497 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.497 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.497 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:46.497 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:46.497 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:46.497 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.497 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.497 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:46.497 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:46.497 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:46.497 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.497 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.497 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:46.497 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:46.498 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:46.498 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.498 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.498 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.498 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:46.498 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:46.498 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.498 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.498 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:46.498 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:46.498 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:46.498 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.498 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.498 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:46.498 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:46.499 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:46.499 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.499 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.499 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:46.499 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:46.499 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:46.499 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.499 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.499 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:46.499 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:46.499 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:46.499 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.499 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.499 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:46.499 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:46.500 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:46.500 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.500 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.500 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:46.500 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:46.500 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:46.500 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:46.500 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:46.500 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:46.500 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:46.500 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:46.500 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.500 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:46.500 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.500 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:46.501 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:46.501 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:46.502 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:46.501+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:46.502 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:46.603 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:46.602+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:46.614 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:46.614 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:46.614 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:46.614 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:46.623 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:46.705 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:46.704+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:46.769 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:46.769 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:46.769 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:46.769 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:46.769 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:46.777 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:46.806 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:46.805+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:46.884 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:46.884 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:46.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 80.846643131999997, 2024-04-26T10:43:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:46.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:46.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:46.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:46.889 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 80.844893010999996, 2024-04-26T10:43:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:46.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:46.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:46.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:46.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:46.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:46.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:46.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:46.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:46.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:46.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 80.844840012999995, 2024-04-26T10:43:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:46.895 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:46.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:46.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:46.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 80.844762269, 2024-04-26T10:43:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:46.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:46.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:46.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:46.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:46.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:46.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:46.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.906 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 80.844723263000006, 2024-04-26T10:43:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:46.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:46.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:46.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:46.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:46.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:46.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.912 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 80.844704441999994, 2024-04-26T10:43:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:46.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:46.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:46.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:46.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:46.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:46.918 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 80.844672439999997, 2024-04-26T10:43:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:46.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:46.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:46.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:46.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:46.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:46.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 80.844463632, 2024-04-26T10:43:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:46.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:46.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:46.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:46.929 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 80.844432341000001, 2024-04-26T10:43:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:46.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:46.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 80.844405090999999, 2024-04-26T10:43:46.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:46.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:46.937 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 80.84162834, 2024-04-26T10:43:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:46.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:46.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:46.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:46.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:46.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:46.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:46.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 80.841578251000001, 2024-04-26T10:43:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.941 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:46.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:46.945 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 80.840686181999999, 2024-04-26T10:43:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:46.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 80.838497853000007, 2024-04-26T10:43:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.950 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:46.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.954 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 80.838362482999997, 2024-04-26T10:43:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:46.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 80.838147909, 2024-04-26T10:43:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:46.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:46.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:46.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:46.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:46.963 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.963 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.963 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.963 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:46.963 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:46.964 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 80.837808968000004, 2024-04-26T10:43:46.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:46.964 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.964 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.964 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:46.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:46.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:46.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:46.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:46.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:46.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:46.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:46.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:46.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:46.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:46.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:46.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:46.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:46.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:46.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:46.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:46.968 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.968 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.968 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.968 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:46.968 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:46.968 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 80.837699591000003, 2024-04-26T10:43:46.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:46.968 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.968 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:46.968 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:46.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:46.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:46.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:46.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:46.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:46.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:46.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:46.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:46.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:46.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:46.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:46.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:46.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:46.972 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.972 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.972 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.972 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:46.972 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:46.972 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 80.837659872000003, 2024-04-26T10:43:46.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:46.972 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.972 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.972 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:46.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:46.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:46.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:46.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:46.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:46.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:46.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:46.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:46.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:46.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:46.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:46.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:46.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:46.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:46.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:46.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:46.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:46.976 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.976 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.976 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.977 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:46.977 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:46.977 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 80.837322338999996, 2024-04-26T10:43:46.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:46.977 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:46.977 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:46.977 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:46.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:46.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:46.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:46.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:46.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:46.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:46.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:46.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:46.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:46.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:46.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:46.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:46.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:46.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:46.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:46.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:46.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:46.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:46.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:46.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:46.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:46.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:46.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:46.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:46.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:46.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:46.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:46.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:46.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:46.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:46.981 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:46.981 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.981 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.981 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.981 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:46.981 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:46.981 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:46.982 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:46.981+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:46.983 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:47.083 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:47.082+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:47.086 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:47.086 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:47.086 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:47.086 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:47.094 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:47.184 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:47.183+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:47.198 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:47.198 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:47.198 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:47.199 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:47.199 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:47.206 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:47.244 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:43:47.289 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:47.288+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:47.349 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:47.349 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:47.349 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:47.349 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:47.349 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.349 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:47.349 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:47.350 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 81.310309297000003, 2024-04-26T10:43:47.350 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:47.350 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:47.350 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:47.350 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:47.350 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.350 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:47.350 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:47.350 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.350 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.350 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.350 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:47.350 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:47.350 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.351 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.351 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.351 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:47.351 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:47.351 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:47.351 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.351 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.351 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:47.351 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:47.351 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:47.351 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.351 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.351 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:47.351 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:47.352 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:47.352 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.352 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.352 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:47.352 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:47.352 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:47.352 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.352 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.352 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:47.352 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:47.352 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:47.352 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.352 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.352 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:47.353 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:47.353 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:47.353 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.353 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.353 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:47.353 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:47.353 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:47.353 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.353 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.353 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:47.353 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:47.353 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:47.353 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.353 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:47.354 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.354 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.354 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.354 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:47.354 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:47.354 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 81.309438517000004, 2024-04-26T10:43:47.354 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:47.354 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:47.354 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:47.354 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:47.354 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.354 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:47.354 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:47.354 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.355 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.355 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.355 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:47.355 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:47.355 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.355 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.355 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.355 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:47.355 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:47.355 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:47.355 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.355 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.355 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:47.355 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:47.355 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:47.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.356 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.356 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:47.356 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:47.356 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:47.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.356 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.356 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:47.356 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:47.356 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:47.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.356 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.356 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:47.356 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:47.357 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:47.357 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.357 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.357 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:47.357 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:47.357 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:47.357 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.357 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.357 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:47.357 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:47.357 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:47.357 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.357 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.357 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:47.357 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:47.358 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:47.358 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.358 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:47.358 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.358 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.358 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.358 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:47.358 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:47.358 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 81.308451173999998, 2024-04-26T10:43:47.359 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:47.359 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:47.359 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:47.359 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:47.359 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.359 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:47.359 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:47.359 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.359 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.359 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.359 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:47.359 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:47.359 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.359 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.360 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:47.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:47.360 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:47.360 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.360 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:47.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:47.360 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:47.360 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.360 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:47.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:47.360 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:47.360 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.361 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.361 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:47.361 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:47.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:47.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.361 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.361 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:47.361 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:47.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:47.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.361 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.361 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:47.361 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:47.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:47.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.362 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.362 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:47.362 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:47.362 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:47.362 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.362 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.362 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:47.362 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:47.362 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:47.362 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.362 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:47.362 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.362 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.362 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.363 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:47.363 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:47.363 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 81.308245908999993, 2024-04-26T10:43:47.363 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:47.363 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:47.363 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:47.363 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:47.363 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.363 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:47.363 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:47.363 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.363 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.363 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.363 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:47.364 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:47.364 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.364 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.364 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.364 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:47.364 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:47.364 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:47.364 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.364 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.364 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:47.364 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:47.364 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:47.364 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.365 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.365 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:47.365 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:47.365 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:47.365 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.365 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.365 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:47.365 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:47.365 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:47.365 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.365 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.365 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:47.365 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:47.365 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:47.365 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.366 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.366 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:47.366 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:47.366 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:47.366 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.366 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.366 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:47.366 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:47.366 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:47.366 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.366 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.366 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:47.366 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:47.366 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:47.367 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.367 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:47.367 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.367 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.367 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.367 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:47.367 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:47.367 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 81.307925030000007, 2024-04-26T10:43:47.367 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:47.367 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:47.367 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:47.367 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:47.367 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.367 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:47.367 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:47.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.368 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:47.368 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:47.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.368 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:47.368 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:47.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:47.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.368 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:47.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:47.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:47.369 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.369 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:47.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:47.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:47.369 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.369 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:47.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:47.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:47.369 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.369 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:47.370 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:47.370 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:47.370 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.370 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.370 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:47.370 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:47.370 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:47.370 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.370 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.370 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:47.370 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:47.370 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:47.370 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.371 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.371 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:47.371 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:47.371 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:47.371 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.371 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.371 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:47.371 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:47.371 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:47.371 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.371 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.371 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:47.371 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:47.371 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:47.371 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.372 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.372 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:47.372 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:47.372 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:47.372 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.372 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:47.372 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.372 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.372 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.372 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:47.372 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:47.372 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 81.307873205999996, 2024-04-26T10:43:47.372 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:47.372 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:47.373 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:47.373 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:47.373 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.373 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:47.373 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:47.373 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.373 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.373 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.373 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:47.373 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:47.373 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.373 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.373 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.373 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:47.373 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:47.374 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:47.374 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.374 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.374 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:47.374 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:47.374 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:47.374 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.374 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.374 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:47.374 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:47.374 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:47.374 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.374 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.374 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:47.374 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:47.375 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:47.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.375 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.375 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:47.375 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:47.375 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:47.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.375 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.375 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:47.375 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:47.375 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:47.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.375 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.375 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:47.375 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:47.376 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:47.376 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.376 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.376 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:47.376 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:47.376 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:47.376 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.376 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.376 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:47.376 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:47.376 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:47.376 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.376 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.376 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:47.376 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:47.377 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:47.377 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.377 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.377 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:47.377 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:47.377 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:47.377 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.377 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:47.377 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.377 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.377 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.377 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:47.377 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:47.377 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 81.307819834, 2024-04-26T10:43:47.378 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:47.378 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:47.378 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:47.378 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:47.378 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.378 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:47.378 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:47.378 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.378 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.378 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.378 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:47.378 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:47.378 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.378 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.379 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.379 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:47.379 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:47.379 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:47.379 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.379 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.379 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:47.379 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:47.379 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:47.379 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:47.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:47.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:47.380 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:47.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:47.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:47.380 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:47.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:47.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:47.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:47.381 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:47.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:47.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:47.381 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:47.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:47.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:47.381 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:47.382 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:47.382 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.382 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.382 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:47.382 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:47.382 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:47.382 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.382 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.382 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:47.382 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:47.382 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:47.382 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.382 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.382 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:47.382 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:47.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:47.383 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.383 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:47.383 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.383 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.383 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:47.383 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:47.383 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 81.307775507000002, 2024-04-26T10:43:47.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:47.383 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:47.383 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:47.383 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:47.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.384 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:47.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:47.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.384 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:47.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:47.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.384 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:47.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:47.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:47.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:47.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:47.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:47.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:47.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:47.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:47.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:47.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:47.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:47.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:47.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:47.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:47.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:47.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:47.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:47.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:47.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:47.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:47.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:47.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:47.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:47.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:47.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:47.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:47.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:47.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:47.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:47.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.388 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:47.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:47.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:47.388 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.388 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:47.388 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.388 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:47.388 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:47.388 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 81.307751793999998, 2024-04-26T10:43:47.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:47.389 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:47.389 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:47.389 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:47.389 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.389 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:47.389 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:47.389 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.389 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.389 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:47.389 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:47.389 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.389 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.389 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:47.390 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:47.390 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:47.390 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.390 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.390 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:47.390 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:47.390 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:47.390 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.390 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.390 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:47.390 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:47.390 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:47.390 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:47.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:47.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:47.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:47.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:47.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:47.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:47.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:47.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:47.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:47.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:47.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:47.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:47.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:47.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:47.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:47.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:47.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:47.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:47.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:47.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:47.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:47.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:47.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:47.393 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.393 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:47.393 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.394 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:47.394 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:47.394 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 81.307717488999998, 2024-04-26T10:43:47.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:47.394 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:47.394 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:47.394 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:47.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:47.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:47.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:47.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:47.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:47.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:47.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:47.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:47.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:47.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:47.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:47.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:47.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:47.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:47.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:47.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:47.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:47.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:47.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:47.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.397 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:47.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:47.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:47.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.397 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:47.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:47.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:47.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.397 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:47.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:47.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:47.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:47.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:47.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:47.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:47.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:47.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:47.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:47.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:47.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:47.399 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.399 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:47.401 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.402 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:47.402 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:47.402 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 81.307380893000001, 2024-04-26T10:43:47.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:47.402 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:47.402 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:47.402 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:47.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:47.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:47.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:47.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:47.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:47.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:47.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:47.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:47.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:47.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:47.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:47.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:47.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:47.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:47.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:47.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:47.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:47.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:47.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:47.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:47.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:47.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:47.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:47.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:47.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:47.405 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.405 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:47.405 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.406 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.406 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:47.406 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:47.406 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 81.307338865000006, 2024-04-26T10:43:47.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:47.406 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:47.406 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:47.406 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:47.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.406 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:47.406 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:47.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.406 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.407 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:47.407 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:47.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.407 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:47.407 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:47.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:47.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.407 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:47.407 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:47.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:47.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:47.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:47.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:47.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:47.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:47.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:47.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:47.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:47.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:47.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:47.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:47.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:47.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:47.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:47.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:47.409 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.410 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:47.410 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.410 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.410 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:47.410 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:47.410 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 81.307285692999997, 2024-04-26T10:43:47.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:47.410 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:47.410 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:47.410 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:47.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.410 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:47.410 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:47.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:47.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:47.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:47.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:47.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:47.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:47.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:47.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:47.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:47.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:47.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:47.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:47.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:47.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:47.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:47.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:47.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:47.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:47.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:47.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:47.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:47.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:47.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:47.413 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.413 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:47.414 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.414 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.414 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:47.414 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:47.414 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 81.303879283000001, 2024-04-26T10:43:47.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:47.414 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:47.414 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:47.414 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:47.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.414 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:47.414 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:47.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:47.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:47.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:47.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:47.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:47.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:47.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:47.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:47.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:47.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:47.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:47.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:47.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:47.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:47.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:47.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:47.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:47.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:47.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:47.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:47.417 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.417 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:47.417 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.417 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:47.417 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:47.417 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 81.301407330000004, 2024-04-26T10:43:47.418 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:47.418 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:47.418 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:47.418 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:47.418 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.418 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:47.418 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:47.418 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.418 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.418 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.418 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:47.418 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:47.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.419 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:47.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:47.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:47.419 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:47.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:47.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:47.419 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:47.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:47.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:47.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:47.420 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:47.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:47.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:47.420 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:47.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:47.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:47.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:47.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:47.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:47.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:47.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:47.421 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.421 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:47.421 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.421 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:47.421 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:47.422 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 81.300753771999993, 2024-04-26T10:43:47.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:47.422 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:47.422 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:47.422 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:47.422 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.422 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:47.422 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:47.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.422 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.422 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.422 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:47.422 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:47.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:47.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:47.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:47.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:47.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:47.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:47.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:47.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:47.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:47.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:47.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:47.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:47.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:47.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:47.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:47.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:47.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:47.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:47.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:47.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:47.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:47.425 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.425 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:47.425 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.425 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:47.426 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:47.426 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 81.300677987, 2024-04-26T10:43:47.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:47.426 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:47.426 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:47.426 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:47.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:47.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:47.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:47.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:47.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.427 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:47.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:47.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:47.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.427 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:47.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:47.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:47.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.427 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:47.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:47.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:47.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:47.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:47.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:47.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:47.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:47.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:47.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:47.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:47.429 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:47.429 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.429 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:47.429 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:47.429 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:47.429 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.429 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:47.429 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.429 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.429 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:47.429 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:47.429 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 81.300464293000005, 2024-04-26T10:43:47.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:47.430 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:47.430 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:47.430 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:47.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:47.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:47.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:47.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:47.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:47.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:47.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:47.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:47.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:47.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:47.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:47.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:47.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:47.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.432 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:47.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:47.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:47.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.432 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:47.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:47.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:47.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.432 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:47.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:47.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:47.433 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.433 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:47.433 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.433 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.433 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:47.433 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:47.433 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 81.298020480000005, 2024-04-26T10:43:47.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:47.433 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:47.433 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:47.433 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:47.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.433 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:47.433 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:47.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.434 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.434 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:47.434 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:47.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.434 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.434 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:47.434 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:47.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:47.434 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.434 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:47.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:47.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:47.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:47.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:47.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:47.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:47.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:47.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:47.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:47.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:47.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:47.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:47.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:47.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:47.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:47.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:47.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:47.436 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.436 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:47.437 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.437 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.437 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:47.437 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:47.437 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 75.847958035999994, 2024-04-26T10:43:47.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:47.437 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:47.437 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:47.437 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:47.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.437 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:47.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:47.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.438 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.438 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:47.438 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:47.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:47.438 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.438 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:47.438 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:47.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:47.438 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:47.439 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:47.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:47.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:47.439 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:47.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:47.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:47.439 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:47.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:47.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:47.440 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:47.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:47.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:47.440 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:47.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:47.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:47.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:47.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:47.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:47.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:47.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:47.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:47.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:47.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:47.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.442 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:47.442 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:47.442 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:47.442 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:47.442 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:47.442 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:47.442 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:47.442 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:47.442 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.442 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:47.442 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.442 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:47.442 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:47.442 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:47.443 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:47.444 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:47.444 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:43:47.445 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:47.442+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:47.445 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:47.455 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:47.455 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:47.458 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:43:47.458 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:43:47.545 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:47.544+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:47.561 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:47.561 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:47.570 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:47.655 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:47.654+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:47.719 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:47.719 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:47.728 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:47.770 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:47.769+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:47.846 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:47.845+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:47.875 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:47.875 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:47.884 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:47.948 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:47.946+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:47.988 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:47.988 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:47.997 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:48.081 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:48.080+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:48.140 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:48.140 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:48.149 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:48.149 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:48.147+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:48.250 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:48.249+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:48.282 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:43:48.290 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:48.290 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:48.299 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:48.351 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:48.350+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:48.410 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:48.411 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:48.419 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:48.452 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:48.451+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:48.553 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:48.552+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:48.565 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:48.565 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:48.574 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:48.653 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:48.652+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:48.721 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:48.721 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:48.730 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:48.754 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:48.754+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:48.834 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:48.834 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:48.841 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:48.885 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:48.884+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:48.943 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:48.943 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:48.952 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:48.992 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:48.991+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:49.057 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:49.055+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:49.093 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:49.093 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:49.103 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:49.157 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:49.156+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:49.212 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:49.212 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:49.222 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:49.266 INFO:teuthology.orchestra.run.smithi049.stderr:nodeep-scrub is set 2024-04-26T10:43:49.268 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:49.266+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:49.329 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:49.330 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:49.339 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:49.359 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:49.358+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:49.460 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:43:49.461 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:49.459+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:49.485 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:49.485 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:49.494 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:49.562 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:49.561+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:49.595 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:49.596 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:49.604 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:49.654 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:49.654 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:49.654 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:43:49.662 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:49.662+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:49.685 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:49.685 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:49.689 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:43:49.689 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:43:49.705 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:49.705 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:49.705 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:49.705 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:49.706 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:49.714 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:49.764 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:49.763+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:49.817 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:49.818 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:49.818 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:49.818 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:49.818 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.818 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:49.818 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:49.818 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 83.778905257999995, 2024-04-26T10:43:49.818 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:49.818 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:49.818 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:49.819 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:49.819 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.819 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:49.819 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:49.819 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.819 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.819 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.819 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:49.819 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:49.819 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.819 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.819 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.819 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:49.819 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:49.820 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:49.820 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.820 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.820 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:49.820 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:49.820 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:49.820 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.820 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.820 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:49.820 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:49.820 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:49.820 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.820 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.820 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:49.821 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:49.821 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:49.821 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.821 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.821 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:49.821 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:49.821 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:49.821 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.821 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.821 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:49.821 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:49.822 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:49.822 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.822 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.822 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:49.822 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:49.822 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:49.822 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.822 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.822 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:49.822 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:49.822 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:49.822 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.822 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:49.822 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.823 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.823 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.823 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:49.823 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:49.823 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 83.778034477999995, 2024-04-26T10:43:49.823 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:49.823 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:49.823 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:49.823 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:49.823 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.823 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:49.823 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:49.823 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.823 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.824 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.824 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:49.824 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:49.824 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.824 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.824 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.824 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:49.824 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:49.824 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:49.824 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.824 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.824 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:49.824 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:49.824 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:49.824 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.825 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.825 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:49.825 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:49.825 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:49.825 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.825 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.825 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:49.825 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:49.825 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:49.825 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.825 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.825 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:49.825 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:49.825 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:49.825 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.826 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.826 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:49.826 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:49.826 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:49.826 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.826 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.826 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:49.826 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:49.826 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:49.826 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.826 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.826 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:49.826 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:49.826 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:49.826 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.827 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:49.827 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.827 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.827 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.827 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:49.827 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:49.827 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 83.777047135000004, 2024-04-26T10:43:49.827 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:49.827 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:49.827 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:49.827 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:49.827 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.827 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:49.827 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:49.828 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.828 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.828 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.828 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:49.828 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:49.828 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.828 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.828 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.828 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:49.828 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:49.828 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:49.828 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.828 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.828 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:49.828 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:49.829 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:49.829 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.829 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.829 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:49.829 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:49.829 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:49.829 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.829 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.829 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:49.829 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:49.829 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:49.829 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.829 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.829 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:49.829 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:49.830 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:49.830 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.830 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.830 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:49.830 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:49.830 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:49.830 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.830 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.830 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:49.830 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:49.830 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:49.830 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.830 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.830 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:49.830 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:49.831 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:49.831 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.831 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:49.831 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.831 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.831 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.831 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:49.831 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:49.831 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 83.776841869999998, 2024-04-26T10:43:49.831 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:49.831 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:49.831 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:49.831 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:49.831 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.831 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:49.832 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:49.832 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.832 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.832 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.832 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:49.832 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:49.832 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.832 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.832 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.832 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:49.832 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:49.832 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:49.832 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.833 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.833 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:49.833 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:49.833 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:49.833 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.833 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.833 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:49.833 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:49.833 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:49.833 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.833 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.833 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:49.833 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:49.833 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:49.833 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.834 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.834 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:49.834 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:49.834 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:49.834 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.834 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.834 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:49.834 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:49.834 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:49.834 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.834 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.834 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:49.834 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:49.834 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:49.835 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.835 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.835 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:49.835 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:49.835 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:49.835 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.835 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:49.835 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.835 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.835 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.835 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:49.835 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:49.835 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 83.776520990999998, 2024-04-26T10:43:49.835 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:49.836 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:49.836 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:49.836 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:49.836 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.836 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:49.836 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:49.836 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.836 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.836 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.836 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:49.836 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:49.836 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.836 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.836 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.836 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:49.837 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:49.837 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:49.837 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.837 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.837 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:49.837 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:49.837 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:49.837 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.837 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.837 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:49.837 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:49.837 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:49.837 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.837 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.837 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:49.838 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:49.838 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:49.838 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.838 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.838 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:49.838 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:49.838 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:49.838 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.838 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.838 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:49.838 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:49.838 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:49.838 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.838 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.839 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:49.839 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:49.839 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:49.839 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.839 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.839 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:49.839 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:49.839 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:49.839 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.839 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.839 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:49.839 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:49.839 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:49.839 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.839 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.840 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:49.840 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:49.840 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:49.840 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.840 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.840 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:49.840 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:49.840 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:49.840 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.840 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:49.840 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.840 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.840 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.840 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:49.840 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:49.841 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 83.776469167000002, 2024-04-26T10:43:49.841 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:49.841 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:49.841 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:49.841 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:49.841 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.841 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:49.841 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:49.841 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.841 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.841 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.841 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:49.841 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:49.841 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.841 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.842 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.842 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:49.842 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:49.842 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:49.842 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.842 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.842 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:49.842 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:49.842 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:49.842 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.842 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.842 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:49.842 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:49.842 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:49.843 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.843 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.843 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:49.843 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:49.843 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:49.843 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.843 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.843 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:49.843 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:49.843 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:49.843 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.843 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.843 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:49.843 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:49.843 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:49.844 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.844 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.844 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:49.844 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:49.844 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:49.844 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.844 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.844 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:49.844 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:49.844 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:49.844 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.844 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.844 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:49.844 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:49.844 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:49.845 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.845 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.845 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:49.845 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:49.845 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:49.845 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.845 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.845 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:49.845 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:49.845 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:49.845 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.845 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:49.845 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.845 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.846 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.846 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:49.846 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:49.846 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 83.776415795000005, 2024-04-26T10:43:49.846 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:49.846 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:49.846 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:49.846 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:49.846 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.846 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:49.846 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:49.846 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.846 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.846 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.846 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:49.847 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:49.847 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.847 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.847 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.847 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:49.847 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:49.847 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:49.847 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.847 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.847 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:49.847 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:49.847 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:49.847 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.848 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.848 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:49.848 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:49.848 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:49.848 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.848 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.848 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:49.848 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:49.848 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:49.848 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.848 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.848 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:49.848 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:49.848 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:49.849 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.849 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.849 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:49.849 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:49.849 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:49.849 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.849 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.849 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:49.849 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:49.849 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:49.849 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.849 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.849 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:49.849 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:49.849 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:49.850 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.850 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.850 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:49.850 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:49.850 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:49.850 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.850 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.850 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:49.850 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:49.850 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:49.850 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.850 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.850 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:49.850 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:49.851 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:49.851 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.851 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:49.851 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.851 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.851 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.851 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:49.851 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:49.851 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 83.776371467999994, 2024-04-26T10:43:49.851 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:49.851 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:49.851 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:49.851 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:49.851 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.852 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:49.852 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:49.852 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.852 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.852 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.852 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:49.852 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:49.854 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.854 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.854 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.854 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:49.855 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:49.855 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:49.855 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.855 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.855 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:49.855 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:49.855 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:49.855 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.855 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.855 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:49.855 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:49.855 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:49.855 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.855 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.855 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:49.856 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:49.856 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:49.856 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.856 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.856 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:49.856 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:49.856 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:49.856 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.856 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.856 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:49.856 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:49.856 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:49.856 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.857 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.857 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:49.857 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:49.857 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:49.857 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.857 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.857 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:49.857 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:49.857 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:49.857 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.857 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.857 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:49.857 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:49.857 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:49.858 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.858 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.858 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:49.858 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:49.858 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:49.858 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.858 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.858 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:49.858 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:49.858 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:49.858 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.858 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:49.858 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.858 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.858 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.859 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:49.859 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:49.859 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 83.776347755000003, 2024-04-26T10:43:49.859 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:49.859 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:49.859 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:49.859 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:49.859 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.859 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:49.859 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:49.859 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.859 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.859 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.859 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:49.860 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:49.860 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.860 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.860 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.860 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:49.860 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:49.860 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:49.860 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.860 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.860 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:49.860 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:49.860 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:49.860 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.861 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.861 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:49.861 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:49.861 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:49.861 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.861 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.861 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:49.861 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:49.861 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:49.861 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.861 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.861 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:49.861 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:49.861 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:49.862 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.862 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.862 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:49.862 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:49.862 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:49.862 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.862 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.862 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:49.862 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:49.862 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:49.862 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.862 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.862 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:49.862 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:49.863 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:49.863 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.863 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.863 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:49.863 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:49.863 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:49.863 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.863 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.863 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:49.863 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:49.863 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:49.863 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.863 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.863 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:49.864 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:49.864 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:49.864 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.864 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:49.864 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.864 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.864 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.864 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:49.864 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:49.864 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 83.776313450000004, 2024-04-26T10:43:49.864 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:49.864 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:49.864 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:49.864 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:49.865 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.865 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:49.865 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:49.865 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.865 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.865 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.865 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:49.865 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:49.865 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.865 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.865 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.865 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:49.865 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:49.865 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:49.866 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.866 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.866 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:49.866 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:49.866 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:49.866 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.866 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.866 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:49.866 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:49.866 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:49.866 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.866 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.866 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:49.866 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:49.866 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:49.867 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.867 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.867 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:49.867 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:49.867 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:49.867 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.867 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.867 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:49.867 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:49.867 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:49.867 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.867 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.867 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:49.867 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:49.868 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:49.868 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.868 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.868 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:49.868 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:49.868 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:49.868 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.868 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.868 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:49.868 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:49.868 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:49.868 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.868 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.868 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:49.868 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:49.869 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:49.869 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.869 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.869 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:49.869 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:49.869 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:49.869 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.869 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:49.869 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.869 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.869 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.869 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:49.869 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:49.869 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 83.775976854000007, 2024-04-26T10:43:49.870 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:49.870 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:49.870 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:49.870 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:49.870 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.870 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:49.870 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:49.870 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.870 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.870 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.870 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:49.870 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:49.870 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.870 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.871 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.871 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:49.871 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:49.871 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:49.871 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.871 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.871 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:49.871 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:49.871 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:49.871 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.871 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.871 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:49.871 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:49.871 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:49.872 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.872 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.872 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:49.872 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:49.872 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:49.872 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.872 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.872 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:49.872 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:49.872 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:49.872 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.872 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.872 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:49.872 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:49.872 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:49.873 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.873 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.873 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:49.873 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:49.873 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:49.873 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.873 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:49.873 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.873 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.873 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.873 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:49.873 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:49.873 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 83.775934825999997, 2024-04-26T10:43:49.873 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:49.873 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:49.874 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:49.874 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:49.874 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.874 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:49.874 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:49.874 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.874 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.874 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.874 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:49.874 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:49.874 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.874 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.874 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.875 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:49.875 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:49.875 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:49.875 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.875 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.875 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:49.875 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:49.875 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:49.875 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.875 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.875 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:49.875 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:49.875 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:49.875 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.875 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.876 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:49.876 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:49.876 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:49.876 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.876 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.876 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:49.876 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:49.876 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:49.876 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.876 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.876 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:49.876 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:49.876 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:49.876 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.877 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.877 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:49.877 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:49.877 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:49.877 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.877 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:49.877 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.877 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.877 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.877 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:49.877 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:49.877 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 83.775881654000003, 2024-04-26T10:43:49.877 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:49.877 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:49.877 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:49.878 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:49.878 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.878 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:49.878 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:49.878 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.878 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.878 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.878 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:49.878 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:49.878 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.878 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.878 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.878 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:49.878 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:49.879 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:49.879 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.879 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.879 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:49.879 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:49.879 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:49.879 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.879 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.879 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:49.879 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:49.879 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:49.879 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.879 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.879 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:49.879 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:49.880 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:49.880 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.880 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.880 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:49.880 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:49.880 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:49.880 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.880 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.880 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:49.880 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:49.880 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:49.880 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.880 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.880 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:49.881 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:49.881 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:49.881 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.881 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:49.881 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.881 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.881 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.881 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:49.881 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:49.881 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 83.772475244000006, 2024-04-26T10:43:49.881 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:49.881 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:49.881 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:49.881 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:49.881 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.882 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:49.882 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:49.882 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.882 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.882 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.882 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:49.882 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:49.882 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.882 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.882 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.882 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:49.882 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:49.882 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:49.882 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.883 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.883 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:49.883 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:49.883 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:49.883 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.883 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.883 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:49.883 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:49.883 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:49.883 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.883 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.883 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:49.883 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:49.883 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:49.884 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.884 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.884 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:49.884 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:49.884 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:49.884 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.884 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.884 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:49.884 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:49.884 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:49.884 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.884 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:49.884 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.884 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.884 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.885 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:49.885 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:49.885 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 83.770003290999995, 2024-04-26T10:43:49.885 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:49.885 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:49.885 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:49.885 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:49.885 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.885 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:49.885 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:49.885 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.885 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.885 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.885 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:49.885 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:49.886 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.886 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.886 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.886 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:49.886 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:49.886 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:49.886 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.886 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.886 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:49.886 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:49.886 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:49.886 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.886 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.886 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:49.887 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:49.887 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:49.887 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.887 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.887 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:49.887 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:49.887 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:49.887 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.887 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.887 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:49.887 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:49.887 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:49.887 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.887 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.888 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:49.888 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:49.888 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:49.888 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.888 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.888 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:49.888 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:49.888 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:49.888 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.888 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:49.888 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.888 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.888 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.888 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:49.889 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:49.889 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 83.769349732999999, 2024-04-26T10:43:49.889 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:49.889 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:49.889 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:49.889 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:49.889 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.889 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:49.889 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:49.889 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.889 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.889 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.889 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:49.889 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:49.890 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.890 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.890 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.890 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:49.890 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:49.890 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:49.890 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.890 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.890 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:49.890 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:49.890 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:49.890 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.890 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.890 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:49.891 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:49.891 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:49.891 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.891 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.891 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:49.891 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:49.891 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:49.891 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.891 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.891 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:49.891 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:49.891 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:49.891 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.891 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.892 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:49.892 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:49.892 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:49.892 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.892 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.892 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:49.892 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:49.892 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:49.892 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.892 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:49.892 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.892 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.892 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.892 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:49.892 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:49.893 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 83.769273948000006, 2024-04-26T10:43:49.893 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:49.893 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:49.893 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:49.893 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:49.893 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.893 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:49.893 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:49.893 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.893 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.893 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.893 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:49.893 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:49.893 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.894 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.894 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.894 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:49.894 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:49.894 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:49.894 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.894 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.894 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:49.894 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:49.894 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:49.894 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.894 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.894 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:49.894 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:49.895 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:49.895 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.895 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.895 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:49.895 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:49.895 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:49.895 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.895 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.895 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:49.895 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:49.895 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:49.895 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.895 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.895 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:49.895 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:49.896 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:49.896 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.896 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.896 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:49.896 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:49.896 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:49.896 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.896 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:49.896 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.896 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.896 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.896 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:49.896 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:49.896 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 83.769060253999996, 2024-04-26T10:43:49.896 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:49.897 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:49.897 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:49.897 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:49.897 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.897 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:49.897 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:49.897 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.897 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.897 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.897 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:49.897 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:49.898 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.898 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.898 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.898 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:49.898 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:49.898 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:49.898 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.898 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.898 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:49.898 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:49.898 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:49.898 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.898 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.898 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:49.899 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:49.899 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:49.899 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.899 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.899 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:49.899 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:49.899 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:49.899 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.899 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.899 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:49.899 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:49.899 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:49.899 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.899 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.900 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:49.900 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:49.900 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:49.900 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.900 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:49.900 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.900 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.900 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.900 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:49.900 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:49.900 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 83.766616440999996, 2024-04-26T10:43:49.900 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:49.900 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:49.900 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:49.900 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:49.901 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.901 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:49.901 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:49.901 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.901 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.901 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.901 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:49.901 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:49.901 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.901 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.901 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.901 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:49.901 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:49.901 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:49.901 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.902 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.902 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:49.902 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:49.902 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:49.902 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.902 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.902 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:49.902 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:49.902 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:49.902 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.902 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.902 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:49.902 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:49.903 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:49.903 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.903 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.903 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:49.903 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:49.903 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:49.903 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.903 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.903 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:49.903 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:49.903 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:49.903 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.903 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.903 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:49.903 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:49.904 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:49.904 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.904 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:49.904 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.904 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.904 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.904 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:49.904 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:49.904 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 78.316553997, 2024-04-26T10:43:49.904 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:49.904 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:49.904 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:49.904 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:49.904 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.905 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:49.905 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:49.905 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.905 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.905 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.905 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:49.905 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:49.905 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:49.905 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.905 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.905 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:49.905 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:49.905 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:49.905 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.905 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.906 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:49.906 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:49.906 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:49.906 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.906 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.906 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:49.906 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:49.906 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:49.906 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.906 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.906 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:49.906 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:49.906 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:49.906 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.906 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.907 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:49.907 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:49.907 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:49.907 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.907 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.907 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:49.907 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:49.907 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:49.907 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.907 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.907 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:49.907 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:49.907 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:49.907 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.908 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.908 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:49.908 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:49.908 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:49.908 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.908 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.908 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:49.908 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:49.908 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:49.908 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.908 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.908 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:49.908 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:49.908 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:49.908 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:49.909 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:49.909 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:49.909 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:49.909 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:49.909 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.909 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:49.909 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.909 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:49.909 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:49.909 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:49.911 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:49.909+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:49.911 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:50.012 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:50.011+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:50.019 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:50.019 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:50.019 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:50.019 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:50.028 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:50.113 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:50.112+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:50.174 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:50.174 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:50.174 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:50.174 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:50.174 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:50.183 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:50.224 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:50.223+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:50.315 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:50.315+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:50.330 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 84.292678344999999, 2024-04-26T10:43:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.331 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.332 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.334 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:50.334 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:50.334 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:50.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.334 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:50.335 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:50.335 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:50.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.335 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:50.335 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:50.336 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 84.290928223999998, 2024-04-26T10:43:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:50.338 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.339 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.340 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.341 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 84.290875225999997, 2024-04-26T10:43:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:50.342 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.343 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:50.343 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:50.343 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.344 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:50.344 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:50.344 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:50.346 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.347 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:50.348 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 84.290797482000002, 2024-04-26T10:43:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:50.350 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:50.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:50.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:50.353 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 84.290758475999993, 2024-04-26T10:43:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:50.355 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:50.356 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:50.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:50.358 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 84.290739654999996, 2024-04-26T10:43:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.359 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:50.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:50.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:50.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:50.364 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 84.290707652999998, 2024-04-26T10:43:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:50.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:50.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 84.290498845000002, 2024-04-26T10:43:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:50.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:50.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 84.290467554000003, 2024-04-26T10:43:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:50.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:50.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 84.290440304000001, 2024-04-26T10:43:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:50.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:50.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:50.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:50.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:50.383 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.383 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:50.383 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.383 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:50.383 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:50.383 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 84.287663553000002, 2024-04-26T10:43:50.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:50.383 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:50.383 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:50.383 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:50.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:50.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:50.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:50.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:50.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:50.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:50.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:50.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:50.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:50.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:50.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:50.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:50.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:50.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:50.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.386 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:50.386 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:50.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:50.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.386 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:50.386 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:50.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:50.386 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.386 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:50.386 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.386 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:50.386 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:50.387 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 84.287613464000003, 2024-04-26T10:43:50.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:50.387 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:50.387 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.387 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:50.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:50.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:50.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:50.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:50.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:50.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:50.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:50.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:50.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:50.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:50.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:50.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:50.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:50.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:50.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:50.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:50.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:50.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:50.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:50.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:50.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:50.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:50.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:50.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:50.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:50.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:50.390 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.390 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:50.390 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.391 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:50.391 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:50.391 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 84.286721395000001, 2024-04-26T10:43:50.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:50.391 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:50.391 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.391 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:50.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:50.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:50.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:50.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:50.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:50.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:50.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:50.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:50.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:50.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:50.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:50.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:50.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:50.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:50.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:50.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:50.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:50.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:50.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:50.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:50.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:50.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:50.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:50.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:50.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:50.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:50.395 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.395 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:50.395 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.395 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:50.395 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:50.395 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 84.284533065999995, 2024-04-26T10:43:50.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:50.395 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:50.395 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.395 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:50.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:50.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:50.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:50.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:50.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:50.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:50.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:50.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:50.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:50.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.397 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:50.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:50.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:50.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.397 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:50.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:50.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.397 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:50.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 84.284397695999999, 2024-04-26T10:43:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.399 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:50.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:50.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 84.284183122000002, 2024-04-26T10:43:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:50.403 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:50.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:50.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 84.283844181000006, 2024-04-26T10:43:50.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.410 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.410 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:50.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:50.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.410 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:50.410 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:50.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:50.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.410 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:50.410 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:50.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:50.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:50.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:50.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:50.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:50.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:50.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:50.411 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.411 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:50.411 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.411 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:50.412 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:50.412 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 84.283734804000005, 2024-04-26T10:43:50.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:50.412 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:50.412 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:50.412 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:50.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:50.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:50.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:50.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:50.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:50.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:50.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:50.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:50.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:50.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:50.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:50.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:50.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:50.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.414 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.414 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:50.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:50.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.414 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:50.414 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:50.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:50.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.414 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:50.414 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:50.415 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:50.415 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.415 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:50.415 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.415 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:50.415 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:50.415 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 84.283695085000005, 2024-04-26T10:43:50.415 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:50.415 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:50.415 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.415 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:50.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.415 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:50.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:50.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:50.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:50.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:50.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:50.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:50.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:50.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:50.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:50.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:50.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:50.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:50.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:50.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:50.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:50.418 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:50.418 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:50.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.418 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:50.418 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:50.418 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:50.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.418 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:50.418 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:50.418 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:50.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.419 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:50.419 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:50.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:50.419 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.419 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:50.419 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.419 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:50.419 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:50.419 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 84.283357551999998, 2024-04-26T10:43:50.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:50.419 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:50.419 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.420 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:50.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:50.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:50.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:50.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:50.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:50.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:50.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:50.421 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.421 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:50.421 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:50.421 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:50.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.421 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:50.421 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:50.421 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:50.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.421 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:50.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:50.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:50.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:50.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:50.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:50.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:50.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:50.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.423 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:50.423 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:50.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:50.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:50.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:50.423 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:50.423 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:50.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:50.423 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.423 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:50.423 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.423 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:50.423 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:50.423 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:50.425 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:50.426 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:50.424+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:50.526 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:50.525+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:50.529 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:50.529 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:50.529 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:50.530 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:50.539 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:50.628 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:50.627+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:50.639 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:50.639 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:50.639 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:50.639 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:50.640 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:50.648 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:50.728 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:50.726+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:50.750 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:50.751 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:50.751 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:50.751 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:50.751 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.751 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:50.751 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:50.751 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 84.712407995000007, 2024-04-26T10:43:50.751 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:50.751 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:50.751 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.751 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:50.751 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.751 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:50.752 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:50.752 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.752 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.752 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.752 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:50.752 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:50.752 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.752 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.752 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.752 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:50.752 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:50.752 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.752 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.752 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.753 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:50.753 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:50.753 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:50.753 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.753 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.753 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:50.753 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:50.753 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:50.753 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.753 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.753 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.753 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:50.753 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:50.753 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.753 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.754 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:50.754 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:50.754 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:50.754 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.754 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.754 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:50.754 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:50.754 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:50.754 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.754 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.754 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:50.754 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:50.754 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:50.755 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.755 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.755 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:50.755 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:50.755 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:50.755 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.755 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:50.755 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.756 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.756 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.756 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:50.756 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:50.756 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 84.711537215000007, 2024-04-26T10:43:50.756 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:50.756 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:50.756 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.756 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:50.756 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.756 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:50.756 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:50.756 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.756 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.757 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.757 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:50.757 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:50.757 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.757 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.757 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.757 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:50.757 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:50.757 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.757 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.757 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.758 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:50.758 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:50.758 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:50.758 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.758 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.758 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:50.758 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:50.758 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:50.758 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.758 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.758 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.758 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:50.758 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:50.758 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.759 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.759 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:50.759 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:50.759 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:50.759 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.759 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.759 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:50.759 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:50.759 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:50.759 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.759 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.759 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:50.759 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:50.759 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:50.759 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.760 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.760 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:50.760 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:50.760 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:50.760 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.760 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:50.760 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.760 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.760 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.760 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:50.760 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:50.760 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 84.710549872000001, 2024-04-26T10:43:50.760 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:50.760 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:50.760 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.761 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:50.761 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.761 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:50.761 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:50.761 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.761 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.761 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.761 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:50.761 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:50.761 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.761 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.761 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.761 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:50.761 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:50.761 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:50.762 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.762 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.762 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:50.762 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:50.762 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:50.762 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.762 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.762 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:50.762 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:50.762 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:50.762 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.762 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.762 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.762 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:50.763 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:50.763 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.763 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.763 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:50.763 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:50.763 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:50.763 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.763 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.763 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:50.763 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:50.763 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:50.763 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.763 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.763 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:50.764 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:50.764 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:50.764 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.764 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.764 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:50.764 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:50.764 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:50.764 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.764 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:50.764 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.764 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.764 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.764 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:50.764 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:50.764 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 84.710344606999996, 2024-04-26T10:43:50.765 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:50.765 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:50.765 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.765 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:50.765 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.765 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:50.765 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:50.765 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.765 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.765 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.765 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:50.765 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:50.765 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.765 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.766 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.766 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:50.766 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:50.766 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.766 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.766 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.766 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:50.766 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:50.766 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:50.766 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.766 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.766 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:50.766 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:50.766 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:50.767 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.767 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.767 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.767 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:50.767 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:50.767 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.767 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.767 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:50.767 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:50.767 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:50.767 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.767 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.767 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:50.767 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:50.767 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:50.768 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.768 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.768 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:50.768 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:50.768 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:50.768 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.768 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.768 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:50.768 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:50.768 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:50.768 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.768 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:50.768 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.768 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.768 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.769 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:50.769 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:50.769 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 84.710023727999996, 2024-04-26T10:43:50.769 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:50.769 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:50.769 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.769 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:50.769 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.769 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:50.769 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:50.769 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.769 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.769 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.769 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:50.770 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:50.770 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.770 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.770 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.770 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:50.770 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:50.770 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:50.770 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.770 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.770 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:50.770 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:50.770 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:50.770 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.770 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.771 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:50.771 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:50.771 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:50.771 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.771 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.771 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.771 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:50.771 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:50.771 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.771 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.771 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:50.771 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:50.771 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:50.771 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.771 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.772 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:50.772 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:50.772 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:50.772 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.772 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.772 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:50.772 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:50.772 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:50.772 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.772 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.772 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:50.772 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:50.772 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:50.772 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.772 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.773 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:50.773 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:50.773 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:50.773 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.773 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.773 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:50.773 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:50.773 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:50.773 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.773 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.773 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:50.773 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:50.773 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:50.773 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.773 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:50.774 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.774 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.774 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.774 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:50.774 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:50.774 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 84.709971904, 2024-04-26T10:43:50.774 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:50.774 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:50.774 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.774 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:50.774 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.774 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:50.774 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:50.774 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.775 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.775 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.775 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:50.775 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:50.775 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.775 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.775 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.775 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:50.775 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:50.775 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.775 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.775 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.775 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:50.775 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:50.775 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:50.776 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.776 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.776 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:50.776 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:50.776 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:50.776 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.776 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.776 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.776 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:50.776 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:50.776 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.776 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.776 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:50.776 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:50.777 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:50.777 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.777 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.777 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:50.777 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:50.777 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:50.777 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.777 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.777 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:50.777 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:50.777 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:50.777 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.777 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.777 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:50.777 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:50.778 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:50.778 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.778 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.778 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:50.778 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:50.778 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:50.778 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.778 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.778 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:50.778 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:50.778 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:50.778 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.778 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.779 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:50.779 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:50.779 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:50.779 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.779 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:50.779 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.779 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.779 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.779 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:50.779 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:50.779 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 84.709918532000003, 2024-04-26T10:43:50.779 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:50.779 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:50.779 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.779 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:50.780 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.780 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:50.780 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:50.780 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.780 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.780 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.780 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:50.780 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:50.780 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.780 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.780 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.780 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:50.780 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:50.780 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.781 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.781 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.781 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:50.781 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:50.781 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:50.781 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.781 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.781 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:50.781 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:50.781 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:50.781 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.781 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.781 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.781 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:50.782 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:50.782 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.782 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.782 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:50.782 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:50.782 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:50.782 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.782 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.782 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:50.782 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:50.782 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:50.782 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.782 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.782 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:50.783 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:50.783 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:50.783 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.783 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.783 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:50.783 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:50.783 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:50.783 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.783 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.783 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:50.783 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:50.783 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:50.783 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.783 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.783 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:50.784 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:50.784 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:50.784 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.784 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.784 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:50.784 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:50.784 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:50.784 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.784 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:50.784 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.784 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.784 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.784 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:50.784 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:50.785 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 84.709874205000006, 2024-04-26T10:43:50.785 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:50.785 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:50.785 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.785 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:50.785 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.785 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:50.785 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:50.785 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.785 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.785 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.785 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:50.785 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:50.785 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.785 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.786 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.786 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:50.786 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:50.786 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:50.786 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.786 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.786 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:50.786 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:50.786 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:50.786 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.786 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.786 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:50.786 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:50.786 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:50.787 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.787 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.787 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.787 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:50.787 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:50.787 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.787 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.787 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:50.787 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:50.787 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:50.787 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.787 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.787 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:50.787 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:50.787 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:50.788 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.788 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.788 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:50.788 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:50.788 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:50.788 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.788 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.788 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:50.788 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:50.788 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:50.788 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.788 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.788 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:50.788 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:50.789 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:50.789 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.789 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.789 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:50.789 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:50.789 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:50.789 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.789 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.789 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:50.789 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:50.789 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:50.789 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.789 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:50.789 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.789 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.790 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.790 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:50.790 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:50.790 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 84.709850492000001, 2024-04-26T10:43:50.790 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:50.790 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:50.790 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.790 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:50.790 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.790 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:50.790 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:50.790 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.790 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.790 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.791 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:50.791 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:50.791 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.791 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.791 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.791 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:50.791 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:50.791 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.791 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.791 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.791 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:50.791 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:50.791 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:50.791 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.791 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.792 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:50.792 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:50.792 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:50.792 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.792 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.792 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.792 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:50.792 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:50.792 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.792 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.792 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:50.792 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:50.792 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:50.792 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.792 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.793 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:50.793 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:50.793 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:50.793 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.793 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.793 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:50.793 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:50.793 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:50.793 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.793 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.793 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:50.793 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:50.793 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:50.793 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.793 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.794 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:50.794 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:50.794 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:50.794 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.794 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.794 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:50.794 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:50.794 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:50.794 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.794 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.794 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:50.794 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:50.794 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:50.794 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.795 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:50.795 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.795 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.795 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.795 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:50.795 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:50.795 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 84.709816187000001, 2024-04-26T10:43:50.795 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:50.795 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:50.795 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.795 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:50.795 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.795 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:50.795 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:50.795 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.796 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.796 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.796 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:50.796 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:50.796 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.796 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.796 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.796 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:50.796 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:50.796 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.796 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.796 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.796 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:50.796 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:50.796 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:50.797 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.797 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.797 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:50.797 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:50.797 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:50.797 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.797 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.797 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.797 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:50.797 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:50.797 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.797 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.797 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:50.797 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:50.797 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:50.798 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.798 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.798 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:50.798 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:50.798 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:50.798 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.798 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.798 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:50.798 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:50.798 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:50.798 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.798 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.798 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:50.798 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:50.798 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:50.799 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.799 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.799 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:50.799 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:50.799 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:50.799 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.799 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.799 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:50.799 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:50.799 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:50.799 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.799 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.799 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:50.799 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:50.800 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:50.800 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.800 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:50.800 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.800 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.800 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.800 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:50.800 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:50.800 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 84.709479591000004, 2024-04-26T10:43:50.800 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:50.800 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:50.800 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:50.800 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:50.800 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.800 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:50.801 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:50.801 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.801 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.801 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.801 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:50.801 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:50.801 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.801 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.801 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.801 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:50.801 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:50.801 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:50.801 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.801 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.801 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:50.801 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:50.802 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:50.802 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.802 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.802 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:50.802 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:50.802 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:50.802 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.802 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.802 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.802 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:50.802 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:50.802 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.802 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.802 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:50.803 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:50.803 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:50.803 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.803 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.803 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:50.803 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:50.803 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:50.803 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.803 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.803 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:50.803 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:50.803 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:50.803 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.803 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:50.803 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.803 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.804 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.804 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:50.804 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:50.804 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 84.709437562999994, 2024-04-26T10:43:50.804 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:50.804 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:50.804 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:50.804 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:50.804 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.804 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:50.804 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:50.804 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.804 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.804 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.804 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:50.805 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:50.805 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.805 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.805 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.805 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:50.805 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:50.805 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.805 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.805 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.805 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:50.805 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:50.805 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:50.805 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.805 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.805 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:50.806 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:50.806 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:50.806 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.806 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.806 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.806 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:50.806 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:50.806 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.806 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.806 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:50.806 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:50.806 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:50.806 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.806 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.807 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:50.807 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:50.807 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:50.807 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.807 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.807 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:50.807 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:50.807 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:50.807 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.807 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:50.807 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.807 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.807 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.807 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:50.807 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:50.808 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 84.709384391, 2024-04-26T10:43:50.808 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:50.808 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:50.808 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:50.808 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:50.808 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.808 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:50.808 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:50.808 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.808 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.808 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.808 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:50.808 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:50.808 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.809 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.809 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.809 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:50.809 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:50.809 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.809 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.809 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.809 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:50.809 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:50.809 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:50.809 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.809 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.809 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:50.809 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:50.810 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:50.810 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.810 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.810 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.810 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:50.810 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:50.810 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.810 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.810 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:50.810 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:50.810 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:50.810 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.810 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.810 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:50.811 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:50.811 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:50.811 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.811 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.811 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:50.811 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:50.811 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:50.811 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.811 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:50.811 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.811 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.811 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.811 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:50.811 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:50.811 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 84.705977981000004, 2024-04-26T10:43:50.812 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:50.812 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:50.812 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:50.812 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:50.812 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.812 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:50.812 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:50.812 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.812 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.812 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.812 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:50.812 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:50.812 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.812 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.813 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.813 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:50.813 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:50.813 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.813 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.813 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.813 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:50.813 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:50.813 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:50.813 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.813 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.813 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:50.813 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:50.813 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:50.813 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.814 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.814 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.814 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:50.814 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:50.814 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.814 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.814 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:50.814 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:50.814 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:50.814 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.814 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.814 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:50.814 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:50.815 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:50.815 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.815 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:50.815 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.815 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.815 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.815 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:50.815 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:50.815 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 84.703506028000007, 2024-04-26T10:43:50.815 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:50.815 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:50.815 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:50.815 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:50.815 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.815 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:50.816 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:50.816 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.816 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.816 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.816 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:50.816 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:50.816 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.816 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.816 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.816 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:50.816 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:50.816 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.816 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.816 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.817 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:50.817 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:50.817 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:50.817 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.817 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.817 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:50.817 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:50.817 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:50.817 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.817 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.817 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.817 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:50.817 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:50.817 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.818 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.818 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:50.818 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:50.818 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:50.818 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.818 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.818 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:50.818 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:50.818 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:50.818 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.818 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.818 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:50.818 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:50.818 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:50.819 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.819 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:50.819 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.819 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.819 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.819 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:50.819 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:50.819 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 84.702852469999996, 2024-04-26T10:43:50.819 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:50.819 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:50.819 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:50.819 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:50.819 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.820 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:50.820 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:50.820 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.820 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.820 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.820 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:50.820 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:50.820 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.820 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.820 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.820 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:50.820 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:50.820 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.820 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.821 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.821 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:50.821 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:50.821 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:50.821 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.821 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.821 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:50.821 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:50.821 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:50.821 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.821 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.821 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.821 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:50.822 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:50.822 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.822 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.822 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:50.822 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:50.822 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:50.822 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.822 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.822 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:50.822 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:50.822 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:50.822 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.822 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.822 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:50.823 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:50.823 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:50.823 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.823 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:50.823 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.823 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.823 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.823 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:50.823 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:50.823 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 84.702776685000003, 2024-04-26T10:43:50.823 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:50.823 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:50.823 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:50.823 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:50.824 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.824 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:50.824 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:50.824 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.824 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.824 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.824 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:50.824 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:50.824 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.824 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.824 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.824 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:50.824 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:50.824 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.824 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.825 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.825 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:50.825 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:50.825 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:50.825 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.825 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.825 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:50.825 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:50.825 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:50.825 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.825 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.825 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.825 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:50.825 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:50.826 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.826 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.826 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:50.826 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:50.826 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:50.826 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.826 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.826 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:50.826 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:50.826 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:50.826 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.826 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.826 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:50.826 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:50.826 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:50.827 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.827 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:50.827 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.827 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.827 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.827 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:50.827 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:50.827 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 84.702562990999994, 2024-04-26T10:43:50.827 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:50.827 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:50.827 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:50.827 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:50.827 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.827 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:50.828 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:50.828 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.828 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.828 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.828 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:50.828 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:50.828 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.828 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.828 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.828 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:50.828 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:50.828 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:50.828 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.828 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.828 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:50.829 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:50.829 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:50.829 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.829 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.829 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:50.829 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:50.829 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:50.829 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.829 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.829 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.829 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:50.829 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:50.829 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.829 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.830 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:50.830 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:50.830 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:50.830 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.830 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.830 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:50.830 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:50.830 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:50.830 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.830 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:50.830 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.830 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.830 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.831 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:50.831 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:50.831 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 84.700119177999994, 2024-04-26T10:43:50.831 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:50.831 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:50.831 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:50.831 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:50.831 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.831 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:50.831 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:50.831 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.831 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.831 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.831 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:50.831 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:50.832 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.832 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.832 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.832 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:50.832 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:50.832 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:50.832 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.832 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.832 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:50.832 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:50.832 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:50.832 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.832 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.832 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:50.833 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:50.833 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:50.833 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.833 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.833 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.833 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:50.833 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:50.833 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.833 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.833 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:50.833 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:50.833 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:50.833 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.833 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.833 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:50.834 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:50.834 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:50.834 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.834 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.834 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:50.834 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:50.834 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:50.834 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.834 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:50.834 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.834 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.834 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.834 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:50.834 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:50.835 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 79.250056733999998, 2024-04-26T10:43:50.835 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:50.835 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:50.835 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:50.835 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:50.835 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.835 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:50.835 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:50.835 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.835 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.835 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.835 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:50.835 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:50.835 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:50.836 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.836 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.836 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:50.836 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:50.836 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:50.836 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.836 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.836 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:50.836 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:50.836 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:50.836 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.836 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.836 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:50.836 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:50.837 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:50.837 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.837 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.837 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:50.837 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:50.837 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:50.837 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.837 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.837 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:50.837 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:50.837 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:50.837 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.837 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.837 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:50.838 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:50.838 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:50.838 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.838 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.838 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:50.838 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:50.838 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:50.838 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.838 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.838 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:50.838 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:50.838 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:50.838 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.838 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.838 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:50.839 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:50.839 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:50.839 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.839 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.839 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:50.839 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:50.839 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:50.839 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:50.839 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:50.839 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:50.839 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:50.839 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:50.839 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.839 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:50.840 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.840 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:50.840 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:50.840 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:50.841 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:50.842 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:50.840+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:50.942 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:50.941+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:50.953 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:50.953 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:50.953 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:50.953 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:50.962 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:51.046 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:51.045+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:51.107 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:51.108 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:51.108 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:51.108 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:51.108 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:51.116 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:51.158 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:51.157+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:51.245 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:51.244+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:51.264 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 85.226953370000004, 2024-04-26T10:43:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.265 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:51.266 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:51.266 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.266 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.266 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.266 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:51.266 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:51.266 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.266 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.266 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.266 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:51.266 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:51.266 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.266 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.266 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.267 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:51.267 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:51.267 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:51.267 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.267 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.267 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:51.267 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:51.267 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:51.267 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.267 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.268 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.268 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:51.268 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:51.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.268 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:51.268 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:51.268 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:51.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.268 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:51.268 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:51.268 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:51.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.269 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.269 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:51.269 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:51.269 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:51.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.269 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.269 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:51.269 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:51.269 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:51.269 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.269 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:51.270 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.270 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.270 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.270 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:51.270 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:51.270 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 85.225203249000003, 2024-04-26T10:43:51.270 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:51.270 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:51.270 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.270 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:51.270 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.270 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:51.270 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:51.270 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.271 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.271 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:51.271 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:51.271 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.271 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.271 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:51.271 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:51.271 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:51.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.271 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.271 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:51.272 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:51.272 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:51.272 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.272 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.272 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:51.272 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:51.272 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:51.272 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.272 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.272 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.272 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:51.272 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:51.272 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.272 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.273 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:51.273 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:51.273 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:51.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.273 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:51.273 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:51.273 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:51.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.273 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:51.273 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:51.273 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:51.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.274 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:51.274 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:51.274 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:51.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.274 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:51.275 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:51.275 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:51.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.275 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:51.275 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:51.275 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:51.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.275 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:51.275 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:51.276 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:51.276 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.276 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:51.276 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.276 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:51.276 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:51.276 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 85.225150251000002, 2024-04-26T10:43:51.276 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:51.276 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:51.276 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.276 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:51.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.276 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:51.277 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:51.277 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.277 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:51.277 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:51.277 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.277 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:51.277 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:51.277 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.278 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:51.278 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:51.278 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:51.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.278 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.278 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:51.278 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:51.278 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:51.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.278 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.278 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.278 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:51.278 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:51.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.279 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:51.279 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:51.279 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:51.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.279 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:51.279 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:51.279 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:51.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.279 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:51.279 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:51.280 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:51.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.280 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:51.280 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:51.280 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:51.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.280 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:51.280 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:51.280 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:51.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.281 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:51.281 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:51.281 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:51.281 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.281 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.281 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:51.281 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:51.281 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:51.281 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.281 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:51.281 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.281 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.281 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.281 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:51.282 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:51.282 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 85.225072506999993, 2024-04-26T10:43:51.282 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:51.282 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:51.282 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.282 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:51.282 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.282 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:51.282 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:51.282 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.282 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.282 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.282 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:51.283 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:51.283 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.283 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.283 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:51.283 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:51.283 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:51.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.283 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.283 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:51.283 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:51.283 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:51.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.283 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.284 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:51.284 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:51.284 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:51.284 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.284 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.284 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.284 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:51.284 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:51.284 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.284 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.284 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:51.284 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:51.284 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:51.284 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.284 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.285 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:51.285 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:51.285 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:51.285 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.285 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.285 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:51.285 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:51.285 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:51.285 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.285 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.285 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:51.285 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:51.285 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:51.285 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.285 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.286 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:51.286 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:51.286 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:51.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.286 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.286 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:51.286 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:51.286 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:51.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.286 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.286 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:51.286 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:51.286 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:51.286 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 85.225033500999999, 2024-04-26T10:43:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:51.287 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:51.288 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:51.289 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.290 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.291 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 85.225014680000001, 2024-04-26T10:43:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.292 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:51.293 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.293 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:51.293 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:51.293 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.294 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:51.294 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:51.294 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.294 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:51.294 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:51.294 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:51.296 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:51.297 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:51.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.298 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:51.298 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:51.298 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:51.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.298 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:51.298 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:51.298 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:51.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.299 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:51.299 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:51.299 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:51.299 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.299 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:51.299 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.299 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.299 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.299 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:51.299 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:51.299 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 85.224982678000003, 2024-04-26T10:43:51.299 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:51.300 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:51.300 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.300 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:51.300 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.300 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:51.300 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:51.300 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.300 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.300 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.300 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:51.300 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:51.300 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.301 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.301 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:51.301 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:51.301 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.301 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.301 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:51.301 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:51.301 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:51.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.301 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.301 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:51.302 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:51.302 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:51.302 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.302 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.302 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.302 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:51.302 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:51.302 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.302 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.302 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:51.302 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:51.302 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:51.303 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.303 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.303 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:51.303 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:51.303 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:51.303 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.303 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.303 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:51.303 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:51.303 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:51.303 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.303 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.304 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:51.304 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:51.304 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:51.304 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.304 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.304 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:51.304 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:51.304 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:51.304 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.304 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.304 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:51.304 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:51.304 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:51.305 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.305 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.305 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:51.305 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:51.305 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:51.305 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.305 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:51.305 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.305 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.305 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.305 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:51.305 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:51.306 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 85.224773870000007, 2024-04-26T10:43:51.306 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:51.306 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:51.306 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.306 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:51.306 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.306 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:51.306 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:51.306 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.306 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.306 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.306 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:51.307 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:51.307 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.307 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.307 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.307 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:51.307 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:51.308 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:51.308 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.308 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.308 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:51.308 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:51.308 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:51.308 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.308 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.309 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:51.309 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:51.309 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:51.309 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.309 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.309 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.309 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:51.309 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:51.309 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.309 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.309 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:51.309 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:51.310 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:51.310 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.310 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.310 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:51.310 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:51.310 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:51.310 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.310 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.310 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:51.311 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:51.311 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:51.311 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.311 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.311 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:51.311 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:51.311 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:51.311 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.311 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.311 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:51.312 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 85.224742578999994, 2024-04-26T10:43:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:51.313 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:51.314 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:51.314 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.314 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:51.314 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:51.314 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.314 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.314 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:51.314 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:51.314 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.315 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:51.315 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:51.315 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.315 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:51.316 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:51.316 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:51.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.316 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.316 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:51.316 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:51.316 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:51.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.316 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.316 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.316 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.317 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.318 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:51.318 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:51.318 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:51.318 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.318 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:51.318 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.318 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.318 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:51.318 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:51.318 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 85.224715329000006, 2024-04-26T10:43:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:51.319 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.320 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.321 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:51.321 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:51.321 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:51.321 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.321 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.321 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.321 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:51.321 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:51.321 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.321 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.321 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:51.321 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:51.322 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.323 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:51.323 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.323 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.323 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:51.323 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:51.323 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 85.221938578000007, 2024-04-26T10:43:51.323 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:51.323 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:51.323 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:51.323 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:51.323 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.324 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:51.324 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:51.324 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.324 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.324 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.324 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:51.324 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:51.324 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.324 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.324 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:51.325 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:51.326 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:51.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.326 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.326 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.326 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:51.326 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:51.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.326 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.326 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:51.326 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:51.326 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:51.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.327 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.327 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:51.327 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:51.327 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:51.327 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.327 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:51.327 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.327 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.327 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:51.327 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:51.328 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 85.221888488999994, 2024-04-26T10:43:51.328 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:51.328 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:51.328 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.328 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:51.328 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.328 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:51.328 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:51.328 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.329 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:51.329 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:51.329 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.329 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:51.329 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:51.329 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.330 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:51.330 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:51.330 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:51.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.330 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.330 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:51.330 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:51.330 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:51.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.330 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.331 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.331 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:51.331 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:51.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.331 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:51.331 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:51.331 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:51.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.331 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:51.332 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:51.332 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:51.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.332 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:51.332 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:51.332 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:51.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.332 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:51.332 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:51.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:51.333 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.333 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:51.333 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.333 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:51.333 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:51.333 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 85.220996420000006, 2024-04-26T10:43:51.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:51.333 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:51.334 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.334 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:51.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.334 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:51.334 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:51.334 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.334 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:51.334 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:51.335 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.335 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:51.335 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:51.335 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.335 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:51.336 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:51.336 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:51.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.336 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:51.336 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:51.336 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:51.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.337 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.337 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:51.337 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:51.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.337 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:51.337 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:51.337 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:51.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.337 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:51.337 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:51.338 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:51.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.338 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.338 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:51.338 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:51.338 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:51.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.338 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.338 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:51.338 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:51.338 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:51.339 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.339 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:51.339 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.339 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:51.339 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:51.339 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 85.218808091, 2024-04-26T10:43:51.339 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:51.339 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:51.339 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.340 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:51.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.340 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:51.340 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:51.340 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.340 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:51.340 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:51.340 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.340 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:51.341 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:51.341 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.341 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:51.341 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:51.341 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:51.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.341 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:51.341 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:51.342 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:51.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.342 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.342 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:51.342 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:51.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.342 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:51.342 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:51.342 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:51.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.343 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:51.343 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:51.343 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:51.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.343 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:51.343 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:51.343 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:51.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.344 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:51.344 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:51.344 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:51.344 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.344 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:51.344 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.344 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:51.344 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:51.344 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 85.218672721000004, 2024-04-26T10:43:51.344 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:51.345 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:51.345 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.345 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:51.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.345 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:51.345 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:51.345 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.345 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:51.345 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:51.345 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.346 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:51.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:51.346 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.346 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:51.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:51.346 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:51.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.347 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:51.347 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:51.347 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:51.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.347 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.347 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:51.347 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:51.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.348 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:51.348 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:51.348 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:51.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.348 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:51.348 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:51.348 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:51.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.349 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:51.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:51.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:51.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.349 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:51.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:51.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:51.349 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.349 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:51.349 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.350 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:51.350 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:51.350 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 85.218458147000007, 2024-04-26T10:43:51.350 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:51.350 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:51.350 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.350 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:51.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.350 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:51.350 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:51.351 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:51.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:51.351 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:51.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:51.351 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:51.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:51.352 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:51.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:51.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:51.352 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:51.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:51.353 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:51.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.353 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:51.353 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:51.353 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:51.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.353 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:51.353 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:51.353 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:51.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.354 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:51.354 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:51.354 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:51.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.354 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:51.354 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:51.354 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:51.354 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.355 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:51.355 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.355 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:51.355 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:51.355 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 85.218119205999997, 2024-04-26T10:43:51.355 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:51.355 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:51.355 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.355 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:51.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:51.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:51.356 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:51.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:51.356 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.357 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:51.357 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:51.357 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.357 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:51.357 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:51.357 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:51.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.357 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:51.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:51.358 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:51.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.358 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:51.358 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:51.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.358 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:51.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:51.358 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:51.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.359 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:51.359 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:51.359 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:51.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.359 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:51.359 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:51.359 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:51.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:51.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:51.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:51.360 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.360 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:51.360 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.360 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:51.360 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:51.360 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 85.218009828999996, 2024-04-26T10:43:51.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:51.361 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:51.361 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:51.361 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:51.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:51.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:51.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:51.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:51.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:51.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:51.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:51.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:51.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:51.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:51.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:51.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:51.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:51.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:51.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:51.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:51.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:51.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:51.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.364 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:51.364 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:51.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:51.364 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.364 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:51.364 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.364 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:51.364 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:51.364 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 85.217970109999996, 2024-04-26T10:43:51.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:51.364 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:51.365 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.365 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:51.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:51.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:51.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:51.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:51.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:51.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:51.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:51.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:51.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:51.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:51.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:51.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:51.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:51.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:51.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:51.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:51.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:51.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:51.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:51.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:51.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:51.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:51.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:51.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:51.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:51.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:51.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:51.369 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.369 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:51.369 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.369 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:51.369 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:51.369 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 85.217632577000003, 2024-04-26T10:43:51.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:51.370 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:51.370 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.370 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:51.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:51.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:51.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:51.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:51.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:51.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:51.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:51.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:51.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:51.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:51.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:51.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:51.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:51.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:51.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:51.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:51.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:51.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:51.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:51.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:51.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:51.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:51.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:51.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:51.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:51.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:51.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:51.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:51.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:51.374 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.374 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:51.374 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.374 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:51.374 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:51.374 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:51.375 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:43:51.377 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:51.377 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:51.375+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:51.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~35s 2024-04-26T10:43:51.477 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:51.476+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:51.481 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:51.481 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:51.481 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:51.481 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:51.490 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:51.578 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:51.577+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:51.591 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:51.591 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:51.591 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:51.592 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:51.592 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:51.600 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:51.679 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:51.677+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:51.690 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:43:51.704 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:51.704 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:51.704 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:51.704 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:51.704 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.704 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:51.704 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:51.705 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 85.665554121, 2024-04-26T10:43:51.705 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:51.705 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:51.705 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.705 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:51.705 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.705 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:51.705 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:51.705 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.705 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.705 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.705 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:51.706 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:51.706 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.706 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.706 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.706 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:51.706 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:51.706 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.706 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.706 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.706 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:51.706 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:51.706 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:51.706 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.707 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.707 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:51.707 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:51.707 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:51.707 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.707 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.707 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.707 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:51.707 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:51.707 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.707 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.707 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:51.707 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:51.707 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:51.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.708 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.708 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:51.708 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:51.708 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:51.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.708 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.708 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:51.708 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:51.708 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:51.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.709 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.709 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:51.709 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:51.710 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:51.710 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.710 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:51.710 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.710 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.710 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.710 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:51.710 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:51.710 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 85.664683341, 2024-04-26T10:43:51.710 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:51.710 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:51.710 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.710 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:51.711 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.711 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:51.711 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:51.711 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.711 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.711 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.711 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:51.711 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:51.711 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.711 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.711 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.711 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:51.711 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:51.711 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.711 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.712 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.712 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:51.712 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:51.712 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:51.712 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.712 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.712 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:51.712 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:51.712 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:51.712 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.712 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.712 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.712 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:51.712 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:51.713 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.713 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.713 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:51.713 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:51.713 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:51.713 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.713 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.713 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:51.713 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:51.713 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:51.713 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.713 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.713 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:51.713 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:51.713 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:51.714 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.714 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.714 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:51.714 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:51.714 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:51.714 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.714 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:51.714 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.714 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.714 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.714 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:51.714 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:51.714 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 85.663695997999994, 2024-04-26T10:43:51.714 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:51.715 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:51.715 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.715 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:51.715 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.715 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:51.715 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:51.715 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.715 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.715 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.715 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:51.715 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:51.715 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.715 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.715 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.715 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:51.716 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:51.716 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:51.716 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.716 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.716 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:51.716 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:51.716 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:51.716 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.716 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.716 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:51.716 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:51.716 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:51.716 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.716 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.716 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.717 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:51.717 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:51.717 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.717 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.717 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:51.717 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:51.717 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:51.717 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.717 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.717 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:51.717 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:51.717 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:51.717 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.717 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.717 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:51.718 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:51.718 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:51.718 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.718 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.718 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:51.718 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:51.718 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:51.718 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.718 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:51.718 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.718 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.718 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.718 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:51.718 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:51.718 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 85.663490733000003, 2024-04-26T10:43:51.719 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:51.719 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:51.719 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.719 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:51.719 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.719 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:51.719 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:51.719 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.719 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.719 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.719 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:51.719 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:51.719 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.719 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.720 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.720 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:51.720 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:51.720 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.720 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.720 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.720 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:51.720 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:51.720 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:51.720 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.720 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.720 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:51.720 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:51.720 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:51.720 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.721 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.721 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.721 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:51.721 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:51.721 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.721 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.721 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:51.721 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:51.721 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:51.721 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.721 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.721 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:51.721 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:51.721 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:51.722 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.722 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.722 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:51.722 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:51.722 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:51.722 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.722 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.722 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:51.722 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:51.722 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:51.722 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.722 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:51.722 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.723 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.723 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.723 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:51.723 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:51.723 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 85.663169854000003, 2024-04-26T10:43:51.723 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:51.723 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:51.723 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.723 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:51.723 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.723 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:51.723 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:51.723 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.723 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.724 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.724 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:51.724 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:51.724 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.724 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.724 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.724 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:51.724 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:51.724 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:51.724 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.724 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.724 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:51.724 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:51.724 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:51.724 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.725 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.725 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:51.725 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:51.725 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:51.725 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.725 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.725 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.725 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:51.725 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:51.725 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.725 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.725 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:51.725 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:51.725 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:51.725 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.726 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.726 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:51.726 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:51.726 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:51.726 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.726 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.726 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:51.726 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:51.726 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:51.726 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.726 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.726 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:51.726 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:51.726 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:51.727 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.727 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.727 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:51.727 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:51.727 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:51.727 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.727 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.727 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:51.727 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:51.727 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:51.727 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.727 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.727 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:51.727 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:51.728 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:51.728 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.728 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:51.728 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.728 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.728 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.728 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:51.728 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:51.728 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 85.663118030000007, 2024-04-26T10:43:51.728 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:51.728 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:51.728 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.728 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:51.728 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.728 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:51.729 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:51.729 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.729 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.729 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.729 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:51.729 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:51.729 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.729 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.729 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.729 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:51.729 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:51.729 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.729 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.729 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.729 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:51.730 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:51.730 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:51.730 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.730 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.730 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:51.730 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:51.730 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:51.730 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.730 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.730 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.730 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:51.730 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:51.730 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.730 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.730 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:51.731 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:51.731 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:51.731 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.731 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.731 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:51.731 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:51.731 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:51.731 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.731 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.731 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:51.731 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:51.731 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:51.731 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.731 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.731 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:51.732 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:51.732 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:51.732 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.732 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.732 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:51.732 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:51.732 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:51.732 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.732 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.732 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:51.732 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:51.732 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:51.732 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.732 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.732 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:51.733 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:51.733 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:51.733 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.733 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:51.733 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.733 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.733 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.733 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:51.733 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:51.733 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 85.663064657999996, 2024-04-26T10:43:51.733 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:51.733 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:51.733 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.733 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:51.734 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.734 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:51.734 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:51.734 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.734 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.734 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.734 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:51.734 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:51.734 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.734 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.734 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.734 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:51.734 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:51.734 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.734 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.735 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.735 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:51.735 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:51.735 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:51.735 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.735 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.735 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:51.735 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:51.735 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:51.735 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.735 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.735 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.735 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:51.736 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:51.736 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.736 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.736 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:51.736 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:51.736 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:51.736 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.736 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.736 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:51.736 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:51.736 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:51.736 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.736 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.736 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:51.736 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:51.737 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:51.737 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.737 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.737 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:51.737 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:51.737 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:51.737 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.737 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.737 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:51.737 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:51.737 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:51.737 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.737 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.737 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:51.738 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:51.738 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:51.738 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.738 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.738 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:51.738 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:51.738 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:51.738 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.738 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:51.738 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.738 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.738 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.738 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:51.738 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:51.738 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 85.663020330999998, 2024-04-26T10:43:51.739 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:51.739 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:51.739 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.739 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:51.739 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.739 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:51.739 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:51.739 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.739 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.739 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.739 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:51.739 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:51.739 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.739 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.739 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.740 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:51.740 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:51.740 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:51.740 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.740 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.740 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:51.740 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:51.740 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:51.740 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.740 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.740 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:51.740 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:51.740 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:51.740 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.740 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.741 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.741 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:51.741 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:51.741 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.741 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.741 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:51.741 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:51.741 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:51.741 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.741 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.741 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:51.741 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:51.741 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:51.741 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.741 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.742 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:51.742 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:51.742 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:51.742 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.742 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.742 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:51.742 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:51.742 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:51.742 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.742 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.742 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:51.742 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:51.742 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:51.742 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.743 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.743 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:51.743 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:51.743 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:51.743 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.743 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.743 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:51.743 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:51.743 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:51.743 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.743 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:51.743 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.743 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.743 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.743 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:51.743 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:51.744 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 85.662996617999994, 2024-04-26T10:43:51.744 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:51.744 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:51.744 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.744 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:51.744 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.744 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:51.744 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:51.744 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.744 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.744 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.744 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:51.744 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:51.744 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.744 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.745 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.745 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:51.745 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:51.745 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.745 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.745 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.745 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:51.745 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:51.745 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:51.745 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.745 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.745 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:51.745 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:51.745 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:51.746 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.746 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.746 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.746 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:51.746 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:51.746 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.746 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.746 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:51.746 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:51.746 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:51.746 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.746 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.746 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:51.746 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:51.747 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:51.747 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.747 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.747 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:51.747 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:51.747 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:51.747 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.747 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.747 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:51.747 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:51.747 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:51.747 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.747 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.748 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:51.748 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:51.748 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:51.748 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.748 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.748 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:51.748 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:51.748 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:51.748 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.748 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.748 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:51.748 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:51.748 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:51.748 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.748 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:51.749 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.749 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.749 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.749 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:51.749 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:51.749 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 85.662962312999994, 2024-04-26T10:43:51.749 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:51.749 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:51.749 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.749 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:51.749 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.749 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:51.749 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:51.749 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.749 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.750 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.750 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:51.750 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:51.750 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.750 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.750 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.750 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:51.750 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:51.750 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.750 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.750 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.750 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:51.750 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:51.750 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:51.751 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.751 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.751 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:51.751 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:51.751 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:51.751 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.751 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.751 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.751 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:51.751 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:51.751 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.751 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.751 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:51.751 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:51.751 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:51.752 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.752 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.752 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:51.752 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:51.752 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:51.752 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.752 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.752 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:51.752 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:51.752 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:51.752 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.752 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.752 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:51.752 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:51.752 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:51.753 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.753 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.753 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:51.753 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:51.753 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:51.753 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.753 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.753 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:51.753 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:51.753 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:51.753 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.753 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.753 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:51.753 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:51.753 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:51.754 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.754 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:51.754 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.754 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.754 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.754 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:51.754 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:51.754 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 85.662625716999997, 2024-04-26T10:43:51.754 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:51.754 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:51.754 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:51.754 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:51.754 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.754 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:51.755 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:51.755 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.755 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.755 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.755 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:51.755 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:51.755 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.755 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.755 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.755 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:51.755 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:51.755 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:51.755 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.755 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.755 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:51.756 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:51.756 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:51.756 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.756 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.756 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:51.756 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:51.756 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:51.756 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.756 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.756 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.756 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:51.756 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:51.756 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.756 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.756 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:51.757 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:51.757 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:51.757 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.757 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.757 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:51.757 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:51.757 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:51.757 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.757 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.757 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:51.757 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:51.757 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:51.757 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.757 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:51.757 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.758 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.758 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.758 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:51.758 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:51.758 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 85.662583689000002, 2024-04-26T10:43:51.758 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:51.758 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:51.758 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:51.758 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:51.758 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.758 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:51.758 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:51.758 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.758 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.758 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.759 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:51.759 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:51.759 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.759 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.759 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.759 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:51.759 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:51.759 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.759 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.759 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.759 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:51.759 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:51.759 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:51.759 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.760 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.760 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:51.760 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:51.760 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:51.760 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.760 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.760 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.760 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:51.760 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:51.760 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.760 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.760 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:51.760 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:51.760 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:51.760 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.761 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.761 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:51.761 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:51.761 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:51.761 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.761 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.761 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:51.761 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:51.761 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:51.761 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.761 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:51.761 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.761 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.761 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.761 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:51.762 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:51.762 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 85.662530516999993, 2024-04-26T10:43:51.762 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:51.762 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:51.762 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:51.762 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:51.762 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.762 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:51.762 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:51.762 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.762 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.762 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.762 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:51.762 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:51.762 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.763 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.763 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.763 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:51.763 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:51.763 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.763 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.763 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.763 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:51.763 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:51.763 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:51.763 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.763 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.763 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:51.763 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:51.764 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:51.764 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.764 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.764 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.764 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:51.764 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:51.764 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.764 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.764 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:51.764 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:51.764 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:51.764 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.764 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.764 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:51.764 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:51.765 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:51.765 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.765 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.765 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:51.765 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:51.765 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:51.765 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.765 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:51.765 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.765 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.765 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.765 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:51.765 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:51.765 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 85.659124106999997, 2024-04-26T10:43:51.766 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:51.766 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:51.766 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:51.766 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:51.766 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.766 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:51.766 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:51.766 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.766 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.766 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.766 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:51.766 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:51.766 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.766 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.766 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.767 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:51.767 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:51.767 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.767 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.767 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.767 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:51.767 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:51.767 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:51.767 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.767 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.767 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:51.767 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:51.767 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:51.767 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.768 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.768 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.768 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:51.768 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:51.768 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.768 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.768 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:51.768 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:51.768 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:51.768 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.768 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.768 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:51.768 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:51.768 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:51.768 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.768 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:51.769 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.769 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.769 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.769 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:51.769 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:51.769 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 85.656652154, 2024-04-26T10:43:51.769 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:51.769 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:51.769 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:51.769 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:51.769 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.769 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:51.769 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:51.769 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.769 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.770 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.770 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:51.770 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:51.770 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.770 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.770 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.770 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:51.770 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:51.770 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.770 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.770 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.770 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:51.770 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:51.770 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:51.771 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.771 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.771 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:51.771 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:51.771 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:51.771 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.771 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.771 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.771 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:51.771 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:51.771 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.771 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.771 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:51.771 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:51.771 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:51.772 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.772 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.772 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:51.772 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:51.772 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:51.772 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.772 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.772 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:51.772 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:51.772 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:51.772 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.772 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:51.772 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.772 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.773 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.773 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:51.773 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:51.773 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 85.655998596000003, 2024-04-26T10:43:51.773 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:51.773 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:51.773 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:51.773 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:51.773 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.773 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:51.773 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:51.773 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.773 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.773 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.773 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:51.774 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:51.774 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.774 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.774 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.774 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:51.774 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:51.774 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.774 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.774 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.774 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:51.774 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:51.774 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:51.774 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.774 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.775 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:51.775 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:51.775 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:51.775 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.775 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.775 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.775 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:51.775 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:51.775 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.775 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.775 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:51.775 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:51.775 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:51.775 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.775 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.776 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:51.776 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:51.776 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:51.776 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.776 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.776 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:51.776 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:51.776 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:51.776 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.776 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:51.776 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.776 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.776 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.776 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:51.776 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:51.777 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 85.655922810999996, 2024-04-26T10:43:51.777 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:51.777 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:51.777 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:51.777 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:51.777 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.777 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:51.777 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:51.777 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.777 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.777 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.777 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:51.777 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:51.777 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.777 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.778 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.778 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:51.778 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:51.778 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.778 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.778 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.778 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:51.778 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:51.778 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:51.778 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.778 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.778 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:51.778 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:51.778 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:51.779 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.779 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.779 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.779 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:51.779 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:51.779 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.779 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.779 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:51.779 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:51.779 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:51.779 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.779 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.779 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:51.779 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:51.780 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:51.780 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.780 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.780 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:51.780 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:51.780 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:51.780 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.780 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:51.780 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.780 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.780 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.780 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:51.780 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:51.780 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 85.655709117000001, 2024-04-26T10:43:51.780 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:51.781 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:51.781 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:51.781 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:51.781 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.781 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:51.781 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:51.781 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.781 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.781 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.781 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:51.781 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:51.781 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.781 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.781 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.781 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:51.782 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:51.782 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:51.782 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.782 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.782 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:51.782 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:51.782 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:51.782 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.782 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.782 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:51.782 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:51.782 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:51.782 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.782 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.782 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.783 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:51.783 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:51.783 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.783 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.783 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:51.783 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:51.783 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:51.783 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.783 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.783 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:51.783 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:51.783 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:51.783 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.783 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:51.784 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.784 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.784 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.784 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:51.784 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:51.784 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 85.653265304000001, 2024-04-26T10:43:51.784 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:51.784 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:51.784 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:51.784 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:51.784 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.784 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:51.784 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:51.784 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.784 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.784 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.785 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:51.785 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:51.785 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.785 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.785 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.785 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:51.785 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:51.785 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:51.785 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.785 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.785 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:51.785 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:51.785 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:51.785 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.785 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.786 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:51.786 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:51.786 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:51.786 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.786 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.786 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.786 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:51.786 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:51.786 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.786 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.786 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:51.786 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:51.786 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:51.786 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.786 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.787 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:51.787 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:51.787 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:51.787 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.787 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.787 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:51.787 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:51.787 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:51.787 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.787 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:51.787 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.787 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.787 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.787 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:51.787 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:51.788 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 80.203202860000005, 2024-04-26T10:43:51.788 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:51.788 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:51.788 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:51.788 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:51.788 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.788 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:51.788 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:51.788 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.788 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.788 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.788 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:51.788 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:51.788 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:51.789 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.789 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.789 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:51.789 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:51.789 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:51.789 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.789 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.789 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:51.789 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:51.789 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:51.789 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.789 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.789 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:51.789 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:51.789 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:51.790 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.790 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.790 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:51.790 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:51.790 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:51.790 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.790 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.790 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:51.790 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:51.790 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:51.790 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.790 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.790 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:51.790 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:51.790 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:51.791 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.791 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.791 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:51.791 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:51.791 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:51.791 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.791 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.791 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:51.791 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:51.791 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:51.791 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.791 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.791 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:51.791 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:51.791 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:51.792 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.792 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.792 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:51.792 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:51.792 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:51.792 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:51.792 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:51.792 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:51.792 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:51.792 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:51.792 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.792 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:51.792 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.792 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:51.792 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:51.793 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:51.794 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:51.795 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:51.793+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:51.822 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:51.823 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:51.823 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:43:51.841 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:51.842 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:51.844 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:43:51.844 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:43:51.895 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:51.894+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:51.906 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:51.906 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:51.915 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:51.996 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:51.995+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:52.021 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:52.021 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:52.030 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:52.098 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:52.097+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:52.135 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:52.136 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:52.144 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:52.198 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:52.198+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:52.248 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:52.248 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:52.256 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:52.281 INFO:teuthology.orchestra.run.smithi049.stderr:noscrub is unset 2024-04-26T10:43:52.299 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:52.298+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:52.358 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:52.358 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:52.367 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:52.400 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:52.399+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:52.501 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:52.500+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:52.507 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:52.507 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:52.516 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:52.602 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:52.601+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:52.625 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:52.625 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:52.633 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:52.703 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:52.702+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:52.739 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:52.739 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:52.748 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:52.803 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:52.802+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:52.855 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:52.855 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:52.863 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:52.907 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:52.906+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:52.967 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:52.967 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:52.976 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:53.005 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:53.005+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:53.107 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:53.106+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:53.117 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:53.117 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:53.126 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:53.208 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:53.207+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:53.227 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:53.228 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:53.236 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:53.309 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:53.308+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:53.347 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:53.349 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:53.356 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:53.410 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:53.409+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:53.461 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:53.461 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:53.469 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:53.511 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:53.510+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:53.613 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:53.612+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:53.616 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:53.617 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:53.625 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:53.714 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:53.712+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:53.731 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:53.731 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:53.740 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:53.814 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:53.813+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:53.846 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:43:53.881 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:53.881 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:53.890 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:53.916 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:53.915+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:53.978 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:43:53.991 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:53.991 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:53.997 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:53.997 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:54.000 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:43:54.000 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:43:54.001 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:54.046 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:54.045+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:54.112 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:54.113 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:54.113 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:54.113 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:54.117 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:54.116+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:54.121 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:54.218 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:54.218+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:54.267 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:54.267 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:54.267 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:54.268 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:54.268 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:54.276 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:54.414 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:43:54.416 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:54.415+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:54.517 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:54.516+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:54.523 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:54.523 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:54.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:54.523 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:54.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.523 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:54.523 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:54.523 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 88.485236694999998, 2024-04-26T10:43:54.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 88.483486573999997, 2024-04-26T10:43:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.530 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:54.530 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:54.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:54.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 88.483433575999996, 2024-04-26T10:43:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:54.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:54.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:54.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.539 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:54.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:54.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:54.539 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.539 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:54.539 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 88.483355832000001, 2024-04-26T10:43:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 88.483316826000006, 2024-04-26T10:43:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 88.483298004999995, 2024-04-26T10:43:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:54.552 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:54.552 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.552 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:54.552 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:54.552 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:54.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.552 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:54.552 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:54.552 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:54.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.552 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:54.553 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:54.553 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:54.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.553 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:54.553 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:54.553 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:54.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.553 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:54.553 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:54.553 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:54.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.554 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:54.554 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:54.554 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:54.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.554 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:54.554 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:54.554 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:54.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.554 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:54.554 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:54.554 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:54.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.555 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:54.555 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:54.555 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:54.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.555 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:54.555 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:54.555 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:54.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.555 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:54.555 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:54.556 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:54.556 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.556 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:54.556 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.556 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:54.556 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:54.556 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 88.483266002999997, 2024-04-26T10:43:54.556 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:54.556 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:54.556 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:54.556 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:54.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.557 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:54.557 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:54.557 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.557 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:54.557 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:54.557 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.557 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:54.557 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:54.557 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:54.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.558 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:54.558 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:54.558 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:54.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.558 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:54.558 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:54.558 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:54.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.558 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:54.558 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:54.559 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:54.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.559 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:54.559 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:54.559 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:54.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.559 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:54.559 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:54.559 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:54.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.559 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:54.560 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:54.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:54.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.560 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:54.560 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:54.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:54.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.560 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:54.560 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:54.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:54.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.561 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:54.561 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:54.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:54.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.561 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:54.561 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:54.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:54.561 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.561 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:54.561 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.561 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:54.561 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:54.562 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 88.483057195000001, 2024-04-26T10:43:54.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:54.562 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:54.562 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:54.562 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:54.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.562 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:54.562 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:54.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.562 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:54.562 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:54.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.563 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:54.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:54.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:54.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.563 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:54.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:54.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:54.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.563 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:54.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:54.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:54.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.564 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:54.564 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:54.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:54.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.564 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:54.564 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:54.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:54.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.564 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:54.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:54.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:54.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:54.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:54.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:54.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:54.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:54.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:54.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:54.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:54.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:54.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:54.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:54.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:54.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:54.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:54.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:54.567 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.567 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:54.567 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.567 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:54.567 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:54.567 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 88.483025904000002, 2024-04-26T10:43:54.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:54.567 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:54.567 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:54.567 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:54.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:54.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:54.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:54.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:54.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:54.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:54.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:54.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:54.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:54.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:54.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:54.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:54.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:54.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:54.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:54.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:54.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:54.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:54.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:54.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:54.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:54.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:54.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:54.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:54.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:54.572 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.572 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:54.572 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.573 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:54.573 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:54.573 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 88.482998653999999, 2024-04-26T10:43:54.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:54.573 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:54.573 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:54.573 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:54.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:54.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:54.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:54.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:54.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.574 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:54.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:54.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:54.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.574 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:54.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:54.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:54.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:54.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:54.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:54.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:54.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:54.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:54.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:54.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:54.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:54.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:54.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:54.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:54.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:54.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:54.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:54.576 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.576 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:54.576 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.576 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:54.577 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:54.577 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 88.480221903, 2024-04-26T10:43:54.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:54.577 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:54.577 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:54.577 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:54.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:54.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:54.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:54.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:54.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:54.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:54.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:54.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:54.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:54.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:54.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:54.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:54.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:54.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:54.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:54.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:54.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:54.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:54.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:54.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:54.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:54.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:54.580 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.580 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:54.580 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.580 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:54.580 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:54.580 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 88.480171814000002, 2024-04-26T10:43:54.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:54.580 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:54.580 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:54.581 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:54.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:54.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:54.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:54.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:54.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:54.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:54.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:54.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:54.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:54.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:54.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:54.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:54.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:54.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:54.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:54.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:54.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:54.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:54.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:54.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:54.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:54.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:54.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:54.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:54.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:54.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:54.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:54.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:54.584 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.584 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:54.584 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.584 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:54.584 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:54.584 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 88.479279744999999, 2024-04-26T10:43:54.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:54.585 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:54.585 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:54.585 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:54.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:54.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:54.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:54.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:54.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:54.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:54.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:54.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:54.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:54.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:54.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:54.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:54.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:54.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:54.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:54.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:54.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:54.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:54.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:54.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:54.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:54.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:54.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.588 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:54.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:54.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:54.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.588 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:54.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:54.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:54.588 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.588 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:54.588 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.588 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:54.589 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:54.589 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 88.477091415999993, 2024-04-26T10:43:54.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:54.589 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:54.589 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:54.589 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:54.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:54.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:54.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:54.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:54.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:54.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:54.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:54.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:54.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:54.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:54.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:54.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:54.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:54.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:54.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:54.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:54.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:54.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:54.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:54.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:54.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:54.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:54.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:54.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:54.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:54.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:54.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:54.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:54.593 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.593 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:54.593 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.594 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:54.594 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:54.594 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 88.476956045999998, 2024-04-26T10:43:54.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:54.594 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:54.594 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:54.594 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:54.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:54.594 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:54.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:54.594 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:54.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.595 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:54.595 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:54.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:54.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.595 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:54.595 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:54.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:54.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.595 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:54.596 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:54.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:54.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.596 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:54.596 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:54.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:54.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.596 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:54.596 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:54.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:54.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.596 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:54.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:54.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:54.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:54.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:54.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:54.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:54.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:54.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:54.597 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.597 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:54.597 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.598 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:54.598 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:54.598 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 88.476741472, 2024-04-26T10:43:54.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:54.598 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:54.598 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:54.598 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:54.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:54.598 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:54.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:54.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:54.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.599 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:54.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:54.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:54.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.599 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:54.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:54.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:54.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.600 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:54.600 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:54.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:54.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.600 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:54.600 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:54.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:54.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.600 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:54.600 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:54.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:54.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.601 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:54.601 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:54.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:54.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.601 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:54.601 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:54.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:54.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.601 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:54.601 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:54.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:54.602 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.602 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:54.602 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.602 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:54.602 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:54.602 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 88.476402531000005, 2024-04-26T10:43:54.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:54.602 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:54.602 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:54.602 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:54.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:54.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:54.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:54.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:54.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:54.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:54.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:54.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:54.604 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:54.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:54.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:54.604 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:54.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:54.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:54.604 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:54.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:54.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:54.605 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:54.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:54.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.605 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:54.605 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:54.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:54.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.605 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:54.605 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:54.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:54.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.606 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:54.606 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:54.606 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:54.606 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.606 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:54.606 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.606 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:54.606 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:54.606 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 88.476293154000004, 2024-04-26T10:43:54.606 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:54.606 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:54.607 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:54.607 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:54.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:54.607 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:54.607 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:54.607 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:54.607 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:54.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:54.608 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:54.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.608 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:54.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:54.608 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:54.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.608 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:54.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:54.608 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:54.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.609 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:54.609 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:54.609 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:54.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.609 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:54.609 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:54.609 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:54.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.609 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:54.609 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:54.609 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:54.609 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.610 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:54.610 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.610 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:54.610 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:54.610 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 88.476253435000004, 2024-04-26T10:43:54.610 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:54.610 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:54.610 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:54.610 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:54.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.610 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:54.611 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:54.611 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.611 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:54.611 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:54.611 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.611 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:54.611 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:54.611 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:54.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.611 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:54.612 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:54.612 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:54.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.612 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:54.612 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:54.612 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:54.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.612 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:54.612 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:54.612 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:54.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.613 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:54.613 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:54.613 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:54.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.613 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:54.613 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:54.613 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:54.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.613 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:54.613 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:54.613 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:54.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.614 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:54.614 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:54.614 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:54.614 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.614 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:54.614 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.614 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:54.614 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:54.614 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 88.475915901999997, 2024-04-26T10:43:54.614 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:54.614 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:54.615 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:54.615 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:54.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.615 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:54.615 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:54.615 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.615 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:54.615 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:54.615 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:54.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.615 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:54.615 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:54.616 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:54.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.616 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:54.616 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:54.616 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:54.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.616 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:54.616 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:54.616 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:54.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.616 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:54.616 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:54.617 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:54.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.617 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:54.617 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:54.617 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:54.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.617 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:54.617 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:54.617 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:54.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.617 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:54.617 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:54.618 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:54.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:54.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:54.618 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:54.618 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:54.618 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:54.618 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.618 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:54.618 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.618 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:54.618 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:54.618 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:54.620 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:54.621 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:54.619+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:54.721 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:54.720+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:54.733 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:54.733 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:54.734 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:54.734 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:54.744 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:54.822 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:54.820+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:54.846 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:54.846 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:54.846 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:54.846 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:54.847 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:54.855 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:54.940 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:54.939+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:54.998 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:54.999 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:54.999 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:54.999 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:54.999 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:54.999 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:54.999 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:54.999 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 88.960070512000001, 2024-04-26T10:43:54.999 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:54.999 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.000 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.000 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.000 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.000 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.000 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:55.000 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.000 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.000 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.000 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.000 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:55.000 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.001 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.001 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.001 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.001 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:55.001 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.001 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.001 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.001 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.001 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:55.001 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:55.001 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.001 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.002 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.002 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:55.002 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:55.002 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.002 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.002 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.002 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:55.002 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:55.002 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.002 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.002 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.003 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:55.003 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:55.003 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.003 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.003 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.003 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:55.003 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:55.003 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.003 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.003 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:55.003 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:55.004 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:55.004 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.004 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.004 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.004 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:55.004 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:55.004 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.004 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.004 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.004 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.004 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.005 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:55.005 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:55.005 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 88.959199732000002, 2024-04-26T10:43:55.005 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:55.005 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.005 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.005 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.005 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.005 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.005 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:55.006 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.006 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.006 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.007 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.007 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:55.007 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.007 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.007 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.007 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.007 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:55.007 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.007 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.007 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.007 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.007 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:55.007 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:55.008 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.008 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.008 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.008 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:55.008 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:55.008 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.008 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.008 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.008 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:55.008 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:55.008 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.008 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.008 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.008 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:55.009 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:55.009 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.009 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.009 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.009 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:55.009 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:55.009 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.009 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.009 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:55.009 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:55.009 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:55.009 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.009 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.009 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.010 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:55.010 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:55.010 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.010 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.010 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.010 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.010 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.010 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:55.010 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:55.010 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 88.958212388999996, 2024-04-26T10:43:55.010 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:55.010 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.010 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.011 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.011 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.011 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.011 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:55.011 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.011 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.011 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.011 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.011 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:55.011 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.011 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.011 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.011 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.011 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:55.012 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:55.012 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.012 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.012 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.012 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:55.012 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:55.012 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.012 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.012 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.012 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:55.012 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:55.012 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.012 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.012 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.012 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:55.013 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:55.013 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.013 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.013 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.013 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:55.013 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:55.013 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.013 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.013 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.013 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:55.013 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:55.013 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.013 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.013 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:55.014 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:55.014 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:55.014 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.014 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.014 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.014 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:55.014 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:55.014 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.014 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.014 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.014 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.014 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.014 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:55.015 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:55.015 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 88.958007124000005, 2024-04-26T10:43:55.015 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:55.015 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.015 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.015 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.015 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.015 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.015 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:55.015 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.015 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.015 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.015 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.015 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:55.016 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.016 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.016 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.016 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.016 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:55.016 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.016 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.016 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.016 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.016 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:55.016 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:55.016 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.016 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.016 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.017 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:55.017 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:55.017 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.017 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.017 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.017 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:55.017 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:55.017 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.017 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.017 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.017 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:55.017 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:55.017 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.017 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.018 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.018 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:55.018 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:55.018 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.018 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.018 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:55.018 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:55.018 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:55.018 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.018 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.018 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.018 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:55.018 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:55.018 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.019 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.019 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.019 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.019 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.019 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.019 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:55.019 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 88.957686245000005, 2024-04-26T10:43:55.019 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:55.019 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.019 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.019 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.019 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.019 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.019 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:55.020 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.020 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.020 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.020 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.020 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:55.020 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.020 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.020 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.020 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.020 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:55.020 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:55.020 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.020 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.021 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.021 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:55.021 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:55.021 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.021 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.021 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.021 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:55.021 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:55.021 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.021 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.021 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.021 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:55.021 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:55.021 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.021 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.022 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.022 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:55.022 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:55.022 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.022 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.022 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.022 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:55.022 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:55.022 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.022 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.022 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:55.022 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:55.022 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:55.023 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.023 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.023 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:55.023 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:55.023 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:55.023 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.023 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.023 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:55.023 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:55.023 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:55.023 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.023 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.023 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:55.023 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:55.024 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:55.024 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.024 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.024 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.024 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:55.024 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:55.024 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.024 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.024 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.024 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.024 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.024 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.024 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:55.024 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 88.957634420999995, 2024-04-26T10:43:55.025 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:55.025 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.025 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.025 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.025 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.025 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.025 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:55.025 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.025 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.025 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.025 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.025 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:55.025 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.025 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.026 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.026 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:55.026 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.026 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.026 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.026 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:55.026 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:55.026 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.026 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.026 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:55.026 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:55.027 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.027 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.027 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.027 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:55.027 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:55.027 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.027 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.027 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.027 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:55.027 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:55.027 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.027 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.027 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.027 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:55.027 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:55.028 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.028 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.028 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:55.028 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:55.028 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:55.028 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.028 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.028 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:55.028 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:55.028 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:55.028 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.028 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.028 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:55.028 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:55.028 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:55.029 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.029 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.029 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:55.029 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:55.029 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:55.029 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.029 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.029 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.029 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:55.029 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:55.029 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.029 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.029 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.030 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.030 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.030 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.030 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:55.030 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 88.957581048999998, 2024-04-26T10:43:55.030 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:55.030 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.030 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.030 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.030 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.030 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.030 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:55.030 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.030 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.030 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.031 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.031 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:55.031 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.031 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.031 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.031 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:55.031 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.031 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.031 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.031 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:55.031 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:55.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.032 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.032 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:55.032 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:55.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.032 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.032 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:55.032 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:55.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.032 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.032 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:55.032 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:55.033 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.033 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.033 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.033 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:55.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:55.033 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.033 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.033 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:55.033 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:55.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:55.033 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.033 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.033 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:55.033 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:55.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:55.034 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.034 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.034 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:55.034 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:55.034 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:55.034 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.034 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.034 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:55.034 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:55.034 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:55.034 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.034 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.034 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.035 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:55.035 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:55.035 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.035 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.035 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.035 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.035 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.035 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.035 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:55.035 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 88.957536722, 2024-04-26T10:43:55.035 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:55.035 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.035 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.035 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.035 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.036 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.036 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:55.036 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.036 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.036 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.036 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.036 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:55.036 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.036 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.036 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.036 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.036 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:55.036 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:55.036 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.037 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.037 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.037 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:55.037 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:55.037 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.037 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.037 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.037 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:55.037 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:55.037 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.037 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.037 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.037 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:55.037 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:55.037 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.038 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.038 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.038 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:55.038 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:55.038 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.038 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.038 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.038 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:55.038 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:55.038 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.038 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.038 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:55.038 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:55.039 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:55.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.039 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:55.039 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:55.039 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:55.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.039 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:55.039 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:55.039 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:55.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.039 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:55.039 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:55.040 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:55.040 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.040 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.040 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.040 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:55.040 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:55.040 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.040 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.040 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.040 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.040 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.040 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.040 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:55.040 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 88.957513008999996, 2024-04-26T10:43:55.041 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:55.041 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.041 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.041 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.041 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.041 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.041 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:55.041 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.041 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.041 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.041 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.041 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:55.041 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.041 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.042 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:55.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.042 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.042 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:55.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:55.042 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.042 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:55.043 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:55.043 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.043 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.043 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.043 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:55.043 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:55.043 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.043 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.043 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.043 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:55.043 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:55.043 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.043 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.043 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.044 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:55.044 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:55.044 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.044 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.044 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:55.044 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:55.044 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:55.044 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.044 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.044 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:55.044 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:55.044 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:55.044 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.044 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.045 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:55.045 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:55.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:55.045 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.045 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.045 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:55.045 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:55.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:55.045 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.045 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.045 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.045 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:55.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:55.045 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.046 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.046 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.046 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.046 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.046 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.046 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:55.046 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 88.957478703999996, 2024-04-26T10:43:55.046 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:55.046 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.046 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.046 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.046 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.046 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.047 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:55.047 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.047 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.047 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.047 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.047 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:55.047 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.047 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.047 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.047 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.047 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:55.047 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.047 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.047 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.047 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.048 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:55.048 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:55.048 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.048 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.048 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.048 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:55.048 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:55.048 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.048 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.048 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.048 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:55.048 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:55.048 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.048 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.049 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.049 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:55.049 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:55.049 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.049 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.049 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.049 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:55.049 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:55.049 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.049 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.049 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:55.049 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:55.049 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:55.049 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.050 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:55.050 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:55.050 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:55.050 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.050 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:55.050 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:55.050 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:55.050 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.050 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:55.050 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:55.050 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:55.051 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.051 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.051 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.051 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:55.051 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:55.051 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.051 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.051 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.051 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.051 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.051 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.051 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:55.051 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 88.957142107999999, 2024-04-26T10:43:55.051 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:55.052 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.052 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:55.052 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.052 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.052 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.052 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:55.052 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.052 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.052 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.052 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.052 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:55.053 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.053 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.053 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.053 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.053 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:55.053 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:55.053 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.053 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.053 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.053 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:55.053 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:55.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.054 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.054 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:55.054 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:55.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.054 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.054 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:55.054 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:55.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.054 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.054 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:55.055 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:55.055 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.055 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.055 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.055 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:55.055 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:55.055 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.055 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.055 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.055 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:55.055 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:55.055 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.055 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.055 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.055 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.056 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.056 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:55.056 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 88.957100080000004, 2024-04-26T10:43:55.056 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:55.056 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.056 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:55.056 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.056 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.056 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:55.056 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.056 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.057 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.057 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:55.057 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.057 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.057 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.057 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.057 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:55.057 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.057 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.057 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.057 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.057 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:55.057 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:55.057 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.058 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.058 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.058 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:55.058 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:55.058 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.058 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.058 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.058 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:55.058 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:55.058 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.058 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.058 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.058 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:55.059 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:55.059 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.059 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.059 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.059 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:55.059 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:55.059 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.059 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.059 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.059 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:55.059 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:55.059 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.059 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.059 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.060 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.060 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.060 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.060 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:55.060 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 88.957046907999995, 2024-04-26T10:43:55.060 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:55.060 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.060 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:55.060 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.060 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.060 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.060 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:55.060 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.060 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.061 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.061 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.061 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:55.061 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.061 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.061 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.061 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.061 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:55.061 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.061 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.061 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.061 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.061 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:55.061 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:55.061 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.062 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.062 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.062 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:55.062 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:55.062 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.062 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.062 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.062 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:55.062 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:55.062 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.062 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.062 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.062 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:55.062 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:55.063 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.063 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.063 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.063 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:55.063 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:55.063 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.063 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.063 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.063 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:55.063 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:55.063 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.063 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.063 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.063 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.064 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.064 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:55.064 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:55.064 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 88.953640497999999, 2024-04-26T10:43:55.064 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:55.064 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.064 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:55.064 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.064 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.064 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.064 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:55.064 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.064 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.064 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.065 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:55.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.065 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:55.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.065 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:55.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:55.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.066 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.066 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.066 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:55.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:55.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.066 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.066 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.066 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:55.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:55.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.066 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.066 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.066 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:55.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:55.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.067 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.067 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.067 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:55.067 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:55.067 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.067 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.067 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.067 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.067 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:55.067 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:55.067 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 88.951168545000002, 2024-04-26T10:43:55.067 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:55.068 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.068 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:55.068 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.068 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.068 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.068 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:55.068 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.068 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.068 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.068 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.068 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:55.068 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.068 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.068 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.069 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.069 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:55.069 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.069 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.069 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.069 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.069 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:55.069 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:55.069 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.069 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.069 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.069 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:55.069 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:55.069 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.069 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.070 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.070 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:55.070 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:55.070 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.070 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.070 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.070 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:55.070 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:55.070 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.070 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.070 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.070 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:55.070 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:55.071 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.071 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.071 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.071 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:55.071 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:55.071 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.071 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.071 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.071 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.071 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.071 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:55.071 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:55.071 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 88.950514987000005, 2024-04-26T10:43:55.071 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:55.072 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.072 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:55.072 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.072 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.072 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.072 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:55.072 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.072 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.072 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.072 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.072 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:55.072 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.072 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.072 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.073 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.073 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:55.073 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.073 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.073 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.073 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.073 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:55.073 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:55.073 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.073 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.073 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.073 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:55.073 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:55.073 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.074 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.074 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.074 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:55.074 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:55.074 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.074 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.074 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.074 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:55.074 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:55.074 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.074 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.074 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.074 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:55.074 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:55.075 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.075 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.075 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.075 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:55.075 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:55.075 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.075 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.075 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.075 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.075 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.075 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:55.075 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:55.075 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 88.950439201999998, 2024-04-26T10:43:55.075 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:55.076 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.076 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:55.076 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.076 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.076 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.076 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:55.076 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.076 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.076 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.076 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.076 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:55.076 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.076 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.076 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.077 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.077 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:55.077 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.077 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.077 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.077 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.077 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:55.077 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:55.077 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.077 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.077 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.077 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:55.077 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:55.077 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.078 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.078 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.078 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:55.078 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:55.078 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.078 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.078 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.078 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:55.078 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:55.078 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.078 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.078 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.078 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:55.079 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:55.079 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.079 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.079 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.079 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:55.079 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:55.079 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.079 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.079 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.079 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.079 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.079 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:55.079 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:55.079 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 88.950225508000003, 2024-04-26T10:43:55.080 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:55.080 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.080 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:55.080 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.080 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.080 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.080 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:55.080 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.080 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.080 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.080 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.080 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:55.080 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.080 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.081 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.081 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.081 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:55.081 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.081 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.081 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.081 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.081 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:55.081 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:55.081 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.081 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.081 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.081 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:55.081 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:55.082 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.082 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.082 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.082 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:55.082 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:55.082 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.082 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.082 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.082 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:55.082 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:55.082 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.082 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.082 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.082 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:55.083 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:55.083 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.083 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.083 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.083 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.083 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.083 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:55.083 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:55.083 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 88.947781695000003, 2024-04-26T10:43:55.083 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:55.083 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.083 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:55.083 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.083 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.083 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.084 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:55.084 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.084 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.084 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.084 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.084 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:55.084 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.084 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.084 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.084 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.084 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:55.084 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:55.084 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.084 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.085 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.085 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:55.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:55.085 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.085 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.085 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.085 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:55.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:55.085 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.085 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.085 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.085 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:55.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:55.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.086 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.086 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.086 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:55.086 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:55.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.086 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.086 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.086 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:55.086 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:55.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.086 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.086 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.087 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:55.087 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:55.087 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.087 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.087 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.087 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.087 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.087 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:55.087 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:55.087 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 83.497719251000007, 2024-04-26T10:43:55.087 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:55.087 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.087 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.087 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.088 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.088 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.088 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:55.088 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.088 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.088 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.088 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.088 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:55.088 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.088 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.088 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.088 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.088 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:55.088 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:55.088 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.089 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.089 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.089 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:55.089 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:55.089 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.089 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.089 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.089 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:55.089 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:55.089 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.089 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.089 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.089 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:55.089 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:55.090 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.090 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.090 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.090 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:55.090 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:55.090 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.090 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.090 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.090 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:55.090 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:55.090 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.090 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.090 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:55.090 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:55.091 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:55.091 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.091 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.091 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:55.091 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:55.091 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:55.091 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.091 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.091 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:55.091 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:55.091 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:55.091 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.091 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.091 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:55.091 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:55.092 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:55.092 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.092 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.092 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.092 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:55.092 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:55.092 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.092 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.092 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.092 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.092 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.092 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:55.094 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:55.094 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:55.093+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:55.195 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:55.194+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:55.209 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:55.209 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:55.210 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:55.210 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:55.219 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:55.284 INFO:teuthology.orchestra.run.smithi049.stderr:nodeep-scrub is unset 2024-04-26T10:43:55.295 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:55.294+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:55.326 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:55.326 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:55.326 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:55.326 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:55.326 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:55.335 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:55.397 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:55.395+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:55.442 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 89.404408812, 2024-04-26T10:43:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 89.402658690999999, 2024-04-26T10:43:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 89.402605692999998, 2024-04-26T10:43:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 89.402527949000003, 2024-04-26T10:43:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 89.402488942999994, 2024-04-26T10:43:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 89.402470121999997, 2024-04-26T10:43:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 89.402438119999999, 2024-04-26T10:43:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 89.402229312000003, 2024-04-26T10:43:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 89.402198021000004, 2024-04-26T10:43:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 89.402170771000002, 2024-04-26T10:43:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 89.399394020000003, 2024-04-26T10:43:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 89.399343931000004, 2024-04-26T10:43:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 89.398451862000002, 2024-04-26T10:43:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:55.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 89.396263532999996, 2024-04-26T10:43:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:55.506 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:55.507 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.508 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:55.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.510 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 89.396128163, 2024-04-26T10:43:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:55.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:55.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 89.395913589000003, 2024-04-26T10:43:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.515 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:55.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:55.519 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 89.395574647999993, 2024-04-26T10:43:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:55.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:55.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 89.395465271000006, 2024-04-26T10:43:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:55.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.527 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 89.395425552000006, 2024-04-26T10:43:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:55.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:55.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:55.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.530 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:55.530 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:55.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:55.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.530 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:55.530 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:55.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:55.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:55.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:55.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:55.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:55.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:55.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:55.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:55.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:55.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.532 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:55.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:55.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:55.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.532 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 89.395088018999999, 2024-04-26T10:43:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:55.533 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:55.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:55.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:55.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:55.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:55.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:55.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:55.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.536 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.536 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:55.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:55.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.536 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:55.536 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:55.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:55.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.536 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:55.537 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.538 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:55.538 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:55.538 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:55.539 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:55.540 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:55.538+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:55.640 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:55.639+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:55.643 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:55.643 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:55.643 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:55.643 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:55.653 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:55.741 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:55.740+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:55.753 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:55.753 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:55.753 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:55.753 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:55.753 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:55.762 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:55.848 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:55.847+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:55.908 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 89.870154803999995, 2024-04-26T10:43:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 89.869284023999995, 2024-04-26T10:43:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 89.868296681000004, 2024-04-26T10:43:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 89.868091415999999, 2024-04-26T10:43:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 89.867770536999998, 2024-04-26T10:43:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 89.867718713000002, 2024-04-26T10:43:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 89.867665341000006, 2024-04-26T10:43:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 89.867621013999994, 2024-04-26T10:43:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 89.867597301000004, 2024-04-26T10:43:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 89.867562996000004, 2024-04-26T10:43:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 89.867226400000007, 2024-04-26T10:43:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 89.867184371999997, 2024-04-26T10:43:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 89.867131200000003, 2024-04-26T10:43:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 89.863724790000006, 2024-04-26T10:43:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 89.861252836999995, 2024-04-26T10:43:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 89.860599278999999, 2024-04-26T10:43:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.981 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.981 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.981 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.981 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:55.981 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.981 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.981 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.981 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.981 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:55.981 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:55.981 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.981 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.981 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.982 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:55.982 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:55.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.982 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.982 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.982 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:55.982 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:55.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.982 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.982 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.982 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:55.982 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:55.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.982 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.983 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.983 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:55.983 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:55.983 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.983 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.983 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.983 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:55.983 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:55.983 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.983 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.983 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.983 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.983 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.983 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:55.983 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:55.984 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 89.860523494000006, 2024-04-26T10:43:55.984 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:55.984 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.984 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:55.984 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.984 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.984 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.984 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:55.984 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.984 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.984 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.984 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.984 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:55.984 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.985 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.985 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.985 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.985 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:55.985 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.985 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.985 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.985 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.985 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:55.985 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:55.985 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.985 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.985 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.985 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:55.986 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:55.986 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.986 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.986 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.986 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:55.986 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:55.986 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.986 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.986 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.986 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:55.986 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:55.986 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.986 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.987 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.987 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:55.987 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:55.987 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.987 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.987 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.987 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:55.987 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:55.987 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.987 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.987 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.987 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.987 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.987 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:55.988 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:55.988 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 89.860309799999996, 2024-04-26T10:43:55.988 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:55.988 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.988 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:55.988 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.988 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.988 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.988 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:55.988 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.988 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.988 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.988 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.989 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:55.989 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.989 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.989 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.989 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.989 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:55.989 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:55.989 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.989 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.989 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.989 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:55.989 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:55.989 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.990 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.990 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.990 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:55.990 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:55.990 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.990 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.990 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.990 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:55.990 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:55.990 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.990 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.990 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.990 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:55.990 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:55.991 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.991 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.991 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.991 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:55.991 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:55.991 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.991 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.991 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.991 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.991 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.991 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:55.991 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:55.991 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 89.857865986999997, 2024-04-26T10:43:55.991 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:55.992 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.992 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:55.992 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.992 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.992 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.992 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:55.992 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.992 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.992 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.992 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.992 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:55.992 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.992 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.992 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.993 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.993 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:55.993 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:55.993 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.993 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.993 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.993 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:55.993 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:55.993 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.993 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.993 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.993 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:55.993 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:55.993 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.994 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.994 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.994 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:55.994 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:55.994 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.994 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.994 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.994 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:55.994 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:55.994 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.994 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.994 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.994 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:55.995 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:55.995 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.995 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.995 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:55.995 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:55.995 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:55.995 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.995 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:55.995 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:55.995 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.995 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.995 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:55.996 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:55.996 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 84.407803543, 2024-04-26T10:43:55.996 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:55.996 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:55.996 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:55.996 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:55.996 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.996 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:55.996 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:55.996 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.996 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.996 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.996 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:55.996 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:55.997 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:55.997 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.997 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.997 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:55.997 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:55.997 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:55.997 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.997 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.997 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:55.997 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:55.997 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:55.997 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.998 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.998 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:55.998 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:55.998 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:55.998 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.998 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.998 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:55.998 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:55.998 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:55.998 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.998 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.998 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:55.998 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:55.999 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:55.999 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.999 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.999 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:55.999 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:55.999 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:55.999 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.999 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.999 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:55.999 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:55.999 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:55.999 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:55.999 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:55.999 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:55.999 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:56.000 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:56.000 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:56.000 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:56.000 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:56.000 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:56.000 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:56.000 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:56.000 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:56.000 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:56.000 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:56.000 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:56.000 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:56.000 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:56.000 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:56.000 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:56.001 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:56.001 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:56.001 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:56.001 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:56.001 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:56.001 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:56.001 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:56.001 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:43:56.003 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:56.001+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:56.004 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:56.103 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:56.101+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:56.119 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:56.119 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:56.119 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:56.128 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:56.129 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:56.130 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:56.130 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:43:56.148 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:56.149 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:56.151 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:43:56.152 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:43:56.204 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:56.203+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:56.235 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:56.235 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:56.243 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:56.305 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:56.304+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:56.389 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:56.390 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:56.399 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:56.443 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:56.442+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:56.502 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:56.503 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:56.507 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:56.506+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:56.511 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:56.608 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:56.606+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:56.652 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:56.652 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:56.661 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:56.708 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:56.708+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:56.803 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:56.803 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:56.809 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:56.808+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:56.813 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:56.911 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:56.910+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:56.921 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:56.921 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:56.930 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:57.012 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:57.011+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:57.035 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:57.036 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:57.044 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:57.113 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:57.112+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:57.150 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:57.150 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:57.159 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:57.214 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:57.213+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:57.262 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:57.263 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:57.271 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:57.282 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~41s 2024-04-26T10:43:57.300 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:43:57.315 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:57.314+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:57.374 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:57.374 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:57.383 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:57.424 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:57.422+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:57.517 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:57.516+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:57.523 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:57.523 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:57.532 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:57.617 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:57.616+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:57.643 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:57.643 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:57.652 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:57.719 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:57.717+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:57.797 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:57.798 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:57.806 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:57.820 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:57.818+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:57.912 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:57.912 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:57.920 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:57.921 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:57.919+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:58.021 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:58.021+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:58.023 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:58.023 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:58.032 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:58.123 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:58.122+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:58.133 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:58.133 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:58.142 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:58.153 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:43:58.223 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:58.222+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:58.244 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:43:58.244 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:43:58.255 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:58.281 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:43:58.281 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:43:58.281 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:43:58.299 INFO:teuthology.orchestra.run.smithi049.stderr:noscrub is set 2024-04-26T10:43:58.303 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:43:58.303 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:43:58.306 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:43:58.307 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:43:58.325 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:58.324+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:58.365 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:58.365 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:58.365 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:58.365 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:58.374 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:58.426 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:58.425+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:58.480 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:58.480 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:58.480 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:58.480 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:58.480 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:58.489 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:58.527 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:58.526+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:58.597 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:58.597 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:58.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:58.597 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:58.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.598 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:58.598 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:58.598 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 92.558657698999994, 2024-04-26T10:43:58.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:58.599 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:58.599 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:58.599 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:58.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.599 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:58.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:58.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.601 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:58.601 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:58.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.601 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:58.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:58.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:58.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:58.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:58.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:58.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:58.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:58.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:58.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:58.604 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:58.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:58.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:58.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 92.556907577999993, 2024-04-26T10:43:58.606 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:58.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.609 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.611 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 92.556854580000007, 2024-04-26T10:43:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:58.612 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:58.613 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:58.614 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.616 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 92.556776835999997, 2024-04-26T10:43:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:58.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:58.618 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:58.619 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:58.620 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:58.621 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 92.556737830000003, 2024-04-26T10:43:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.623 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.624 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.625 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.626 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:58.627 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 92.556719009000005, 2024-04-26T10:43:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:58.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:58.630 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:58.631 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 92.556687006999994, 2024-04-26T10:43:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.633 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.634 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.635 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.636 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.637 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 92.556478198999997, 2024-04-26T10:43:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:58.638 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:58.639 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:58.640 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.641 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:58.642 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 92.556446907999998, 2024-04-26T10:43:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:58.643 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:58.644 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:58.645 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.646 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 92.556419657999996, 2024-04-26T10:43:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:58.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:58.650 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 92.553642906999997, 2024-04-26T10:43:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:58.651 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.652 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:58.652 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:58.652 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.652 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:58.652 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:58.652 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:58.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.652 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:58.652 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:58.652 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:58.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.653 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:58.653 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:58.653 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:58.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.653 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:58.653 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:58.653 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:58.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.653 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:58.653 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:58.653 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 92.553592817999998, 2024-04-26T10:43:58.654 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.658 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:58.659 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:58.659 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 92.552700748999996, 2024-04-26T10:43:58.659 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:58.659 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:58.659 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:58.659 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:58.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.659 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:58.659 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:58.659 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.659 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:58.659 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:58.659 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.660 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:58.660 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:58.660 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:58.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.660 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:58.660 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:58.660 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:58.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.660 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:58.660 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:58.660 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:58.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.661 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:58.661 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:58.661 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:58.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.661 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:58.661 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:58.661 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:58.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.661 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:58.661 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:58.662 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:58.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.662 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.662 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:58.662 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:58.662 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:58.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.662 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.662 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:58.662 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:58.662 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:58.662 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.662 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:58.662 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.663 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:58.663 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:58.663 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 92.550512420000004, 2024-04-26T10:43:58.663 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:58.663 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:58.663 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:58.663 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:58.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.663 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:58.663 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:58.663 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.663 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:58.664 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:58.664 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.664 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:58.664 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:58.664 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:58.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.664 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:58.664 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:58.664 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:58.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.664 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:58.664 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:58.665 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:58.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.665 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:58.665 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:58.665 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:58.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.665 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:58.665 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:58.665 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:58.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.665 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:58.665 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:58.666 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:58.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.666 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:58.666 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:58.666 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:58.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.669 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:58.670 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:58.670 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:58.670 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.670 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:58.670 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.670 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:58.670 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:58.670 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 92.550377049999994, 2024-04-26T10:43:58.670 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:58.670 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:58.670 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:58.670 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:58.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.671 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:58.671 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:58.671 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.671 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:58.671 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:58.671 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.671 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:58.671 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:58.671 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:58.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.672 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:58.672 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:58.672 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:58.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.672 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:58.672 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:58.672 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:58.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.672 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:58.672 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:58.672 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:58.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.673 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:58.673 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:58.673 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:58.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.673 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:58.673 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:58.673 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:58.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.673 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:58.673 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:58.673 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:58.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.674 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:58.674 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:58.674 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:58.674 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.674 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:58.674 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.674 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:58.674 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:58.674 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 92.550162475999997, 2024-04-26T10:43:58.674 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:58.674 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:58.675 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:58.675 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:58.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.675 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:58.675 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:58.675 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.675 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:58.675 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:58.675 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.675 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:58.675 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:58.676 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:58.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.676 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:58.676 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:58.676 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:58.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.676 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:58.676 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:58.676 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:58.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.676 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:58.676 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:58.677 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:58.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.677 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:58.677 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:58.677 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:58.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.677 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:58.677 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:58.677 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:58.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.677 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:58.677 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:58.678 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:58.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.678 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:58.678 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:58.678 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:58.678 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.678 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:58.678 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.678 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:58.678 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:58.678 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 92.549823535000002, 2024-04-26T10:43:58.679 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:58.679 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:58.679 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:58.679 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:58.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.679 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:58.679 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:58.679 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.679 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:58.679 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:58.679 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.680 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:58.680 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:58.680 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:58.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.680 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:58.680 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:58.680 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:58.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.680 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:58.680 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:58.680 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:58.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.681 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:58.681 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:58.681 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:58.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.681 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:58.681 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:58.681 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:58.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.681 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:58.681 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:58.681 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:58.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.682 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:58.682 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:58.682 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:58.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.682 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:58.682 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:58.682 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:58.682 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.682 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:58.682 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.682 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:58.683 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:58.683 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 92.549714158, 2024-04-26T10:43:58.683 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:58.683 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:58.683 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:58.683 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:58.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.683 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:58.683 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:58.683 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.683 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:58.683 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:58.683 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.684 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:58.684 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:58.684 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:58.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.684 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:58.685 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:58.685 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:58.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.685 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:58.685 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:58.685 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:58.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.685 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:58.685 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:58.685 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:58.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.686 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:58.686 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:58.686 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:58.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.686 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:58.686 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:58.686 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:58.686 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.686 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:58.686 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.686 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:58.686 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:58.687 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 92.549674439, 2024-04-26T10:43:58.687 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:58.687 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:58.687 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:58.687 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:58.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.687 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:58.687 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:58.687 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.687 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:58.687 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:58.687 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.688 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:58.688 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:58.688 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:58.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.688 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:58.688 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:58.688 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:58.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.688 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:58.688 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:58.688 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:58.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.689 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:58.689 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:58.689 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:58.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.689 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:58.689 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:58.689 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:58.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.689 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:58.689 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:58.690 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:58.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.690 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:58.690 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:58.690 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:58.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.690 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:58.690 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:58.690 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:58.690 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.690 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:58.690 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.691 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:58.691 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:58.691 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 92.549336905999994, 2024-04-26T10:43:58.691 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:58.691 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:58.691 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:58.691 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:58.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.691 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:58.691 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:58.691 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.691 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:58.692 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:58.692 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:58.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.692 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:58.692 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:58.692 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:58.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.692 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:58.692 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:58.692 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:58.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.692 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:58.693 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:58.693 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:58.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.693 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:58.693 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:58.693 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:58.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.693 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:58.693 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:58.693 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:58.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.693 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:58.694 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:58.694 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:58.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.694 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:58.694 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:58.694 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:58.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:58.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:58.694 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:58.694 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:58.694 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:58.694 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.694 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:58.694 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.695 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:58.695 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:58.695 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:58.696 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:58.697 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:58.695+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:58.797 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:58.795+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:58.799 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:58.799 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:58.799 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:58.799 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:58.808 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:58.898 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:58.897+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:58.949 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:58.950 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:58.950 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:58.950 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:58.950 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:58.959 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:59.003 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:59.002+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:59.063 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:59.063 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:59.063 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:59.063 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:59.063 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.063 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:59.063 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:59.063 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.024169255999993, 2024-04-26T10:43:59.063 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:59.064 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.064 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.064 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.064 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.064 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.064 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:59.064 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.064 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.064 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.064 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.064 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:59.064 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.064 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.064 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.065 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:59.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.065 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:59.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:59.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.065 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:59.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:59.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.066 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.066 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:59.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:59.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.066 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.066 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.066 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:59.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:59.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.066 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.066 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:59.066 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:59.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:59.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.067 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.067 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:59.067 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:59.067 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:59.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.067 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.067 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.067 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:59.067 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:59.067 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.067 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.067 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.068 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.068 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:59.068 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:59.068 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.023298475999994, 2024-04-26T10:43:59.068 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:59.068 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.068 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.069 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.069 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.069 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.069 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:59.069 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.069 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.069 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.069 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.069 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:59.069 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.069 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.069 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.069 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.069 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:59.069 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.070 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.070 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.070 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.070 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:59.070 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:59.070 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.070 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.070 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.070 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:59.070 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:59.070 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.070 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.070 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.070 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:59.071 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:59.071 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.071 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.071 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.071 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:59.071 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:59.071 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.071 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.071 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:59.071 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:59.071 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:59.071 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.071 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.071 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:59.071 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:59.072 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:59.072 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.072 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.072 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.072 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:59.072 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:59.072 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.072 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.072 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.072 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.072 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.072 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:59.072 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:59.072 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.022311133000002, 2024-04-26T10:43:59.072 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:59.073 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.073 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.073 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.073 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.073 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.073 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:59.073 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.073 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.073 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.073 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.073 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:59.073 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.073 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.073 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.073 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.074 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:59.074 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:59.074 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.074 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.074 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.074 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:59.074 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:59.074 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.074 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.074 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.074 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:59.074 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:59.074 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.074 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.074 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.075 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:59.075 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:59.075 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.075 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.075 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.075 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:59.075 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:59.075 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.075 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.075 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:59.075 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:59.075 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:59.075 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.075 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.075 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:59.076 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:59.076 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:59.076 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.076 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.076 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.076 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:59.076 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:59.076 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.076 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.076 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.076 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.076 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.077 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:59.077 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:59.077 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.022105867999997, 2024-04-26T10:43:59.077 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:59.077 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.077 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.077 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.077 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.077 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.077 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:59.077 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.077 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.077 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.077 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.078 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:59.078 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.078 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.078 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.078 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.078 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:59.082 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.082 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.082 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.082 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.082 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:59.082 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:59.082 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.082 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.082 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.082 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:59.082 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:59.082 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.082 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.083 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.083 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:59.083 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:59.083 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.083 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.083 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.083 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:59.083 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:59.083 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.083 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.083 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:59.083 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:59.083 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:59.083 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.083 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.084 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:59.084 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:59.084 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:59.084 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.084 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.084 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.084 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:59.084 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:59.084 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.084 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.084 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.084 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.084 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.084 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:59.085 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:59.085 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.021784988999997, 2024-04-26T10:43:59.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:59.085 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.085 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.085 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.085 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.085 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.085 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:59.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.085 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.085 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.085 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.085 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:59.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.086 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.086 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.086 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:59.086 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:59.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.086 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.086 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.086 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:59.086 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:59.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.086 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.086 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.086 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:59.086 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:43:59.087 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.087 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.087 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.087 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:43:59.087 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:43:59.087 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.087 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.087 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.087 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:43:59.087 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:43:59.087 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.087 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.087 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:59.087 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:43:59.088 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:43:59.088 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.088 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.088 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:59.088 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:43:59.088 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:43:59.088 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.088 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.088 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:59.088 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:43:59.088 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:43:59.088 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.088 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.088 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:59.088 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:43:59.089 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:43:59.089 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.089 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.089 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:59.089 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:43:59.089 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:43:59.089 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.089 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.089 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.089 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:43:59.089 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:43:59.089 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.090 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.090 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.090 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.090 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.090 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:59.090 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:59.090 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.021733165000001, 2024-04-26T10:43:59.090 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:43:59.090 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.090 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.090 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.090 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.090 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.090 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:59.091 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.091 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.091 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.091 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.091 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:43:59.091 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.091 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.091 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.091 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.091 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:43:59.091 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.091 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.091 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.091 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.092 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:43:59.092 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:43:59.092 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.092 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.092 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.092 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:43:59.093 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:43:59.093 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.093 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.094 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.094 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:43:59.094 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:43:59.094 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.094 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.094 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.094 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:43:59.094 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:43:59.094 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.094 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.094 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:59.094 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:43:59.094 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:43:59.095 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.095 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.095 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:59.095 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:43:59.095 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:43:59.095 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.095 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.095 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:59.095 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:43:59.095 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:43:59.095 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.096 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.096 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:59.096 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:43:59.096 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:43:59.096 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.096 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.096 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:59.096 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:43:59.096 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:43:59.096 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.096 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.097 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.097 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:43:59.097 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:43:59.097 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.097 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.097 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.097 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.097 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.097 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:59.097 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:59.097 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.021679793000004, 2024-04-26T10:43:59.097 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:43:59.097 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.097 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.097 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.098 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.098 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.098 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:59.098 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.098 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.098 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.098 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.098 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:59.098 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.098 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.098 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.098 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.098 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:43:59.098 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.099 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.099 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.099 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.099 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:43:59.099 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:43:59.099 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.099 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.099 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.099 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:43:59.099 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:43:59.099 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.099 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.099 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.099 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:43:59.099 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:43:59.100 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.100 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.100 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.100 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:43:59.100 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:43:59.100 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.100 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.100 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:59.100 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:43:59.100 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:43:59.100 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.100 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.100 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:59.100 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:43:59.101 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:43:59.101 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.101 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.101 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:59.101 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:43:59.101 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:43:59.101 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.101 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.101 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:59.101 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:43:59.101 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:43:59.101 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.101 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.101 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:59.101 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:43:59.102 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:43:59.102 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.102 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.102 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.102 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:43:59.102 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:43:59.102 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.102 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.103 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.103 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.103 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.103 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:59.103 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:59.103 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.021635466000006, 2024-04-26T10:43:59.103 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:43:59.103 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.103 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.103 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.103 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.103 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.103 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:59.104 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.104 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.104 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.104 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.104 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:59.104 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.104 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.104 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.104 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.104 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:43:59.104 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:59.104 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.104 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.104 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.104 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:43:59.105 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:43:59.105 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.105 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.105 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.105 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:43:59.105 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:43:59.105 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.105 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.105 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.105 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:43:59.105 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:43:59.105 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.105 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.105 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.105 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:43:59.106 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:43:59.106 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.106 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.106 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:59.106 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:43:59.106 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:43:59.106 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.106 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.106 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:43:59.106 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:43:59.106 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:43:59.106 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.107 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.107 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:59.107 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:43:59.107 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:43:59.107 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.107 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.107 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:59.107 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:43:59.107 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:43:59.107 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.107 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.107 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:59.107 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:43:59.107 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:43:59.107 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.108 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.108 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.108 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:43:59.108 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:43:59.108 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.108 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.108 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.108 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.108 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.108 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:59.108 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:59.108 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.021611753000002, 2024-04-26T10:43:59.108 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:43:59.108 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.108 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.109 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.109 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.109 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.109 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:59.109 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.109 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.109 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.109 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.109 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:59.109 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.109 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.109 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.109 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.109 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:43:59.109 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.110 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.110 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.110 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.110 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:43:59.110 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:43:59.110 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.110 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.110 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.110 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:43:59.110 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:43:59.110 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.110 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.110 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.110 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:43:59.111 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:43:59.111 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.111 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.111 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.111 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:43:59.111 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:43:59.111 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.111 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.111 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:59.111 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:43:59.111 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:43:59.111 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.111 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.111 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:59.112 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:43:59.112 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:43:59.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.112 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.112 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:59.112 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:43:59.112 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:43:59.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.112 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.112 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:59.112 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:43:59.112 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:43:59.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.112 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.112 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:59.113 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:43:59.113 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:43:59.113 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.113 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.113 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.113 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:43:59.114 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:43:59.114 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.114 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.114 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.114 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.114 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.114 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:59.114 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:59.114 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.021577448000002, 2024-04-26T10:43:59.115 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:43:59.115 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.115 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.115 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.115 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.115 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.115 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:59.115 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.115 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.115 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.115 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.116 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:43:59.116 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.116 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.116 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.116 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.116 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:43:59.116 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.116 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.116 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.116 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.116 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:43:59.116 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:43:59.116 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.116 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.116 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.117 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:43:59.117 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:43:59.117 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.117 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.117 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.117 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:43:59.117 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:43:59.117 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.117 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.117 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.117 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:43:59.117 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:43:59.117 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.117 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.118 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:59.118 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:43:59.118 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:43:59.118 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.118 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.118 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:59.118 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:43:59.118 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:43:59.118 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.118 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.118 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:59.118 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:43:59.118 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:43:59.118 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.118 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.119 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:59.119 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:43:59.119 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:43:59.119 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.119 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.119 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:59.119 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:43:59.119 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:43:59.119 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.119 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.119 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.120 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:43:59.120 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:43:59.120 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.120 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.120 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.120 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.120 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.120 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:59.120 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:59.120 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.021240852000005, 2024-04-26T10:43:59.120 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:43:59.120 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.120 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:59.120 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.120 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.121 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.121 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:59.121 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.121 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.121 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.121 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.121 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:43:59.121 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.121 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.121 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.121 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.121 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:43:59.121 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:59.121 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.121 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.122 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.122 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:43:59.122 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:43:59.122 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.122 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.122 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.122 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:43:59.122 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:43:59.122 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.122 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.122 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.122 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:43:59.122 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:43:59.122 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.122 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.123 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.123 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:43:59.123 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:43:59.123 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.123 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.123 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:59.123 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:43:59.123 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:43:59.123 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.124 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.124 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.124 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:43:59.124 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:43:59.124 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.124 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.124 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.124 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.124 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.124 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:59.124 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:59.124 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.021198823999995, 2024-04-26T10:43:59.125 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:43:59.125 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.125 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:59.125 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.125 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.125 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.125 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:59.125 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.125 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.125 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.125 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.125 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:59.125 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.125 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.126 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.126 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.126 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:43:59.126 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.126 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.126 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.126 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.126 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:43:59.126 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:43:59.126 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.126 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.126 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.126 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:43:59.126 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:43:59.127 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.127 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.127 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.127 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:43:59.127 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:43:59.127 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.127 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.127 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.127 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:43:59.127 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:43:59.127 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.127 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.127 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:59.127 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:43:59.127 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:43:59.128 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.128 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.128 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.128 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:43:59.128 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:43:59.128 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.128 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.128 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.128 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.128 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.128 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:59.128 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:59.128 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.021145652000001, 2024-04-26T10:43:59.128 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:43:59.129 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.129 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:59.129 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.129 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.129 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.129 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:59.129 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.129 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.129 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.129 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:59.129 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.129 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.129 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.130 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:43:59.130 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.130 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.130 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.130 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.130 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:43:59.130 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:43:59.130 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.130 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.130 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.130 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:43:59.130 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:43:59.130 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.130 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.131 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.131 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:43:59.131 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:43:59.131 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.131 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.131 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.131 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:43:59.131 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:43:59.131 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.131 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.131 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:59.131 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:43:59.131 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:43:59.131 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.131 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.132 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.132 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:43:59.132 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:43:59.132 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.132 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.132 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.132 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.132 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:59.132 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:59.132 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.017739242000005, 2024-04-26T10:43:59.132 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:43:59.132 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.132 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:59.132 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.133 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.133 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:59.133 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.133 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.133 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:43:59.133 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.133 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.133 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:43:59.133 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.134 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.134 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.134 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:43:59.134 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:43:59.134 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.134 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.134 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.134 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:43:59.134 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:43:59.134 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.134 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.134 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.134 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:43:59.134 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:43:59.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.135 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.135 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.135 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:43:59.135 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:43:59.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.135 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.135 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.135 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:43:59.135 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:43:59.135 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.135 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.135 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.135 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.136 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:59.136 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:59.136 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.015267288999993, 2024-04-26T10:43:59.136 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:43:59.136 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.136 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:59.136 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.136 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.136 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.136 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:59.136 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.136 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.136 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.136 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.136 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:43:59.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.137 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.137 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.137 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.137 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:43:59.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.137 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.137 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.137 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.137 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:43:59.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:43:59.137 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.137 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.137 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.137 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:43:59.138 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:43:59.138 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.138 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.138 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.138 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:43:59.138 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:43:59.138 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.138 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.138 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.138 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:43:59.138 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:43:59.138 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.138 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.138 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:59.139 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:43:59.139 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:43:59.139 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.139 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.139 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.139 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:43:59.139 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:43:59.139 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.139 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.139 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.139 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.139 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.139 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:59.139 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:59.139 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.014613730999997, 2024-04-26T10:43:59.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:43:59.140 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.140 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:59.140 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.140 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.140 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:59.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.140 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.140 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.140 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:59.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.140 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.141 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.141 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.141 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:43:59.141 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.141 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.141 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.141 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.141 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:43:59.141 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:43:59.141 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.141 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.141 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.141 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:43:59.141 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:43:59.142 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.142 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.142 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.142 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:43:59.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:43:59.142 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.142 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.142 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.142 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:43:59.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:43:59.142 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.142 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.142 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:59.142 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:43:59.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:43:59.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:43:59.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:43:59.143 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.143 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.143 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.143 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:43:59.143 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:59.143 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.014537946000004, 2024-04-26T10:43:59.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:43:59.143 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.144 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:59.144 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.144 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.144 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:59.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.144 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.144 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:59.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.144 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.145 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:43:59.145 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.145 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.145 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.145 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.145 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:59.145 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:43:59.145 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.145 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.145 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.145 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:43:59.145 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:43:59.145 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.145 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.145 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.146 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:43:59.146 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:43:59.146 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.146 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.146 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.146 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:43:59.146 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:43:59.146 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.146 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.146 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:59.146 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:43:59.146 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:43:59.146 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.146 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.146 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.147 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:43:59.147 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:43:59.147 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.147 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.147 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.147 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.147 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.147 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:43:59.147 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:59.147 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.014324251999994, 2024-04-26T10:43:59.147 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:43:59.147 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.147 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:43:59.147 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.147 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:59.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:43:59.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:43:59.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.149 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.149 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:43:59.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:43:59.149 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.149 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.149 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:43:59.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:43:59.149 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.149 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.149 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:43:59.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:43:59.149 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.150 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.150 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:43:59.150 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:43:59.150 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.150 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.150 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.150 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:43:59.150 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:43:59.150 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.150 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.150 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.150 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.150 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.150 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:43:59.150 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:59.151 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.011880438999995, 2024-04-26T10:43:59.151 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:43:59.151 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.151 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:43:59.151 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.151 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.151 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.151 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:59.151 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.151 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.151 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.151 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.151 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:43:59.151 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.152 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.152 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.152 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:43:59.152 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:43:59.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.152 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.152 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.152 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:43:59.152 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:43:59.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.153 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:43:59.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:43:59.153 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.153 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:43:59.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:43:59.153 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.153 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:43:59.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:43:59.154 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.154 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.154 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:59.154 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:43:59.154 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:43:59.154 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.154 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.154 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.154 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:43:59.154 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:43:59.155 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.155 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.155 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.155 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.155 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.155 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:43:59.155 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:59.155 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 87.561817994999998, 2024-04-26T10:43:59.155 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:43:59.155 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.155 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.155 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.155 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.155 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.155 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:59.156 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.156 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.156 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.156 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.156 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:43:59.156 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.156 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.156 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.156 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.156 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:43:59.156 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:43:59.156 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.156 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.156 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.156 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:43:59.157 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:43:59.157 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.157 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.157 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.157 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:43:59.157 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:43:59.157 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.157 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.157 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.157 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:43:59.157 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:43:59.157 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.157 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.157 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.157 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:43:59.158 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:43:59.158 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.158 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.158 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:59.158 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:43:59.158 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:43:59.158 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.158 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.158 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:59.158 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:43:59.158 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:43:59.158 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.158 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.158 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:43:59.158 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:43:59.159 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:43:59.159 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.159 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.159 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:59.159 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:43:59.159 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:43:59.159 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.159 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.159 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:59.159 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:43:59.159 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:43:59.159 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.159 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.159 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.159 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:43:59.160 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:43:59.160 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.160 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.160 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.160 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.160 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.160 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:59.161 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:59.160+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:59.162 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:43:59.262 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:59.262+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:59.277 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:59.277 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:59.277 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:43:59.277 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:59.287 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:43:59.364 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:59.363+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:59.394 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:59.394 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:43:59.394 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:43:59.394 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:43:59.394 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:59.403 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:43:59.465 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:59.464+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:59.504 INFO:tasks.workunit.client.0.smithi049.stderr:Updating files: 94% (11837/12492) Updating files: 95% (11868/12492) Updating files: 96% (11993/12492) Updating files: 97% (12118/12492) Updating files: 98% (12243/12492) Updating files: 99% (12368/12492) Updating files: 100% (12492/12492) Updating files: 100% (12492/12492), done. 2024-04-26T10:43:59.511 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:43:59.511 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:43:59.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:43:59.511 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:43:59.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.511 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:59.511 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:59.511 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 93.472958613000003, 2024-04-26T10:43:59.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:43:59.511 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:59.511 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.512 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:59.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:59.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:59.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:59.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:59.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:59.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:43:59.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:59.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:43:59.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:43:59.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:59.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:43:59.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:43:59.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:43:59.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:43:59.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:59.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:43:59.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:43:59.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:59.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:43:59.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:43:59.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:59.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:43:59.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:43:59.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:59.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:43:59.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:43:59.516 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.516 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:59.516 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.516 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:59.516 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:59.517 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 93.471208492000002, 2024-04-26T10:43:59.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:43:59.517 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:59.517 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.517 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:59.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:59.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:59.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:59.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:43:59.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:59.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:43:59.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:59.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:59.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:43:59.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:43:59.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:59.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:43:59.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:43:59.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:43:59.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:43:59.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:59.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:43:59.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:43:59.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:59.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:43:59.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:43:59.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.522 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:59.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:43:59.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:43:59.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:59.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:43:59.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:43:59.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:59.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:43:59.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:43:59.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:59.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:43:59.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:43:59.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:59.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:43:59.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:43:59.524 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.524 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:59.525 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.525 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:59.525 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:59.525 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 93.471155494000001, 2024-04-26T10:43:59.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:43:59.525 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:59.525 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.525 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:59.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:59.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:59.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:59.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:59.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:59.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:43:59.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:59.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:43:59.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:43:59.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.527 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:59.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:43:59.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:43:59.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.527 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:43:59.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:43:59.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:59.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:43:59.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:43:59.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:59.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:43:59.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:43:59.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:59.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:43:59.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:43:59.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:59.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:43:59.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:43:59.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:59.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:43:59.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:43:59.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:59.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:43:59.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:43:59.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.530 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:59.530 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:43:59.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:43:59.530 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.530 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:59.530 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.530 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:59.530 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:59.530 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 93.471077750000006, 2024-04-26T10:43:59.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:43:59.531 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:59.531 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.531 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:59.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:59.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:59.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:59.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:43:59.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.532 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:59.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:43:59.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:59.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.532 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:59.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:43:59.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:43:59.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:59.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:43:59.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:43:59.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:43:59.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:43:59.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:59.534 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:43:59.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:43:59.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:59.534 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:43:59.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:43:59.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:59.534 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:43:59.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:43:59.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:59.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:43:59.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:43:59.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:59.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:43:59.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:43:59.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:59.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:43:59.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:43:59.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.536 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:59.536 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:43:59.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:43:59.536 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.536 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:59.536 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.536 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:59.536 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:59.537 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 93.471038743999998, 2024-04-26T10:43:59.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:43:59.537 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:59.537 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.537 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:59.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:59.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:59.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:59.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:43:59.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:59.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:43:59.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:59.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:59.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:43:59.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:43:59.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.539 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:59.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:43:59.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:43:59.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.539 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:43:59.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:43:59.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:59.540 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:43:59.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:43:59.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:59.540 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:43:59.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:43:59.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:59.540 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:43:59.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:43:59.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.541 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:59.541 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:43:59.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:43:59.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.541 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:59.541 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:43:59.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:43:59.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.541 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:59.541 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:43:59.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:43:59.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:59.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:43:59.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:43:59.542 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.542 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:59.542 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.542 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:59.542 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:59.543 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 93.471019923, 2024-04-26T10:43:59.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:43:59.543 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:59.543 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.543 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:59.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:59.543 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:59.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:59.543 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:59.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:59.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:43:59.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:59.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:59.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:43:59.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:43:59.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:59.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:43:59.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:43:59.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.545 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.545 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:43:59.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:43:59.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.545 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:59.545 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:43:59.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:43:59.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:59.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:43:59.546 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:43:59.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:59.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:43:59.546 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:43:59.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:59.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:43:59.546 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:43:59.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:59.547 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:43:59.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:43:59.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:59.547 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:43:59.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:43:59.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:59.548 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:43:59.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:43:59.548 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.548 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:59.548 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.548 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:59.548 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:59.548 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 93.470987921000003, 2024-04-26T10:43:59.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:43:59.548 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:59.548 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.549 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:59.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.549 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:59.549 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:59.549 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.549 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:59.549 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:43:59.549 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.549 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:59.550 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:43:59.550 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.550 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:59.550 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:43:59.550 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:43:59.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.550 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:59.550 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:43:59.550 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:43:59.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.551 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:43:59.551 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:43:59.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:59.551 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:43:59.551 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:43:59.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.552 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:59.552 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:43:59.552 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:43:59.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.552 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:59.552 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:43:59.552 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:43:59.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.553 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:59.553 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:43:59.553 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:43:59.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.553 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:59.553 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:43:59.553 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:43:59.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.553 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:59.553 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:43:59.553 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:43:59.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.554 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:59.554 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:43:59.554 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:43:59.554 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.554 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:59.554 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.555 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:59.555 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:59.555 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 93.470779113000006, 2024-04-26T10:43:59.555 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:43:59.555 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:59.555 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.555 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:59.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.555 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:59.555 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:59.555 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.556 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:59.556 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:43:59.556 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.556 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:59.556 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:43:59.556 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:43:59.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.556 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:59.556 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:43:59.557 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:43:59.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.557 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:59.557 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:43:59.557 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:43:59.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.557 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.557 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:43:59.557 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:43:59.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.558 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:59.558 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:43:59.558 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:43:59.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.558 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:59.558 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:43:59.558 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:43:59.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.558 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:43:59.558 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:43:59.559 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:43:59.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.559 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:43:59.559 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:43:59.559 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:43:59.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.559 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:43:59.559 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:43:59.559 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:43:59.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.560 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:59.560 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:43:59.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:43:59.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.560 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:59.560 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:43:59.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:43:59.560 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.560 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:59.560 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.561 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:59.561 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:59.561 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 93.470747822000007, 2024-04-26T10:43:59.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:43:59.561 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:59.561 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:59.561 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:59.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.561 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:59.561 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:59.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.561 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:59.562 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:43:59.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.562 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:59.562 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:43:59.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.562 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:59.562 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:43:59.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:43:59.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.563 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:59.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:43:59.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:43:59.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.563 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:43:59.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:43:59.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.563 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:59.564 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:43:59.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:43:59.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.564 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:59.564 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:43:59.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:43:59.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.564 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:59.564 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:43:59.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:43:59.564 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.565 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:59.565 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.565 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:59.565 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:59.565 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 93.470720572000005, 2024-04-26T10:43:59.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:43:59.565 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:59.565 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:43:59.565 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:59.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:59.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:59.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:59.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:59.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:59.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:43:59.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:59.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:43:59.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:43:59.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:59.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:43:59.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:43:59.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:43:59.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:43:59.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:59.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:43:59.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:43:59.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:59.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:43:59.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:43:59.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:59.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:43:59.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:43:59.569 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.569 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:59.569 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.569 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:59.569 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:59.569 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 93.467943821000006, 2024-04-26T10:43:59.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:43:59.569 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:59.569 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:59.569 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:59.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:59.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:59.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:59.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:43:59.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:59.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:43:59.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:59.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:43:59.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:43:59.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:59.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:43:59.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:43:59.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:43:59.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:43:59.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:59.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:43:59.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:43:59.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:59.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:43:59.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:43:59.572 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.572 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:59.573 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.573 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:59.573 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:59.573 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 93.467893731999993, 2024-04-26T10:43:59.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:43:59.573 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:59.573 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.573 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:59.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:59.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:59.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.574 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:59.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:43:59.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.574 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:59.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:43:59.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:59.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:43:59.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:43:59.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:59.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:43:59.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:43:59.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:43:59.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:43:59.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:59.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:43:59.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:43:59.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:59.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:43:59.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:43:59.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:59.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:43:59.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:43:59.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:59.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:43:59.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:43:59.577 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.577 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:59.577 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.577 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:59.577 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:59.578 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 93.467001663000005, 2024-04-26T10:43:59.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:43:59.578 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:59.578 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.578 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:59.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:59.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:59.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:59.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:43:59.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:59.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:43:59.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:59.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:43:59.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:43:59.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:59.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:43:59.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:43:59.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.580 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:43:59.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:43:59.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.580 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:59.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:43:59.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:43:59.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:59.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:43:59.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:43:59.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:59.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:43:59.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:43:59.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:59.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:43:59.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:43:59.581 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.582 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:59.582 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.582 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:43:59.582 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:59.582 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 93.464813333999999, 2024-04-26T10:43:59.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:43:59.582 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:59.582 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.582 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:59.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:59.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:59.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:59.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:59.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:59.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:43:59.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:59.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:43:59.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:43:59.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:59.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:43:59.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:43:59.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:43:59.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:43:59.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:59.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:43:59.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:43:59.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:59.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:43:59.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:43:59.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:59.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:43:59.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:43:59.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:59.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:43:59.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:43:59.586 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.586 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:59.586 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.586 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:59.586 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:59.587 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 93.464677964000003, 2024-04-26T10:43:59.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:43:59.587 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:59.587 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.587 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:59.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:59.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:59.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:59.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:43:59.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.588 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:59.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:43:59.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.588 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:59.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:43:59.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:43:59.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:59.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:43:59.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:43:59.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:43:59.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:43:59.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:59.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:43:59.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:43:59.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:59.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:43:59.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:43:59.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:59.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:43:59.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:43:59.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:59.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:43:59.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:43:59.591 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.591 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:59.591 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.591 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:43:59.591 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:59.591 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 93.464463390000006, 2024-04-26T10:43:59.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:43:59.591 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:59.591 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.592 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:59.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:59.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:59.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:59.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:59.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:59.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:43:59.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:59.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:43:59.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:43:59.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:59.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:43:59.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:43:59.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.594 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:43:59.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:43:59.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:59.594 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:43:59.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:43:59.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:59.595 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:43:59.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:43:59.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.595 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:59.595 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:43:59.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:43:59.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.595 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:59.595 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:43:59.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:43:59.596 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.596 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:59.596 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.596 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:43:59.596 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:59.596 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 93.464124448999996, 2024-04-26T10:43:59.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:43:59.596 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:59.596 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.596 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:59.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.596 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:59.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:59.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:59.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:59.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:59.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:43:59.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:59.598 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:43:59.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:43:59.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:59.598 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:43:59.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:43:59.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.598 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:43:59.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:43:59.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.599 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:59.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:43:59.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:43:59.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.599 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:59.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:43:59.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:43:59.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.600 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:59.600 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:43:59.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:43:59.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.600 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:59.600 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:43:59.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:43:59.600 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.600 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:59.600 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.600 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:43:59.601 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:59.601 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 93.464015071999995, 2024-04-26T10:43:59.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:43:59.601 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:59.601 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:43:59.601 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:59.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.601 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:59.601 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:59.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:59.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:43:59.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:59.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:43:59.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:59.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:59.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:43:59.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:43:59.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:59.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:43:59.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:43:59.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:43:59.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:43:59.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:59.604 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:43:59.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:43:59.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:59.604 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:43:59.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:43:59.604 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.604 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:59.604 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.604 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:43:59.604 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:59.605 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 93.463975352999995, 2024-04-26T10:43:59.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:43:59.605 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:59.605 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.605 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:59.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.605 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:59.605 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:59.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.605 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:59.606 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:59.606 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.606 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:59.606 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:43:59.606 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:43:59.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.606 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:59.606 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:43:59.606 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:43:59.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:59.607 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:43:59.607 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:43:59.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.607 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:43:59.607 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:43:59.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:59.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:43:59.608 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:43:59.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.608 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:59.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:43:59.608 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:43:59.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.608 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:59.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:43:59.608 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:43:59.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.609 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:59.609 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:43:59.609 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:43:59.609 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.609 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:59.609 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.609 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:43:59.609 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:59.609 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 93.463637820000002, 2024-04-26T10:43:59.609 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:43:59.609 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:43:59.610 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.610 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:43:59.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.610 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:43:59.610 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:59.610 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.610 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:43:59.610 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:43:59.610 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:43:59.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.611 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:43:59.611 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:43:59.611 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.611 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:43:59.611 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:43:59.611 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:43:59.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.611 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:43:59.611 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:43:59.611 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:43:59.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.612 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.612 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:43:59.612 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:43:59.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.612 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:43:59.612 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:43:59.612 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:43:59.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.612 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:43:59.612 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:43:59.613 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:43:59.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.613 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:43:59.613 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:43:59.613 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:43:59.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:43:59.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:43:59.613 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:43:59.613 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:43:59.613 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:43:59.613 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.613 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:59.614 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.614 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:43:59.614 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:43:59.614 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:43:59.616 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:43:59.616 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:59.614+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:59.716 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:59.715+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:59.719 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:59.719 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:59.719 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:43:59.719 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:59.728 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:43:59.817 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:43:59.815+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:43:59.829 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:59.829 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:43:59.829 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:43:59.829 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:43:59.829 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:43:59.838 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:43:59.918 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:43:59.917+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:43:59.980 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:43:59.980 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:43:59.981 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:43:59.981 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:43:59.981 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.981 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:59.981 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:59.981 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.941958521999993, 2024-04-26T10:43:59.981 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:43:59.981 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.981 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.981 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.981 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.981 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.981 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:59.981 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.982 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.982 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.982 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:43:59.982 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.982 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.982 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.982 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:43:59.982 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.982 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.982 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.982 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:43:59.983 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:43:59.983 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.983 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.983 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.983 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:43:59.983 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:43:59.983 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.983 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.983 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.983 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:43:59.983 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:43:59.983 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.983 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.983 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.983 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:43:59.984 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:43:59.984 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.984 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.984 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:59.984 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:43:59.984 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:43:59.984 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.984 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.984 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:59.984 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:43:59.984 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:43:59.984 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.984 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.984 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.985 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:43:59.985 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:43:59.985 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.985 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.985 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.985 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.985 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.985 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:43:59.985 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:59.985 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.941087741999993, 2024-04-26T10:43:59.985 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:43:59.985 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.985 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.985 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.985 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.986 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.986 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:59.986 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.986 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.986 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.986 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.986 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:59.986 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.986 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.986 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.986 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.986 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:43:59.986 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.986 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.987 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.987 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.987 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:43:59.987 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:43:59.987 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.987 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.987 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.987 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:43:59.987 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:43:59.987 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.987 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.987 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.987 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:43:59.987 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:43:59.987 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:43:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:43:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:43:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:43:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:43:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:43:59.988 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:43:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:43:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.940100399000002, 2024-04-26T10:43:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:43:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.989 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:43:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.990 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:43:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:43:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:43:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:43:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:43:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:43:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.991 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:43:59.992 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:43:59.992 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.992 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.992 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.992 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:43:59.992 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:43:59.992 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.992 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.992 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:59.992 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:43:59.992 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:43:59.992 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.992 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.992 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:59.992 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:43:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:43:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:43:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:43:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:43:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.939895133999997, 2024-04-26T10:43:59.993 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:43:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.994 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:43:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:43:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:43:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:43:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:43:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:43:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.995 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:43:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:43:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:43:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:43:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:43:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:43:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:43:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:43:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:43:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.996 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:43:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:43:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:43:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:43:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:43:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:43:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:43:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:43:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:43:59.997 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:59.998 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.939574254999997, 2024-04-26T10:43:59.998 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:43:59.998 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:43:59.998 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:43:59.998 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:43:59.998 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.998 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:43:59.998 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:59.998 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.998 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.998 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.998 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:43:59.998 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:43:59.998 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:43:59.999 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.999 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.999 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:43:59.999 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:43:59.999 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:43:59.999 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.999 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.999 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:43:59.999 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:43:59.999 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:43:59.999 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:43:59.999 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:43:59.999 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:43:59.999 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:43:59.999 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:44:00.000 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.000 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.000 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:00.000 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:44:00.000 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:44:00.000 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.000 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.000 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:00.000 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:44:00.000 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:44:00.000 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.000 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.000 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:00.000 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:44:00.000 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:44:00.001 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.001 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.001 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:00.001 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:44:00.001 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:44:00.001 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.001 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.001 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:00.001 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:44:00.001 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:44:00.001 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.001 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.001 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:00.002 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:44:00.002 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:44:00.002 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.002 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.002 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:00.002 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:44:00.002 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:44:00.002 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.002 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.002 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:00.002 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:44:00.002 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:44:00.002 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.002 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:00.003 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.003 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.003 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.003 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:00.003 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:00.003 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.939522431, 2024-04-26T10:44:00.003 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:44:00.003 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:00.003 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:00.003 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:00.003 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.003 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:00.003 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:00.003 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.004 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.004 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.004 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:00.004 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:00.004 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.004 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.004 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.004 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:00.004 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:44:00.004 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:00.004 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.004 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.004 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:00.004 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:44:00.004 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:44:00.005 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.005 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.005 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:00.005 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:44:00.005 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:44:00.005 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.005 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.005 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:00.005 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:44:00.005 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:44:00.005 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.005 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.005 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:00.005 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:44:00.005 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:44:00.006 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.006 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.006 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:00.006 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:44:00.006 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:44:00.006 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.006 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.006 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:00.006 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:44:00.006 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:44:00.006 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.006 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.006 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:00.006 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:44:00.006 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:44:00.007 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.007 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.007 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:00.007 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:44:00.007 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:44:00.007 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.007 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.007 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:00.007 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:44:00.007 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:44:00.007 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.007 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.007 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:00.007 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:44:00.008 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:44:00.008 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.008 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:00.008 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.008 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.008 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.008 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:00.008 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:00.008 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.939469059000004, 2024-04-26T10:44:00.008 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:44:00.008 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:00.008 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:00.008 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:00.008 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.008 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:00.009 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:00.009 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.009 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.009 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.009 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:00.009 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:00.009 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.009 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.009 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.009 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:00.009 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:00.009 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:00.009 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.009 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.009 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:00.010 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:44:00.010 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:44:00.010 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.010 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.010 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:00.010 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:44:00.010 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:44:00.010 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.010 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.010 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:00.011 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:44:00.011 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:44:00.011 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.011 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.011 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:00.011 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:44:00.011 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:44:00.011 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.011 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.011 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:00.011 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:44:00.011 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:44:00.011 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.011 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.012 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:00.012 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:44:00.012 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:44:00.012 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.012 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.012 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:00.012 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:44:00.012 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:44:00.012 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.012 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.012 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:00.012 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:44:00.012 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:44:00.012 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.012 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.013 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:00.013 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:44:00.013 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:44:00.013 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.013 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.013 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:00.013 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:44:00.013 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:44:00.013 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.013 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:00.013 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.013 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.013 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.013 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:00.013 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:00.014 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.939424732000006, 2024-04-26T10:44:00.014 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:44:00.014 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:00.014 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:00.014 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:00.014 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.014 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:00.014 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:00.014 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.014 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.014 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.014 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:00.014 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:00.014 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.015 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.015 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.015 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:00.015 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:00.015 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:00.015 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.015 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.015 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:00.015 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:44:00.015 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:44:00.015 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.015 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.015 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:00.015 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:44:00.015 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:44:00.016 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.016 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.016 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:00.016 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:44:00.016 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:44:00.016 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.016 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.016 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:00.016 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:44:00.016 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:44:00.016 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.016 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.016 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:00.016 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:44:00.017 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:44:00.017 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.017 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.017 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:00.017 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:44:00.017 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:44:00.017 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.017 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.017 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:00.017 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:44:00.017 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:44:00.017 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.017 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.017 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:00.018 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:44:00.018 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:44:00.018 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.018 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.018 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:00.018 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:44:00.018 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:44:00.018 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.018 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.018 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:00.018 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:44:00.018 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:44:00.018 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.018 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:00.018 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.019 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.019 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.019 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:00.019 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:00.019 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.939401019000002, 2024-04-26T10:44:00.019 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:44:00.019 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:00.019 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:00.019 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:00.019 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.019 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:00.019 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:00.019 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.019 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.019 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.020 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:00.020 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:00.020 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.020 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.020 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.020 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:00.020 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:00.020 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:00.020 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.020 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.020 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:00.020 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:44:00.020 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:44:00.020 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.021 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.021 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:00.021 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:44:00.021 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:44:00.021 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.021 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.021 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:00.021 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:44:00.021 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:44:00.021 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.021 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.021 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:00.021 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:44:00.021 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:44:00.021 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.022 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.022 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:00.022 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:44:00.022 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:44:00.022 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.022 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.022 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:00.022 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:44:00.022 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:44:00.022 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.022 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.022 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:00.022 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:44:00.022 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:44:00.023 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.023 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.023 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:00.023 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:44:00.023 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:44:00.023 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.023 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.023 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:00.023 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:44:00.023 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:44:00.023 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.023 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.023 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:00.023 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:44:00.024 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:44:00.024 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.024 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:00.024 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.024 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.024 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.024 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:00.024 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:00.024 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.939366714000002, 2024-04-26T10:44:00.024 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:44:00.024 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:00.024 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:00.024 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:00.024 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.025 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:00.025 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:00.025 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.025 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.025 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.025 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:00.025 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:00.025 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.025 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.025 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.025 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:00.025 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:44:00.025 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:00.025 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.025 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.026 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:00.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:44:00.026 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:44:00.026 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.026 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.026 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:00.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:44:00.026 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:44:00.026 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.026 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.026 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:00.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:44:00.026 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:44:00.026 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.027 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.027 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:00.027 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:44:00.027 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:44:00.027 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.027 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.027 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:00.027 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:44:00.027 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:44:00.027 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.027 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.027 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:00.027 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:44:00.027 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:44:00.027 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.028 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.028 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:00.028 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:44:00.028 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:44:00.028 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.028 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.028 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:00.028 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:44:00.028 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:44:00.028 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.028 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.028 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:00.028 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:44:00.028 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:44:00.028 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.029 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.029 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:00.029 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:44:00.029 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:44:00.029 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.029 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:00.029 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.029 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.029 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.029 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:00.029 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:00.029 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.939030118000005, 2024-04-26T10:44:00.029 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:44:00.029 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:00.029 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:44:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:44:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:44:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:44:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:44:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:44:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:44:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:44:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:44:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:44:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:44:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:44:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:44:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.938988089999995, 2024-04-26T10:44:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:44:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:44:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:44:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:44:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:44:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:44:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:44:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:44:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:44:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:44:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:44:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:44:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:44:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.938934918000001, 2024-04-26T10:44:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:44:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:44:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:44:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:44:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:44:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:44:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:44:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:00.040 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:44:00.040 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:44:00.040 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.040 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.040 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:00.040 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:44:00.040 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:44:00.040 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.040 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.040 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:00.040 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:44:00.040 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:44:00.040 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.040 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:00.041 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.041 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.041 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.041 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:00.041 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:00.041 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.935528508000004, 2024-04-26T10:44:00.041 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:44:00.041 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:00.041 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:44:00.041 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:00.041 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.041 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:00.041 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:00.041 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:44:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:44:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:44:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:44:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:44:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:44:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:44:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:44:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:44:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:44:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:44:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:44:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:44:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.933056554999993, 2024-04-26T10:44:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:44:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:44:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:44:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:44:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:44:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:44:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:44:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:44:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:00.047 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:44:00.047 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:44:00.047 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.047 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.047 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:00.047 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:44:00.047 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:44:00.047 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.047 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.047 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:00.047 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:44:00.047 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:44:00.047 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.047 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:44:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:44:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:44:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.932402996999997, 2024-04-26T10:44:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:44:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:44:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:44:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:44:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:44:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:44:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:44:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:44:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:44:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:44:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:44:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:44:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:44:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:44:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.932327212000004, 2024-04-26T10:44:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:44:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:44:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:44:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:44:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:44:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:44:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:44:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:44:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:44:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:44:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:44:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:44:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:44:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:44:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:44:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.932113517999994, 2024-04-26T10:44:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:44:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:44:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:44:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:44:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:44:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:44:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:44:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:44:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:44:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:44:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:44:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:44:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:44:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:44:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:44:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:44:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:44:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 93.929669704999995, 2024-04-26T10:44:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:44:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:44:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:44:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:44:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:44:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:44:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:44:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:44:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:44:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:44:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:44:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:44:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:44:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:44:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:44:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:44:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:44:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:44:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 88.479607260999998, 2024-04-26T10:44:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:44:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:44:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:44:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:44:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:44:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:44:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:44:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:44:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:44:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:44:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:44:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:44:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:44:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:44:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:44:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:44:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:44:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:44:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:44:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:44:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:44:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:44:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:00.069 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:00.069 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:00.070 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:00.069+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:00.071 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:00.170 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:00.170+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:00.184 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:00.185 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:00.185 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:44:00.185 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:00.194 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:00.271 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:00.271+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:00.308 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:44:00.315 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:44:00.333 INFO:tasks.workunit.client.0.smithi049.stderr:Note: switching to '7d2137f0a666c92a9411c1af5c33e4968be54da6'. 2024-04-26T10:44:00.333 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-04-26T10:44:00.333 INFO:tasks.workunit.client.0.smithi049.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T10:44:00.333 INFO:tasks.workunit.client.0.smithi049.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T10:44:00.333 INFO:tasks.workunit.client.0.smithi049.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T10:44:00.333 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-04-26T10:44:00.333 INFO:tasks.workunit.client.0.smithi049.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T10:44:00.333 INFO:tasks.workunit.client.0.smithi049.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T10:44:00.333 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-04-26T10:44:00.333 INFO:tasks.workunit.client.0.smithi049.stderr: git switch -c 2024-04-26T10:44:00.334 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-04-26T10:44:00.334 INFO:tasks.workunit.client.0.smithi049.stderr:Or undo this operation with: 2024-04-26T10:44:00.334 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-04-26T10:44:00.334 INFO:tasks.workunit.client.0.smithi049.stderr: git switch - 2024-04-26T10:44:00.334 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-04-26T10:44:00.334 INFO:tasks.workunit.client.0.smithi049.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T10:44:00.334 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-04-26T10:44:00.334 INFO:tasks.workunit.client.0.smithi049.stderr:HEAD is now at 7d2137f0a66 Merge pull request #57086 from zdover23/wip-doc-2024-04-25-backport-57057-to-reef 2024-04-26T10:44:00.340 DEBUG:teuthology.orchestra.run.smithi049:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-26T10:44:00.340 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:00.341 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:00.341 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:00.341 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:00.341 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:00.348 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:00.373 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:00.372+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:00.399 INFO:tasks.workunit.client.0.smithi049.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T10:44:00.401 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T10:44:00.401 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T10:44:00.434 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:00.434 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:00.435 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:00.453 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:00.453 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:00.458 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:00.459 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:00.462 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:00.463 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:00.464 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:00.507 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:00.506+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:00.568 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:00.568 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:00.575 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:00.574+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:00.577 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:00.676 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:00.675+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:00.720 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:00.721 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:00.729 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:00.776 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:00.775+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:00.830 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:00.831 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:00.839 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:00.884 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:00.883+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:00.952 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:00.952 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:00.960 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:00.962 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T10:44:00.978 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:00.977+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:01.020 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T10:44:01.060 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T10:44:01.062 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T10:44:01.062 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T10:44:01.078 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:01.077+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:01.101 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T10:44:01.105 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-04-26T10:44:01.105 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-26T10:44:01.107 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:01.107 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:01.116 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:01.121 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-26T10:44:01.122 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-26T10:44:01.123 DEBUG:teuthology.orchestra.run.smithi049:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7d2137f0a666c92a9411c1af5c33e4968be54da6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-26T10:44:01.179 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:01.178+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:01.184 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir -p fsstress 2024-04-26T10:44:01.185 INFO:tasks.workunit.client.0.smithi049.stderr:+ pushd fsstress 2024-04-26T10:44:01.186 INFO:tasks.workunit.client.0.smithi049.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T10:44:01.186 INFO:tasks.workunit.client.0.smithi049.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-26T10:44:01.221 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:01.221 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:01.230 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:01.280 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:01.279+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:01.301 INFO:teuthology.orchestra.run.smithi049.stderr:nodeep-scrub is set 2024-04-26T10:44:01.333 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:01.334 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:01.342 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:01.387 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:01.386+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:01.445 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:01.445 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:01.455 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:01.482 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:01.482+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:01.583 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:01.583+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:01.596 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:01.596 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:01.605 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:01.684 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:01.683+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:01.713 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:01.714 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:01.722 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:01.785 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:01.784+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:01.869 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:01.869 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:01.878 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:01.921 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:01.920+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:01.983 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:01.984 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:01.987 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:01.986+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:01.992 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:02.088 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:02.086+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:02.095 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:02.095 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:02.105 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:02.189 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:02.188+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:02.247 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:02.247 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:02.256 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:02.300 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:02.299+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:02.356 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:02.356 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:02.367 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:02.407 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:02.406+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:02.464 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:44:02.478 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:02.478 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:02.487 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:02.531 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:02.530+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:02.592 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:02.590+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:02.592 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:02.592 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:02.599 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:02.600 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:02.600 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:02.602 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:02.618 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:02.618 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:02.621 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:02.621 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:02.693 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:02.692+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:02.749 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:02.750 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:02.750 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:02.750 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:02.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.750 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:02.750 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:02.750 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 96.711868554000006, 2024-04-26T10:44:02.750 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:44:02.750 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:02.750 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:02.750 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:02.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.751 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:02.751 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:02.751 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.751 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:02.751 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:02.751 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.751 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:02.751 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:02.751 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:02.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.752 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:02.752 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:44:02.752 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:44:02.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.752 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:02.752 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:44:02.752 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:44:02.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.752 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:02.752 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:44:02.752 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:44:02.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.753 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:02.753 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:44:02.753 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:44:02.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.753 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:02.753 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:44:02.753 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:44:02.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.753 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:02.753 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:44:02.753 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:44:02.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.754 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:02.754 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:44:02.754 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:44:02.754 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.754 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:02.754 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.754 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:02.754 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:02.754 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 96.710118433000005, 2024-04-26T10:44:02.754 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:44:02.754 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:02.755 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:02.755 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:02.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.755 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:02.755 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:02.755 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.755 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:02.755 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:02.755 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.755 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:02.756 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:44:02.756 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:02.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.756 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:02.756 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:44:02.756 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:44:02.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.756 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:02.756 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:44:02.756 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:44:02.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.756 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:02.757 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:44:02.757 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:44:02.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.757 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:02.757 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:44:02.757 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:44:02.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.757 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:02.757 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:44:02.757 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:44:02.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.758 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:02.758 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:44:02.758 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:44:02.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.758 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:02.758 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:44:02.758 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:44:02.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.758 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:02.758 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:44:02.758 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:44:02.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.759 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:02.759 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:44:02.759 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:44:02.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.759 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:02.759 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:44:02.759 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:44:02.759 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.759 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:02.759 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.760 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:02.760 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:02.760 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 96.710065435000004, 2024-04-26T10:44:02.760 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:44:02.760 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:02.760 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:02.760 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:02.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.760 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:02.760 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:02.760 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.760 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:02.761 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:02.761 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.761 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:02.761 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:02.761 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:02.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.761 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:02.761 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:44:02.761 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:44:02.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.761 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:02.762 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:44:02.762 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:44:02.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.762 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.762 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:02.762 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:44:02.762 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:44:02.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.762 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.762 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:02.762 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:44:02.762 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:44:02.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.763 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:02.763 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:44:02.763 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:44:02.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.763 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:02.763 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:44:02.763 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:44:02.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.763 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:02.763 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:44:02.763 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:44:02.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.764 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.764 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:02.764 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:44:02.764 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:44:02.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.764 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.764 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:02.764 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:44:02.764 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:44:02.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.764 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.764 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:02.764 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:44:02.764 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:44:02.765 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.765 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:02.765 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.765 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:02.765 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:02.765 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 96.709987690999995, 2024-04-26T10:44:02.765 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:44:02.765 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:02.765 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:02.765 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:02.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.765 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:02.765 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:02.766 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.766 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:02.766 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:02.766 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.766 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:02.766 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:44:02.766 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:02.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.767 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:02.767 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:44:02.767 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:44:02.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.767 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:02.767 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:44:02.767 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:44:02.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.767 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:02.767 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:44:02.767 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:44:02.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.768 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:02.768 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:44:02.768 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:44:02.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.768 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:02.768 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:44:02.768 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:44:02.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.768 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:02.768 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:44:02.768 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:44:02.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.769 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:02.769 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:44:02.769 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:44:02.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.769 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:02.769 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:44:02.769 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:44:02.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.769 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:02.769 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:44:02.769 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:44:02.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.770 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:02.770 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:44:02.770 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:44:02.770 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.770 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:02.770 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.770 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:02.770 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:02.770 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 96.709948685000001, 2024-04-26T10:44:02.770 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:44:02.770 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:02.771 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:02.771 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:02.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.771 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:02.771 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:02.771 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.771 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:02.771 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:02.771 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.771 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:02.771 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:44:02.772 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:02.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.772 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:02.772 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:44:02.772 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:44:02.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.772 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:02.772 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:44:02.772 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:44:02.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.772 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:02.773 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:44:02.773 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:44:02.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.773 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:02.773 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:44:02.773 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:44:02.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.773 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:02.773 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:44:02.773 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:44:02.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.773 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:02.774 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:44:02.774 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:44:02.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.774 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:02.774 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:44:02.774 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:44:02.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.774 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:02.774 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:44:02.774 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:44:02.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.775 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:02.775 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:44:02.775 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:44:02.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.775 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:02.775 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:44:02.775 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:44:02.775 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.775 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:02.775 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.776 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:02.776 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:02.776 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 96.709929864000003, 2024-04-26T10:44:02.776 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:44:02.776 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:02.776 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:02.776 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:02.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.776 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:02.776 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:02.776 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.776 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:02.777 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:02.777 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.777 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:02.777 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:02.777 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:02.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.777 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:02.777 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:44:02.777 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:44:02.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.778 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:02.778 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:44:02.778 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:44:02.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.778 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:02.778 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:44:02.778 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:44:02.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.778 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:02.778 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:44:02.778 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:44:02.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.779 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:02.779 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:44:02.779 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:44:02.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.779 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:02.779 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:44:02.779 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:44:02.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.779 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:02.779 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:44:02.779 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:44:02.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.780 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:02.780 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:44:02.780 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:44:02.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.780 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:02.780 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:44:02.780 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:44:02.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.780 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:02.780 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:44:02.781 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:44:02.781 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.781 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:02.781 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.781 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:02.781 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:02.781 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 96.709897862000005, 2024-04-26T10:44:02.781 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:44:02.781 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:02.781 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:02.781 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:02.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.782 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:02.782 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:02.782 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.782 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:02.782 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:02.782 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.782 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:02.782 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:44:02.782 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:02.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.783 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:02.783 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:44:02.783 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:44:02.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.783 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:02.783 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:44:02.783 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:44:02.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.783 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:02.783 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:44:02.783 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:44:02.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.784 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:02.784 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:44:02.784 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:44:02.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.784 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:02.784 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:44:02.784 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:44:02.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.784 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:02.784 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:44:02.785 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:44:02.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.785 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:02.785 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:44:02.785 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:44:02.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.785 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:02.785 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:44:02.785 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:44:02.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.785 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:02.786 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:44:02.786 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:44:02.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.786 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:02.786 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:44:02.786 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:44:02.786 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.786 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:02.786 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.786 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:02.786 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:02.787 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 96.709689053999995, 2024-04-26T10:44:02.787 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:44:02.787 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:02.787 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:02.787 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:02.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.787 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:02.787 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:02.787 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.787 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:02.787 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:02.787 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.788 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:02.788 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:44:02.788 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:02.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.788 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:02.788 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:44:02.788 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:44:02.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.788 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:02.788 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:44:02.788 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:44:02.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.789 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:02.789 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:44:02.789 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:44:02.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.789 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:02.789 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:44:02.789 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:44:02.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.789 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:02.789 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:44:02.789 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:44:02.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.790 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:02.790 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:44:02.790 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:44:02.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.790 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:02.790 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:44:02.790 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:44:02.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.790 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:02.791 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:44:02.791 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:44:02.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.791 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.791 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:02.791 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:44:02.791 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:44:02.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.791 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.791 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:02.791 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:44:02.791 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:44:02.791 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.791 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:02.791 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.792 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:02.792 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:02.792 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 96.709657762999996, 2024-04-26T10:44:02.792 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:44:02.792 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:02.792 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:02.792 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:02.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.792 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:02.792 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:02.792 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.793 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:02.793 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:02.793 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.793 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:02.793 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:44:02.793 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:02.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.793 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:02.793 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:44:02.793 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:44:02.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.794 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:02.794 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:44:02.794 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:44:02.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.794 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:02.794 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:44:02.794 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:44:02.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.794 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:02.794 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:44:02.794 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:44:02.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.795 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:02.795 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:44:02.795 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:44:02.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.795 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:02.795 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:44:02.795 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:44:02.795 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.795 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:02.795 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.796 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:02.796 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:02.796 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 96.709630512999993, 2024-04-26T10:44:02.796 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:44:02.796 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:02.796 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:02.796 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:02.796 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.796 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:02.796 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:02.796 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.796 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.796 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:02.797 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:02.797 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.797 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:02.797 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:02.797 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:02.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.797 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:02.797 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:44:02.797 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:44:02.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.798 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:02.798 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:44:02.798 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:44:02.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.798 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:02.798 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:44:02.798 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:44:02.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.798 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:02.798 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:44:02.798 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:44:02.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.799 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:02.799 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:44:02.799 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:44:02.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.799 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:02.799 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:44:02.799 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:44:02.799 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.799 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:02.799 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.799 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:02.800 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:02.800 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 96.706853761999994, 2024-04-26T10:44:02.800 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:44:02.800 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:02.800 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:44:02.800 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:02.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.800 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:02.800 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:02.800 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.800 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:02.800 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:02.800 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.801 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:02.801 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:44:02.801 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:02.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.801 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:02.801 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:44:02.801 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:44:02.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.801 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:02.801 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:44:02.801 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:44:02.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.802 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:02.802 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:44:02.802 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:44:02.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.802 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:02.802 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:44:02.802 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:44:02.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.802 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:02.802 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:44:02.803 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:44:02.803 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.803 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:02.803 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.803 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:02.803 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:02.803 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 96.706803672999996, 2024-04-26T10:44:02.803 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:44:02.803 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:02.803 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:02.803 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:02.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.804 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:02.804 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:02.804 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.804 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:02.804 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:02.804 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.804 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:02.804 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:44:02.804 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:02.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.805 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:02.805 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:44:02.805 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:44:02.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.805 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:02.805 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:44:02.805 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:44:02.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.805 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:02.805 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:44:02.805 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:44:02.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.806 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:02.806 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:44:02.806 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:44:02.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.806 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:02.806 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:44:02.806 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:44:02.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.806 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:02.806 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:44:02.806 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:44:02.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.807 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:02.807 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:44:02.807 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:44:02.807 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.807 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:02.807 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.807 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:02.807 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:02.807 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 96.705911603999994, 2024-04-26T10:44:02.807 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:44:02.807 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:02.808 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:02.808 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:02.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.808 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:02.808 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:02.808 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.808 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:02.808 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:02.808 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.808 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:02.809 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:44:02.809 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:02.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.809 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:02.809 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:44:02.809 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:44:02.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.809 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:02.809 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:44:02.809 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:44:02.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.809 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:02.810 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:44:02.810 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:44:02.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.810 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:02.810 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:44:02.810 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:44:02.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.810 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:02.810 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:44:02.810 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:44:02.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.810 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:02.811 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:44:02.811 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:44:02.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.811 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:02.811 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:44:02.811 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:02.811 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.811 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:02.811 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.811 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:44:02.811 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:02.812 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 96.703723275000002, 2024-04-26T10:44:02.812 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:44:02.812 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:02.812 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:02.812 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:02.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.812 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:02.812 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:02.812 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.812 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:02.812 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:02.812 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.813 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:02.813 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:02.813 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:02.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.813 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:02.813 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:44:02.813 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:44:02.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.814 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:02.814 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:44:02.814 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:44:02.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.814 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:02.814 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:44:02.814 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:44:02.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.814 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:02.814 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:44:02.814 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:44:02.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.815 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:02.815 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:44:02.815 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:44:02.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.815 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:02.815 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:44:02.815 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:44:02.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.815 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:02.816 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:44:02.816 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:44:02.816 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.816 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:02.816 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.816 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:44:02.816 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:02.816 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 96.703587905000006, 2024-04-26T10:44:02.816 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:44:02.816 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:02.816 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:02.816 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:02.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.817 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:02.817 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:02.817 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.817 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:02.817 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:02.817 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.817 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:02.817 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:44:02.818 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:02.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.818 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:02.818 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:44:02.818 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:44:02.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.818 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:02.818 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:44:02.818 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:44:02.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.819 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:02.819 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:44:02.819 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:44:02.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.819 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:02.819 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:44:02.819 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:44:02.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.819 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:02.819 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:44:02.819 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:44:02.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.820 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:02.820 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:44:02.820 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:44:02.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.820 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:02.820 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:44:02.820 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:44:02.820 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.820 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:02.820 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.821 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:44:02.821 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:02.821 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 96.703373330999995, 2024-04-26T10:44:02.821 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:44:02.821 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:02.821 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:02.821 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:02.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.821 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:02.821 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:02.821 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.821 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:02.822 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:02.822 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.822 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:02.822 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:02.822 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:02.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.822 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:02.822 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:44:02.822 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:44:02.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.823 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:02.823 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:44:02.823 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:44:02.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.823 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:02.823 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:44:02.823 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:44:02.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.823 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:02.823 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:44:02.824 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:44:02.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.824 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:02.824 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:44:02.824 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:44:02.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.824 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:02.824 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:44:02.824 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:44:02.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.824 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:02.824 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:44:02.825 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:44:02.825 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.825 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:02.825 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.825 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.825 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:44:02.825 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:02.825 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 96.703034389999999, 2024-04-26T10:44:02.825 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:44:02.825 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:02.825 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:02.825 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:02.825 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.826 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:02.826 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:02.826 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.826 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:02.826 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:02.826 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.826 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:02.826 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:02.826 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:02.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.827 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:02.827 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:44:02.827 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:44:02.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.827 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:02.827 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:44:02.827 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:44:02.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.827 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:02.827 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:44:02.828 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:44:02.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.828 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:02.828 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:44:02.828 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:44:02.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.828 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:02.828 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:44:02.828 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:44:02.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.829 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:02.829 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:44:02.829 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:44:02.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.829 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:02.829 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:44:02.829 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:44:02.829 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.829 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:02.829 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.830 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:02.830 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:02.830 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 96.702925012999998, 2024-04-26T10:44:02.830 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:44:02.830 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:02.830 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:44:02.830 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:02.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.830 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:02.830 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:02.831 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.831 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:02.831 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:02.831 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.831 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:02.831 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:44:02.831 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:02.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.831 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:02.832 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:44:02.832 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:44:02.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.832 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:02.832 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:44:02.832 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:44:02.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.832 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:02.832 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:44:02.832 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:44:02.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.833 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:02.833 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:44:02.833 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:44:02.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.833 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:02.833 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:44:02.833 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:44:02.833 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.833 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:02.833 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.834 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:44:02.834 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:02.834 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 96.702885293999998, 2024-04-26T10:44:02.834 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:44:02.834 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:02.834 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:02.834 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:02.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.834 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:02.834 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:02.834 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.835 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:02.835 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:02.835 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.835 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:02.835 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:02.835 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:02.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.835 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:02.835 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:44:02.835 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:44:02.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.836 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:02.836 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:44:02.836 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:44:02.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.836 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:02.836 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:44:02.836 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:44:02.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.836 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:02.836 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:44:02.836 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:44:02.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.837 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.837 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:02.837 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:44:02.837 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:44:02.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.837 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.837 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:02.837 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:44:02.837 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:44:02.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.837 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.837 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:02.837 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:44:02.837 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:44:02.838 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.838 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:02.838 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.838 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:44:02.838 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:02.838 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 96.702547761000005, 2024-04-26T10:44:02.838 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:44:02.838 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:02.838 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:02.838 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:02.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.838 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:02.839 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:02.839 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.839 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:02.839 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:02.839 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:02.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.839 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:02.839 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:44:02.839 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:02.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.840 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:02.840 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:44:02.840 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:44:02.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.840 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:02.840 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:44:02.840 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:44:02.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.840 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:02.840 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:44:02.841 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:44:02.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.841 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:02.841 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:44:02.841 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:44:02.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.841 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:02.841 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:44:02.841 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:44:02.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.842 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:02.842 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:44:02.842 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:44:02.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:02.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:02.842 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:02.842 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:44:02.842 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:44:02.842 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.842 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:02.842 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.842 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:02.842 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:02.842 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:02.844 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:02.845 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:02.843+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:02.944 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:02.944+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:02.947 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:02.947 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:02.947 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:44:02.947 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:02.956 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:03.046 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:03.045+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:03.057 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:03.057 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:03.057 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:03.057 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:03.057 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:03.067 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:03.146 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~47s 2024-04-26T10:44:03.147 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:03.146+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:03.174 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:03.175 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:03.175 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:03.175 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:03.175 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.175 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:03.175 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:03.175 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 97.132167030000005, 2024-04-26T10:44:03.175 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:44:03.175 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:03.175 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.175 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:44:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.177 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.177 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:03.177 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:44:03.177 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:44:03.177 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.177 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.177 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:03.177 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:44:03.177 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:44:03.177 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.177 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.177 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.177 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:44:03.177 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:44:03.178 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.178 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.178 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:03.178 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:44:03.178 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:44:03.181 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.181 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.181 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:03.181 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:44:03.181 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:44:03.181 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.181 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.181 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:03.182 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:44:03.182 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:44:03.182 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.182 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.182 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:03.182 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:44:03.182 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:44:03.182 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.182 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:03.182 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.182 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.182 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.182 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:03.183 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:03.183 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 97.131296250000005, 2024-04-26T10:44:03.183 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:44:03.183 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:03.183 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.183 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:03.183 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.183 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:03.183 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:03.183 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.183 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.184 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.184 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:03.184 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:03.184 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.184 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.184 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.184 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:03.184 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:03.184 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.184 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.185 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.185 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:03.185 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:44:03.185 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:44:03.185 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.185 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.185 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:03.185 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:44:03.185 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:44:03.185 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.185 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.185 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.185 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:44:03.185 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:44:03.186 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.186 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.186 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:03.186 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:44:03.186 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:44:03.186 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.186 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.186 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:03.186 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:44:03.186 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:44:03.186 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.186 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.186 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:03.186 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:44:03.186 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:44:03.187 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.187 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.187 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:03.187 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:44:03.187 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:44:03.187 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.187 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:03.187 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.187 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.187 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.187 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:03.187 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:03.187 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 97.130308907, 2024-04-26T10:44:03.187 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:44:03.188 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:03.188 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.188 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:03.188 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.188 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:03.188 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:03.188 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.188 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.188 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.188 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:03.189 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:03.189 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.189 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.189 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.189 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:03.189 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:44:03.189 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:03.189 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.189 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.189 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:03.189 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:44:03.189 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:44:03.189 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.189 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.190 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:03.190 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:44:03.190 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:44:03.190 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.190 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.190 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.190 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:44:03.190 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:44:03.190 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.190 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.190 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:03.190 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:44:03.190 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:44:03.190 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.191 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.191 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:03.191 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:44:03.191 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:44:03.191 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.191 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.191 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:03.191 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:44:03.191 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:44:03.191 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.191 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.191 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:03.191 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:44:03.191 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:44:03.191 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.192 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:03.192 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.192 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.192 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.192 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:03.192 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:03.192 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 97.130103641999995, 2024-04-26T10:44:03.192 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:44:03.192 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:03.192 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.192 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:03.192 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.192 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:03.192 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:03.193 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.193 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.193 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.193 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:03.193 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:03.193 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.193 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.193 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.193 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:03.193 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:03.194 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.194 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.194 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.194 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:03.194 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:44:03.194 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:44:03.194 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.195 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.195 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:03.195 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:44:03.195 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:44:03.195 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.195 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.195 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.195 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:44:03.195 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:44:03.195 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.195 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.195 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:03.195 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:44:03.195 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:44:03.196 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.196 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.196 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:03.196 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:44:03.196 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:44:03.196 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.196 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.196 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:03.196 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:44:03.196 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:44:03.196 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.196 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.196 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:03.196 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:44:03.197 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:44:03.197 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.197 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:03.197 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.197 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.197 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.197 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:03.197 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:03.197 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 97.129782762999994, 2024-04-26T10:44:03.197 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:44:03.197 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:03.197 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.197 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:03.197 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.197 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:03.198 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:03.198 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.198 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.198 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.198 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:03.198 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:03.198 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.198 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.198 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.198 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:03.198 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:44:03.198 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:03.198 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.199 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.199 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:03.199 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:44:03.199 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:44:03.199 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.199 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.199 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:03.199 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:44:03.199 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:44:03.199 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.199 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.199 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.199 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:44:03.199 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:44:03.199 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.200 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.200 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:03.200 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:44:03.200 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:44:03.200 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.200 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.200 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:03.200 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:44:03.200 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:44:03.200 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.200 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.200 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:03.200 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:44:03.200 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:44:03.201 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.201 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.201 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:03.201 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:44:03.201 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:44:03.201 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.201 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.201 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:03.201 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:44:03.201 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:44:03.201 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.201 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.201 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:03.201 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:44:03.201 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:44:03.202 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.202 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.202 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:03.202 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:44:03.202 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:44:03.202 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.202 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:03.202 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.202 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.202 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.202 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:03.202 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:03.202 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 97.129730938999998, 2024-04-26T10:44:03.202 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:44:03.203 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:03.203 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.203 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:03.203 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.203 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:03.203 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:03.203 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.203 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.203 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.203 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:03.203 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:03.203 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.203 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.203 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.204 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:03.204 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:44:03.204 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.204 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.204 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.204 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:03.204 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:44:03.204 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:44:03.204 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.204 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.205 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:03.205 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:44:03.205 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:44:03.205 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.205 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.205 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.205 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:44:03.205 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:44:03.205 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.205 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.205 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:03.205 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:44:03.206 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:44:03.206 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.206 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.206 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:03.206 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:44:03.206 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:44:03.206 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.206 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.206 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:03.206 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:44:03.206 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:44:03.207 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.207 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.207 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:03.207 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:44:03.207 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:44:03.207 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.207 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.207 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:03.208 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:44:03.208 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:44:03.208 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.208 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.208 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:03.208 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:44:03.208 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:44:03.208 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.208 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.208 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:03.208 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:44:03.208 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:44:03.208 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.208 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:03.209 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.209 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.209 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.209 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:03.209 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:03.209 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 97.129677567000002, 2024-04-26T10:44:03.209 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:44:03.209 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:03.209 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.209 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:03.210 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.210 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:03.210 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:03.210 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.210 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.210 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.210 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:03.210 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:03.210 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.210 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.210 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.210 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:03.210 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:03.210 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.211 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.211 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.211 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:03.211 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:44:03.211 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:44:03.211 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.211 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.211 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:03.211 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:44:03.211 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:44:03.211 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.211 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.211 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.211 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:44:03.212 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:44:03.212 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.212 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.212 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:03.212 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:44:03.212 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:44:03.212 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.212 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.212 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:03.212 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:44:03.212 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:44:03.212 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.212 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.212 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:03.212 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:44:03.213 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:44:03.213 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.213 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.213 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:03.213 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:44:03.213 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:44:03.213 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.213 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.213 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:03.213 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:44:03.213 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:44:03.213 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.213 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.213 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:03.214 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:44:03.214 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:44:03.214 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.214 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.214 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:03.214 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:44:03.214 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:44:03.214 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.214 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:03.214 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.214 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.214 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.214 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:03.214 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:03.214 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 97.129633240000004, 2024-04-26T10:44:03.215 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:44:03.215 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:03.215 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.215 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:03.215 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.215 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:03.215 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:03.216 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.216 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.216 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.216 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:03.216 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:03.216 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.216 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.216 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.216 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:03.216 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:03.216 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:03.216 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.216 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.216 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:03.216 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:44:03.217 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:44:03.217 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.217 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.217 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:03.217 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:44:03.217 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:44:03.217 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.217 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.217 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.217 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:44:03.217 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:44:03.217 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.217 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.217 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:03.218 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:44:03.218 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:44:03.218 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.218 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.218 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:03.218 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:44:03.218 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:44:03.218 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.218 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.218 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:03.218 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:44:03.218 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:44:03.218 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.218 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.218 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:03.219 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:44:03.219 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:44:03.219 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.219 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.219 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:03.219 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:44:03.219 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:44:03.219 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.219 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.219 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:03.219 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:44:03.219 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:44:03.219 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.219 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.220 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:03.220 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:44:03.220 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:44:03.220 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.220 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:03.220 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.220 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.220 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.220 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:03.220 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:03.220 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 97.129609527, 2024-04-26T10:44:03.220 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:44:03.220 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:03.220 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.220 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:03.221 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.221 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:03.221 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:03.221 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.221 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.221 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.221 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:03.221 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:03.221 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.221 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.221 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.221 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:03.221 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:03.221 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.222 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.222 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.222 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:03.222 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:44:03.222 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:44:03.222 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.222 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.222 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:03.222 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:44:03.222 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:44:03.222 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.222 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.222 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.222 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:44:03.223 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:44:03.223 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.223 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.223 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:03.223 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:44:03.223 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:44:03.223 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.223 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.223 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:03.223 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:44:03.223 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:44:03.223 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.223 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.223 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:03.224 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:44:03.224 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:44:03.224 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.224 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.224 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:03.224 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:44:03.224 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:44:03.224 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.224 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.224 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:03.224 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:44:03.225 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:44:03.225 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.225 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.225 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:03.225 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:44:03.225 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:44:03.225 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.225 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.226 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:03.226 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:44:03.226 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:44:03.226 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.226 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:03.226 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.226 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.226 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.226 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:03.226 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:03.226 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 97.129575222, 2024-04-26T10:44:03.226 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:44:03.226 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:03.227 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.227 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:03.227 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.227 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:03.227 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:03.227 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.227 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.227 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.227 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:03.227 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:03.227 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.227 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.227 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.227 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:03.228 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:44:03.228 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.228 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.228 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.228 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:03.228 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:44:03.228 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:44:03.228 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.228 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.228 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:03.228 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:44:03.228 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:44:03.228 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.228 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.228 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.229 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:44:03.229 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:44:03.229 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.229 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.229 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:03.229 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:44:03.229 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:44:03.229 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.229 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.229 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:03.229 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:44:03.230 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:44:03.230 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.230 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.230 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:03.230 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:44:03.230 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:44:03.230 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.230 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.230 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:03.230 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:44:03.230 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:44:03.230 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.230 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.230 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:03.231 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:44:03.231 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:44:03.231 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.231 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.231 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:03.231 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:44:03.231 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:44:03.231 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.231 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.231 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:03.231 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:44:03.231 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:44:03.231 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.231 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:03.231 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.232 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.232 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.232 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:03.232 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:03.232 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 97.129238626000003, 2024-04-26T10:44:03.232 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:44:03.232 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:03.232 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:03.232 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:03.232 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.232 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:03.232 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:03.232 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.232 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.233 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.233 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:03.233 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:03.233 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.233 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.233 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.233 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:03.233 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:44:03.233 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:03.233 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.233 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.233 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:03.233 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:44:03.233 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:44:03.233 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.234 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.234 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:03.234 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:44:03.234 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:44:03.234 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.234 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.234 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.234 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:44:03.234 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:44:03.234 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.234 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.234 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:03.234 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:44:03.234 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:44:03.235 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.235 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.235 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:03.235 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:44:03.235 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:44:03.235 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.235 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.235 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:03.235 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:44:03.235 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:44:03.235 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.235 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:03.235 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.235 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.235 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.236 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:03.236 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:03.236 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 97.129196597999993, 2024-04-26T10:44:03.236 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:44:03.236 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:03.236 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:03.236 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:03.237 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.237 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:03.237 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:03.237 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.237 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.237 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.237 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:03.237 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:03.237 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.237 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.237 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.237 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:03.237 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:03.237 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.238 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.238 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.238 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:03.238 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:44:03.238 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:44:03.238 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.238 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.238 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:03.239 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:44:03.239 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:44:03.239 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.239 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.239 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.239 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:44:03.239 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:44:03.239 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.239 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.239 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:03.239 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:44:03.239 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:44:03.239 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.240 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.240 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:03.240 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:44:03.240 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:44:03.240 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.240 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.240 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:03.240 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:44:03.240 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:44:03.240 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.240 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:03.240 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.241 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.241 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.241 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:03.241 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:03.241 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 97.129143425999999, 2024-04-26T10:44:03.241 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:44:03.241 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:03.241 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:03.241 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:03.242 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.242 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:03.242 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:03.242 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.243 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.243 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.243 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:03.243 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:03.243 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.243 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.243 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.243 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:03.243 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:03.243 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.243 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.243 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.243 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:03.243 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:44:03.244 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:44:03.244 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.244 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.244 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:03.244 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:44:03.244 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:44:03.244 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.244 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.244 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.244 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:44:03.244 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:44:03.244 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.244 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.244 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:03.244 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:44:03.245 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:44:03.245 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.245 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.245 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:03.245 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:44:03.245 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:44:03.245 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.245 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.245 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:03.247 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:44:03.248 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:44:03.248 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.248 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:03.248 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.248 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.248 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.248 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:03.248 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:03.248 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 97.125737016000002, 2024-04-26T10:44:03.248 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:44:03.248 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:03.248 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:44:03.248 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:03.249 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.249 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:03.249 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:03.249 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.249 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.249 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.249 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:03.249 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:03.249 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.249 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.249 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.249 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:03.249 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:44:03.249 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.249 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.250 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.250 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:03.250 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:44:03.250 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:44:03.250 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.250 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.250 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:03.250 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:44:03.250 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:44:03.250 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.250 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.250 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.250 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:44:03.250 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:44:03.250 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.251 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.251 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:03.251 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:44:03.251 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:44:03.251 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.251 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.251 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:03.251 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:44:03.251 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:44:03.251 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.251 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:03.251 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.251 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.251 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.251 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:44:03.252 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:44:03.252 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 97.123265063000005, 2024-04-26T10:44:03.252 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:44:03.252 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:03.252 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:03.252 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:03.252 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.252 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:03.252 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:44:03.252 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.252 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.252 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.252 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:03.252 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:44:03.253 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.253 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.253 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.253 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:03.253 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:44:03.253 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.253 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.253 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.253 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:03.253 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:44:03.253 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:44:03.253 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.253 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.253 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:03.253 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:44:03.254 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:44:03.254 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.254 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.254 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.254 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:44:03.254 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:44:03.254 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.254 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.254 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:03.254 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:44:03.254 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:44:03.254 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.254 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.255 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:03.255 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:44:03.255 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:44:03.255 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.255 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.255 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:03.255 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:44:03.255 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:44:03.255 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.255 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:03.255 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.255 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.255 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.255 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:44:03.256 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:03.256 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 97.122611504999995, 2024-04-26T10:44:03.256 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:44:03.256 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:03.256 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:03.256 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:03.256 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.256 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:03.256 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:03.256 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.256 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.256 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.257 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:03.257 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:03.257 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.257 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.257 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.257 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:03.257 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:03.257 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.258 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.258 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.258 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:03.258 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:44:03.258 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:44:03.258 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.258 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.258 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:03.258 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:44:03.258 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:44:03.258 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.258 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.259 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.259 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:44:03.259 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:44:03.259 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.259 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.259 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:03.259 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:44:03.259 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:44:03.259 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.259 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.259 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:03.259 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:44:03.260 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:44:03.260 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.260 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.260 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:03.260 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:44:03.260 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:44:03.260 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.260 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:03.260 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.260 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.260 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.260 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:44:03.260 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:03.260 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 97.122535720000002, 2024-04-26T10:44:03.261 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:44:03.261 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:03.261 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:03.261 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:03.261 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.261 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:03.261 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:03.261 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.261 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.261 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.261 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:03.261 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:03.261 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.261 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.261 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.262 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:03.262 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:03.262 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.262 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.262 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.262 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:03.262 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:44:03.262 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:44:03.262 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.262 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.262 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:03.262 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:44:03.262 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:44:03.262 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.263 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.263 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.263 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:44:03.263 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:44:03.263 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.263 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.263 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:03.263 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:44:03.263 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:44:03.264 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.264 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.264 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:03.264 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:44:03.264 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:44:03.264 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.264 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.264 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:03.264 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:44:03.264 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:44:03.265 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.265 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:03.265 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.265 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.265 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.265 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:44:03.265 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:44:03.265 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 97.122322026000006, 2024-04-26T10:44:03.265 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:44:03.265 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:03.266 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:44:03.266 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:03.266 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.266 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:03.266 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:44:03.266 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.266 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.266 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.266 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:03.266 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:44:03.266 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.267 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.267 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.267 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:03.267 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:44:03.267 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.268 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.268 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.268 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:03.268 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:44:03.268 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:44:03.268 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.268 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.268 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:03.268 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:44:03.268 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:44:03.268 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.268 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.268 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.268 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:44:03.268 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:44:03.269 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.269 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.269 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:03.269 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:44:03.269 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:44:03.269 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.269 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.269 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:03.269 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:44:03.269 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:44:03.269 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.269 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:03.269 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.270 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.270 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.270 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:44:03.270 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:44:03.270 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 97.119878213000007, 2024-04-26T10:44:03.270 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:44:03.270 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:03.270 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:03.270 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:03.270 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.270 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:03.270 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:44:03.270 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.270 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.270 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.271 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:03.271 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:44:03.271 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.271 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.271 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.271 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:03.271 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:44:03.271 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:44:03.271 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.271 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.271 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:03.271 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:44:03.272 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:44:03.272 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.272 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.272 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:03.272 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:44:03.272 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:44:03.272 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.272 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.272 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.272 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:44:03.272 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:44:03.272 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.272 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.273 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:03.273 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:44:03.273 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:44:03.273 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.273 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.273 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:03.273 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:44:03.273 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:44:03.273 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.273 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.273 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:03.273 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:44:03.273 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:44:03.273 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.273 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:03.274 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.274 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.274 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.274 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:44:03.274 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:03.274 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 91.669815768999996, 2024-04-26T10:44:03.274 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:44:03.274 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:03.274 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.274 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:03.274 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.274 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:03.274 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:03.274 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.275 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.275 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.275 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:03.275 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:03.275 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:03.275 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.275 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.275 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:03.275 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:44:03.275 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:03.275 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.275 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.275 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:03.275 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:44:03.276 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:44:03.276 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.276 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.276 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:03.276 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:44:03.276 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:44:03.276 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.276 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.276 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.276 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:44:03.276 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:44:03.276 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.276 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.276 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:03.276 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:44:03.277 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:44:03.277 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.277 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.277 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:03.277 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:44:03.277 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:44:03.277 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.277 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.277 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:03.277 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:44:03.277 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:44:03.277 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.277 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.277 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:03.278 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:44:03.278 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:44:03.278 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.278 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.278 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:03.278 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:44:03.278 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:44:03.278 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.278 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.278 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:03.278 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:44:03.278 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:44:03.278 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:03.279 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:03.279 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:03.279 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:44:03.279 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:44:03.279 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.279 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:03.279 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.279 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:03.279 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:03.279 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:03.281 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:03.279+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:03.281 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:03.315 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:44:03.382 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:03.381+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:03.398 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:03.398 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:03.398 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:44:03.398 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:03.408 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:03.494 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:03.493+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:03.556 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:03.556 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:03.556 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:03.556 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:03.556 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:03.565 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:03.583 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:03.582+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:03.684 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:03.683+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:03.712 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 97.674438842000001, 2024-04-26T10:44:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:44:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:44:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:44:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:44:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:44:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:44:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:44:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:44:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:44:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:44:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:44:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:44:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:44:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:44:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:44:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 97.672688721, 2024-04-26T10:44:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:44:03.718 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:03.718 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.718 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:03.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.718 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:03.718 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:03.718 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.718 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:03.718 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:44:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:44:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:44:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:44:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:44:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:44:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:44:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:44:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:44:03.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.721 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:03.721 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:44:03.721 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:44:03.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:44:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:44:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:44:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:44:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:44:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:44:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:44:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:44:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:44:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:44:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 97.672635722999999, 2024-04-26T10:44:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:44:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:44:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:44:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:44:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:44:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:44:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:44:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:44:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:44:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:44:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:44:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:44:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:44:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:44:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:44:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:44:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:44:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:44:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:44:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:44:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:44:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 97.672557979000004, 2024-04-26T10:44:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:44:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:44:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:44:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:44:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:44:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:44:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:44:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:44:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:44:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:44:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:44:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:44:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:44:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:44:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:44:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:44:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:44:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:44:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:44:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:44:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:44:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:44:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 97.672518972999995, 2024-04-26T10:44:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:44:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:44:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:44:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:44:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:44:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:44:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:44:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:44:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:44:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:44:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:44:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:44:03.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.741 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:03.741 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:44:03.741 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:44:03.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.741 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:03.741 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:44:03.741 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:44:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:44:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:44:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:44:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:44:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:44:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:44:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 97.672500151999998, 2024-04-26T10:44:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:44:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:44:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:44:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:44:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:44:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:44:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:44:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:44:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:44:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:44:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:44:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:44:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:44:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:44:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:44:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:44:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:44:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:44:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:44:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:44:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:44:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 97.67246815, 2024-04-26T10:44:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:44:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:44:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:44:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:44:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:44:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:44:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:44:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:44:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:44:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:44:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:44:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:44:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:44:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:44:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:44:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:44:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:44:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:44:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:44:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:44:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:44:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:44:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 97.672259342000004, 2024-04-26T10:44:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:44:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:44:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:44:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:44:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:44:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:44:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:44:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:44:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:44:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:44:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:44:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:44:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:44:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:44:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:44:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:44:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:44:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:44:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:44:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:44:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:44:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:44:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 97.672228051000005, 2024-04-26T10:44:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:44:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:44:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:44:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:44:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:44:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:44:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:44:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:44:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:44:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:44:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:44:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:44:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:44:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:44:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 97.672200801000002, 2024-04-26T10:44:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:44:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:44:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:44:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:44:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:44:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:44:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:44:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:44:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:44:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:44:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:44:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:44:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:44:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 97.669424050000003, 2024-04-26T10:44:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:44:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:44:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:44:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:44:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:44:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:44:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:44:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:44:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:44:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:44:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:44:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:44:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:44:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 97.669373961000005, 2024-04-26T10:44:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:44:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:44:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:44:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:44:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:44:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:44:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:44:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:44:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:44:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:44:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:44:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:44:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:44:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:44:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:44:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:44:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 97.668481892000003, 2024-04-26T10:44:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:44:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:44:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:44:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:44:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:44:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:44:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:44:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:44:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:44:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:44:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:44:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:44:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:44:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:44:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:44:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:44:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 97.666293562999996, 2024-04-26T10:44:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:44:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:44:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:44:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:44:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:44:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:44:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:44:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:44:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:44:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:44:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:44:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:44:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:44:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:44:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:44:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:44:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 97.666158193000001, 2024-04-26T10:44:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:44:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:44:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:44:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:44:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:44:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:44:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:44:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:44:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:44:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:44:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:44:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:44:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:44:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:44:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:44:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:44:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:44:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 97.665943619000004, 2024-04-26T10:44:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:44:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.794 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:03.794 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:03.794 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.794 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:03.794 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:03.794 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.794 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:03.795 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:44:03.795 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:44:03.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.795 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:03.795 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:44:03.795 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:44:03.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.795 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.795 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:44:03.795 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:44:03.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:44:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:44:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:44:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:44:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:44:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:44:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:44:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:44:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:44:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 97.665604677999994, 2024-04-26T10:44:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:44:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.798 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:03.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.798 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:03.798 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:03.798 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.798 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:03.799 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:03.799 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.799 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:03.799 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:03.799 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.799 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:44:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:44:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:44:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:44:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:44:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:44:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:44:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:44:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:44:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:44:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:44:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:44:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.802 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:03.802 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:44:03.802 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:44:03.802 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.802 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:03.802 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.802 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:03.802 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:03.802 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 97.665495300999993, 2024-04-26T10:44:03.802 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:44:03.802 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:03.803 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:44:03.803 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:03.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.803 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:03.803 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:03.803 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.803 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:03.803 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:03.803 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.803 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:03.803 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:44:03.804 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:03.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.804 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:03.804 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:44:03.804 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:44:03.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.804 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:03.804 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:44:03.804 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:44:03.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.804 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.805 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:44:03.805 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:44:03.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.805 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:03.805 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:44:03.805 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:44:03.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.805 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:03.805 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:44:03.805 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:44:03.805 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.805 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:03.806 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.806 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:44:03.806 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:03.806 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 97.665455582000007, 2024-04-26T10:44:03.806 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:44:03.806 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:03.806 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.806 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:03.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.806 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:03.806 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:03.807 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.807 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:03.807 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:03.807 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.807 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:03.807 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:03.807 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:03.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.807 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:03.807 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:44:03.808 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:44:03.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.808 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:03.808 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:44:03.808 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:44:03.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.808 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.808 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:44:03.808 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:44:03.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.809 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:03.809 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:44:03.809 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:44:03.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.809 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:03.809 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:44:03.809 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:44:03.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.810 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:03.810 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:44:03.810 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:44:03.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.810 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:03.810 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:44:03.810 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:44:03.810 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.811 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:03.811 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.811 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:44:03.811 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:03.811 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 97.665118049, 2024-04-26T10:44:03.811 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:44:03.811 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:03.811 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:03.811 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:03.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.811 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:03.811 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:03.812 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.812 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:03.812 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:03.812 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:03.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.812 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:03.812 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:44:03.812 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:03.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.812 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:03.812 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:44:03.813 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:44:03.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.813 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:03.813 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:44:03.813 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:44:03.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.813 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:03.813 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:44:03.813 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:44:03.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.814 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:03.814 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:44:03.814 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:44:03.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.814 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:03.815 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:44:03.815 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:44:03.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.816 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:03.816 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:44:03.816 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:44:03.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:03.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:03.816 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:03.816 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:44:03.816 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:44:03.816 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.816 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:03.816 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.816 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:03.816 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:03.817 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:03.818 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:03.819 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:03.817+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:03.919 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:03.918+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:03.926 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:03.927 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:03.927 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:44:03.927 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:03.936 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:04.020 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:04.019+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:04.037 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:04.037 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:04.037 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:04.037 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:04.038 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:04.046 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:04.121 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:04.121+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:04.150 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:04.151 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:04.151 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:04.151 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:04.151 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.151 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:04.151 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:04.151 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 98.112086191000003, 2024-04-26T10:44:04.151 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:44:04.151 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:04.151 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.151 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:04.151 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.151 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:04.152 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:04.152 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.152 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.152 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:04.152 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:04.152 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.152 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.152 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:04.152 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:44:04.152 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.152 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:04.153 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:44:04.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:44:04.153 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:04.153 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:44:04.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:44:04.153 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.153 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:44:04.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:44:04.153 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.154 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.154 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:04.154 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:44:04.154 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:44:04.154 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.154 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.154 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:04.154 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:44:04.154 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:44:04.154 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.154 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.154 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:04.154 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:44:04.155 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:44:04.155 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.155 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.155 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:04.155 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:44:04.155 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:44:04.155 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.156 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:04.156 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.156 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.156 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.157 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:04.157 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:04.157 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 98.111215411000003, 2024-04-26T10:44:04.157 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:44:04.157 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:04.157 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.157 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:04.157 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.157 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:04.157 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:04.157 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.157 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.157 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.157 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:04.158 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:04.158 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.158 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.158 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.158 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:04.158 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:04.158 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.158 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.158 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.158 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:04.158 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:44:04.158 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:44:04.158 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.159 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.159 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:04.159 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:44:04.159 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:44:04.159 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.159 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.159 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.159 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:44:04.159 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:44:04.159 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.159 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.159 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:04.159 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:44:04.159 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:44:04.159 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.160 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.160 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:04.160 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:44:04.160 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:44:04.160 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.160 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.160 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:04.160 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:44:04.160 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:44:04.160 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.160 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.160 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:04.160 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:44:04.160 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:44:04.161 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.161 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:04.161 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.161 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.161 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.161 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:04.161 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:04.161 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 98.110228067999998, 2024-04-26T10:44:04.161 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:44:04.161 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:04.161 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.161 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:04.161 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.161 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:04.162 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:04.162 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.162 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.162 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.162 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:04.162 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:04.162 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.162 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.162 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.162 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:04.163 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:44:04.163 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:04.163 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.163 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.163 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:04.163 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:44:04.163 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:44:04.163 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.163 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.163 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:04.163 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:44:04.163 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:44:04.163 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.163 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.164 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.164 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:44:04.164 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:44:04.164 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.164 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.164 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:04.164 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:44:04.164 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:44:04.164 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.164 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.164 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:04.164 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:44:04.164 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:44:04.164 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.164 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.165 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:04.165 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:44:04.165 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:44:04.165 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.165 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.165 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:04.165 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:44:04.165 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:44:04.165 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.165 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:04.165 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.165 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.165 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.165 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:04.166 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:04.166 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 98.110022803000007, 2024-04-26T10:44:04.166 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:44:04.166 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:04.166 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.166 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:04.166 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.166 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:04.166 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:04.166 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.166 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.166 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.166 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:04.166 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:04.167 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.167 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.167 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.167 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:04.167 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:04.167 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.167 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.167 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.167 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:04.167 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:44:04.167 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:44:04.167 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.167 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.167 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:04.168 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:44:04.168 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:44:04.168 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.168 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.168 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.168 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:44:04.168 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:44:04.168 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.168 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.168 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:04.168 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:44:04.168 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:44:04.168 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.168 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.169 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:04.169 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:44:04.169 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:44:04.169 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.169 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.169 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:04.169 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:44:04.169 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:44:04.169 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.169 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.169 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:04.169 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:44:04.169 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:44:04.169 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.170 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:04.170 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.170 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.170 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.170 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:04.170 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:04.170 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 98.109701924000007, 2024-04-26T10:44:04.170 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:44:04.170 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:04.170 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.170 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:04.170 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.170 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:04.170 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:04.171 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.171 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.171 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.171 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:04.171 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:04.171 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.171 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.171 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.171 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:04.171 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:44:04.171 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:04.171 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.171 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.171 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:04.172 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:44:04.172 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:44:04.172 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.172 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.172 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:04.172 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:44:04.172 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:44:04.172 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.172 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.172 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.172 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:44:04.172 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:44:04.172 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.172 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.173 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:04.173 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:44:04.173 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:44:04.173 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.173 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.173 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:04.173 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:44:04.173 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:44:04.173 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.173 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.173 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:04.173 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:44:04.173 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:44:04.173 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.174 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.174 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:04.174 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:44:04.174 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:44:04.174 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.174 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.174 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:04.174 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:44:04.174 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:44:04.174 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.174 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.174 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:04.174 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:44:04.174 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:44:04.175 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.175 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.175 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:04.175 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:44:04.175 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:44:04.175 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.175 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:04.175 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.175 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.175 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.175 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:04.175 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:04.175 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 98.109650099999996, 2024-04-26T10:44:04.175 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:44:04.176 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:04.176 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.176 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:04.176 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.176 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:04.176 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:04.176 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.176 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.176 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.176 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:04.176 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:04.176 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.176 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.176 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.176 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:04.177 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:44:04.177 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.177 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.177 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.177 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:04.177 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:44:04.177 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:44:04.177 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.177 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.177 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:04.177 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:44:04.177 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:44:04.177 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.177 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.178 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.178 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:44:04.178 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:44:04.178 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.178 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.178 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:04.178 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:44:04.178 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:44:04.178 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.178 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.178 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:04.178 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:44:04.178 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:44:04.178 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.179 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.179 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:04.179 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:44:04.179 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:44:04.179 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.179 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.179 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:04.179 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:44:04.179 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:44:04.179 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.179 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.179 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:04.179 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:44:04.179 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:44:04.179 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.180 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.180 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:04.180 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:44:04.180 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:44:04.180 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.180 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.181 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:04.181 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:44:04.181 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:44:04.181 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.181 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:04.181 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.182 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.182 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.182 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:04.182 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:04.182 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 98.109596728, 2024-04-26T10:44:04.182 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:44:04.183 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:04.183 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.183 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:04.183 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.183 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:04.183 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:04.183 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.183 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.183 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.183 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:04.183 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:04.184 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.184 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.184 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.184 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:04.184 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:04.184 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.184 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.184 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.184 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:04.184 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:44:04.184 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:44:04.184 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.184 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.184 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:04.185 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:44:04.185 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:44:04.185 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.185 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.185 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.185 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:44:04.185 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:44:04.185 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.185 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.185 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:04.186 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:44:04.186 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:44:04.186 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.186 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.186 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:04.187 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:44:04.187 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:44:04.187 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.187 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.190 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:04.190 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:44:04.190 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:44:04.190 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.190 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.190 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:04.190 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:44:04.190 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:44:04.190 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.190 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.191 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:04.191 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:44:04.191 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:44:04.191 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.191 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.191 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:04.191 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:44:04.191 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:44:04.191 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.191 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.191 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:04.191 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:44:04.191 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:44:04.191 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.192 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:04.192 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.192 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.192 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.192 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:04.192 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:04.192 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 98.109552401000002, 2024-04-26T10:44:04.192 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:44:04.192 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:04.192 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.192 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:04.192 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.192 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:04.192 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:04.193 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.193 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.193 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.193 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:04.193 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:04.193 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.193 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.193 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.193 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:04.194 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:04.195 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:04.195 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.195 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.195 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:04.195 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:44:04.195 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:44:04.195 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.195 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.195 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:04.195 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:44:04.195 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:44:04.195 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.196 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.196 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.196 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:44:04.196 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:44:04.196 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.196 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.196 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:04.196 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:44:04.196 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:44:04.196 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.196 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.196 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:04.196 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:44:04.196 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:44:04.196 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.197 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.197 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:04.197 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:44:04.197 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:44:04.197 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.197 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.197 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:04.197 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:44:04.197 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:44:04.197 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.197 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.197 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:04.197 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:44:04.197 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:44:04.198 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.198 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.198 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:04.198 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:44:04.198 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:44:04.198 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.198 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.198 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:04.198 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:44:04.198 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:44:04.198 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.198 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:04.198 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.198 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.199 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.199 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:04.199 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:04.199 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 98.109528687999997, 2024-04-26T10:44:04.199 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:44:04.199 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:04.199 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.199 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:04.199 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.199 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:04.199 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:04.199 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.200 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.200 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.200 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:04.200 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:04.200 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.200 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.200 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.200 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:04.200 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:04.200 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.200 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.200 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.200 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:04.200 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:44:04.201 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:44:04.201 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.201 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.201 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:04.201 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:44:04.201 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:44:04.201 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.201 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.201 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.201 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:44:04.202 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:44:04.202 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.202 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.202 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:04.202 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:44:04.202 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:44:04.202 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.202 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.202 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:04.202 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:44:04.203 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:44:04.203 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.203 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.203 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:04.203 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:44:04.203 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:44:04.203 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.203 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.203 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:04.203 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:44:04.203 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:44:04.203 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.203 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.203 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:04.204 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:44:04.204 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:44:04.204 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.204 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.204 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:04.204 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:44:04.204 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:44:04.204 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.204 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.204 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:04.204 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:44:04.204 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:44:04.204 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.204 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:04.205 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.205 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.205 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.205 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:04.205 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:04.205 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 98.109494382999998, 2024-04-26T10:44:04.206 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:44:04.206 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:04.206 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.206 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:04.206 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.206 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:04.206 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:04.206 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.206 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.206 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.207 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:04.207 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:04.207 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.207 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.207 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.207 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:04.207 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:44:04.207 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.207 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.207 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.207 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:04.208 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:44:04.208 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:44:04.208 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.208 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.208 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:04.208 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:44:04.208 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:44:04.208 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.208 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.208 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.208 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:44:04.208 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:44:04.208 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.208 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.208 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:04.209 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:44:04.209 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:44:04.209 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.209 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.209 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:04.209 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:44:04.209 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:44:04.209 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.209 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.209 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:04.209 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:44:04.209 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:44:04.209 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.210 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.210 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:04.210 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:44:04.210 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:44:04.210 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.210 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.210 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:04.210 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:44:04.210 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:44:04.211 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.211 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.211 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:04.211 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:44:04.211 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:44:04.211 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.211 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.211 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:04.212 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:44:04.212 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:44:04.212 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.212 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:04.212 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.213 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.213 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.213 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:04.213 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:04.213 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 98.109157787000001, 2024-04-26T10:44:04.213 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:44:04.213 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:04.213 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:04.213 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:04.213 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.213 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:04.213 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:04.213 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.213 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.214 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.214 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:04.214 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:04.214 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.214 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.214 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.214 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:04.214 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:44:04.214 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:04.214 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.214 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.214 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:04.215 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:44:04.215 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:44:04.215 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.215 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.215 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:04.215 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:44:04.215 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:44:04.215 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.215 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.216 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.216 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:44:04.216 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:44:04.216 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.216 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.216 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:04.216 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:44:04.216 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:44:04.216 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.216 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.216 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:04.217 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:44:04.217 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:44:04.217 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.217 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.217 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:04.217 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:44:04.217 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:44:04.217 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.217 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:04.217 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.217 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.217 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.217 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:04.218 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:04.218 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 98.109115759000005, 2024-04-26T10:44:04.218 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:44:04.218 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:04.218 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:04.218 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:04.218 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.218 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:04.218 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:04.218 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.218 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.219 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.219 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:04.219 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:04.219 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.219 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.219 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.219 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:04.219 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:04.219 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.219 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.219 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.219 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:04.219 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:44:04.219 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:44:04.220 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.220 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.220 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:04.220 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:44:04.220 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:44:04.220 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.220 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.220 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.220 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:44:04.220 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:44:04.220 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.220 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.220 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:04.220 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:44:04.221 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:44:04.221 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.221 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.221 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:04.221 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:44:04.221 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:44:04.221 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.221 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.221 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:04.221 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:44:04.221 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:44:04.221 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.221 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:04.221 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.221 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.222 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.222 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:04.222 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:04.222 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 98.109062586999997, 2024-04-26T10:44:04.222 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:44:04.222 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:04.222 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:04.222 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:04.222 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.222 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:04.223 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:04.223 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.223 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.223 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.224 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:04.224 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:04.224 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.224 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.224 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.224 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:04.224 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:04.224 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.224 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.224 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.225 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:04.225 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:44:04.225 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:44:04.225 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.225 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.225 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:04.225 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:44:04.225 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:44:04.225 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.225 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.225 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.226 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:44:04.226 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:44:04.226 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.226 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.226 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:04.226 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:44:04.227 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:44:04.227 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.227 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.227 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:04.227 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:44:04.227 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:44:04.227 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.227 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.227 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:04.227 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:44:04.227 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:44:04.227 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.227 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:04.227 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.228 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.228 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.228 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:04.228 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:04.228 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 98.105656177, 2024-04-26T10:44:04.228 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:44:04.228 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:04.228 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:44:04.228 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:04.228 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.228 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:04.228 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:04.228 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.228 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.228 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.229 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:04.229 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:04.229 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.229 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.229 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.229 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:04.229 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:44:04.229 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.229 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.229 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.229 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:04.229 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:44:04.229 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:44:04.229 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.229 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.230 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:04.230 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:44:04.230 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:44:04.230 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.230 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.230 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.230 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:44:04.230 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:44:04.230 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.230 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.230 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:04.230 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:44:04.230 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:44:04.230 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.231 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.231 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:04.231 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:44:04.231 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:44:04.231 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.231 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:04.231 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.231 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.231 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.231 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:44:04.231 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:44:04.231 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 98.103184224000003, 2024-04-26T10:44:04.231 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:44:04.231 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:04.231 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:04.232 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:04.232 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.232 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:04.232 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:44:04.232 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.232 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.232 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.232 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:04.232 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:44:04.232 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.232 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.232 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.232 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:04.232 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:44:04.233 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.233 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.233 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.233 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:04.233 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:44:04.233 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:44:04.233 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.233 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.233 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:04.233 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:44:04.234 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:44:04.234 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.234 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.234 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.234 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:44:04.234 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:44:04.234 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.234 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.234 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:04.234 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:44:04.235 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:44:04.235 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.235 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.235 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:04.235 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:44:04.235 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:44:04.235 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.235 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.235 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:04.235 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:44:04.235 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:44:04.235 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.235 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:04.235 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.236 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.236 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.236 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:44:04.236 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:04.236 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 98.102530666000007, 2024-04-26T10:44:04.236 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:44:04.236 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:04.236 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:04.236 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:04.236 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.236 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:04.237 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:04.237 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.237 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.237 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.237 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:04.237 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:04.237 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.237 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.237 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.238 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:04.238 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:04.238 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.238 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.238 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.238 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:04.238 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:44:04.238 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:44:04.238 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.238 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.238 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:04.238 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:44:04.238 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:44:04.238 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.239 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.239 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.239 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:44:04.239 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:44:04.239 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.239 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.239 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:04.239 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:44:04.239 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:44:04.239 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.239 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.239 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:04.239 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:44:04.239 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:44:04.240 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.240 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.240 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:04.240 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:44:04.240 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:44:04.240 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.240 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:04.240 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.240 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.240 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.240 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:44:04.240 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:04.240 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 98.102454881, 2024-04-26T10:44:04.240 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:44:04.240 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:04.241 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:04.241 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:04.241 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.241 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:04.241 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:04.241 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.241 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.241 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.241 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:04.241 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:04.241 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.241 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.241 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.242 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:04.242 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:04.242 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.242 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.242 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.242 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:04.242 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:44:04.242 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:44:04.242 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.243 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.243 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:04.243 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:44:04.243 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:44:04.243 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.243 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.243 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.243 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:44:04.243 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:44:04.243 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.243 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.243 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:04.243 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:44:04.243 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:44:04.243 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.244 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.244 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:04.244 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:44:04.244 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:44:04.244 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.244 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.245 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:04.245 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:44:04.245 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:44:04.245 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.245 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:04.245 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.245 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.245 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.245 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:44:04.245 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:44:04.245 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 98.102241187000004, 2024-04-26T10:44:04.245 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:44:04.245 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:04.245 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:44:04.246 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:04.246 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.246 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:04.246 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:44:04.246 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.246 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.246 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.246 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:04.246 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:44:04.246 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.246 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.246 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.246 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:04.246 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:44:04.246 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.247 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.247 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.247 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:04.247 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:44:04.247 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:44:04.247 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.248 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.248 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:04.248 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:44:04.248 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:44:04.248 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.248 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.248 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.248 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:44:04.248 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:44:04.248 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.248 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.248 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:04.248 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:44:04.248 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:44:04.249 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.249 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.249 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:04.249 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:44:04.249 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:44:04.249 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.249 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:04.249 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.249 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.249 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.249 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:44:04.249 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:44:04.249 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 98.099797374000005, 2024-04-26T10:44:04.249 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:44:04.249 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:04.250 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:04.250 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:04.250 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.250 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:04.250 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:44:04.250 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.250 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.250 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.250 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:04.250 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:44:04.250 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.250 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.250 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.250 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:04.251 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:44:04.251 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:44:04.251 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.251 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.251 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:04.251 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:44:04.251 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:44:04.251 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.251 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.251 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:04.251 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:44:04.251 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:44:04.251 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.251 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.252 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.252 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:44:04.252 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:44:04.252 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.252 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.252 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:04.252 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:44:04.252 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:44:04.252 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.252 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.252 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:04.252 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:44:04.252 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:44:04.252 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.252 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.253 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:04.253 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:44:04.253 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:44:04.253 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.253 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:04.253 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.253 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.253 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.253 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:44:04.253 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:04.253 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 92.649734929999994, 2024-04-26T10:44:04.253 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:44:04.253 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:04.253 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.253 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:04.254 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.254 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:04.254 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:04.254 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.254 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.254 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.254 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:04.255 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:04.255 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:04.255 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.255 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.255 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:04.255 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:44:04.255 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:04.255 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.256 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.256 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:04.256 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:44:04.256 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:44:04.256 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.256 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.256 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:04.256 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:44:04.256 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:44:04.256 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.256 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.256 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.256 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:44:04.256 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:44:04.256 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.257 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.257 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:04.257 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:44:04.257 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:44:04.257 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.257 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.257 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:04.257 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:44:04.257 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:44:04.257 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.257 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.257 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:04.258 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:44:04.258 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:44:04.258 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.258 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.259 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:04.259 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:44:04.259 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:44:04.259 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.259 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.259 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:04.259 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:44:04.259 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:44:04.259 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.259 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.259 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:04.259 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:44:04.259 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:44:04.259 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:04.260 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:04.260 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:04.260 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:44:04.260 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:44:04.260 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.260 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:04.260 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.260 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:04.260 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:04.260 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:04.263 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:04.260+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:04.263 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:04.311 INFO:teuthology.orchestra.run.smithi049.stderr:noscrub is unset 2024-04-26T10:44:04.362 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:04.361+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:04.380 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:04.380 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:04.380 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:44:04.381 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:04.389 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:04.464 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:04.463+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:04.496 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:04.496 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:04.496 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:04.496 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:04.496 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:04.505 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:04.565 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:04.564+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:04.622 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:44:04.652 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:04.652 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:04.652 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:04.653 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:04.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.653 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:04.653 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:04.653 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 98.614717248999995, 2024-04-26T10:44:04.653 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:44:04.653 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:04.653 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.653 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:04.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.653 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:04.653 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:04.653 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.654 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:04.654 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:04.654 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.654 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:04.654 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:04.654 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.654 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:04.654 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:44:04.655 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:44:04.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.655 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:04.655 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:44:04.655 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:44:04.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.655 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.655 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:44:04.655 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:44:04.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.655 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:04.655 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:44:04.656 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:44:04.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.656 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:04.656 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:44:04.656 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:44:04.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.656 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:04.656 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:44:04.656 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:44:04.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.656 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:04.657 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:44:04.657 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:44:04.657 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.657 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:04.657 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.657 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:04.657 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:04.657 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 98.612967127999994, 2024-04-26T10:44:04.657 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:44:04.657 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:04.657 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.657 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:04.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.658 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:04.658 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:04.658 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.658 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:04.658 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:04.658 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.658 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:04.658 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:44:04.659 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:04.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.659 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:04.659 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:44:04.659 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:44:04.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.659 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:04.659 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:44:04.659 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:44:04.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.660 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.660 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:44:04.660 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:44:04.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.660 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:04.660 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:44:04.660 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:44:04.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.660 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:04.660 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:44:04.660 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:44:04.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.661 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:04.661 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:44:04.661 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:44:04.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.661 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:04.661 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:44:04.661 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:44:04.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.661 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:04.661 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:44:04.661 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:44:04.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.662 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.662 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:04.662 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:44:04.662 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:44:04.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.662 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.662 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:04.662 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:44:04.663 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:44:04.663 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.663 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:04.663 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.663 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:04.663 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:04.663 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 98.612914129999993, 2024-04-26T10:44:04.663 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:44:04.663 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:04.663 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.663 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:04.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.664 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:04.664 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:04.664 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.664 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:04.664 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:04.664 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.664 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:04.664 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:04.664 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.665 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:04.665 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:44:04.665 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:44:04.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.665 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:04.665 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:44:04.665 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:44:04.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.665 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.665 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:44:04.665 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:44:04.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.666 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:04.666 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:44:04.666 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:44:04.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.666 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:04.666 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:44:04.666 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:44:04.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.666 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:04.666 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:44:04.667 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:44:04.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.667 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:04.667 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:44:04.667 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:44:04.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.667 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:04.667 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:44:04.667 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:44:04.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.667 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:04.668 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:44:04.668 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:44:04.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.668 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:04.668 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:44:04.668 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:44:04.668 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.668 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:04.668 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.668 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:04.668 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:04.669 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 98.612836385999998, 2024-04-26T10:44:04.669 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:44:04.669 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:04.669 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.669 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:04.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.669 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:04.669 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:04.669 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.669 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:04.669 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:04.669 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.670 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:04.670 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:44:04.670 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:04.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.670 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:04.670 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:44:04.670 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:44:04.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.671 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:04.671 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:44:04.671 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:44:04.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.671 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.671 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:44:04.671 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:44:04.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.671 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:04.671 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:44:04.671 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:44:04.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.672 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:04.672 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:44:04.672 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:44:04.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.672 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:04.672 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:44:04.672 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:44:04.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.672 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:04.672 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:44:04.672 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:44:04.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.673 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:04.673 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:44:04.673 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:44:04.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.673 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:04.673 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:44:04.673 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:44:04.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.673 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:04.673 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:44:04.674 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:44:04.674 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.674 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:04.674 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.674 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:04.674 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:04.674 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 98.612797380000003, 2024-04-26T10:44:04.674 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:44:04.674 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:04.674 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.674 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:04.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.675 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:04.675 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:04.675 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.675 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:04.675 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:04.675 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.675 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:04.675 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:44:04.675 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:04.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.676 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:04.676 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:44:04.676 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:44:04.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.676 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:04.676 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:44:04.676 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:44:04.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.676 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.676 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:44:04.676 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:44:04.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.677 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:04.677 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:44:04.677 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:44:04.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.677 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:04.677 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:44:04.677 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:44:04.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.677 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:04.677 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:44:04.677 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:44:04.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.678 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:04.678 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:44:04.678 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:44:04.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.678 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:04.678 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:44:04.678 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:44:04.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.678 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:04.678 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:44:04.678 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:44:04.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.679 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:04.679 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:44:04.679 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:44:04.679 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.679 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:04.679 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.679 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:04.679 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:04.679 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 98.612778559000006, 2024-04-26T10:44:04.679 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:44:04.679 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:04.679 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.680 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:04.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.680 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:04.680 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:04.680 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.680 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:04.680 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:04.680 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.680 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:04.680 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:04.681 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:04.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.681 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:04.681 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:44:04.681 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:44:04.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.681 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:04.681 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:44:04.681 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:44:04.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.682 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.682 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:44:04.682 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:44:04.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.682 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:04.682 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:44:04.682 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:44:04.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.682 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:04.682 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:44:04.682 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:44:04.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.683 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:04.683 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:44:04.683 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:44:04.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.683 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:04.683 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:44:04.683 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:44:04.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.683 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:04.683 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:44:04.683 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:44:04.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.684 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:04.684 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:44:04.684 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:44:04.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.684 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:04.684 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:44:04.684 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:44:04.684 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.684 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:04.684 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.685 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:04.685 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:04.685 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 98.612746556999994, 2024-04-26T10:44:04.685 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:44:04.685 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:04.685 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.685 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:04.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.685 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:04.685 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:04.685 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.685 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:04.686 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:04.686 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.686 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:04.686 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:44:04.686 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.686 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:04.686 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:44:04.686 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:44:04.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.686 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:04.687 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:44:04.687 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:44:04.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.687 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.687 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:44:04.687 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:44:04.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.687 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:04.687 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:44:04.687 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:44:04.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.688 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:04.688 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:44:04.688 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:44:04.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.688 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:04.688 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:44:04.688 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:44:04.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.688 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:04.688 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:44:04.688 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:44:04.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:44:04.689 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:44:04.690 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.690 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:04.690 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.690 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:04.690 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:04.690 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 98.612537748999998, 2024-04-26T10:44:04.690 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:44:04.690 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:04.690 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.690 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:04.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.690 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:04.690 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:04.691 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.691 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:04.691 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:04.691 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.691 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:04.691 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:44:04.691 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:04.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.691 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.692 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:04.693 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:44:04.693 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:44:04.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.693 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:04.693 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:44:04.693 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:44:04.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.693 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:04.693 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:44:04.693 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:44:04.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.693 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:04.694 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:44:04.694 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:44:04.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.694 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:04.694 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:44:04.694 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:44:04.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.694 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:04.694 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:44:04.694 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:44:04.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.695 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:04.695 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:44:04.695 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:44:04.695 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.695 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:04.695 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.695 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:04.695 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:04.695 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 98.612506457999999, 2024-04-26T10:44:04.695 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:44:04.695 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:04.695 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:04.696 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:04.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.696 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:04.696 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:04.696 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.696 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:04.696 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:04.696 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.696 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:04.696 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:44:04.696 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.697 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:04.697 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:44:04.697 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:44:04.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.697 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:04.697 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:44:04.697 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:44:04.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.697 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.697 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:44:04.698 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:44:04.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.698 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:04.698 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:44:04.698 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:44:04.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.698 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:04.698 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:44:04.698 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:44:04.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.698 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:04.699 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:44:04.699 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:44:04.699 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.699 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:04.699 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.699 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:04.699 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:04.699 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 98.612479207999996, 2024-04-26T10:44:04.699 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:44:04.699 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:04.699 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:04.699 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:04.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.700 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:04.700 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:04.700 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.700 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:04.700 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:04.700 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.700 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:04.700 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:04.700 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.701 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:04.701 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:44:04.701 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:44:04.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.701 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:04.701 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:44:04.701 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:44:04.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.701 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.701 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:44:04.702 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:44:04.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.702 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:04.702 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:44:04.702 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:44:04.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.702 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:04.702 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:44:04.702 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:44:04.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.702 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:04.703 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:44:04.703 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:44:04.703 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.703 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:04.703 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.703 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:04.703 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:04.703 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 98.609702456999997, 2024-04-26T10:44:04.703 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:44:04.703 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:04.703 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:44:04.703 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:44:04.704 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:44:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:44:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:44:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:44:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.705 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:44:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:44:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:44:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:44:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:44:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:44:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:04.706 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 98.609652367999999, 2024-04-26T10:44:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:44:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:04.707 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:44:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:44:04.708 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:44:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:44:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:44:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:44:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:44:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:44:04.709 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:44:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:44:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:44:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:44:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:44:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.710 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:44:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:44:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 98.608760298999997, 2024-04-26T10:44:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:44:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:04.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:44:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:44:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:44:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:44:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:44:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:44:04.713 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:44:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:44:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:44:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:44:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:44:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:04.714 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:44:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:44:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:44:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:44:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 98.606571970000005, 2024-04-26T10:44:04.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:44:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.717 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:04.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:04.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.717 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:04.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:44:04.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:44:04.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.717 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:04.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:44:04.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:44:04.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.718 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.718 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:44:04.718 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:44:04.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.718 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:04.718 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:44:04.718 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:44:04.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.718 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:04.718 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:44:04.718 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:44:04.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.719 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:04.719 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:44:04.719 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:44:04.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.719 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:04.719 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:44:04.719 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:44:04.719 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.719 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:04.719 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.720 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:44:04.720 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:04.720 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 98.606436599999995, 2024-04-26T10:44:04.720 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:44:04.720 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:04.720 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.720 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:04.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.720 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:04.720 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:04.720 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.721 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:04.721 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:04.721 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.721 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:04.721 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:44:04.721 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.721 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:04.721 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:44:04.721 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:44:04.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:04.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:44:04.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:44:04.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:44:04.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:44:04.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:04.723 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:44:04.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:44:04.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.723 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:04.723 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:44:04.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:44:04.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.723 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:04.723 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:44:04.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:44:04.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.724 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:04.724 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:44:04.724 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:44:04.724 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.724 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:04.724 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.724 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.724 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:44:04.724 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:04.724 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 98.606222025999998, 2024-04-26T10:44:04.724 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:44:04.724 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:04.725 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.725 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:04.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.725 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:04.725 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:04.725 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.725 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:04.725 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:04.725 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.725 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:04.726 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:04.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.726 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:04.726 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:44:04.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:44:04.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.726 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:04.726 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:44:04.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:44:04.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:44:04.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:44:04.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:04.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:44:04.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:44:04.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:04.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:44:04.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:44:04.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:04.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:44:04.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:44:04.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:04.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:44:04.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:44:04.728 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.728 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:04.728 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.728 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:44:04.729 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:04.729 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 98.605883085000002, 2024-04-26T10:44:04.729 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:44:04.729 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:04.729 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.729 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:04.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.729 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:04.729 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:04.729 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.729 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:04.729 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:04.729 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.730 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:04.730 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:04.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.730 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:04.730 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:44:04.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:44:04.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.730 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:04.730 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:44:04.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:44:04.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:44:04.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:44:04.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:04.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:44:04.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:44:04.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:04.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:44:04.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:44:04.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.732 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:04.732 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:44:04.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:44:04.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.732 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:04.732 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:44:04.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:44:04.732 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.732 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:04.732 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.733 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:04.733 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:04.733 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 98.605773708000001, 2024-04-26T10:44:04.733 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:44:04.733 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:04.733 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:44:04.733 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:04.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.733 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:04.733 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:04.733 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.734 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:04.734 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:04.734 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.734 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:04.734 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:44:04.734 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:04.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.734 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:04.734 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:44:04.734 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:44:04.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.735 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:04.735 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:44:04.735 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:44:04.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.735 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.735 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:44:04.735 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:44:04.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.735 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:04.735 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:44:04.735 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:44:04.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.736 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:04.736 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:44:04.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:44:04.736 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.736 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:04.736 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.736 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:44:04.736 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:04.736 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 98.605733989000001, 2024-04-26T10:44:04.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:44:04.737 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:04.737 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.737 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:04.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.737 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:04.737 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:04.737 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.737 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:04.737 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:04.737 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.738 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:04.738 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:04.738 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:04.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.738 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:04.738 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:44:04.738 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:44:04.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.739 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:04.739 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:44:04.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:44:04.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.739 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.739 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:44:04.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:44:04.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.739 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:04.739 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:44:04.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:44:04.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.740 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:04.740 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:44:04.740 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:44:04.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.740 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:04.740 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:44:04.740 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:44:04.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.740 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:04.740 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:44:04.740 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:44:04.740 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.741 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:04.741 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.741 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:44:04.741 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:04.741 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 98.605396455999994, 2024-04-26T10:44:04.741 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:44:04.741 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:04.741 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:04.741 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:04.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.741 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:04.741 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:04.741 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.742 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:04.742 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:04.742 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:04.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.742 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:04.742 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:44:04.742 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:04.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.742 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:04.742 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:44:04.742 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:44:04.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.743 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:04.743 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:44:04.743 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:44:04.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.743 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:04.743 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:44:04.743 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:44:04.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.743 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:04.743 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:44:04.743 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:44:04.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.744 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:04.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:44:04.744 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:44:04.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.744 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:04.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:44:04.744 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:44:04.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:04.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:04.744 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:04.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:44:04.744 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:44:04.745 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.745 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:04.745 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.745 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:04.745 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:04.745 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:04.746 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:04.747 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:04.745+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:04.758 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:04.759 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:04.759 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:04.777 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:04.777 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:04.780 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:04.780 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:04.847 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:04.845+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:04.854 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:04.854 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:04.862 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:04.948 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:04.947+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:05.003 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:05.003 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:05.012 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:05.053 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:05.052+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:05.150 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:05.149+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:05.153 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:05.154 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:05.163 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:05.252 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:05.251+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:05.274 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:05.275 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:05.283 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:05.368 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:05.367+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:05.429 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:05.430 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:05.438 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:05.480 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:05.479+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:05.555 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:05.554+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:05.585 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:05.585 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:05.594 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:05.656 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:05.655+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:05.697 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:05.697 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:05.706 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:05.756 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:05.755+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:05.807 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:05.807 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:05.816 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:05.858 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:05.857+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:05.958 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:05.958 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:05.959 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:05.958+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:05.967 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:06.060 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:06.059+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:06.077 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:06.077 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:06.086 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:06.170 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:06.169+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:06.231 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:06.231 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:06.240 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:06.262 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:06.261+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:06.326 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:44:06.364 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:06.362+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:06.386 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:06.386 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:06.395 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:06.464 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:06.462+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:06.499 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:06.499 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:06.508 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:06.565 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:06.564+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:06.649 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:06.649 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:06.658 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:06.703 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:06.702+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:06.759 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:06.760 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:06.767 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:06.765+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:06.768 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:06.781 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:44:06.868 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:06.867+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:06.877 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:06.877 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:06.885 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:06.904 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:06.905 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:06.905 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:06.922 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:06.923 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:06.925 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:06.926 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:06.969 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:06.968+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:06.990 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:06.990 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:06.991 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:06.991 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:06.991 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:06.999 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:07.070 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:07.068+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:07.106 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:07.106 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:07.106 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:07.106 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:07.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.107 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:07.107 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:07.107 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.068476359, 2024-04-26T10:44:07.107 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:44:07.107 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:07.107 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.107 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:07.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.107 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:07.107 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:07.107 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.108 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:07.108 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:07.108 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.108 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:07.108 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:07.108 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.108 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:07.108 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:44:07.108 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:44:07.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.109 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:07.109 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:44:07.109 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:44:07.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.109 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.109 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:44:07.109 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:44:07.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.109 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:07.109 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:44:07.109 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:44:07.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.110 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:07.110 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:44:07.110 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:44:07.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.110 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:07.110 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:44:07.110 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:44:07.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.110 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:07.110 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:44:07.111 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:44:07.111 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.111 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:07.111 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.111 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:07.111 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:07.111 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.066726238, 2024-04-26T10:44:07.111 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:44:07.111 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:07.111 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.111 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:07.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.112 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:07.112 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:07.112 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.112 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:07.112 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:07.112 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.112 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:07.112 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:44:07.112 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:07.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.113 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:07.113 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:44:07.113 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:44:07.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.113 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:07.113 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:44:07.113 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:44:07.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.113 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.113 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:44:07.113 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:44:07.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.114 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:07.114 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:44:07.114 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:44:07.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.114 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:07.114 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:44:07.114 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:44:07.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.114 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:07.114 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:44:07.115 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:44:07.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.115 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:07.115 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:44:07.115 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:44:07.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.115 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:07.115 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:44:07.115 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:44:07.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.115 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:07.115 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:44:07.116 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:44:07.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.116 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:07.116 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:44:07.116 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:44:07.116 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.116 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:07.116 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.116 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:07.116 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:07.116 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.06667324, 2024-04-26T10:44:07.117 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:44:07.117 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:07.117 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.117 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:07.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.117 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:07.117 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:07.117 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.117 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:07.117 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:07.117 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.118 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:07.118 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:07.118 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.118 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:07.118 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:44:07.118 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:44:07.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.118 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:07.119 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:44:07.119 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:44:07.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.119 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.119 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:44:07.119 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:44:07.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.119 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:07.119 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:44:07.119 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:44:07.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.119 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:07.120 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:44:07.120 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:44:07.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.120 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:07.120 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:44:07.120 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:44:07.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.120 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:07.120 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:44:07.120 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:44:07.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.121 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:07.121 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:44:07.121 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:44:07.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.121 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:07.121 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:44:07.121 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:44:07.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.121 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:07.121 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:44:07.121 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:44:07.121 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.122 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:07.122 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.122 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:07.122 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:07.122 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.06659549600001, 2024-04-26T10:44:07.122 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:44:07.122 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:07.122 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.122 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:07.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.123 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:07.123 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:07.123 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.123 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.123 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:07.123 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:07.123 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.123 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.123 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:07.123 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:44:07.123 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:07.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.124 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:07.124 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:44:07.124 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:44:07.124 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.124 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:07.124 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:44:07.124 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:44:07.124 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.125 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.125 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:44:07.125 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:44:07.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.125 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:07.125 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:44:07.125 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:44:07.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.125 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:07.125 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:44:07.126 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:44:07.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.126 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.126 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:07.126 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:44:07.126 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:44:07.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.126 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.126 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:07.126 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:44:07.126 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:44:07.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.126 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.127 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:07.127 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:44:07.127 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:44:07.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.127 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.127 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:07.127 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:44:07.127 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:44:07.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.127 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.127 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:07.127 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:44:07.127 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:44:07.127 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.127 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:07.128 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.128 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.128 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.128 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:07.128 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:07.128 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.06655649, 2024-04-26T10:44:07.128 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:44:07.128 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:07.128 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.129 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:07.129 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.129 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:07.129 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:07.129 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.129 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.129 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.129 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:07.129 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:07.129 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.129 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.129 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.129 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:07.129 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:44:07.130 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:07.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.130 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:07.130 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:44:07.130 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:44:07.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.130 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:07.130 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:44:07.130 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:44:07.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.130 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.131 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:44:07.131 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:44:07.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.131 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.131 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:07.131 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:44:07.131 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:44:07.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.131 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.131 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:07.131 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:44:07.131 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:44:07.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.131 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.131 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:07.132 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:44:07.132 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:44:07.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.132 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:07.132 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:44:07.132 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:44:07.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.132 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:07.132 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:44:07.132 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:44:07.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.133 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:07.133 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:44:07.133 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:44:07.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.133 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:07.133 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:44:07.133 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:44:07.133 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.133 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:07.133 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.133 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:07.133 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:07.134 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.066537669, 2024-04-26T10:44:07.134 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:44:07.134 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:07.134 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.134 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:07.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.134 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:07.134 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:07.134 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.134 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:07.134 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:07.135 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.135 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:07.135 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:07.135 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:07.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.135 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:07.135 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:44:07.135 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:44:07.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.136 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:07.136 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:44:07.136 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:44:07.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.136 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.136 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:44:07.136 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:44:07.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.136 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:07.136 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:44:07.136 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:44:07.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.137 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.137 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:07.137 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:44:07.137 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:44:07.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.137 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.137 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:07.137 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:44:07.137 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:44:07.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.137 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.137 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:07.137 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:44:07.138 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:44:07.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.138 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:07.138 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:44:07.138 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:44:07.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.138 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:07.138 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:44:07.138 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:44:07.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.138 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:07.139 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:44:07.139 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:44:07.139 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.139 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:07.139 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.139 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:07.139 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:07.139 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.066505667, 2024-04-26T10:44:07.139 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:44:07.139 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:07.139 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.140 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:07.140 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.140 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:07.140 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:07.140 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.140 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.140 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:07.140 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:07.140 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.140 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.140 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:07.140 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:44:07.141 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.141 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:07.141 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:44:07.141 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:44:07.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.141 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:07.141 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:44:07.141 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:44:07.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.141 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:44:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:44:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:44:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:44:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:44:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:44:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:44:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:44:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:44:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:44:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:44:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:44:07.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:44:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:44:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:44:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:44:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.066296859, 2024-04-26T10:44:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:44:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:07.145 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:44:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:07.146 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:44:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:44:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:44:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:44:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:44:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:44:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.147 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:07.148 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:44:07.148 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:44:07.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.148 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:07.148 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:44:07.148 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:44:07.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.148 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:07.148 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:44:07.148 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:44:07.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.149 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:07.149 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:44:07.149 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:44:07.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.149 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:07.149 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:44:07.149 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:44:07.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.149 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:07.149 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:44:07.149 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:44:07.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.150 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.150 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:07.150 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:44:07.150 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:44:07.150 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.150 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:07.150 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.150 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.150 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:07.150 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:07.150 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.06626556800001, 2024-04-26T10:44:07.150 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:44:07.150 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.151 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:44:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:44:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:44:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:44:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:44:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:44:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:44:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:44:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:44:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:44:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:44:07.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.154 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:07.154 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:44:07.154 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:44:07.154 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.154 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:07.154 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.154 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.154 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:07.154 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:07.154 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.066238318, 2024-04-26T10:44:07.154 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:44:07.154 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:07.155 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:07.155 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:07.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.155 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:07.155 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:07.155 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.155 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:07.155 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:07.155 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.155 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:07.155 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:07.156 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.156 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.156 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:07.156 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:44:07.156 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:44:07.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.156 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.156 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:07.156 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:44:07.156 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:44:07.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.156 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.156 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.157 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:44:07.157 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:44:07.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.157 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:07.157 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:44:07.157 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:44:07.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.157 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:07.157 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:44:07.157 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:44:07.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.158 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:07.158 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:44:07.158 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:44:07.158 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.158 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:07.158 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.158 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:07.158 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:07.158 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.063461567, 2024-04-26T10:44:07.158 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:44:07.158 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:07.158 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:44:07.159 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:07.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.159 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:07.159 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:07.159 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.159 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:07.159 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:07.159 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.159 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:07.159 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:44:07.160 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.160 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:07.160 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:44:07.160 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:44:07.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.160 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:07.160 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:44:07.160 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:44:07.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.160 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.161 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:44:07.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:44:07.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.161 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:07.161 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:44:07.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:44:07.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.161 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:07.161 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:44:07.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:44:07.161 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.161 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:07.162 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.162 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:07.162 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:07.162 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.06341147800001, 2024-04-26T10:44:07.162 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:44:07.162 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:07.162 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.162 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:07.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.162 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:07.162 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:07.163 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.163 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:07.163 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:07.163 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.163 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:07.163 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:44:07.163 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.163 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:07.164 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:44:07.164 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:44:07.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.164 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:07.164 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:44:07.164 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:44:07.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.164 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.164 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:44:07.164 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:44:07.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.165 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:07.165 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:44:07.165 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:44:07.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.165 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:07.165 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:44:07.165 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:44:07.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.165 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:07.165 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:44:07.165 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:44:07.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.166 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:07.166 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:44:07.166 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:44:07.166 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.166 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:07.166 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.166 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:07.166 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:07.166 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.062519409, 2024-04-26T10:44:07.166 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:44:07.167 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:07.167 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.167 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:07.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.167 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:07.167 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:07.167 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.167 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:07.167 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:07.167 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.167 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:07.168 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:44:07.168 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.168 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:07.168 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:44:07.168 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:44:07.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.168 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:07.168 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:44:07.168 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:44:07.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.169 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.169 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.169 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:44:07.169 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:44:07.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.169 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.169 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:07.169 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:44:07.169 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:44:07.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.169 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.170 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:07.170 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:44:07.170 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:44:07.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.170 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.170 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:07.170 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:44:07.170 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:44:07.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.170 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.170 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:07.170 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:44:07.170 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:07.171 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.171 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:07.171 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.171 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:44:07.171 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:07.171 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.06033108, 2024-04-26T10:44:07.171 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:44:07.171 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:07.171 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.171 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:07.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.171 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:07.172 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:07.172 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.172 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.172 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.172 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:07.172 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:07.172 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.173 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:07.173 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:07.173 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.173 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:07.173 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:44:07.173 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:44:07.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.173 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:07.173 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:44:07.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:44:07.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.174 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.174 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:44:07.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:44:07.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.174 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:07.174 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:44:07.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:44:07.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.175 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:07.175 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:44:07.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:44:07.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.175 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:07.175 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:44:07.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:44:07.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.175 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:07.175 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:44:07.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:44:07.175 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.175 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:07.176 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.176 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:44:07.176 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:07.176 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.06019571, 2024-04-26T10:44:07.176 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:44:07.176 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:07.176 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.176 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:07.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.176 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:07.176 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:07.176 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.177 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:07.177 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:07.177 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.177 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:07.177 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:44:07.177 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.177 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:07.178 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:44:07.178 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:44:07.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.178 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:07.178 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:44:07.178 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:44:07.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.178 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.178 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:44:07.178 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:44:07.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.179 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:07.179 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:44:07.179 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:44:07.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.179 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:07.179 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:44:07.179 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:44:07.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.179 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:07.179 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:44:07.179 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:44:07.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.180 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:07.180 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:44:07.180 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:44:07.180 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.180 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:07.180 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.180 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:44:07.180 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:07.180 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.059981136, 2024-04-26T10:44:07.180 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:44:07.181 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:07.181 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.181 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:07.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.181 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:07.181 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:07.181 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.181 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:07.181 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:07.181 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.182 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:07.182 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:07.182 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.182 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:07.182 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:44:07.182 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:44:07.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.182 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:07.182 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:44:07.182 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:44:07.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.183 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.183 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:44:07.183 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:44:07.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.183 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:07.183 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:44:07.183 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:44:07.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.183 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:07.184 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:44:07.184 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:44:07.184 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.184 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:07.184 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:44:07.184 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:44:07.184 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.184 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:07.184 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:44:07.184 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:44:07.184 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.184 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:07.185 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.185 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:44:07.185 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:07.185 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.059642195, 2024-04-26T10:44:07.185 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:44:07.185 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:07.185 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.185 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:07.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.185 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:07.185 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:07.185 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:07.186 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:07.186 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:07.186 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:07.186 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:07.186 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:44:07.187 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:44:07.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.187 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:07.187 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:44:07.187 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:44:07.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.187 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.187 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:44:07.187 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:44:07.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.187 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:07.188 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:44:07.188 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:44:07.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.188 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:07.188 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:44:07.188 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:44:07.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.188 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:07.188 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:44:07.188 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:44:07.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.189 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:07.189 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:44:07.189 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:44:07.189 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.189 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:07.189 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.189 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.189 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:07.189 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:07.189 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.05953281799999, 2024-04-26T10:44:07.189 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:44:07.189 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:07.189 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:44:07.189 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:07.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.190 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:07.190 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:07.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.190 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.190 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:07.190 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:07.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.190 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.190 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:07.190 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:44:07.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:07.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:07.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:44:07.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:44:07.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:07.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:44:07.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:44:07.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.192 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.192 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:44:07.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:44:07.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.192 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:07.192 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:44:07.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:44:07.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.192 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:07.192 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:44:07.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:44:07.193 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.193 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:07.193 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.193 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:44:07.193 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:07.193 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.05949309899999, 2024-04-26T10:44:07.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:44:07.193 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:07.193 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.193 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:07.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.193 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:07.194 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:07.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.194 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:07.194 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:07.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.194 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:07.194 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:07.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:07.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.195 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:07.195 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:44:07.195 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:44:07.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.195 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:07.195 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:44:07.195 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:44:07.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:44:07.196 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:44:07.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:07.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:44:07.196 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:44:07.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:07.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:44:07.196 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:44:07.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.197 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:07.197 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:44:07.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:44:07.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.197 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:07.197 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:44:07.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:44:07.197 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.197 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:07.197 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.198 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:44:07.198 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:07.198 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.059155566, 2024-04-26T10:44:07.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:44:07.198 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:07.198 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.198 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:07.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.198 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:07.198 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:07.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:07.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:07.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:07.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:07.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:44:07.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:07.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:44:07.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:44:07.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:07.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:44:07.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:44:07.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:44:07.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:44:07.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:07.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:44:07.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:44:07.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:07.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:44:07.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:44:07.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:07.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:44:07.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:44:07.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:07.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:07.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:07.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:44:07.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:44:07.202 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.202 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:07.202 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.202 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:07.202 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:07.202 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:07.204 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:07.204 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:07.202+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:07.304 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:07.304+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:07.307 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:07.307 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:07.307 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:44:07.307 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:07.313 INFO:teuthology.orchestra.run.smithi049.stderr:nodeep-scrub is unset 2024-04-26T10:44:07.318 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:07.406 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:07.405+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:07.419 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:07.419 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:07.419 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:07.419 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:07.419 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:07.429 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:07.506 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:07.505+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:07.532 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:07.532 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:07.532 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:07.532 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:07.532 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.532 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:07.532 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:07.532 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 101.493663778, 2024-04-26T10:44:07.533 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:44:07.533 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:07.533 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.533 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:07.533 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.533 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:07.533 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:07.533 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.533 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.533 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.533 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:07.533 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:07.533 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.533 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.534 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.534 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:07.534 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:44:07.534 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.534 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.534 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:07.534 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:44:07.534 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:44:07.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.534 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.534 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:07.534 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:44:07.535 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:44:07.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.535 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.535 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.535 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:44:07.535 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:44:07.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.535 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.535 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:07.535 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:44:07.535 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:44:07.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.535 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.535 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:07.535 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:44:07.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:44:07.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.536 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.536 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:07.536 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:44:07.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:44:07.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.536 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.536 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:07.536 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:44:07.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:44:07.536 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.536 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:07.536 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.537 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.537 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.537 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:07.537 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:07.537 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 101.492792998, 2024-04-26T10:44:07.537 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:44:07.537 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:07.537 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.537 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:07.537 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.537 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:07.537 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:07.537 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.538 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.538 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.538 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:07.538 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:07.538 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.538 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.538 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.538 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:07.538 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:07.538 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.538 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.538 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.538 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:07.539 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:44:07.539 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:44:07.539 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.539 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.539 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:07.539 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:44:07.539 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:44:07.539 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.539 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.539 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.539 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:44:07.539 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:44:07.539 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.539 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.540 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:07.540 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:44:07.540 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:44:07.540 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.540 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.540 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:07.540 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:44:07.540 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:44:07.540 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.540 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.540 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:07.540 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:44:07.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:44:07.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.541 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:07.541 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:44:07.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:44:07.541 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.541 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:07.541 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.541 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:07.541 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:07.542 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 101.49180565499999, 2024-04-26T10:44:07.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:44:07.542 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:07.542 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.542 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:07.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.542 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:07.542 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:07.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.542 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.542 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:07.542 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:07.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.543 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.543 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.543 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:07.543 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:44:07.543 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:07.543 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.543 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.543 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:07.543 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:44:07.543 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:44:07.543 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.543 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.543 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:07.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:44:07.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:44:07.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:44:07.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:44:07.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:07.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:44:07.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:44:07.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.545 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:07.545 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:44:07.545 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:44:07.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.545 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.545 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:07.545 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:44:07.545 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:44:07.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.545 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.545 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:07.545 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:44:07.546 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:44:07.546 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.546 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:07.546 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.546 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:07.546 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:07.546 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 101.49160039, 2024-04-26T10:44:07.546 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:44:07.546 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:07.546 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.546 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:07.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:07.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:07.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.547 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:07.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:07.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.547 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:07.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:07.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.548 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.548 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:07.548 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:44:07.548 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:44:07.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.548 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.548 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:07.548 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:44:07.548 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:44:07.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.548 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.548 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.548 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:44:07.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:44:07.549 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.549 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:07.549 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:44:07.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:44:07.549 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.549 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:07.549 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:44:07.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:44:07.549 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:07.550 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:44:07.550 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:44:07.550 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:07.550 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:44:07.550 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:44:07.550 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.550 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:07.550 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.550 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.551 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:07.551 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:07.551 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 101.491279511, 2024-04-26T10:44:07.551 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:44:07.551 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:07.551 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.551 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:07.551 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.551 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:07.551 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:07.551 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.551 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.551 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.552 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:07.552 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:07.552 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.552 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.552 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.552 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:07.552 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:44:07.552 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:07.552 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.552 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.552 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:07.553 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:44:07.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:44:07.553 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.553 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.553 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:07.553 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:44:07.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:44:07.553 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.553 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.553 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.553 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:44:07.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:44:07.553 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.554 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.554 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:07.554 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:44:07.554 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:44:07.554 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.554 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.554 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:07.554 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:44:07.554 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:44:07.554 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.554 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.554 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:07.554 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:44:07.555 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:44:07.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.555 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:07.555 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:44:07.555 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:44:07.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.555 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:07.555 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:44:07.555 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:44:07.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:07.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:44:07.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:44:07.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.556 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:07.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:44:07.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:44:07.556 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.556 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:07.556 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.556 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.557 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:07.557 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:07.557 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 101.49122768700001, 2024-04-26T10:44:07.557 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:44:07.557 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:07.557 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.557 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:07.557 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.557 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:07.557 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:07.557 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.557 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.557 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.557 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:07.557 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:07.558 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.558 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.558 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:07.558 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:44:07.558 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.558 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.558 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:07.558 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:44:07.558 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:44:07.558 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.559 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:07.559 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:44:07.559 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:44:07.559 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.559 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.559 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.559 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:44:07.559 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:44:07.559 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.559 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.559 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:07.559 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:44:07.559 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:44:07.560 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.560 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.560 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:07.560 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:44:07.560 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:44:07.560 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.560 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.560 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:07.560 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:44:07.560 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:44:07.560 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.560 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.560 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:07.560 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:44:07.560 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:44:07.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.561 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.561 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:07.561 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:44:07.561 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:44:07.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.561 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.561 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:07.561 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:44:07.561 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:44:07.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.561 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.561 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:07.561 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:44:07.562 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:44:07.562 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.562 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:07.562 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.562 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.562 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.562 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:07.562 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:07.562 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 101.49117431499999, 2024-04-26T10:44:07.562 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:44:07.562 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:07.562 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.562 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:07.563 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.563 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:07.563 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:07.563 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.563 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.563 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.563 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:07.563 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:07.563 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.563 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.563 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.563 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:07.563 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:07.563 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.563 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.564 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:07.564 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:44:07.564 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:44:07.564 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.564 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:07.564 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:44:07.564 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:44:07.564 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.564 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.564 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:44:07.564 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:44:07.565 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.565 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.565 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:07.565 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:44:07.565 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:44:07.565 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.565 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.565 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:07.565 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:44:07.565 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:44:07.565 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.565 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.565 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:07.565 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:44:07.566 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:44:07.566 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.566 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.566 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:07.566 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:44:07.566 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:44:07.566 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.566 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.566 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:07.566 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:44:07.566 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:44:07.566 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.566 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.567 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:07.567 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:44:07.567 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:44:07.567 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.567 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.567 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:07.567 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:44:07.567 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:44:07.567 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.567 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:07.567 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.567 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.567 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.567 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:07.568 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:07.568 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 101.491129988, 2024-04-26T10:44:07.568 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:44:07.568 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:07.568 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.568 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:07.568 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.568 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:07.568 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:07.568 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.568 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.568 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.568 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:07.568 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:07.569 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.569 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.569 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.569 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:07.569 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:07.569 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:07.569 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.569 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.569 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:07.569 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:44:07.569 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:44:07.569 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.569 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.569 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:07.570 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:44:07.570 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:44:07.570 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.570 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.570 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.570 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:44:07.570 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:44:07.570 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.570 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.570 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:07.570 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:44:07.570 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:44:07.570 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.570 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.570 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:07.571 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:44:07.571 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:44:07.571 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.571 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.571 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:07.571 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:44:07.571 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:44:07.571 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.571 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.571 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:07.571 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:44:07.571 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:44:07.571 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.572 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.572 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:07.572 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:44:07.572 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:44:07.572 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.572 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.572 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:07.572 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:44:07.572 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:44:07.572 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.572 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.572 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:07.572 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:44:07.572 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:44:07.573 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.573 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:07.573 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.573 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.573 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.573 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:07.573 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:07.573 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 101.49110627500001, 2024-04-26T10:44:07.573 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:44:07.573 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:07.573 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.573 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:07.573 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.573 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:07.574 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:07.574 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.574 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.574 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.574 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:07.574 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:07.574 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.574 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.574 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.574 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:07.574 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:07.574 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.574 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.574 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.575 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:07.575 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:44:07.575 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:44:07.575 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.575 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.575 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:07.575 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:44:07.575 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:44:07.575 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.575 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.575 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.575 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:44:07.575 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:44:07.576 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.576 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.576 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:07.576 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:44:07.576 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:44:07.576 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.576 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.576 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:07.576 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:44:07.576 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:44:07.576 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.576 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.576 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:07.576 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:44:07.577 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:44:07.577 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.577 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.577 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:07.577 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:44:07.577 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:44:07.577 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.577 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.577 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:07.577 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:44:07.577 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:44:07.577 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.577 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.577 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:07.578 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:44:07.578 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:44:07.578 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.578 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.578 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:07.578 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:44:07.578 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:44:07.578 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.578 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:07.578 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.578 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.578 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.578 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:07.579 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:07.579 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 101.49107196999999, 2024-04-26T10:44:07.579 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:44:07.579 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:07.579 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.579 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:07.579 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.579 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:07.579 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:07.579 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.579 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.579 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.579 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:07.580 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:07.580 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.580 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.580 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.580 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:07.580 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:44:07.580 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.580 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.580 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.580 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:07.580 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:44:07.580 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:44:07.580 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.580 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.581 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:07.581 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:44:07.581 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:44:07.581 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.581 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.581 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.581 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:44:07.581 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:44:07.581 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.581 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.581 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:07.581 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:44:07.581 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:44:07.581 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.582 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.582 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:07.582 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:44:07.582 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:44:07.582 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.582 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.582 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:07.582 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:44:07.582 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:44:07.582 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.582 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.582 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:07.583 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:44:07.583 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:44:07.583 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.583 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.583 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:07.583 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:44:07.583 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:44:07.583 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.583 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.583 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:07.583 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:44:07.583 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:44:07.583 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.583 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.584 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:07.584 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:44:07.584 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:44:07.584 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.584 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:07.584 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.584 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.584 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.584 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:07.584 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:07.584 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 101.490735374, 2024-04-26T10:44:07.584 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:44:07.584 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:07.584 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:07.584 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:07.585 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.585 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:07.585 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:07.585 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.585 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.585 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.585 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:07.585 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:07.585 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.585 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.585 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.585 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:07.585 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:44:07.585 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:07.586 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.586 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.586 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:07.586 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:44:07.586 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:44:07.586 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.586 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.586 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:07.586 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:44:07.586 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:44:07.586 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.586 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.586 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.586 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:44:07.587 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:44:07.587 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.587 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.587 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:07.587 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:44:07.587 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:44:07.587 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.587 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.587 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:07.587 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:44:07.587 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:44:07.587 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.587 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.587 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:07.587 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:44:07.588 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:44:07.588 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.588 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:07.588 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.588 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.588 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.588 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:07.588 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:07.588 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 101.490693346, 2024-04-26T10:44:07.588 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:44:07.588 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:07.588 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:07.589 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:07.589 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.589 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:07.589 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:07.589 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.589 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.589 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.589 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:07.589 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:07.589 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.589 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.589 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.590 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:07.590 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:07.590 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.590 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.590 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.590 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:07.590 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:44:07.590 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:44:07.590 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.590 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.590 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:07.590 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:44:07.590 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:44:07.590 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.591 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.591 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.591 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:44:07.591 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:44:07.591 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.591 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.591 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:07.591 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:44:07.591 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:44:07.591 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.591 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.591 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:07.591 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:44:07.591 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:44:07.592 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.592 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.592 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:07.592 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:44:07.592 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:44:07.592 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.592 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:07.592 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.592 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.592 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.592 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:07.592 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:07.592 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 101.49064017400001, 2024-04-26T10:44:07.592 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:44:07.593 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:07.593 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:07.593 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:07.593 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.593 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:07.593 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:07.593 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.593 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.593 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.593 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:07.593 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:07.593 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.593 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.593 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.594 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:07.594 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:07.594 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.594 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.594 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.594 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:07.594 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:44:07.594 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:44:07.594 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.594 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.594 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:07.594 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:44:07.594 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:44:07.594 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.594 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.595 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.595 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:44:07.595 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:44:07.595 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.595 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.595 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:07.595 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:44:07.595 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:44:07.595 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.595 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.595 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:07.595 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:44:07.595 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:44:07.596 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.596 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.596 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:07.596 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:44:07.596 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:44:07.596 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.596 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:07.596 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.596 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.596 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.596 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:07.596 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:07.596 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 101.487233764, 2024-04-26T10:44:07.596 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:44:07.597 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:07.597 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:44:07.597 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:07.597 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.597 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:07.597 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:07.597 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.597 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.597 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.597 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:07.597 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:07.597 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.597 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.598 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.598 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:07.598 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:44:07.598 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.598 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.598 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.598 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:07.598 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:44:07.598 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:44:07.598 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.598 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.598 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:07.598 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:44:07.598 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:44:07.599 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.599 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.599 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.599 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:44:07.599 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:44:07.599 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.599 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.599 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:07.599 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:44:07.599 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:44:07.599 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.599 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.599 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:07.599 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:44:07.600 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:44:07.600 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.600 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:07.600 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.600 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.600 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.600 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:44:07.600 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:44:07.600 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 101.484761811, 2024-04-26T10:44:07.600 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:44:07.600 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:07.600 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:07.600 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:07.601 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.601 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:07.601 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:44:07.601 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.601 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.601 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.601 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:07.601 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:44:07.601 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.601 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.601 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.601 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:07.601 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:44:07.601 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.601 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.602 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.602 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:07.602 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:44:07.602 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:44:07.602 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.602 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.602 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:07.602 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:44:07.602 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:44:07.602 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.602 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.602 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.602 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:44:07.603 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:44:07.603 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.603 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.603 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:07.603 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:44:07.603 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:44:07.603 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.603 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.603 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:07.603 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:44:07.603 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:44:07.603 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.603 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.603 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:07.604 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:44:07.604 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:44:07.604 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.604 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:07.604 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.604 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.604 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.604 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:44:07.604 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:07.604 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 101.484108253, 2024-04-26T10:44:07.604 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:44:07.604 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:07.604 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:07.605 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:07.605 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.605 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:07.605 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:07.605 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.605 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.605 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.605 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:07.605 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:07.605 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.605 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.605 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.605 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:07.606 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:07.606 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.606 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.606 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.606 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:07.606 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:44:07.606 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:44:07.606 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.606 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.606 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:07.606 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:44:07.606 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:44:07.606 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.606 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.607 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.607 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:44:07.607 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:44:07.607 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.607 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.607 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:07.607 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:44:07.607 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:44:07.607 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.607 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.607 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:07.607 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:44:07.607 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:44:07.607 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.607 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.608 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:07.608 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:44:07.608 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:44:07.608 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.608 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:07.608 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.608 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.608 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.608 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:44:07.608 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:07.608 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 101.484032468, 2024-04-26T10:44:07.608 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:44:07.608 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:07.608 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:07.609 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:07.609 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.609 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:07.609 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:07.609 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.609 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.609 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.609 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:07.609 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:07.609 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.609 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.609 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.609 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:07.609 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:07.610 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.610 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.610 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.610 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:07.610 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:44:07.610 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:44:07.610 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.610 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.610 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:07.610 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:44:07.611 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:44:07.611 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.611 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.611 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.611 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:44:07.611 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:44:07.611 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.611 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.611 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:07.611 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:44:07.611 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:44:07.611 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.611 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.611 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:07.612 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:44:07.612 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:44:07.612 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.612 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.612 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:07.612 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:44:07.612 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:44:07.612 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.612 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:07.612 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.612 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.612 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.612 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:44:07.612 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:44:07.613 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 101.483818774, 2024-04-26T10:44:07.613 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:44:07.613 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:07.613 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:44:07.613 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:07.613 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.613 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:07.613 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:44:07.613 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.613 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.613 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.613 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:07.613 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:44:07.613 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.614 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.614 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.614 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:07.614 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:44:07.614 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:07.614 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.614 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.614 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:07.614 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:44:07.614 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:44:07.614 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.614 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.614 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:07.615 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:44:07.615 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:44:07.615 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.615 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.615 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.615 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:44:07.615 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:44:07.615 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.615 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.615 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:07.615 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:44:07.615 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:44:07.615 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.615 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.615 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:07.616 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:44:07.616 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:44:07.616 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.616 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:07.616 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.616 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.616 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.616 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:44:07.616 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:44:07.616 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 101.481374961, 2024-04-26T10:44:07.616 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:44:07.616 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:07.616 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:07.616 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:07.617 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.617 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:07.617 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:44:07.617 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.617 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.617 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.617 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:07.617 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:44:07.617 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.617 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.617 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.617 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:07.617 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:44:07.617 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:44:07.618 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.618 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.618 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:07.618 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:44:07.618 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:44:07.618 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.618 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.618 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:07.618 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:44:07.618 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:44:07.618 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.618 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.618 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.619 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:44:07.619 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:44:07.619 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.619 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.619 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:07.619 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:44:07.619 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:44:07.619 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.619 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.619 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:07.619 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:44:07.619 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:44:07.619 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.619 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.619 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:07.620 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:44:07.620 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:44:07.620 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.620 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:07.620 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.620 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.620 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.620 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:44:07.620 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:07.620 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 96.031312517000003, 2024-04-26T10:44:07.620 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:44:07.620 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:07.620 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:07.620 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:07.621 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.621 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:07.621 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:07.621 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.621 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.621 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.621 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:07.621 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:07.621 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:07.621 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.621 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.621 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:07.621 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:44:07.621 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:07.622 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.622 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.622 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:07.622 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:44:07.622 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:44:07.622 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.622 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.622 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:07.622 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:44:07.622 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:44:07.622 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.623 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.623 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:07.623 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:44:07.623 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:44:07.623 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.623 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.623 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:07.623 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:44:07.623 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:44:07.623 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.623 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.623 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:07.623 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:44:07.623 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:44:07.624 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.624 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.624 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:07.624 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:44:07.624 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:44:07.624 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.624 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.624 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:07.624 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:44:07.624 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:44:07.624 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.624 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.624 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:07.624 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:44:07.625 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:44:07.625 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.625 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.625 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:07.625 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:44:07.625 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:44:07.625 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:07.625 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:07.625 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:07.625 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:44:07.625 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:44:07.625 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.625 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:07.625 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.626 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:07.626 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:07.626 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:07.627 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:07.626+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:07.628 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:07.728 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:07.727+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:07.742 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:07.743 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:07.743 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:44:07.743 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:07.752 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:07.829 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:07.828+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:07.898 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:07.899 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:07.899 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:07.899 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:07.899 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:07.908 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:07.929 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:07.928+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:08.015 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:08.015 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:08.015 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:08.016 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:08.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.016 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:08.016 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:08.016 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.97763063799999, 2024-04-26T10:44:08.016 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:44:08.016 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:08.016 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.016 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:08.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.016 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:08.016 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:08.016 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.017 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:08.017 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:08.017 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.017 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:08.017 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:08.017 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.017 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:08.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:44:08.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:44:08.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:08.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:44:08.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:44:08.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:44:08.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:44:08.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.019 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:08.019 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:44:08.019 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:44:08.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.019 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:08.019 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:44:08.019 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:44:08.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.019 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:08.019 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:44:08.019 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:44:08.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.020 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:08.020 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:44:08.020 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:44:08.020 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.020 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:08.020 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.020 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:08.020 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:08.020 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.97588051699999, 2024-04-26T10:44:08.021 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:44:08.021 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:08.021 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.021 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:08.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.021 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:08.021 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:08.021 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.021 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:08.021 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:08.021 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.022 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:08.022 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:44:08.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:08.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.022 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:08.022 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:44:08.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:44:08.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.022 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:08.022 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:44:08.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:44:08.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.023 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:44:08.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:44:08.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:08.023 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:44:08.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:44:08.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:08.024 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:44:08.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:44:08.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.024 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:08.024 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:44:08.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:44:08.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.024 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:08.024 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:44:08.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:44:08.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.024 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:08.025 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:44:08.025 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:44:08.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.025 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:08.025 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:44:08.025 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:44:08.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.025 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:08.025 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:44:08.025 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:44:08.025 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.025 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:08.026 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.026 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:08.026 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:08.026 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.97582751900001, 2024-04-26T10:44:08.026 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:44:08.026 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:08.026 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.026 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:08.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.026 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:08.026 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:08.027 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:08.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:08.027 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:08.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:08.027 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:08.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:44:08.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:44:08.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.028 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:08.028 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:44:08.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:44:08.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.028 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.028 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:44:08.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:44:08.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.028 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:08.028 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:44:08.029 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:44:08.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.029 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:08.029 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:44:08.029 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:44:08.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.029 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:08.029 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:44:08.029 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:44:08.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.030 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:08.030 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:44:08.030 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:44:08.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.030 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:08.030 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:44:08.030 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:44:08.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.030 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:08.030 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:44:08.030 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:44:08.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.031 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.031 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:08.031 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:44:08.031 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:44:08.031 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.031 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:08.031 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.031 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.031 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:08.031 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:08.031 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.975749775, 2024-04-26T10:44:08.031 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:44:08.032 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:08.032 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.032 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:08.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.032 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:08.032 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:08.032 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.032 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:08.032 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:08.032 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.033 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:08.033 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:44:08.033 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:08.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.033 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:08.033 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:44:08.033 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:44:08.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.033 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:08.033 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:44:08.033 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:44:08.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.034 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.034 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:44:08.034 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:44:08.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.034 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:08.034 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:44:08.034 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:44:08.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.034 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:08.034 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:44:08.035 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:44:08.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.035 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:08.035 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:44:08.035 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:44:08.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.035 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:08.035 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:44:08.035 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:44:08.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.035 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:08.036 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:44:08.036 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:44:08.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.036 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.036 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:08.036 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:44:08.036 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:44:08.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.036 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.036 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:08.036 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:44:08.036 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:44:08.036 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.036 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:08.036 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.037 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:08.037 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:08.037 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.975710769, 2024-04-26T10:44:08.037 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:44:08.037 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:08.037 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.037 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:08.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.037 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:08.037 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:08.037 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.038 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:08.038 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:08.038 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.038 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:08.038 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:44:08.038 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:08.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.038 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:08.039 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:44:08.039 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:44:08.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.039 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:08.039 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:44:08.039 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:44:08.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.039 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.039 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:44:08.039 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:44:08.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.039 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:08.040 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:44:08.040 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:44:08.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.040 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:08.040 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:44:08.040 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:44:08.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.040 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:08.040 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:44:08.040 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:44:08.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.041 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:08.041 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:44:08.041 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:44:08.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.041 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:08.041 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:44:08.041 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:44:08.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.041 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:08.041 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:44:08.041 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:44:08.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.042 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.042 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:08.042 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:44:08.042 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:44:08.042 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.042 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:08.042 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.042 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.042 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.042 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:08.042 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:08.042 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.97569194800001, 2024-04-26T10:44:08.042 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:44:08.043 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:08.043 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.043 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:08.043 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.043 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:08.043 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:08.043 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.043 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.043 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:08.043 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:08.043 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.043 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.044 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:08.044 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:08.044 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:08.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.044 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:08.044 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:44:08.044 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:44:08.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.044 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:08.044 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:44:08.044 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:44:08.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.045 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.045 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.045 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:44:08.045 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:44:08.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.045 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.045 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:08.045 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:44:08.045 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:44:08.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.045 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.045 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:08.046 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:44:08.046 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:44:08.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.046 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.046 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:08.046 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:44:08.046 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:44:08.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.046 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.046 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:08.046 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:44:08.046 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:44:08.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.047 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.047 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:08.047 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:44:08.047 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:44:08.047 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.047 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.047 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:08.047 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:44:08.047 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:44:08.047 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.047 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.047 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:08.047 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:44:08.047 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:44:08.048 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.048 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:08.048 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.048 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:08.048 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:08.048 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.97565994599999, 2024-04-26T10:44:08.048 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:44:08.048 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:08.048 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.048 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:08.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.048 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:08.048 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:08.048 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.049 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:08.049 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:08.049 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.049 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:08.049 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:44:08.049 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.049 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:08.049 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:44:08.050 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:44:08.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.050 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:08.050 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:44:08.050 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:44:08.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.051 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.051 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:44:08.051 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:44:08.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.051 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:08.051 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:44:08.051 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:44:08.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.052 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.052 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:08.052 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:44:08.052 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:44:08.052 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.052 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.052 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:08.052 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:44:08.052 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:44:08.052 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.052 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.052 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:08.052 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:44:08.053 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:44:08.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.053 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.053 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:08.053 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:44:08.053 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:44:08.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.053 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.053 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:08.053 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:44:08.053 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:44:08.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.053 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.054 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:08.054 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:44:08.054 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:44:08.054 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.054 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:08.054 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.054 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.054 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:08.054 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:08.054 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.975451138, 2024-04-26T10:44:08.054 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:44:08.054 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:08.054 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.055 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:08.055 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.055 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:08.055 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:08.055 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.055 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.055 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:08.055 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:08.055 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.055 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.055 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:08.055 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:44:08.055 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:08.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.056 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.056 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:08.056 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:44:08.056 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:44:08.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.056 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.056 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:08.056 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:44:08.056 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:44:08.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.056 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.056 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.057 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:44:08.057 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:44:08.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.057 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.057 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:08.057 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:44:08.057 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:44:08.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.057 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.057 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:08.057 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:44:08.057 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:44:08.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.057 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.058 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:08.058 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:44:08.058 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:44:08.058 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.058 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.058 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:08.058 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:44:08.058 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:44:08.058 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.058 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.058 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:08.058 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:44:08.058 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:44:08.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.059 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.059 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:08.059 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:44:08.059 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:44:08.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.059 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.059 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:08.059 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:44:08.059 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:44:08.059 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.059 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:08.060 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.060 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.060 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:08.060 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:08.060 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.975419847, 2024-04-26T10:44:08.060 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:44:08.060 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:08.060 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:08.060 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:08.060 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.060 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:08.060 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:08.060 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.061 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:08.061 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:08.061 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.061 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:08.061 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:44:08.061 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.061 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:08.061 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:44:08.062 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:44:08.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.062 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.062 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:08.062 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:44:08.062 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:44:08.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.062 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.062 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.062 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:44:08.062 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:44:08.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.062 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.063 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:08.063 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:44:08.063 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:44:08.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.063 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.063 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:08.063 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:44:08.063 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:44:08.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.063 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.063 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:08.063 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:44:08.063 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:44:08.064 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.064 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:08.064 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.064 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.064 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.064 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:08.064 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:08.064 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.975392597, 2024-04-26T10:44:08.064 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:44:08.064 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:08.064 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:08.064 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:08.064 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.064 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.065 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:44:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:44:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:44:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:44:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:44:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:44:08.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:44:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:44:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:44:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:44:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:44:08.067 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:44:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.972615846, 2024-04-26T10:44:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:44:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:44:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:08.068 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:44:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.069 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:44:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:44:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:44:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:44:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:44:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:44:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:44:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:44:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:44:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:44:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:08.072 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:08.072 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.972565757, 2024-04-26T10:44:08.072 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:44:08.072 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:08.072 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.072 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:08.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.072 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:08.072 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:08.072 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.072 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.072 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:08.072 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:44:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:44:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:44:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.073 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:44:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:44:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:44:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:44:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:44:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:44:08.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:44:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:44:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:44:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:44:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:44:08.075 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:44:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.971673688, 2024-04-26T10:44:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:44:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.076 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:44:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.077 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:44:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:44:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:44:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:44:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:44:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:44:08.078 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.079 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:08.079 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:44:08.079 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:44:08.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.079 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:08.079 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:44:08.079 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:44:08.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.079 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:08.079 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:44:08.080 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:44:08.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.080 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.080 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:08.080 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:44:08.080 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:08.080 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.080 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:08.080 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.080 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.080 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:44:08.080 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:08.080 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.969485359, 2024-04-26T10:44:08.081 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:44:08.081 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:08.081 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.081 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:08.081 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.081 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:08.081 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:08.081 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.081 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.081 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.081 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:08.081 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:08.081 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.081 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.082 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.082 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:08.082 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:08.082 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.082 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.082 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:08.082 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:44:08.082 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:44:08.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.082 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.082 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:08.082 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:44:08.083 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:44:08.083 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.083 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.083 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.083 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:44:08.083 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:44:08.083 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.083 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.083 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:08.083 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:44:08.083 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:44:08.083 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.083 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.083 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:08.083 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:44:08.084 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:44:08.084 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.084 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.084 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:08.084 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:44:08.084 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:44:08.084 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.084 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.084 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:08.084 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:44:08.084 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:44:08.084 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.084 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:08.085 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.085 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.085 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:44:08.085 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:08.085 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.96934998899999, 2024-04-26T10:44:08.085 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:44:08.085 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:08.085 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.085 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:08.085 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.085 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:08.085 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:08.085 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.086 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:08.086 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:08.086 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.086 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:08.086 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:44:08.086 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.086 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:08.086 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:44:08.087 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:44:08.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.087 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.087 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:08.087 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:44:08.087 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:44:08.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.087 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.087 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.087 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:44:08.087 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:44:08.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.087 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.087 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:08.088 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:44:08.088 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:44:08.088 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.088 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.088 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:08.088 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:44:08.088 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:44:08.088 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.088 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.088 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:08.088 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:44:08.088 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:44:08.088 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.089 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.089 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:08.089 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:44:08.089 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:44:08.089 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.089 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:08.089 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.089 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.089 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:44:08.089 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:08.089 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.969135415, 2024-04-26T10:44:08.089 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:44:08.089 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:08.090 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.090 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:08.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.090 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:08.090 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:08.090 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.090 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:08.090 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:08.090 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.091 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:08.091 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:08.091 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.091 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:08.091 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:44:08.091 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:44:08.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.091 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:08.091 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:44:08.091 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:44:08.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.092 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.092 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:44:08.092 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:44:08.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.092 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:08.092 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:44:08.092 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:44:08.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.092 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:08.092 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:44:08.092 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:44:08.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.093 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:08.093 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:44:08.093 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:44:08.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.093 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:08.093 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:44:08.093 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:44:08.093 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.093 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:08.093 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.094 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:44:08.094 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:08.094 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.968796474, 2024-04-26T10:44:08.094 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:44:08.094 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:08.094 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.094 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:08.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.094 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:08.094 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:08.094 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.095 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:08.095 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:08.095 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.095 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:08.095 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:08.095 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.095 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:08.095 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:44:08.095 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:44:08.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.096 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:08.096 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:44:08.096 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:44:08.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.096 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.096 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:44:08.096 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:44:08.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.096 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:08.096 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:44:08.097 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:44:08.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.097 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:08.097 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:44:08.097 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:44:08.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.097 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:08.097 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:44:08.097 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:44:08.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.097 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:08.097 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:44:08.097 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:44:08.098 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.098 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:08.098 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.098 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.098 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.098 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:08.098 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:08.098 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.968687097, 2024-04-26T10:44:08.098 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:44:08.098 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:08.098 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:44:08.098 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:08.098 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.098 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:08.099 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:08.099 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.099 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:08.099 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:08.099 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.099 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:08.099 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:44:08.099 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:08.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.101 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:08.101 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:44:08.101 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:44:08.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.101 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:08.101 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:44:08.101 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:44:08.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.102 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.102 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.102 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:44:08.102 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:44:08.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.102 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.102 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:08.102 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:44:08.102 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:44:08.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.102 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.102 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:08.102 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:44:08.102 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:44:08.103 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.103 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:08.103 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.103 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.103 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:44:08.103 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:08.103 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.968647378, 2024-04-26T10:44:08.103 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:44:08.103 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:08.103 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.103 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:08.103 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.103 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:08.103 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:08.104 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.104 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:08.104 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:08.104 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.104 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:08.104 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:08.104 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:08.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.104 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:08.104 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:44:08.104 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:44:08.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.105 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:08.105 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:44:08.105 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:44:08.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.105 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.105 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:44:08.105 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:44:08.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.105 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:44:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:44:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:44:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:44:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:44:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:44:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.107 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:08.107 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:44:08.107 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:44:08.107 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.107 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:08.107 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.107 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:44:08.107 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:08.107 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 101.96830984499999, 2024-04-26T10:44:08.107 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:44:08.107 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:08.107 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.107 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:08.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.108 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:08.108 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:08.108 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.108 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:08.108 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:08.108 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:08.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.108 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:08.108 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:44:08.108 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.109 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:08.109 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:44:08.109 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:44:08.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.109 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:08.109 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:44:08.109 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:44:08.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.109 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.109 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:44:08.109 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:44:08.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.110 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:08.110 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:44:08.110 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:44:08.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.110 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:08.110 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:44:08.110 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:44:08.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.110 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:08.110 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:44:08.110 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:44:08.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:08.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:08.111 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:08.111 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:44:08.111 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:44:08.111 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.111 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:08.111 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.111 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:08.111 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:08.111 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:08.113 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:08.113 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:08.112+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:08.214 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:08.212+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:08.217 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:08.217 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:08.217 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:44:08.217 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:08.226 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:08.314 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:08.313+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:08.368 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:08.368 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:08.368 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:08.368 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:08.368 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:08.376 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:08.417 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:08.416+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:08.516 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:08.515+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:08.519 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:08.519 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:08.519 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:08.520 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:08.520 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.520 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:08.520 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:08.520 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 102.481250554, 2024-04-26T10:44:08.520 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:44:08.520 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:08.520 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.520 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:08.520 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.520 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:08.520 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:08.520 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.520 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.521 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.521 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:08.521 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:08.521 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.521 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.521 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.521 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:08.521 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:44:08.521 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.521 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.521 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.521 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:08.521 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:44:08.521 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:44:08.522 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.522 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.522 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:08.522 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:44:08.522 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:44:08.522 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.522 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.522 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.522 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:44:08.522 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:44:08.522 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.522 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.522 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:08.523 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:44:08.523 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:44:08.523 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.523 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.523 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:08.523 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:44:08.523 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:44:08.523 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.523 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.523 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:08.523 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:44:08.523 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:44:08.523 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.523 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.524 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:08.524 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:44:08.524 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:44:08.524 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.524 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:08.524 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.524 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.524 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.524 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:08.524 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:08.524 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 102.480379774, 2024-04-26T10:44:08.524 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:44:08.524 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:08.524 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.525 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:08.525 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.525 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:08.525 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:08.525 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.525 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.525 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.525 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:08.525 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:08.525 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.525 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.525 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.525 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:08.525 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:08.526 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.526 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.526 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.526 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:08.526 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:44:08.526 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:44:08.526 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.526 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.526 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:08.526 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:44:08.526 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:44:08.526 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.526 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.526 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.527 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:44:08.527 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:44:08.527 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.527 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.527 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:08.527 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:44:08.527 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:44:08.527 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.527 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.527 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:08.527 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:44:08.527 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:44:08.527 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.527 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.528 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:08.528 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:44:08.528 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:44:08.528 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.528 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.528 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:08.528 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:44:08.528 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:44:08.528 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.528 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:08.528 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.528 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.529 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.529 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:08.529 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:08.529 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 102.47939243099999, 2024-04-26T10:44:08.529 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:44:08.529 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:08.529 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.529 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:08.529 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.529 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:08.529 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:08.529 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.529 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.529 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.530 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:08.530 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:08.530 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.530 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.530 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.530 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:08.530 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:44:08.530 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:08.530 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.530 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.530 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:08.530 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:44:08.530 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:44:08.530 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.531 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.531 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:08.531 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:44:08.531 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:44:08.531 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.531 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.531 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.531 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:44:08.531 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:44:08.531 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.531 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.531 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:08.531 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:44:08.531 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:44:08.532 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.532 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.532 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:08.532 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:44:08.532 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:44:08.532 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.532 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.532 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:08.532 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:44:08.532 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:44:08.532 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.532 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.532 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:08.532 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:44:08.532 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:44:08.532 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.533 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:08.533 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.533 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.533 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.533 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:08.533 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:08.533 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 102.479187166, 2024-04-26T10:44:08.533 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:44:08.533 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:08.533 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.533 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:08.533 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.533 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:08.533 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:08.533 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.534 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.534 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:08.534 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:08.534 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.534 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.534 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:08.534 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:08.534 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.534 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.535 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:08.535 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:44:08.535 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:44:08.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.535 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.535 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:08.535 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:44:08.535 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:44:08.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.535 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.535 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.535 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:44:08.535 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:44:08.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.536 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.536 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:08.536 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:44:08.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:44:08.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.536 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.536 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:08.536 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:44:08.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:44:08.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.537 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.537 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:08.537 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:44:08.537 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:44:08.537 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.537 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.537 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:08.537 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:44:08.537 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:44:08.537 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.537 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:08.537 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.538 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.538 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.538 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:08.538 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:08.538 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 102.478866287, 2024-04-26T10:44:08.538 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:44:08.538 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:08.538 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.538 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:08.538 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.538 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:08.538 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:08.538 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.538 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.539 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.539 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:08.539 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:08.539 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.539 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.539 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.539 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:08.539 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:44:08.539 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:08.539 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.539 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.539 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:08.539 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:44:08.539 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:44:08.539 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.540 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.540 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:08.540 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:44:08.540 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:44:08.540 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.540 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.540 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.540 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:44:08.540 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:44:08.540 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.540 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.540 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:08.540 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:44:08.540 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:44:08.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.541 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:08.541 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:44:08.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:44:08.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.541 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:08.541 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:44:08.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:44:08.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.541 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:08.541 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:44:08.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:44:08.542 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.542 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:08.542 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:44:08.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:44:08.542 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.542 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:08.542 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:44:08.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:44:08.542 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.542 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:08.542 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:44:08.543 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:44:08.543 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.543 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:08.543 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.543 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.543 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.543 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:08.543 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:08.543 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 102.47881446300001, 2024-04-26T10:44:08.543 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:44:08.543 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:08.543 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.543 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:08.543 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:08.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:08.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:08.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:08.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:08.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:44:08.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.545 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:08.545 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:44:08.545 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:44:08.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.545 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.545 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:08.545 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:44:08.545 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:44:08.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.545 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.545 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.545 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:44:08.545 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:44:08.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.546 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:08.546 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:44:08.546 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:44:08.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.546 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:08.546 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:44:08.546 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:44:08.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.546 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:08.546 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:44:08.546 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:44:08.547 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:08.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:44:08.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:44:08.547 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:08.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:44:08.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:44:08.547 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:08.548 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:44:08.548 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:44:08.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.548 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.548 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:08.548 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:44:08.548 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:44:08.548 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.548 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:08.548 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.548 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.548 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:08.548 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:08.549 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 102.478761091, 2024-04-26T10:44:08.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:44:08.549 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:08.549 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.549 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:08.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.549 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:08.549 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:08.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.549 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.549 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:08.549 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:08.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.549 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:08.550 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:08.550 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.550 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:08.550 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:44:08.550 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:44:08.550 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:08.550 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:44:08.550 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:44:08.551 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.551 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.551 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.551 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:44:08.551 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:44:08.551 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.551 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.551 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:08.551 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:44:08.551 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:44:08.551 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.551 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.551 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:08.551 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:44:08.552 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:44:08.552 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.552 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.552 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:08.552 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:44:08.552 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:44:08.552 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.553 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.553 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:08.553 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:44:08.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:44:08.553 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.553 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.553 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:08.553 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:44:08.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:44:08.553 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.553 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.553 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:08.553 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:44:08.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:44:08.554 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.554 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.554 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:08.554 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:44:08.554 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:44:08.554 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.554 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:08.554 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.554 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.554 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.554 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:08.554 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:08.554 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 102.478716764, 2024-04-26T10:44:08.554 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:44:08.555 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:08.555 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.555 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:08.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.555 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:08.555 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:08.555 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.555 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:08.555 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:08.555 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:08.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:08.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:08.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.556 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:08.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:44:08.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:44:08.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.556 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:08.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:44:08.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:44:08.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.556 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.557 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.557 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:44:08.557 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:44:08.557 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.557 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.557 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:08.557 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:44:08.557 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:44:08.557 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.557 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.557 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:08.557 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:44:08.557 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:44:08.557 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.558 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:08.558 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:44:08.558 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:44:08.558 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.558 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:08.558 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:44:08.558 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:44:08.558 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.558 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:08.558 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:44:08.558 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:44:08.559 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.559 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.559 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:08.559 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:44:08.559 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:44:08.559 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.559 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.559 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:08.559 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:44:08.559 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:44:08.559 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.559 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:08.559 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.559 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.559 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.560 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:08.560 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:08.560 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 102.47869305099999, 2024-04-26T10:44:08.560 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:44:08.560 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:08.560 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.560 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:08.560 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.560 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:08.560 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:08.560 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.560 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.560 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.560 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:08.560 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:08.561 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.561 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.561 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:08.561 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:08.561 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.561 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.561 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:08.561 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:44:08.561 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:44:08.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.561 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.561 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:08.562 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:44:08.562 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:44:08.562 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.562 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.562 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.562 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:44:08.562 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:44:08.562 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.562 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.562 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:08.562 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:44:08.562 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:44:08.562 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.563 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.563 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:08.563 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:44:08.563 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:44:08.563 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.563 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.563 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:08.563 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:44:08.563 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:44:08.563 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.563 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.563 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:08.563 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:44:08.563 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:44:08.564 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.564 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:08.564 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:44:08.564 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:44:08.564 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.564 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:08.564 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:44:08.564 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:44:08.564 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.564 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:08.564 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:44:08.564 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:44:08.565 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.565 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:08.565 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.565 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.565 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.565 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:08.565 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:08.565 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 102.47865874599999, 2024-04-26T10:44:08.565 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:44:08.565 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:08.565 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.565 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:08.565 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.565 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:08.566 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:08.566 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.566 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.566 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.566 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:08.566 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:08.566 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.566 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.566 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.566 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:08.566 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:44:08.566 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.566 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.566 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.567 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:08.567 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:44:08.567 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:44:08.567 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.567 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.567 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:08.567 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:44:08.567 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:44:08.567 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.567 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.567 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.567 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:44:08.567 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:44:08.567 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.567 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.568 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:08.568 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:44:08.568 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:44:08.568 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.568 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.568 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:08.568 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:44:08.568 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:44:08.568 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.568 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.568 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:08.568 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:44:08.568 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:44:08.568 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.569 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.569 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:08.569 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:44:08.569 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:44:08.569 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.569 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.569 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:08.569 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:44:08.569 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:44:08.569 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.569 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.569 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:08.569 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:44:08.569 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:44:08.570 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.570 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.570 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:08.570 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:44:08.570 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:44:08.570 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.570 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:08.570 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.570 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.570 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.570 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:08.570 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:08.570 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 102.47832215, 2024-04-26T10:44:08.570 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:44:08.571 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:08.571 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:08.571 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:08.571 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.571 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:08.571 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:08.571 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.571 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.571 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.571 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:08.571 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:08.571 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.571 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.571 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.572 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:08.572 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:44:08.572 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:08.572 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.572 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.572 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:08.572 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:44:08.572 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:44:08.572 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.572 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.572 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:08.572 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:44:08.572 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:44:08.572 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.572 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.573 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.573 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:44:08.573 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:44:08.573 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.573 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.573 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:08.573 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:44:08.573 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:44:08.573 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.573 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.573 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:08.573 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:44:08.573 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:44:08.573 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.574 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.574 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:08.574 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:44:08.574 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:44:08.574 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.574 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:08.574 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.574 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.574 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.574 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:08.574 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:08.574 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 102.478280122, 2024-04-26T10:44:08.574 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:44:08.574 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:08.575 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:08.575 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:08.575 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.575 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:08.575 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:08.575 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.575 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.575 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.575 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:08.575 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:08.575 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.575 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.575 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.575 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:08.576 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:08.576 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.576 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.576 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.576 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:08.576 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:44:08.576 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:44:08.576 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.576 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.576 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:08.576 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:44:08.576 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:44:08.576 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.576 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.576 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.577 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:44:08.577 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:44:08.577 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.577 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.577 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:08.577 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:44:08.577 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:44:08.577 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.577 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.577 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:08.577 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:44:08.577 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:44:08.577 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.577 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.578 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:08.578 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:44:08.578 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:44:08.578 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.578 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:08.578 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.578 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.578 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.578 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:08.578 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:08.578 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 102.47822695000001, 2024-04-26T10:44:08.578 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:44:08.578 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:08.578 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:08.579 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:08.579 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.579 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:08.579 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:08.579 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.579 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.579 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.579 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:08.579 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:08.579 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.579 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.579 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.579 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:08.579 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:08.579 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.580 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.580 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.580 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:08.580 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:44:08.580 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:44:08.580 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.580 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.580 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:08.580 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:44:08.580 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:44:08.580 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.580 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.580 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.580 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:44:08.580 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:44:08.581 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.581 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.581 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:08.581 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:44:08.581 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:44:08.581 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.581 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.581 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:08.581 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:44:08.581 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:44:08.581 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.581 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.581 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:08.581 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:44:08.582 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:44:08.582 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.582 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:08.582 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.582 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.582 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.582 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:08.582 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:08.582 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 102.47482054, 2024-04-26T10:44:08.582 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:44:08.582 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:08.582 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:44:08.582 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:08.582 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.582 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:08.583 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:08.583 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.583 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.583 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.583 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:08.583 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:08.583 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.583 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.583 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.583 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:08.583 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:44:08.583 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.583 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.583 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.584 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:08.584 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:44:08.584 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:44:08.584 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.584 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.584 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:08.584 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:44:08.584 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:44:08.584 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.584 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.584 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.584 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:44:08.584 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:44:08.584 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.584 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.585 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:08.585 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:44:08.585 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:44:08.585 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.585 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.585 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:08.585 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:44:08.585 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:44:08.585 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.585 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:08.585 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.585 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.585 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.585 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:44:08.586 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:44:08.586 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 102.472348587, 2024-04-26T10:44:08.586 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:44:08.586 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:08.586 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:08.586 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:08.586 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.586 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:08.586 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:44:08.586 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.586 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.586 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.587 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:08.587 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:44:08.587 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.587 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.587 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.587 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:08.587 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:44:08.587 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.587 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.587 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.587 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:08.587 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:44:08.587 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:44:08.587 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.587 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.588 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:08.588 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:44:08.588 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:44:08.588 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.588 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.588 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.588 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:44:08.588 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:44:08.588 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.588 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.588 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:08.588 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:44:08.588 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:44:08.588 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.589 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.589 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:08.589 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:44:08.589 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:44:08.589 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.589 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.589 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:08.589 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:44:08.589 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:44:08.589 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.589 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:08.589 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.589 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.589 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.590 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:44:08.590 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:08.590 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 102.471695029, 2024-04-26T10:44:08.590 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:44:08.590 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:08.590 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:08.590 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:08.590 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.590 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:08.590 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:08.590 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.590 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.590 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.590 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:08.591 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:08.591 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.591 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.591 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.591 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:08.591 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:08.591 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.591 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.591 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.591 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:08.591 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:44:08.591 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:44:08.591 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.591 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.592 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:08.592 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:44:08.592 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:44:08.592 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.592 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.592 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.592 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:44:08.592 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:44:08.592 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.592 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.592 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:08.592 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:44:08.592 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:44:08.592 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.593 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.593 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:08.593 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:44:08.593 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:44:08.593 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.593 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.593 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:08.593 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:44:08.593 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:44:08.593 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.593 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:08.593 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.593 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.593 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.594 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:44:08.594 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:08.594 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 102.471619244, 2024-04-26T10:44:08.594 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:44:08.594 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:08.594 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:08.594 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:08.594 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.594 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:08.594 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:08.594 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.594 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.594 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.594 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:08.595 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:08.595 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.595 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.595 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.595 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:08.595 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:08.595 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.595 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.595 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.595 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:08.595 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:44:08.595 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:44:08.595 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.595 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.596 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:08.596 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:44:08.596 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:44:08.596 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.596 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.596 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.596 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:44:08.596 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:44:08.596 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.596 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.596 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:08.596 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:44:08.596 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:44:08.596 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.597 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.597 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:08.597 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:44:08.597 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:44:08.597 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.597 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.597 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:08.597 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:44:08.597 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:44:08.597 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.597 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:08.597 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.597 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.597 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.598 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:44:08.598 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:44:08.598 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 102.47140555, 2024-04-26T10:44:08.598 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:44:08.598 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:08.598 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:44:08.598 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:08.598 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.598 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:08.598 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:44:08.598 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.598 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.598 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.599 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:08.599 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:44:08.599 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.599 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.599 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.599 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:08.599 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:44:08.599 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:08.599 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.599 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.599 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:08.599 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:44:08.599 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:44:08.599 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.600 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.600 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:08.600 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:44:08.600 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:44:08.600 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.600 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.600 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.600 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:44:08.600 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:44:08.600 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.600 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.600 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:08.600 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:44:08.600 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:44:08.601 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.601 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.601 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:08.601 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:44:08.601 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:44:08.601 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.601 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:08.601 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.601 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.601 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.601 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:44:08.601 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:44:08.601 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 102.468961737, 2024-04-26T10:44:08.601 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:44:08.602 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:08.602 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:08.602 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:08.602 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.602 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:08.602 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:44:08.602 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.602 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.602 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.602 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:08.602 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:44:08.602 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.602 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.602 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.603 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:08.603 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:44:08.603 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:44:08.603 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.603 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.603 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:08.603 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:44:08.603 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:44:08.603 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.603 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.603 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:08.603 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:44:08.603 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:44:08.603 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.604 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.604 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.604 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:44:08.604 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:44:08.604 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.604 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.604 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:08.604 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:44:08.604 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:44:08.604 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.604 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.604 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:08.604 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:44:08.604 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:44:08.605 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.605 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.605 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:08.605 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:44:08.605 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:44:08.605 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.605 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:08.605 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.605 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.605 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.605 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:44:08.605 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:08.605 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 97.018899293000004, 2024-04-26T10:44:08.606 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:44:08.606 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:08.606 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:08.606 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:08.606 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.606 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:08.606 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:08.606 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.606 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.606 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.606 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:08.606 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:08.606 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:08.606 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.607 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.607 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:08.607 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:44:08.607 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:08.607 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.607 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.607 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:08.607 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:44:08.607 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:44:08.607 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.607 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.607 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:08.607 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:44:08.607 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:44:08.607 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.608 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.608 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:08.608 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:44:08.608 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:44:08.608 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.608 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.608 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:08.608 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:44:08.608 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:44:08.608 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.608 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.608 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:08.608 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:44:08.608 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:44:08.609 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.609 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.609 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:08.609 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:44:08.609 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:44:08.609 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.609 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.609 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:08.609 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:44:08.609 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:44:08.609 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.609 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.609 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:08.609 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:44:08.610 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:44:08.610 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.610 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.610 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:08.610 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:44:08.610 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:44:08.610 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:08.610 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:08.610 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:08.610 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:44:08.610 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:44:08.610 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.610 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:08.610 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.611 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:08.611 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:08.611 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:08.612 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:08.656 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:08.655+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:08.717 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:08.716+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:08.725 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:08.725 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:08.725 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:44:08.725 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:08.734 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:08.819 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:08.818+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:08.881 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:08.881 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:08.881 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:08.881 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:08.881 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:08.890 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:08.922 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:08.921+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:08.926 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:44:09.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~53s 2024-04-26T10:44:09.022 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:09.022+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:09.037 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:09.037 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:09.037 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:09.037 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:09.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.037 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:09.037 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:09.037 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 102.999333721, 2024-04-26T10:44:09.037 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:44:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:44:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:44:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:44:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:44:09.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.040 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:09.040 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:44:09.040 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:44:09.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.040 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:09.040 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:44:09.040 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:44:09.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.040 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:09.040 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:44:09.040 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:44:09.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.041 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:09.041 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:44:09.041 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:44:09.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.041 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:09.041 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:44:09.041 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:44:09.041 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.041 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:09.041 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.042 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:09.042 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:09.042 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 102.9975836, 2024-04-26T10:44:09.042 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:44:09.042 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:09.042 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:09.042 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:09.042 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.042 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:09.042 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:09.042 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.042 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.042 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.043 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:09.043 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:09.043 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.043 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.043 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:09.043 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:44:09.043 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:09.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.043 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.043 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:09.043 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:44:09.043 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:44:09.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.043 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.044 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:09.044 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:44:09.044 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:44:09.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.044 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:09.044 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:44:09.044 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:44:09.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.044 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:09.044 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:44:09.044 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:44:09.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.045 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.045 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:09.045 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:44:09.045 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:44:09.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.045 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.045 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:09.045 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:44:09.045 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:44:09.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.045 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.045 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:09.045 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:44:09.045 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:44:09.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.046 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.046 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:09.046 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:44:09.046 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:44:09.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.046 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.046 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:09.046 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:44:09.046 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:44:09.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.046 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.046 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:09.046 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:44:09.047 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:44:09.047 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.047 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:09.047 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.047 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.047 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.047 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:09.047 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:09.047 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 102.997530602, 2024-04-26T10:44:09.047 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:44:09.047 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:09.047 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:09.047 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:09.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.048 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:09.048 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:09.048 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.048 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:09.048 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:09.048 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.048 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:09.048 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:09.048 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:09.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.049 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:09.049 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:44:09.049 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:44:09.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.049 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:09.049 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:44:09.049 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:44:09.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.049 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:09.049 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:44:09.049 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:44:09.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.050 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:09.050 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:44:09.050 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:44:09.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.050 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:09.050 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:44:09.050 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:44:09.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.050 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:09.050 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:44:09.050 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:44:09.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.051 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:09.051 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:44:09.051 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:44:09.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.051 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:09.051 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:44:09.051 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:44:09.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.051 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:09.052 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:44:09.052 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:44:09.052 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.052 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.052 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:09.052 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:44:09.052 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:44:09.052 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.052 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:09.052 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.052 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.052 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.052 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:09.052 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:09.052 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 102.997452858, 2024-04-26T10:44:09.053 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:44:09.053 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:09.053 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:09.053 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:09.053 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.053 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:09.053 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:09.053 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.053 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.053 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:09.053 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:09.053 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.054 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.054 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:09.054 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:44:09.054 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:09.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.054 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.054 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:09.054 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:44:09.054 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:44:09.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.054 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.054 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:09.054 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:44:09.055 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:44:09.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.055 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.055 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:09.055 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:44:09.055 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:44:09.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.055 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.055 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:09.055 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:44:09.055 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:44:09.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.055 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.056 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:09.056 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:44:09.056 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:44:09.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.056 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.056 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:09.056 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:44:09.056 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:44:09.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.056 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.056 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:09.056 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:44:09.056 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:44:09.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.057 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.057 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:09.057 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:44:09.057 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:44:09.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.057 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.057 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:09.057 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:44:09.057 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:44:09.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.057 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.057 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:09.057 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:44:09.058 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:44:09.058 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.058 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:09.058 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.058 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.058 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.058 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:09.058 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:09.058 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 102.99741385199999, 2024-04-26T10:44:09.058 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:44:09.058 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:09.058 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:09.058 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:09.058 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.059 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:09.059 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:09.059 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.059 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.059 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:09.059 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:09.059 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.059 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.059 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:09.059 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:44:09.059 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:09.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.060 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.060 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:09.060 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:44:09.060 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:44:09.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.060 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.060 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:09.060 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:44:09.060 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:44:09.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.060 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.060 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:09.061 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:44:09.061 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:44:09.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.061 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:09.061 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:44:09.061 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:44:09.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.061 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:09.061 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:44:09.061 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:44:09.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.062 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:09.062 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:44:09.062 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:44:09.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.062 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.062 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:09.062 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:44:09.062 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:44:09.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.062 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.062 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:09.062 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:44:09.062 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:44:09.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.063 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.063 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:09.063 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:44:09.063 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:44:09.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.063 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.063 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:09.063 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:44:09.063 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:44:09.063 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.063 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:09.063 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.064 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.064 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:09.064 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:09.064 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 102.997395031, 2024-04-26T10:44:09.064 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:44:09.064 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:09.064 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:09.064 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:09.064 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.064 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:09.064 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:09.064 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.064 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.064 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.065 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:09.065 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:09.065 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.065 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.065 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:09.065 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:09.065 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:09.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.065 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.065 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:09.065 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:44:09.065 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:44:09.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.066 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.066 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:09.066 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:44:09.066 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:44:09.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.066 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.066 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:09.066 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:44:09.066 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:44:09.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.066 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.066 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:09.066 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:44:09.067 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:44:09.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.067 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:09.067 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:44:09.067 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:44:09.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.067 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:09.067 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:44:09.067 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:44:09.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.067 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:09.068 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:44:09.068 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:44:09.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.068 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:09.068 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:44:09.068 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:44:09.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.068 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:09.068 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:44:09.068 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:44:09.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.069 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.069 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:09.069 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:44:09.069 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:44:09.069 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.069 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:09.069 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.069 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.069 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:09.069 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:09.069 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 102.997363029, 2024-04-26T10:44:09.069 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:44:09.069 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:09.070 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:09.070 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:09.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.070 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:09.070 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:09.070 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.070 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.070 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:09.070 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:09.070 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.070 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.070 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:09.071 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:44:09.071 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:09.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.071 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.071 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:09.071 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:44:09.071 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:44:09.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.071 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.071 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:09.071 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:44:09.071 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:44:09.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.071 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.072 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:09.072 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:44:09.072 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:44:09.072 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.072 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:09.072 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:44:09.072 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:44:09.072 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.072 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:09.072 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:44:09.072 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:44:09.072 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.073 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.073 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:09.073 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:44:09.073 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:44:09.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.073 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.073 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:09.073 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:44:09.073 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:44:09.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.073 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.073 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:09.073 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:44:09.073 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:44:09.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.074 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.074 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:09.074 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:44:09.074 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:44:09.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.074 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.074 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:09.074 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:44:09.074 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:44:09.074 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.074 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:09.074 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.075 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:09.075 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:09.075 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 102.997154221, 2024-04-26T10:44:09.075 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:44:09.075 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:09.075 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:09.075 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:09.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.075 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:09.075 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:09.075 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.075 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:09.076 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:09.076 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.076 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.076 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:09.076 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:44:09.076 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:09.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.076 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.076 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:09.076 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:44:09.076 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:44:09.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.076 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.077 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:09.077 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:44:09.077 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:44:09.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.077 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.077 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:09.077 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:44:09.077 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:44:09.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.077 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.077 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:09.077 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:44:09.077 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:44:09.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.078 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:09.078 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:44:09.078 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:44:09.078 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.078 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:09.078 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:44:09.078 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:44:09.078 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.078 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:09.078 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:44:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:44:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:44:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:44:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:44:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:44:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:44:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:44:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 102.99712293, 2024-04-26T10:44:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:44:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.081 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:09.081 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:09.081 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.081 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.081 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.081 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:09.081 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:09.081 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.081 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.081 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.081 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:09.081 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:44:09.081 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:09.081 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.082 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.082 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:09.082 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:44:09.082 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:44:09.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.082 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.082 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:09.082 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:44:09.082 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:44:09.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.082 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.082 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:09.082 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:44:09.082 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:44:09.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:44:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:44:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:44:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:44:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:44:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:44:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 102.99709568, 2024-04-26T10:44:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:44:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:44:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:44:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:44:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:44:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:44:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:44:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:44:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:44:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:44:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:44:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:44:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:44:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 102.994318929, 2024-04-26T10:44:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:44:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:44:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:44:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:44:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:44:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:44:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:44:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:44:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:44:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:44:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:44:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:44:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:44:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 102.99426884, 2024-04-26T10:44:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:44:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:44:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:44:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:44:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:44:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:44:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:44:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:44:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:44:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:44:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:09.095 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:44:09.095 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:44:09.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.095 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:09.095 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:44:09.095 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:44:09.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.095 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:09.095 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:44:09.095 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:44:09.095 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.095 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:09.095 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.096 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:09.096 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:09.096 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 102.993376771, 2024-04-26T10:44:09.096 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:44:09.096 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:09.096 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:09.096 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:09.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.096 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:09.096 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:09.096 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.097 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:09.097 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:09.097 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.097 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:09.097 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:44:09.097 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:09.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.097 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:09.097 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:44:09.097 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:44:09.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.098 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.098 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:09.098 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:44:09.098 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:44:09.098 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.098 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.098 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:09.098 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:44:09.098 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:44:09.098 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.098 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.098 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:09.098 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:44:09.099 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:44:09.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.099 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:09.099 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:44:09.099 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:44:09.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.099 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:09.099 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:44:09.099 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:44:09.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.099 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:09.099 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:44:09.100 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:09.100 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.100 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:09.100 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.100 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.100 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:44:09.100 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:09.100 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 102.991188442, 2024-04-26T10:44:09.100 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:44:09.100 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:09.100 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:09.100 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:09.100 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.101 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:09.101 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:09.101 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.101 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:09.101 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:09.101 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.101 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:09.101 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:09.101 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:09.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.102 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:09.102 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:44:09.102 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:44:09.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.102 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.102 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:09.102 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:44:09.102 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:44:09.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.102 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.102 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:09.102 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:44:09.102 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:44:09.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.103 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.103 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:09.103 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:44:09.103 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:44:09.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.103 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.103 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:09.103 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:44:09.103 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:44:09.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.103 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.103 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:09.103 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:44:09.103 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:44:09.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.104 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:09.104 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:44:09.104 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:44:09.104 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.104 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:09.104 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.104 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:44:09.104 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:09.104 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 102.991053072, 2024-04-26T10:44:09.104 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:44:09.104 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:09.105 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:09.105 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:09.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.105 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:09.105 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:09.105 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.105 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:09.105 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:09.105 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.105 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:09.105 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:44:09.106 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:09.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.106 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:09.106 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:44:09.106 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:44:09.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.106 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:09.106 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:44:09.106 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:44:09.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.106 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:09.107 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:44:09.107 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:44:09.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.107 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:09.107 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:44:09.107 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:44:09.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.107 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:09.107 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:44:09.107 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:44:09.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.108 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:09.108 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:44:09.108 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:44:09.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.108 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:09.108 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:44:09.108 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:44:09.108 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.108 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:09.108 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.108 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:44:09.109 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:09.109 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 102.990838498, 2024-04-26T10:44:09.109 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:44:09.109 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:09.109 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:09.109 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:09.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.109 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:09.109 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:09.109 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.109 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:09.109 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:09.110 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.110 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:09.110 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:09.110 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:09.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.110 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:09.110 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:44:09.110 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:44:09.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.110 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:09.110 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:44:09.111 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:44:09.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.111 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:09.111 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:44:09.111 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:44:09.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.111 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:09.111 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:44:09.111 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:44:09.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.111 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:09.112 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:44:09.112 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:44:09.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.112 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:09.112 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:44:09.112 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:44:09.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.112 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:09.112 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:44:09.112 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:44:09.112 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.112 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:09.112 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.113 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:44:09.113 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:09.113 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 102.99049955700001, 2024-04-26T10:44:09.113 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:44:09.113 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:09.113 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:09.113 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:09.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.113 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:09.113 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:09.113 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.114 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:09.114 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:09.114 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.114 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:09.114 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:09.114 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:09.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.114 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:09.114 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:44:09.114 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:44:09.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.115 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:09.115 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:44:09.115 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:44:09.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.115 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:09.115 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:44:09.115 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:44:09.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.115 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:09.115 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:44:09.115 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:44:09.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.116 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:09.116 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:44:09.116 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:44:09.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.116 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:09.116 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:44:09.116 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:44:09.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.116 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:09.116 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:44:09.116 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:44:09.117 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.117 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:09.117 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.117 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:09.117 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:09.117 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 102.99039018000001, 2024-04-26T10:44:09.117 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:44:09.117 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:09.117 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:44:09.117 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:09.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.117 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:09.117 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:09.118 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.118 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:09.118 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:09.118 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.118 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:09.118 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:44:09.118 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:09.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.119 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:09.119 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:44:09.119 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:44:09.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.119 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:09.119 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:44:09.119 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:44:09.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.119 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:09.119 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:44:09.119 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:44:09.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.120 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:09.120 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:44:09.120 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:44:09.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.120 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:09.120 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:44:09.120 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:44:09.120 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.120 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:09.120 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.121 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:44:09.121 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:09.121 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 102.99035046100001, 2024-04-26T10:44:09.121 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:44:09.121 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:09.121 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:09.121 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:09.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.121 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:09.121 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:09.121 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.121 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:09.121 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:09.122 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.122 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:09.122 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:09.122 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:09.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.122 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:09.122 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:44:09.122 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:44:09.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.122 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:09.123 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:44:09.123 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:44:09.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.123 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.123 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:09.123 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:44:09.123 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:44:09.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.123 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.123 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:09.123 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:44:09.123 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:44:09.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.123 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.124 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:09.124 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:44:09.124 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:44:09.124 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.124 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:09.124 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:44:09.124 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:44:09.124 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.124 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:09.124 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:44:09.124 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:44:09.124 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.124 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:09.125 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.125 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:44:09.125 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:09.125 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 102.990012928, 2024-04-26T10:44:09.125 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:44:09.125 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:09.125 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:09.125 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:09.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.125 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:09.125 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:09.125 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.126 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.126 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:09.126 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:09.126 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:09.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.126 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.126 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:09.126 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:44:09.126 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:09.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.126 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.126 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:09.126 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:44:09.127 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:44:09.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.127 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.127 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:09.127 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:44:09.127 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:44:09.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.127 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.127 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:09.127 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:44:09.127 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:44:09.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.127 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.127 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:09.127 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:44:09.129 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:44:09.129 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.129 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.129 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:09.129 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:44:09.130 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:44:09.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.130 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:09.130 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:44:09.130 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:44:09.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:09.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:09.130 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:09.130 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:44:09.130 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:44:09.130 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.130 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:09.130 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.131 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:09.131 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:09.131 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:09.132 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:09.132 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:09.131+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:09.133 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:09.133 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:09.133 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:09.134 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:09.134 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:09.135 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:09.135 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:09.233 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:09.232+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:09.237 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:09.237 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:09.245 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:09.326 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:44:09.334 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:09.334+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:09.346 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:09.346 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:09.354 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:09.435 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:09.434+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:09.455 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:09.455 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:09.464 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:09.536 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:09.535+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:09.574 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:09.574 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:09.583 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:09.666 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:09.666+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:09.729 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:09.729 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:09.738 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:09.739 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:09.737+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:09.839 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:09.838+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:09.885 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:09.885 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:09.894 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:09.939 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:09.939+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:09.999 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:09.999 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:10.008 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:10.040 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:10.040+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:10.109 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:10.110 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:10.119 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:10.141 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:10.141+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:10.220 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:10.221 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:10.229 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:10.273 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:10.272+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:10.323 INFO:teuthology.orchestra.run.smithi049.stderr:noscrub is set 2024-04-26T10:44:10.340 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:10.340 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:10.343 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:10.342+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:10.350 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:10.444 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:10.443+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:10.495 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:10.495 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:10.504 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:10.544 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:10.544+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:10.610 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:10.610 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:10.618 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:10.646 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:10.645+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:10.720 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:10.721 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:10.730 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:10.773 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:10.772+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:10.830 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:10.830 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:10.839 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:10.847 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:10.846+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:10.948 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:10.947+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:10.981 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:10.981 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:10.990 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:11.049 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:11.048+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:11.100 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:11.100 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:11.110 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:11.136 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:44:11.149 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:11.149+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:11.215 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:11.215 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:11.224 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:11.251 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:11.250+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:11.272 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:11.272 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:11.273 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:11.290 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:11.290 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:11.293 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:11.294 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:11.331 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:11.331 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:11.331 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:11.331 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:11.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.332 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:11.332 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:11.332 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 105.293444522, 2024-04-26T10:44:11.332 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:44:11.332 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:11.332 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.332 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:11.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.332 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:11.332 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:11.332 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.333 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:11.333 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:11.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.333 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:11.333 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:11.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.333 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:11.333 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:44:11.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:44:11.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.334 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:11.334 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:44:11.334 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:44:11.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.334 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.334 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:44:11.334 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:44:11.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.335 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:11.335 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:44:11.335 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:44:11.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.335 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:11.335 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:44:11.335 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:44:11.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.335 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:11.335 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:44:11.336 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:44:11.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.336 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:11.336 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:44:11.336 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:44:11.336 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.336 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:11.336 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.336 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:11.337 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:11.337 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 105.291694401, 2024-04-26T10:44:11.337 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:44:11.337 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:11.337 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.337 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:11.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.337 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:11.338 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:11.338 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.338 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.338 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:11.338 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:11.338 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.338 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.338 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:11.338 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:44:11.338 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:11.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.339 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:11.339 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:44:11.339 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:44:11.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.339 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:11.339 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:44:11.339 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:44:11.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.339 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.339 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:44:11.339 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:44:11.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.340 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:11.340 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:44:11.341 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:44:11.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.341 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:11.341 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:44:11.341 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:44:11.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.341 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:11.341 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:44:11.341 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:44:11.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.342 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:11.342 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:44:11.342 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:44:11.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.342 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:11.342 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:44:11.342 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:44:11.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.342 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:11.343 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:44:11.343 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:44:11.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.343 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:11.343 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:44:11.343 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:44:11.343 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.343 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:11.343 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.343 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:11.343 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:11.344 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 105.291641403, 2024-04-26T10:44:11.344 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:44:11.344 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:11.344 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.344 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:11.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.344 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:11.344 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:11.344 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.344 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:11.344 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:11.344 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.345 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:11.345 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:11.345 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.345 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:11.345 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:44:11.345 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:44:11.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.345 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:11.345 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:44:11.345 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:44:11.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.346 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:44:11.346 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:44:11.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.346 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:11.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:44:11.346 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:44:11.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.346 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:11.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:44:11.347 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:44:11.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.347 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:11.347 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:44:11.347 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:44:11.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.347 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:11.347 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:44:11.347 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:44:11.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.347 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:11.348 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:44:11.348 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:44:11.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.348 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:11.348 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:44:11.348 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:44:11.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.349 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:11.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:44:11.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:44:11.349 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.349 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:11.349 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.349 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:11.349 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:11.349 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 105.291563659, 2024-04-26T10:44:11.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:44:11.349 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:11.350 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.350 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:11.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.350 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:11.350 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:11.350 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.350 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:11.350 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:11.350 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.350 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:11.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:44:11.351 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:11.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:11.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:44:11.351 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:44:11.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:11.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:44:11.351 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:44:11.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:44:11.352 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:44:11.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:11.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:44:11.352 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:44:11.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:11.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:44:11.352 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:44:11.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.353 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:11.353 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:44:11.353 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:44:11.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.353 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:11.353 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:44:11.353 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:44:11.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.354 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:11.354 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:44:11.354 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:44:11.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.354 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:11.354 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:44:11.354 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:44:11.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:11.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:44:11.355 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:44:11.355 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.355 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:11.355 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.355 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:11.355 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:11.355 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 105.291524653, 2024-04-26T10:44:11.355 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:44:11.355 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:11.355 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.356 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:11.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:11.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:11.356 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:11.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:11.356 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:11.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:44:11.357 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:11.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.357 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:11.357 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:44:11.357 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:44:11.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.357 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:11.357 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:44:11.357 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:44:11.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.357 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:44:11.358 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:44:11.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.358 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:11.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:44:11.358 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:44:11.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.358 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:11.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:44:11.358 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:44:11.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.359 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:11.359 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:44:11.359 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:44:11.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.359 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:11.359 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:44:11.359 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:44:11.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.359 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:11.359 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:44:11.359 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:44:11.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:11.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:44:11.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:44:11.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:11.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:44:11.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:44:11.360 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.360 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:11.360 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.360 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:11.361 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:11.361 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 105.291505832, 2024-04-26T10:44:11.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:44:11.361 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:11.361 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.361 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:11.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:11.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:11.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:11.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:11.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:11.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:11.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:11.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:11.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:44:11.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:44:11.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:11.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:44:11.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:44:11.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:44:11.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:44:11.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:11.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:44:11.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:44:11.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.364 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:11.364 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:44:11.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:44:11.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.364 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:11.364 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:44:11.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:44:11.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.364 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:11.364 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:44:11.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:44:11.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:11.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:44:11.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:44:11.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:11.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:44:11.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:44:11.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:11.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:44:11.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:44:11.366 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.366 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:11.366 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.366 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:11.366 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:11.366 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 105.29147383, 2024-04-26T10:44:11.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:44:11.366 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:11.366 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.366 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:11.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:11.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:11.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:11.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:11.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:11.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:44:11.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:11.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:44:11.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:44:11.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:11.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:44:11.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:44:11.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:44:11.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:44:11.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:11.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:44:11.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:44:11.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:11.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:44:11.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:44:11.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:11.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:44:11.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:44:11.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:11.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:44:11.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:44:11.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:11.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:44:11.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:44:11.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:11.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:44:11.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:44:11.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:11.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:44:11.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:44:11.371 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.371 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:11.371 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.371 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:11.371 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:11.371 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 105.291265022, 2024-04-26T10:44:11.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:44:11.372 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:11.372 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.372 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:11.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:11.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:11.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:11.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:11.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:11.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:44:11.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:11.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:11.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:44:11.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:44:11.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:11.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:44:11.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:44:11.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:44:11.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:44:11.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:11.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:44:11.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:44:11.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:11.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:44:11.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:44:11.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:11.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:44:11.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:44:11.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:11.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:44:11.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:44:11.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:11.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:44:11.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:44:11.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:11.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:44:11.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:44:11.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:11.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:44:11.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:44:11.376 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.376 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:11.376 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.377 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:11.377 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:11.377 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 105.29123373100001, 2024-04-26T10:44:11.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:44:11.377 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:11.377 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:11.377 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:11.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:11.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:11.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:11.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:11.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:11.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:44:11.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:11.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:44:11.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:44:11.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:11.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:44:11.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:44:11.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:44:11.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:44:11.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:11.381 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:44:11.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:44:11.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:11.381 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:44:11.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:44:11.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:11.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:44:11.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:44:11.382 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.382 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:11.382 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.382 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:11.382 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:11.382 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 105.291206481, 2024-04-26T10:44:11.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:44:11.382 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:11.382 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:11.382 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:11.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:11.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:11.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:11.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:11.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:11.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:11.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:11.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:44:11.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:44:11.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:11.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:44:11.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:44:11.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:44:11.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:44:11.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:11.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:44:11.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:44:11.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:11.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:44:11.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:44:11.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.386 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:11.386 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:44:11.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:44:11.386 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.386 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:11.386 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.386 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:11.386 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:11.386 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 105.28842973, 2024-04-26T10:44:11.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:44:11.386 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:11.386 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:44:11.387 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:11.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:11.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:11.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:11.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:11.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:11.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:44:11.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:11.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:44:11.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:44:11.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:11.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:44:11.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:44:11.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:44:11.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:44:11.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:11.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:44:11.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:44:11.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:11.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:44:11.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:44:11.389 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.389 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:11.389 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.390 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:11.390 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:11.390 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 105.28837964100001, 2024-04-26T10:44:11.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:44:11.390 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:11.390 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.390 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:11.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:11.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:11.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:11.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:11.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:11.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:44:11.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:11.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:44:11.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:44:11.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:11.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:44:11.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:44:11.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:44:11.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:44:11.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:11.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:44:11.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:44:11.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:11.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:44:11.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:44:11.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:11.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:44:11.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:44:11.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:11.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:44:11.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:44:11.393 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.394 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:11.394 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.394 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:11.394 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:11.394 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 105.287487572, 2024-04-26T10:44:11.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:44:11.394 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:11.394 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.394 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:11.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:11.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:11.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:11.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:11.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:11.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:44:11.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:11.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:44:11.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:44:11.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:11.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:44:11.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:44:11.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:44:11.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:44:11.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:11.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:44:11.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:44:11.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.397 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:11.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:44:11.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:44:11.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.397 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:11.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:44:11.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:44:11.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.397 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:11.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:44:11.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:11.398 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.398 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:11.398 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.398 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:44:11.398 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:11.398 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 105.285299243, 2024-04-26T10:44:11.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:44:11.398 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:11.398 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.398 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:11.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:11.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:11.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:11.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:11.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:11.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:11.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:11.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:44:11.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:44:11.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:11.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:44:11.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:44:11.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:44:11.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:44:11.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:11.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:44:11.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:44:11.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:11.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:44:11.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:44:11.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:11.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:44:11.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:44:11.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:11.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:44:11.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:44:11.402 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.402 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:11.402 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.402 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:44:11.402 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:11.402 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 105.285163873, 2024-04-26T10:44:11.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:44:11.402 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:11.402 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.403 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:11.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:11.403 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:11.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:11.403 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:11.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:11.403 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:44:11.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:11.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:44:11.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:44:11.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:11.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:44:11.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:44:11.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:44:11.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:44:11.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.405 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:11.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:44:11.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:44:11.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.405 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:11.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:44:11.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:44:11.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.405 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:11.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:44:11.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:44:11.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:11.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:44:11.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:44:11.406 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.406 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:11.406 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.406 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:44:11.406 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:11.406 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 105.284949299, 2024-04-26T10:44:11.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:44:11.407 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:11.407 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.407 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:11.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:11.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:11.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:11.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:11.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:11.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:11.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:11.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:44:11.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:44:11.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:11.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:44:11.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:44:11.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.409 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.409 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:44:11.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:44:11.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.409 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:11.409 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:44:11.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:44:11.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.409 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:11.409 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:44:11.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:44:11.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.410 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:11.410 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:44:11.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:44:11.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.410 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:11.410 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:44:11.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:44:11.410 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.410 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:11.410 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.410 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:44:11.411 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:11.411 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 105.28461035799999, 2024-04-26T10:44:11.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:44:11.411 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:11.411 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.411 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:11.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:11.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:11.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:11.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:11.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:11.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:11.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:11.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:44:11.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:44:11.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:11.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:44:11.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:44:11.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:44:11.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:44:11.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:11.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:44:11.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:44:11.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:11.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:44:11.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:44:11.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.414 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:11.414 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:44:11.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:44:11.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.414 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:11.414 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:44:11.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:44:11.414 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.414 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:11.414 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.415 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:11.415 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:11.415 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 105.28450098099999, 2024-04-26T10:44:11.415 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:44:11.415 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:11.415 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:44:11.415 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:11.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.415 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:11.415 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:11.415 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:11.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:11.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:11.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:44:11.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:11.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:11.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:44:11.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:44:11.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:11.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:44:11.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:44:11.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:44:11.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:44:11.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:11.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:44:11.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:44:11.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.418 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:11.418 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:44:11.418 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:44:11.418 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.418 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:11.418 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.418 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:44:11.418 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:11.418 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 105.28446126199999, 2024-04-26T10:44:11.418 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:44:11.418 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:11.418 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.419 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:11.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.419 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:11.419 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:11.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.419 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:11.419 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:11.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.419 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:11.419 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:11.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:11.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:11.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:44:11.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:44:11.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:11.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:44:11.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:44:11.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:44:11.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:44:11.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.421 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:11.421 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:44:11.421 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:44:11.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.421 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:11.421 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:44:11.421 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:44:11.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.421 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:11.421 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:44:11.421 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:44:11.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:11.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:44:11.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:44:11.422 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.422 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:11.422 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.422 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:44:11.422 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:11.422 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 105.284123729, 2024-04-26T10:44:11.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:44:11.423 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:11.423 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.423 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:11.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.423 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:11.423 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:11.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.423 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:11.423 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:11.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:11.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.423 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:11.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:44:11.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:11.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:44:11.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:44:11.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:11.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:44:11.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:44:11.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:44:11.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:44:11.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:11.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:44:11.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:44:11.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:11.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:44:11.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:44:11.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:11.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:44:11.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:44:11.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:11.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:11.426 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:11.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:44:11.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:44:11.426 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.426 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:11.426 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.426 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:11.426 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:11.426 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:11.428 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:11.429 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:11.427+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:11.529 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:11.528+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:11.531 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:11.531 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:11.531 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:44:11.531 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:11.540 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:11.630 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:11.628+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:11.640 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:11.641 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:11.641 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:11.641 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:11.641 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:11.650 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:11.730 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:11.730+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:11.793 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:11.793 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:11.794 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:11.794 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:11.794 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.794 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:11.794 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:11.794 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 105.754999183, 2024-04-26T10:44:11.794 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:44:11.794 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:11.794 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.794 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:11.794 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.794 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:11.794 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:11.795 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.795 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.795 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.795 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:11.795 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:11.795 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.795 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.795 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.795 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:11.795 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:44:11.795 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.795 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.795 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.795 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:11.796 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:44:11.796 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:44:11.796 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.796 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.796 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:11.796 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:44:11.796 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:44:11.796 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.796 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.796 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.796 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:44:11.796 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:44:11.796 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.797 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.797 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:11.797 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:44:11.797 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:44:11.797 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.797 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.797 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:11.797 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:44:11.797 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:44:11.797 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.797 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.797 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:11.797 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:44:11.797 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:44:11.798 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.798 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.798 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:11.798 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:44:11.798 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:44:11.798 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.798 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:11.798 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.798 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.798 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.798 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:11.798 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:11.798 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 105.754128403, 2024-04-26T10:44:11.798 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:44:11.799 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:11.799 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.799 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:11.799 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.799 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:11.799 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:11.799 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.799 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.799 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.799 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:11.799 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:11.799 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.799 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.799 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.800 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:11.800 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:11.800 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.800 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.800 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.800 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:11.800 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:44:11.800 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:44:11.800 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.800 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.800 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:11.800 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:44:11.800 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:44:11.800 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.801 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.801 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.801 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:44:11.801 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:44:11.801 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.801 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.801 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:11.801 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:44:11.801 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:44:11.801 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.801 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.802 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:11.802 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:44:11.802 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:44:11.802 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.802 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.802 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:11.802 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:44:11.802 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:44:11.802 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.802 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.802 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:11.802 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:44:11.802 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:44:11.802 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.803 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:11.803 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.803 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.803 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.803 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:11.803 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:11.803 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 105.75314106, 2024-04-26T10:44:11.803 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:44:11.803 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:11.803 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.803 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:11.803 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.803 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:11.803 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:11.803 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.804 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.804 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.804 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:11.804 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:11.804 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.804 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.804 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.804 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:11.804 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:44:11.804 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:11.804 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.804 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.804 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:11.804 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:44:11.805 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:44:11.805 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.805 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.805 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:11.805 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:44:11.805 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:44:11.805 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.805 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.805 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.805 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:44:11.805 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:44:11.805 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.805 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.805 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:11.806 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:44:11.806 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:44:11.806 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.806 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.806 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:11.806 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:44:11.806 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:44:11.806 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.806 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.806 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:11.806 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:44:11.806 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:44:11.806 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.806 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.807 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:11.807 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:44:11.807 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:44:11.807 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.807 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:11.807 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.807 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.807 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.807 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:11.807 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:11.807 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 105.752935795, 2024-04-26T10:44:11.807 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:44:11.807 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:11.807 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.807 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:11.808 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.808 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:11.808 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:11.808 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.808 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.808 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.808 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:11.808 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:11.808 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.808 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.808 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.808 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:11.808 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:11.809 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.809 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.809 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.809 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:11.809 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:44:11.809 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:44:11.809 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.809 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.809 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:11.809 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:44:11.809 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:44:11.809 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.809 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.809 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.810 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:44:11.810 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:44:11.810 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.810 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.810 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:11.810 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:44:11.810 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:44:11.810 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.810 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.810 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:11.810 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:44:11.810 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:44:11.810 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.810 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.811 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:11.811 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:44:11.811 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:44:11.811 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.811 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.811 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:11.811 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:44:11.811 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:44:11.811 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.812 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:11.812 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.812 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.813 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.813 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:11.813 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:11.813 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 105.752614916, 2024-04-26T10:44:11.813 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:44:11.813 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:11.813 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.813 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:11.813 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.813 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:11.813 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:11.813 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.813 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.813 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.814 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:11.814 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:11.814 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.814 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.814 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.814 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:11.814 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:44:11.814 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:11.814 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.814 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.814 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:11.814 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:44:11.814 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:44:11.814 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.815 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.815 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:11.815 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:44:11.815 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:44:11.815 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.815 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.815 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.815 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:44:11.815 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:44:11.815 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.815 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.815 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:11.815 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:44:11.815 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:44:11.815 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.816 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.816 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:11.816 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:44:11.816 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:44:11.816 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.816 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.816 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:11.816 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:44:11.816 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:44:11.816 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.816 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.816 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:11.816 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:44:11.816 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:44:11.817 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.817 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.817 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:11.817 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:44:11.817 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:44:11.817 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.817 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.817 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:11.817 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:44:11.817 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:44:11.817 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.817 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.817 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:11.817 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:44:11.817 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:44:11.818 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.818 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:11.818 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.818 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.818 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.818 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:11.818 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:11.818 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 105.752563092, 2024-04-26T10:44:11.818 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:44:11.818 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:11.818 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.818 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:11.818 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.819 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:11.819 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:11.819 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.819 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.819 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.819 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:11.819 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:11.819 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.819 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.819 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.819 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:11.819 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:44:11.819 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.819 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.819 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.820 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:11.820 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:44:11.820 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:44:11.820 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.820 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.820 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:11.820 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:44:11.820 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:44:11.820 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.820 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.820 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.820 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:44:11.820 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:44:11.820 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.821 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.821 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:11.821 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:44:11.821 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:44:11.821 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.821 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.821 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:11.821 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:44:11.821 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:44:11.821 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.821 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.821 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:11.821 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:44:11.821 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:44:11.822 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.822 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.822 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:11.822 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:44:11.822 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:44:11.822 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.822 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.822 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:11.822 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:44:11.822 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:44:11.822 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.822 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.822 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:11.823 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:44:11.823 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:44:11.823 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.823 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.823 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:11.823 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:44:11.823 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:44:11.823 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.823 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:11.823 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.823 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.823 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.823 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:11.823 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:11.823 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 105.75250972000001, 2024-04-26T10:44:11.824 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:44:11.824 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:11.824 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.824 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:11.824 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.824 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:11.824 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:11.824 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.824 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.824 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.824 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:11.824 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:11.824 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.824 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.825 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.825 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:11.825 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:11.825 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.825 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.825 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.825 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:11.825 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:44:11.825 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:44:11.825 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.825 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.825 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:11.825 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:44:11.825 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:44:11.826 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.826 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.826 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.826 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:44:11.826 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:44:11.826 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.826 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.826 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:11.826 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:44:11.826 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:44:11.826 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.826 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.826 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:11.826 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:44:11.827 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:44:11.827 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.827 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.827 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:11.827 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:44:11.827 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:44:11.827 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.827 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.827 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:11.827 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:44:11.827 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:44:11.827 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.827 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.827 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:11.828 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:44:11.828 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:44:11.828 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.828 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.828 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:11.828 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:44:11.828 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:44:11.828 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.828 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.828 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:11.828 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:44:11.828 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:44:11.828 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.828 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:11.829 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.829 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.829 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.829 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:11.829 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:11.829 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 105.75246539299999, 2024-04-26T10:44:11.829 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:44:11.829 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:11.829 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.829 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:11.829 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.829 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:11.829 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:11.829 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.829 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.830 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.830 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:11.830 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:11.830 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.830 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.830 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.830 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:11.830 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:11.830 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:11.830 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.830 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.830 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:11.830 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:44:11.830 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:44:11.831 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.831 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.831 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:11.831 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:44:11.831 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:44:11.831 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.831 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.831 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.831 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:44:11.831 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:44:11.831 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.831 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.831 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:11.831 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:44:11.831 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:44:11.832 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.832 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.832 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:11.832 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:44:11.832 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:44:11.832 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.832 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.832 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:11.832 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:44:11.832 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:44:11.832 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.832 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.832 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:11.832 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:44:11.832 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:44:11.833 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.833 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.833 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:11.833 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:44:11.833 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:44:11.833 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.833 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.833 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:11.833 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:44:11.833 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:44:11.833 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.833 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.833 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:11.833 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:44:11.834 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:44:11.834 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.834 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:11.834 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.834 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.834 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.834 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:11.834 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:11.834 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 105.75244168, 2024-04-26T10:44:11.834 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:44:11.834 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:11.834 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.834 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:11.834 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.834 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:11.835 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:11.835 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.835 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.835 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.835 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:11.835 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:11.835 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.835 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.835 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.835 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:11.835 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:11.835 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.835 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.835 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.836 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:11.836 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:44:11.836 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:44:11.836 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.836 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.836 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:11.836 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:44:11.836 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:44:11.836 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.836 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.836 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.836 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:44:11.836 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:44:11.836 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.836 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.837 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:11.837 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:44:11.837 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:44:11.837 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.837 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.837 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:11.837 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:44:11.837 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:44:11.837 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.837 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.837 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:11.837 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:44:11.837 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:44:11.837 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.837 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.838 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:11.838 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:44:11.838 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:44:11.838 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.838 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.838 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:11.838 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:44:11.838 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:44:11.838 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.838 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.838 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:11.838 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:44:11.838 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:44:11.839 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.839 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.839 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:11.839 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:44:11.839 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:44:11.839 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.839 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:11.839 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.839 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.839 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.839 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:11.839 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:11.839 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 105.752407375, 2024-04-26T10:44:11.839 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:44:11.839 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:11.840 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.840 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:11.840 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.840 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:11.840 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:11.840 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.840 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.840 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.840 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:11.840 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:11.840 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.840 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.840 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.840 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:11.841 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:44:11.841 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.841 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.841 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.841 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:11.841 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:44:11.841 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:44:11.841 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.841 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.841 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:11.841 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:44:11.841 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:44:11.841 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.841 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.841 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.842 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:44:11.842 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:44:11.842 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.842 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.842 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:11.842 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:44:11.842 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:44:11.842 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.842 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.842 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:11.842 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:44:11.842 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:44:11.842 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.842 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.843 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:11.843 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:44:11.843 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:44:11.843 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.843 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.843 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:11.843 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:44:11.843 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:44:11.843 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.843 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.843 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:11.843 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:44:11.843 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:44:11.843 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.843 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.844 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:11.844 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:44:11.844 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:44:11.844 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.844 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.844 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:11.844 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:44:11.844 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:44:11.844 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.844 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:11.844 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.844 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.844 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.844 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:11.844 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:11.845 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 105.75207077899999, 2024-04-26T10:44:11.845 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:44:11.845 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:11.845 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:11.845 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:11.845 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.845 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:11.845 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:11.845 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.845 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.845 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.845 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:11.845 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:11.845 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.845 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.846 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.846 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:11.846 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:44:11.846 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:11.846 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.846 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.846 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:11.846 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:44:11.846 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:44:11.846 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.846 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.846 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:11.846 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:44:11.846 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:44:11.847 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.847 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.847 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.847 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:44:11.847 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:44:11.847 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.847 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.847 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:11.847 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:44:11.847 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:44:11.847 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.847 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.847 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:11.847 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:44:11.847 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:44:11.848 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.848 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.848 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:11.848 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:44:11.848 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:44:11.848 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.848 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:11.848 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.848 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.848 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.848 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:11.848 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:11.848 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 105.752028751, 2024-04-26T10:44:11.848 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:44:11.848 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:11.849 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:11.849 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:11.849 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.849 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:11.849 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:11.849 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.849 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.849 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.849 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:11.849 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:11.849 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.849 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.849 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.849 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:11.850 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:11.850 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.850 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.850 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.850 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:11.850 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:44:11.850 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:44:11.850 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.850 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.850 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:11.850 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:44:11.850 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:44:11.850 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.850 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.851 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.851 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:44:11.851 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:44:11.851 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.851 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.851 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:11.851 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:44:11.851 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:44:11.851 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.851 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.851 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:11.851 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:44:11.851 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:44:11.851 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.851 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.852 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:11.852 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:44:11.852 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:44:11.852 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.852 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:11.852 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.852 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.852 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.852 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:11.852 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:11.852 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 105.751975579, 2024-04-26T10:44:11.852 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:44:11.852 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:11.852 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:11.852 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:11.853 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.853 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:11.853 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:11.853 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.853 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.853 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.853 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:11.853 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:11.853 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.853 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.853 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.853 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:11.853 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:11.853 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.854 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.854 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.854 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:11.854 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:44:11.854 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:44:11.854 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.854 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.854 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:11.854 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:44:11.854 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:44:11.854 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.854 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.854 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.854 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:44:11.854 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:44:11.855 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.855 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.855 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:11.855 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:44:11.855 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:44:11.855 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.855 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.855 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:11.855 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:44:11.855 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:44:11.855 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.855 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.855 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:11.855 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:44:11.856 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:44:11.856 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.856 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:11.856 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.856 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.856 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.856 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:11.856 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:11.856 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 105.74856916900001, 2024-04-26T10:44:11.856 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:44:11.856 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:11.856 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:44:11.856 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:11.856 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.856 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:11.857 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:11.857 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.857 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.857 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.857 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:11.857 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:11.857 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.857 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.857 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.857 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:11.857 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:44:11.857 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.857 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.857 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.857 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:11.857 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:44:11.858 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:44:11.858 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.858 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.858 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:11.858 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:44:11.858 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:44:11.858 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.858 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.858 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.858 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:44:11.858 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:44:11.858 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.858 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.858 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:11.859 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:44:11.859 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:44:11.859 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.859 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.859 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:11.859 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:44:11.859 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:44:11.859 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.859 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:11.859 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.859 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.859 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.859 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:44:11.859 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:44:11.859 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 105.746097216, 2024-04-26T10:44:11.860 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:44:11.860 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:11.860 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:11.860 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:11.860 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.860 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:11.860 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:44:11.860 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.860 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.860 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.860 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:11.860 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:44:11.860 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.860 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.860 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.861 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:11.861 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:44:11.861 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.861 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.861 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.861 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:11.861 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:44:11.861 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:44:11.861 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.861 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.861 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:11.861 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:44:11.861 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:44:11.861 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.861 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.862 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.862 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:44:11.862 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:44:11.862 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.862 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.862 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:11.862 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:44:11.862 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:44:11.862 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.862 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.862 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:11.862 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:44:11.862 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:44:11.862 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.863 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.863 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:11.863 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:44:11.863 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:44:11.863 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.863 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:11.863 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.863 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.863 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.863 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:44:11.863 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:11.863 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 105.745443658, 2024-04-26T10:44:11.864 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:44:11.864 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:11.864 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:11.864 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:11.864 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.864 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:11.864 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:11.864 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.864 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.864 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.864 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:11.864 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:11.864 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.864 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.864 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.865 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:11.865 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:11.865 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.865 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.865 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.865 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:11.865 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:44:11.865 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:44:11.865 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.865 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.865 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:11.865 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:44:11.865 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:44:11.865 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.866 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.866 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.866 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:44:11.866 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:44:11.866 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.866 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.866 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:11.866 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:44:11.866 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:44:11.866 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.866 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.866 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:11.866 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:44:11.866 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:44:11.866 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.867 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.867 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:11.867 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:44:11.867 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:44:11.867 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.867 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:11.867 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.867 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.867 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.867 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:44:11.867 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:11.867 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 105.74536787300001, 2024-04-26T10:44:11.867 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:44:11.867 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:11.867 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:11.868 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:11.868 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.868 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:11.868 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:11.868 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.868 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.868 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.868 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:11.868 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:11.868 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.868 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.868 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.868 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:11.868 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:11.869 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.869 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.869 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.869 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:11.869 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:44:11.869 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:44:11.869 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.869 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.869 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:11.869 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:44:11.869 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:44:11.869 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.869 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.869 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.870 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:44:11.870 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:44:11.870 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.870 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.870 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:11.870 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:44:11.870 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:44:11.870 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.870 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.870 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:11.870 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:44:11.870 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:44:11.870 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.870 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.871 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:11.871 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:44:11.871 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:44:11.871 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.871 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:11.871 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.871 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.871 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.871 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:44:11.871 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:44:11.871 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 105.745154179, 2024-04-26T10:44:11.871 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:44:11.871 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:11.871 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:44:11.872 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:11.872 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.872 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:11.872 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:44:11.872 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.872 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.872 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.872 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:11.872 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:44:11.872 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.872 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.872 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.872 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:11.872 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:44:11.873 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:11.873 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.873 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.873 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:11.873 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:44:11.873 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:44:11.873 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.873 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.873 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:11.873 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:44:11.873 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:44:11.873 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.873 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.873 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.874 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:44:11.874 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:44:11.874 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.874 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.874 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:11.874 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:44:11.874 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:44:11.874 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.874 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.874 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:11.874 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:44:11.874 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:44:11.874 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.874 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:11.874 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.875 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.875 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.875 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:44:11.875 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:44:11.875 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 105.742710366, 2024-04-26T10:44:11.875 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:44:11.875 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:11.875 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:11.875 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:11.875 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.875 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:11.875 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:44:11.875 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.875 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.876 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.876 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:11.876 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:44:11.876 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.876 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.876 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.876 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:11.876 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:44:11.876 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:44:11.876 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.876 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.876 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:11.876 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:44:11.877 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:44:11.877 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.877 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.877 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:11.877 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:44:11.877 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:44:11.877 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.877 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.877 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.877 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:44:11.877 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:44:11.877 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.877 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.877 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:11.877 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:44:11.878 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:44:11.878 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.878 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.878 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:11.878 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:44:11.878 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:44:11.878 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.878 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.878 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:11.878 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:44:11.878 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:44:11.878 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.878 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:11.878 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.879 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.879 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.879 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:44:11.879 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:11.879 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 100.292647922, 2024-04-26T10:44:11.879 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:44:11.879 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:11.879 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:11.879 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:11.879 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.879 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:11.879 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:11.879 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.879 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.880 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.880 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:11.880 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:11.880 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:11.880 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.880 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.880 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:11.880 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:44:11.880 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:11.880 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.880 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.880 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:11.880 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:44:11.880 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:44:11.880 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.881 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.881 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:11.881 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:44:11.881 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:44:11.881 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.881 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.881 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:11.881 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:44:11.881 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:44:11.881 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.881 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.881 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:11.881 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:44:11.881 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:44:11.881 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.882 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.882 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:11.882 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:44:11.882 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:44:11.882 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.882 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.882 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:11.882 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:44:11.882 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:44:11.882 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.882 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.882 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:11.882 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:44:11.882 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:44:11.883 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.883 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.883 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:11.883 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:44:11.883 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:44:11.883 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.883 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.883 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:11.883 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:44:11.883 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:44:11.883 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:11.883 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:11.883 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:11.883 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:44:11.883 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:44:11.884 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.884 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:11.884 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.884 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:11.884 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:11.884 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:11.885 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:11.884+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:11.886 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:11.985 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:11.985+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:11.997 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:11.997 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:11.997 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:44:11.997 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:12.006 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:12.090 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:12.089+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:12.152 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:12.152 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:12.152 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:12.152 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:12.152 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:12.161 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:12.202 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:12.201+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:12.288 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:12.288+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:12.308 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:12.308 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:12.308 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:12.308 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:12.309 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.309 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:12.309 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:12.309 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 106.27053411999999, 2024-04-26T10:44:12.309 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:44:12.309 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:12.309 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.309 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:12.309 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.309 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:12.309 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:12.309 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.309 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.309 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.310 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:12.310 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:12.310 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.310 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.310 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.310 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:12.310 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:12.310 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.310 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.310 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.310 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:12.310 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:44:12.310 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:44:12.311 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.311 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.311 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:12.311 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:44:12.311 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:44:12.311 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.311 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.311 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.311 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:44:12.311 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:44:12.311 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.311 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.311 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:12.311 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:44:12.312 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:44:12.312 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.312 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.312 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:12.312 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:44:12.312 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:44:12.312 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.312 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.312 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:12.312 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:44:12.312 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:44:12.312 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.312 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.312 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:12.313 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:44:12.313 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:44:12.313 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.313 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:12.313 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.313 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.313 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.313 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:12.313 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:12.313 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 106.26878399899999, 2024-04-26T10:44:12.313 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:44:12.313 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:12.313 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.313 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:12.314 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.314 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:12.314 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:12.314 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.314 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.314 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:12.314 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:12.314 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.314 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.314 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:12.314 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:44:12.315 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:12.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.315 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:12.315 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:44:12.315 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:44:12.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.315 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:12.315 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:44:12.315 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:44:12.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.315 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.316 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:44:12.316 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:44:12.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.316 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.316 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:12.316 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:44:12.316 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:44:12.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.316 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.316 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:12.316 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:44:12.316 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:44:12.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.317 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.317 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:12.317 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:44:12.317 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:44:12.317 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.317 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.317 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:12.317 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:44:12.317 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:44:12.317 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.317 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.317 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:12.317 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:44:12.317 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:44:12.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.318 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.318 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:12.318 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:44:12.318 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:44:12.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.318 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.318 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:12.318 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:44:12.318 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:44:12.318 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.318 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:12.318 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.319 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.319 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:12.319 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:12.319 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 106.26873100100001, 2024-04-26T10:44:12.319 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:44:12.319 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:12.319 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.319 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:12.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.319 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:12.319 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:12.319 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.319 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.320 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:12.320 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:12.320 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.320 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.320 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.320 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:12.320 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:12.320 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.320 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.320 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.320 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:12.320 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:44:12.320 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:44:12.321 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.321 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.321 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:12.321 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:44:12.321 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:44:12.321 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.321 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.321 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.321 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:44:12.321 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:44:12.321 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.321 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.321 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:12.321 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:44:12.322 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:44:12.322 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.322 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.322 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:12.322 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:44:12.322 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:44:12.322 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.322 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.322 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:12.322 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:44:12.322 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:44:12.322 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.322 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.323 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:12.323 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:44:12.323 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:44:12.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.323 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.323 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:12.323 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:44:12.323 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:44:12.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.323 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.323 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:12.323 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:44:12.323 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:44:12.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.323 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.324 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:12.324 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:44:12.324 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:44:12.324 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.324 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:12.324 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.324 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.324 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.324 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:12.324 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:12.324 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 106.268653257, 2024-04-26T10:44:12.324 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:44:12.324 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:12.324 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.325 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:12.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.325 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:12.325 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:12.325 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.325 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.325 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:12.325 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:12.325 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.325 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.325 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:12.325 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:44:12.326 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:12.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.326 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.326 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:12.326 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:44:12.326 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:44:12.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.326 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.326 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:12.326 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:44:12.326 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:44:12.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.326 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.327 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.327 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:44:12.327 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:44:12.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.327 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.327 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:12.327 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:44:12.327 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:44:12.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.327 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.327 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:12.327 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:44:12.327 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:44:12.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.328 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.328 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:12.328 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:44:12.328 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:44:12.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.328 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.328 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:12.328 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:44:12.328 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:44:12.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.328 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.328 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:12.328 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:44:12.328 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:44:12.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.329 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:12.329 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:44:12.329 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:44:12.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.329 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:12.329 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:44:12.329 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:44:12.329 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.329 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:12.329 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.330 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.330 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:12.330 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:12.330 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 106.268614251, 2024-04-26T10:44:12.330 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:44:12.330 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:12.330 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.330 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:12.330 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.330 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:12.330 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:12.330 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.330 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.331 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:12.331 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:12.331 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.331 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:12.331 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:44:12.331 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:12.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.331 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:12.331 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:44:12.331 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:44:12.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.332 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:12.332 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:44:12.332 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:44:12.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.332 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.332 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:44:12.332 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:44:12.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.332 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:12.332 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:44:12.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:44:12.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.333 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:12.333 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:44:12.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:44:12.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.333 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:12.333 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:44:12.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:44:12.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.333 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:12.334 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:44:12.334 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:44:12.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.334 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:12.334 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:44:12.334 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:44:12.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.334 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:12.334 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:44:12.334 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:44:12.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.335 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:12.335 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:44:12.335 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:44:12.335 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.335 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:12.335 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.335 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:12.335 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:12.335 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 106.26859543, 2024-04-26T10:44:12.335 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:44:12.335 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:12.335 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.336 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:12.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.336 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:12.336 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:12.336 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.336 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:12.336 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:12.337 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.337 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:12.337 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:12.337 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:12.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.337 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:12.337 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:44:12.337 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:44:12.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.338 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:12.338 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:44:12.338 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:44:12.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.338 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.338 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.338 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:44:12.338 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:44:12.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.338 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.338 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:12.338 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:44:12.338 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:44:12.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.339 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:12.339 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:44:12.339 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:44:12.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.339 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:12.339 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:44:12.339 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:44:12.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.339 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:12.339 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:44:12.340 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:44:12.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.340 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:12.340 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:44:12.340 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:44:12.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.340 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:12.340 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:44:12.340 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:44:12.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.341 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:12.341 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:44:12.341 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:44:12.341 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.341 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:12.341 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.341 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:12.341 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:12.341 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 106.26856342799999, 2024-04-26T10:44:12.341 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:44:12.341 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:12.341 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.342 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:12.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.342 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:12.342 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:12.342 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.342 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:12.342 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:12.342 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.342 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:12.342 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:44:12.343 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.343 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:12.343 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:44:12.343 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:44:12.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.343 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:12.343 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:44:12.343 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:44:12.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.344 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.344 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:44:12.344 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:44:12.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.344 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:12.344 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:44:12.344 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:44:12.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.344 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:12.344 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:44:12.344 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:44:12.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.345 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:12.345 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:44:12.345 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:44:12.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.345 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:12.345 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:44:12.345 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:44:12.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.345 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:12.345 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:44:12.345 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:44:12.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.346 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:12.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:44:12.346 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:44:12.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.346 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:12.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:44:12.346 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:44:12.346 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.346 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:12.346 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.347 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:12.347 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:12.347 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 106.26835462, 2024-04-26T10:44:12.347 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:44:12.347 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:12.347 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.347 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:12.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.347 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:12.347 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:12.347 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.348 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:12.348 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:12.348 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.348 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:12.348 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:44:12.348 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:12.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.348 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:12.348 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:44:12.348 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:44:12.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.349 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:12.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:44:12.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:44:12.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.349 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:44:12.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:44:12.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.349 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:12.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:44:12.350 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:44:12.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.350 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:12.350 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:44:12.350 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:44:12.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.350 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:12.350 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:44:12.350 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:44:12.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:12.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:44:12.351 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:44:12.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:12.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:44:12.351 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:44:12.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:12.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:44:12.351 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:44:12.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:12.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:44:12.352 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:44:12.352 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.352 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:12.352 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.352 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:12.352 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:12.352 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 106.268323329, 2024-04-26T10:44:12.352 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:44:12.352 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:12.353 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:12.353 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:12.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.353 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:12.353 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:12.353 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.353 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:12.353 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:12.353 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.353 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:12.354 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:44:12.354 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.354 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:12.354 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:44:12.354 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:44:12.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.354 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:12.354 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:44:12.354 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:44:12.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:44:12.355 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:44:12.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:12.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:44:12.355 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:44:12.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:12.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:44:12.355 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:44:12.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:12.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:44:12.356 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:44:12.356 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.356 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:12.356 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.356 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:12.356 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:12.356 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 106.268296079, 2024-04-26T10:44:12.356 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:44:12.356 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:12.357 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:12.357 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:12.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.357 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:12.357 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:12.357 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.357 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:12.357 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:12.357 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.357 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:12.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:12.358 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.358 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:12.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:44:12.358 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:44:12.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.358 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:12.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:44:12.358 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:44:12.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.359 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.359 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:44:12.359 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:44:12.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.359 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:12.359 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:44:12.359 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:44:12.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.359 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:12.359 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:44:12.359 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:44:12.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:12.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:44:12.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:44:12.360 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.360 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:12.360 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.360 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:12.360 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:12.360 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 106.265519328, 2024-04-26T10:44:12.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:44:12.361 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:12.361 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:44:12.361 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:12.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:12.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:12.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:12.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:12.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:12.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:44:12.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:12.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:44:12.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:44:12.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:12.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:44:12.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:44:12.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:44:12.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:44:12.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:12.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:44:12.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:44:12.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:12.364 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:44:12.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:44:12.364 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.364 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:12.364 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.364 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:12.364 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:12.364 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 106.265469239, 2024-04-26T10:44:12.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:44:12.364 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:12.364 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.364 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:12.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:12.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:12.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:12.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:12.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:12.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:44:12.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:12.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:44:12.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:44:12.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:12.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:44:12.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:44:12.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:44:12.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:44:12.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:12.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:44:12.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:44:12.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:12.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:44:12.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:44:12.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:12.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:44:12.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:44:12.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:12.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:44:12.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:44:12.368 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.368 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:12.368 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.369 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:12.369 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:12.369 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 106.26457717, 2024-04-26T10:44:12.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:44:12.369 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:12.369 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.369 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:12.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:12.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:12.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:12.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:12.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:12.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:44:12.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:12.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:44:12.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:44:12.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:12.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:44:12.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:44:12.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:44:12.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:44:12.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:12.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:44:12.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:44:12.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:12.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:44:12.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:44:12.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:12.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:44:12.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:44:12.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:12.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:44:12.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:12.373 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.373 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:12.373 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.373 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:44:12.373 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:12.373 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 106.262388841, 2024-04-26T10:44:12.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:44:12.373 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:12.373 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.373 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:12.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:12.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:12.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:12.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:12.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:12.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:12.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:12.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:44:12.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:44:12.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:12.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:44:12.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:44:12.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:44:12.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:44:12.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:12.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:44:12.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:44:12.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:12.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:44:12.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:44:12.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:12.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:44:12.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:44:12.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:12.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:44:12.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:44:12.377 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.377 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:12.377 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.377 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:44:12.377 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:12.377 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 106.26225347099999, 2024-04-26T10:44:12.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:44:12.377 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:12.377 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.378 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:12.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:12.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:12.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:12.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:12.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:12.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:44:12.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:12.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:44:12.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:44:12.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:12.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:44:12.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:44:12.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.380 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:44:12.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:44:12.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.380 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:12.380 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:44:12.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:44:12.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.380 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:12.380 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:44:12.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:44:12.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:12.381 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:44:12.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:44:12.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:12.381 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:44:12.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:44:12.381 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.381 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:12.381 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.381 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:44:12.382 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:12.382 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 106.262038897, 2024-04-26T10:44:12.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:44:12.382 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:12.382 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.382 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:12.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:12.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:12.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:12.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:12.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:12.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:12.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:12.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:44:12.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:44:12.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:12.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:44:12.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:44:12.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:44:12.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:44:12.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:12.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:44:12.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:44:12.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:12.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:44:12.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:44:12.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:12.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:44:12.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:44:12.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:12.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:44:12.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:44:12.385 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.386 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:12.386 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.386 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:44:12.386 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:12.386 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 106.261699956, 2024-04-26T10:44:12.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:44:12.386 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:12.386 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.386 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:12.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.386 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:12.386 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:12.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:12.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:12.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:12.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:12.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:12.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:44:12.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:44:12.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:12.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:44:12.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:44:12.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:44:12.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:44:12.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:12.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:44:12.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:44:12.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:12.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:44:12.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:44:12.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:12.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:44:12.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:44:12.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:12.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:44:12.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:44:12.390 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.390 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:12.390 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.390 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:12.390 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:12.390 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 106.261590579, 2024-04-26T10:44:12.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:44:12.390 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:12.390 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:44:12.391 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:12.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:12.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:12.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:12.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:12.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:12.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:44:12.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:12.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:12.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:44:12.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:44:12.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:12.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:44:12.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:44:12.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:44:12.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:44:12.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:12.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:44:12.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:44:12.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:12.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:44:12.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:44:12.393 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.393 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:12.393 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.394 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:44:12.394 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:12.394 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 106.26155086, 2024-04-26T10:44:12.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:44:12.394 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:12.394 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.394 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:12.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:12.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:12.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:12.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:12.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:12.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:12.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:12.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:12.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:44:12.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:44:12.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.397 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:12.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:44:12.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:44:12.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:44:12.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:44:12.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:12.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:44:12.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:44:12.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:12.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:44:12.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:44:12.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:12.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:44:12.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:44:12.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:12.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:44:12.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:44:12.399 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.400 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:12.400 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.400 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:44:12.400 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:12.400 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 106.26121332699999, 2024-04-26T10:44:12.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:44:12.400 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:12.400 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.400 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:12.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:12.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:12.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:12.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:12.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:12.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:12.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:44:12.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:12.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:44:12.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:44:12.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:12.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:44:12.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:44:12.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:44:12.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:44:12.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:12.403 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:44:12.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:44:12.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:12.403 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:44:12.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:44:12.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:12.403 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:44:12.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:44:12.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:12.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:12.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:12.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:44:12.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:44:12.404 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.404 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:12.404 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.404 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:12.404 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:12.404 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:12.404 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:44:12.406 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:12.407 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:12.405+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:12.507 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:12.506+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:12.511 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:12.511 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:12.511 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:44:12.511 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:12.520 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:12.608 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:12.608+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:12.662 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:12.662 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:12.662 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:12.662 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:12.662 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:12.671 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:12.716 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:12.715+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:12.774 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:12.775 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:12.775 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:12.775 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:12.775 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.775 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:12.775 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:12.775 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 106.73604526299999, 2024-04-26T10:44:12.775 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:44:12.775 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:12.775 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.775 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:12.775 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.775 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:12.775 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:12.776 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.776 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.776 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.776 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:12.776 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:12.776 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.776 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.776 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.776 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:12.776 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:44:12.776 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.776 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.776 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.776 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:12.777 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:44:12.777 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:44:12.777 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.777 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.777 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:12.777 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:44:12.777 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:44:12.777 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.777 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.777 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.777 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:44:12.777 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:44:12.777 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.777 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.778 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:12.778 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:44:12.778 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:44:12.778 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.778 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.778 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:12.778 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:44:12.778 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:44:12.778 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.778 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.778 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:12.778 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:44:12.778 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:44:12.778 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.779 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.779 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:12.779 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:44:12.779 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:44:12.779 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.779 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:12.779 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.779 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.779 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.779 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:12.779 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:12.779 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 106.73517448299999, 2024-04-26T10:44:12.779 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:44:12.779 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:12.779 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.780 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:12.780 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.780 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:12.780 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:12.780 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.780 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.780 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.780 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:12.780 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:12.780 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.780 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.780 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.780 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:12.780 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:12.780 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.781 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.781 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.781 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:12.781 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:44:12.781 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:44:12.781 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.781 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.781 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:12.781 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:44:12.781 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:44:12.781 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.781 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.781 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.781 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:44:12.781 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:44:12.782 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.782 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.782 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:12.782 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:44:12.782 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:44:12.782 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.782 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.782 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:12.782 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:44:12.782 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:44:12.782 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.782 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.782 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:12.782 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:44:12.783 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:44:12.783 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.783 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.783 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:12.783 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:44:12.783 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:44:12.783 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.783 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:12.783 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.783 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.783 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.783 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:12.783 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:12.783 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 106.73418714, 2024-04-26T10:44:12.783 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:44:12.784 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:12.784 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.784 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:12.784 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.784 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:12.784 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:12.784 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.784 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.784 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.784 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:12.784 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:12.784 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.784 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.784 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.784 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:12.784 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:44:12.785 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:12.785 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.785 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.785 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:12.785 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:44:12.785 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:44:12.785 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.785 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.785 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:12.785 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:44:12.785 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:44:12.785 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.785 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.785 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.786 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:44:12.786 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:44:12.786 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.786 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.786 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:12.786 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:44:12.786 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:44:12.786 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.786 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.786 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:12.786 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:44:12.786 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:44:12.786 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.786 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.787 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:12.787 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:44:12.787 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:44:12.787 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.787 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.787 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:12.787 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:44:12.787 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:44:12.787 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.787 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:12.787 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.787 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.787 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.787 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:12.787 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:12.787 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 106.733981875, 2024-04-26T10:44:12.788 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010741710000000001, 2024-04-26T10:44:12.788 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:12.788 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.788 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:12.788 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.788 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:12.788 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:12.788 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.788 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.788 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.788 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:12.788 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:12.788 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.788 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.789 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.789 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:12.789 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038596+0000", 2024-04-26T10:44:12.789 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.789 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.789 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.789 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:12.789 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038606+0000", 2024-04-26T10:44:12.789 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0137e-05 2024-04-26T10:44:12.789 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.789 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.789 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:12.789 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038615+0000", 2024-04-26T10:44:12.789 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:44:12.789 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.790 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.790 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.790 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038623+0000", 2024-04-26T10:44:12.790 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:44:12.790 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.790 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.790 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:12.790 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038691+0000", 2024-04-26T10:44:12.790 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7398999999999996e-05 2024-04-26T10:44:12.790 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.790 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.790 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:12.790 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038714+0000", 2024-04-26T10:44:12.790 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:44:12.791 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.791 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.791 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:12.791 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039651+0000", 2024-04-26T10:44:12.791 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00093687399999999998 2024-04-26T10:44:12.791 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.791 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.791 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:12.791 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039670+0000", 2024-04-26T10:44:12.791 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9414000000000001e-05 2024-04-26T10:44:12.791 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.791 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:12.791 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.791 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.792 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.792 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:12.792 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:12.792 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 106.733660996, 2024-04-26T10:44:12.792 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:44:12.792 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:12.792 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.792 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:12.792 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.792 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:12.792 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:12.792 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.792 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.792 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.792 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:12.793 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:12.793 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.793 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.793 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.793 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:12.793 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:44:12.793 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:12.793 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.793 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.793 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:12.793 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:44:12.793 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:44:12.793 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.793 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.793 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:12.794 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:44:12.794 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:44:12.794 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.794 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.794 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.794 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:44:12.794 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:44:12.794 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.794 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.794 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:12.794 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:44:12.794 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:44:12.794 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.795 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.795 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:12.795 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:44:12.795 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:44:12.795 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.795 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.795 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:12.795 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:44:12.795 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:44:12.795 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.795 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.795 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:12.795 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:44:12.795 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:44:12.795 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.796 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.796 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:12.796 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:44:12.796 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:44:12.796 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.796 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.796 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:12.796 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:44:12.796 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:44:12.796 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.796 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.796 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:12.796 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:44:12.797 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:44:12.797 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.797 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:12.797 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.797 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.797 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.797 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:12.797 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:12.797 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 106.733609172, 2024-04-26T10:44:12.797 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:44:12.797 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:12.797 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.797 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:12.797 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.797 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:12.798 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:12.798 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.798 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.798 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.798 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:12.798 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:12.798 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.798 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.798 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.798 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:12.798 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:44:12.798 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.798 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.798 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.799 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:12.799 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:44:12.799 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:44:12.799 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.799 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.799 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:12.799 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:44:12.799 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:44:12.799 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.799 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.799 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.799 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:44:12.799 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:44:12.799 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.800 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.800 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:12.800 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:44:12.800 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:44:12.800 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.800 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.800 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:12.800 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:44:12.800 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:44:12.800 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.800 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.800 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:12.800 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:44:12.800 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:44:12.800 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.801 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.801 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:12.801 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:44:12.801 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:44:12.801 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.801 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.801 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:12.801 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:44:12.801 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:44:12.801 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.801 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.801 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:12.801 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:44:12.801 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:44:12.801 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.802 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.802 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:12.802 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:44:12.802 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:44:12.802 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.802 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:12.802 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.802 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.802 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.802 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:12.802 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:12.802 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 106.7335558, 2024-04-26T10:44:12.802 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:44:12.802 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:12.803 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.803 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:12.803 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.803 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:12.803 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:12.803 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.803 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.803 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.803 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:12.803 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:12.803 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.803 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.803 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.803 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:12.804 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:12.804 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.804 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.804 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.804 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:12.804 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:44:12.804 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:44:12.804 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.804 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.804 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:12.804 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:44:12.804 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:44:12.804 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.804 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.804 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.805 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:44:12.805 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:44:12.805 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.805 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.805 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:12.805 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:44:12.805 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:44:12.805 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.805 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.805 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:12.805 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:44:12.805 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:44:12.805 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.805 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.805 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:12.806 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:44:12.806 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:44:12.806 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.806 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.806 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:12.806 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:44:12.806 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:44:12.806 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.806 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.806 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:12.806 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:44:12.806 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:44:12.806 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.807 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.807 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:12.807 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:44:12.807 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:44:12.807 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.807 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.807 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:12.807 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:44:12.807 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:44:12.807 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.807 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:12.807 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.807 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.807 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.808 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:12.808 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:12.808 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 106.73351147299999, 2024-04-26T10:44:12.808 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:44:12.808 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:12.808 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.808 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:12.808 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.808 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:12.808 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:12.808 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.808 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.808 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.808 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:12.808 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:12.809 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.809 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.809 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.809 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:12.809 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:12.809 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:12.809 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.809 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.809 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:12.809 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:44:12.809 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:44:12.809 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.809 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.809 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:12.809 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:44:12.810 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:44:12.810 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.810 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.810 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.810 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:44:12.810 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:44:12.810 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.810 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.810 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:12.810 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:44:12.810 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:44:12.810 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.810 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.811 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:12.811 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:44:12.811 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:44:12.811 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.811 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.811 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:12.811 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:44:12.811 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:44:12.811 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.811 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.811 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:12.811 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:44:12.811 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:44:12.811 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.812 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.812 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:12.812 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:44:12.812 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:44:12.812 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.812 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.812 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:12.812 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:44:12.812 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:44:12.812 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.812 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.812 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:12.812 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:44:12.812 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:44:12.813 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.813 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:12.813 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.813 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.813 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.813 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:12.813 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:12.813 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 106.73348776, 2024-04-26T10:44:12.813 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:44:12.813 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:12.813 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.813 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:12.813 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.813 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:12.813 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:12.814 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.814 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.814 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.814 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:12.814 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:12.814 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.814 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.814 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.814 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:12.814 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:12.814 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.814 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.814 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.814 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:12.815 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:44:12.815 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:44:12.815 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.815 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.815 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:12.815 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:44:12.815 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:44:12.815 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.815 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.815 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.815 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:44:12.815 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:44:12.815 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.815 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.816 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:12.816 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:44:12.816 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:44:12.816 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.816 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.816 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:12.816 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:44:12.816 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:44:12.816 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.816 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.816 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:12.816 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:44:12.816 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:44:12.816 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.816 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.817 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:12.817 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:44:12.817 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:44:12.817 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.817 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.817 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:12.817 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:44:12.817 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:44:12.817 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.817 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.817 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:12.817 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:44:12.817 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:44:12.817 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.817 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.818 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:12.818 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:44:12.818 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:44:12.818 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.818 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:12.818 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.818 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.818 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.818 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:12.818 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:12.818 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 106.733453455, 2024-04-26T10:44:12.818 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:44:12.818 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:12.819 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.819 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:12.819 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.819 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:12.819 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:12.819 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.819 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.819 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.819 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:12.819 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:12.819 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.819 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.819 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.819 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:12.820 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:44:12.820 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.820 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.820 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.820 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:12.820 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:44:12.820 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:44:12.820 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.820 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.820 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:12.820 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:44:12.820 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:44:12.820 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.820 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.821 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.821 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:44:12.821 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:44:12.821 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.821 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.821 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:12.821 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:44:12.821 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:44:12.821 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.821 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.821 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:12.821 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:44:12.821 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:44:12.821 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.822 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.822 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:12.822 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:44:12.822 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:44:12.822 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.822 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.822 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:12.822 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:44:12.822 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:44:12.822 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.822 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.822 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:12.822 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:44:12.822 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:44:12.823 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.823 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.823 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:12.823 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:44:12.823 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:44:12.823 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.823 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.823 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:12.823 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:44:12.823 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:44:12.823 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.823 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:12.823 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.823 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.823 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.824 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:12.824 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:12.824 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 106.73311685900001, 2024-04-26T10:44:12.824 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:44:12.824 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:12.824 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:12.824 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:12.824 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.824 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:12.824 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:12.824 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.824 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.824 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.824 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:12.825 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:12.825 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.825 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.825 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.825 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:12.825 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:44:12.825 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:12.825 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.825 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.825 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:12.825 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:44:12.825 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:44:12.825 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.825 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.826 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:12.826 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:44:12.826 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:44:12.826 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.826 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.826 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.826 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:44:12.826 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:44:12.826 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.826 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.826 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:12.826 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:44:12.826 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:44:12.826 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.827 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.827 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:12.827 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:44:12.827 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:44:12.827 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.827 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.827 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:12.827 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:44:12.827 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:44:12.827 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.827 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:12.827 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.827 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.827 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.827 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:12.828 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:12.828 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 106.733074831, 2024-04-26T10:44:12.828 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:44:12.828 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:12.828 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:12.828 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:12.828 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.828 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:12.828 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:12.828 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.828 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.828 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.828 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:12.828 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:12.828 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.829 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.829 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.829 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:12.829 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:12.829 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.829 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.829 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.829 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:12.829 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:44:12.829 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:44:12.829 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.829 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.829 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:12.829 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:44:12.830 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:44:12.830 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.830 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.830 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.830 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:44:12.830 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:44:12.830 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.830 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.830 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:12.830 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:44:12.830 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:44:12.830 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.830 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.830 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:12.831 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:44:12.831 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:44:12.831 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.831 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.831 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:12.831 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:44:12.831 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:44:12.831 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.831 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:12.831 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.831 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.831 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.831 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:12.831 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:12.832 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 106.733021659, 2024-04-26T10:44:12.832 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:44:12.832 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:12.832 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:12.832 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:12.832 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.832 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:12.832 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:12.832 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.832 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.832 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.832 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:12.832 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:12.832 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.832 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.833 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.833 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:12.833 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:12.833 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.833 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.833 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.833 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:12.833 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:44:12.833 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:44:12.833 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.833 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.833 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:12.833 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:44:12.833 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:44:12.833 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.834 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.834 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.834 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:44:12.834 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:44:12.834 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.834 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.834 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:12.834 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:44:12.834 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:44:12.834 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.834 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.834 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:12.834 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:44:12.834 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:44:12.834 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.835 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.835 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:12.835 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:44:12.835 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:44:12.835 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.835 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:12.835 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.835 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.835 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.835 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:12.835 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:12.835 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 106.72961524900001, 2024-04-26T10:44:12.835 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:44:12.835 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:12.836 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:44:12.836 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:12.836 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.836 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:12.836 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:12.836 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.836 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.836 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.836 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:12.836 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:12.836 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.836 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.836 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.836 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:12.837 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:44:12.837 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.837 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.837 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.837 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:12.837 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:44:12.837 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:44:12.837 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.837 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.837 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:12.837 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:44:12.837 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:44:12.837 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.837 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.837 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.838 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:44:12.838 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:44:12.838 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.838 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.838 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:12.838 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:44:12.838 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:44:12.838 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.838 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.838 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:12.838 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:44:12.838 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:44:12.838 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.838 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:12.839 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.839 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.839 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.839 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:44:12.839 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:44:12.839 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 106.72714329599999, 2024-04-26T10:44:12.839 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00034882499999999998, 2024-04-26T10:44:12.839 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:12.839 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:12.839 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:12.839 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.839 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:12.839 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:44:12.839 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.840 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.840 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.840 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:12.840 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045435+0000", 2024-04-26T10:44:12.840 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.840 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.840 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.840 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:12.840 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045434+0000", 2024-04-26T10:44:12.840 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.840 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.840 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.840 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:12.840 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045438+0000", 2024-04-26T10:44:12.840 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3100000000000001e-06 2024-04-26T10:44:12.840 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.841 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.841 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:12.841 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045445+0000", 2024-04-26T10:44:12.841 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8589999999999999e-06 2024-04-26T10:44:12.841 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.841 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.841 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.841 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045453+0000", 2024-04-26T10:44:12.841 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:44:12.841 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.841 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.841 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:12.841 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045675+0000", 2024-04-26T10:44:12.841 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000221974 2024-04-26T10:44:12.841 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.842 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.842 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:12.842 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045684+0000", 2024-04-26T10:44:12.842 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.541e-06 2024-04-26T10:44:12.842 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.842 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.842 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:12.842 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045783+0000", 2024-04-26T10:44:12.842 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9524999999999993e-05 2024-04-26T10:44:12.842 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.842 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:12.842 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.842 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.843 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.843 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:44:12.843 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:12.843 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 106.726489738, 2024-04-26T10:44:12.843 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00054366400000000002, 2024-04-26T10:44:12.843 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:12.843 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:12.843 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:12.843 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.843 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:12.843 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:12.843 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.843 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.843 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.844 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:12.844 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:12.844 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.844 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.844 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.844 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:12.844 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046088+0000", 2024-04-26T10:44:12.844 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.844 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.844 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.844 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:12.844 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046093+0000", 2024-04-26T10:44:12.844 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.113e-06 2024-04-26T10:44:12.844 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.844 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.845 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:12.845 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046102+0000", 2024-04-26T10:44:12.845 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9870000000000005e-06 2024-04-26T10:44:12.845 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.845 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.845 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.845 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046110+0000", 2024-04-26T10:44:12.845 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8350000000000004e-06 2024-04-26T10:44:12.845 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.845 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.845 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:12.845 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046473+0000", 2024-04-26T10:44:12.845 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00036296800000000003 2024-04-26T10:44:12.845 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.845 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.846 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:12.846 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046487+0000", 2024-04-26T10:44:12.846 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4239999999999999e-05 2024-04-26T10:44:12.846 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.846 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.846 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:12.846 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046632+0000", 2024-04-26T10:44:12.846 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014509000000000001 2024-04-26T10:44:12.846 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.846 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:12.846 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.846 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.846 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.847 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:44:12.847 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:12.847 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 106.72641395300001, 2024-04-26T10:44:12.847 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00059921799999999999, 2024-04-26T10:44:12.847 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:12.847 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:12.847 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:12.847 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.847 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:12.847 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:12.847 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.847 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.847 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.847 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:12.847 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:12.848 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.848 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.848 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.848 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:12.848 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046164+0000", 2024-04-26T10:44:12.848 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.848 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.848 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.848 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:12.848 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:44:12.848 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8700000000000001e-06 2024-04-26T10:44:12.848 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.848 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.848 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:12.849 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046172+0000", 2024-04-26T10:44:12.849 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8540000000000002e-06 2024-04-26T10:44:12.849 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.849 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.849 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.849 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046180+0000", 2024-04-26T10:44:12.849 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:44:12.849 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.849 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.849 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:12.849 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046657+0000", 2024-04-26T10:44:12.849 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047606599999999998 2024-04-26T10:44:12.849 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.849 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.850 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:12.850 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046663+0000", 2024-04-26T10:44:12.850 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:44:12.850 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.850 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.850 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:12.850 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046763+0000", 2024-04-26T10:44:12.850 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010042100000000001 2024-04-26T10:44:12.850 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.850 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:12.850 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.850 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.850 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.850 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 8 lcod 14'4)", 2024-04-26T10:44:12.851 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:44:12.851 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 106.726200259, 2024-04-26T10:44:12.851 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060493500000000002, 2024-04-26T10:44:12.851 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:12.851 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:44:12.851 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:12.851 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.851 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:12.851 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:44:12.851 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.851 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.851 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.851 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:12.851 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046378+0000", 2024-04-26T10:44:12.852 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.852 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.852 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.852 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:12.852 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046377+0000", 2024-04-26T10:44:12.852 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:12.852 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.852 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.852 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:12.852 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046381+0000", 2024-04-26T10:44:12.852 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.506e-06 2024-04-26T10:44:12.852 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.852 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.852 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:12.853 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046389+0000", 2024-04-26T10:44:12.853 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:44:12.853 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.853 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.853 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.853 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046394+0000", 2024-04-26T10:44:12.853 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:44:12.853 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.853 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.853 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:12.853 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046900+0000", 2024-04-26T10:44:12.853 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050546300000000005 2024-04-26T10:44:12.853 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.853 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.853 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:12.854 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046983+0000", 2024-04-26T10:44:12.854 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2934000000000003e-05 2024-04-26T10:44:12.854 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.854 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:12.854 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.854 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.854 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.854 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:44:12.854 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:44:12.854 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 106.723756446, 2024-04-26T10:44:12.854 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043023399999999999, 2024-04-26T10:44:12.854 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:12.854 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:12.854 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:12.855 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.855 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:12.855 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:44:12.855 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.855 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.855 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.855 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:12.855 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048822+0000", 2024-04-26T10:44:12.855 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.855 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.855 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.855 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:12.855 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048821+0000", 2024-04-26T10:44:12.855 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:44:12.855 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.856 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.856 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:12.856 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048823+0000", 2024-04-26T10:44:12.856 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.468e-06 2024-04-26T10:44:12.856 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.856 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.856 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:12.856 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048827+0000", 2024-04-26T10:44:12.856 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9190000000000001e-06 2024-04-26T10:44:12.856 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.856 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.856 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.856 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048831+0000", 2024-04-26T10:44:12.856 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.459e-06 2024-04-26T10:44:12.857 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.857 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.857 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:12.857 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049171+0000", 2024-04-26T10:44:12.857 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000339458 2024-04-26T10:44:12.857 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.857 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.857 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:12.857 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049176+0000", 2024-04-26T10:44:12.857 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:44:12.857 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.857 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.857 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:12.857 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049252+0000", 2024-04-26T10:44:12.857 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5369000000000003e-05 2024-04-26T10:44:12.857 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.858 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:12.858 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.858 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.858 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.858 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:44:12.858 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:12.858 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 101.273694002, 2024-04-26T10:44:12.858 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:44:12.858 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:12.858 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:12.858 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:12.858 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.858 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:12.858 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:12.859 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.859 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.859 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.859 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:12.859 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:12.859 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:12.859 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.859 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.859 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:12.859 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:44:12.859 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:12.859 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.859 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.859 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:12.859 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:44:12.860 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:44:12.860 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.860 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.860 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:12.860 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:44:12.860 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:44:12.860 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.860 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.860 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:12.860 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:44:12.860 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:44:12.860 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.860 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.860 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:12.861 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:44:12.861 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:44:12.861 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.861 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.861 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:12.861 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:44:12.861 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:44:12.861 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.861 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.861 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:12.861 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:44:12.861 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:44:12.861 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.861 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.862 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:12.862 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:44:12.862 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:44:12.862 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.862 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.862 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:12.862 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:44:12.862 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:44:12.862 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.862 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.862 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:12.862 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:44:12.862 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:44:12.862 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:12.862 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:12.863 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:12.863 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:44:12.863 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:44:12.863 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.863 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:12.863 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.863 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:12.863 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:12.863 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:12.865 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:12.865 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:12.864+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:12.966 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:12.965+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:12.976 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:12.976 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:12.976 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:44:12.976 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:12.985 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:13.069 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:13.068+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:13.131 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:13.131 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:13.131 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:13.131 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:13.131 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:13.140 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:13.181 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:13.180+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:13.269 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:13.268+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:13.288 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:13.289 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:13.289 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:13.289 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:13.289 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.289 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:13.290 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:13.290 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 107.249892575, 2024-04-26T10:44:13.290 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:44:13.290 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:13.290 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:13.290 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:13.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.291 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:13.291 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:13.291 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.292 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:13.292 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:13.292 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.292 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:13.293 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:13.293 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:13.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.293 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.293 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:13.293 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:44:13.294 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:44:13.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.295 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:13.296 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:44:13.296 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:44:13.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.296 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:13.296 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:44:13.296 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:44:13.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.297 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.297 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:13.297 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:44:13.297 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:44:13.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.297 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.297 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:13.297 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:44:13.298 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:44:13.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.298 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:13.298 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:44:13.298 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:44:13.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.299 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:13.299 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:44:13.299 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:44:13.299 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.299 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:13.299 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.299 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.299 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.300 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:13.300 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:13.300 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 107.248142454, 2024-04-26T10:44:13.300 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:44:13.300 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:13.300 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:13.300 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:13.300 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.300 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:13.301 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:13.301 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.301 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.301 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:13.301 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:13.301 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.301 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.302 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:13.302 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:44:13.302 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:13.302 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.302 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.302 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:13.302 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:44:13.302 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:44:13.303 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.303 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.303 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:13.303 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:44:13.303 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:44:13.303 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.303 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.303 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:13.304 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:44:13.304 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:44:13.304 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.304 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.304 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:13.304 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:44:13.304 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:44:13.304 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.304 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.305 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:13.305 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:44:13.305 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:44:13.305 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.305 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.305 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:13.305 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:44:13.305 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:44:13.305 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.305 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.305 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:13.306 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:44:13.306 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:44:13.306 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.306 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.306 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:13.306 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:44:13.306 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:44:13.306 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.306 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.306 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:13.306 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:44:13.306 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:44:13.307 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.307 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.307 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:13.307 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:44:13.307 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:44:13.307 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.307 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:13.307 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.307 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.307 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.307 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:13.307 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:13.307 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 107.248089456, 2024-04-26T10:44:13.307 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:44:13.308 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:13.308 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:13.308 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:13.308 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.308 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:13.308 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:13.308 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.308 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.308 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.308 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:13.308 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:13.308 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.308 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.308 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.309 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:13.309 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:13.309 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:13.309 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.309 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.309 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:13.309 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:44:13.309 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:44:13.309 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.309 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.309 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:13.309 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:44:13.310 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:44:13.310 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.310 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.310 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:13.310 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:44:13.310 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:44:13.310 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.310 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.310 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:13.310 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:44:13.310 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:44:13.310 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.310 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.311 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:13.311 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:44:13.311 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:44:13.311 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.311 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.311 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:13.311 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:44:13.311 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:44:13.312 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.312 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.312 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:13.312 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:44:13.312 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:44:13.312 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.312 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.312 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:13.312 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:44:13.312 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:44:13.313 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.313 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.313 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:13.313 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:44:13.313 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:44:13.313 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.313 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.313 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:13.313 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:44:13.313 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:44:13.313 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.313 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:13.313 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.314 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.314 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:13.314 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:13.314 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 107.24801171199999, 2024-04-26T10:44:13.314 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:44:13.314 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:13.314 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:13.314 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:13.314 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.314 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:13.314 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:13.315 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.315 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:13.315 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:13.315 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.315 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:13.315 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:44:13.315 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:13.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.316 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:13.316 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:44:13.316 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:44:13.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.316 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.316 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:13.316 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:44:13.316 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:44:13.317 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.317 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.317 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:13.317 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:44:13.317 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:44:13.317 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.317 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.317 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:13.317 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:44:13.317 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:44:13.317 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.317 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.317 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:13.318 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:44:13.318 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:44:13.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.318 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.318 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:13.318 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:44:13.318 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:44:13.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.318 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.318 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:13.319 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:44:13.319 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:44:13.319 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.319 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:13.319 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:44:13.319 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:44:13.319 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.319 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:13.319 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:44:13.319 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:44:13.319 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.320 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:13.320 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:44:13.320 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:44:13.320 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.320 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:13.320 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.320 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.320 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.320 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:13.320 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:13.320 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 107.247972706, 2024-04-26T10:44:13.320 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:44:13.320 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:13.321 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:13.321 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:13.321 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.321 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:13.321 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:13.321 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.321 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.321 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.321 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:13.321 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:13.321 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.321 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.322 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.322 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:13.322 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:44:13.322 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:13.322 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.322 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.322 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:13.322 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:44:13.322 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:44:13.322 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.322 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.322 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:13.323 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:44:13.323 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:44:13.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.323 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.323 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:13.323 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:44:13.323 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:44:13.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.324 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.324 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:13.324 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:44:13.324 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:44:13.324 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.324 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.324 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:13.324 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:44:13.324 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:44:13.324 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.324 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.324 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:13.324 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:44:13.324 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:44:13.325 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.325 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:13.325 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:44:13.325 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:44:13.325 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.325 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:13.325 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:44:13.325 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:44:13.325 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.325 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:13.325 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:44:13.326 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:44:13.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.326 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.326 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:13.326 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:44:13.326 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:44:13.326 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.326 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:13.326 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.326 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.326 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:13.327 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:13.327 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 107.247953885, 2024-04-26T10:44:13.327 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:44:13.327 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:13.327 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:13.327 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:13.327 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.327 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:13.327 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:13.328 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.328 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.328 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:13.328 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:13.328 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.328 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.328 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:13.328 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:13.328 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:13.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.329 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:13.329 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:44:13.329 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:44:13.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.329 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:13.329 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:44:13.329 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:44:13.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.329 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:13.329 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:44:13.330 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:44:13.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.330 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.330 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:13.330 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:44:13.330 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:44:13.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.330 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.330 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:13.330 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:44:13.330 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:44:13.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.331 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:13.331 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:44:13.331 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:44:13.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.331 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:13.331 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:44:13.331 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:44:13.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.331 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:44:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:44:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:44:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:44:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:44:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:44:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.332 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:13.333 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.333 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:13.333 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:13.333 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 107.247921883, 2024-04-26T10:44:13.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:44:13.333 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:13.333 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:13.333 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:13.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.333 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:13.333 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:13.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.334 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:13.334 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:13.334 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.334 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:13.334 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:44:13.334 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:13.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.335 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:13.335 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:44:13.335 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:44:13.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.335 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:13.335 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:44:13.335 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:44:13.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.335 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:13.335 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:44:13.335 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:44:13.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.336 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:13.336 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:44:13.336 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:44:13.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.336 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:13.336 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:44:13.336 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:44:13.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.336 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:13.336 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:44:13.336 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:44:13.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.337 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:13.337 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:44:13.337 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:44:13.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.337 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:13.337 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:44:13.337 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:44:13.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.337 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:13.338 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:44:13.338 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:44:13.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.338 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.338 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:13.338 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:44:13.338 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:44:13.338 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.338 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:13.339 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.339 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:13.339 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:13.339 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 107.24771307499999, 2024-04-26T10:44:13.339 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:44:13.339 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:13.339 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:13.339 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:13.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.340 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:13.340 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:13.340 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.340 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:13.340 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:13.340 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.340 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:13.340 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:44:13.340 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:13.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.341 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:13.341 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:44:13.341 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:44:13.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.341 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:13.341 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:44:13.341 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:44:13.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.341 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:13.342 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:44:13.342 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:44:13.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.342 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:13.342 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:44:13.342 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:44:13.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.342 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:13.343 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:44:13.343 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:44:13.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.343 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:13.343 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:44:13.343 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:44:13.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.343 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:13.343 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:44:13.343 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:44:13.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.344 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:13.344 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:44:13.344 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:44:13.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.344 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:13.344 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:44:13.344 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:44:13.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.344 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:13.344 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:44:13.344 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:44:13.344 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.345 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:13.345 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.345 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:13.345 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:13.345 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 107.24768178399999, 2024-04-26T10:44:13.345 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:44:13.345 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:13.345 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:13.345 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:13.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.346 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:13.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:13.346 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.346 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:13.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:13.346 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.346 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:13.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:44:13.346 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:13.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.347 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:13.347 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:44:13.347 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:44:13.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.347 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:13.347 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:44:13.347 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:44:13.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.347 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:13.347 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:44:13.347 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:44:13.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.348 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:13.348 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:44:13.348 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:44:13.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.348 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:13.348 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:44:13.348 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:44:13.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.349 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:13.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:44:13.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:44:13.349 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.349 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:13.349 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.349 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:13.349 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:13.349 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 107.24765453400001, 2024-04-26T10:44:13.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:44:13.349 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:13.350 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:13.350 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:13.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.350 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:13.350 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:13.350 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.350 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:13.350 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:13.350 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:13.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:13.351 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:13.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:13.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:44:13.351 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:44:13.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:13.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:44:13.351 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:44:13.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:13.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:44:13.352 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:44:13.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:13.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:44:13.352 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:44:13.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:13.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:44:13.352 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:44:13.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.353 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:13.353 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:44:13.353 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:44:13.353 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.353 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:13.353 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.353 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:13.353 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:13.353 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 107.24487778300001, 2024-04-26T10:44:13.353 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:44:13.354 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:13.354 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:44:13.354 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:13.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.354 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:13.354 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:13.354 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.354 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:13.354 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:13.354 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:13.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:44:13.355 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:13.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:13.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:44:13.355 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:44:13.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:13.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:44:13.356 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:44:13.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:13.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:44:13.356 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:44:13.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:13.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:44:13.356 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:44:13.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:13.357 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:44:13.357 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:44:13.357 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.357 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:13.357 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.357 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:13.357 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:13.357 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 107.24482769399999, 2024-04-26T10:44:13.357 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:44:13.357 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:13.357 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:13.357 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:13.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.358 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:13.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:13.358 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.358 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:13.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:13.358 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.358 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:13.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:44:13.359 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:13.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.359 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:13.359 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:44:13.359 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:44:13.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.359 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:13.359 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:44:13.359 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:44:13.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:13.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:44:13.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:44:13.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:13.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:44:13.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:44:13.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:13.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:44:13.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:44:13.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:13.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:44:13.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:44:13.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:13.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:44:13.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:44:13.361 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.361 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:13.361 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.362 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:13.362 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:13.362 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 107.24393562500001, 2024-04-26T10:44:13.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:44:13.362 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:13.362 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:13.362 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:13.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:13.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:13.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:13.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:13.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:13.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:44:13.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:13.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:13.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:44:13.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:44:13.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.364 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:13.364 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:44:13.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:44:13.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.364 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:13.364 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:44:13.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:44:13.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.364 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:13.364 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:44:13.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:44:13.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:13.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:44:13.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:44:13.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:13.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:44:13.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:44:13.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:13.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:44:13.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:13.366 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.366 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:13.366 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.366 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:44:13.366 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:13.366 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 107.241747296, 2024-04-26T10:44:13.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:44:13.366 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:13.366 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:13.366 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:13.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:13.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:13.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:13.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:13.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:13.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:13.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:13.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:13.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:44:13.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:44:13.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:13.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:44:13.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:44:13.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:13.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:44:13.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:44:13.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:13.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:44:13.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:44:13.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:13.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:44:13.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:44:13.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:13.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:44:13.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:44:13.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:13.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:44:13.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:44:13.370 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.370 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:13.370 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.370 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:44:13.370 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:13.370 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 107.241611926, 2024-04-26T10:44:13.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:44:13.371 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:13.371 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:13.371 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:13.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:13.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:13.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:13.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:13.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:13.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:44:13.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:13.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:13.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:44:13.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:44:13.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:13.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:44:13.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:44:13.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:13.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:44:13.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:44:13.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:13.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:44:13.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:44:13.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:13.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:44:13.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:44:13.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:13.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:44:13.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:44:13.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:13.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:44:13.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:44:13.374 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.374 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:13.374 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.375 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:44:13.375 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:13.375 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 107.24139735200001, 2024-04-26T10:44:13.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:44:13.375 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:13.375 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:13.375 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:13.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:13.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:13.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:13.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:13.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:13.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:13.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:13.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:13.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:44:13.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:44:13.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:13.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:44:13.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:44:13.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:13.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:44:13.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:44:13.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:13.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:44:13.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:44:13.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:13.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:44:13.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:44:13.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:13.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:44:13.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:44:13.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:13.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:44:13.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:44:13.379 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.379 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:13.379 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.379 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:10 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'5, mlcod=0'0)", 2024-04-26T10:44:13.379 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:13.379 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 107.241058411, 2024-04-26T10:44:13.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039807499999999999, 2024-04-26T10:44:13.379 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:13.379 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:13.380 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044731+0000", 2024-04-26T10:44:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044742+0000", 2024-04-26T10:44:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1119e-05 2024-04-26T10:44:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044750+0000", 2024-04-26T10:44:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4759999999999998e-06 2024-04-26T10:44:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:13.381 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044772+0000", 2024-04-26T10:44:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1520999999999999e-05 2024-04-26T10:44:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045056+0000", 2024-04-26T10:44:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028398200000000001 2024-04-26T10:44:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045138+0000", 2024-04-26T10:44:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1716000000000002e-05 2024-04-26T10:44:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:13.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048685+0000", 2024-04-26T10:44:13.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035467929999999999 2024-04-26T10:44:13.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:13.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048712+0000", 2024-04-26T10:44:13.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7435000000000001e-05 2024-04-26T10:44:13.383 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.383 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:13.383 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.383 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.14 epoch 14/12 rep_tid 172 entries 14'5 (0'0) error 3:2e2fa760:::200.00000001:head by mds.0.3:32 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 107.240949034, 2024-04-26T10:44:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040703040000000003, 2024-04-26T10:44:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:44:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044841+0000", 2024-04-26T10:44:13.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044840+0000", 2024-04-26T10:44:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044847+0000", 2024-04-26T10:44:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3500000000000002e-06 2024-04-26T10:44:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044857+0000", 2024-04-26T10:44:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0299000000000001e-05 2024-04-26T10:44:13.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.386 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:13.386 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044873+0000", 2024-04-26T10:44:13.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6065e-05 2024-04-26T10:44:13.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.386 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:13.386 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045579+0000", 2024-04-26T10:44:13.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070585500000000002 2024-04-26T10:44:13.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.386 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:13.386 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048911+0000", 2024-04-26T10:44:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033319529999999999 2024-04-26T10:44:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:11 3.10 e14/12 3:0bd6d154:::602.00000000:head v 14'6, mlcod=0'0)", 2024-04-26T10:44:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 107.240909315, 2024-04-26T10:44:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041290399999999996, 2024-04-26T10:44:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:13.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044880+0000", 2024-04-26T10:44:13.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044885+0000", 2024-04-26T10:44:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:44:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044892+0000", 2024-04-26T10:44:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9070000000000007e-06 2024-04-26T10:44:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:13.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044898+0000", 2024-04-26T10:44:13.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:44:13.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:13.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045874+0000", 2024-04-26T10:44:13.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097616300000000005 2024-04-26T10:44:13.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:13.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045959+0000", 2024-04-26T10:44:13.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5242999999999997e-05 2024-04-26T10:44:13.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048970+0000", 2024-04-26T10:44:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030101770000000002 2024-04-26T10:44:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049009+0000", 2024-04-26T10:44:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9776e-05 2024-04-26T10:44:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.391 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:44:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 107.240571782, 2024-04-26T10:44:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:44:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:13.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:44:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:44:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:44:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:13.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:44:13.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:44:13.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:13.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:44:13.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:44:13.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:13.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:44:13.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:44:13.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:13.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:44:13.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:44:13.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:13.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:44:13.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:44:13.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:13.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:13.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:13.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:44:13.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:44:13.395 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.395 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:13.395 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.396 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:13.396 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:13.396 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:13.396 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:44:13.398 INFO:teuthology.orchestra.run.smithi049.stderr:nodeep-scrub is set 2024-04-26T10:44:13.399 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:13.399 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:13.397+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:13.468 INFO:tasks.workunit.client.0.smithi049.stderr:+ tar xzf ltp-full.tgz 2024-04-26T10:44:13.498 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:13.496+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:13.506 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:13.507 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:13.507 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:13.507 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(client.4532.0:7 4.36 e52/37 4:6ee5e2c4:::100000001f9.00000000:head v 52'1, mlcod=0'0)", 2024-04-26T10:44:13.507 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:13.505408+0000", 2024-04-26T10:44:13.507 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.00073960200000000001, 2024-04-26T10:44:13.507 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00074556899999999996, 2024-04-26T10:44:13.508 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:13.508 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:13.508 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:13.508 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:13.508 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:13.508 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.505408+0000", 2024-04-26T10:44:13.509 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:13.509 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:13.509 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:13.509 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:13.509 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.505408+0000", 2024-04-26T10:44:13.510 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:13.510 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:13.510 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:13.510 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:13.510 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.505407+0000", 2024-04-26T10:44:13.510 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:13.510 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:13.510 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:13.510 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:13.510 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.505423+0000", 2024-04-26T10:44:13.511 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6032000000000002e-05 2024-04-26T10:44:13.511 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:13.511 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:13.511 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:13.511 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.505435+0000", 2024-04-26T10:44:13.512 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1711e-05 2024-04-26T10:44:13.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:13.512 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:13.512 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:13.512 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.505443+0000", 2024-04-26T10:44:13.512 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.0169999999999996e-06 2024-04-26T10:44:13.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:13.512 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:13.512 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:13.512 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.505487+0000", 2024-04-26T10:44:13.512 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3662000000000003e-05 2024-04-26T10:44:13.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:13.512 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:13.513 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:13.513 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.505505+0000", 2024-04-26T10:44:13.513 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.7819999999999999e-05 2024-04-26T10:44:13.513 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:13.513 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:13.513 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:13.513 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.506128+0000", 2024-04-26T10:44:13.513 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062324799999999997 2024-04-26T10:44:13.513 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:13.513 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:13.513 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:13.513 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.506154+0000", 2024-04-26T10:44:13.513 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6148000000000001e-05 2024-04-26T10:44:13.513 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:13.514 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:13.514 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:13.514 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:13.514 INFO:teuthology.orchestra.run.smithi195.stdout: ], 2024-04-26T10:44:13.514 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 1 2024-04-26T10:44:13.514 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:13.516 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:13.573 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:13.573 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:13.574 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:13.592 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:13.592 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:13.595 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:13.596 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:13.600 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:13.599+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:13.664 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:13.664 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:13.673 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:13.700 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:13.699+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:13.801 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:13.800+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:13.820 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:13.820 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:13.829 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:13.902 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:13.901+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:13.943 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:13.944 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:13.953 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:14.003 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:14.002+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:14.071 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:14.071 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:14.081 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:14.126 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:14.125+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:14.194 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:14.194 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:14.203 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:14.245 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:14.244+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:14.306 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:14.304+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:14.317 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:14.317 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:14.328 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:14.413 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:14.412+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:14.473 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:14.473 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:14.483 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:14.508 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:14.507+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:14.609 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:14.609+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:14.628 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:14.629 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:14.638 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:14.710 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:14.710+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:14.749 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:14.749 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:14.758 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:14.811 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:14.810+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:14.821 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~59s 2024-04-26T10:44:14.868 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:14.869 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:14.878 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:14.922 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:14.921+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:14.994 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:14.994 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:15.003 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:15.044 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:15.044+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:15.113 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:15.113+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:15.117 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:15.117 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:15.127 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:15.214 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:15.213+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:15.234 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:15.234 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:15.243 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:15.315 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:15.315+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:15.352 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:15.352 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:15.363 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:15.400 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:44:15.416 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:15.415+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:15.479 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:15.479 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:15.488 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:15.529 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:15.528+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:15.597 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:44:15.619 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:15.618+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:15.642 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:15.642 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:15.651 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:15.720 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:15.719+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:15.741 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:15.761 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:15.762 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:15.764 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:15.765 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:15.806 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:15.806 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:15.806 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:15.806 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:15.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.807 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:15.807 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:15.807 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 109.76809538400001, 2024-04-26T10:44:15.807 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:44:15.807 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:15.807 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:15.807 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:15.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.808 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:15.808 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:15.808 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.808 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:15.808 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:15.808 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.809 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:15.809 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:15.809 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:15.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.809 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:15.809 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:44:15.810 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:44:15.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.810 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:15.810 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:44:15.810 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:44:15.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.810 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:15.811 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:44:15.811 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:44:15.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.811 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:15.811 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:44:15.811 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:44:15.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.812 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:15.812 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:44:15.812 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:44:15.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.812 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:15.813 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:44:15.813 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:44:15.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.813 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:15.813 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:44:15.813 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:44:15.813 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.813 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:15.814 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.814 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:15.814 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:15.814 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 109.76634526300001, 2024-04-26T10:44:15.814 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:44:15.814 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:15.815 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:15.815 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:15.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.815 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:15.815 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:15.815 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.815 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:15.816 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:15.816 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.816 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:15.816 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:44:15.816 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:15.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.817 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:15.817 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:44:15.817 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:44:15.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.817 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:15.817 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:44:15.817 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:44:15.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.818 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:15.818 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:44:15.818 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:44:15.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.818 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:15.819 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:44:15.819 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:44:15.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.819 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:15.819 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:44:15.819 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:44:15.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.820 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:15.820 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:44:15.820 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:44:15.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.820 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:15.820 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:44:15.820 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:44:15.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.820 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:15.821 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:44:15.821 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:44:15.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.821 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:15.821 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:44:15.821 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:44:15.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.822 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:15.822 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:44:15.822 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:44:15.822 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.822 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:15.823 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.823 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:15.823 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:15.823 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 109.766292265, 2024-04-26T10:44:15.823 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:44:15.824 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:15.824 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:15.824 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:15.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.824 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:15.824 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:15.825 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.825 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.825 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:15.825 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:15.825 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.826 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:15.826 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:15.826 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:15.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.827 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:15.827 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:44:15.827 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:44:15.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.828 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:15.828 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:44:15.829 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:44:15.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.829 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:15.829 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:44:15.829 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:44:15.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.830 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:15.830 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:44:15.830 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:44:15.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.831 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:15.831 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:44:15.831 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:44:15.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.831 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:15.831 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:44:15.831 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:44:15.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.832 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:15.832 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:44:15.832 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:44:15.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.832 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:15.833 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:44:15.833 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:44:15.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.833 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:15.833 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:44:15.833 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:44:15.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.834 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:15.834 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:44:15.834 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:44:15.834 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 109.76621452099999, 2024-04-26T10:44:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:44:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:15.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.836 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:15.836 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:15.836 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.836 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:15.836 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:15.836 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:44:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:44:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:44:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:44:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:44:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:44:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:44:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:44:15.838 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:44:15.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.839 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:15.839 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:44:15.839 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:44:15.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.839 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:15.839 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:44:15.839 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:44:15.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.840 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:15.840 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:44:15.840 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:44:15.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.841 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:15.841 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:44:15.841 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:44:15.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.841 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:15.841 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:44:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:44:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:44:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:44:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:15.842 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 109.766175515, 2024-04-26T10:44:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:44:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:15.843 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:15.844 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.845 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:15.845 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:44:15.845 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:15.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.846 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:15.847 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:44:15.847 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:44:15.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.847 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:15.847 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:44:15.847 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:44:15.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.848 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:15.848 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:44:15.848 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:44:15.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.848 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:15.848 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:44:15.849 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:44:15.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.849 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:15.849 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:44:15.849 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:44:15.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.850 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:15.850 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:44:15.850 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:44:15.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.850 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:15.851 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:44:15.851 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:44:15.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.851 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:15.851 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:44:15.851 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:44:15.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.851 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:15.851 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:44:15.851 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:44:15.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.852 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:15.852 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:44:15.852 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:44:15.852 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.853 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:15.853 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.854 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:15.854 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:15.854 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 109.766156694, 2024-04-26T10:44:15.854 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:44:15.855 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:15.855 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:15.855 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:15.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.855 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:15.855 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:15.855 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.856 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:15.856 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:15.856 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.857 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:15.857 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:15.857 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:15.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.858 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:15.858 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:44:15.858 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:44:15.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.859 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:15.859 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:44:15.859 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:44:15.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.860 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:15.860 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:44:15.861 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:44:15.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.862 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:15.862 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:44:15.862 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:44:15.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.862 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:15.863 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:44:15.863 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:44:15.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.863 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:15.863 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:44:15.864 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:44:15.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.864 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:15.864 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:44:15.865 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:44:15.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.865 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:15.865 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:44:15.865 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:44:15.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.866 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:15.866 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:44:15.866 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:44:15.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.866 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:15.866 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:44:15.866 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:44:15.867 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.867 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:15.867 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.867 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:15.867 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:15.867 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 109.76612469200001, 2024-04-26T10:44:15.867 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:44:15.868 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:15.868 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:15.868 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:15.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.868 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:15.868 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:15.868 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.869 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:15.869 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:15.869 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:44:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:44:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:44:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:44:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:44:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:44:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:44:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:44:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:44:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:44:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:44:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:44:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:44:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:44:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:44:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:44:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:44:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:44:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:44:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:44:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:44:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.879 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:15.879 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:15.879 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 109.76591588399999, 2024-04-26T10:44:15.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:44:15.879 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:44:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:44:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:44:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:44:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:44:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:44:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:44:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:44:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:44:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:44:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:44:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:44:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:44:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:44:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:44:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:44:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:44:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:44:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:44:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:44:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:44:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.886 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:15.886 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.886 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:15.886 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:15.886 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 109.765884593, 2024-04-26T10:44:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:44:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:44:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:15.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:44:15.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:44:15.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:15.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:44:15.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:44:15.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:15.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:44:15.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:44:15.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:15.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:44:15.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:44:15.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:15.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:44:15.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:44:15.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:15.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:44:15.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:44:15.897 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.897 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:15.897 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 109.76585734299999, 2024-04-26T10:44:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:44:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:44:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:44:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:44:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:44:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:44:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:44:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:44:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:44:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:44:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:44:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:44:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:44:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.901 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 109.76308059199999, 2024-04-26T10:44:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:44:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:44:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:15.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:44:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:44:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:44:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:15.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:44:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:44:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:44:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:44:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:44:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:44:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:15.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:44:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:44:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 109.763030503, 2024-04-26T10:44:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:44:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:15.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:44:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:15.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:44:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:44:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:44:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:44:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:44:15.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:44:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:44:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:44:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:44:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:44:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:15.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:44:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:44:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:44:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:44:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 109.76213843399999, 2024-04-26T10:44:15.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:44:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:44:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:44:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:44:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:44:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:44:15.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:44:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:44:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:44:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:44:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:44:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:44:15.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:44:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:44:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:44:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:44:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 109.759950105, 2024-04-26T10:44:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:44:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:44:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:44:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:44:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:44:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:44:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:44:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:44:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:44:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:44:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:44:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:44:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:44:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:44:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:44:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.917 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:44:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 109.75981473500001, 2024-04-26T10:44:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:44:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:15.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:44:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:15.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:44:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:44:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:44:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:44:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:44:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:44:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:15.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:44:15.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:44:15.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:15.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:44:15.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:44:15.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:15.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:44:15.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:44:15.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:15.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:44:15.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:44:15.922 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.922 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:15.922 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.922 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:3 3.14 e14/12 3:287034c4:::1.00000000.inode:head v 14'4, mlcod=0'0)", 2024-04-26T10:44:15.923 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:15.923 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 109.75960016099999, 2024-04-26T10:44:15.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043846290000000001, 2024-04-26T10:44:15.923 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:15.923 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:15.923 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:15.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:15.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:15.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:15.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:15.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:15.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044392+0000", 2024-04-26T10:44:15.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:15.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:15.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044403+0000", 2024-04-26T10:44:15.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1291000000000001e-05 2024-04-26T10:44:15.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:15.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044410+0000", 2024-04-26T10:44:15.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2389999999999996e-06 2024-04-26T10:44:15.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:15.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044422+0000", 2024-04-26T10:44:15.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1534e-05 2024-04-26T10:44:15.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:15.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045125+0000", 2024-04-26T10:44:15.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00070341999999999996 2024-04-26T10:44:15.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:15.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045145+0000", 2024-04-26T10:44:15.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9712999999999999e-05 2024-04-26T10:44:15.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:15.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048750+0000", 2024-04-26T10:44:15.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036045869999999998 2024-04-26T10:44:15.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:15.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048777+0000", 2024-04-26T10:44:15.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7208000000000001e-05 2024-04-26T10:44:15.927 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.927 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:15.927 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.927 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:12 3.10 e14/12 3:0d89b25e:::603.00000000:head v 14'7, mlcod=0'0)", 2024-04-26T10:44:15.927 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:15.927 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 109.75877459100001, 2024-04-26T10:44:15.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042131460000000001, 2024-04-26T10:44:15.927 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:15.927 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:15.927 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:15.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:15.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:15.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:15.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045218+0000", 2024-04-26T10:44:15.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:15.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045217+0000", 2024-04-26T10:44:15.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:15.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:15.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045223+0000", 2024-04-26T10:44:15.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:44:15.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:15.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045232+0000", 2024-04-26T10:44:15.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-04-26T10:44:15.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:15.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045239+0000", 2024-04-26T10:44:15.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9829999999999999e-06 2024-04-26T10:44:15.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:15.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046450+0000", 2024-04-26T10:44:15.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001211052 2024-04-26T10:44:15.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:15.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046472+0000", 2024-04-26T10:44:15.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1656999999999999e-05 2024-04-26T10:44:15.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:15.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049397+0000", 2024-04-26T10:44:15.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029256180000000001 2024-04-26T10:44:15.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:15.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049431+0000", 2024-04-26T10:44:15.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3575999999999998e-05 2024-04-26T10:44:15.931 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.931 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:15.931 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.931 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:44:15.931 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:13.306328+0000", 2024-04-26T10:44:15.931 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 2.4976640749999999, 2024-04-26T10:44:15.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012467232999999999, 2024-04-26T10:44:15.931 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:15.932 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:15.932 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:15.932 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:15.932 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:15.932 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 4 2024-04-26T10:44:15.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.932 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:15.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:15.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.306328+0000", 2024-04-26T10:44:15.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:15.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.306328+0000", 2024-04-26T10:44:15.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:15.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.306325+0000", 2024-04-26T10:44:15.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999971 2024-04-26T10:44:15.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:15.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313008+0000", 2024-04-26T10:44:15.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0066830450000000003 2024-04-26T10:44:15.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:15.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313032+0000", 2024-04-26T10:44:15.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3034e-05 2024-04-26T10:44:15.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:15.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313041+0000", 2024-04-26T10:44:15.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.037e-06 2024-04-26T10:44:15.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:15.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313086+0000", 2024-04-26T10:44:15.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5259000000000002e-05 2024-04-26T10:44:15.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:15.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313156+0000", 2024-04-26T10:44:15.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0504000000000001e-05 2024-04-26T10:44:15.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:15.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.318691+0000", 2024-04-26T10:44:15.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0055346370000000002 2024-04-26T10:44:15.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:15.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.318724+0000", 2024-04-26T10:44:15.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3300000000000003e-05 2024-04-26T10:44:15.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:15.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.318796+0000", 2024-04-26T10:44:15.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1316999999999995e-05 2024-04-26T10:44:15.936 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.936 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:15.936 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.936 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:44:15.936 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:13.469171+0000", 2024-04-26T10:44:15.936 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 2.3348214390000002, 2024-04-26T10:44:15.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017514674000000001, 2024-04-26T10:44:15.937 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:15.937 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:15.937 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:15.937 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:15.937 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:15.937 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 5 2024-04-26T10:44:15.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.937 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:15.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:15.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.469171+0000", 2024-04-26T10:44:15.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:15.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.469171+0000", 2024-04-26T10:44:15.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:15.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.469168+0000", 2024-04-26T10:44:15.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999971 2024-04-26T10:44:15.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:15.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.474986+0000", 2024-04-26T10:44:15.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0058177690000000004 2024-04-26T10:44:15.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:15.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475001+0000", 2024-04-26T10:44:15.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5349000000000002e-05 2024-04-26T10:44:15.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:15.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475009+0000", 2024-04-26T10:44:15.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.3579999999999997e-06 2024-04-26T10:44:15.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:15.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475157+0000", 2024-04-26T10:44:15.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014815 2024-04-26T10:44:15.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:15.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475325+0000", 2024-04-26T10:44:15.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00016793299999999999 2024-04-26T10:44:15.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:15.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475461+0000", 2024-04-26T10:44:15.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00013602800000000001 2024-04-26T10:44:15.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:15.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.483044+0000", 2024-04-26T10:44:15.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0075827309999999997 2024-04-26T10:44:15.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:15.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.486538+0000", 2024-04-26T10:44:15.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0034942739999999999 2024-04-26T10:44:15.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:15.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.486596+0000", 2024-04-26T10:44:15.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8019999999999997e-05 2024-04-26T10:44:15.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:15.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.486686+0000", 2024-04-26T10:44:15.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9702000000000003e-05 2024-04-26T10:44:15.942 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.942 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:15.942 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.942 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:44:15.942 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:13.475021+0000", 2024-04-26T10:44:15.942 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 2.3289715929999999, 2024-04-26T10:44:15.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0084663459999999996, 2024-04-26T10:44:15.942 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:15.942 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:15.942 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:15.942 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:15.943 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:15.943 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 6 2024-04-26T10:44:15.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.943 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:15.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:15.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475021+0000", 2024-04-26T10:44:15.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:15.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475021+0000", 2024-04-26T10:44:15.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:15.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:15.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475020+0000", 2024-04-26T10:44:15.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:15.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:15.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480334+0000", 2024-04-26T10:44:15.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053142500000000004 2024-04-26T10:44:15.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:15.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480354+0000", 2024-04-26T10:44:15.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.931e-05 2024-04-26T10:44:15.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:15.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480365+0000", 2024-04-26T10:44:15.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1477999999999999e-05 2024-04-26T10:44:15.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:15.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480420+0000", 2024-04-26T10:44:15.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4802000000000001e-05 2024-04-26T10:44:15.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:15.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480596+0000", 2024-04-26T10:44:15.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000175806 2024-04-26T10:44:15.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:15.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.483338+0000", 2024-04-26T10:44:15.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0027423730000000002 2024-04-26T10:44:15.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:15.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.483389+0000", 2024-04-26T10:44:15.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0662999999999999e-05 2024-04-26T10:44:15.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:15.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:15.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:15.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.483487+0000", 2024-04-26T10:44:15.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.8350000000000005e-05 2024-04-26T10:44:15.947 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.947 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:15.947 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.947 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:15.947 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:15.947 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:15.948 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:15.949 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:15.947+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:16.049 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:16.049+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:16.060 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:16.060 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:16.061 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:44:16.061 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:16.071 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:16.151 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:16.150+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:16.224 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:16.224 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:16.225 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:16.225 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:16.225 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:16.235 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:16.252 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:16.251+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:16.336 INFO:teuthology.orchestra.run.smithi049.stderr:noscrub is unset 2024-04-26T10:44:16.346 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:16.346 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:16.347 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:16.347 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:16.347 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.347 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:16.347 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:16.347 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 110.305971255, 2024-04-26T10:44:16.348 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:44:16.348 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:16.348 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.348 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:16.348 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.348 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:16.349 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:16.349 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.349 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.349 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.349 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:16.349 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:16.350 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.350 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.350 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.350 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:16.350 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:44:16.350 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:16.351 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.351 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.351 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:16.351 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:44:16.351 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:44:16.351 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.352 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.352 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:16.352 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:44:16.352 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:44:16.352 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.352 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.353 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.353 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:44:16.353 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:44:16.353 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.353 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.353 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:16.354 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:44:16.354 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:44:16.354 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.354 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.355 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:16.355 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:44:16.355 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:44:16.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.356 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.356 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:16.356 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:44:16.356 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:44:16.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.357 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.357 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:16.357 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:44:16.357 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:44:16.357 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.357 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:16.358 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.358 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.358 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.358 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:16.358 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:16.358 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 110.305100475, 2024-04-26T10:44:16.359 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:44:16.359 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:16.359 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.359 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:16.359 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.359 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:16.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:16.360 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.360 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.360 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:16.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:16.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.361 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.361 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:16.361 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:16.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:16.362 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.362 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.362 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:16.362 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:44:16.362 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:44:16.363 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.363 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.363 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:16.363 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:44:16.363 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:44:16.363 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.363 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.363 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.363 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:44:16.363 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:44:16.364 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.364 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.364 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:16.364 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:44:16.364 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:44:16.364 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.364 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.364 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:16.364 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:44:16.364 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:44:16.364 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.364 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.364 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:16.364 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:44:16.365 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:44:16.365 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.365 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.365 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:16.365 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:44:16.365 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:44:16.365 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.366 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:16.366 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.366 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.366 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.366 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:16.366 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:16.366 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 110.304113132, 2024-04-26T10:44:16.366 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:44:16.366 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:16.366 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.366 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:16.366 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.366 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:16.367 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:16.367 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.367 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.367 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.367 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:16.367 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:16.367 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.367 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.367 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.367 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:16.367 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:44:16.367 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:16.367 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.367 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.367 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:16.368 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:44:16.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:44:16.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.368 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:16.368 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:44:16.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:44:16.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.368 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.368 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:44:16.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:44:16.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.368 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:16.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:44:16.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:44:16.369 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.369 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:16.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:44:16.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:44:16.369 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.369 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:16.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:44:16.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:44:16.369 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.369 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.370 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:16.370 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:44:16.370 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:44:16.370 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.370 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:16.370 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.370 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.370 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.370 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:16.370 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:16.370 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 110.30358698800001, 2024-04-26T10:44:16.370 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:44:16.370 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:16.370 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.370 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:16.371 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.371 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:16.371 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:16.371 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.371 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.371 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.371 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:16.371 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:16.371 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.371 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.371 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.372 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:16.372 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:44:16.372 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:16.372 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.372 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.372 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:16.372 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:44:16.372 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:44:16.372 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.372 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.373 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:16.373 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:44:16.373 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:44:16.373 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.373 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.373 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.373 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:44:16.373 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:44:16.373 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.373 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.373 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:16.373 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:44:16.373 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:44:16.373 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.373 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.374 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:16.374 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:44:16.374 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:44:16.374 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.374 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.374 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:16.374 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:44:16.374 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:44:16.374 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.374 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.374 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:16.374 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:44:16.374 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:44:16.374 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.375 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.375 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:16.375 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:44:16.375 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:44:16.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.376 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.376 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:16.376 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:44:16.376 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:44:16.376 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.376 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.376 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:16.377 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:44:16.377 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:44:16.377 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.377 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:16.377 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.377 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.377 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.377 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:16.377 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:16.377 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 110.303535164, 2024-04-26T10:44:16.377 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:44:16.378 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:16.378 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.378 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:16.378 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.378 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:16.378 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:16.378 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.378 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.378 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.378 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:16.378 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:16.378 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.378 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.379 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.379 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:16.379 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:44:16.379 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:16.379 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.379 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.379 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:16.379 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:44:16.379 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:44:16.379 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.379 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.379 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:16.379 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:44:16.379 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:44:16.380 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:44:16.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:44:16.380 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:16.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:44:16.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:44:16.380 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:16.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:44:16.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:44:16.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:16.381 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:44:16.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:44:16.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:16.381 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:44:16.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:44:16.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:16.381 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:44:16.382 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:44:16.382 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.382 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.382 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:16.382 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:44:16.382 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:44:16.382 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.382 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.382 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:16.382 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:44:16.382 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:44:16.382 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.382 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:16.382 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.383 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.383 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:16.383 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:16.383 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 110.303481792, 2024-04-26T10:44:16.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:44:16.383 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:16.383 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.383 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:16.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.383 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:16.383 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:16.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.383 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.384 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:16.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:16.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.384 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:16.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:16.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:16.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.384 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:16.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:44:16.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:44:16.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:16.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:44:16.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:44:16.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:44:16.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:44:16.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:16.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:44:16.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:44:16.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:16.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:44:16.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:44:16.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:16.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:44:16.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:44:16.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:16.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:44:16.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:44:16.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:16.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:44:16.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:44:16.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.388 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:16.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:44:16.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:44:16.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.388 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:16.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:44:16.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:44:16.388 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.388 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:16.388 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.389 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.389 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:16.389 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:16.389 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 110.303437465, 2024-04-26T10:44:16.389 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:44:16.389 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:16.389 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.389 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:16.389 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.389 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:16.389 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:16.389 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.389 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.390 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:16.390 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:16.390 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.390 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.390 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.390 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:16.390 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:16.390 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:16.390 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.390 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.390 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:16.390 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:44:16.390 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:44:16.390 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:16.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:44:16.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:44:16.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:44:16.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:44:16.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:16.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:44:16.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:44:16.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:16.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:44:16.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:44:16.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:16.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:44:16.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:44:16.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:16.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:44:16.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:44:16.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:16.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:44:16.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:44:16.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:16.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:44:16.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:44:16.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:16.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:44:16.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:44:16.394 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.394 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:16.394 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.394 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:16.394 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:16.394 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 110.303413752, 2024-04-26T10:44:16.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:44:16.394 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:16.394 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.394 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:16.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:16.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:16.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:16.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:16.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:16.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:16.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:16.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:16.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:44:16.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:44:16.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:16.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:44:16.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:44:16.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:44:16.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:44:16.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.397 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:16.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:44:16.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:44:16.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:16.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:44:16.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:44:16.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:16.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:44:16.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:44:16.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:16.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:44:16.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:44:16.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:16.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:44:16.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:44:16.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:16.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:44:16.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:44:16.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:16.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:44:16.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:44:16.400 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.400 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:16.400 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.400 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:16.401 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:16.401 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 110.303379447, 2024-04-26T10:44:16.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:44:16.401 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:16.401 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.401 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:16.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.401 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:16.401 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:16.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.401 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:16.401 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:16.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:16.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:44:16.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:16.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:16.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:44:16.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:44:16.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:16.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:44:16.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:44:16.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:44:16.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:44:16.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:16.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:44:16.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:44:16.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:16.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:44:16.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:44:16.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:16.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:44:16.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:44:16.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:16.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:44:16.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:44:16.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:16.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:44:16.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:44:16.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:16.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:44:16.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:44:16.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:16.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:44:16.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:44:16.405 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.405 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:16.406 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.406 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.406 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:16.406 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:16.406 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 110.303042851, 2024-04-26T10:44:16.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:44:16.406 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:16.406 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:16.406 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:16.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.406 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:16.406 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:16.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.407 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:16.407 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:16.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:16.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:44:16.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:16.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:16.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:44:16.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:44:16.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:16.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:44:16.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:44:16.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:44:16.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:44:16.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:16.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:44:16.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:44:16.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:16.410 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:44:16.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:44:16.410 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.410 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:16.410 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:44:16.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:44:16.410 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.410 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:16.410 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.410 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.410 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:16.410 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:16.411 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 110.303000823, 2024-04-26T10:44:16.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:44:16.411 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:16.411 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:16.411 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:16.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:16.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:16.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:16.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:16.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:16.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:16.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:16.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:16.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:44:16.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:44:16.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:16.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:44:16.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:44:16.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:44:16.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:44:16.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:16.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:44:16.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:44:16.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:16.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:44:16.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:44:16.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.414 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:16.414 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:44:16.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:44:16.414 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.414 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:16.414 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.414 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.414 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:16.414 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:16.414 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 110.302947651, 2024-04-26T10:44:16.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:44:16.414 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:16.415 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:16.415 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:16.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:16.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:16.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:16.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:16.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:16.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:16.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:16.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:16.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:44:16.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:44:16.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:16.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:44:16.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:44:16.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:44:16.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:44:16.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:16.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:44:16.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:44:16.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:16.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:44:16.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:44:16.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.418 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.418 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:16.418 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:44:16.418 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:44:16.418 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.418 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:16.418 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.419 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.419 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 3 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:16.419 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:16.419 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 110.299541241, 2024-04-26T10:44:16.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015788130000000001, 2024-04-26T10:44:16.419 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:16.419 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-26T10:44:16.419 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:16.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:16.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:16.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.419 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:16.420 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042963+0000", 2024-04-26T10:44:16.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:16.420 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042962+0000", 2024-04-26T10:44:16.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:16.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:16.420 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042979+0000", 2024-04-26T10:44:16.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6974999999999999e-05 2024-04-26T10:44:16.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:16.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.042996+0000", 2024-04-26T10:44:16.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:44:16.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043011+0000", 2024-04-26T10:44:16.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.588e-05 2024-04-26T10:44:16.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:16.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.043065+0000", 2024-04-26T10:44:16.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3344999999999998e-05 2024-04-26T10:44:16.422 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.422 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.422 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:16.422 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.044542+0000", 2024-04-26T10:44:16.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0014767459999999999 2024-04-26T10:44:16.422 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.422 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:16.422 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.422 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.422 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.422 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:44:16.422 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:16.422 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 104.84361999399999, 2024-04-26T10:44:16.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:44:16.423 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:16.423 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.423 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:16.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:16.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:16.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:16.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:16.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:16.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:44:16.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:16.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:16.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:44:16.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:44:16.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:16.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:44:16.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:44:16.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:44:16.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:44:16.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:16.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:44:16.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:44:16.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:16.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:44:16.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:44:16.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:16.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:44:16.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:44:16.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:16.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:44:16.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:44:16.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:16.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:44:16.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:44:16.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.427 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:16.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:44:16.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:44:16.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.427 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:16.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:44:16.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:44:16.427 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.427 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:16.427 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.427 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(client.4532.0:5 4.10 e52/37 4:09a4c37f:::10000000003.00000001:head v 52'1, mlcod=0'0)", 2024-04-26T10:44:16.428 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:16.428 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 2.8668802810000003, 2024-04-26T10:44:16.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010754041000000001, 2024-04-26T10:44:16.428 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:16.428 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.428 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:16.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:16.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:16.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:16.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:16.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.429 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.429 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:16.429 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:16.429 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:44:16.429 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.429 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:16.429 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479849+0000", 2024-04-26T10:44:16.429 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004225716 2024-04-26T10:44:16.429 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.429 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:16.429 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479868+0000", 2024-04-26T10:44:16.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.8666000000000001e-05 2024-04-26T10:44:16.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479878+0000", 2024-04-26T10:44:16.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.6150000000000003e-06 2024-04-26T10:44:16.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:16.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479935+0000", 2024-04-26T10:44:16.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7766999999999998e-05 2024-04-26T10:44:16.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:16.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479960+0000", 2024-04-26T10:44:16.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4343000000000001e-05 2024-04-26T10:44:16.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:16.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.486332+0000", 2024-04-26T10:44:16.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0063727610000000002 2024-04-26T10:44:16.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:16.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.486378+0000", 2024-04-26T10:44:16.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.5334000000000003e-05 2024-04-26T10:44:16.431 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.431 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:16.432 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.432 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:1953 4.2f 4:f64fcecc:::10000000aae.00000000:head [write 0~703] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:44:16.432 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:15.762425+0000", 2024-04-26T10:44:16.432 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.58007874400000004, 2024-04-26T10:44:16.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0012756670000000001, 2024-04-26T10:44:16.432 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:16.432 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.432 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:16.432 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:16.432 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:16.432 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 1953 2024-04-26T10:44:16.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.433 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:16.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.433 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:16.433 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.762425+0000", 2024-04-26T10:44:16.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.433 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.433 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:16.433 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.762425+0000", 2024-04-26T10:44:16.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.433 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.433 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:16.433 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.762424+0000", 2024-04-26T10:44:16.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:16.434 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.434 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:16.434 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.762429+0000", 2024-04-26T10:44:16.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6e-06 2024-04-26T10:44:16.434 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.434 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:16.434 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.762440+0000", 2024-04-26T10:44:16.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.094e-05 2024-04-26T10:44:16.434 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.434 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.762445+0000", 2024-04-26T10:44:16.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.2780000000000001e-06 2024-04-26T10:44:16.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:16.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.762480+0000", 2024-04-26T10:44:16.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4996999999999997e-05 2024-04-26T10:44:16.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:16.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.762588+0000", 2024-04-26T10:44:16.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000107817 2024-04-26T10:44:16.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:16.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.762708+0000", 2024-04-26T10:44:16.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00011972 2024-04-26T10:44:16.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:16.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.763284+0000", 2024-04-26T10:44:16.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00057604900000000003 2024-04-26T10:44:16.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:16.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.763620+0000", 2024-04-26T10:44:16.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00033604300000000001 2024-04-26T10:44:16.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.437 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:16.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.763659+0000", 2024-04-26T10:44:16.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9050000000000001e-05 2024-04-26T10:44:16.437 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.437 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:16.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.763701+0000", 2024-04-26T10:44:16.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1943000000000001e-05 2024-04-26T10:44:16.437 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.437 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:16.437 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.437 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.437 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(client.4532.0:1973 4.38 e52/37 4:1c9ec4cf:::10000000ac5.00000000:head v 52'27, mlcod=52'25)", 2024-04-26T10:44:16.437 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:15.784505+0000", 2024-04-26T10:44:16.438 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.55799883500000003, 2024-04-26T10:44:16.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001174661, 2024-04-26T10:44:16.438 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:16.438 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.438 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:16.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.438 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:16.438 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.784505+0000", 2024-04-26T10:44:16.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.438 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.438 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:16.438 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.784505+0000", 2024-04-26T10:44:16.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.784505+0000", 2024-04-26T10:44:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.784522+0000", 2024-04-26T10:44:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.7762e-05 2024-04-26T10:44:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.784532+0000", 2024-04-26T10:44:16.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5470000000000002e-06 2024-04-26T10:44:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.784536+0000", 2024-04-26T10:44:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9940000000000002e-06 2024-04-26T10:44:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.784586+0000", 2024-04-26T10:44:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9999e-05 2024-04-26T10:44:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.784600+0000", 2024-04-26T10:44:16.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.3668e-05 2024-04-26T10:44:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.785652+0000", 2024-04-26T10:44:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010521910000000001 2024-04-26T10:44:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.785680+0000", 2024-04-26T10:44:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8079e-05 2024-04-26T10:44:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.442 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:2011 4.37 4:ef08c8d3:::10000000af1.00000000:head [write 0~15216] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:44:16.442 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:15.825166+0000", 2024-04-26T10:44:16.442 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.51733824299999998, 2024-04-26T10:44:16.442 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001153025, 2024-04-26T10:44:16.442 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:16.442 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.442 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:16.442 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:16.442 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:16.442 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 2011 2024-04-26T10:44:16.442 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.442 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:16.442 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.442 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:16.443 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.825166+0000", 2024-04-26T10:44:16.443 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.443 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.443 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.443 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:16.443 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.825166+0000", 2024-04-26T10:44:16.443 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.443 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.443 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.443 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:16.443 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.825165+0000", 2024-04-26T10:44:16.443 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:16.443 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.443 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.444 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:16.444 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.825181+0000", 2024-04-26T10:44:16.444 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6229999999999999e-05 2024-04-26T10:44:16.444 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.444 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.444 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:16.444 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.825191+0000", 2024-04-26T10:44:16.444 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5489999999999995e-06 2024-04-26T10:44:16.444 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.444 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.444 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.444 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.825195+0000", 2024-04-26T10:44:16.444 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.5639999999999998e-06 2024-04-26T10:44:16.444 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.445 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.445 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:16.445 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.825234+0000", 2024-04-26T10:44:16.445 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9205000000000002e-05 2024-04-26T10:44:16.445 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.445 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.445 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:16.445 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.825342+0000", 2024-04-26T10:44:16.445 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000107243 2024-04-26T10:44:16.445 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.445 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.445 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:16.445 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.825460+0000", 2024-04-26T10:44:16.445 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000118731 2024-04-26T10:44:16.445 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.446 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.446 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:16.446 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.825965+0000", 2024-04-26T10:44:16.446 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00050464599999999998 2024-04-26T10:44:16.446 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.446 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.446 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:16.446 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.826272+0000", 2024-04-26T10:44:16.446 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00030676999999999999 2024-04-26T10:44:16.446 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.446 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.446 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:16.446 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.826300+0000", 2024-04-26T10:44:16.446 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7844999999999999e-05 2024-04-26T10:44:16.447 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.447 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.447 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:16.447 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.826319+0000", 2024-04-26T10:44:16.447 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9103999999999999e-05 2024-04-26T10:44:16.447 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.447 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:16.447 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.447 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.447 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.447 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:2066 4.2f 4:f6db8bee:::10000000b37.00000000:head [write 0~1587] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:44:16.447 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:15.890902+0000", 2024-04-26T10:44:16.447 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.451601482, 2024-04-26T10:44:16.447 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013526860000000001, 2024-04-26T10:44:16.447 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:16.448 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.448 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:16.448 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:16.448 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:16.448 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 2066 2024-04-26T10:44:16.448 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.448 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:16.448 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.448 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:16.448 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.890902+0000", 2024-04-26T10:44:16.448 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.448 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.448 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.448 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:16.449 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.890902+0000", 2024-04-26T10:44:16.449 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.449 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.449 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.449 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:16.449 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.890901+0000", 2024-04-26T10:44:16.449 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:16.449 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.449 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.449 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:16.449 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.890915+0000", 2024-04-26T10:44:16.449 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4382999999999999e-05 2024-04-26T10:44:16.449 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.449 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.449 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:16.450 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.890944+0000", 2024-04-26T10:44:16.450 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8696000000000001e-05 2024-04-26T10:44:16.450 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.450 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.450 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.450 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.890958+0000", 2024-04-26T10:44:16.450 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4620000000000001e-05 2024-04-26T10:44:16.450 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.450 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.450 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:16.450 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.891041+0000", 2024-04-26T10:44:16.450 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3065000000000005e-05 2024-04-26T10:44:16.450 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.450 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.451 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:16.451 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.891255+0000", 2024-04-26T10:44:16.451 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00021409599999999999 2024-04-26T10:44:16.451 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.451 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.451 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:16.451 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.891328+0000", 2024-04-26T10:44:16.451 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.2657000000000006e-05 2024-04-26T10:44:16.451 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.451 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.451 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:16.451 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.891796+0000", 2024-04-26T10:44:16.451 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00046812699999999999 2024-04-26T10:44:16.451 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.451 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.452 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:16.452 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.892205+0000", 2024-04-26T10:44:16.452 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00040917500000000001 2024-04-26T10:44:16.452 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.452 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.452 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:16.452 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.892236+0000", 2024-04-26T10:44:16.452 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0477999999999999e-05 2024-04-26T10:44:16.452 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.452 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.452 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:16.452 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:15.892255+0000", 2024-04-26T10:44:16.452 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9324999999999999e-05 2024-04-26T10:44:16.452 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.452 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:16.453 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.453 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.453 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.453 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:2258 4.2f 4:f4081772:::10000000c21.00000000:head [write 0~1992] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:44:16.453 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:16.101130+0000", 2024-04-26T10:44:16.453 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.241373697, 2024-04-26T10:44:16.453 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001222608, 2024-04-26T10:44:16.453 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:16.453 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.453 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:16.453 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:16.453 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:16.453 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 2258 2024-04-26T10:44:16.453 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.454 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:16.454 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.454 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:16.454 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.101130+0000", 2024-04-26T10:44:16.454 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.454 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.454 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.454 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:16.454 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.101130+0000", 2024-04-26T10:44:16.454 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:16.454 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.454 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.454 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:16.454 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.101130+0000", 2024-04-26T10:44:16.454 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:16.455 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.455 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.455 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:16.455 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.101134+0000", 2024-04-26T10:44:16.455 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9230000000000001e-06 2024-04-26T10:44:16.455 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.455 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.455 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:16.455 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.101144+0000", 2024-04-26T10:44:16.455 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9580000000000002e-06 2024-04-26T10:44:16.455 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.455 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.455 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.455 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.101149+0000", 2024-04-26T10:44:16.456 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0289999999999996e-06 2024-04-26T10:44:16.456 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.456 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.456 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:16.456 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.101185+0000", 2024-04-26T10:44:16.456 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5407999999999997e-05 2024-04-26T10:44:16.456 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.456 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.456 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:16.456 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.101303+0000", 2024-04-26T10:44:16.456 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00011809800000000001 2024-04-26T10:44:16.456 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.456 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.456 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:16.456 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.101424+0000", 2024-04-26T10:44:16.457 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012060799999999999 2024-04-26T10:44:16.457 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.457 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.457 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:16.457 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.101994+0000", 2024-04-26T10:44:16.457 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00057026899999999998 2024-04-26T10:44:16.457 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.457 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.457 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:16.457 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.102281+0000", 2024-04-26T10:44:16.457 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00028743099999999999 2024-04-26T10:44:16.457 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.457 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.457 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:16.457 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.102321+0000", 2024-04-26T10:44:16.458 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9926999999999999e-05 2024-04-26T10:44:16.458 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:16.458 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:16.458 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:16.458 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.102353+0000", 2024-04-26T10:44:16.458 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1677000000000002e-05 2024-04-26T10:44:16.458 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.458 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:16.458 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.458 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:16.458 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:16.458 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:16.460 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:16.459+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:16.461 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:16.560 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:16.559+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:16.574 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:16.574 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:16.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.575 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:2713 4.22 4:44ce4017:::10000000df1.00000000:head [write 0~2663 in=2663b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:44:16.575 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:16.572898+0000", 2024-04-26T10:44:16.575 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.000601112, 2024-04-26T10:44:16.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00061891300000000002, 2024-04-26T10:44:16.575 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:16.575 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:16.575 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:16.576 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:16.576 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:16.576 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 2713 2024-04-26T10:44:16.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.576 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:16.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:16.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.572898+0000", 2024-04-26T10:44:16.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:16.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.572898+0000", 2024-04-26T10:44:16.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.580 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:16.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.572898+0000", 2024-04-26T10:44:16.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:16.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:16.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.572904+0000", 2024-04-26T10:44:16.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4670000000000001e-06 2024-04-26T10:44:16.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:16.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.572917+0000", 2024-04-26T10:44:16.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.274e-05 2024-04-26T10:44:16.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.572922+0000", 2024-04-26T10:44:16.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1120000000000004e-06 2024-04-26T10:44:16.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:16.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.572954+0000", 2024-04-26T10:44:16.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1958000000000001e-05 2024-04-26T10:44:16.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:16.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.573039+0000", 2024-04-26T10:44:16.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5297999999999995e-05 2024-04-26T10:44:16.584 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.585 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:16.585 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.585 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.585 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-26T10:44:16.585 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 1 2024-04-26T10:44:16.585 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:16.587 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:16.661 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:16.660+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:16.743 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:16.744 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:16.744 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:16.744 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:16.744 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:16.754 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:16.762 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:16.761+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:16.862 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:16.862+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:16.873 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:16.873 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:16.873 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:16.873 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:16.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.873 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:16.873 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:16.873 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 110.835030385, 2024-04-26T10:44:16.873 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:44:16.873 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:16.874 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.874 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:16.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.874 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:16.874 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:16.874 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.874 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:16.874 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:16.874 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.874 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:16.874 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:16.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:16.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:16.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:44:16.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:44:16.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:16.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:44:16.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:44:16.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.876 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:44:16.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:44:16.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.876 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:16.876 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:44:16.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:44:16.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.876 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:16.876 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:44:16.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:44:16.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.876 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:16.876 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:44:16.877 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:44:16.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.877 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:16.877 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:44:16.877 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:44:16.877 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.877 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:16.877 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.877 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:16.877 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:16.878 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 110.833280264, 2024-04-26T10:44:16.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:44:16.878 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:16.878 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.878 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:16.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.878 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:16.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:16.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.878 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:16.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:16.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:16.879 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:44:16.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:16.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:16.879 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:44:16.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:44:16.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:16.879 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:44:16.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:44:16.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.880 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.880 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:44:16.880 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:44:16.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.880 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:16.880 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:44:16.880 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:44:16.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.880 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:16.880 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:44:16.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:44:16.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:16.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:44:16.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:44:16.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:16.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:44:16.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:44:16.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:16.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:44:16.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:44:16.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.882 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:16.882 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:44:16.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:44:16.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.882 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:16.882 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:44:16.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:44:16.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.882 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:16.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.883 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:16.883 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:16.883 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 110.83322726599999, 2024-04-26T10:44:16.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:44:16.883 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:16.883 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.883 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:16.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:16.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:16.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:16.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:16.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.884 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:16.884 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:16.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:16.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.884 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:16.884 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:44:16.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:44:16.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:16.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:44:16.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:44:16.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:44:16.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:44:16.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:16.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:44:16.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:44:16.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:16.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:44:16.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:44:16.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:16.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:44:16.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:44:16.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:16.887 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:44:16.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:44:16.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:16.887 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:44:16.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:44:16.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:16.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:44:16.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:44:16.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:16.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:44:16.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:44:16.888 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.888 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:16.888 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.889 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:16.889 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:16.889 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 110.833149522, 2024-04-26T10:44:16.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:44:16.889 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:16.889 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.889 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:16.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.889 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:16.889 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:16.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:16.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:16.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:16.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:44:16.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:16.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:16.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:44:16.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:44:16.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:16.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:44:16.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:44:16.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:44:16.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:44:16.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:16.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:44:16.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:44:16.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:16.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:44:16.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:44:16.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:16.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:44:16.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:44:16.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:16.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:44:16.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:44:16.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:16.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:44:16.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:44:16.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:16.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:44:16.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:44:16.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:16.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:44:16.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:44:16.895 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.895 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:16.895 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.895 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:16.895 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:16.895 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 110.833110516, 2024-04-26T10:44:16.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:44:16.895 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:16.895 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.896 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:16.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:16.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:16.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:16.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:16.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:16.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:44:16.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:16.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:16.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:44:16.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:44:16.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:16.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:44:16.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:44:16.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:44:16.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:44:16.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:16.898 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:44:16.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:44:16.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:16.898 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:44:16.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:44:16.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:16.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:44:16.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:44:16.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:16.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:44:16.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:44:16.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:16.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:44:16.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:44:16.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:16.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:44:16.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:44:16.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:16.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:44:16.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:44:16.900 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.900 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:16.900 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.901 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:16.901 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:16.901 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 110.83309169499999, 2024-04-26T10:44:16.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:44:16.901 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:16.901 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.901 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:16.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:16.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:16.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:16.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:16.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:16.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:16.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:16.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:16.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:44:16.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:44:16.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:16.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:44:16.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:44:16.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:44:16.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:44:16.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:16.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:44:16.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:44:16.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:16.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:44:16.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:44:16.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:16.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:44:16.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:44:16.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:16.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:44:16.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:44:16.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:16.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:44:16.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:44:16.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:16.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:44:16.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:44:16.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:16.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:44:16.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:44:16.906 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.906 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:16.906 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.906 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:16.906 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:16.906 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 110.833059693, 2024-04-26T10:44:16.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:44:16.906 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:16.906 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.907 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:16.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:16.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:16.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:16.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:16.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:16.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:44:16.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:16.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:16.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:44:16.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:44:16.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:16.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:44:16.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:44:16.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:44:16.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:44:16.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:16.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:44:16.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:44:16.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:16.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:44:16.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:44:16.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:16.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:44:16.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:44:16.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:16.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:44:16.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:44:16.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:16.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:44:16.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:44:16.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:16.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:44:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:44:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:44:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:44:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 110.832850885, 2024-04-26T10:44:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:44:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:16.912 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.912 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:16.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:16.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:16.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:16.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:16.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:16.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:44:16.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:16.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:16.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:44:16.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:44:16.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:16.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:44:16.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:44:16.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:44:16.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:44:16.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:16.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:44:16.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:44:16.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:16.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:44:16.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:44:16.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:16.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:44:16.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:44:16.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:16.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:44:16.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:44:16.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:16.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:44:16.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:44:16.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:16.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:44:16.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:44:16.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:16.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:44:16.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:44:16.916 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.916 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:16.917 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.917 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:16.917 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:16.917 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 110.832819594, 2024-04-26T10:44:16.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:44:16.917 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:16.917 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:16.917 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:16.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:16.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:16.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:16.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:16.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:16.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:44:16.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:16.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:16.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:44:16.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:44:16.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:16.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:44:16.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:44:16.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:44:16.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:44:16.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:16.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:44:16.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:44:16.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:16.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:44:16.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:44:16.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:16.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:44:16.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:44:16.920 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.921 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:16.921 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.921 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:16.921 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:16.921 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 110.832792344, 2024-04-26T10:44:16.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:44:16.921 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:16.921 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:16.921 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:16.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:16.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:16.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:16.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:16.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:16.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:16.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:16.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:16.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:44:16.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:44:16.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:16.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:44:16.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:44:16.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:44:16.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:44:16.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:16.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:44:16.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:44:16.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:16.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:44:16.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:44:16.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:16.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:44:16.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:44:16.924 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.924 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:16.924 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.925 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:16.925 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:16.925 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 110.830015593, 2024-04-26T10:44:16.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:44:16.925 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:16.925 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:44:16.925 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:16.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:16.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:16.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:16.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:16.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:16.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:44:16.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:16.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:16.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:44:16.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:44:16.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:16.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:44:16.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:44:16.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:44:16.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:44:16.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:16.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:44:16.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:44:16.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:16.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:44:16.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:44:16.927 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.928 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:16.928 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.928 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:16.928 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:16.928 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 110.829965504, 2024-04-26T10:44:16.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:44:16.928 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:16.928 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.928 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:16.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:16.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:16.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:16.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:16.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:16.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:44:16.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:16.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:16.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:44:16.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:44:16.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:16.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:44:16.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:44:16.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:44:16.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:44:16.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:16.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:44:16.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:44:16.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:16.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:44:16.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:44:16.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:16.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:44:16.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:44:16.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:16.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:44:16.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:44:16.932 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.932 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:16.932 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.932 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:16.932 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:16.932 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 110.829073435, 2024-04-26T10:44:16.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:44:16.932 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:16.932 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.932 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:16.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:16.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:16.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:16.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:16.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:16.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:44:16.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:16.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:16.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:44:16.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:44:16.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:16.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:44:16.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:44:16.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:44:16.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:44:16.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:16.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:44:16.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:44:16.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:16.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:44:16.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:44:16.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:16.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:44:16.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:44:16.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:16.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:44:16.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:16.936 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.936 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:16.936 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.936 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:44:16.936 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:16.936 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 110.82688510600001, 2024-04-26T10:44:16.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:44:16.936 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:16.937 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.937 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:16.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:16.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:16.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:16.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:16.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:16.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:16.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:16.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:16.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:44:16.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:44:16.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:16.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:44:16.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:44:16.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:44:16.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:44:16.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:16.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:44:16.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:44:16.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:16.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:44:16.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:44:16.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:16.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:44:16.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:44:16.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:16.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:44:16.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:44:16.940 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.940 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:16.941 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.941 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:44:16.941 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:16.941 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 110.826749736, 2024-04-26T10:44:16.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:44:16.941 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:16.941 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.941 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:16.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:16.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:16.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:16.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:16.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:16.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:44:16.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:16.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:16.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:44:16.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:44:16.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:16.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:44:16.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:44:16.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:44:16.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:44:16.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:16.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:44:16.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:44:16.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:16.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:44:16.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:44:16.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:16.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:44:16.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:44:16.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:16.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:44:16.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:44:16.945 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.945 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:16.945 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.945 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:44:16.946 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:13.306328+0000", 2024-04-26T10:44:16.946 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.5645990759999999, 2024-04-26T10:44:16.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012467232999999999, 2024-04-26T10:44:16.946 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:16.946 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.946 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:16.946 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:16.946 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:16.946 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 4 2024-04-26T10:44:16.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.946 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:16.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:16.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.306328+0000", 2024-04-26T10:44:16.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:16.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.306328+0000", 2024-04-26T10:44:16.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:16.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.306325+0000", 2024-04-26T10:44:16.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999971 2024-04-26T10:44:16.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:16.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313008+0000", 2024-04-26T10:44:16.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0066830450000000003 2024-04-26T10:44:16.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:16.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313032+0000", 2024-04-26T10:44:16.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3034e-05 2024-04-26T10:44:16.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313041+0000", 2024-04-26T10:44:16.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.037e-06 2024-04-26T10:44:16.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:16.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313086+0000", 2024-04-26T10:44:16.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5259000000000002e-05 2024-04-26T10:44:16.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.950 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:16.950 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313156+0000", 2024-04-26T10:44:16.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0504000000000001e-05 2024-04-26T10:44:16.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.950 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:16.950 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.318691+0000", 2024-04-26T10:44:16.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0055346370000000002 2024-04-26T10:44:16.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.950 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:16.950 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.318724+0000", 2024-04-26T10:44:16.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3300000000000003e-05 2024-04-26T10:44:16.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:16.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.318796+0000", 2024-04-26T10:44:16.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1316999999999995e-05 2024-04-26T10:44:16.951 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.951 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:16.951 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.951 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:44:16.951 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:13.469171+0000", 2024-04-26T10:44:16.951 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.4017564399999998, 2024-04-26T10:44:16.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017514674000000001, 2024-04-26T10:44:16.951 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:16.951 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.951 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:16.952 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:16.952 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:16.952 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 5 2024-04-26T10:44:16.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.952 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:16.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:16.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.469171+0000", 2024-04-26T10:44:16.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:16.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.469171+0000", 2024-04-26T10:44:16.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:16.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.469168+0000", 2024-04-26T10:44:16.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999971 2024-04-26T10:44:16.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:16.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.474986+0000", 2024-04-26T10:44:16.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0058177690000000004 2024-04-26T10:44:16.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:16.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475001+0000", 2024-04-26T10:44:16.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5349000000000002e-05 2024-04-26T10:44:16.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475009+0000", 2024-04-26T10:44:16.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.3579999999999997e-06 2024-04-26T10:44:16.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:16.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475157+0000", 2024-04-26T10:44:16.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014815 2024-04-26T10:44:16.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:16.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475325+0000", 2024-04-26T10:44:16.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00016793299999999999 2024-04-26T10:44:16.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:16.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475461+0000", 2024-04-26T10:44:16.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00013602800000000001 2024-04-26T10:44:16.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:16.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.483044+0000", 2024-04-26T10:44:16.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0075827309999999997 2024-04-26T10:44:16.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:16.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.486538+0000", 2024-04-26T10:44:16.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0034942739999999999 2024-04-26T10:44:16.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:16.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.486596+0000", 2024-04-26T10:44:16.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8019999999999997e-05 2024-04-26T10:44:16.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:16.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.486686+0000", 2024-04-26T10:44:16.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9702000000000003e-05 2024-04-26T10:44:16.957 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.957 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:16.957 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.957 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:44:16.957 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:13.475021+0000", 2024-04-26T10:44:16.957 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.3959065939999999, 2024-04-26T10:44:16.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0084663459999999996, 2024-04-26T10:44:16.957 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:16.957 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.957 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:16.957 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:16.958 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:16.958 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 6 2024-04-26T10:44:16.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.958 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:16.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:16.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475021+0000", 2024-04-26T10:44:16.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:16.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475021+0000", 2024-04-26T10:44:16.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:16.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475020+0000", 2024-04-26T10:44:16.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:16.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:16.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480334+0000", 2024-04-26T10:44:16.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053142500000000004 2024-04-26T10:44:16.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:16.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480354+0000", 2024-04-26T10:44:16.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.931e-05 2024-04-26T10:44:16.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480365+0000", 2024-04-26T10:44:16.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1477999999999999e-05 2024-04-26T10:44:16.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:16.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480420+0000", 2024-04-26T10:44:16.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4802000000000001e-05 2024-04-26T10:44:16.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:16.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480596+0000", 2024-04-26T10:44:16.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000175806 2024-04-26T10:44:16.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:16.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.483338+0000", 2024-04-26T10:44:16.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0027423730000000002 2024-04-26T10:44:16.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:16.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.483389+0000", 2024-04-26T10:44:16.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0662999999999999e-05 2024-04-26T10:44:16.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:16.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.483487+0000", 2024-04-26T10:44:16.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.8350000000000005e-05 2024-04-26T10:44:16.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.962 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:16.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.962 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:63 3.1b 3:ddb4e4d7:::200.00000002:head [write 0~1908408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T10:44:16.963 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:16.502931+0000", 2024-04-26T10:44:16.963 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.36799634599999997, 2024-04-26T10:44:16.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0055555680000000003, 2024-04-26T10:44:16.963 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:16.963 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.963 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:16.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:16.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.502931+0000", 2024-04-26T10:44:16.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:16.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.502931+0000", 2024-04-26T10:44:16.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:16.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.502930+0000", 2024-04-26T10:44:16.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:16.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:16.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.505184+0000", 2024-04-26T10:44:16.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022540419999999999 2024-04-26T10:44:16.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:16.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.505199+0000", 2024-04-26T10:44:16.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4260999999999999e-05 2024-04-26T10:44:16.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.505207+0000", 2024-04-26T10:44:16.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4589999999999998e-06 2024-04-26T10:44:16.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:16.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.505277+0000", 2024-04-26T10:44:16.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9575999999999999e-05 2024-04-26T10:44:16.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:16.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.505347+0000", 2024-04-26T10:44:16.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0741999999999995e-05 2024-04-26T10:44:16.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:16.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.508408+0000", 2024-04-26T10:44:16.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030602720000000002 2024-04-26T10:44:16.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:16.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.508439+0000", 2024-04-26T10:44:16.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0892999999999997e-05 2024-04-26T10:44:16.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:16.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.508487+0000", 2024-04-26T10:44:16.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8121999999999998e-05 2024-04-26T10:44:16.967 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.967 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:16.967 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.967 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:65 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T10:44:16.967 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:16.510703+0000", 2024-04-26T10:44:16.967 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.360224139, 2024-04-26T10:44:16.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012272897, 2024-04-26T10:44:16.967 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:16.967 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:16.967 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:16.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:16.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.510703+0000", 2024-04-26T10:44:16.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:16.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.510703+0000", 2024-04-26T10:44:16.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:16.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:16.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.510702+0000", 2024-04-26T10:44:16.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:16.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:16.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.511120+0000", 2024-04-26T10:44:16.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00041818600000000002 2024-04-26T10:44:16.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:16.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.511131+0000", 2024-04-26T10:44:16.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0900999999999999e-05 2024-04-26T10:44:16.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:16.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.511139+0000", 2024-04-26T10:44:16.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7160000000000003e-06 2024-04-26T10:44:16.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:16.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.511174+0000", 2024-04-26T10:44:16.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.5499e-05 2024-04-26T10:44:16.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:16.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.511226+0000", 2024-04-26T10:44:16.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.168e-05 2024-04-26T10:44:16.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.517346+0000", 2024-04-26T10:44:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061201149999999998 2024-04-26T10:44:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.522622+0000", 2024-04-26T10:44:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0052753440000000004 2024-04-26T10:44:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.522878+0000", 2024-04-26T10:44:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00025625300000000001 2024-04-26T10:44:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.522920+0000", 2024-04-26T10:44:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2620000000000002e-05 2024-04-26T10:44:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.522976+0000", 2024-04-26T10:44:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5682e-05 2024-04-26T10:44:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:16.972 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:16.972 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:16.974 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:16.974 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:16.973+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:17.075 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:17.074+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:17.083 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:17.083 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:17.083 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.084 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:3222 4.2f 4:f76bf1d3:::10000000ffa.00000000:head [write 0~12637 in=12637b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:44:17.084 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:17.082572+0000", 2024-04-26T10:44:17.084 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.00030247899999999997, 2024-04-26T10:44:17.084 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00033016799999999999, 2024-04-26T10:44:17.084 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:17.084 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:44:17.084 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:17.084 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:17.084 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:17.084 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 3222 2024-04-26T10:44:17.084 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.084 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:17.084 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.084 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:17.085 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.082572+0000", 2024-04-26T10:44:17.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.085 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.085 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.085 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:17.085 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.082572+0000", 2024-04-26T10:44:17.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.085 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.085 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.085 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:17.085 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.082571+0000", 2024-04-26T10:44:17.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:17.085 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.085 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.085 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:17.086 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.082584+0000", 2024-04-26T10:44:17.086 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2794e-05 2024-04-26T10:44:17.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.086 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.086 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:17.086 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.082593+0000", 2024-04-26T10:44:17.086 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9139999999999997e-06 2024-04-26T10:44:17.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.086 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.086 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.086 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.082598+0000", 2024-04-26T10:44:17.086 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0599999999999998e-06 2024-04-26T10:44:17.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.086 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.087 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:17.087 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.082638+0000", 2024-04-26T10:44:17.087 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0037999999999999e-05 2024-04-26T10:44:17.087 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.087 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.087 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:17.087 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.082719+0000", 2024-04-26T10:44:17.087 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1017e-05 2024-04-26T10:44:17.087 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.087 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.087 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:17.087 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.082792+0000", 2024-04-26T10:44:17.087 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.25e-05 2024-04-26T10:44:17.087 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.087 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:17.088 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.088 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.088 INFO:teuthology.orchestra.run.smithi195.stdout: ], 2024-04-26T10:44:17.088 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 1 2024-04-26T10:44:17.088 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:17.094 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:17.175 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:17.174+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:17.204 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:17.204 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:17.204 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:17.204 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:17.204 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:17.213 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:17.276 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:17.276+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:17.328 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:17.328 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:17.328 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:17.328 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:17.328 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.328 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:17.328 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:17.328 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 111.28941870600001, 2024-04-26T10:44:17.328 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:44:17.328 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:17.328 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.328 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:17.328 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.328 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:17.328 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:17.329 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.329 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.329 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.329 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:17.329 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:17.329 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.329 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.329 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.329 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:17.329 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:44:17.329 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:17.329 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.329 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.329 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:17.329 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:44:17.330 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:44:17.330 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.330 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.330 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:17.330 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:44:17.330 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:44:17.330 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.330 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.330 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.330 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:44:17.330 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:44:17.330 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.330 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.330 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:17.330 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:44:17.330 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:44:17.331 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.331 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.331 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:17.331 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:44:17.331 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:44:17.331 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.331 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.331 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:17.331 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:44:17.331 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:44:17.331 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.331 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.331 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:17.331 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:44:17.331 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:44:17.331 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.332 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:17.332 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.332 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.332 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.332 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:17.332 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:17.332 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 111.28854792600001, 2024-04-26T10:44:17.332 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:44:17.332 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:17.332 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.332 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:17.332 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.332 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:17.332 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:17.332 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.333 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.333 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.333 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:17.333 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:17.333 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.333 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.333 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.333 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:17.333 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:17.333 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:17.333 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.333 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.333 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:17.333 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:44:17.333 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:44:17.333 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.333 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.334 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:17.334 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:44:17.334 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:44:17.334 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.334 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.334 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.334 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:44:17.334 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:44:17.334 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.334 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.334 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:17.334 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:44:17.335 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:44:17.335 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.335 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.335 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:17.335 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:44:17.336 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:44:17.336 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.336 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.336 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:17.336 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:44:17.337 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:44:17.337 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.337 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.337 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:17.337 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:44:17.337 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:44:17.337 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.337 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:17.337 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.337 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.337 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.337 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:17.337 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:17.337 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 111.287560583, 2024-04-26T10:44:17.338 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:44:17.338 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:17.338 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.338 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:17.338 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.338 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:17.338 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:17.338 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.338 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.338 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.338 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:17.338 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:17.338 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.338 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.339 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.339 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:17.339 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:44:17.339 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:17.339 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.339 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.339 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:17.339 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:44:17.339 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:44:17.339 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.339 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.339 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:17.339 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:44:17.339 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:44:17.339 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.340 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.340 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.340 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:44:17.340 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:44:17.340 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.340 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.340 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:17.340 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:44:17.340 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:44:17.340 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.340 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.340 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:17.340 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:44:17.340 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:44:17.340 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.341 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.341 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:17.341 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:44:17.341 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:44:17.341 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.341 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.341 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:17.341 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:44:17.341 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:44:17.341 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.341 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:17.341 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.341 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.341 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.342 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:17.342 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:17.342 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 111.287034439, 2024-04-26T10:44:17.342 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:44:17.342 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:17.342 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.342 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:17.342 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.342 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:17.342 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:17.342 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.342 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.342 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.342 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:17.343 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:17.343 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.343 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.343 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.343 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:17.343 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:44:17.343 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:17.343 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.343 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.343 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:17.343 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:44:17.343 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:44:17.343 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.344 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.344 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:17.344 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:44:17.344 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:44:17.344 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.344 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.344 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.344 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:44:17.344 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:44:17.344 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.344 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.344 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:17.344 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:44:17.344 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:44:17.345 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.345 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.345 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:17.345 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:44:17.345 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:44:17.345 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.345 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.345 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:17.345 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:44:17.345 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:44:17.345 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.345 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.345 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:17.345 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:44:17.346 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:44:17.346 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.346 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.346 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:17.346 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:44:17.346 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:44:17.346 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.346 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.346 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:17.346 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:44:17.346 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:44:17.346 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.346 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.346 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:17.347 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:44:17.347 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:44:17.347 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.347 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:17.347 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.347 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.347 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.347 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:17.347 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:17.347 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 111.286982615, 2024-04-26T10:44:17.347 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:44:17.347 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:17.347 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.347 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:17.348 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.348 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:17.348 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:17.348 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.348 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.348 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.348 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:17.348 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:17.348 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.348 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.348 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.348 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:17.348 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:44:17.348 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:17.348 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.349 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.349 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:17.349 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:44:17.349 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:44:17.349 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.349 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.349 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:17.349 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:44:17.349 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:44:17.349 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.349 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.349 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.349 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:44:17.349 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:44:17.350 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.350 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.350 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:17.350 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:44:17.350 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:44:17.350 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.350 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.350 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:17.350 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:44:17.350 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:44:17.350 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.350 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.350 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:17.350 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:44:17.351 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:44:17.351 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.351 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.351 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:17.351 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:44:17.351 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:44:17.351 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.352 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.352 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:17.352 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:44:17.352 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:44:17.353 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.353 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.353 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:17.353 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:44:17.353 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:44:17.353 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.353 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.354 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:17.354 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:44:17.354 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:44:17.354 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.354 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:17.354 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.354 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.354 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.354 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:17.354 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:17.355 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 111.286929243, 2024-04-26T10:44:17.355 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:44:17.355 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:17.355 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.355 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:17.355 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.355 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:17.355 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:17.355 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.355 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.355 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.355 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:17.355 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:17.356 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.356 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.356 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:17.356 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:17.356 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:17.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.357 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.357 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:17.357 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:44:17.357 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:44:17.357 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.357 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.357 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:17.357 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:44:17.358 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:44:17.358 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.358 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.358 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.358 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:44:17.358 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:44:17.359 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.359 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.359 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:17.359 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:44:17.359 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:44:17.359 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.359 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.359 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:17.359 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:44:17.359 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:44:17.359 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.359 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.359 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:17.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:44:17.360 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:44:17.360 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.360 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:17.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:44:17.360 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:44:17.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.361 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.361 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:17.361 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:44:17.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:44:17.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.362 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.362 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:17.362 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:44:17.362 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:44:17.362 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.362 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.362 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:17.363 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:44:17.363 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:44:17.363 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.363 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:17.363 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.363 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.364 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.364 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:17.364 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:17.364 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 111.28688491600001, 2024-04-26T10:44:17.364 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:44:17.364 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:17.365 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.365 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:17.365 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.365 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:17.365 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:17.365 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.366 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.366 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.366 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:17.366 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:17.366 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.366 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.366 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.366 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:17.366 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:17.366 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:17.367 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.367 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.367 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:17.367 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:44:17.367 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:44:17.367 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.367 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.367 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:17.367 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:44:17.367 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:44:17.367 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.367 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.367 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.367 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:44:17.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:44:17.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.368 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:17.368 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:44:17.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:44:17.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.368 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:17.368 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:44:17.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:44:17.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:17.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:44:17.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:44:17.369 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.369 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:17.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:44:17.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:44:17.369 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.369 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:17.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:44:17.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:44:17.369 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.370 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.370 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:17.370 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:44:17.370 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:44:17.370 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.370 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.370 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:17.370 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:44:17.370 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:44:17.370 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.370 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:17.370 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.370 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.371 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.371 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:17.371 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:17.371 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 111.286861203, 2024-04-26T10:44:17.371 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:44:17.371 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:17.371 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.371 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:17.371 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.371 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:17.371 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:17.371 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.371 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.371 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.372 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:17.372 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:17.372 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.372 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.372 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.372 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:17.372 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:17.372 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:17.372 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.372 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.372 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:17.372 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:44:17.372 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:44:17.373 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.373 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.373 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:17.373 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:44:17.373 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:44:17.373 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.373 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.373 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.373 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:44:17.373 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:44:17.373 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.374 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.374 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:17.374 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:44:17.374 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:44:17.374 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.374 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.374 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:17.375 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:44:17.375 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:44:17.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.375 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.375 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:17.375 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:44:17.375 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:44:17.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.375 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.375 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:17.375 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:44:17.375 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:44:17.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.376 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.376 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:17.376 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:44:17.376 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:44:17.376 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.376 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.376 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:17.376 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:44:17.376 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:44:17.376 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.376 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.376 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:17.376 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:44:17.376 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:44:17.377 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.377 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:17.377 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.377 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.377 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.377 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:17.377 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:17.377 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 111.286826898, 2024-04-26T10:44:17.377 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:44:17.377 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:17.377 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.377 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:17.377 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.377 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:17.378 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:17.378 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.378 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.378 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.378 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:17.378 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:17.378 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.378 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.378 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.378 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:17.378 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:44:17.378 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:17.378 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.378 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.379 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:17.379 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:44:17.379 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:44:17.379 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.379 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.379 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:17.379 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:44:17.379 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:44:17.379 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.379 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.379 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.379 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:44:17.379 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:44:17.379 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:17.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:44:17.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:44:17.380 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:17.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:44:17.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:44:17.380 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:17.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:44:17.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:44:17.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:17.381 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:44:17.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:44:17.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:17.381 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:44:17.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:44:17.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:17.382 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:44:17.382 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:44:17.382 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.382 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.382 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:17.382 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:44:17.382 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:44:17.382 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.382 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:17.382 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.382 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.382 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.382 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:17.383 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:17.383 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 111.286490302, 2024-04-26T10:44:17.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:44:17.383 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:17.383 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:17.383 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:17.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.383 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:17.383 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:17.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.383 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.383 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:17.383 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:17.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.384 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:17.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:44:17.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:17.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.384 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:17.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:44:17.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:44:17.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:17.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:44:17.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:44:17.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:44:17.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:44:17.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:17.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:44:17.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:44:17.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:17.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:44:17.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:44:17.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:17.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:44:17.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:44:17.386 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.386 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:17.386 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.387 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:17.387 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:17.387 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 111.28644827399999, 2024-04-26T10:44:17.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:44:17.387 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:17.387 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:17.387 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:17.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:17.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:17.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:17.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:17.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.388 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:17.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:17.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:17.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.388 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:17.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:44:17.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:44:17.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.389 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:17.389 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:44:17.389 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:44:17.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.389 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.389 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.389 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:44:17.389 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:44:17.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.389 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.389 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:17.389 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:44:17.389 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:44:17.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.390 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.390 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:17.390 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:44:17.390 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:44:17.390 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.390 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.390 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:17.390 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:44:17.390 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:44:17.390 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.390 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:17.390 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.390 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.391 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:17.391 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:17.391 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 111.286395102, 2024-04-26T10:44:17.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:44:17.391 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:17.391 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:17.391 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:17.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:17.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:17.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:17.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:17.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:17.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:17.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:17.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:17.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:44:17.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:44:17.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:17.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:44:17.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:44:17.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:44:17.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:44:17.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:17.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:44:17.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:44:17.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:17.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:44:17.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:44:17.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:17.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:44:17.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:44:17.397 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.397 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:17.397 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.398 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:44:17.398 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:17.398 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 105.827067445, 2024-04-26T10:44:17.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:44:17.398 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:17.399 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.399 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:17.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:17.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:17.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:17.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:17.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.401 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:17.401 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:44:17.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:17.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:17.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:44:17.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:44:17.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:17.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:44:17.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:44:17.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:44:17.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:44:17.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:17.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:44:17.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:44:17.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:17.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:44:17.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:44:17.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:17.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:44:17.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:44:17.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.406 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:17.406 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:44:17.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:44:17.406 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.406 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:17.407 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:44:17.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:44:17.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.407 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:17.407 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:44:17.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:44:17.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:17.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:44:17.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:44:17.409 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.409 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:17.409 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.410 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(client.4532.0:5 4.10 e52/37 4:09a4c37f:::10000000003.00000001:head v 52'1, mlcod=0'0)", 2024-04-26T10:44:17.410 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:17.410 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 3.8503277320000002, 2024-04-26T10:44:17.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010754041000000001, 2024-04-26T10:44:17.410 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:17.410 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.411 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:17.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:17.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:17.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:17.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:17.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:17.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:17.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:44:17.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.414 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:17.414 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479849+0000", 2024-04-26T10:44:17.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004225716 2024-04-26T10:44:17.414 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.414 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:17.414 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479868+0000", 2024-04-26T10:44:17.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.8666000000000001e-05 2024-04-26T10:44:17.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479878+0000", 2024-04-26T10:44:17.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.6150000000000003e-06 2024-04-26T10:44:17.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:17.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479935+0000", 2024-04-26T10:44:17.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7766999999999998e-05 2024-04-26T10:44:17.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:17.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479960+0000", 2024-04-26T10:44:17.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4343000000000001e-05 2024-04-26T10:44:17.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:17.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.486332+0000", 2024-04-26T10:44:17.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0063727610000000002 2024-04-26T10:44:17.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:17.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.486378+0000", 2024-04-26T10:44:17.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.5334000000000003e-05 2024-04-26T10:44:17.416 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.416 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:65 3.6 e53/37 3:654134d2:::mds0_openfiles.0:head v 53'6, mlcod=48'4)", 2024-04-26T10:44:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:16.517520+0000", 2024-04-26T10:44:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.80843098499999999, 2024-04-26T10:44:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052681739999999996, 2024-04-26T10:44:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517520+0000", 2024-04-26T10:44:17.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.418 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.418 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.418 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:17.418 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517520+0000", 2024-04-26T10:44:17.418 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.418 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.418 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:17.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517520+0000", 2024-04-26T10:44:17.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:17.419 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:17.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517652+0000", 2024-04-26T10:44:17.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000132662 2024-04-26T10:44:17.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:17.420 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517662+0000", 2024-04-26T10:44:17.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7019999999999996e-06 2024-04-26T10:44:17.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517668+0000", 2024-04-26T10:44:17.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0530000000000003e-06 2024-04-26T10:44:17.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:17.422 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517730+0000", 2024-04-26T10:44:17.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2158999999999999e-05 2024-04-26T10:44:17.422 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.422 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.422 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:17.422 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517745+0000", 2024-04-26T10:44:17.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4273999999999999e-05 2024-04-26T10:44:17.422 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.422 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.422 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:17.422 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.522754+0000", 2024-04-26T10:44:17.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0050096450000000001 2024-04-26T10:44:17.422 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:17.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.522789+0000", 2024-04-26T10:44:17.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4406000000000002e-05 2024-04-26T10:44:17.423 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.423 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:17.423 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.423 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(client.4532.0:2656 4.36 e53/37 4:6dd4a55d:::10000000fae.00000000:head v 53'42, mlcod=53'40)", 2024-04-26T10:44:17.423 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:16.521267+0000", 2024-04-26T10:44:17.423 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.80468459800000003, 2024-04-26T10:44:17.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016892459999999999, 2024-04-26T10:44:17.423 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:17.423 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.424 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:17.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:17.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.521267+0000", 2024-04-26T10:44:17.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:17.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.521267+0000", 2024-04-26T10:44:17.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:17.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.521266+0000", 2024-04-26T10:44:17.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:17.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:17.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.521272+0000", 2024-04-26T10:44:17.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.366e-06 2024-04-26T10:44:17.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:17.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.521280+0000", 2024-04-26T10:44:17.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7499999999999992e-06 2024-04-26T10:44:17.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.521286+0000", 2024-04-26T10:44:17.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6949999999999997e-06 2024-04-26T10:44:17.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:17.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.521324+0000", 2024-04-26T10:44:17.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7966000000000002e-05 2024-04-26T10:44:17.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:17.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.521346+0000", 2024-04-26T10:44:17.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1474000000000001e-05 2024-04-26T10:44:17.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.427 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:17.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.522936+0000", 2024-04-26T10:44:17.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015906659999999999 2024-04-26T10:44:17.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.427 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:17.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.522956+0000", 2024-04-26T10:44:17.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9811000000000001e-05 2024-04-26T10:44:17.427 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.427 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:17.428 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.428 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(client.4532.0:2866 4.29 e53/37 4:9796eaf4:::10000000e8a.00000000:head v 53'53, mlcod=53'51)", 2024-04-26T10:44:17.428 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:16.718696+0000", 2024-04-26T10:44:17.428 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.60725579699999999, 2024-04-26T10:44:17.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001681632, 2024-04-26T10:44:17.428 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:17.428 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.428 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:17.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:17.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.718696+0000", 2024-04-26T10:44:17.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.429 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:17.429 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.718696+0000", 2024-04-26T10:44:17.429 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.429 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.429 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:17.429 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.718694+0000", 2024-04-26T10:44:17.429 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:17.429 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.429 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:17.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.719127+0000", 2024-04-26T10:44:17.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043338799999999999 2024-04-26T10:44:17.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:17.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.719138+0000", 2024-04-26T10:44:17.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.118e-05 2024-04-26T10:44:17.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.719144+0000", 2024-04-26T10:44:17.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0390000000000001e-06 2024-04-26T10:44:17.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:17.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.719186+0000", 2024-04-26T10:44:17.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1291999999999997e-05 2024-04-26T10:44:17.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:17.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.719207+0000", 2024-04-26T10:44:17.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1075000000000001e-05 2024-04-26T10:44:17.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:17.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.720354+0000", 2024-04-26T10:44:17.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001146811 2024-04-26T10:44:17.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.432 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:17.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.720377+0000", 2024-04-26T10:44:17.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3723999999999999e-05 2024-04-26T10:44:17.432 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.432 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:17.432 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.432 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:3051 4.11 4:8afd8039:::10000000f44.00000000:head [write 0~672130] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:44:17.432 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:16.898960+0000", 2024-04-26T10:44:17.432 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.42699091, 2024-04-26T10:44:17.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027624870000000001, 2024-04-26T10:44:17.433 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:17.433 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.433 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:17.433 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:17.433 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:17.433 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 3051 2024-04-26T10:44:17.433 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.433 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:17.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.433 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:17.433 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.898960+0000", 2024-04-26T10:44:17.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.434 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.434 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:17.434 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.898960+0000", 2024-04-26T10:44:17.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.434 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.434 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:17.434 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.898960+0000", 2024-04-26T10:44:17.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:17.434 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.434 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:17.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.899863+0000", 2024-04-26T10:44:17.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00090309799999999997 2024-04-26T10:44:17.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:17.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.899874+0000", 2024-04-26T10:44:17.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1269e-05 2024-04-26T10:44:17.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.899879+0000", 2024-04-26T10:44:17.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.1549999999999998e-06 2024-04-26T10:44:17.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:17.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.899925+0000", 2024-04-26T10:44:17.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6079999999999999e-05 2024-04-26T10:44:17.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:17.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.900041+0000", 2024-04-26T10:44:17.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000115308 2024-04-26T10:44:17.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:17.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.901610+0000", 2024-04-26T10:44:17.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001569467 2024-04-26T10:44:17.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.437 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:17.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.901652+0000", 2024-04-26T10:44:17.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1665000000000002e-05 2024-04-26T10:44:17.437 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.437 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:17.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.901723+0000", 2024-04-26T10:44:17.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1185000000000004e-05 2024-04-26T10:44:17.437 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.437 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:17.437 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.438 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.438 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(client.4532.0:3304 4.9 e53/37 4:93280087:::1000000104e.00000000:head v 53'57, mlcod=53'55)", 2024-04-26T10:44:17.438 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:17.170913+0000", 2024-04-26T10:44:17.438 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.15503831300000001, 2024-04-26T10:44:17.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016381709999999999, 2024-04-26T10:44:17.438 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:17.438 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.438 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:17.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.438 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:17.438 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.170913+0000", 2024-04-26T10:44:17.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:17.439 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.170913+0000", 2024-04-26T10:44:17.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:17.439 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.170913+0000", 2024-04-26T10:44:17.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:17.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:17.439 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.171375+0000", 2024-04-26T10:44:17.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00046264100000000002 2024-04-26T10:44:17.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:17.440 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.171385+0000", 2024-04-26T10:44:17.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.6339999999999996e-06 2024-04-26T10:44:17.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.440 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.171390+0000", 2024-04-26T10:44:17.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8899999999999998e-06 2024-04-26T10:44:17.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:17.440 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.171437+0000", 2024-04-26T10:44:17.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7097e-05 2024-04-26T10:44:17.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:17.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.171463+0000", 2024-04-26T10:44:17.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6709000000000001e-05 2024-04-26T10:44:17.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:17.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.172520+0000", 2024-04-26T10:44:17.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001056569 2024-04-26T10:44:17.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:17.442 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.172551+0000", 2024-04-26T10:44:17.442 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1204000000000001e-05 2024-04-26T10:44:17.442 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.442 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:17.442 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.442 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.442 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.442 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:3346 4.3c 4:3cac0111:::10000001079.00000000:head [write 0~368036] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:44:17.442 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:17.218125+0000", 2024-04-26T10:44:17.442 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.10782652700000001, 2024-04-26T10:44:17.442 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017712240000000001, 2024-04-26T10:44:17.442 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:17.442 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.443 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:17.443 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:17.443 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:17.443 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 3346 2024-04-26T10:44:17.443 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.443 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:17.443 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.443 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:17.443 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.218125+0000", 2024-04-26T10:44:17.443 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.444 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.444 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.444 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:17.444 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.218125+0000", 2024-04-26T10:44:17.444 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:17.444 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.444 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.444 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:17.444 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.218124+0000", 2024-04-26T10:44:17.444 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:17.444 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.444 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.444 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:17.444 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.218400+0000", 2024-04-26T10:44:17.445 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000276218 2024-04-26T10:44:17.445 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.445 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.445 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:17.445 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.218413+0000", 2024-04-26T10:44:17.445 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.3444999999999999e-05 2024-04-26T10:44:17.445 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.445 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.445 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.445 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.218419+0000", 2024-04-26T10:44:17.445 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3319999999999999e-06 2024-04-26T10:44:17.445 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.445 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.445 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:17.445 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.218466+0000", 2024-04-26T10:44:17.446 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7157000000000003e-05 2024-04-26T10:44:17.446 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.446 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.446 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:17.446 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.218590+0000", 2024-04-26T10:44:17.446 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012381499999999999 2024-04-26T10:44:17.446 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.446 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.446 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:17.446 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.219775+0000", 2024-04-26T10:44:17.447 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001185773 2024-04-26T10:44:17.447 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.447 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.447 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:17.447 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.219818+0000", 2024-04-26T10:44:17.447 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3031000000000002e-05 2024-04-26T10:44:17.447 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:17.447 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:17.447 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:17.447 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.219896+0000", 2024-04-26T10:44:17.447 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7688000000000006e-05 2024-04-26T10:44:17.447 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.447 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:17.447 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.447 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:17.448 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:17.448 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:17.449 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:17.448+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:17.449 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:17.550 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:17.549+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:17.563 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:17.563 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:17.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.563 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:3656 4.13 4:c9cea989:::100000011b9.00000000:head [write 0~1422 in=1422b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:44:17.564 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:17.562070+0000", 2024-04-26T10:44:17.564 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.00027232800000000001, 2024-04-26T10:44:17.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000288044, 2024-04-26T10:44:17.564 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:17.564 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:17.564 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:17.564 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:17.565 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:17.565 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 3656 2024-04-26T10:44:17.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.565 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:17.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:17.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:17.562070+0000", 2024-04-26T10:44:17.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:17.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:17.562070+0000", 2024-04-26T10:44:17.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:17.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:17.562070+0000", 2024-04-26T10:44:17.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:17.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:17.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:17.562073+0000", 2024-04-26T10:44:17.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4309999999999998e-06 2024-04-26T10:44:17.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.569 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:17.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:17.562081+0000", 2024-04-26T10:44:17.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5170000000000002e-06 2024-04-26T10:44:17.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:17.562085+0000", 2024-04-26T10:44:17.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3209999999999998e-06 2024-04-26T10:44:17.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:17.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:17.562128+0000", 2024-04-26T10:44:17.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3302e-05 2024-04-26T10:44:17.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:17.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:17.562211+0000", 2024-04-26T10:44:17.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.3206000000000003e-05 2024-04-26T10:44:17.571 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.571 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:17.571 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.571 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.571 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-26T10:44:17.571 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 1 2024-04-26T10:44:17.571 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:17.573 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:17.658 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:17.657+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:17.730 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:17.731 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:17.731 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:17.741 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:17.766 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:44:17.782 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:17.781+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:17.854 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:17.853+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:17.899 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:17.899 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 111.86152772200001, 2024-04-26T10:44:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:44:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:17.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:17.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:44:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:44:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:44:17.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:44:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:44:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:44:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:44:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:44:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:17.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:44:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:44:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:44:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:44:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:44:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:44:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.905 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:17.905 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:17.905 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 111.859777601, 2024-04-26T10:44:17.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:44:17.905 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:17.905 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.905 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:17.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:17.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:17.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:17.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:17.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:17.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:44:17.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:17.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:17.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:44:17.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:44:17.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:17.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:44:17.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:44:17.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:44:17.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:44:17.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:17.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:44:17.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:44:17.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:17.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:44:17.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:44:17.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:17.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:44:17.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:44:17.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:17.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:44:17.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:44:17.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:17.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:44:17.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:44:17.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:17.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:44:17.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:44:17.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:17.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:44:17.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:44:17.915 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.915 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:17.916 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.916 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:17.916 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:17.916 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 111.859724603, 2024-04-26T10:44:17.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:44:17.916 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:17.917 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.917 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:17.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:17.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:17.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:17.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:17.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:17.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:17.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:17.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:17.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:44:17.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:44:17.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:17.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:44:17.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:44:17.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:44:17.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:44:17.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:17.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:44:17.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:44:17.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:17.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:44:17.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:44:17.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:17.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:44:17.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:44:17.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:17.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:44:17.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:44:17.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:17.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:44:17.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:44:17.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:17.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:44:17.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:44:17.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:17.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:44:17.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:44:17.924 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.924 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:17.924 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.924 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:17.924 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:17.924 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 111.85964685899999, 2024-04-26T10:44:17.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:44:17.925 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:17.925 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.925 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:17.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:17.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:17.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:17.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:17.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:17.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:44:17.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:17.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:17.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:44:17.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:44:17.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:17.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:44:17.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:44:17.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:44:17.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:44:17.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:17.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:44:17.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:44:17.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:17.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:44:17.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:44:17.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:17.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:44:17.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:44:17.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:17.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:44:17.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:44:17.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:17.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:44:17.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:44:17.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:17.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:44:17.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:44:17.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:17.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:44:17.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:44:17.929 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.929 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:17.929 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.930 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:17.930 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:17.930 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 111.859607853, 2024-04-26T10:44:17.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:44:17.930 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:17.930 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.930 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:17.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:17.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:17.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:17.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:17.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:17.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:44:17.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:17.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:17.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:44:17.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:44:17.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:17.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:44:17.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:44:17.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:44:17.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:44:17.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:17.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:44:17.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:44:17.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:17.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:44:17.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:44:17.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:17.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:44:17.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:44:17.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:17.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:44:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:44:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:44:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:44:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:44:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:44:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:44:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:44:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 111.859589032, 2024-04-26T10:44:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:44:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:44:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:44:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:44:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:44:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:44:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:44:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:44:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:44:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:44:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:44:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:17.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:44:17.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:44:17.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:17.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:44:17.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:44:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:44:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:44:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:44:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:44:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:17.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:44:17.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:44:17.941 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.941 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:17.941 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 111.85955703, 2024-04-26T10:44:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:44:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:44:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:44:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:44:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:44:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:44:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:44:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:44:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:44:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:44:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:44:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:44:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:44:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:44:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:44:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:44:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:44:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:44:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:44:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:44:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:44:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:44:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:17.948 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:17.948 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 111.85934822199999, 2024-04-26T10:44:17.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:44:17.948 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:17.948 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.948 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:17.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:17.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:44:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:44:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:44:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:44:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:44:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:44:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:44:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:44:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:44:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:44:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:44:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:44:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:44:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:44:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:44:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:44:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:44:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:44:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:44:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:44:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:44:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 111.859316931, 2024-04-26T10:44:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:44:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:44:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:44:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:44:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:44:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:44:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:44:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:44:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:44:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:44:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:44:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:44:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:44:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:44:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 111.85928968100001, 2024-04-26T10:44:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:44:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:44:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:44:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:44:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:44:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:44:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:44:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:44:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:44:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:44:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:44:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:44:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:44:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 111.85651292999999, 2024-04-26T10:44:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:44:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:44:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:44:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:44:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:44:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:44:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:44:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:44:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:44:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:44:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:44:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:44:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:44:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 111.856462841, 2024-04-26T10:44:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:44:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:44:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:44:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:44:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:44:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:44:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:44:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:44:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:44:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:44:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:44:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:44:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:44:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:44:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:44:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:44:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 111.85557077199999, 2024-04-26T10:44:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:44:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:44:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:44:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:44:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:44:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:44:17.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.972 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:44:17.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:44:17.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:17.972 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:44:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:44:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:44:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:44:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:44:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:44:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:44:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:44:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 111.853382443, 2024-04-26T10:44:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:44:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:44:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:44:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:44:17.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:44:17.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:44:17.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:44:17.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:17.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:44:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:44:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:44:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:44:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:44:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:44:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:44:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:44:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:44:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 111.85324707300001, 2024-04-26T10:44:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:44:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:44:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:44:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:44:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:44:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:44:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:44:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:44:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:44:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:44:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:44:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:44:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:44:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:44:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:44:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:44:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:44:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:13.306328+0000", 2024-04-26T10:44:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.5910964129999998, 2024-04-26T10:44:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012467232999999999, 2024-04-26T10:44:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 4 2024-04-26T10:44:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.306328+0000", 2024-04-26T10:44:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.306328+0000", 2024-04-26T10:44:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.306325+0000", 2024-04-26T10:44:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999971 2024-04-26T10:44:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313008+0000", 2024-04-26T10:44:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0066830450000000003 2024-04-26T10:44:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313032+0000", 2024-04-26T10:44:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3034e-05 2024-04-26T10:44:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313041+0000", 2024-04-26T10:44:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.037e-06 2024-04-26T10:44:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313086+0000", 2024-04-26T10:44:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5259000000000002e-05 2024-04-26T10:44:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313156+0000", 2024-04-26T10:44:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0504000000000001e-05 2024-04-26T10:44:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.318691+0000", 2024-04-26T10:44:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0055346370000000002 2024-04-26T10:44:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.318724+0000", 2024-04-26T10:44:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3300000000000003e-05 2024-04-26T10:44:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.318796+0000", 2024-04-26T10:44:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1316999999999995e-05 2024-04-26T10:44:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:44:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:13.469171+0000", 2024-04-26T10:44:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4282537770000001, 2024-04-26T10:44:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017514674000000001, 2024-04-26T10:44:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 5 2024-04-26T10:44:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.469171+0000", 2024-04-26T10:44:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.469171+0000", 2024-04-26T10:44:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.469168+0000", 2024-04-26T10:44:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999971 2024-04-26T10:44:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.474986+0000", 2024-04-26T10:44:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0058177690000000004 2024-04-26T10:44:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475001+0000", 2024-04-26T10:44:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5349000000000002e-05 2024-04-26T10:44:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475009+0000", 2024-04-26T10:44:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.3579999999999997e-06 2024-04-26T10:44:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475157+0000", 2024-04-26T10:44:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014815 2024-04-26T10:44:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475325+0000", 2024-04-26T10:44:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00016793299999999999 2024-04-26T10:44:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475461+0000", 2024-04-26T10:44:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00013602800000000001 2024-04-26T10:44:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.483044+0000", 2024-04-26T10:44:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0075827309999999997 2024-04-26T10:44:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.486538+0000", 2024-04-26T10:44:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0034942739999999999 2024-04-26T10:44:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.486596+0000", 2024-04-26T10:44:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8019999999999997e-05 2024-04-26T10:44:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.486686+0000", 2024-04-26T10:44:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9702000000000003e-05 2024-04-26T10:44:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:44:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:13.475021+0000", 2024-04-26T10:44:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4224039309999998, 2024-04-26T10:44:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0084663459999999996, 2024-04-26T10:44:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 6 2024-04-26T10:44:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475021+0000", 2024-04-26T10:44:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475021+0000", 2024-04-26T10:44:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475020+0000", 2024-04-26T10:44:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480334+0000", 2024-04-26T10:44:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053142500000000004 2024-04-26T10:44:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480354+0000", 2024-04-26T10:44:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.931e-05 2024-04-26T10:44:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480365+0000", 2024-04-26T10:44:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1477999999999999e-05 2024-04-26T10:44:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480420+0000", 2024-04-26T10:44:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4802000000000001e-05 2024-04-26T10:44:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480596+0000", 2024-04-26T10:44:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000175806 2024-04-26T10:44:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.483338+0000", 2024-04-26T10:44:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0027423730000000002 2024-04-26T10:44:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.483389+0000", 2024-04-26T10:44:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0662999999999999e-05 2024-04-26T10:44:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.483487+0000", 2024-04-26T10:44:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.8350000000000005e-05 2024-04-26T10:44:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:63 3.1b 3:ddb4e4d7:::200.00000002:head [write 0~1908408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T10:44:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:16.502931+0000", 2024-04-26T10:44:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 1.3944936829999999, 2024-04-26T10:44:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0055555680000000003, 2024-04-26T10:44:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.502931+0000", 2024-04-26T10:44:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.502931+0000", 2024-04-26T10:44:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.502930+0000", 2024-04-26T10:44:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.505184+0000", 2024-04-26T10:44:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022540419999999999 2024-04-26T10:44:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.505199+0000", 2024-04-26T10:44:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4260999999999999e-05 2024-04-26T10:44:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.505207+0000", 2024-04-26T10:44:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4589999999999998e-06 2024-04-26T10:44:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.505277+0000", 2024-04-26T10:44:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9575999999999999e-05 2024-04-26T10:44:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.505347+0000", 2024-04-26T10:44:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0741999999999995e-05 2024-04-26T10:44:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.508408+0000", 2024-04-26T10:44:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030602720000000002 2024-04-26T10:44:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.508439+0000", 2024-04-26T10:44:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0892999999999997e-05 2024-04-26T10:44:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.508487+0000", 2024-04-26T10:44:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8121999999999998e-05 2024-04-26T10:44:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:65 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T10:44:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:16.510703+0000", 2024-04-26T10:44:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 1.386721476, 2024-04-26T10:44:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012272897, 2024-04-26T10:44:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.510703+0000", 2024-04-26T10:44:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.510703+0000", 2024-04-26T10:44:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.510702+0000", 2024-04-26T10:44:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.511120+0000", 2024-04-26T10:44:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00041818600000000002 2024-04-26T10:44:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.511131+0000", 2024-04-26T10:44:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0900999999999999e-05 2024-04-26T10:44:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.511139+0000", 2024-04-26T10:44:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7160000000000003e-06 2024-04-26T10:44:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.511174+0000", 2024-04-26T10:44:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.5499e-05 2024-04-26T10:44:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.511226+0000", 2024-04-26T10:44:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.168e-05 2024-04-26T10:44:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.517346+0000", 2024-04-26T10:44:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061201149999999998 2024-04-26T10:44:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.008 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:18.008 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.522622+0000", 2024-04-26T10:44:18.008 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0052753440000000004 2024-04-26T10:44:18.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:18.008 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.008 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:18.008 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.522878+0000", 2024-04-26T10:44:18.008 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00025625300000000001 2024-04-26T10:44:18.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:18.008 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.008 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:18.008 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.522920+0000", 2024-04-26T10:44:18.008 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2620000000000002e-05 2024-04-26T10:44:18.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:18.009 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:18.009 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:18.009 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.522976+0000", 2024-04-26T10:44:18.009 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5682e-05 2024-04-26T10:44:18.009 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:18.009 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:18.009 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:18.009 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:18.009 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:18.009 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:18.010 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:18.011 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:18.010+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:18.011 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:18.011 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:18.012 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:18.012 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:18.013 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:18.013 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:18.013 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:18.111 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:18.111+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:18.128 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:18.128 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:18.137 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:18.213 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:18.213+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:18.250 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:18.250 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:18.259 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:18.346 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:18.345+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:18.405 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:18.405 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:18.415 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:18.414+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:18.416 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:18.461 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:44:18.516 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:18.515+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:18.525 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:18.526 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:18.535 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:18.617 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:18.617+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:18.690 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:18.690 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:18.699 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:18.744 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:18.743+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:18.813 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:18.813 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:18.820 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:18.819+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:18.822 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:18.921 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:18.920+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:18.934 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:18.935 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:18.944 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:19.021 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:19.020+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:19.101 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:19.101 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:19.112 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:19.122 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:19.121+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:19.220 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:19.221 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:19.223 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:19.222+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:19.230 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:19.324 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:19.323+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:19.341 INFO:teuthology.orchestra.run.smithi049.stderr:nodeep-scrub is unset 2024-04-26T10:44:19.357 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:19.357 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:19.367 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:19.452 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:19.451+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:19.521 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:19.521 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:19.525 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:19.524+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:19.530 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:19.627 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:19.626+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:19.686 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:19.686 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:19.695 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:19.728 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:19.727+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:19.801 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:19.801 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:19.811 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:19.856 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:19.856+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:19.921 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:19.922 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:19.930 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:19.929+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:19.931 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:20.015 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:44:20.030 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:20.030+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:20.078 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:20.078 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:20.088 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:20.132 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:20.131+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:20.151 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:20.151 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:20.151 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:20.170 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:20.171 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:20.173 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:20.174 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:20.203 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:20.203 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:20.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.203 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:6170 4.6 4:6037d181:::10000001c49.00000000:head [write 0~485 in=485b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:44:20.203 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:20.201909+0000", 2024-04-26T10:44:20.203 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.00074689199999999998, 2024-04-26T10:44:20.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00076263600000000002, 2024-04-26T10:44:20.204 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:20.204 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:44:20.204 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:20.204 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:20.204 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:20.204 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 6170 2024-04-26T10:44:20.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.205 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:20.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.205 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:20.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:20.201909+0000", 2024-04-26T10:44:20.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.205 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:20.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:20.201909+0000", 2024-04-26T10:44:20.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:20.206 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:20.201908+0000", 2024-04-26T10:44:20.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:20.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:20.206 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:20.201917+0000", 2024-04-26T10:44:20.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.85e-06 2024-04-26T10:44:20.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:20.206 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:20.201930+0000", 2024-04-26T10:44:20.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.312e-05 2024-04-26T10:44:20.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:20.201937+0000", 2024-04-26T10:44:20.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2049999999999996e-06 2024-04-26T10:44:20.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:20.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:20.201974+0000", 2024-04-26T10:44:20.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6897999999999998e-05 2024-04-26T10:44:20.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.209 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:20.209 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:20.202051+0000", 2024-04-26T10:44:20.209 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6891000000000006e-05 2024-04-26T10:44:20.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.209 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:20.209 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:20.202123+0000", 2024-04-26T10:44:20.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2138000000000006e-05 2024-04-26T10:44:20.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.210 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:20.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:20.202621+0000", 2024-04-26T10:44:20.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00049726700000000002 2024-04-26T10:44:20.211 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.211 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:20.211 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.211 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.211 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-26T10:44:20.211 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 1 2024-04-26T10:44:20.212 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:20.213 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:20.255 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:20.254+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:20.333 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:20.333+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:20.369 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:20.369 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:20.369 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:20.369 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:20.369 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:20.378 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:20.434 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:20.434+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:20.494 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:20.494 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:20.495 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:20.495 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:20.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.495 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:20.495 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:20.495 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 114.456365965, 2024-04-26T10:44:20.495 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:44:20.495 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:20.495 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.495 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:20.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.495 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:20.495 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:20.495 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.496 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:20.496 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:20.496 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.496 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:20.496 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:20.496 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:20.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.496 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:20.496 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:44:20.496 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:44:20.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.497 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:20.497 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:44:20.497 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:44:20.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.497 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.497 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:44:20.497 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:44:20.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.497 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:20.497 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:44:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:44:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:44:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:44:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:44:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:44:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.498 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:44:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:44:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 114.454615844, 2024-04-26T10:44:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:44:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:20.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:44:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:44:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:44:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:44:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:44:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:44:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:44:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:44:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:44:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:44:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:44:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:44:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:44:20.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:44:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:44:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:44:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:44:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:44:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:44:20.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:44:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:44:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 114.454562846, 2024-04-26T10:44:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:44:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:20.504 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:20.505 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:44:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:44:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:44:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:44:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:44:20.506 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:44:20.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.507 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:20.507 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:44:20.507 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:44:20.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.507 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:20.507 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:44:20.507 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:44:20.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.507 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:20.507 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:44:20.507 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:44:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:44:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:44:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:44:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:44:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:20.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:44:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:44:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:44:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:44:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 114.45448510200001, 2024-04-26T10:44:20.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:44:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:44:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:44:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:44:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:44:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:44:20.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:44:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:44:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:44:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:44:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:44:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:44:20.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:44:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:44:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:44:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:44:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:44:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:44:20.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:44:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:44:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:44:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:44:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.514 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 114.454446096, 2024-04-26T10:44:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:44:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:20.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:44:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:44:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:44:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:44:20.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:44:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:44:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:44:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:44:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:44:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:44:20.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:44:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:44:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:44:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:44:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:44:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:44:20.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:44:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:44:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:44:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:44:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:44:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 114.454427275, 2024-04-26T10:44:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:44:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:20.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:44:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:44:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:20.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:44:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:44:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:44:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:44:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:44:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:44:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:44:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:44:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:44:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:44:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:44:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:44:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:44:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:44:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:44:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:44:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:44:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:44:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:20.524 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 114.454395273, 2024-04-26T10:44:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:44:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:44:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:44:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:44:20.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:44:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:44:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:44:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:44:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:44:20.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:44:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:44:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:44:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:44:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:44:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:44:20.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:44:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:44:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:44:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:44:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:44:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:20.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:44:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:44:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 114.45418646500001, 2024-04-26T10:44:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:44:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:20.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:44:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:44:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:44:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:44:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:44:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:44:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:44:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:44:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:44:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:44:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:44:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:44:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:44:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:44:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:44:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:44:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:44:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:44:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:44:20.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:44:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:44:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 114.45415517399999, 2024-04-26T10:44:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:44:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:44:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:44:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:44:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:44:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:44:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:44:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:44:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:44:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:44:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:44:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:44:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:44:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:44:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 114.45412792400001, 2024-04-26T10:44:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:44:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:44:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:44:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:44:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:44:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:44:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:44:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:44:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:44:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:44:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:44:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:44:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:44:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 114.45135117300001, 2024-04-26T10:44:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:44:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:44:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:44:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:44:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:44:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:44:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:44:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:44:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:44:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:44:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:44:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:44:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:44:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 114.45130108399999, 2024-04-26T10:44:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:44:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:44:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:44:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:44:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:44:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:44:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:44:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:44:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:44:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:44:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:44:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:44:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:44:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:44:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:44:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:44:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 114.45040901500001, 2024-04-26T10:44:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:44:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:44:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:44:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:44:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:44:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:44:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:44:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:44:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:44:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:44:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:44:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:44:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:44:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:44:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:44:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:1 3.14 e14/12 3:292cf221:::200.00000000:head v 14'3, mlcod=0'0)", 2024-04-26T10:44:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 114.448220686, 2024-04-26T10:44:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046371540000000001, 2024-04-26T10:44:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044042+0000", 2024-04-26T10:44:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044071+0000", 2024-04-26T10:44:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:44:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044153+0000", 2024-04-26T10:44:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1780999999999995e-05 2024-04-26T10:44:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044164+0000", 2024-04-26T10:44:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1783999999999999e-05 2024-04-26T10:44:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044255+0000", 2024-04-26T10:44:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0662999999999996e-05 2024-04-26T10:44:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044289+0000", 2024-04-26T10:44:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:44:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048646+0000", 2024-04-26T10:44:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043564650000000003 2024-04-26T10:44:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048679+0000", 2024-04-26T10:44:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3515e-05 2024-04-26T10:44:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:9 3.10 e14/12 3:09401a81:::601.00000000:head v 14'4, mlcod=0'0)", 2024-04-26T10:44:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 114.448085316, 2024-04-26T10:44:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044483250000000004, 2024-04-26T10:44:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044178+0000", 2024-04-26T10:44:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044177+0000", 2024-04-26T10:44:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044184+0000", 2024-04-26T10:44:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6309999999999997e-06 2024-04-26T10:44:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044228+0000", 2024-04-26T10:44:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4227000000000002e-05 2024-04-26T10:44:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044281+0000", 2024-04-26T10:44:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3254000000000002e-05 2024-04-26T10:44:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044372+0000", 2024-04-26T10:44:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1188999999999997e-05 2024-04-26T10:44:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044393+0000", 2024-04-26T10:44:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0267000000000001e-05 2024-04-26T10:44:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048584+0000", 2024-04-26T10:44:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041909720000000003 2024-04-26T10:44:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048626+0000", 2024-04-26T10:44:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2308999999999998e-05 2024-04-26T10:44:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:44:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:13.306328+0000", 2024-04-26T10:44:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 7.1859346559999997, 2024-04-26T10:44:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012467232999999999, 2024-04-26T10:44:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 4 2024-04-26T10:44:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.306328+0000", 2024-04-26T10:44:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.306328+0000", 2024-04-26T10:44:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.306325+0000", 2024-04-26T10:44:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999971 2024-04-26T10:44:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313008+0000", 2024-04-26T10:44:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0066830450000000003 2024-04-26T10:44:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313032+0000", 2024-04-26T10:44:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3034e-05 2024-04-26T10:44:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313041+0000", 2024-04-26T10:44:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.037e-06 2024-04-26T10:44:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313086+0000", 2024-04-26T10:44:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5259000000000002e-05 2024-04-26T10:44:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313156+0000", 2024-04-26T10:44:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0504000000000001e-05 2024-04-26T10:44:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.318691+0000", 2024-04-26T10:44:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0055346370000000002 2024-04-26T10:44:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.318724+0000", 2024-04-26T10:44:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3300000000000003e-05 2024-04-26T10:44:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.318796+0000", 2024-04-26T10:44:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1316999999999995e-05 2024-04-26T10:44:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:44:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:13.469171+0000", 2024-04-26T10:44:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 7.02309202, 2024-04-26T10:44:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017514674000000001, 2024-04-26T10:44:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 5 2024-04-26T10:44:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.469171+0000", 2024-04-26T10:44:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.469171+0000", 2024-04-26T10:44:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.469168+0000", 2024-04-26T10:44:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999971 2024-04-26T10:44:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.474986+0000", 2024-04-26T10:44:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0058177690000000004 2024-04-26T10:44:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475001+0000", 2024-04-26T10:44:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5349000000000002e-05 2024-04-26T10:44:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475009+0000", 2024-04-26T10:44:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.3579999999999997e-06 2024-04-26T10:44:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475157+0000", 2024-04-26T10:44:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014815 2024-04-26T10:44:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475325+0000", 2024-04-26T10:44:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00016793299999999999 2024-04-26T10:44:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475461+0000", 2024-04-26T10:44:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00013602800000000001 2024-04-26T10:44:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.483044+0000", 2024-04-26T10:44:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0075827309999999997 2024-04-26T10:44:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.486538+0000", 2024-04-26T10:44:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0034942739999999999 2024-04-26T10:44:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.486596+0000", 2024-04-26T10:44:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8019999999999997e-05 2024-04-26T10:44:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.486686+0000", 2024-04-26T10:44:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9702000000000003e-05 2024-04-26T10:44:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:44:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:13.475021+0000", 2024-04-26T10:44:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 7.0172421739999997, 2024-04-26T10:44:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0084663459999999996, 2024-04-26T10:44:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 6 2024-04-26T10:44:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475021+0000", 2024-04-26T10:44:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475021+0000", 2024-04-26T10:44:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475020+0000", 2024-04-26T10:44:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480334+0000", 2024-04-26T10:44:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053142500000000004 2024-04-26T10:44:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480354+0000", 2024-04-26T10:44:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.931e-05 2024-04-26T10:44:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480365+0000", 2024-04-26T10:44:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1477999999999999e-05 2024-04-26T10:44:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480420+0000", 2024-04-26T10:44:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4802000000000001e-05 2024-04-26T10:44:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480596+0000", 2024-04-26T10:44:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000175806 2024-04-26T10:44:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.483338+0000", 2024-04-26T10:44:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0027423730000000002 2024-04-26T10:44:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.483389+0000", 2024-04-26T10:44:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0662999999999999e-05 2024-04-26T10:44:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.483487+0000", 2024-04-26T10:44:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.8350000000000005e-05 2024-04-26T10:44:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:63 3.1b 3:ddb4e4d7:::200.00000002:head [write 0~1908408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T10:44:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:16.502931+0000", 2024-04-26T10:44:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.9893319260000002, 2024-04-26T10:44:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0055555680000000003, 2024-04-26T10:44:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.502931+0000", 2024-04-26T10:44:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.502931+0000", 2024-04-26T10:44:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.502930+0000", 2024-04-26T10:44:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.505184+0000", 2024-04-26T10:44:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022540419999999999 2024-04-26T10:44:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.505199+0000", 2024-04-26T10:44:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4260999999999999e-05 2024-04-26T10:44:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.505207+0000", 2024-04-26T10:44:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4589999999999998e-06 2024-04-26T10:44:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.505277+0000", 2024-04-26T10:44:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9575999999999999e-05 2024-04-26T10:44:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.505347+0000", 2024-04-26T10:44:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0741999999999995e-05 2024-04-26T10:44:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.508408+0000", 2024-04-26T10:44:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030602720000000002 2024-04-26T10:44:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.508439+0000", 2024-04-26T10:44:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0892999999999997e-05 2024-04-26T10:44:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.508487+0000", 2024-04-26T10:44:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8121999999999998e-05 2024-04-26T10:44:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:65 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T10:44:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:16.510703+0000", 2024-04-26T10:44:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.9815597189999998, 2024-04-26T10:44:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012272897, 2024-04-26T10:44:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.510703+0000", 2024-04-26T10:44:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.510703+0000", 2024-04-26T10:44:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.510702+0000", 2024-04-26T10:44:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.511120+0000", 2024-04-26T10:44:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00041818600000000002 2024-04-26T10:44:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.511131+0000", 2024-04-26T10:44:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0900999999999999e-05 2024-04-26T10:44:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.511139+0000", 2024-04-26T10:44:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7160000000000003e-06 2024-04-26T10:44:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.511174+0000", 2024-04-26T10:44:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.5499e-05 2024-04-26T10:44:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.511226+0000", 2024-04-26T10:44:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.168e-05 2024-04-26T10:44:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.517346+0000", 2024-04-26T10:44:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061201149999999998 2024-04-26T10:44:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.522622+0000", 2024-04-26T10:44:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0052753440000000004 2024-04-26T10:44:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.522878+0000", 2024-04-26T10:44:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00025625300000000001 2024-04-26T10:44:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.522920+0000", 2024-04-26T10:44:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2620000000000002e-05 2024-04-26T10:44:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.522976+0000", 2024-04-26T10:44:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5682e-05 2024-04-26T10:44:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:20.588 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:20.589 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:20.588+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:20.590 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:20.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~64s 2024-04-26T10:44:20.690 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:20.689+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:20.707 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:20.707 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:20.707 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.707 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:6588 4.17 4:e872470c:::10000001e1a.00000000:head [write 0~828 in=828b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:44:20.707 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:20.705447+0000", 2024-04-26T10:44:20.707 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.00077149399999999996, 2024-04-26T10:44:20.707 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00079721800000000004, 2024-04-26T10:44:20.707 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:20.707 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.707 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:20.707 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:20.708 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:20.708 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 6588 2024-04-26T10:44:20.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.708 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:20.708 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.708 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:20.708 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.705447+0000", 2024-04-26T10:44:20.708 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.708 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.708 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:20.708 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.705447+0000", 2024-04-26T10:44:20.708 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.708 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.709 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:20.709 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.705447+0000", 2024-04-26T10:44:20.709 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:20.709 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.709 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.709 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:20.709 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.705452+0000", 2024-04-26T10:44:20.709 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0379999999999999e-06 2024-04-26T10:44:20.709 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.709 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.709 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:20.709 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.705462+0000", 2024-04-26T10:44:20.709 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0922e-05 2024-04-26T10:44:20.709 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.709 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.710 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.710 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.705468+0000", 2024-04-26T10:44:20.710 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.2750000000000003e-06 2024-04-26T10:44:20.710 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.710 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.710 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:20.710 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.705499+0000", 2024-04-26T10:44:20.710 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1510000000000002e-05 2024-04-26T10:44:20.710 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.710 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.710 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:20.710 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.705576+0000", 2024-04-26T10:44:20.710 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.6620999999999997e-05 2024-04-26T10:44:20.710 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.710 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.711 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:20.711 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.706194+0000", 2024-04-26T10:44:20.711 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00061853500000000003 2024-04-26T10:44:20.711 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.711 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.711 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:20.711 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.706243+0000", 2024-04-26T10:44:20.711 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8594000000000003e-05 2024-04-26T10:44:20.711 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.711 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:20.711 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.711 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.711 INFO:teuthology.orchestra.run.smithi195.stdout: ], 2024-04-26T10:44:20.711 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 1 2024-04-26T10:44:20.711 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:20.717 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:20.791 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:20.790+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:20.825 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:20.826 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:20.826 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:20.826 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:20.826 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:20.836 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:20.892 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:20.891+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:20.943 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:20.943 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:20.943 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:20.943 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:20.943 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.943 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:20.943 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:20.943 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 114.904123368, 2024-04-26T10:44:20.943 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:44:20.943 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:20.944 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.944 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:20.944 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.944 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:20.944 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:20.944 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.944 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.944 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.944 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:20.944 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:20.944 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.944 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.944 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.944 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:20.944 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:44:20.945 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:20.945 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.945 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.945 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:20.945 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:44:20.945 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:44:20.945 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.945 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.945 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:20.945 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:44:20.945 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:44:20.945 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.945 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.945 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.946 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:44:20.946 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:44:20.946 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.946 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.946 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:20.946 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:44:20.946 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:44:20.946 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.946 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.946 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:20.946 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:44:20.946 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:44:20.946 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.946 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.947 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:20.947 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:44:20.947 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:44:20.947 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.947 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.947 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:20.947 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:44:20.947 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:44:20.947 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.947 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:20.947 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.947 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.947 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.947 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:20.948 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:20.948 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 114.903252588, 2024-04-26T10:44:20.948 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022445999999999998, 2024-04-26T10:44:20.948 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:20.948 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.948 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:20.948 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.948 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:20.948 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:20.948 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.948 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.948 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.948 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:20.948 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:20.948 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.949 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.949 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.949 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:20.949 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037403+0000", 2024-04-26T10:44:20.949 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:20.949 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.949 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.949 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:20.949 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037410+0000", 2024-04-26T10:44:20.949 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.058e-06 2024-04-26T10:44:20.949 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.949 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.949 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:20.949 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037420+0000", 2024-04-26T10:44:20.950 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0051000000000001e-05 2024-04-26T10:44:20.950 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.950 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.950 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.950 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037429+0000", 2024-04-26T10:44:20.950 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8070000000000006e-06 2024-04-26T10:44:20.950 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.950 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.950 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:20.950 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038433+0000", 2024-04-26T10:44:20.950 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010042569999999999 2024-04-26T10:44:20.950 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.950 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.950 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:20.950 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038453+0000", 2024-04-26T10:44:20.951 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9636999999999999e-05 2024-04-26T10:44:20.951 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.951 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.951 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:20.951 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039615+0000", 2024-04-26T10:44:20.951 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0011619600000000001 2024-04-26T10:44:20.951 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.951 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.951 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:20.951 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039648+0000", 2024-04-26T10:44:20.951 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3358000000000001e-05 2024-04-26T10:44:20.951 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.951 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:20.951 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.951 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.952 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.952 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:20.952 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:20.952 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 114.902265245, 2024-04-26T10:44:20.952 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016662440000000001, 2024-04-26T10:44:20.952 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:20.952 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.952 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:20.952 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.953 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:20.953 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:20.953 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.953 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.953 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.953 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:20.953 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038391+0000", 2024-04-26T10:44:20.953 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.953 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.953 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.953 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:20.953 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038390+0000", 2024-04-26T10:44:20.953 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:20.953 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.954 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.954 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:20.954 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038407+0000", 2024-04-26T10:44:20.954 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6518e-05 2024-04-26T10:44:20.954 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.954 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.954 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:20.954 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038418+0000", 2024-04-26T10:44:20.954 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1946999999999999e-05 2024-04-26T10:44:20.954 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.954 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.954 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.954 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038427+0000", 2024-04-26T10:44:20.954 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8740000000000001e-06 2024-04-26T10:44:20.954 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.955 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.955 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:20.955 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038625+0000", 2024-04-26T10:44:20.955 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000197405 2024-04-26T10:44:20.955 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.955 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.955 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:20.955 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038646+0000", 2024-04-26T10:44:20.955 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1291e-05 2024-04-26T10:44:20.955 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.955 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.955 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:20.955 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040036+0000", 2024-04-26T10:44:20.955 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013898510000000001 2024-04-26T10:44:20.956 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.956 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.956 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:20.956 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040057+0000", 2024-04-26T10:44:20.956 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:44:20.956 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.956 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:20.956 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.956 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.956 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.956 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:20.956 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:20.956 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 114.901739101, 2024-04-26T10:44:20.956 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:44:20.956 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:20.957 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.957 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:20.957 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.957 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:20.957 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:20.957 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.957 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.957 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.957 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:20.957 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:20.957 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.957 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.957 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.957 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:20.958 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:44:20.958 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:20.958 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.958 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.958 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:20.958 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:44:20.958 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:44:20.958 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.958 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.958 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:20.958 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:44:20.958 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:44:20.958 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.959 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.959 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.959 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:44:20.959 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:44:20.959 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.959 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.959 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:20.959 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:44:20.959 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:44:20.959 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.959 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.959 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:20.959 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:44:20.959 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:44:20.959 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.960 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.960 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:20.960 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:44:20.960 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:44:20.960 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.960 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.960 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:20.960 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:44:20.960 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:44:20.960 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.960 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.960 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:20.960 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:44:20.960 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:44:20.961 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.961 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.961 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:20.961 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:44:20.961 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:44:20.961 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.961 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.961 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:20.961 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:44:20.962 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:44:20.962 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.962 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:20.962 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.962 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.962 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.962 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:20.962 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:20.962 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 114.90168727699999, 2024-04-26T10:44:20.962 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:44:20.962 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:20.962 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.962 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:20.963 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.963 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:20.963 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:20.963 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.963 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.963 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.963 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:20.963 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:20.963 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.963 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.963 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.963 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:20.963 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:44:20.963 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:20.964 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.964 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.964 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:20.964 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:44:20.964 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:44:20.964 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.964 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.964 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:20.964 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:44:20.964 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:44:20.964 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.964 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.964 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.964 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:44:20.965 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:44:20.965 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.965 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.965 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:20.965 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:44:20.965 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:44:20.965 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.965 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.965 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:20.965 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:44:20.965 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:44:20.965 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.965 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.965 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:20.966 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:44:20.966 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:44:20.966 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.966 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.966 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:20.966 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:44:20.966 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:44:20.966 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.966 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.966 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:20.966 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:44:20.966 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:44:20.966 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.967 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.967 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:20.967 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:44:20.967 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:44:20.967 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.967 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.967 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:20.967 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:44:20.967 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:44:20.967 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.967 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:20.967 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.967 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.967 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.967 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:20.968 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:20.968 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 114.901633905, 2024-04-26T10:44:20.968 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:44:20.968 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:20.968 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.968 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:20.968 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.968 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:20.968 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:20.968 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.968 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.968 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.968 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:20.968 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:20.969 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.969 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.969 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.969 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:20.969 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:20.969 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:20.969 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.969 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.969 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:20.969 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:44:20.969 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:44:20.969 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.969 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.969 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:20.970 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:44:20.970 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:44:20.970 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.970 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.970 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.970 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:44:20.970 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:44:20.970 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.970 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.970 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:20.970 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:44:20.970 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:44:20.970 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.970 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.971 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:20.971 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:44:20.971 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:44:20.971 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.971 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.971 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:20.971 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:44:20.971 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:44:20.971 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.971 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.971 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:20.971 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:44:20.971 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:44:20.972 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.972 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.972 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:20.972 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:44:20.972 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:44:20.972 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.972 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.972 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:20.972 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:44:20.972 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:44:20.972 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.972 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.972 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:20.972 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:44:20.973 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:44:20.973 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.973 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:20.973 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.973 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.973 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.973 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:20.973 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:20.973 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 114.901589578, 2024-04-26T10:44:20.973 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:44:20.973 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:20.973 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.973 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:20.973 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.974 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:20.974 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:20.974 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.974 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.974 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.974 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:20.974 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:20.974 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.974 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.974 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.974 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:20.974 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:20.974 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:20.974 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:44:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:44:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:44:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:44:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:44:20.975 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:44:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:44:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:44:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:44:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:44:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:44:20.976 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:44:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:44:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:44:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:44:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:44:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:44:20.977 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:44:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:44:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:44:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 114.90156586499999, 2024-04-26T10:44:20.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:44:20.979 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:20.979 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.979 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:20.979 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.979 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:20.979 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:20.979 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.979 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.979 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.979 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:20.979 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:20.979 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.979 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.979 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.980 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:20.980 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:20.980 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:20.980 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.980 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.980 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:20.980 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:44:20.980 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:44:20.980 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.980 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.980 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:20.980 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:44:20.980 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:44:20.980 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.980 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:44:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:44:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:44:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:44:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:44:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:44:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.981 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:44:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:44:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:44:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:44:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:44:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:44:20.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:44:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:44:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:44:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:44:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.983 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 114.90153156, 2024-04-26T10:44:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:44:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:20.984 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:44:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:44:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:44:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.985 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:44:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:44:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:44:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:44:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:44:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:44:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.986 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:44:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:44:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:44:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:44:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:44:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:44:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.987 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:44:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:44:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:44:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:44:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:44:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:44:20.988 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 114.901194964, 2024-04-26T10:44:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:44:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:20.989 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:44:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:20.990 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:44:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:44:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:44:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:44:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:44:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:44:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:20.991 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:44:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:44:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:44:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:44:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:44:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:44:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:20.992 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 114.901152936, 2024-04-26T10:44:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:44:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.993 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:44:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:44:20.994 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:44:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:44:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:44:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:44:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:44:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:44:20.995 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:44:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:44:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:44:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:44:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.996 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 114.90109976399999, 2024-04-26T10:44:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:44:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:20.997 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:44:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:44:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.998 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:44:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:44:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:44:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:44:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:44:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:44:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:20.999 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:44:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:44:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:44:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:44:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.000 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:44:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 109.44177210700001, 2024-04-26T10:44:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001707201, 2024-04-26T10:44:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498884+0000", 2024-04-26T10:44:21.001 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498882+0000", 2024-04-26T10:44:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498895+0000", 2024-04-26T10:44:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2746e-05 2024-04-26T10:44:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:21.002 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498939+0000", 2024-04-26T10:44:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4706000000000002e-05 2024-04-26T10:44:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.498946+0000", 2024-04-26T10:44:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.776e-06 2024-04-26T10:44:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499048+0000", 2024-04-26T10:44:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010233100000000001 2024-04-26T10:44:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:21.003 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499162+0000", 2024-04-26T10:44:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114023 2024-04-26T10:44:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499274+0000", 2024-04-26T10:44:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111797 2024-04-26T10:44:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.499900+0000", 2024-04-26T10:44:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00062547099999999995 2024-04-26T10:44:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.004 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500506+0000", 2024-04-26T10:44:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00060670699999999995 2024-04-26T10:44:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500544+0000", 2024-04-26T10:44:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7889000000000003e-05 2024-04-26T10:44:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:31.500591+0000", 2024-04-26T10:44:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6900999999999997e-05 2024-04-26T10:44:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:21.005 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(client.4532.0:5 4.10 e52/37 4:09a4c37f:::10000000003.00000001:head v 52'1, mlcod=0'0)", 2024-04-26T10:44:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 7.4650323939999996, 2024-04-26T10:44:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010754041000000001, 2024-04-26T10:44:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.006 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:44:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.007 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479849+0000", 2024-04-26T10:44:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004225716 2024-04-26T10:44:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479868+0000", 2024-04-26T10:44:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.8666000000000001e-05 2024-04-26T10:44:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479878+0000", 2024-04-26T10:44:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.6150000000000003e-06 2024-04-26T10:44:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.008 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479935+0000", 2024-04-26T10:44:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7766999999999998e-05 2024-04-26T10:44:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479960+0000", 2024-04-26T10:44:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4343000000000001e-05 2024-04-26T10:44:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.486332+0000", 2024-04-26T10:44:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0063727610000000002 2024-04-26T10:44:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.009 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.486378+0000", 2024-04-26T10:44:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.5334000000000003e-05 2024-04-26T10:44:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:65 3.6 e53/37 3:654134d2:::mds0_openfiles.0:head v 53'6, mlcod=48'4)", 2024-04-26T10:44:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:16.517520+0000", 2024-04-26T10:44:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 4.4231356469999996, 2024-04-26T10:44:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052681739999999996, 2024-04-26T10:44:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:21.010 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517520+0000", 2024-04-26T10:44:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517520+0000", 2024-04-26T10:44:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517520+0000", 2024-04-26T10:44:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517652+0000", 2024-04-26T10:44:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000132662 2024-04-26T10:44:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517662+0000", 2024-04-26T10:44:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7019999999999996e-06 2024-04-26T10:44:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.012 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517668+0000", 2024-04-26T10:44:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0530000000000003e-06 2024-04-26T10:44:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517730+0000", 2024-04-26T10:44:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2158999999999999e-05 2024-04-26T10:44:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517745+0000", 2024-04-26T10:44:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4273999999999999e-05 2024-04-26T10:44:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:21.013 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.522754+0000", 2024-04-26T10:44:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0050096450000000001 2024-04-26T10:44:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.522789+0000", 2024-04-26T10:44:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4406000000000002e-05 2024-04-26T10:44:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(client.4532.0:2656 4.36 e53/37 4:6dd4a55d:::10000000fae.00000000:head v 53'42, mlcod=53'40)", 2024-04-26T10:44:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:16.521267+0000", 2024-04-26T10:44:21.014 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 4.41938926, 2024-04-26T10:44:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0016892459999999999, 2024-04-26T10:44:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.521267+0000", 2024-04-26T10:44:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.521267+0000", 2024-04-26T10:44:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.015 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.521266+0000", 2024-04-26T10:44:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.521272+0000", 2024-04-26T10:44:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.366e-06 2024-04-26T10:44:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.521280+0000", 2024-04-26T10:44:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7499999999999992e-06 2024-04-26T10:44:21.016 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.521286+0000", 2024-04-26T10:44:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6949999999999997e-06 2024-04-26T10:44:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.521324+0000", 2024-04-26T10:44:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7966000000000002e-05 2024-04-26T10:44:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.521346+0000", 2024-04-26T10:44:21.017 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1474000000000001e-05 2024-04-26T10:44:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.522936+0000", 2024-04-26T10:44:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015906659999999999 2024-04-26T10:44:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.522956+0000", 2024-04-26T10:44:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9811000000000001e-05 2024-04-26T10:44:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.018 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(client.4532.0:2866 4.29 e53/37 4:9796eaf4:::10000000e8a.00000000:head v 53'53, mlcod=53'51)", 2024-04-26T10:44:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:16.718696+0000", 2024-04-26T10:44:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 4.2219604589999999, 2024-04-26T10:44:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001681632, 2024-04-26T10:44:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.718696+0000", 2024-04-26T10:44:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.019 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.718696+0000", 2024-04-26T10:44:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.718694+0000", 2024-04-26T10:44:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.021 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.719127+0000", 2024-04-26T10:44:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00043338799999999999 2024-04-26T10:44:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.719138+0000", 2024-04-26T10:44:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.118e-05 2024-04-26T10:44:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.719144+0000", 2024-04-26T10:44:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0390000000000001e-06 2024-04-26T10:44:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.022 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.719186+0000", 2024-04-26T10:44:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1291999999999997e-05 2024-04-26T10:44:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.719207+0000", 2024-04-26T10:44:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1075000000000001e-05 2024-04-26T10:44:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.720354+0000", 2024-04-26T10:44:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001146811 2024-04-26T10:44:21.023 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.720377+0000", 2024-04-26T10:44:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3723999999999999e-05 2024-04-26T10:44:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:3051 4.11 4:8afd8039:::10000000f44.00000000:head [write 0~672130] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:44:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:16.898960+0000", 2024-04-26T10:44:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 4.0416955720000001, 2024-04-26T10:44:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027624870000000001, 2024-04-26T10:44:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:21.024 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 3051 2024-04-26T10:44:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.898960+0000", 2024-04-26T10:44:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.898960+0000", 2024-04-26T10:44:21.025 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.898960+0000", 2024-04-26T10:44:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.899863+0000", 2024-04-26T10:44:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00090309799999999997 2024-04-26T10:44:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:21.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.899874+0000", 2024-04-26T10:44:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1269e-05 2024-04-26T10:44:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.899879+0000", 2024-04-26T10:44:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.1549999999999998e-06 2024-04-26T10:44:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.899925+0000", 2024-04-26T10:44:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6079999999999999e-05 2024-04-26T10:44:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:21.027 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.900041+0000", 2024-04-26T10:44:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000115308 2024-04-26T10:44:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.901610+0000", 2024-04-26T10:44:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001569467 2024-04-26T10:44:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.901652+0000", 2024-04-26T10:44:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1665000000000002e-05 2024-04-26T10:44:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.028 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.901723+0000", 2024-04-26T10:44:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1185000000000004e-05 2024-04-26T10:44:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:3346 4.3c 4:3cac0111:::10000001079.00000000:head [write 0~368036] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:44:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:17.218125+0000", 2024-04-26T10:44:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 3.7225311890000001, 2024-04-26T10:44:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017712240000000001, 2024-04-26T10:44:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:21.029 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 3346 2024-04-26T10:44:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.218125+0000", 2024-04-26T10:44:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.218125+0000", 2024-04-26T10:44:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.030 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.218124+0000", 2024-04-26T10:44:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.218400+0000", 2024-04-26T10:44:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000276218 2024-04-26T10:44:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.218413+0000", 2024-04-26T10:44:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.3444999999999999e-05 2024-04-26T10:44:21.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.218419+0000", 2024-04-26T10:44:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3319999999999999e-06 2024-04-26T10:44:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.218466+0000", 2024-04-26T10:44:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7157000000000003e-05 2024-04-26T10:44:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.218590+0000", 2024-04-26T10:44:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012381499999999999 2024-04-26T10:44:21.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.219775+0000", 2024-04-26T10:44:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001185773 2024-04-26T10:44:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.219818+0000", 2024-04-26T10:44:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3031000000000002e-05 2024-04-26T10:44:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:17.219896+0000", 2024-04-26T10:44:21.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7688000000000006e-05 2024-04-26T10:44:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:76 3.1f e54/37 3:f83d65d8:::200.00000004:head v 54'5, mlcod=0'0)", 2024-04-26T10:44:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:20.488063+0000", 2024-04-26T10:44:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.45259269299999999, 2024-04-26T10:44:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.008466477, 2024-04-26T10:44:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:21.034 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.488063+0000", 2024-04-26T10:44:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.488063+0000", 2024-04-26T10:44:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.488063+0000", 2024-04-26T10:44:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.035 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.491671+0000", 2024-04-26T10:44:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0036083310000000002 2024-04-26T10:44:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.491684+0000", 2024-04-26T10:44:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.3053e-05 2024-04-26T10:44:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.491708+0000", 2024-04-26T10:44:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3635999999999999e-05 2024-04-26T10:44:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.036 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.491742+0000", 2024-04-26T10:44:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3794999999999997e-05 2024-04-26T10:44:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.491755+0000", 2024-04-26T10:44:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.3643e-05 2024-04-26T10:44:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.496487+0000", 2024-04-26T10:44:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004731758 2024-04-26T10:44:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.037 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:21.038 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.496530+0000", 2024-04-26T10:44:21.038 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2865999999999999e-05 2024-04-26T10:44:21.038 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.038 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:21.038 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.038 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.038 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:21.038 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:21.039 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:21.038+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:21.040 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:21.141 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:21.140+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:21.170 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:21.170 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:21.170 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.170 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:6997 4.3 4:c2e726d5:::10000001fff.00000000:head [write 0~984 in=984b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:44:21.170 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.169333+0000", 2024-04-26T10:44:21.171 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.00033096200000000002, 2024-04-26T10:44:21.171 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00034807000000000002, 2024-04-26T10:44:21.171 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:21.171 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:21.171 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:21.171 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:21.171 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:21.171 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 6997 2024-04-26T10:44:21.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.171 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:21.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.171 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:21.171 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.169333+0000", 2024-04-26T10:44:21.172 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.172 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.172 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.172 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:21.172 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.169333+0000", 2024-04-26T10:44:21.173 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.173 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:21.173 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.169332+0000", 2024-04-26T10:44:21.173 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:21.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.173 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:21.173 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.169337+0000", 2024-04-26T10:44:21.173 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6090000000000003e-06 2024-04-26T10:44:21.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.173 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:21.174 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.169348+0000", 2024-04-26T10:44:21.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1096e-05 2024-04-26T10:44:21.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.174 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.174 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.169353+0000", 2024-04-26T10:44:21.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3929999999999999e-06 2024-04-26T10:44:21.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.174 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:21.174 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.169391+0000", 2024-04-26T10:44:21.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7863e-05 2024-04-26T10:44:21.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.175 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:21.175 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.169461+0000", 2024-04-26T10:44:21.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9764999999999994e-05 2024-04-26T10:44:21.175 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.175 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:21.175 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.175 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.175 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-26T10:44:21.175 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 1 2024-04-26T10:44:21.175 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:21.181 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:21.267 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:21.266+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:21.342 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:21.341+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:21.343 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:21.343 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:21.343 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:21.343 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:21.343 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:21.354 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:21.356 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:44:21.443 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:21.442+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:21.506 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:21.507 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:21.507 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:21.507 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:21.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.507 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:31 3.d e14/12 3:b50e409b:::mds_snaptable:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:21.507 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:21.507 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 115.46857797600001, 2024-04-26T10:44:21.507 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057202360000000001, 2024-04-26T10:44:21.507 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:21.507 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.507 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:21.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.507 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:21.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:21.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.508 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:21.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:21.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.508 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:21.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035897+0000", 2024-04-26T10:44:21.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:21.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.509 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:21.509 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035904+0000", 2024-04-26T10:44:21.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:44:21.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.509 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:21.509 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035912+0000", 2024-04-26T10:44:21.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1929999999999993e-06 2024-04-26T10:44:21.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.509 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.509 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.035920+0000", 2024-04-26T10:44:21.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8709999999999997e-06 2024-04-26T10:44:21.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:21.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036251+0000", 2024-04-26T10:44:21.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033125599999999999 2024-04-26T10:44:21.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:21.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.036272+0000", 2024-04-26T10:44:21.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1169999999999999e-05 2024-04-26T10:44:21.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:21.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041577+0000", 2024-04-26T10:44:21.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053051019999999999 2024-04-26T10:44:21.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.511 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:21.511 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041617+0000", 2024-04-26T10:44:21.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0076000000000001e-05 2024-04-26T10:44:21.511 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.511 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:21.511 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.511 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:21.511 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:21.511 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 115.46682785500001, 2024-04-26T10:44:21.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.008573074, 2024-04-26T10:44:21.512 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:21.512 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.512 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:21.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:21.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:21.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:21.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037647+0000", 2024-04-26T10:44:21.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:21.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037645+0000", 2024-04-26T10:44:21.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:21.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:21.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037657+0000", 2024-04-26T10:44:21.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:44:21.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:21.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037671+0000", 2024-04-26T10:44:21.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3856000000000001e-05 2024-04-26T10:44:21.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037681+0000", 2024-04-26T10:44:21.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0019e-05 2024-04-26T10:44:21.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:21.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037786+0000", 2024-04-26T10:44:21.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105714 2024-04-26T10:44:21.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:21.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037931+0000", 2024-04-26T10:44:21.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000144525 2024-04-26T10:44:21.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:21.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038126+0000", 2024-04-26T10:44:21.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019559199999999999 2024-04-26T10:44:21.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:21.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041629+0000", 2024-04-26T10:44:21.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035025730000000001 2024-04-26T10:44:21.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:21.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046044+0000", 2024-04-26T10:44:21.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004414734 2024-04-26T10:44:21.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:21.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046159+0000", 2024-04-26T10:44:21.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115692 2024-04-26T10:44:21.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:21.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046220+0000", 2024-04-26T10:44:21.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0760000000000001e-05 2024-04-26T10:44:21.516 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.516 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:21.516 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.517 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:21.517 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:21.517 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 115.466774857, 2024-04-26T10:44:21.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087058789999999997, 2024-04-26T10:44:21.517 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:21.517 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.517 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:21.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:21.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:21.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:21.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:21.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:21.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037700+0000", 2024-04-26T10:44:21.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:21.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:21.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037704+0000", 2024-04-26T10:44:21.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:44:21.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:21.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037715+0000", 2024-04-26T10:44:21.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0693000000000001e-05 2024-04-26T10:44:21.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037729+0000", 2024-04-26T10:44:21.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3776e-05 2024-04-26T10:44:21.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:21.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039735+0000", 2024-04-26T10:44:21.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002006655 2024-04-26T10:44:21.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:21.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039836+0000", 2024-04-26T10:44:21.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100961 2024-04-26T10:44:21.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:21.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040014+0000", 2024-04-26T10:44:21.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000178176 2024-04-26T10:44:21.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:21.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044741+0000", 2024-04-26T10:44:21.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047267910000000002 2024-04-26T10:44:21.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:21.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046290+0000", 2024-04-26T10:44:21.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015484559999999999 2024-04-26T10:44:21.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:21.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046353+0000", 2024-04-26T10:44:21.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3201999999999996e-05 2024-04-26T10:44:21.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:21.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046406+0000", 2024-04-26T10:44:21.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3118000000000002e-05 2024-04-26T10:44:21.522 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.522 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:21.522 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.522 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:21.522 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:21.522 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 115.466697113, 2024-04-26T10:44:21.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011270741000000001, 2024-04-26T10:44:21.522 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:21.522 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.522 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:21.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:21.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:21.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:21.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037778+0000", 2024-04-26T10:44:21.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:21.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037777+0000", 2024-04-26T10:44:21.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:21.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:21.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037782+0000", 2024-04-26T10:44:21.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1100000000000002e-06 2024-04-26T10:44:21.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:21.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037792+0000", 2024-04-26T10:44:21.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5340000000000005e-06 2024-04-26T10:44:21.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037798+0000", 2024-04-26T10:44:21.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3439999999999997e-06 2024-04-26T10:44:21.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:21.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040365+0000", 2024-04-26T10:44:21.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002566881 2024-04-26T10:44:21.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:21.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040511+0000", 2024-04-26T10:44:21.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000146036 2024-04-26T10:44:21.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:21.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040652+0000", 2024-04-26T10:44:21.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014046299999999999 2024-04-26T10:44:21.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:21.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045380+0000", 2024-04-26T10:44:21.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047281199999999997 2024-04-26T10:44:21.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:21.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048951+0000", 2024-04-26T10:44:21.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003571248 2024-04-26T10:44:21.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:21.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048995+0000", 2024-04-26T10:44:21.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4215999999999998e-05 2024-04-26T10:44:21.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.527 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:21.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049049+0000", 2024-04-26T10:44:21.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3522e-05 2024-04-26T10:44:21.527 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.527 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:21.527 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.527 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:21.527 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:21.527 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 115.466658107, 2024-04-26T10:44:21.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011361599999999999, 2024-04-26T10:44:21.528 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:21.528 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.528 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:21.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:21.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:21.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:21.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037817+0000", 2024-04-26T10:44:21.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:21.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037816+0000", 2024-04-26T10:44:21.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:21.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:21.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037821+0000", 2024-04-26T10:44:21.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:44:21.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:21.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037827+0000", 2024-04-26T10:44:21.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5050000000000004e-06 2024-04-26T10:44:21.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.530 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.530 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037831+0000", 2024-04-26T10:44:21.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0620000000000002e-06 2024-04-26T10:44:21.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.530 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:21.530 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041659+0000", 2024-04-26T10:44:21.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003827638 2024-04-26T10:44:21.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.530 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:21.530 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041746+0000", 2024-04-26T10:44:21.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7009000000000007e-05 2024-04-26T10:44:21.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:21.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042197+0000", 2024-04-26T10:44:21.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000451247 2024-04-26T10:44:21.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:21.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047167+0000", 2024-04-26T10:44:21.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049701429999999998 2024-04-26T10:44:21.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:21.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049109+0000", 2024-04-26T10:44:21.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019412570000000001 2024-04-26T10:44:21.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.532 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:21.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049154+0000", 2024-04-26T10:44:21.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:44:21.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.532 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:21.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049178+0000", 2024-04-26T10:44:21.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4677000000000001e-05 2024-04-26T10:44:21.532 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.532 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:21.532 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.532 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:21.533 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:21.533 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 115.466639286, 2024-04-26T10:44:21.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00807772, 2024-04-26T10:44:21.533 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:21.533 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.533 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:21.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:21.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:21.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:21.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:21.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:21.534 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037836+0000", 2024-04-26T10:44:21.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:21.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:21.534 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037837+0000", 2024-04-26T10:44:21.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9099999999999999e-06 2024-04-26T10:44:21.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:21.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037841+0000", 2024-04-26T10:44:21.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.49e-06 2024-04-26T10:44:21.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037846+0000", 2024-04-26T10:44:21.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.429e-06 2024-04-26T10:44:21.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:21.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037906+0000", 2024-04-26T10:44:21.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9249999999999997e-05 2024-04-26T10:44:21.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:21.536 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038085+0000", 2024-04-26T10:44:21.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017908999999999999 2024-04-26T10:44:21.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.536 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:21.536 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038203+0000", 2024-04-26T10:44:21.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118678 2024-04-26T10:44:21.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.536 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:21.536 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042986+0000", 2024-04-26T10:44:21.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047828430000000002 2024-04-26T10:44:21.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:21.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045463+0000", 2024-04-26T10:44:21.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024768469999999999 2024-04-26T10:44:21.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:21.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045527+0000", 2024-04-26T10:44:21.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3886000000000005e-05 2024-04-26T10:44:21.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:21.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045913+0000", 2024-04-26T10:44:21.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000386513 2024-04-26T10:44:21.537 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.537 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:21.538 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.538 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:21.538 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:21.538 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 115.46660728400001, 2024-04-26T10:44:21.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082990939999999999, 2024-04-26T10:44:21.538 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:21.538 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.538 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:21.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:21.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:21.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.539 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:21.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037868+0000", 2024-04-26T10:44:21.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.539 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:21.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037867+0000", 2024-04-26T10:44:21.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:21.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.539 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:21.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037871+0000", 2024-04-26T10:44:21.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.641e-06 2024-04-26T10:44:21.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:21.540 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037880+0000", 2024-04-26T10:44:21.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8629999999999997e-06 2024-04-26T10:44:21.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.540 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.037887+0000", 2024-04-26T10:44:21.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:44:21.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:21.540 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039620+0000", 2024-04-26T10:44:21.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001732819 2024-04-26T10:44:21.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.541 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:21.541 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039747+0000", 2024-04-26T10:44:21.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000127088 2024-04-26T10:44:21.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.541 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:21.541 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.039912+0000", 2024-04-26T10:44:21.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000164706 2024-04-26T10:44:21.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.541 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:21.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043442+0000", 2024-04-26T10:44:21.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003530428 2024-04-26T10:44:21.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:21.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046071+0000", 2024-04-26T10:44:21.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026293890000000002 2024-04-26T10:44:21.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:21.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046117+0000", 2024-04-26T10:44:21.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5580000000000001e-05 2024-04-26T10:44:21.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:21.543 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046167+0000", 2024-04-26T10:44:21.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9846999999999999e-05 2024-04-26T10:44:21.543 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.543 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:21.543 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.543 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:21.543 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:21.543 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 115.46639847599999, 2024-04-26T10:44:21.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011038844000000001, 2024-04-26T10:44:21.543 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:21.543 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.544 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:21.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:21.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:21.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:21.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038077+0000", 2024-04-26T10:44:21.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:21.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038076+0000", 2024-04-26T10:44:21.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:21.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.545 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:21.545 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038083+0000", 2024-04-26T10:44:21.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9229999999999996e-06 2024-04-26T10:44:21.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.545 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:21.545 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038092+0000", 2024-04-26T10:44:21.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2920000000000001e-06 2024-04-26T10:44:21.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.545 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.545 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038101+0000", 2024-04-26T10:44:21.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0100000000000001e-06 2024-04-26T10:44:21.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:21.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042444+0000", 2024-04-26T10:44:21.546 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043433530000000003 2024-04-26T10:44:21.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:21.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.042838+0000", 2024-04-26T10:44:21.546 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039408800000000001 2024-04-26T10:44:21.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:21.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043268+0000", 2024-04-26T10:44:21.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043013099999999999 2024-04-26T10:44:21.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:21.547 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048446+0000", 2024-04-26T10:44:21.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051772190000000003 2024-04-26T10:44:21.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:21.547 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049037+0000", 2024-04-26T10:44:21.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000591747 2024-04-26T10:44:21.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.548 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:21.548 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049079+0000", 2024-04-26T10:44:21.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1680000000000001e-05 2024-04-26T10:44:21.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.548 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:21.548 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.049115+0000", 2024-04-26T10:44:21.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6297999999999997e-05 2024-04-26T10:44:21.548 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.548 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:21.548 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.548 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:21.548 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:21.549 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 115.466367185, 2024-04-26T10:44:21.549 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078138779999999998, 2024-04-26T10:44:21.549 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:21.549 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:21.549 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:21.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.549 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:21.549 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:21.549 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.549 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:21.549 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038108+0000", 2024-04-26T10:44:21.549 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.550 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:21.550 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038107+0000", 2024-04-26T10:44:21.550 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:21.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.550 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:21.550 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038111+0000", 2024-04-26T10:44:21.550 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.241e-06 2024-04-26T10:44:21.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.550 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:21.551 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038117+0000", 2024-04-26T10:44:21.551 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.764e-06 2024-04-26T10:44:21.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.551 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038124+0000", 2024-04-26T10:44:21.551 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:44:21.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:21.551 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038171+0000", 2024-04-26T10:44:21.551 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.689e-05 2024-04-26T10:44:21.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:21.552 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038280+0000", 2024-04-26T10:44:21.552 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000109242 2024-04-26T10:44:21.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.552 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:21.552 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.045922+0000", 2024-04-26T10:44:21.552 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076419249999999999 2024-04-26T10:44:21.552 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.552 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:21.552 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.552 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:21.552 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:21.553 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 115.46633993499999, 2024-04-26T10:44:21.553 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086255889999999995, 2024-04-26T10:44:21.553 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:21.553 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:21.553 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:21.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.553 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:21.553 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:21.553 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.553 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:21.553 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:21.553 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.554 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:21.554 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038135+0000", 2024-04-26T10:44:21.554 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:21.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.554 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:21.554 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038145+0000", 2024-04-26T10:44:21.554 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0436e-05 2024-04-26T10:44:21.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.554 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:21.554 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038154+0000", 2024-04-26T10:44:21.554 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4479999999999994e-06 2024-04-26T10:44:21.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.555 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.555 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038160+0000", 2024-04-26T10:44:21.555 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:44:21.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.555 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:21.555 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038217+0000", 2024-04-26T10:44:21.555 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.698e-05 2024-04-26T10:44:21.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.555 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:21.555 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.038743+0000", 2024-04-26T10:44:21.555 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052606899999999999 2024-04-26T10:44:21.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.556 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:21.556 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.046761+0000", 2024-04-26T10:44:21.556 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080176450000000003 2024-04-26T10:44:21.556 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.556 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:21.556 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.556 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "pg_update_log_missing(3.1e epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:44:21.556 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:21.556 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 115.46356318399999, 2024-04-26T10:44:21.556 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006489379, 2024-04-26T10:44:21.557 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:21.557 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-04-26T10:44:21.557 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:21.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.557 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:21.557 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:21.557 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.557 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:21.557 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040912+0000", 2024-04-26T10:44:21.557 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.557 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:21.558 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040911+0000", 2024-04-26T10:44:21.558 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:21.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.558 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:21.558 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040920+0000", 2024-04-26T10:44:21.558 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1139999999999995e-06 2024-04-26T10:44:21.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.558 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:21.558 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040934+0000", 2024-04-26T10:44:21.558 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3872e-05 2024-04-26T10:44:21.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.559 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.559 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040953+0000", 2024-04-26T10:44:21.559 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8970999999999998e-05 2024-04-26T10:44:21.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.559 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:21.559 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043082+0000", 2024-04-26T10:44:21.559 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00212889 2024-04-26T10:44:21.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.559 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:21.559 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047401+0000", 2024-04-26T10:44:21.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043190770000000002 2024-04-26T10:44:21.560 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.560 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:21.560 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.560 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:24 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:21.560 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:21.560 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 115.463513095, 2024-04-26T10:44:21.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069074940000000001, 2024-04-26T10:44:21.560 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:21.560 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.560 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:21.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.561 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:21.561 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:21.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.561 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:21.561 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040962+0000", 2024-04-26T10:44:21.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.561 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:21.561 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040961+0000", 2024-04-26T10:44:21.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:21.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.562 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:21.562 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040967+0000", 2024-04-26T10:44:21.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:44:21.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.562 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:21.562 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040976+0000", 2024-04-26T10:44:21.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6940000000000001e-06 2024-04-26T10:44:21.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.562 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.040986+0000", 2024-04-26T10:44:21.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0069e-05 2024-04-26T10:44:21.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.563 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:21.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043516+0000", 2024-04-26T10:44:21.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025302380000000002 2024-04-26T10:44:21.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.563 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:21.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.043592+0000", 2024-04-26T10:44:21.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6274999999999997e-05 2024-04-26T10:44:21.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.564 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:21.564 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047836+0000", 2024-04-26T10:44:21.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042436949999999996 2024-04-26T10:44:21.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.564 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:21.564 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047869+0000", 2024-04-26T10:44:21.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3362999999999999e-05 2024-04-26T10:44:21.564 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.564 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:21.564 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.565 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(mds.0.3:25 3.7 e14/12 3:e0b41d06:::609.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:44:21.565 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:21.565 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 115.46262102599999, 2024-04-26T10:44:21.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061643139999999997, 2024-04-26T10:44:21.565 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:21.565 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.565 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:21.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:21.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:21.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:21.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041854+0000", 2024-04-26T10:44:21.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:21.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041853+0000", 2024-04-26T10:44:21.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:21.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:21.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041870+0000", 2024-04-26T10:44:21.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6441999999999999e-05 2024-04-26T10:44:21.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:21.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041879+0000", 2024-04-26T10:44:21.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7329999999999998e-06 2024-04-26T10:44:21.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.041888+0000", 2024-04-26T10:44:21.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5040000000000002e-06 2024-04-26T10:44:21.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:21.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044155+0000", 2024-04-26T10:44:21.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022673229999999999 2024-04-26T10:44:21.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:21.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.044176+0000", 2024-04-26T10:44:21.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0944000000000001e-05 2024-04-26T10:44:21.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:21.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.047990+0000", 2024-04-26T10:44:21.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038138960000000002 2024-04-26T10:44:21.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:21.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:42:26.048018+0000", 2024-04-26T10:44:21.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:21.568 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.568 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:21.569 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.569 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:4 4.32 4:4def72d4:::10000000003.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:44:21.569 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:13.306328+0000", 2024-04-26T10:44:21.569 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.1981466669999996, 2024-04-26T10:44:21.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012467232999999999, 2024-04-26T10:44:21.569 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:21.569 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.569 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:21.569 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:21.569 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:21.569 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 4 2024-04-26T10:44:21.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.570 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:21.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:21.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.306328+0000", 2024-04-26T10:44:21.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:21.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.306328+0000", 2024-04-26T10:44:21.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:21.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.306325+0000", 2024-04-26T10:44:21.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999971 2024-04-26T10:44:21.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:21.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313008+0000", 2024-04-26T10:44:21.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0066830450000000003 2024-04-26T10:44:21.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:21.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313032+0000", 2024-04-26T10:44:21.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3034e-05 2024-04-26T10:44:21.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313041+0000", 2024-04-26T10:44:21.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.037e-06 2024-04-26T10:44:21.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:21.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313086+0000", 2024-04-26T10:44:21.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5259000000000002e-05 2024-04-26T10:44:21.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:21.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.313156+0000", 2024-04-26T10:44:21.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0504000000000001e-05 2024-04-26T10:44:21.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:21.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.318691+0000", 2024-04-26T10:44:21.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0055346370000000002 2024-04-26T10:44:21.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:21.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.318724+0000", 2024-04-26T10:44:21.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3300000000000003e-05 2024-04-26T10:44:21.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:21.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.318796+0000", 2024-04-26T10:44:21.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1316999999999995e-05 2024-04-26T10:44:21.573 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.573 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:21.573 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.574 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:44:21.574 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:13.469171+0000", 2024-04-26T10:44:21.574 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.0353040310000008, 2024-04-26T10:44:21.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017514674000000001, 2024-04-26T10:44:21.574 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:21.574 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.574 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:21.574 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:21.574 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:21.574 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 5 2024-04-26T10:44:21.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.575 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:21.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:21.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.469171+0000", 2024-04-26T10:44:21.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:21.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.469171+0000", 2024-04-26T10:44:21.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:21.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.469168+0000", 2024-04-26T10:44:21.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999971 2024-04-26T10:44:21.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:21.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.474986+0000", 2024-04-26T10:44:21.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0058177690000000004 2024-04-26T10:44:21.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:21.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475001+0000", 2024-04-26T10:44:21.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5349000000000002e-05 2024-04-26T10:44:21.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475009+0000", 2024-04-26T10:44:21.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.3579999999999997e-06 2024-04-26T10:44:21.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:21.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475157+0000", 2024-04-26T10:44:21.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014815 2024-04-26T10:44:21.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:21.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475325+0000", 2024-04-26T10:44:21.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00016793299999999999 2024-04-26T10:44:21.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:21.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475461+0000", 2024-04-26T10:44:21.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00013602800000000001 2024-04-26T10:44:21.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:21.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.483044+0000", 2024-04-26T10:44:21.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0075827309999999997 2024-04-26T10:44:21.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:21.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.486538+0000", 2024-04-26T10:44:21.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0034942739999999999 2024-04-26T10:44:21.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:21.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.486596+0000", 2024-04-26T10:44:21.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8019999999999997e-05 2024-04-26T10:44:21.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:21.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.486686+0000", 2024-04-26T10:44:21.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9702000000000003e-05 2024-04-26T10:44:21.579 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.579 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:21.579 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.579 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:44:21.579 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:13.475021+0000", 2024-04-26T10:44:21.580 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.0294541850000005, 2024-04-26T10:44:21.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0084663459999999996, 2024-04-26T10:44:21.580 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:21.580 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.580 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:21.580 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:21.580 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:21.580 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 6 2024-04-26T10:44:21.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.580 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:21.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.580 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:21.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475021+0000", 2024-04-26T10:44:21.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:21.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475021+0000", 2024-04-26T10:44:21.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:21.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.475020+0000", 2024-04-26T10:44:21.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:21.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:21.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480334+0000", 2024-04-26T10:44:21.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053142500000000004 2024-04-26T10:44:21.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:21.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480354+0000", 2024-04-26T10:44:21.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.931e-05 2024-04-26T10:44:21.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480365+0000", 2024-04-26T10:44:21.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1477999999999999e-05 2024-04-26T10:44:21.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:21.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480420+0000", 2024-04-26T10:44:21.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4802000000000001e-05 2024-04-26T10:44:21.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:21.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.480596+0000", 2024-04-26T10:44:21.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000175806 2024-04-26T10:44:21.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:21.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.483338+0000", 2024-04-26T10:44:21.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0027423730000000002 2024-04-26T10:44:21.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:21.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.483389+0000", 2024-04-26T10:44:21.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0662999999999999e-05 2024-04-26T10:44:21.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:21.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:13.483487+0000", 2024-04-26T10:44:21.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.8350000000000005e-05 2024-04-26T10:44:21.584 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.584 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:21.584 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.585 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:65 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e53)", 2024-04-26T10:44:21.585 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:16.510703+0000", 2024-04-26T10:44:21.585 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.9937717299999997, 2024-04-26T10:44:21.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012272897, 2024-04-26T10:44:21.585 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:21.585 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.585 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:21.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:21.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.510703+0000", 2024-04-26T10:44:21.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:21.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.510703+0000", 2024-04-26T10:44:21.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:21.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.510702+0000", 2024-04-26T10:44:21.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:21.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:21.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.511120+0000", 2024-04-26T10:44:21.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00041818600000000002 2024-04-26T10:44:21.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:21.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.511131+0000", 2024-04-26T10:44:21.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0900999999999999e-05 2024-04-26T10:44:21.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.511139+0000", 2024-04-26T10:44:21.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7160000000000003e-06 2024-04-26T10:44:21.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:21.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.511174+0000", 2024-04-26T10:44:21.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.5499e-05 2024-04-26T10:44:21.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.588 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:21.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.511226+0000", 2024-04-26T10:44:21.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.168e-05 2024-04-26T10:44:21.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.588 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:21.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.517346+0000", 2024-04-26T10:44:21.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061201149999999998 2024-04-26T10:44:21.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.588 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:21.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.522622+0000", 2024-04-26T10:44:21.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0052753440000000004 2024-04-26T10:44:21.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:21.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.522878+0000", 2024-04-26T10:44:21.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00025625300000000001 2024-04-26T10:44:21.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:21.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.522920+0000", 2024-04-26T10:44:21.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2620000000000002e-05 2024-04-26T10:44:21.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:21.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:16.522976+0000", 2024-04-26T10:44:21.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5682e-05 2024-04-26T10:44:21.590 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.590 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:21.590 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.590 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:76 3.1f 3:f83d65d8:::200.00000004:head [write 0~3781368 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:21.590 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:20.482547+0000", 2024-04-26T10:44:21.590 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 1.021928468, 2024-04-26T10:44:21.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014225990000000001, 2024-04-26T10:44:21.590 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:21.590 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.590 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:21.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:21.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:20.482547+0000", 2024-04-26T10:44:21.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:21.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:20.482547+0000", 2024-04-26T10:44:21.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:21.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:20.482546+0000", 2024-04-26T10:44:21.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:21.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:21.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:20.487575+0000", 2024-04-26T10:44:21.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.005029721 2024-04-26T10:44:21.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:21.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:20.487592+0000", 2024-04-26T10:44:21.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6178e-05 2024-04-26T10:44:21.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:20.487598+0000", 2024-04-26T10:44:21.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6420000000000001e-06 2024-04-26T10:44:21.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:21.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:20.487643+0000", 2024-04-26T10:44:21.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4579999999999997e-05 2024-04-26T10:44:21.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:21.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:20.487734+0000", 2024-04-26T10:44:21.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1061000000000001e-05 2024-04-26T10:44:21.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:21.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:20.487814+0000", 2024-04-26T10:44:21.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0366999999999998e-05 2024-04-26T10:44:21.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:21.594 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:20.492711+0000", 2024-04-26T10:44:21.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0048970250000000002 2024-04-26T10:44:21.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:21.594 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:20.496683+0000", 2024-04-26T10:44:21.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039718119999999999 2024-04-26T10:44:21.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:21.595 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:20.496720+0000", 2024-04-26T10:44:21.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6684000000000003e-05 2024-04-26T10:44:21.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.595 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:21.595 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:20.496773+0000", 2024-04-26T10:44:21.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2726000000000003e-05 2024-04-26T10:44:21.595 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.595 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:21.595 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.595 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:7246 4.33 4:cd39a79d:::10000002114.00000000:head [write 0~3211] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:44:21.595 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.460488+0000", 2024-04-26T10:44:21.596 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.043986846000000003, 2024-04-26T10:44:21.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018628133000000002, 2024-04-26T10:44:21.596 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:21.596 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.596 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:21.596 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:21.596 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:21.596 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 7246 2024-04-26T10:44:21.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.596 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:21.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.596 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:21.596 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.460488+0000", 2024-04-26T10:44:21.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:21.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.460488+0000", 2024-04-26T10:44:21.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:21.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.460488+0000", 2024-04-26T10:44:21.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:21.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:21.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.460492+0000", 2024-04-26T10:44:21.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5079999999999999e-06 2024-04-26T10:44:21.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:21.598 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.460499+0000", 2024-04-26T10:44:21.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8789999999999997e-06 2024-04-26T10:44:21.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.598 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.460503+0000", 2024-04-26T10:44:21.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0539999999999996e-06 2024-04-26T10:44:21.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:21.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.477601+0000", 2024-04-26T10:44:21.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017097979999999999 2024-04-26T10:44:21.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.599 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:21.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.477754+0000", 2024-04-26T10:44:21.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000152948 2024-04-26T10:44:21.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.599 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:21.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.477903+0000", 2024-04-26T10:44:21.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000149135 2024-04-26T10:44:21.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.599 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:21.600 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.479064+0000", 2024-04-26T10:44:21.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00116098 2024-04-26T10:44:21.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.600 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:21.600 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.479068+0000", 2024-04-26T10:44:21.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6729999999999998e-06 2024-04-26T10:44:21.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.600 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:21.600 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.479095+0000", 2024-04-26T10:44:21.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6911999999999999e-05 2024-04-26T10:44:21.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.601 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:21.601 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.479116+0000", 2024-04-26T10:44:21.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1679999999999999e-05 2024-04-26T10:44:21.601 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.601 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:21.601 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.601 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:7247 4.3 4:c3d09780:::10000002115.00000000:head [write 0~2504] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:44:21.601 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.461477+0000", 2024-04-26T10:44:21.601 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.042998443999999997, 2024-04-26T10:44:21.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018487312999999998, 2024-04-26T10:44:21.601 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:21.601 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.602 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:21.602 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:21.602 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:21.602 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 7247 2024-04-26T10:44:21.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.602 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:21.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:21.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.461477+0000", 2024-04-26T10:44:21.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:21.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.461477+0000", 2024-04-26T10:44:21.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:21.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:21.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.461476+0000", 2024-04-26T10:44:21.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:21.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:21.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.461483+0000", 2024-04-26T10:44:21.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.81e-06 2024-04-26T10:44:21.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:21.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.477573+0000", 2024-04-26T10:44:21.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016090118 2024-04-26T10:44:21.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.604 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.477594+0000", 2024-04-26T10:44:21.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1433e-05 2024-04-26T10:44:21.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:21.604 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.477629+0000", 2024-04-26T10:44:21.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4727999999999997e-05 2024-04-26T10:44:21.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:21.605 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.478374+0000", 2024-04-26T10:44:21.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00074537699999999998 2024-04-26T10:44:21.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.605 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:21.605 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.479876+0000", 2024-04-26T10:44:21.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015021279999999999 2024-04-26T10:44:21.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.605 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:21.605 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.479903+0000", 2024-04-26T10:44:21.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6553000000000001e-05 2024-04-26T10:44:21.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:21.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:21.605 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:21.606 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.479964+0000", 2024-04-26T10:44:21.606 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0955999999999997e-05 2024-04-26T10:44:21.606 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.606 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:21.606 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.606 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:21.606 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:21.606 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:21.608 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:21.608 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:21.606+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:21.708 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:21.707+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:21.720 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:21.720 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:21.720 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:44:21.720 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:21.729 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:21.809 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:21.808+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:21.836 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:21.836 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:21.836 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:21.836 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:21.836 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:21.845 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:21.910 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:21.909+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:21.957 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:21.957 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:21.957 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:21.958 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:21.958 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.958 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:21.958 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:21.958 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 115.918617342, 2024-04-26T10:44:21.958 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:44:21.958 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:21.958 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.958 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:21.958 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.958 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:21.958 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:21.958 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.958 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.959 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.959 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:21.959 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:21.959 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.959 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.959 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.959 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:21.959 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:44:21.959 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:21.959 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.959 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.959 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:21.960 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:44:21.960 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:44:21.960 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.960 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.960 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:21.960 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:44:21.960 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:44:21.960 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.960 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.960 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.960 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:44:21.960 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:44:21.960 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.961 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.961 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:21.961 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:44:21.961 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:44:21.961 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.961 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.961 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:21.961 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:44:21.961 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:44:21.961 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.961 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.961 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:21.961 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:44:21.962 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:44:21.962 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.962 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.962 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:21.962 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:44:21.962 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:44:21.962 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.962 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:21.962 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.962 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.962 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.962 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:21.962 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:21.963 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 115.91623307499999, 2024-04-26T10:44:21.963 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:44:21.963 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:21.963 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.963 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:21.963 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.963 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:21.963 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:21.963 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.963 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.963 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.963 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:21.963 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:21.963 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.964 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.964 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.964 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:21.964 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:44:21.964 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:21.964 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.964 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.964 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:21.964 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:44:21.964 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:44:21.964 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.964 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.964 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:21.964 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:44:21.965 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:44:21.965 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.965 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.965 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.965 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:44:21.965 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:44:21.965 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.965 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.965 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:21.965 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:44:21.965 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:44:21.965 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.965 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.966 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:21.966 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:44:21.966 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:44:21.966 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.966 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.966 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:21.966 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:44:21.966 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:44:21.966 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.966 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.966 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:21.966 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:44:21.966 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:44:21.966 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.966 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.967 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:21.967 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:44:21.967 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:44:21.967 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.967 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.967 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:21.967 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:44:21.967 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:44:21.967 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.967 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.967 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:21.967 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:44:21.967 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:44:21.968 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.968 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:21.968 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.968 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.968 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.968 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:21.968 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:21.968 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 115.916181251, 2024-04-26T10:44:21.968 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:44:21.968 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:21.968 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.968 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:21.968 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.968 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:21.969 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:21.969 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.969 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.969 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.969 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:21.969 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:21.969 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.969 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.969 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.969 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:21.969 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:44:21.969 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:21.969 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.969 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.970 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:21.970 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:44:21.970 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:44:21.970 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.970 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.970 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:21.970 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:44:21.970 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:44:21.970 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.970 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.970 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.970 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:44:21.971 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:44:21.971 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.971 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.971 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:21.971 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:44:21.971 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:44:21.971 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.971 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.971 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:21.971 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:44:21.971 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:44:21.971 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.971 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.971 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:21.971 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:44:21.972 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:44:21.972 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.972 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.972 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:21.972 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:44:21.972 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:44:21.972 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.972 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.972 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:21.972 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:44:21.972 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:44:21.972 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.972 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.972 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:21.973 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:44:21.973 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:44:21.973 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.973 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.973 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:21.973 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:44:21.973 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:44:21.973 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.973 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:21.973 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.973 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.973 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.973 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:21.973 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:21.974 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 115.916127879, 2024-04-26T10:44:21.974 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:44:21.974 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:21.974 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.974 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:21.974 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.974 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:21.974 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:21.974 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.974 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.974 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.974 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:21.974 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:21.974 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.975 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.975 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.975 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:21.975 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:21.975 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:21.975 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.975 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.975 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:21.975 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:44:21.975 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:44:21.975 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.975 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.975 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:21.975 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:44:21.976 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:44:21.976 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.976 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.976 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.976 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:44:21.976 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:44:21.976 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.976 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.976 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:21.976 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:44:21.976 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:44:21.976 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.976 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.976 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:21.977 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:44:21.977 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:44:21.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.977 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:21.977 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:44:21.977 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:44:21.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.977 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:21.977 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:44:21.977 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:44:21.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.978 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.978 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:21.978 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:44:21.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:44:21.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.978 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.978 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:21.978 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:44:21.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:44:21.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.978 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.978 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:21.978 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:44:21.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:44:21.979 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.979 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:21.979 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.979 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.979 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.979 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:21.979 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:21.979 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 115.916083552, 2024-04-26T10:44:21.979 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:44:21.979 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:21.979 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.979 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:21.979 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.979 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:21.979 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:21.980 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.980 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.980 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.980 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:21.980 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:21.980 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.980 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.980 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.980 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:21.980 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:21.980 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:21.980 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.980 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.980 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:21.980 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:44:21.981 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:44:21.981 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.981 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.981 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:21.981 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:44:21.981 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:44:21.981 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.981 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.981 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.981 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:44:21.981 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:44:21.981 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.981 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.981 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:21.981 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:44:21.982 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:44:21.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.982 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.982 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:21.982 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:44:21.982 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:44:21.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.982 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.982 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:21.982 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:44:21.982 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:44:21.982 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.982 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.982 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:21.983 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:44:21.983 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:44:21.983 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.983 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.983 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:21.983 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:44:21.983 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:44:21.983 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.983 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.983 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:21.983 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:44:21.983 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:44:21.983 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.983 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.984 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:21.984 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:44:21.984 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:44:21.984 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.984 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:21.984 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.984 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.984 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.984 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:21.984 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:21.984 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 115.916059839, 2024-04-26T10:44:21.984 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:44:21.984 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:21.984 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.984 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:21.985 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.985 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:21.985 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:21.985 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.985 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.985 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.985 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:21.985 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:21.985 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.985 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.985 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.985 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:21.985 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:21.985 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:21.986 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.986 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.986 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:21.986 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:44:21.986 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:44:21.986 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.986 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.986 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:21.986 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:44:21.986 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:44:21.986 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.986 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.986 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.986 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:44:21.987 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:44:21.987 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.987 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.987 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:21.987 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:44:21.987 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:44:21.987 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.987 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.987 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:21.987 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:44:21.987 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:44:21.987 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.988 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.988 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:21.988 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:44:21.988 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:44:21.988 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.989 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.989 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:21.989 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:44:21.989 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:44:21.989 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.989 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.991 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:21.991 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:44:21.991 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:44:21.991 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.991 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.991 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:21.991 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:44:21.991 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:44:21.991 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.991 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.991 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:21.991 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:44:21.991 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:44:21.992 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.992 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:21.992 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.992 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.992 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.992 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:21.992 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:21.992 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 115.916025534, 2024-04-26T10:44:21.992 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:44:21.992 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:21.992 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:21.992 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:21.992 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.992 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:21.992 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:21.993 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.993 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.993 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.993 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:21.993 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:21.993 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.993 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.993 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.993 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:21.993 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:44:21.993 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:21.993 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.993 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.993 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:21.993 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:44:21.994 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:44:21.994 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.994 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.994 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:21.994 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:44:21.994 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:44:21.994 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.995 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.995 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:21.995 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:44:21.995 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:44:21.995 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.995 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.995 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:21.996 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:44:21.996 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:44:21.996 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.996 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.996 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:21.996 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:44:21.996 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:44:21.996 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.996 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.996 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:21.996 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:44:21.996 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:44:21.996 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.996 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.997 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:21.997 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:44:21.997 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:44:21.997 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.997 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.997 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:21.997 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:44:21.997 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:44:21.997 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.997 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.997 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:21.997 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:44:21.997 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:44:21.997 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.997 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.998 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:21.998 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:44:21.998 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:44:21.998 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.998 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:21.998 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:21.998 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.998 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.998 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:21.998 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:21.998 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 115.915688938, 2024-04-26T10:44:21.998 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:44:21.998 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:21.998 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:21.998 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:21.999 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.999 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:21.999 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:21.999 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:21.999 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:21.999 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:21.999 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:21.999 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:21.999 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.000 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.000 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.001 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:22.001 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:44:22.001 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:22.001 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.001 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.001 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:22.001 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:44:22.001 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:44:22.001 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.001 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.001 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:22.001 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:44:22.001 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:44:22.001 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.002 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.002 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:22.002 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:44:22.002 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:44:22.002 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.002 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.002 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:22.002 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:44:22.002 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:44:22.002 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.002 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.002 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:22.002 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:44:22.002 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:44:22.003 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.003 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.003 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:22.003 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:44:22.003 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:44:22.003 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.003 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:22.003 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.003 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.003 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.003 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:22.003 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:22.003 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 115.91564691000001, 2024-04-26T10:44:22.003 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:44:22.004 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:22.004 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:22.004 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:22.004 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.004 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:22.004 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:22.004 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.004 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.004 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.004 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:22.004 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:22.004 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.004 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.004 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.004 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:22.005 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:22.005 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:22.006 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.006 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.006 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:22.006 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:44:22.006 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:44:22.006 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.006 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.006 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:22.006 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:44:22.006 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:44:22.006 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.006 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.006 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:22.007 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:44:22.007 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:44:22.007 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.007 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.007 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:22.007 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:44:22.007 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:44:22.007 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.007 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.007 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:22.008 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:44:22.008 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:44:22.009 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.009 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.009 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:22.009 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:44:22.009 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:44:22.009 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.009 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:22.009 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.009 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.009 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.009 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:22.009 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:22.009 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 115.915593738, 2024-04-26T10:44:22.009 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:44:22.010 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:22.010 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:22.010 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:22.010 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.010 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:22.010 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:22.010 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.010 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.010 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.010 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:22.010 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:22.010 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.010 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.010 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.011 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:22.011 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:22.011 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:22.011 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.011 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.011 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:22.011 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:44:22.011 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:44:22.011 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.011 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.011 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:22.012 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:44:22.012 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:44:22.012 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.012 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.012 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:22.012 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:44:22.012 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:44:22.012 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.012 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.012 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:22.012 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:44:22.012 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:44:22.012 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.012 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.013 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:22.013 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:44:22.013 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:44:22.013 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.013 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.013 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:22.013 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:44:22.013 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:44:22.013 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.013 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:22.013 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.013 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.013 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.013 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(client.4532.0:5 4.10 e52/37 4:09a4c37f:::10000000003.00000001:head v 52'1, mlcod=0'0)", 2024-04-26T10:44:22.013 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:22.014 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.4795263680000001, 2024-04-26T10:44:22.014 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010754041000000001, 2024-04-26T10:44:22.014 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:22.014 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:22.014 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:22.014 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.014 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:22.014 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:22.014 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.014 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.014 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.014 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:22.014 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:22.014 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.015 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.015 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.015 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:22.015 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:22.015 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:44:22.015 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.015 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.015 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:22.015 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479849+0000", 2024-04-26T10:44:22.015 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004225716 2024-04-26T10:44:22.015 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.015 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.015 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:22.015 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479868+0000", 2024-04-26T10:44:22.015 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.8666000000000001e-05 2024-04-26T10:44:22.016 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.016 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.016 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:22.016 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479878+0000", 2024-04-26T10:44:22.016 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.6150000000000003e-06 2024-04-26T10:44:22.016 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.016 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.016 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:22.016 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479935+0000", 2024-04-26T10:44:22.016 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7766999999999998e-05 2024-04-26T10:44:22.016 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.016 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.016 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:22.016 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479960+0000", 2024-04-26T10:44:22.016 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4343000000000001e-05 2024-04-26T10:44:22.017 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.017 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.017 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:22.017 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.486332+0000", 2024-04-26T10:44:22.017 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0063727610000000002 2024-04-26T10:44:22.017 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.017 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.017 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:22.017 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.486378+0000", 2024-04-26T10:44:22.017 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.5334000000000003e-05 2024-04-26T10:44:22.017 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.017 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:22.017 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.017 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.017 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.018 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:65 3.6 e53/37 3:654134d2:::mds0_openfiles.0:head v 53'6, mlcod=48'4)", 2024-04-26T10:44:22.018 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:16.517520+0000", 2024-04-26T10:44:22.018 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 5.4376296210000001, 2024-04-26T10:44:22.018 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052681739999999996, 2024-04-26T10:44:22.018 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:22.018 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:22.018 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:22.018 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.018 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:22.018 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517520+0000", 2024-04-26T10:44:22.018 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.018 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.018 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.018 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:22.019 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517520+0000", 2024-04-26T10:44:22.019 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.019 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.019 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.019 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:22.019 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517520+0000", 2024-04-26T10:44:22.019 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:22.019 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.019 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.019 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:22.019 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517652+0000", 2024-04-26T10:44:22.019 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000132662 2024-04-26T10:44:22.019 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.019 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.020 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:22.020 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517662+0000", 2024-04-26T10:44:22.020 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7019999999999996e-06 2024-04-26T10:44:22.020 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.020 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.020 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:22.020 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517668+0000", 2024-04-26T10:44:22.020 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0530000000000003e-06 2024-04-26T10:44:22.020 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.020 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.020 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:22.020 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517730+0000", 2024-04-26T10:44:22.020 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2158999999999999e-05 2024-04-26T10:44:22.020 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.020 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.021 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:22.021 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517745+0000", 2024-04-26T10:44:22.021 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4273999999999999e-05 2024-04-26T10:44:22.021 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.021 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.021 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:22.021 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.522754+0000", 2024-04-26T10:44:22.021 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0050096450000000001 2024-04-26T10:44:22.021 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.021 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.021 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:22.022 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.522789+0000", 2024-04-26T10:44:22.022 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4406000000000002e-05 2024-04-26T10:44:22.022 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.022 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:22.022 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.022 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.022 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.022 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:3051 4.11 4:8afd8039:::10000000f44.00000000:head [write 0~672130] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:44:22.022 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:16.898960+0000", 2024-04-26T10:44:22.022 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 5.0561895459999997, 2024-04-26T10:44:22.022 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027624870000000001, 2024-04-26T10:44:22.022 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:22.022 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:22.022 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:22.023 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:22.023 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:22.023 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 3051 2024-04-26T10:44:22.023 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.023 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:22.023 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.023 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:22.023 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.898960+0000", 2024-04-26T10:44:22.023 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.023 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.023 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.023 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:22.023 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.898960+0000", 2024-04-26T10:44:22.024 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.024 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.024 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.024 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:22.024 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.898960+0000", 2024-04-26T10:44:22.024 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:22.024 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.024 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.024 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:22.024 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.899863+0000", 2024-04-26T10:44:22.024 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00090309799999999997 2024-04-26T10:44:22.024 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.024 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.024 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:22.025 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.899874+0000", 2024-04-26T10:44:22.025 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1269e-05 2024-04-26T10:44:22.025 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.025 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.025 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:22.025 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.899879+0000", 2024-04-26T10:44:22.025 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.1549999999999998e-06 2024-04-26T10:44:22.025 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.025 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.025 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:22.025 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.899925+0000", 2024-04-26T10:44:22.025 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6079999999999999e-05 2024-04-26T10:44:22.025 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.025 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.025 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:22.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.900041+0000", 2024-04-26T10:44:22.026 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000115308 2024-04-26T10:44:22.026 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.026 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.026 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:22.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.901610+0000", 2024-04-26T10:44:22.026 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001569467 2024-04-26T10:44:22.026 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.026 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.026 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:22.026 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.901652+0000", 2024-04-26T10:44:22.026 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1665000000000002e-05 2024-04-26T10:44:22.026 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.026 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.027 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:22.027 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.901723+0000", 2024-04-26T10:44:22.027 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1185000000000004e-05 2024-04-26T10:44:22.027 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.027 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:22.027 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.027 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.027 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.027 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:76 3.1f e54/37 3:f83d65d8:::200.00000004:head v 54'5, mlcod=0'0)", 2024-04-26T10:44:22.027 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:20.488063+0000", 2024-04-26T10:44:22.027 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 1.467086667, 2024-04-26T10:44:22.027 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.008466477, 2024-04-26T10:44:22.027 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:22.027 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:22.027 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:22.028 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.028 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:22.028 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.488063+0000", 2024-04-26T10:44:22.028 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.028 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.028 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.028 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:22.028 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.488063+0000", 2024-04-26T10:44:22.028 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.028 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.028 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.028 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:22.028 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.488063+0000", 2024-04-26T10:44:22.028 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:22.028 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.029 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.029 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:22.029 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.491671+0000", 2024-04-26T10:44:22.029 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0036083310000000002 2024-04-26T10:44:22.029 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.029 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.029 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:22.029 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.491684+0000", 2024-04-26T10:44:22.029 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.3053e-05 2024-04-26T10:44:22.029 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.029 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.029 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:22.029 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.491708+0000", 2024-04-26T10:44:22.030 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3635999999999999e-05 2024-04-26T10:44:22.030 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.030 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.030 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:22.030 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.491742+0000", 2024-04-26T10:44:22.030 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3794999999999997e-05 2024-04-26T10:44:22.030 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.030 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.030 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:22.030 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.491755+0000", 2024-04-26T10:44:22.030 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.3643e-05 2024-04-26T10:44:22.030 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.031 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.031 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:22.031 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.496487+0000", 2024-04-26T10:44:22.031 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004731758 2024-04-26T10:44:22.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.031 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.031 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:22.031 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.496530+0000", 2024-04-26T10:44:22.031 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2865999999999999e-05 2024-04-26T10:44:22.031 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.031 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:22.032 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.032 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:79 3.1a e54/12 3:5e41ab69:::200.00000005:head v 54'2, mlcod=0'0)", 2024-04-26T10:44:22.032 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:21.509811+0000", 2024-04-26T10:44:22.032 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.44533909199999999, 2024-04-26T10:44:22.032 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0074314530000000002, 2024-04-26T10:44:22.032 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:22.032 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:22.032 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:22.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.032 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:22.032 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.509811+0000", 2024-04-26T10:44:22.032 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.033 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.033 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:22.033 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.509811+0000", 2024-04-26T10:44:22.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.033 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.033 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.033 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:22.033 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.509810+0000", 2024-04-26T10:44:22.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:22.033 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.033 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.033 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:22.033 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.513080+0000", 2024-04-26T10:44:22.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0032696639999999998 2024-04-26T10:44:22.034 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.034 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.034 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:22.034 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.513092+0000", 2024-04-26T10:44:22.034 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2378000000000001e-05 2024-04-26T10:44:22.034 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.034 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.034 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:22.034 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.513097+0000", 2024-04-26T10:44:22.034 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9450000000000001e-06 2024-04-26T10:44:22.034 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.034 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.034 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:22.035 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.513170+0000", 2024-04-26T10:44:22.035 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.2577999999999995e-05 2024-04-26T10:44:22.035 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.035 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.035 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:22.035 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.513182+0000", 2024-04-26T10:44:22.035 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1769e-05 2024-04-26T10:44:22.035 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.035 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.035 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:22.035 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.517200+0000", 2024-04-26T10:44:22.035 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0040181150000000001 2024-04-26T10:44:22.035 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.035 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.035 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:22.036 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.517242+0000", 2024-04-26T10:44:22.036 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2580999999999998e-05 2024-04-26T10:44:22.036 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.036 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:22.036 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.036 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.036 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.036 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:80 3.6 e54/37 3:654134d2:::mds0_openfiles.0:head v 54'7, mlcod=49'5)", 2024-04-26T10:44:22.036 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:21.536534+0000", 2024-04-26T10:44:22.036 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.41861562400000002, 2024-04-26T10:44:22.036 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.014436087, 2024-04-26T10:44:22.036 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:22.036 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:22.036 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:22.036 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.037 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:22.037 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.536534+0000", 2024-04-26T10:44:22.037 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.037 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.037 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.037 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:22.037 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.536534+0000", 2024-04-26T10:44:22.037 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.037 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.037 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.037 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:22.037 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.536534+0000", 2024-04-26T10:44:22.037 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:22.037 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.038 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.038 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:22.038 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.536999+0000", 2024-04-26T10:44:22.038 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00046557800000000002 2024-04-26T10:44:22.038 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.038 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.038 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:22.038 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.537008+0000", 2024-04-26T10:44:22.038 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.0990000000000005e-06 2024-04-26T10:44:22.038 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.038 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.038 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:22.038 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.537013+0000", 2024-04-26T10:44:22.038 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4569999999999998e-06 2024-04-26T10:44:22.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.039 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:22.039 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.537050+0000", 2024-04-26T10:44:22.039 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7191999999999999e-05 2024-04-26T10:44:22.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.039 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:22.039 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.537064+0000", 2024-04-26T10:44:22.039 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.3930999999999999e-05 2024-04-26T10:44:22.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.039 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:22.039 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.550933+0000", 2024-04-26T10:44:22.039 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013868660999999999 2024-04-26T10:44:22.040 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.040 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.040 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:22.040 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.550971+0000", 2024-04-26T10:44:22.040 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7824000000000002e-05 2024-04-26T10:44:22.040 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.040 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:22.040 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.040 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.040 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.040 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:117 3.1a e54/12 3:5e41ab69:::200.00000005:head v 54'39, mlcod=54'34)", 2024-04-26T10:44:22.040 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:21.547445+0000", 2024-04-26T10:44:22.040 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.40770526600000001, 2024-04-26T10:44:22.040 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0038616309999999999, 2024-04-26T10:44:22.040 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:22.041 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:22.041 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:22.041 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.041 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:22.041 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.547445+0000", 2024-04-26T10:44:22.041 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.041 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.041 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.041 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:22.041 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.547445+0000", 2024-04-26T10:44:22.041 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.041 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.041 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.041 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:22.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.547444+0000", 2024-04-26T10:44:22.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:22.042 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.042 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:22.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.547451+0000", 2024-04-26T10:44:22.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.9450000000000004e-06 2024-04-26T10:44:22.042 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.042 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:22.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.547459+0000", 2024-04-26T10:44:22.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8650000000000001e-06 2024-04-26T10:44:22.042 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.042 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:22.043 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.547465+0000", 2024-04-26T10:44:22.043 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5770000000000001e-06 2024-04-26T10:44:22.043 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.043 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.043 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:22.043 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.547496+0000", 2024-04-26T10:44:22.043 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1479000000000001e-05 2024-04-26T10:44:22.043 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.043 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.043 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:22.043 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.547514+0000", 2024-04-26T10:44:22.043 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.7918999999999999e-05 2024-04-26T10:44:22.043 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.043 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.043 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:22.044 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.551285+0000", 2024-04-26T10:44:22.044 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0037713379999999999 2024-04-26T10:44:22.044 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.044 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.044 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:22.044 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.551306+0000", 2024-04-26T10:44:22.044 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0965999999999999e-05 2024-04-26T10:44:22.044 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.044 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:22.044 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.044 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.044 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.044 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:118 3.1a e54/12 3:5e41ab69:::200.00000005:head v 54'40, mlcod=54'36)", 2024-04-26T10:44:22.044 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:21.548135+0000", 2024-04-26T10:44:22.045 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.40701526900000001, 2024-04-26T10:44:22.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0031880419999999999, 2024-04-26T10:44:22.045 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:22.045 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:22.045 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:22.045 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.045 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:22.045 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548135+0000", 2024-04-26T10:44:22.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.045 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.045 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.045 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:22.045 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548135+0000", 2024-04-26T10:44:22.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.045 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.046 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.046 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:22.046 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548134+0000", 2024-04-26T10:44:22.046 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:22.046 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.046 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.046 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:22.046 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548139+0000", 2024-04-26T10:44:22.046 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.1000000000000003e-06 2024-04-26T10:44:22.046 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.046 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.046 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:22.046 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548150+0000", 2024-04-26T10:44:22.046 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0318e-05 2024-04-26T10:44:22.047 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.047 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.049 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:22.049 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548156+0000", 2024-04-26T10:44:22.049 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9479999999999996e-06 2024-04-26T10:44:22.049 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.049 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.049 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:22.049 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548184+0000", 2024-04-26T10:44:22.049 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8119e-05 2024-04-26T10:44:22.049 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.049 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.049 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:22.050 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548194+0000", 2024-04-26T10:44:22.050 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0115000000000001e-05 2024-04-26T10:44:22.050 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.050 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:22.050 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.551308+0000", 2024-04-26T10:44:22.050 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.003114361 2024-04-26T10:44:22.050 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.050 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:22.050 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.551323+0000", 2024-04-26T10:44:22.050 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4688999999999999e-05 2024-04-26T10:44:22.050 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.050 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:22.051 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.051 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.051 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.051 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:119 3.1a e54/12 3:5e41ab69:::200.00000005:head v 54'41, mlcod=54'36)", 2024-04-26T10:44:22.051 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:21.548622+0000", 2024-04-26T10:44:22.051 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.40652835399999998, 2024-04-26T10:44:22.051 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027130600000000002, 2024-04-26T10:44:22.051 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:22.051 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:22.051 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:22.051 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.051 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:22.051 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548622+0000", 2024-04-26T10:44:22.051 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.052 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.052 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.052 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:22.052 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548622+0000", 2024-04-26T10:44:22.052 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.052 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.052 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.052 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:22.052 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548621+0000", 2024-04-26T10:44:22.052 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:22.052 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.052 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.052 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:22.052 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548625+0000", 2024-04-26T10:44:22.052 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1980000000000003e-06 2024-04-26T10:44:22.053 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.053 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.053 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:22.053 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548633+0000", 2024-04-26T10:44:22.053 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9410000000000007e-06 2024-04-26T10:44:22.053 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.053 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.053 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:22.053 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548638+0000", 2024-04-26T10:44:22.053 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0119999999999996e-06 2024-04-26T10:44:22.053 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.053 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.053 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:22.053 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548669+0000", 2024-04-26T10:44:22.053 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0222e-05 2024-04-26T10:44:22.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.054 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:22.054 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548679+0000", 2024-04-26T10:44:22.054 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0815000000000001e-05 2024-04-26T10:44:22.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.054 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:22.054 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.551324+0000", 2024-04-26T10:44:22.054 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0026441250000000002 2024-04-26T10:44:22.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.054 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:22.054 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.551335+0000", 2024-04-26T10:44:22.055 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.116e-05 2024-04-26T10:44:22.055 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.055 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:22.055 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.055 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.055 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.055 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(client.4532.0:7286 4.28 e54/37 4:17a6e24f:::10000002141.00000000:head v 54'118, mlcod=54'116)", 2024-04-26T10:44:22.055 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:21.549423+0000", 2024-04-26T10:44:22.055 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.40572690300000003, 2024-04-26T10:44:22.055 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0024093880000000002, 2024-04-26T10:44:22.055 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:22.055 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:22.055 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:22.055 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.055 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:22.056 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.549423+0000", 2024-04-26T10:44:22.056 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.056 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.056 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:22.056 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.549423+0000", 2024-04-26T10:44:22.056 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:22.056 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.056 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:22.056 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.549423+0000", 2024-04-26T10:44:22.056 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:22.056 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.056 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:22.057 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.549433+0000", 2024-04-26T10:44:22.057 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0353999999999999e-05 2024-04-26T10:44:22.057 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.057 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.057 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:22.057 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.549441+0000", 2024-04-26T10:44:22.057 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.6939999999999995e-06 2024-04-26T10:44:22.057 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.057 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.057 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:22.057 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.549446+0000", 2024-04-26T10:44:22.057 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8500000000000002e-06 2024-04-26T10:44:22.057 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.058 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.058 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:22.058 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.549478+0000", 2024-04-26T10:44:22.058 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1917e-05 2024-04-26T10:44:22.058 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.058 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.058 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:22.058 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.549497+0000", 2024-04-26T10:44:22.058 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9423e-05 2024-04-26T10:44:22.058 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.058 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.059 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:22.059 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.551805+0000", 2024-04-26T10:44:22.059 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0023079620000000002 2024-04-26T10:44:22.059 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:22.059 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:22.059 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:22.059 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.551833+0000", 2024-04-26T10:44:22.059 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7628e-05 2024-04-26T10:44:22.059 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.059 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:22.059 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.059 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:22.059 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:22.059 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:22.061 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:22.060+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:22.061 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:22.162 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:22.161+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:22.175 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:44:22.177 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:22.177 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:22.177 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:44:22.177 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:22.187 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:22.263 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:22.262+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:22.302 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:22.303 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:22.303 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:22.303 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:22.303 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:22.313 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:22.321 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:22.321 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:22.321 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:22.343 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:22.344 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:22.346 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:22.346 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:22.354 INFO:teuthology.orchestra.run.smithi049.stderr:noscrub is set 2024-04-26T10:44:22.363 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:22.363+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:22.430 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:22.431 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:22.441 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:22.464 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:22.463+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:22.548 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:22.548 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:22.557 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:22.600 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:22.600+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:22.661 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:22.661 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:22.667 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:22.666+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:22.670 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:22.768 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:22.767+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:22.815 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:22.815 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:22.824 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:22.870 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:22.869+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:22.938 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:22.938 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:22.948 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:22.972 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:22.971+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:23.074 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:23.073+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:23.108 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:23.108 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:23.118 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:23.202 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:23.201+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:23.274 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:23.274 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:23.276 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:23.276+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:23.283 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:23.377 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:23.377+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:23.392 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:23.392 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:23.401 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:23.485 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:23.485+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:23.548 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:23.548 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:23.558 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:23.578 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:23.578+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:23.679 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:23.679+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:23.704 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:23.705 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:23.714 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:23.780 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:23.780+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:23.836 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:23.836 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:23.847 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:23.888 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:23.887+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:23.983 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:23.983+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:24.000 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:24.000 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:24.010 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:24.084 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:24.084+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:24.128 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:24.128 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:24.137 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:24.186 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:24.185+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:24.250 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:24.250 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:24.260 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:24.287 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:24.286+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:24.347 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:44:24.366 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:24.367 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:24.369 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:44:24.376 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:24.388 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:24.387+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:24.480 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:24.480 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:24.488 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:24.488+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:24.490 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:24.491 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:24.491 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:24.491 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:24.514 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:24.514 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:24.517 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:24.518 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:24.590 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:24.589+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:24.615 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:24.615 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:24.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:9747 4.2d 4:b6d2126d:::10000002cc6.00000000:head [write 0~17990 in=17990b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T10:44:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:24.614217+0000", 2024-04-26T10:44:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.00063133799999999995, 2024-04-26T10:44:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00064953500000000002, 2024-04-26T10:44:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:44:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 9747 2024-04-26T10:44:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.616 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:24.617 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:24.614217+0000", 2024-04-26T10:44:24.617 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.617 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:24.617 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:24.614217+0000", 2024-04-26T10:44:24.617 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.617 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:24.617 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:24.614216+0000", 2024-04-26T10:44:24.617 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:24.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.618 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:24.618 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:24.614228+0000", 2024-04-26T10:44:24.618 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1517e-05 2024-04-26T10:44:24.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.618 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:24.618 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:24.614239+0000", 2024-04-26T10:44:24.618 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1029999999999999e-05 2024-04-26T10:44:24.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.618 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:24.618 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:24.614245+0000", 2024-04-26T10:44:24.618 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3400000000000003e-06 2024-04-26T10:44:24.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.619 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:24.619 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:24.614285+0000", 2024-04-26T10:44:24.619 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9412999999999997e-05 2024-04-26T10:44:24.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.619 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:24.619 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:24.614417+0000", 2024-04-26T10:44:24.619 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000131872 2024-04-26T10:44:24.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.619 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:24.619 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:24.614551+0000", 2024-04-26T10:44:24.619 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00013462500000000001 2024-04-26T10:44:24.620 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.620 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:24.620 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.620 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.620 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-26T10:44:24.620 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 1 2024-04-26T10:44:24.620 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:24.625 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:24.691 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:24.690+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:24.736 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:24.736 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:24.736 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:24.736 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:24.736 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:24.746 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:24.791 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:24.791+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:24.892 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:24.891+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:24.906 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:80 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.3812084570000001, 2024-04-26T10:44:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029259192, 2024-04-26T10:44:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522252+0000", 2024-04-26T10:44:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523121+0000", 2024-04-26T10:44:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00086885100000000002 2024-04-26T10:44:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523133+0000", 2024-04-26T10:44:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2109999999999999e-05 2024-04-26T10:44:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523139+0000", 2024-04-26T10:44:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.541e-06 2024-04-26T10:44:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523176+0000", 2024-04-26T10:44:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6847999999999997e-05 2024-04-26T10:44:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523240+0000", 2024-04-26T10:44:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3941000000000003e-05 2024-04-26T10:44:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.536390+0000", 2024-04-26T10:44:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013150811 2024-04-26T10:44:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551071+0000", 2024-04-26T10:44:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014680021 2024-04-26T10:44:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551428+0000", 2024-04-26T10:44:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00035703900000000002 2024-04-26T10:44:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551462+0000", 2024-04-26T10:44:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4337e-05 2024-04-26T10:44:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551513+0000", 2024-04-26T10:44:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0875000000000003e-05 2024-04-26T10:44:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:129 3.1a 3:5e41ab69:::200.00000005:head [write 3557843~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.3771503869999999, 2024-04-26T10:44:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029108253000000001, 2024-04-26T10:44:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526311+0000", 2024-04-26T10:44:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526315+0000", 2024-04-26T10:44:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4809999999999998e-06 2024-04-26T10:44:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526319+0000", 2024-04-26T10:44:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0690000000000003e-06 2024-04-26T10:44:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526321+0000", 2024-04-26T10:44:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4880000000000001e-06 2024-04-26T10:44:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553856+0000", 2024-04-26T10:44:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027534916 2024-04-26T10:44:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553900+0000", 2024-04-26T10:44:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3954e-05 2024-04-26T10:44:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553962+0000", 2024-04-26T10:44:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1519000000000005e-05 2024-04-26T10:44:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555348+0000", 2024-04-26T10:44:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013864579999999999 2024-04-26T10:44:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555378+0000", 2024-04-26T10:44:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9441000000000002e-05 2024-04-26T10:44:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555401+0000", 2024-04-26T10:44:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2815000000000001e-05 2024-04-26T10:44:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555420+0000", 2024-04-26T10:44:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9341e-05 2024-04-26T10:44:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:130 3.1a 3:5e41ab69:::200.00000005:head [write 3559243~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.3771385519999999, 2024-04-26T10:44:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029188316999999998, 2024-04-26T10:44:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526325+0000", 2024-04-26T10:44:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4899999999999999e-06 2024-04-26T10:44:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526327+0000", 2024-04-26T10:44:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.745e-06 2024-04-26T10:44:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526330+0000", 2024-04-26T10:44:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5620000000000002e-06 2024-04-26T10:44:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554200+0000", 2024-04-26T10:44:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027869541000000001 2024-04-26T10:44:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554244+0000", 2024-04-26T10:44:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4464e-05 2024-04-26T10:44:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554304+0000", 2024-04-26T10:44:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9457999999999999e-05 2024-04-26T10:44:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555453+0000", 2024-04-26T10:44:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011494000000000001 2024-04-26T10:44:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555457+0000", 2024-04-26T10:44:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1779999999999996e-06 2024-04-26T10:44:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555480+0000", 2024-04-26T10:44:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2802e-05 2024-04-26T10:44:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555512+0000", 2024-04-26T10:44:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1885999999999999e-05 2024-04-26T10:44:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:131 3.1a 3:5e41ab69:::200.00000005:head [write 3560642~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.3771299720000001, 2024-04-26T10:44:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029683102999999999, 2024-04-26T10:44:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526336+0000", 2024-04-26T10:44:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.681e-06 2024-04-26T10:44:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526338+0000", 2024-04-26T10:44:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8430000000000001e-06 2024-04-26T10:44:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526341+0000", 2024-04-26T10:44:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6180000000000002e-06 2024-04-26T10:44:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554745+0000", 2024-04-26T10:44:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028404088000000001 2024-04-26T10:44:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554788+0000", 2024-04-26T10:44:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2738999999999999e-05 2024-04-26T10:44:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554849+0000", 2024-04-26T10:44:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1362e-05 2024-04-26T10:44:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555963+0000", 2024-04-26T10:44:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001113597 2024-04-26T10:44:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555969+0000", 2024-04-26T10:44:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6900000000000003e-06 2024-04-26T10:44:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555995+0000", 2024-04-26T10:44:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5165999999999999e-05 2024-04-26T10:44:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556015+0000", 2024-04-26T10:44:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0522000000000001e-05 2024-04-26T10:44:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:132 3.1a 3:5e41ab69:::200.00000005:head [write 3562043~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.3771097069999998, 2024-04-26T10:44:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030129895, 2024-04-26T10:44:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526354+0000", 2024-04-26T10:44:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8560000000000001e-06 2024-04-26T10:44:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526359+0000", 2024-04-26T10:44:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4700000000000001e-06 2024-04-26T10:44:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526365+0000", 2024-04-26T10:44:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2120000000000002e-06 2024-04-26T10:44:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555050+0000", 2024-04-26T10:44:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028685458 2024-04-26T10:44:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555093+0000", 2024-04-26T10:44:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3307999999999999e-05 2024-04-26T10:44:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555156+0000", 2024-04-26T10:44:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2396000000000004e-05 2024-04-26T10:44:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556052+0000", 2024-04-26T10:44:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00089650299999999999 2024-04-26T10:44:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556439+0000", 2024-04-26T10:44:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038647900000000001 2024-04-26T10:44:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556463+0000", 2024-04-26T10:44:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4071e-05 2024-04-26T10:44:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556482+0000", 2024-04-26T10:44:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9378999999999999e-05 2024-04-26T10:44:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 3563440~3660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.377093313, 2024-04-26T10:44:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030550738000000001, 2024-04-26T10:44:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526368+0000", 2024-04-26T10:44:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526375+0000", 2024-04-26T10:44:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7510000000000002e-06 2024-04-26T10:44:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526381+0000", 2024-04-26T10:44:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3929999999999996e-06 2024-04-26T10:44:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526387+0000", 2024-04-26T10:44:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.215e-06 2024-04-26T10:44:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555542+0000", 2024-04-26T10:44:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029154992000000001 2024-04-26T10:44:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555610+0000", 2024-04-26T10:44:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8610999999999998e-05 2024-04-26T10:44:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555681+0000", 2024-04-26T10:44:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1072e-05 2024-04-26T10:44:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556866+0000", 2024-04-26T10:44:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001184598 2024-04-26T10:44:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556872+0000", 2024-04-26T10:44:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.55e-06 2024-04-26T10:44:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556897+0000", 2024-04-26T10:44:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.516e-05 2024-04-26T10:44:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556919+0000", 2024-04-26T10:44:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1951e-05 2024-04-26T10:44:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:134 3.1a 3:5e41ab69:::200.00000005:head [write 3567100~2427 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.3770602479999998, 2024-04-26T10:44:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031267445999999997, 2024-04-26T10:44:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526401+0000", 2024-04-26T10:44:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526408+0000", 2024-04-26T10:44:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7769999999999997e-06 2024-04-26T10:44:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526415+0000", 2024-04-26T10:44:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0720000000000002e-06 2024-04-26T10:44:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526421+0000", 2024-04-26T10:44:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9699999999999996e-06 2024-04-26T10:44:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556084+0000", 2024-04-26T10:44:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029662351999999999 2024-04-26T10:44:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556126+0000", 2024-04-26T10:44:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2385000000000002e-05 2024-04-26T10:44:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556186+0000", 2024-04-26T10:44:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9945999999999998e-05 2024-04-26T10:44:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557598+0000", 2024-04-26T10:44:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0014121559999999999 2024-04-26T10:44:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557626+0000", 2024-04-26T10:44:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7960999999999999e-05 2024-04-26T10:44:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557650+0000", 2024-04-26T10:44:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3969999999999999e-05 2024-04-26T10:44:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557669+0000", 2024-04-26T10:44:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9262e-05 2024-04-26T10:44:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:135 3.1a 3:5e41ab69:::200.00000005:head [write 3569527~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.3770359819999998, 2024-04-26T10:44:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031322516000000002, 2024-04-26T10:44:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526429+0000", 2024-04-26T10:44:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0750000000000002e-06 2024-04-26T10:44:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526435+0000", 2024-04-26T10:44:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.263e-06 2024-04-26T10:44:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526442+0000", 2024-04-26T10:44:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1219999999999997e-06 2024-04-26T10:44:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556515+0000", 2024-04-26T10:44:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030073132999999998 2024-04-26T10:44:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556564+0000", 2024-04-26T10:44:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8871e-05 2024-04-26T10:44:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556625+0000", 2024-04-26T10:44:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1307000000000001e-05 2024-04-26T10:44:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557678+0000", 2024-04-26T10:44:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010523100000000001 2024-04-26T10:44:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557709+0000", 2024-04-26T10:44:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1748000000000002e-05 2024-04-26T10:44:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557732+0000", 2024-04-26T10:44:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2415000000000001e-05 2024-04-26T10:44:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557749+0000", 2024-04-26T10:44:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6736999999999999e-05 2024-04-26T10:44:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:136 3.1a 3:5e41ab69:::200.00000005:head [write 3571449~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.3770147919999998, 2024-04-26T10:44:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032180937, 2024-04-26T10:44:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526455+0000", 2024-04-26T10:44:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6429999999999995e-06 2024-04-26T10:44:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526461+0000", 2024-04-26T10:44:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526467+0000", 2024-04-26T10:44:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4389999999999999e-06 2024-04-26T10:44:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556950+0000", 2024-04-26T10:44:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030483854000000001 2024-04-26T10:44:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556989+0000", 2024-04-26T10:44:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8415999999999999e-05 2024-04-26T10:44:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557051+0000", 2024-04-26T10:44:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2088999999999995e-05 2024-04-26T10:44:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558166+0000", 2024-04-26T10:44:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001114622 2024-04-26T10:44:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558584+0000", 2024-04-26T10:44:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000418033 2024-04-26T10:44:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558609+0000", 2024-04-26T10:44:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5344999999999999e-05 2024-04-26T10:44:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558628+0000", 2024-04-26T10:44:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9273999999999999e-05 2024-04-26T10:44:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:137 3.1a 3:5e41ab69:::200.00000005:head [write 3573699~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.3769911430000001, 2024-04-26T10:44:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032241530999999997, 2024-04-26T10:44:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526470+0000", 2024-04-26T10:44:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526473+0000", 2024-04-26T10:44:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.818e-06 2024-04-26T10:44:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526480+0000", 2024-04-26T10:44:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4119999999999998e-06 2024-04-26T10:44:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526484+0000", 2024-04-26T10:44:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6840000000000004e-06 2024-04-26T10:44:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557323+0000", 2024-04-26T10:44:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030838956000000001 2024-04-26T10:44:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557362+0000", 2024-04-26T10:44:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8343999999999997e-05 2024-04-26T10:44:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557421+0000", 2024-04-26T10:44:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9176999999999999e-05 2024-04-26T10:44:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:24.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558636+0000", 2024-04-26T10:44:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012153789999999999 2024-04-26T10:44:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558668+0000", 2024-04-26T10:44:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1452999999999999e-05 2024-04-26T10:44:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558694+0000", 2024-04-26T10:44:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6288999999999999e-05 2024-04-26T10:44:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558712+0000", 2024-04-26T10:44:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8459000000000001e-05 2024-04-26T10:44:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:138 3.1a 3:5e41ab69:::200.00000005:head [write 3575103~4205 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.3769738240000002, 2024-04-26T10:44:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032665567999999999, 2024-04-26T10:44:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:24.965 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:24.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:24.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:24.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:24.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526495+0000", 2024-04-26T10:44:24.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7580000000000003e-06 2024-04-26T10:44:24.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:24.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526501+0000", 2024-04-26T10:44:24.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1680000000000001e-06 2024-04-26T10:44:24.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:24.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526505+0000", 2024-04-26T10:44:24.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.673e-06 2024-04-26T10:44:24.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:24.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557781+0000", 2024-04-26T10:44:24.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031275718000000001 2024-04-26T10:44:24.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:24.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557825+0000", 2024-04-26T10:44:24.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4048000000000002e-05 2024-04-26T10:44:24.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:24.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557888+0000", 2024-04-26T10:44:24.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2562000000000002e-05 2024-04-26T10:44:24.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:24.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559073+0000", 2024-04-26T10:44:24.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011852239999999999 2024-04-26T10:44:24.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:24.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559112+0000", 2024-04-26T10:44:24.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9226e-05 2024-04-26T10:44:24.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:24.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559136+0000", 2024-04-26T10:44:24.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3966000000000001e-05 2024-04-26T10:44:24.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:24.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559154+0000", 2024-04-26T10:44:24.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7575e-05 2024-04-26T10:44:24.970 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.970 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:24.970 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.971 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:139 3.1a 3:5e41ab69:::200.00000005:head [write 3579308~2255 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:24.971 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:24.971 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.3769522059999999, 2024-04-26T10:44:24.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033424720999999998, 2024-04-26T10:44:24.971 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:24.971 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:24.971 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:24.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:24.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:24.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:24.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:24.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:24.972 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526509+0000", 2024-04-26T10:44:24.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:24.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:24.972 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526516+0000", 2024-04-26T10:44:24.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5209999999999999e-06 2024-04-26T10:44:24.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:24.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526522+0000", 2024-04-26T10:44:24.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1229999999999997e-06 2024-04-26T10:44:24.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:24.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526527+0000", 2024-04-26T10:44:24.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7849999999999999e-06 2024-04-26T10:44:24.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:24.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558194+0000", 2024-04-26T10:44:24.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031667419000000002 2024-04-26T10:44:24.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:24.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558234+0000", 2024-04-26T10:44:24.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9774999999999998e-05 2024-04-26T10:44:24.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:24.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558294+0000", 2024-04-26T10:44:24.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0242999999999999e-05 2024-04-26T10:44:24.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:24.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559106+0000", 2024-04-26T10:44:24.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00081148099999999996 2024-04-26T10:44:24.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:24.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559890+0000", 2024-04-26T10:44:24.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00078439999999999998 2024-04-26T10:44:24.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:24.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559917+0000", 2024-04-26T10:44:24.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7044000000000001e-05 2024-04-26T10:44:24.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:24.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559935+0000", 2024-04-26T10:44:24.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7448e-05 2024-04-26T10:44:24.976 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.976 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:24.976 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.976 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:140 3.1a 3:5e41ab69:::200.00000005:head [write 3581563~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:24.976 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:24.976 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.3769307849999999, 2024-04-26T10:44:24.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033867728, 2024-04-26T10:44:24.976 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:24.976 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:24.976 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:24.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:24.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:24.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:24.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:24.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:24.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:24.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:24.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:24.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526538+0000", 2024-04-26T10:44:24.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.905e-06 2024-04-26T10:44:24.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:24.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526542+0000", 2024-04-26T10:44:24.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9550000000000002e-06 2024-04-26T10:44:24.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:24.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526545+0000", 2024-04-26T10:44:24.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8499999999999998e-06 2024-04-26T10:44:24.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:24.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558744+0000", 2024-04-26T10:44:24.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032198986999999998 2024-04-26T10:44:24.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:24.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558788+0000", 2024-04-26T10:44:24.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4365e-05 2024-04-26T10:44:24.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:24.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558854+0000", 2024-04-26T10:44:24.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5952999999999997e-05 2024-04-26T10:44:24.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:24.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559971+0000", 2024-04-26T10:44:24.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011172770000000001 2024-04-26T10:44:24.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:24.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560354+0000", 2024-04-26T10:44:24.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038267599999999998 2024-04-26T10:44:24.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.981 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:24.981 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560380+0000", 2024-04-26T10:44:24.981 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6140999999999999e-05 2024-04-26T10:44:24.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.981 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:24.981 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560399+0000", 2024-04-26T10:44:24.981 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9032999999999999e-05 2024-04-26T10:44:24.981 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.981 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:24.981 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.982 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:141 3.1a 3:5e41ab69:::200.00000005:head [write 3583482~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:24.982 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:24.982 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.3769151260000001, 2024-04-26T10:44:24.982 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034316301, 2024-04-26T10:44:24.982 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:24.982 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:24.982 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:24.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.982 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:24.982 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:24.982 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.983 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:24.983 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:24.983 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.983 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:24.983 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:24.983 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:24.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.983 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:24.983 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526548+0000", 2024-04-26T10:44:24.983 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.739e-06 2024-04-26T10:44:24.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.984 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:24.984 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526551+0000", 2024-04-26T10:44:24.984 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.044e-06 2024-04-26T10:44:24.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.984 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:24.984 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526562+0000", 2024-04-26T10:44:24.984 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0370000000000001e-05 2024-04-26T10:44:24.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.984 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:24.984 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559179+0000", 2024-04-26T10:44:24.984 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032617444000000002 2024-04-26T10:44:24.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.985 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:24.985 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559220+0000", 2024-04-26T10:44:24.985 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0364999999999997e-05 2024-04-26T10:44:24.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.985 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:24.985 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559280+0000", 2024-04-26T10:44:24.985 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0569000000000002e-05 2024-04-26T10:44:24.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.985 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:24.985 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560814+0000", 2024-04-26T10:44:24.986 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015337580000000001 2024-04-26T10:44:24.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.986 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:24.986 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560820+0000", 2024-04-26T10:44:24.986 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.455e-06 2024-04-26T10:44:24.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.986 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:24.986 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560846+0000", 2024-04-26T10:44:24.986 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5228999999999998e-05 2024-04-26T10:44:24.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.986 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:24.987 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560863+0000", 2024-04-26T10:44:24.987 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7555e-05 2024-04-26T10:44:24.987 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.987 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:24.987 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:24.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.987 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:142 3.1a 3:5e41ab69:::200.00000005:head [write 3585931~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:24.987 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:24.987 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.376894729, 2024-04-26T10:44:24.987 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034372373999999997, 2024-04-26T10:44:24.987 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:24.987 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:24.987 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:24.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.988 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:24.988 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:24.988 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.988 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:24.988 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:24.988 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:24.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.988 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:24.988 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:24.988 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:24.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.989 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:24.989 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526573+0000", 2024-04-26T10:44:24.989 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0800000000000002e-06 2024-04-26T10:44:24.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.989 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:24.989 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526580+0000", 2024-04-26T10:44:24.989 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5799999999999997e-06 2024-04-26T10:44:24.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.989 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:24.989 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526585+0000", 2024-04-26T10:44:24.989 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2270000000000001e-06 2024-04-26T10:44:24.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.990 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:24.990 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559601+0000", 2024-04-26T10:44:24.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033016684999999997 2024-04-26T10:44:24.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.990 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:24.990 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559642+0000", 2024-04-26T10:44:24.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0321000000000002e-05 2024-04-26T10:44:24.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.990 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:24.990 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559706+0000", 2024-04-26T10:44:24.991 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4228999999999998e-05 2024-04-26T10:44:24.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:24.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:24.991 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:24.991 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560871+0000", 2024-04-26T10:44:24.991 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001164893 2024-04-26T10:44:25.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.050 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:25.050 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560899+0000", 2024-04-26T10:44:25.050 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:25.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.050 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:25.050 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560922+0000", 2024-04-26T10:44:25.051 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3337999999999999e-05 2024-04-26T10:44:25.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.051 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:25.051 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560940+0000", 2024-04-26T10:44:25.051 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7289999999999999e-05 2024-04-26T10:44:25.051 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:25.051 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:25.051 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:25.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.051 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:143 3.1a 3:5e41ab69:::200.00000005:head [write 3587331~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:25.051 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:25.052 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.376872831, 2024-04-26T10:44:25.052 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035256000000000003, 2024-04-26T10:44:25.052 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:25.052 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:25.052 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:25.052 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.052 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:25.052 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:25.052 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:25.052 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.052 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.052 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:25.052 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:25.052 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:25.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.053 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.053 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:25.053 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:25.053 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:25.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.053 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.053 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:25.053 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526592+0000", 2024-04-26T10:44:25.053 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2449999999999998e-06 2024-04-26T10:44:25.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.053 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.053 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:25.053 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526596+0000", 2024-04-26T10:44:25.054 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7000000000000002e-06 2024-04-26T10:44:25.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.054 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.054 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.054 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526599+0000", 2024-04-26T10:44:25.054 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6160000000000002e-06 2024-04-26T10:44:25.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.054 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.054 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:25.054 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559997+0000", 2024-04-26T10:44:25.054 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033397835000000001 2024-04-26T10:44:25.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.054 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.055 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:25.055 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560051+0000", 2024-04-26T10:44:25.055 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3742000000000001e-05 2024-04-26T10:44:25.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.055 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.055 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:25.055 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560112+0000", 2024-04-26T10:44:25.055 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0851999999999999e-05 2024-04-26T10:44:25.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.055 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.055 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:25.055 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561404+0000", 2024-04-26T10:44:25.055 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001291869 2024-04-26T10:44:25.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.056 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.056 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:25.056 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561797+0000", 2024-04-26T10:44:25.056 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039383000000000002 2024-04-26T10:44:25.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.056 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.056 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:25.056 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561827+0000", 2024-04-26T10:44:25.056 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9247e-05 2024-04-26T10:44:25.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.056 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.056 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:25.056 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561845+0000", 2024-04-26T10:44:25.056 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8462999999999999e-05 2024-04-26T10:44:25.057 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:25.057 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:25.057 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:25.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.057 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.057 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:144 3.1a 3:5e41ab69:::200.00000005:head [write 3588736~4987 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:25.057 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:25.057 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.3767505390000001, 2024-04-26T10:44:25.057 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035224283000000002, 2024-04-26T10:44:25.057 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:25.057 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:25.057 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:25.057 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.057 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:25.058 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:25.058 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:25.058 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.058 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.058 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:25.058 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:25.058 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:25.058 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.058 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.058 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:25.058 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:25.058 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:25.058 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.058 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.059 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:25.059 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526718+0000", 2024-04-26T10:44:25.059 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.43e-06 2024-04-26T10:44:25.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.059 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.059 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:25.059 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526726+0000", 2024-04-26T10:44:25.059 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:44:25.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.059 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.059 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.059 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526729+0000", 2024-04-26T10:44:25.059 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6480000000000001e-06 2024-04-26T10:44:25.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.060 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.060 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:25.060 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560427+0000", 2024-04-26T10:44:25.060 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033697280000000003 2024-04-26T10:44:25.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.060 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.060 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:25.060 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560466+0000", 2024-04-26T10:44:25.060 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9606e-05 2024-04-26T10:44:25.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.060 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.060 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:25.060 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560525+0000", 2024-04-26T10:44:25.060 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9218000000000001e-05 2024-04-26T10:44:25.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.061 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:25.061 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561854+0000", 2024-04-26T10:44:25.061 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001328421 2024-04-26T10:44:25.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.061 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:25.061 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561887+0000", 2024-04-26T10:44:25.061 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2746000000000001e-05 2024-04-26T10:44:25.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.061 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:25.061 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561912+0000", 2024-04-26T10:44:25.061 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5126999999999998e-05 2024-04-26T10:44:25.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.062 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.062 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:25.062 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561936+0000", 2024-04-26T10:44:25.062 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4032999999999998e-05 2024-04-26T10:44:25.062 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:25.062 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:25.062 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:25.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.062 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.062 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:145 3.1a 3:5e41ab69:::200.00000005:head [write 3593723~2939 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:25.062 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:25.062 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.373831494, 2024-04-26T10:44:25.062 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033294394999999997, 2024-04-26T10:44:25.063 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:25.063 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:25.063 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:25.063 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.063 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:25.064 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:25.064 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:25.064 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.064 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.064 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:25.064 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:25.064 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:25.064 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.064 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.064 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:25.064 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529630+0000", 2024-04-26T10:44:25.065 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:25.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.065 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.065 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:25.065 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529635+0000", 2024-04-26T10:44:25.065 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7960000000000003e-06 2024-04-26T10:44:25.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.065 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.065 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:25.065 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529643+0000", 2024-04-26T10:44:25.065 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0390000000000005e-06 2024-04-26T10:44:25.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.065 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.065 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.066 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529648+0000", 2024-04-26T10:44:25.066 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9599999999999999e-06 2024-04-26T10:44:25.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.066 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.066 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:25.066 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560969+0000", 2024-04-26T10:44:25.066 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031321767 2024-04-26T10:44:25.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.066 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.066 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:25.066 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561009+0000", 2024-04-26T10:44:25.066 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9904999999999998e-05 2024-04-26T10:44:25.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.067 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:25.067 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561070+0000", 2024-04-26T10:44:25.067 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0708999999999998e-05 2024-04-26T10:44:25.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.067 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:25.067 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562352+0000", 2024-04-26T10:44:25.067 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012818440000000001 2024-04-26T10:44:25.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.067 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:25.067 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562867+0000", 2024-04-26T10:44:25.067 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000515665 2024-04-26T10:44:25.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.068 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:25.068 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562893+0000", 2024-04-26T10:44:25.068 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5469999999999998e-05 2024-04-26T10:44:25.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.068 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:25.068 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562925+0000", 2024-04-26T10:44:25.068 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1974999999999998e-05 2024-04-26T10:44:25.068 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:25.068 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:25.068 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:25.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.069 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.069 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:146 3.1a 3:5e41ab69:::200.00000005:head [write 3596662~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:25.069 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:25.069 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.3736032800000002, 2024-04-26T10:44:25.069 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033178429000000002, 2024-04-26T10:44:25.069 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:25.069 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:25.069 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:25.069 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.069 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:25.069 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:25.069 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:25.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.070 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:25.070 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:25.070 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:25.070 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.070 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:25.070 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529858+0000", 2024-04-26T10:44:25.070 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:25.070 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.070 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:25.070 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529863+0000", 2024-04-26T10:44:25.071 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4500000000000003e-06 2024-04-26T10:44:25.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.071 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.071 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:25.071 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529874+0000", 2024-04-26T10:44:25.071 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0552e-05 2024-04-26T10:44:25.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.071 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.071 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.071 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529882+0000", 2024-04-26T10:44:25.071 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4449999999999996e-06 2024-04-26T10:44:25.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.071 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.071 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:25.072 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561452+0000", 2024-04-26T10:44:25.072 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031569680000000003 2024-04-26T10:44:25.072 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.072 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:25.072 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561511+0000", 2024-04-26T10:44:25.072 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9332e-05 2024-04-26T10:44:25.072 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.072 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:25.072 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561583+0000", 2024-04-26T10:44:25.072 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1730000000000006e-05 2024-04-26T10:44:25.072 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.073 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.073 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:25.073 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562933+0000", 2024-04-26T10:44:25.073 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013500059999999999 2024-04-26T10:44:25.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.073 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.073 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:25.073 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562976+0000", 2024-04-26T10:44:25.073 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2987e-05 2024-04-26T10:44:25.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.073 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.073 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:25.073 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563015+0000", 2024-04-26T10:44:25.073 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9453999999999999e-05 2024-04-26T10:44:25.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.074 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.074 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:25.074 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563037+0000", 2024-04-26T10:44:25.074 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1679e-05 2024-04-26T10:44:25.074 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:25.074 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:25.074 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:25.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.074 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.074 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:147 3.1a 3:5e41ab69:::200.00000005:head [write 3598061~3384 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:25.074 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.535041+0000", 2024-04-26T10:44:25.074 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.3684212279999999, 2024-04-26T10:44:25.074 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028490299, 2024-04-26T10:44:25.075 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:25.075 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:25.075 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:25.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.075 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:25.075 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.535041+0000", 2024-04-26T10:44:25.075 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:25.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.075 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:25.075 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.535041+0000", 2024-04-26T10:44:25.075 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:25.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.076 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.076 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:25.076 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.535040+0000", 2024-04-26T10:44:25.076 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:25.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.076 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.076 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:25.076 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.535045+0000", 2024-04-26T10:44:25.076 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0030000000000002e-06 2024-04-26T10:44:25.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.076 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.076 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:25.076 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.535053+0000", 2024-04-26T10:44:25.076 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5680000000000002e-06 2024-04-26T10:44:25.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.077 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.077 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.077 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.535057+0000", 2024-04-26T10:44:25.077 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6779999999999999e-06 2024-04-26T10:44:25.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.077 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.077 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:25.077 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561968+0000", 2024-04-26T10:44:25.077 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.026910661999999998 2024-04-26T10:44:25.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.077 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.077 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:25.077 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562006+0000", 2024-04-26T10:44:25.077 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7842000000000001e-05 2024-04-26T10:44:25.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.078 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:25.078 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562069+0000", 2024-04-26T10:44:25.078 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3118000000000001e-05 2024-04-26T10:44:25.078 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.078 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:25.078 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563462+0000", 2024-04-26T10:44:25.078 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001393116 2024-04-26T10:44:25.078 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.078 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:25.078 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563490+0000", 2024-04-26T10:44:25.079 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8271000000000001e-05 2024-04-26T10:44:25.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.079 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:25.079 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563514+0000", 2024-04-26T10:44:25.079 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3964e-05 2024-04-26T10:44:25.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:25.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:25.079 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:25.079 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563531+0000", 2024-04-26T10:44:25.079 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6915e-05 2024-04-26T10:44:25.079 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:25.079 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:25.079 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:25.080 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:25.080 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:25.080 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:25.081 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:25.080+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:25.082 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:25.182 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:25.182+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:25.197 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:25.197 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:25.197 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:44:25.197 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:25.207 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:25.291 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:25.291+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:25.354 INFO:teuthology.orchestra.run.smithi049.stderr:nodeep-scrub is set 2024-04-26T10:44:25.355 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:25.355 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:25.356 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:25.356 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:25.356 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:25.365 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:25.383 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:25.382+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:25.484 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:25.484+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:25.519 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:25.519 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:25.519 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:25.519 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:25.519 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.519 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:44:25.519 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:25.520 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 119.480278207, 2024-04-26T10:44:25.520 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027418490000000002, 2024-04-26T10:44:25.520 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:25.520 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:25.520 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:25.520 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.520 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:25.520 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:25.520 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.520 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.520 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.520 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:25.520 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036533+0000", 2024-04-26T10:44:25.521 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.521 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.521 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.521 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:25.521 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036532+0000", 2024-04-26T10:44:25.521 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:25.521 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.521 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.521 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:25.521 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036549+0000", 2024-04-26T10:44:25.521 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6892999999999999e-05 2024-04-26T10:44:25.521 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.521 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.521 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:25.522 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036557+0000", 2024-04-26T10:44:25.522 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.294e-06 2024-04-26T10:44:25.522 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.522 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.522 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.522 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.036567+0000", 2024-04-26T10:44:25.522 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0611000000000001e-05 2024-04-26T10:44:25.522 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.522 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.522 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:25.522 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037434+0000", 2024-04-26T10:44:25.522 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086689799999999995 2024-04-26T10:44:25.523 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.523 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.523 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:25.523 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.037464+0000", 2024-04-26T10:44:25.523 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0049e-05 2024-04-26T10:44:25.523 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.523 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.523 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:25.523 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039243+0000", 2024-04-26T10:44:25.523 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017791389999999999 2024-04-26T10:44:25.523 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.523 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.523 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:25.524 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039275+0000", 2024-04-26T10:44:25.524 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1276999999999999e-05 2024-04-26T10:44:25.524 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.524 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:25.524 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.524 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.524 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.524 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:25.524 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:25.524 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 119.47789394, 2024-04-26T10:44:25.524 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068600559999999998, 2024-04-26T10:44:25.524 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:25.524 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:25.525 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:25.525 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.525 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:25.525 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:25.525 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.525 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.525 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.525 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:25.525 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038917+0000", 2024-04-26T10:44:25.525 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.525 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.525 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.525 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:25.526 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038915+0000", 2024-04-26T10:44:25.526 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:25.526 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.526 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.526 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:25.526 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038928+0000", 2024-04-26T10:44:25.526 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2412000000000001e-05 2024-04-26T10:44:25.526 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.526 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.526 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:25.526 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038940+0000", 2024-04-26T10:44:25.526 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2785e-05 2024-04-26T10:44:25.526 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.526 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.527 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.529 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038952+0000", 2024-04-26T10:44:25.529 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1473e-05 2024-04-26T10:44:25.529 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.529 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.529 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:25.530 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039037+0000", 2024-04-26T10:44:25.530 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4587999999999997e-05 2024-04-26T10:44:25.530 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.530 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.530 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:25.530 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039210+0000", 2024-04-26T10:44:25.530 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017348999999999999 2024-04-26T10:44:25.530 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.530 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.530 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:25.530 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039324+0000", 2024-04-26T10:44:25.530 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000113745 2024-04-26T10:44:25.531 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.531 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.531 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:25.531 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040835+0000", 2024-04-26T10:44:25.531 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0015110119999999999 2024-04-26T10:44:25.531 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.531 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.531 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:25.531 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045690+0000", 2024-04-26T10:44:25.531 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048557230000000002 2024-04-26T10:44:25.531 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.531 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.531 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:25.532 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045739+0000", 2024-04-26T10:44:25.532 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8164999999999997e-05 2024-04-26T10:44:25.532 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.532 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.532 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:25.532 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.045777+0000", 2024-04-26T10:44:25.532 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:44:25.532 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.532 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:25.532 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.532 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.532 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.532 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:25.532 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:25.533 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 119.47784211600001, 2024-04-26T10:44:25.533 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076526390000000001, 2024-04-26T10:44:25.533 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:25.533 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:25.533 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:25.533 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.533 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:25.533 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:25.533 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.533 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.533 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.533 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:25.533 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038969+0000", 2024-04-26T10:44:25.534 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.534 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.534 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:25.534 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038968+0000", 2024-04-26T10:44:25.534 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:25.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.534 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.534 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:25.534 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.038973+0000", 2024-04-26T10:44:25.534 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:44:25.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.534 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.534 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:25.535 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039008+0000", 2024-04-26T10:44:25.535 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4650999999999997e-05 2024-04-26T10:44:25.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.535 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.535 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.535 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039013+0000", 2024-04-26T10:44:25.535 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8080000000000001e-06 2024-04-26T10:44:25.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.535 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.535 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:25.535 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039699+0000", 2024-04-26T10:44:25.535 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00068526299999999997 2024-04-26T10:44:25.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.535 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.536 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:25.536 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039783+0000", 2024-04-26T10:44:25.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4708000000000003e-05 2024-04-26T10:44:25.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.536 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.536 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:25.536 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039937+0000", 2024-04-26T10:44:25.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000153895 2024-04-26T10:44:25.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.536 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.536 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:25.536 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041255+0000", 2024-04-26T10:44:25.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013182020000000001 2024-04-26T10:44:25.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.537 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.537 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:25.537 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046502+0000", 2024-04-26T10:44:25.537 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052466800000000001 2024-04-26T10:44:25.537 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.537 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.537 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:25.537 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046559+0000", 2024-04-26T10:44:25.537 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6861999999999999e-05 2024-04-26T10:44:25.537 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.537 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.537 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:25.537 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046621+0000", 2024-04-26T10:44:25.537 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2408000000000003e-05 2024-04-26T10:44:25.537 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.538 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:25.538 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.538 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.538 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.538 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:25.538 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:25.538 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 119.47778874399999, 2024-04-26T10:44:25.538 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:44:25.538 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:25.538 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:25.538 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:25.538 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.538 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:25.538 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:25.539 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.539 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.539 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.539 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:25.539 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:25.539 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.539 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.539 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.539 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:25.539 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:25.539 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:25.539 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.539 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.539 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:25.539 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:44:25.540 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:44:25.540 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.540 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.540 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:25.540 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:44:25.540 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:44:25.540 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.540 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.540 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.540 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:44:25.540 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:44:25.540 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.540 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.540 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:25.541 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:44:25.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:44:25.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.541 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:25.541 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:44:25.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:44:25.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.541 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:25.541 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:44:25.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:44:25.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.541 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:25.542 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:44:25.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:44:25.542 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.542 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:25.542 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:44:25.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:44:25.542 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.542 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:25.542 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:44:25.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:44:25.542 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.543 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:25.543 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:44:25.543 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:44:25.543 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.543 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:25.543 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.543 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.543 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.543 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:25.543 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:25.543 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 119.477744417, 2024-04-26T10:44:25.543 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:44:25.543 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:25.543 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:25.544 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:25.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:25.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:25.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:25.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:25.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:25.545 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:25.545 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:25.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.545 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.545 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:25.545 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:44:25.545 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:44:25.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.545 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.545 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:25.545 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:44:25.545 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:44:25.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.545 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.545 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.546 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:44:25.546 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:44:25.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.546 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:25.546 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:44:25.546 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:44:25.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.546 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:25.546 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:44:25.546 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:44:25.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:25.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:44:25.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:44:25.547 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:25.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:44:25.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:44:25.547 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:25.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:44:25.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:44:25.547 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.548 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.548 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:25.548 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:44:25.548 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:44:25.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.548 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.548 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:25.548 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:44:25.548 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:44:25.548 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.548 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:25.548 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.548 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.548 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:25.549 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:25.549 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 119.47772070400001, 2024-04-26T10:44:25.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076669069999999997, 2024-04-26T10:44:25.549 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:25.549 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:25.549 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:25.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.549 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:25.549 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:25.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.549 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:25.550 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:25.550 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.550 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:25.550 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039090+0000", 2024-04-26T10:44:25.550 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:25.550 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:25.550 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039101+0000", 2024-04-26T10:44:25.550 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1449e-05 2024-04-26T10:44:25.550 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.551 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:25.551 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039110+0000", 2024-04-26T10:44:25.551 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:44:25.551 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.551 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.551 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.551 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039117+0000", 2024-04-26T10:44:25.551 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:44:25.551 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.551 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.551 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:25.551 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040196+0000", 2024-04-26T10:44:25.551 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0010792880000000001 2024-04-26T10:44:25.551 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.551 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.552 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:25.552 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040317+0000", 2024-04-26T10:44:25.552 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120485 2024-04-26T10:44:25.552 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.552 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.552 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:25.552 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040441+0000", 2024-04-26T10:44:25.552 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012437 2024-04-26T10:44:25.552 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.552 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.552 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:25.552 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041276+0000", 2024-04-26T10:44:25.552 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083439400000000002 2024-04-26T10:44:25.553 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.553 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.553 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:25.553 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046668+0000", 2024-04-26T10:44:25.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053919900000000002 2024-04-26T10:44:25.553 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.553 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.553 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:25.553 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046724+0000", 2024-04-26T10:44:25.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6632000000000003e-05 2024-04-26T10:44:25.553 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.553 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.553 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:25.553 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046757+0000", 2024-04-26T10:44:25.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2777000000000001e-05 2024-04-26T10:44:25.554 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.554 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:25.554 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.554 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.554 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.554 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:25.554 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:25.554 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 119.47768639900001, 2024-04-26T10:44:25.554 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0073353330000000003, 2024-04-26T10:44:25.554 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:25.554 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:25.554 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:25.554 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.554 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:25.555 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:25.555 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.555 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:25.555 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039125+0000", 2024-04-26T10:44:25.555 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.555 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:25.555 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039124+0000", 2024-04-26T10:44:25.555 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:25.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.555 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:25.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039127+0000", 2024-04-26T10:44:25.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:44:25.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.556 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:25.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039135+0000", 2024-04-26T10:44:25.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:44:25.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.556 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039142+0000", 2024-04-26T10:44:25.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:44:25.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.556 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:25.557 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039191+0000", 2024-04-26T10:44:25.557 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9777999999999997e-05 2024-04-26T10:44:25.557 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.557 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.557 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:25.557 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039308+0000", 2024-04-26T10:44:25.557 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000116536 2024-04-26T10:44:25.557 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.557 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.557 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-26T10:44:25.557 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039413+0000", 2024-04-26T10:44:25.557 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000105538 2024-04-26T10:44:25.558 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.558 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:25.558 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040301+0000", 2024-04-26T10:44:25.558 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088794799999999995 2024-04-26T10:44:25.558 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.558 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:25.558 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046374+0000", 2024-04-26T10:44:25.558 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060731049999999996 2024-04-26T10:44:25.558 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.558 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:25.558 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046417+0000", 2024-04-26T10:44:25.559 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2935999999999997e-05 2024-04-26T10:44:25.559 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.559 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.559 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:25.559 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046460+0000", 2024-04-26T10:44:25.559 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2468000000000001e-05 2024-04-26T10:44:25.559 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.559 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:25.559 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.559 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.559 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.559 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:25.559 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:25.559 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 119.477349803, 2024-04-26T10:44:25.559 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071203689999999997, 2024-04-26T10:44:25.560 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:25.560 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:25.560 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:25.560 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.560 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:25.560 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:25.560 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.560 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.560 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.560 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:25.560 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039461+0000", 2024-04-26T10:44:25.560 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.560 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.560 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.560 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:25.561 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039460+0000", 2024-04-26T10:44:25.561 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:25.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.561 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.561 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:25.561 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039466+0000", 2024-04-26T10:44:25.561 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5849999999999999e-06 2024-04-26T10:44:25.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.561 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.561 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:25.561 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039477+0000", 2024-04-26T10:44:25.561 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:44:25.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.561 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.562 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.562 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039485+0000", 2024-04-26T10:44:25.562 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:44:25.562 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.562 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.562 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:25.562 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039731+0000", 2024-04-26T10:44:25.562 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00024582299999999999 2024-04-26T10:44:25.562 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.562 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.562 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:25.562 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039818+0000", 2024-04-26T10:44:25.562 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7553999999999996e-05 2024-04-26T10:44:25.562 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.563 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.563 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:25.563 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046581+0000", 2024-04-26T10:44:25.563 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00676298 2024-04-26T10:44:25.563 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.563 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:25.563 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.563 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.563 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.563 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:25.563 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:25.563 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 119.477307775, 2024-04-26T10:44:25.564 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007472528, 2024-04-26T10:44:25.564 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:25.564 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:25.564 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:25.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.564 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:25.564 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:25.564 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.564 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.564 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:25.564 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:25.564 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.564 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.565 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:25.565 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039503+0000", 2024-04-26T10:44:25.565 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:25.565 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.565 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.565 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:25.565 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039507+0000", 2024-04-26T10:44:25.565 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0899999999999998e-06 2024-04-26T10:44:25.565 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.565 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.565 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:25.565 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039514+0000", 2024-04-26T10:44:25.565 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4569999999999999e-06 2024-04-26T10:44:25.565 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.565 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.566 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.566 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039533+0000", 2024-04-26T10:44:25.566 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9392e-05 2024-04-26T10:44:25.566 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.566 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.566 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:25.566 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040887+0000", 2024-04-26T10:44:25.566 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001353981 2024-04-26T10:44:25.566 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.566 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.566 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:25.566 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041010+0000", 2024-04-26T10:44:25.566 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00012222099999999999 2024-04-26T10:44:25.566 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.567 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.567 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:25.567 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.046976+0000", 2024-04-26T10:44:25.567 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059659650000000002 2024-04-26T10:44:25.567 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.567 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:25.567 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.567 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.567 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.567 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:25.567 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:25.567 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 119.47725460300001, 2024-04-26T10:44:25.567 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:44:25.567 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:25.568 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:25.568 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:25.568 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.568 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:25.568 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:25.568 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.568 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.568 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.568 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:25.568 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:25.568 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.568 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.568 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.568 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:25.568 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:25.569 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:25.569 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.569 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.569 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:25.569 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:44:25.569 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:44:25.569 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.569 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.569 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:25.569 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:44:25.569 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:44:25.569 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.569 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.569 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.569 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:44:25.570 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:44:25.570 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.570 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.570 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:25.570 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:44:25.570 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:44:25.570 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.570 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.570 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:25.570 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:44:25.570 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:44:25.570 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.570 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.571 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:25.571 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:44:25.571 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:44:25.571 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.571 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:25.571 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.571 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.571 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.571 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(client.4532.0:5 4.10 e52/37 4:09a4c37f:::10000000003.00000001:head v 52'1, mlcod=0'0)", 2024-04-26T10:44:25.571 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:25.571 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 12.041187233, 2024-04-26T10:44:25.571 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010754041000000001, 2024-04-26T10:44:25.571 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:25.571 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:25.572 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:25.572 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.572 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:25.572 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:25.572 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.572 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.572 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.572 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:25.572 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:25.572 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.572 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.572 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.572 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:25.572 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:25.573 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:44:25.573 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.573 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.573 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:25.573 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479849+0000", 2024-04-26T10:44:25.573 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004225716 2024-04-26T10:44:25.573 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.573 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.573 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:25.573 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479868+0000", 2024-04-26T10:44:25.573 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.8666000000000001e-05 2024-04-26T10:44:25.573 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.573 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.573 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.574 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479878+0000", 2024-04-26T10:44:25.574 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.6150000000000003e-06 2024-04-26T10:44:25.574 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.574 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.574 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:25.574 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479935+0000", 2024-04-26T10:44:25.574 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7766999999999998e-05 2024-04-26T10:44:25.574 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.574 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.574 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:25.574 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479960+0000", 2024-04-26T10:44:25.574 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4343000000000001e-05 2024-04-26T10:44:25.574 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.574 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.575 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:25.575 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.486332+0000", 2024-04-26T10:44:25.575 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0063727610000000002 2024-04-26T10:44:25.575 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.575 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.575 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:25.575 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.486378+0000", 2024-04-26T10:44:25.575 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.5334000000000003e-05 2024-04-26T10:44:25.575 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.575 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:25.575 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.575 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.575 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.575 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:65 3.6 e53/37 3:654134d2:::mds0_openfiles.0:head v 53'6, mlcod=48'4)", 2024-04-26T10:44:25.575 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:16.517520+0000", 2024-04-26T10:44:25.576 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.9992904859999996, 2024-04-26T10:44:25.576 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052681739999999996, 2024-04-26T10:44:25.576 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:25.576 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:25.576 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:25.576 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.576 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:25.576 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517520+0000", 2024-04-26T10:44:25.576 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.576 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.576 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.576 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:25.576 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517520+0000", 2024-04-26T10:44:25.576 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.576 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.577 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.577 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:25.577 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517520+0000", 2024-04-26T10:44:25.577 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:25.577 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.577 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.577 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:25.577 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517652+0000", 2024-04-26T10:44:25.577 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000132662 2024-04-26T10:44:25.577 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.577 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.577 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:25.577 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517662+0000", 2024-04-26T10:44:25.577 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7019999999999996e-06 2024-04-26T10:44:25.578 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.578 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.578 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.578 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517668+0000", 2024-04-26T10:44:25.578 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0530000000000003e-06 2024-04-26T10:44:25.578 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.578 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.578 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:25.578 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517730+0000", 2024-04-26T10:44:25.578 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2158999999999999e-05 2024-04-26T10:44:25.578 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.578 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.578 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:25.579 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.517745+0000", 2024-04-26T10:44:25.579 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4273999999999999e-05 2024-04-26T10:44:25.579 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.579 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.579 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:25.579 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.522754+0000", 2024-04-26T10:44:25.579 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0050096450000000001 2024-04-26T10:44:25.579 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.579 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.579 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:25.579 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.522789+0000", 2024-04-26T10:44:25.579 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4406000000000002e-05 2024-04-26T10:44:25.579 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.579 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:25.579 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.580 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.580 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.580 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:3051 4.11 4:8afd8039:::10000000f44.00000000:head [write 0~672130] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:44:25.580 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:16.898960+0000", 2024-04-26T10:44:25.580 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.6178504109999992, 2024-04-26T10:44:25.580 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027624870000000001, 2024-04-26T10:44:25.580 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:25.580 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:25.580 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:25.580 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:25.580 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:25.580 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 3051 2024-04-26T10:44:25.580 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.580 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:25.580 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.581 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:25.581 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.898960+0000", 2024-04-26T10:44:25.581 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.581 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.581 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.581 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:25.581 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.898960+0000", 2024-04-26T10:44:25.581 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.581 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.581 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.581 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:25.581 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.898960+0000", 2024-04-26T10:44:25.581 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:25.581 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.581 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.582 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:25.582 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.899863+0000", 2024-04-26T10:44:25.582 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00090309799999999997 2024-04-26T10:44:25.582 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.582 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.582 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:25.582 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.899874+0000", 2024-04-26T10:44:25.582 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1269e-05 2024-04-26T10:44:25.582 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.582 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.582 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.582 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.899879+0000", 2024-04-26T10:44:25.582 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.1549999999999998e-06 2024-04-26T10:44:25.583 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.583 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.583 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:25.583 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.899925+0000", 2024-04-26T10:44:25.583 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6079999999999999e-05 2024-04-26T10:44:25.583 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.583 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.583 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:25.583 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.900041+0000", 2024-04-26T10:44:25.583 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000115308 2024-04-26T10:44:25.583 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.583 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.583 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:25.583 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.901610+0000", 2024-04-26T10:44:25.584 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001569467 2024-04-26T10:44:25.584 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.584 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.584 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:25.584 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.901652+0000", 2024-04-26T10:44:25.584 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1665000000000002e-05 2024-04-26T10:44:25.584 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.584 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.584 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:25.584 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:16.901723+0000", 2024-04-26T10:44:25.584 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1185000000000004e-05 2024-04-26T10:44:25.584 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.584 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:25.584 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.584 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.585 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.585 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:76 3.1f e54/37 3:f83d65d8:::200.00000004:head v 54'5, mlcod=0'0)", 2024-04-26T10:44:25.585 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:20.488063+0000", 2024-04-26T10:44:25.585 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 5.0287475319999997, 2024-04-26T10:44:25.585 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.008466477, 2024-04-26T10:44:25.585 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:25.585 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:25.585 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:25.585 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.585 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:25.585 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.488063+0000", 2024-04-26T10:44:25.585 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.585 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.585 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.586 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:25.586 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.488063+0000", 2024-04-26T10:44:25.586 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.586 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.586 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.586 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:25.586 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.488063+0000", 2024-04-26T10:44:25.586 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:25.586 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.586 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.586 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:25.586 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.491671+0000", 2024-04-26T10:44:25.586 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0036083310000000002 2024-04-26T10:44:25.586 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.587 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.587 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:25.587 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.491684+0000", 2024-04-26T10:44:25.587 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.3053e-05 2024-04-26T10:44:25.587 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.587 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.587 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.587 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.491708+0000", 2024-04-26T10:44:25.587 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3635999999999999e-05 2024-04-26T10:44:25.587 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.587 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.587 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:25.587 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.491742+0000", 2024-04-26T10:44:25.587 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3794999999999997e-05 2024-04-26T10:44:25.587 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.588 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.588 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:25.588 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.491755+0000", 2024-04-26T10:44:25.588 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.3643e-05 2024-04-26T10:44:25.588 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.588 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.588 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:25.588 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.496487+0000", 2024-04-26T10:44:25.588 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004731758 2024-04-26T10:44:25.588 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.588 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.588 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:25.588 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:20.496530+0000", 2024-04-26T10:44:25.588 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2865999999999999e-05 2024-04-26T10:44:25.588 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.589 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:25.589 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.589 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.589 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.589 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:79 3.1a e54/12 3:5e41ab69:::200.00000005:head v 54'2, mlcod=0'0)", 2024-04-26T10:44:25.589 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:21.509811+0000", 2024-04-26T10:44:25.589 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 4.0069999569999997, 2024-04-26T10:44:25.589 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0074314530000000002, 2024-04-26T10:44:25.589 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:25.589 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:25.589 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:25.589 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.589 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:25.589 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.509811+0000", 2024-04-26T10:44:25.589 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.590 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.590 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.590 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:25.590 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.509811+0000", 2024-04-26T10:44:25.590 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.590 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.590 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.590 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:25.590 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.509810+0000", 2024-04-26T10:44:25.590 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:25.590 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.590 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.590 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:25.590 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.513080+0000", 2024-04-26T10:44:25.591 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0032696639999999998 2024-04-26T10:44:25.591 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.591 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.591 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:25.591 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.513092+0000", 2024-04-26T10:44:25.591 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2378000000000001e-05 2024-04-26T10:44:25.591 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.591 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.591 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.591 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.513097+0000", 2024-04-26T10:44:25.591 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9450000000000001e-06 2024-04-26T10:44:25.591 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.591 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.591 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:25.592 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.513170+0000", 2024-04-26T10:44:25.592 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.2577999999999995e-05 2024-04-26T10:44:25.592 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.592 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.592 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:25.592 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.513182+0000", 2024-04-26T10:44:25.592 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1769e-05 2024-04-26T10:44:25.592 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.592 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.592 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:25.592 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.517200+0000", 2024-04-26T10:44:25.592 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0040181150000000001 2024-04-26T10:44:25.592 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.592 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.592 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:25.593 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.517242+0000", 2024-04-26T10:44:25.593 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2580999999999998e-05 2024-04-26T10:44:25.593 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.593 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:25.593 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.593 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.593 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.593 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:80 3.6 e54/37 3:654134d2:::mds0_openfiles.0:head v 54'7, mlcod=49'5)", 2024-04-26T10:44:25.593 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:21.536534+0000", 2024-04-26T10:44:25.593 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 3.980276489, 2024-04-26T10:44:25.593 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.014436087, 2024-04-26T10:44:25.593 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:25.593 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:25.594 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:25.594 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.594 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:25.594 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.536534+0000", 2024-04-26T10:44:25.594 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.594 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.594 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.594 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:25.594 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.536534+0000", 2024-04-26T10:44:25.594 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.594 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.594 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.594 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:25.595 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.536534+0000", 2024-04-26T10:44:25.595 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:25.595 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.595 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.595 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:25.595 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.536999+0000", 2024-04-26T10:44:25.595 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00046557800000000002 2024-04-26T10:44:25.595 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.595 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.595 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:25.595 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.537008+0000", 2024-04-26T10:44:25.595 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.0990000000000005e-06 2024-04-26T10:44:25.595 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.595 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.596 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.596 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.537013+0000", 2024-04-26T10:44:25.596 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4569999999999998e-06 2024-04-26T10:44:25.596 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.596 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.596 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:25.596 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.537050+0000", 2024-04-26T10:44:25.596 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7191999999999999e-05 2024-04-26T10:44:25.596 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.596 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.596 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:25.596 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.537064+0000", 2024-04-26T10:44:25.596 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.3930999999999999e-05 2024-04-26T10:44:25.596 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.597 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.597 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:25.597 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.550933+0000", 2024-04-26T10:44:25.597 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013868660999999999 2024-04-26T10:44:25.597 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.597 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.597 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:25.597 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.550971+0000", 2024-04-26T10:44:25.597 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7824000000000002e-05 2024-04-26T10:44:25.597 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.597 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:25.597 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.597 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.597 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.597 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:117 3.1a e54/12 3:5e41ab69:::200.00000005:head v 54'39, mlcod=54'34)", 2024-04-26T10:44:25.598 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:21.547445+0000", 2024-04-26T10:44:25.598 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 3.9693661310000001, 2024-04-26T10:44:25.598 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0038616309999999999, 2024-04-26T10:44:25.598 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:25.598 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:25.598 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:25.598 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.598 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:25.598 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.547445+0000", 2024-04-26T10:44:25.598 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.598 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.598 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.598 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:25.598 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.547445+0000", 2024-04-26T10:44:25.598 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.599 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.599 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.599 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:25.599 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.547444+0000", 2024-04-26T10:44:25.599 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:25.599 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.599 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.599 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:25.599 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.547451+0000", 2024-04-26T10:44:25.599 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.9450000000000004e-06 2024-04-26T10:44:25.599 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.599 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.599 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:25.599 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.547459+0000", 2024-04-26T10:44:25.600 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8650000000000001e-06 2024-04-26T10:44:25.600 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.600 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.600 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.600 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.547465+0000", 2024-04-26T10:44:25.600 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5770000000000001e-06 2024-04-26T10:44:25.600 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.600 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.600 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:25.600 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.547496+0000", 2024-04-26T10:44:25.600 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1479000000000001e-05 2024-04-26T10:44:25.600 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.600 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.600 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:25.601 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.547514+0000", 2024-04-26T10:44:25.601 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.7918999999999999e-05 2024-04-26T10:44:25.601 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.601 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.601 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:25.601 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.551285+0000", 2024-04-26T10:44:25.601 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0037713379999999999 2024-04-26T10:44:25.601 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.601 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.601 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:25.601 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.551306+0000", 2024-04-26T10:44:25.601 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0965999999999999e-05 2024-04-26T10:44:25.601 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.601 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:25.601 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.602 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.602 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.602 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:118 3.1a e54/12 3:5e41ab69:::200.00000005:head v 54'40, mlcod=54'36)", 2024-04-26T10:44:25.602 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:21.548135+0000", 2024-04-26T10:44:25.602 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 3.9686761339999999, 2024-04-26T10:44:25.602 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0031880419999999999, 2024-04-26T10:44:25.602 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:25.602 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:25.602 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:25.602 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.602 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:25.602 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548135+0000", 2024-04-26T10:44:25.602 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.602 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.603 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.603 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:25.603 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548135+0000", 2024-04-26T10:44:25.603 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.603 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.603 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.603 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:25.603 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548134+0000", 2024-04-26T10:44:25.603 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:25.603 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.603 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.603 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:25.603 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548139+0000", 2024-04-26T10:44:25.603 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.1000000000000003e-06 2024-04-26T10:44:25.604 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.604 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.604 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:25.604 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548150+0000", 2024-04-26T10:44:25.604 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0318e-05 2024-04-26T10:44:25.604 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.604 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.604 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.604 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548156+0000", 2024-04-26T10:44:25.604 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9479999999999996e-06 2024-04-26T10:44:25.604 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.604 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.604 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:25.604 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548184+0000", 2024-04-26T10:44:25.605 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8119e-05 2024-04-26T10:44:25.605 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.605 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.605 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:25.605 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.548194+0000", 2024-04-26T10:44:25.605 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0115000000000001e-05 2024-04-26T10:44:25.605 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.605 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.605 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:25.605 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.551308+0000", 2024-04-26T10:44:25.605 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.003114361 2024-04-26T10:44:25.605 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.605 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.605 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:25.606 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.551323+0000", 2024-04-26T10:44:25.606 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4688999999999999e-05 2024-04-26T10:44:25.606 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.606 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:25.606 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.606 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.606 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.606 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:9757 4.3a 4:5e14edba:::10000002cd2.00000000:head [write 0~2872501] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T10:44:25.606 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:24.694378+0000", 2024-04-26T10:44:25.606 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.82243267099999995, 2024-04-26T10:44:25.606 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0071954319999999999, 2024-04-26T10:44:25.606 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:25.606 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:25.606 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:25.607 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:25.607 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:25.607 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 9757 2024-04-26T10:44:25.607 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.607 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:25.607 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.607 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:25.607 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:24.694378+0000", 2024-04-26T10:44:25.607 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.607 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.607 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.607 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:25.607 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:24.694378+0000", 2024-04-26T10:44:25.607 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.608 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.608 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.608 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:25.608 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:24.694376+0000", 2024-04-26T10:44:25.608 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:25.608 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.608 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.608 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:25.608 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:24.697398+0000", 2024-04-26T10:44:25.608 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.003022074 2024-04-26T10:44:25.608 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.608 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.608 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:25.608 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:24.697411+0000", 2024-04-26T10:44:25.609 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.3271999999999999e-05 2024-04-26T10:44:25.609 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.609 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.609 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.609 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:24.697417+0000", 2024-04-26T10:44:25.609 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9170000000000003e-06 2024-04-26T10:44:25.609 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.609 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.609 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:25.609 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:24.697475+0000", 2024-04-26T10:44:25.609 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7210999999999998e-05 2024-04-26T10:44:25.609 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.609 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.610 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:25.610 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:24.697561+0000", 2024-04-26T10:44:25.610 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.6959999999999994e-05 2024-04-26T10:44:25.610 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.610 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.610 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:25.610 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:24.701489+0000", 2024-04-26T10:44:25.610 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0039274069999999999 2024-04-26T10:44:25.610 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.610 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.610 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:25.610 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:24.701517+0000", 2024-04-26T10:44:25.610 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.783e-05 2024-04-26T10:44:25.610 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.611 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.611 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:25.611 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:24.701574+0000", 2024-04-26T10:44:25.611 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6949e-05 2024-04-26T10:44:25.611 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.611 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:25.611 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.611 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.611 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.611 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(client.4532.0:10559 4.21 e56/37 4:8595f8c6:::10000003053.00000000:head v 56'180, mlcod=56'178)", 2024-04-26T10:44:25.611 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:25.506057+0000", 2024-04-26T10:44:25.611 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.010753672000000001, 2024-04-26T10:44:25.611 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0039466420000000002, 2024-04-26T10:44:25.611 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:25.612 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:25.612 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:25.612 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.612 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:25.612 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.506057+0000", 2024-04-26T10:44:25.612 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.612 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.612 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.612 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:25.612 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.506057+0000", 2024-04-26T10:44:25.612 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:25.612 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.612 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.612 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:25.613 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.506057+0000", 2024-04-26T10:44:25.613 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:25.613 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.613 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.613 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:25.613 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.507372+0000", 2024-04-26T10:44:25.613 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0013158810000000001 2024-04-26T10:44:25.613 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.613 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.613 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:25.613 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.507386+0000", 2024-04-26T10:44:25.613 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.331e-05 2024-04-26T10:44:25.613 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.613 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.614 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:25.614 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.507392+0000", 2024-04-26T10:44:25.614 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2979999999999997e-06 2024-04-26T10:44:25.614 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.614 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.614 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:25.614 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.507439+0000", 2024-04-26T10:44:25.614 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7108999999999999e-05 2024-04-26T10:44:25.614 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.614 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.614 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:25.614 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.507461+0000", 2024-04-26T10:44:25.614 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.2045999999999999e-05 2024-04-26T10:44:25.614 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.614 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.615 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:25.615 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.509983+0000", 2024-04-26T10:44:25.615 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0025215929999999999 2024-04-26T10:44:25.615 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:25.615 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:25.615 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:25.615 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.510004+0000", 2024-04-26T10:44:25.615 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1077000000000002e-05 2024-04-26T10:44:25.615 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.615 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:25.615 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.615 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:25.615 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:25.615 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:25.617 INFO:tasks.workunit.client.0.smithi049.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-26T10:44:25.617 INFO:tasks.workunit.client.0.smithi049.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T10:44:25.618 INFO:tasks.workunit.client.0.smithi049.stderr:+ make 2024-04-26T10:44:25.618 INFO:tasks.workunit.client.0.smithi049.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-26T10:44:25.618 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:25.616+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:25.619 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:25.717 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:25.715+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:25.725 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:25.725 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:25.725 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:44:25.726 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:25.734 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:25.818 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:25.818+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:25.880 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:25.880 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:25.880 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:25.880 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:25.880 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:25.889 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:25.892 INFO:tasks.workunit.client.0.smithi049.stderr:++ readlink -f fsstress 2024-04-26T10:44:25.893 INFO:tasks.workunit.client.0.smithi049.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-26T10:44:25.893 INFO:tasks.workunit.client.0.smithi049.stderr:+ popd 2024-04-26T10:44:25.894 INFO:tasks.workunit.client.0.smithi049.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T10:44:25.894 INFO:tasks.workunit.client.0.smithi049.stderr:+ popd 2024-04-26T10:44:25.894 INFO:tasks.workunit.client.0.smithi049.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-26T10:44:25.895 INFO:tasks.workunit.client.0.smithi049.stderr:++ mktemp -d -p . 2024-04-26T10:44:25.896 INFO:tasks.workunit.client.0.smithi049.stderr:+ T=./tmp.0weVHK2n7l 2024-04-26T10:44:25.896 INFO:tasks.workunit.client.0.smithi049.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.0weVHK2n7l -l 1 -n 1000 -p 10 -v 2024-04-26T10:44:25.897 INFO:tasks.workunit.client.0.smithi049.stdout:seed = 1713780529 2024-04-26T10:44:25.898 INFO:tasks.workunit.client.0.smithi049.stdout:0/0: write - no filename 2024-04-26T10:44:25.898 INFO:tasks.workunit.client.0.smithi049.stdout:0/1: rename - no filename 2024-04-26T10:44:25.898 INFO:tasks.workunit.client.0.smithi049.stdout:0/2: dwrite - no filename 2024-04-26T10:44:25.899 INFO:tasks.workunit.client.0.smithi049.stdout:1/0: chown . 8896 1 2024-04-26T10:44:25.900 INFO:tasks.workunit.client.0.smithi049.stdout:0/3: symlink l0 0 2024-04-26T10:44:25.900 INFO:tasks.workunit.client.0.smithi049.stdout:0/4: fdatasync - no filename 2024-04-26T10:44:25.900 INFO:tasks.workunit.client.0.smithi049.stdout:2/0: rmdir - no directory 2024-04-26T10:44:25.900 INFO:tasks.workunit.client.0.smithi049.stdout:2/1: dwrite - no filename 2024-04-26T10:44:25.900 INFO:tasks.workunit.client.0.smithi049.stdout:2/2: dread - no filename 2024-04-26T10:44:25.900 INFO:tasks.workunit.client.0.smithi049.stdout:2/3: dread - no filename 2024-04-26T10:44:25.900 INFO:tasks.workunit.client.0.smithi049.stdout:2/4: truncate - no filename 2024-04-26T10:44:25.900 INFO:tasks.workunit.client.0.smithi049.stdout:2/5: stat - no entries 2024-04-26T10:44:25.900 INFO:tasks.workunit.client.0.smithi049.stdout:2/6: chown . 55620834 1 2024-04-26T10:44:25.900 INFO:tasks.workunit.client.0.smithi049.stdout:2/7: dwrite - no filename 2024-04-26T10:44:25.901 INFO:tasks.workunit.client.0.smithi049.stdout:2/8: dwrite - no filename 2024-04-26T10:44:25.901 INFO:tasks.workunit.client.0.smithi049.stdout:2/9: rename - no filename 2024-04-26T10:44:25.901 INFO:tasks.workunit.client.0.smithi049.stdout:2/10: stat - no entries 2024-04-26T10:44:25.901 INFO:tasks.workunit.client.0.smithi049.stdout:2/11: dread - no filename 2024-04-26T10:44:25.901 INFO:tasks.workunit.client.0.smithi049.stdout:0/5: creat f1 x:0 0 0 2024-04-26T10:44:25.901 INFO:tasks.workunit.client.0.smithi049.stdout:1/1: creat f0 x:0 0 0 2024-04-26T10:44:25.902 INFO:tasks.workunit.client.0.smithi049.stdout:1/2: chown f0 3528374 1 2024-04-26T10:44:25.902 INFO:tasks.workunit.client.0.smithi049.stdout:2/12: creat f0 x:0 0 0 2024-04-26T10:44:25.903 INFO:tasks.workunit.client.0.smithi049.stdout:0/6: write f1 [320090,124876] 0 2024-04-26T10:44:25.903 INFO:tasks.workunit.client.0.smithi049.stdout:3/0: creat f0 x:0 0 0 2024-04-26T10:44:25.903 INFO:tasks.workunit.client.0.smithi049.stdout:4/0: rmdir - no directory 2024-04-26T10:44:25.903 INFO:tasks.workunit.client.0.smithi049.stdout:4/1: write - no filename 2024-04-26T10:44:25.903 INFO:tasks.workunit.client.0.smithi049.stdout:2/13: chown f0 26 1 2024-04-26T10:44:25.903 INFO:tasks.workunit.client.0.smithi049.stdout:3/1: dread - f0 zero size 2024-04-26T10:44:25.903 INFO:tasks.workunit.client.0.smithi049.stdout:5/0: rename - no filename 2024-04-26T10:44:25.903 INFO:tasks.workunit.client.0.smithi049.stdout:5/1: fsync - no filename 2024-04-26T10:44:25.903 INFO:tasks.workunit.client.0.smithi049.stdout:5/2: write - no filename 2024-04-26T10:44:25.903 INFO:tasks.workunit.client.0.smithi049.stdout:5/3: dread - no filename 2024-04-26T10:44:25.903 INFO:tasks.workunit.client.0.smithi049.stdout:5/4: dread - no filename 2024-04-26T10:44:25.903 INFO:tasks.workunit.client.0.smithi049.stdout:5/5: dwrite - no filename 2024-04-26T10:44:25.903 INFO:tasks.workunit.client.0.smithi049.stdout:1/3: mknod c1 0 2024-04-26T10:44:25.903 INFO:tasks.workunit.client.0.smithi049.stdout:2/14: symlink l1 0 2024-04-26T10:44:25.903 INFO:tasks.workunit.client.0.smithi049.stdout:4/2: creat f0 x:0 0 0 2024-04-26T10:44:25.905 INFO:tasks.workunit.client.0.smithi049.stdout:5/6: mknod c0 0 2024-04-26T10:44:25.905 INFO:tasks.workunit.client.0.smithi049.stdout:5/7: dwrite - no filename 2024-04-26T10:44:25.905 INFO:tasks.workunit.client.0.smithi049.stdout:1/4: truncate f0 101445 0 2024-04-26T10:44:25.905 INFO:tasks.workunit.client.0.smithi049.stdout:6/0: dread - no filename 2024-04-26T10:44:25.905 INFO:tasks.workunit.client.0.smithi049.stdout:3/2: write f0 [1008138,42044] 0 2024-04-26T10:44:25.905 INFO:tasks.workunit.client.0.smithi049.stdout:2/15: chown l1 8 1 2024-04-26T10:44:25.905 INFO:tasks.workunit.client.0.smithi049.stdout:5/8: symlink l1 0 2024-04-26T10:44:25.906 INFO:tasks.workunit.client.0.smithi049.stdout:4/3: write f0 [516394,124281] 0 2024-04-26T10:44:25.906 INFO:tasks.workunit.client.0.smithi049.stdout:6/1: creat f0 x:0 0 0 2024-04-26T10:44:25.906 INFO:tasks.workunit.client.0.smithi049.stdout:1/5: write f0 [741628,7032] 0 2024-04-26T10:44:25.906 INFO:tasks.workunit.client.0.smithi049.stdout:2/16: truncate f0 870193 0 2024-04-26T10:44:25.906 INFO:tasks.workunit.client.0.smithi049.stdout:7/0: creat f0 x:0 0 0 2024-04-26T10:44:25.907 INFO:tasks.workunit.client.0.smithi049.stdout:2/17: readlink l1 0 2024-04-26T10:44:25.908 INFO:tasks.workunit.client.0.smithi049.stdout:2/18: rmdir - no directory 2024-04-26T10:44:25.908 INFO:tasks.workunit.client.0.smithi049.stdout:2/19: rmdir - no directory 2024-04-26T10:44:25.908 INFO:tasks.workunit.client.0.smithi049.stdout:4/4: creat f1 x:0 0 0 2024-04-26T10:44:25.908 INFO:tasks.workunit.client.0.smithi049.stdout:6/2: chown f0 230077 1 2024-04-26T10:44:25.908 INFO:tasks.workunit.client.0.smithi049.stdout:4/5: fdatasync f0 0 2024-04-26T10:44:25.908 INFO:tasks.workunit.client.0.smithi049.stdout:2/20: chown l1 26 1 2024-04-26T10:44:25.909 INFO:tasks.workunit.client.0.smithi049.stdout:6/3: read - f0 zero size 2024-04-26T10:44:25.909 INFO:tasks.workunit.client.0.smithi049.stdout:7/1: write f0 [1027497,73276] 0 2024-04-26T10:44:25.910 INFO:tasks.workunit.client.0.smithi049.stdout:8/0: creat f0 x:0 0 0 2024-04-26T10:44:25.911 INFO:tasks.workunit.client.0.smithi049.stdout:4/6: write f0 [1660659,107651] 0 2024-04-26T10:44:25.911 INFO:tasks.workunit.client.0.smithi049.stdout:2/21: creat f2 x:0 0 0 2024-04-26T10:44:25.911 INFO:tasks.workunit.client.0.smithi049.stdout:8/1: rename f0 to f1 0 2024-04-26T10:44:25.911 INFO:tasks.workunit.client.0.smithi049.stdout:7/2: symlink l1 0 2024-04-26T10:44:25.914 INFO:tasks.workunit.client.0.smithi049.stdout:9/0: creat f0 x:0 0 0 2024-04-26T10:44:25.914 INFO:tasks.workunit.client.0.smithi049.stdout:2/22: read - f2 zero size 2024-04-26T10:44:25.914 INFO:tasks.workunit.client.0.smithi049.stdout:4/7: fdatasync f1 0 2024-04-26T10:44:25.914 INFO:tasks.workunit.client.0.smithi049.stdout:0/7: dwrite f1 [0,4194304] 0 2024-04-26T10:44:25.915 INFO:tasks.workunit.client.0.smithi049.stdout:9/1: dread - f0 zero size 2024-04-26T10:44:25.916 INFO:tasks.workunit.client.0.smithi049.stdout:3/3: dwrite f0 [0,4194304] 0 2024-04-26T10:44:25.917 INFO:tasks.workunit.client.0.smithi049.stdout:0/8: write f1 [2546065,35701] 0 2024-04-26T10:44:25.918 INFO:tasks.workunit.client.0.smithi049.stdout:3/4: chown f0 124694 1 2024-04-26T10:44:25.919 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:25.918+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:25.922 INFO:tasks.workunit.client.0.smithi049.stdout:6/4: dwrite f0 [0,4194304] 0 2024-04-26T10:44:25.925 INFO:tasks.workunit.client.0.smithi049.stdout:7/3: dwrite f0 [0,4194304] 0 2024-04-26T10:44:25.925 INFO:tasks.workunit.client.0.smithi049.stdout:8/2: mkdir d2 0 2024-04-26T10:44:25.928 INFO:tasks.workunit.client.0.smithi049.stdout:0/9: dwrite f1 [0,4194304] 0 2024-04-26T10:44:25.929 INFO:tasks.workunit.client.0.smithi049.stdout:3/5: dwrite f0 [0,4194304] 0 2024-04-26T10:44:25.930 INFO:tasks.workunit.client.0.smithi049.stdout:3/6: write f0 [3719079,56107] 0 2024-04-26T10:44:25.931 INFO:tasks.workunit.client.0.smithi049.stdout:3/7: write f0 [3387436,23960] 0 2024-04-26T10:44:25.931 INFO:tasks.workunit.client.0.smithi049.stdout:2/23: creat f3 x:0 0 0 2024-04-26T10:44:25.931 INFO:tasks.workunit.client.0.smithi049.stdout:1/6: getdents . 0 2024-04-26T10:44:25.933 INFO:tasks.workunit.client.0.smithi049.stdout:5/9: getdents . 0 2024-04-26T10:44:25.933 INFO:tasks.workunit.client.0.smithi049.stdout:5/10: truncate - no filename 2024-04-26T10:44:25.933 INFO:tasks.workunit.client.0.smithi049.stdout:5/11: truncate - no filename 2024-04-26T10:44:25.933 INFO:tasks.workunit.client.0.smithi049.stdout:5/12: rmdir - no directory 2024-04-26T10:44:25.933 INFO:tasks.workunit.client.0.smithi049.stdout:5/13: write - no filename 2024-04-26T10:44:25.933 INFO:tasks.workunit.client.0.smithi049.stdout:2/24: dread - f3 zero size 2024-04-26T10:44:25.933 INFO:tasks.workunit.client.0.smithi049.stdout:9/2: mknod c1 0 2024-04-26T10:44:25.933 INFO:tasks.workunit.client.0.smithi049.stdout:1/7: chown c1 2318691 1 2024-04-26T10:44:25.933 INFO:tasks.workunit.client.0.smithi049.stdout:3/8: write f0 [893575,84154] 0 2024-04-26T10:44:25.933 INFO:tasks.workunit.client.0.smithi049.stdout:6/5: creat f1 x:0 0 0 2024-04-26T10:44:25.933 INFO:tasks.workunit.client.0.smithi049.stdout:7/4: mkdir d2 0 2024-04-26T10:44:25.933 INFO:tasks.workunit.client.0.smithi049.stdout:3/9: rmdir - no directory 2024-04-26T10:44:25.933 INFO:tasks.workunit.client.0.smithi049.stdout:9/3: write f0 [65651,9507] 0 2024-04-26T10:44:25.934 INFO:tasks.workunit.client.0.smithi049.stdout:0/10: creat f2 x:0 0 0 2024-04-26T10:44:25.934 INFO:tasks.workunit.client.0.smithi049.stdout:5/14: unlink c0 0 2024-04-26T10:44:25.934 INFO:tasks.workunit.client.0.smithi049.stdout:5/15: dread - no filename 2024-04-26T10:44:25.934 INFO:tasks.workunit.client.0.smithi049.stdout:5/16: readlink l1 0 2024-04-26T10:44:25.935 INFO:tasks.workunit.client.0.smithi049.stdout:4/8: getdents . 0 2024-04-26T10:44:25.935 INFO:tasks.workunit.client.0.smithi049.stdout:1/8: chown f0 69079 1 2024-04-26T10:44:25.935 INFO:tasks.workunit.client.0.smithi049.stdout:9/4: dread f0 [0,4194304] 0 2024-04-26T10:44:25.936 INFO:tasks.workunit.client.0.smithi049.stdout:5/17: rename l1 to l2 0 2024-04-26T10:44:25.936 INFO:tasks.workunit.client.0.smithi049.stdout:9/5: readlink - no filename 2024-04-26T10:44:25.936 INFO:tasks.workunit.client.0.smithi049.stdout:4/9: symlink l2 0 2024-04-26T10:44:25.936 INFO:tasks.workunit.client.0.smithi049.stdout:1/9: chown f0 126068 1 2024-04-26T10:44:25.937 INFO:tasks.workunit.client.0.smithi049.stdout:9/6: stat f0 0 2024-04-26T10:44:25.942 INFO:tasks.workunit.client.0.smithi049.stdout:5/18: creat f3 x:0 0 0 2024-04-26T10:44:25.942 INFO:tasks.workunit.client.0.smithi049.stdout:4/10: creat f3 x:0 0 0 2024-04-26T10:44:25.942 INFO:tasks.workunit.client.0.smithi049.stdout:1/10: symlink l2 0 2024-04-26T10:44:25.943 INFO:tasks.workunit.client.0.smithi049.stdout:9/7: mkdir d2 0 2024-04-26T10:44:25.943 INFO:tasks.workunit.client.0.smithi049.stdout:9/8: stat d2 0 2024-04-26T10:44:25.943 INFO:tasks.workunit.client.0.smithi049.stdout:5/19: read - f3 zero size 2024-04-26T10:44:25.946 INFO:tasks.workunit.client.0.smithi049.stdout:4/11: write f1 [126883,73988] 0 2024-04-26T10:44:25.946 INFO:tasks.workunit.client.0.smithi049.stdout:7/5: dread f0 [0,4194304] 0 2024-04-26T10:44:25.948 INFO:tasks.workunit.client.0.smithi049.stdout:5/20: write f3 [110195,75128] 0 2024-04-26T10:44:25.948 INFO:tasks.workunit.client.0.smithi049.stdout:4/12: chown f0 144 1 2024-04-26T10:44:25.950 INFO:tasks.workunit.client.0.smithi049.stdout:3/10: dwrite f0 [0,4194304] 0 2024-04-26T10:44:25.950 INFO:tasks.workunit.client.0.smithi049.stdout:8/3: dwrite f1 [0,4194304] 0 2024-04-26T10:44:25.950 INFO:tasks.workunit.client.0.smithi049.stdout:6/6: dwrite f1 [0,4194304] 0 2024-04-26T10:44:25.951 INFO:tasks.workunit.client.0.smithi049.stdout:6/7: rmdir - no directory 2024-04-26T10:44:25.951 INFO:tasks.workunit.client.0.smithi049.stdout:6/8: rmdir - no directory 2024-04-26T10:44:25.951 INFO:tasks.workunit.client.0.smithi049.stdout:2/25: dwrite f3 [0,4194304] 0 2024-04-26T10:44:25.951 INFO:tasks.workunit.client.0.smithi049.stdout:1/11: getdents . 0 2024-04-26T10:44:25.951 INFO:tasks.workunit.client.0.smithi049.stdout:4/13: mknod c4 0 2024-04-26T10:44:25.951 INFO:tasks.workunit.client.0.smithi049.stdout:7/6: mkdir d2/d3 0 2024-04-26T10:44:25.951 INFO:tasks.workunit.client.0.smithi049.stdout:5/21: write f3 [1012364,91629] 0 2024-04-26T10:44:25.951 INFO:tasks.workunit.client.0.smithi049.stdout:4/14: unlink f0 0 2024-04-26T10:44:25.952 INFO:tasks.workunit.client.0.smithi049.stdout:7/7: creat d2/f4 x:0 0 0 2024-04-26T10:44:25.953 INFO:tasks.workunit.client.0.smithi049.stdout:7/8: readlink l1 0 2024-04-26T10:44:25.953 INFO:tasks.workunit.client.0.smithi049.stdout:1/12: link l2 l3 0 2024-04-26T10:44:25.954 INFO:tasks.workunit.client.0.smithi049.stdout:7/9: mknod d2/c5 0 2024-04-26T10:44:25.957 INFO:tasks.workunit.client.0.smithi049.stdout:7/10: unlink d2/f4 0 2024-04-26T10:44:25.960 INFO:tasks.workunit.client.0.smithi049.stdout:9/9: dwrite f0 [0,4194304] 0 2024-04-26T10:44:25.960 INFO:tasks.workunit.client.0.smithi049.stdout:6/9: dread f0 [0,4194304] 0 2024-04-26T10:44:25.961 INFO:tasks.workunit.client.0.smithi049.stdout:3/11: fsync f0 0 2024-04-26T10:44:25.962 INFO:tasks.workunit.client.0.smithi049.stdout:9/10: rename f0 to d2/f3 0 2024-04-26T10:44:25.963 INFO:tasks.workunit.client.0.smithi049.stdout:6/10: write f1 [3765838,31291] 0 2024-04-26T10:44:25.963 INFO:tasks.workunit.client.0.smithi049.stdout:4/15: dwrite f3 [0,4194304] 0 2024-04-26T10:44:25.964 INFO:tasks.workunit.client.0.smithi049.stdout:7/11: truncate f0 3459568 0 2024-04-26T10:44:25.964 INFO:tasks.workunit.client.0.smithi049.stdout:1/13: dwrite f0 [0,4194304] 0 2024-04-26T10:44:25.964 INFO:tasks.workunit.client.0.smithi049.stdout:4/16: mknod c5 0 2024-04-26T10:44:25.965 INFO:tasks.workunit.client.0.smithi049.stdout:6/11: link f1 f2 0 2024-04-26T10:44:25.967 INFO:tasks.workunit.client.0.smithi049.stdout:4/17: link c4 c6 0 2024-04-26T10:44:25.967 INFO:tasks.workunit.client.0.smithi049.stdout:6/12: symlink l3 0 2024-04-26T10:44:25.968 INFO:tasks.workunit.client.0.smithi049.stdout:6/13: chown l3 529 1 2024-04-26T10:44:25.970 INFO:tasks.workunit.client.0.smithi049.stdout:8/4: fsync f1 0 2024-04-26T10:44:25.970 INFO:tasks.workunit.client.0.smithi049.stdout:8/5: readlink - no filename 2024-04-26T10:44:25.971 INFO:tasks.workunit.client.0.smithi049.stdout:8/6: readlink - no filename 2024-04-26T10:44:25.972 INFO:tasks.workunit.client.0.smithi049.stdout:4/18: getdents . 0 2024-04-26T10:44:25.973 INFO:tasks.workunit.client.0.smithi049.stdout:3/12: dwrite f0 [0,4194304] 0 2024-04-26T10:44:25.973 INFO:tasks.workunit.client.0.smithi049.stdout:8/7: creat d2/f3 x:0 0 0 2024-04-26T10:44:25.973 INFO:tasks.workunit.client.0.smithi049.stdout:1/14: dread f0 [0,4194304] 0 2024-04-26T10:44:25.976 INFO:tasks.workunit.client.0.smithi049.stdout:9/11: dwrite d2/f3 [0,4194304] 0 2024-04-26T10:44:25.976 INFO:tasks.workunit.client.0.smithi049.stdout:3/13: chown f0 1783 1 2024-04-26T10:44:25.976 INFO:tasks.workunit.client.0.smithi049.stdout:1/15: symlink l4 0 2024-04-26T10:44:25.976 INFO:tasks.workunit.client.0.smithi049.stdout:8/8: symlink d2/l4 0 2024-04-26T10:44:25.976 INFO:tasks.workunit.client.0.smithi049.stdout:1/16: stat l4 0 2024-04-26T10:44:25.976 INFO:tasks.workunit.client.0.smithi049.stdout:9/12: unlink c1 0 2024-04-26T10:44:25.976 INFO:tasks.workunit.client.0.smithi049.stdout:8/9: fsync d2/f3 0 2024-04-26T10:44:25.977 INFO:tasks.workunit.client.0.smithi049.stdout:7/12: dread f0 [0,4194304] 0 2024-04-26T10:44:25.977 INFO:tasks.workunit.client.0.smithi049.stdout:1/17: write f0 [2236996,13003] 0 2024-04-26T10:44:25.977 INFO:tasks.workunit.client.0.smithi049.stdout:9/13: creat d2/f4 x:0 0 0 2024-04-26T10:44:25.978 INFO:tasks.workunit.client.0.smithi049.stdout:9/14: dread - d2/f4 zero size 2024-04-26T10:44:25.978 INFO:tasks.workunit.client.0.smithi049.stdout:6/14: dread f2 [0,4194304] 0 2024-04-26T10:44:25.978 INFO:tasks.workunit.client.0.smithi049.stdout:6/15: fsync f0 0 2024-04-26T10:44:25.979 INFO:tasks.workunit.client.0.smithi049.stdout:9/15: chown d2/f3 184142 1 2024-04-26T10:44:25.979 INFO:tasks.workunit.client.0.smithi049.stdout:6/16: creat f4 x:0 0 0 2024-04-26T10:44:25.979 INFO:tasks.workunit.client.0.smithi049.stdout:9/16: dread - d2/f4 zero size 2024-04-26T10:44:25.979 INFO:tasks.workunit.client.0.smithi049.stdout:7/13: truncate f0 618496 0 2024-04-26T10:44:25.980 INFO:tasks.workunit.client.0.smithi049.stdout:9/17: read d2/f3 [620165,50054] 0 2024-04-26T10:44:25.980 INFO:tasks.workunit.client.0.smithi049.stdout:6/17: write f4 [374306,77987] 0 2024-04-26T10:44:25.980 INFO:tasks.workunit.client.0.smithi049.stdout:8/10: dread f1 [0,4194304] 0 2024-04-26T10:44:25.980 INFO:tasks.workunit.client.0.smithi049.stdout:9/18: unlink d2/f4 0 2024-04-26T10:44:25.981 INFO:tasks.workunit.client.0.smithi049.stdout:6/18: write f1 [4735360,122796] 0 2024-04-26T10:44:25.981 INFO:tasks.workunit.client.0.smithi049.stdout:9/19: creat d2/f5 x:0 0 0 2024-04-26T10:44:25.981 INFO:tasks.workunit.client.0.smithi049.stdout:8/11: write d2/f3 [945056,129398] 0 2024-04-26T10:44:25.982 INFO:tasks.workunit.client.0.smithi049.stdout:6/19: unlink f2 0 2024-04-26T10:44:25.982 INFO:tasks.workunit.client.0.smithi049.stdout:7/14: truncate f0 1121821 0 2024-04-26T10:44:25.983 INFO:tasks.workunit.client.0.smithi049.stdout:9/20: creat d2/f6 x:0 0 0 2024-04-26T10:44:25.983 INFO:tasks.workunit.client.0.smithi049.stdout:1/18: dwrite f0 [0,4194304] 0 2024-04-26T10:44:25.983 INFO:tasks.workunit.client.0.smithi049.stdout:8/12: creat d2/f5 x:0 0 0 2024-04-26T10:44:25.983 INFO:tasks.workunit.client.0.smithi049.stdout:7/15: creat d2/f6 x:0 0 0 2024-04-26T10:44:25.984 INFO:tasks.workunit.client.0.smithi049.stdout:9/21: chown d2/f5 3897 1 2024-04-26T10:44:25.984 INFO:tasks.workunit.client.0.smithi049.stdout:8/13: creat d2/f6 x:0 0 0 2024-04-26T10:44:25.986 INFO:tasks.workunit.client.0.smithi049.stdout:1/19: getdents . 0 2024-04-26T10:44:25.986 INFO:tasks.workunit.client.0.smithi049.stdout:8/14: symlink d2/l7 0 2024-04-26T10:44:25.986 INFO:tasks.workunit.client.0.smithi049.stdout:9/22: write d2/f6 [907705,109287] 0 2024-04-26T10:44:25.986 INFO:tasks.workunit.client.0.smithi049.stdout:7/16: rename d2/c5 to d2/d3/c7 0 2024-04-26T10:44:25.986 INFO:tasks.workunit.client.0.smithi049.stdout:1/20: truncate f0 4476247 0 2024-04-26T10:44:25.986 INFO:tasks.workunit.client.0.smithi049.stdout:4/19: fdatasync f3 0 2024-04-26T10:44:25.986 INFO:tasks.workunit.client.0.smithi049.stdout:9/23: chown d2/f3 69844033 1 2024-04-26T10:44:25.987 INFO:tasks.workunit.client.0.smithi049.stdout:7/17: chown d2 266931 1 2024-04-26T10:44:25.987 INFO:tasks.workunit.client.0.smithi049.stdout:8/15: link d2/f6 d2/f8 0 2024-04-26T10:44:25.987 INFO:tasks.workunit.client.0.smithi049.stdout:1/21: write f0 [1979754,12257] 0 2024-04-26T10:44:25.987 INFO:tasks.workunit.client.0.smithi049.stdout:8/16: creat d2/f9 x:0 0 0 2024-04-26T10:44:25.987 INFO:tasks.workunit.client.0.smithi049.stdout:9/24: truncate d2/f5 781568 0 2024-04-26T10:44:25.987 INFO:tasks.workunit.client.0.smithi049.stdout:7/18: truncate d2/f6 45680 0 2024-04-26T10:44:25.987 INFO:tasks.workunit.client.0.smithi049.stdout:8/17: truncate d2/f9 467148 0 2024-04-26T10:44:25.988 INFO:tasks.workunit.client.0.smithi049.stdout:9/25: symlink d2/l7 0 2024-04-26T10:44:25.990 INFO:tasks.workunit.client.0.smithi049.stdout:9/26: creat d2/f8 x:0 0 0 2024-04-26T10:44:25.990 INFO:tasks.workunit.client.0.smithi049.stdout:8/18: fsync d2/f8 0 2024-04-26T10:44:25.990 INFO:tasks.workunit.client.0.smithi049.stdout:1/22: dread f0 [0,4194304] 0 2024-04-26T10:44:25.991 INFO:tasks.workunit.client.0.smithi049.stdout:8/19: dread - d2/f5 zero size 2024-04-26T10:44:25.992 INFO:tasks.workunit.client.0.smithi049.stdout:4/20: dwrite f1 [0,4194304] 0 2024-04-26T10:44:25.992 INFO:tasks.workunit.client.0.smithi049.stdout:8/20: stat d2/f8 0 2024-04-26T10:44:25.997 INFO:tasks.workunit.client.0.smithi049.stdout:7/19: dwrite f0 [0,4194304] 0 2024-04-26T10:44:25.998 INFO:tasks.workunit.client.0.smithi049.stdout:9/27: dwrite d2/f6 [0,4194304] 0 2024-04-26T10:44:26.000 INFO:tasks.workunit.client.0.smithi049.stdout:1/23: dread f0 [0,4194304] 0 2024-04-26T10:44:26.000 INFO:tasks.workunit.client.0.smithi049.stdout:7/20: unlink d2/d3/c7 0 2024-04-26T10:44:26.001 INFO:tasks.workunit.client.0.smithi049.stdout:7/21: symlink d2/d3/l8 0 2024-04-26T10:44:26.003 INFO:tasks.workunit.client.0.smithi049.stdout:8/21: dwrite f1 [0,4194304] 0 2024-04-26T10:44:26.003 INFO:tasks.workunit.client.0.smithi049.stdout:4/21: dwrite f1 [0,4194304] 0 2024-04-26T10:44:26.003 INFO:tasks.workunit.client.0.smithi049.stdout:7/22: readlink d2/d3/l8 0 2024-04-26T10:44:26.003 INFO:tasks.workunit.client.0.smithi049.stdout:9/28: truncate d2/f5 254533 0 2024-04-26T10:44:26.004 INFO:tasks.workunit.client.0.smithi049.stdout:4/22: creat f7 x:0 0 0 2024-04-26T10:44:26.004 INFO:tasks.workunit.client.0.smithi049.stdout:7/23: write d2/f6 [361571,123438] 0 2024-04-26T10:44:26.004 INFO:tasks.workunit.client.0.smithi049.stdout:8/22: rename d2/f3 to d2/fa 0 2024-04-26T10:44:26.005 INFO:tasks.workunit.client.0.smithi049.stdout:4/23: chown c4 97628 1 2024-04-26T10:44:26.006 INFO:tasks.workunit.client.0.smithi049.stdout:1/24: dread f0 [0,4194304] 0 2024-04-26T10:44:26.007 INFO:tasks.workunit.client.0.smithi049.stdout:1/25: mknod c5 0 2024-04-26T10:44:26.011 INFO:tasks.workunit.client.0.smithi049.stdout:9/29: dwrite d2/f3 [0,4194304] 0 2024-04-26T10:44:26.013 INFO:tasks.workunit.client.0.smithi049.stdout:4/24: dread f3 [0,4194304] 0 2024-04-26T10:44:26.013 INFO:tasks.workunit.client.0.smithi049.stdout:7/24: dwrite d2/f6 [0,4194304] 0 2024-04-26T10:44:26.013 INFO:tasks.workunit.client.0.smithi049.stdout:8/23: dwrite d2/f6 [0,4194304] 0 2024-04-26T10:44:26.013 INFO:tasks.workunit.client.0.smithi049.stdout:9/30: symlink d2/l9 0 2024-04-26T10:44:26.013 INFO:tasks.workunit.client.0.smithi049.stdout:7/25: fdatasync f0 0 2024-04-26T10:44:26.014 INFO:tasks.workunit.client.0.smithi049.stdout:4/25: write f7 [661319,34602] 0 2024-04-26T10:44:26.014 INFO:tasks.workunit.client.0.smithi049.stdout:7/26: stat d2/f6 0 2024-04-26T10:44:26.014 INFO:tasks.workunit.client.0.smithi049.stdout:8/24: write d2/f5 [295230,99666] 0 2024-04-26T10:44:26.014 INFO:tasks.workunit.client.0.smithi049.stdout:4/26: creat f8 x:0 0 0 2024-04-26T10:44:26.015 INFO:tasks.workunit.client.0.smithi049.stdout:9/31: unlink d2/f6 0 2024-04-26T10:44:26.015 INFO:tasks.workunit.client.0.smithi049.stdout:4/27: readlink l2 0 2024-04-26T10:44:26.015 INFO:tasks.workunit.client.0.smithi049.stdout:7/27: symlink d2/d3/l9 0 2024-04-26T10:44:26.015 INFO:tasks.workunit.client.0.smithi049.stdout:8/25: rename d2/l7 to d2/lb 0 2024-04-26T10:44:26.015 INFO:tasks.workunit.client.0.smithi049.stdout:9/32: mkdir d2/da 0 2024-04-26T10:44:26.016 INFO:tasks.workunit.client.0.smithi049.stdout:7/28: write d2/f6 [1873664,17149] 0 2024-04-26T10:44:26.016 INFO:tasks.workunit.client.0.smithi049.stdout:9/33: stat d2 0 2024-04-26T10:44:26.016 INFO:tasks.workunit.client.0.smithi049.stdout:4/28: link f7 f9 0 2024-04-26T10:44:26.017 INFO:tasks.workunit.client.0.smithi049.stdout:9/34: unlink d2/l7 0 2024-04-26T10:44:26.017 INFO:tasks.workunit.client.0.smithi049.stdout:4/29: symlink la 0 2024-04-26T10:44:26.017 INFO:tasks.workunit.client.0.smithi049.stdout:8/26: link d2/f9 d2/fc 0 2024-04-26T10:44:26.017 INFO:tasks.workunit.client.0.smithi049.stdout:4/30: truncate f9 776466 0 2024-04-26T10:44:26.017 INFO:tasks.workunit.client.0.smithi049.stdout:8/27: creat d2/fd x:0 0 0 2024-04-26T10:44:26.017 INFO:tasks.workunit.client.0.smithi049.stdout:9/35: creat d2/da/fb x:0 0 0 2024-04-26T10:44:26.018 INFO:tasks.workunit.client.0.smithi049.stdout:4/31: chown f7 13 1 2024-04-26T10:44:26.018 INFO:tasks.workunit.client.0.smithi049.stdout:8/28: unlink d2/fa 0 2024-04-26T10:44:26.019 INFO:tasks.workunit.client.0.smithi049.stdout:8/29: creat d2/fe x:0 0 0 2024-04-26T10:44:26.019 INFO:tasks.workunit.client.0.smithi049.stdout:9/36: rename d2/f5 to d2/fc 0 2024-04-26T10:44:26.020 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:26.019+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:26.020 INFO:tasks.workunit.client.0.smithi049.stdout:8/30: mkdir d2/df 0 2024-04-26T10:44:26.020 INFO:tasks.workunit.client.0.smithi049.stdout:9/37: read d2/f3 [1890099,89196] 0 2024-04-26T10:44:26.022 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:26.022 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:26.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:26.022 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:26.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.022 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:80 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:26.022 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:26.022 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4964488090000003, 2024-04-26T10:44:26.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029259192, 2024-04-26T10:44:26.023 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:26.023 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.023 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:26.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:26.023 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:26.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:26.023 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:26.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.024 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:26.024 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522252+0000", 2024-04-26T10:44:26.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:26.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.024 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:26.024 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523121+0000", 2024-04-26T10:44:26.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00086885100000000002 2024-04-26T10:44:26.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.024 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:26.025 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523133+0000", 2024-04-26T10:44:26.025 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2109999999999999e-05 2024-04-26T10:44:26.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.025 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.025 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523139+0000", 2024-04-26T10:44:26.025 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.541e-06 2024-04-26T10:44:26.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.025 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:26.025 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523176+0000", 2024-04-26T10:44:26.025 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6847999999999997e-05 2024-04-26T10:44:26.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.026 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:26.026 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523240+0000", 2024-04-26T10:44:26.026 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3941000000000003e-05 2024-04-26T10:44:26.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.026 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:26.026 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.536390+0000", 2024-04-26T10:44:26.026 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013150811 2024-04-26T10:44:26.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.026 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:26.026 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551071+0000", 2024-04-26T10:44:26.026 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014680021 2024-04-26T10:44:26.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:26.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551428+0000", 2024-04-26T10:44:26.027 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00035703900000000002 2024-04-26T10:44:26.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:26.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551462+0000", 2024-04-26T10:44:26.027 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4337e-05 2024-04-26T10:44:26.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:26.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551513+0000", 2024-04-26T10:44:26.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0875000000000003e-05 2024-04-26T10:44:26.028 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.028 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:26.028 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.028 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:129 3.1a 3:5e41ab69:::200.00000005:head [write 3557843~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:26.028 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:26.028 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4923907390000002, 2024-04-26T10:44:26.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029108253000000001, 2024-04-26T10:44:26.028 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:26.028 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.028 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:26.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.029 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:26.029 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:26.029 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.029 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:26.029 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:26.029 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.029 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:26.029 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526311+0000", 2024-04-26T10:44:26.029 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:26.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.030 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:26.030 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526315+0000", 2024-04-26T10:44:26.030 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4809999999999998e-06 2024-04-26T10:44:26.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.030 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:26.030 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526319+0000", 2024-04-26T10:44:26.030 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0690000000000003e-06 2024-04-26T10:44:26.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.030 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.030 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526321+0000", 2024-04-26T10:44:26.031 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4880000000000001e-06 2024-04-26T10:44:26.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.031 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.031 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:26.031 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553856+0000", 2024-04-26T10:44:26.031 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027534916 2024-04-26T10:44:26.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.031 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.031 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:26.031 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553900+0000", 2024-04-26T10:44:26.031 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3954e-05 2024-04-26T10:44:26.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.031 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.031 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:26.032 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553962+0000", 2024-04-26T10:44:26.032 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1519000000000005e-05 2024-04-26T10:44:26.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.032 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:26.032 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555348+0000", 2024-04-26T10:44:26.032 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013864579999999999 2024-04-26T10:44:26.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.032 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:26.032 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555378+0000", 2024-04-26T10:44:26.032 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9441000000000002e-05 2024-04-26T10:44:26.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.033 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:26.033 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555401+0000", 2024-04-26T10:44:26.033 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2815000000000001e-05 2024-04-26T10:44:26.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.033 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:26.033 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555420+0000", 2024-04-26T10:44:26.033 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9341e-05 2024-04-26T10:44:26.033 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.033 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:26.033 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.034 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:130 3.1a 3:5e41ab69:::200.00000005:head [write 3559243~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:26.034 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:26.034 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4923789039999997, 2024-04-26T10:44:26.034 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029188316999999998, 2024-04-26T10:44:26.034 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:26.034 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.034 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:26.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.034 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:26.034 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:26.034 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.034 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:26.035 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:26.035 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.035 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:26.035 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:26.035 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:26.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.035 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:26.035 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526325+0000", 2024-04-26T10:44:26.035 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4899999999999999e-06 2024-04-26T10:44:26.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.036 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:26.036 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526327+0000", 2024-04-26T10:44:26.036 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.745e-06 2024-04-26T10:44:26.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.036 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.036 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.036 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526330+0000", 2024-04-26T10:44:26.036 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5620000000000002e-06 2024-04-26T10:44:26.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.036 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.036 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:26.036 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554200+0000", 2024-04-26T10:44:26.036 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027869541000000001 2024-04-26T10:44:26.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.037 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:26.037 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554244+0000", 2024-04-26T10:44:26.037 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4464e-05 2024-04-26T10:44:26.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.037 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:26.037 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554304+0000", 2024-04-26T10:44:26.037 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9457999999999999e-05 2024-04-26T10:44:26.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.037 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:26.037 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555453+0000", 2024-04-26T10:44:26.037 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011494000000000001 2024-04-26T10:44:26.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.038 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:26.038 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555457+0000", 2024-04-26T10:44:26.038 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1779999999999996e-06 2024-04-26T10:44:26.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.038 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:26.038 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555480+0000", 2024-04-26T10:44:26.038 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2802e-05 2024-04-26T10:44:26.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.038 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:26.039 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555512+0000", 2024-04-26T10:44:26.039 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1885999999999999e-05 2024-04-26T10:44:26.039 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.039 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:26.039 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.039 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:131 3.1a 3:5e41ab69:::200.00000005:head [write 3560642~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:26.039 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:26.039 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4923703240000004, 2024-04-26T10:44:26.039 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029683102999999999, 2024-04-26T10:44:26.039 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:26.039 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.039 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:26.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.040 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:26.040 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:26.040 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.040 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:26.040 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:26.040 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.040 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:26.040 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:26.040 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:26.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.041 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:26.041 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526336+0000", 2024-04-26T10:44:26.041 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.681e-06 2024-04-26T10:44:26.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.041 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:26.041 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526338+0000", 2024-04-26T10:44:26.041 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8430000000000001e-06 2024-04-26T10:44:26.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.041 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.041 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526341+0000", 2024-04-26T10:44:26.042 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6180000000000002e-06 2024-04-26T10:44:26.042 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.042 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.042 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:26.042 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554745+0000", 2024-04-26T10:44:26.042 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028404088000000001 2024-04-26T10:44:26.042 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.042 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.042 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:26.042 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554788+0000", 2024-04-26T10:44:26.042 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2738999999999999e-05 2024-04-26T10:44:26.042 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.042 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.042 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:26.043 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554849+0000", 2024-04-26T10:44:26.043 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1362e-05 2024-04-26T10:44:26.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.043 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.043 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:26.043 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555963+0000", 2024-04-26T10:44:26.043 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001113597 2024-04-26T10:44:26.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.043 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.043 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:26.043 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555969+0000", 2024-04-26T10:44:26.043 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6900000000000003e-06 2024-04-26T10:44:26.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.043 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.044 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:26.044 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555995+0000", 2024-04-26T10:44:26.044 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5165999999999999e-05 2024-04-26T10:44:26.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.044 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:26.044 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556015+0000", 2024-04-26T10:44:26.044 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0522000000000001e-05 2024-04-26T10:44:26.044 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.044 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:26.044 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.044 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:132 3.1a 3:5e41ab69:::200.00000005:head [write 3562043~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:26.045 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:26.045 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4923500589999996, 2024-04-26T10:44:26.045 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030129895, 2024-04-26T10:44:26.045 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:26.045 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.045 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:26.045 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.045 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:26.045 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:26.045 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.045 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.045 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:26.045 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:26.045 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.046 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.046 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:26.046 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:26.046 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:26.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.046 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.046 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:26.046 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526354+0000", 2024-04-26T10:44:26.046 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8560000000000001e-06 2024-04-26T10:44:26.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.046 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.046 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:26.046 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526359+0000", 2024-04-26T10:44:26.047 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4700000000000001e-06 2024-04-26T10:44:26.047 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.047 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.047 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.047 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526365+0000", 2024-04-26T10:44:26.047 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2120000000000002e-06 2024-04-26T10:44:26.047 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.047 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.047 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:26.047 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555050+0000", 2024-04-26T10:44:26.047 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028685458 2024-04-26T10:44:26.047 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.047 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.047 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:26.048 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555093+0000", 2024-04-26T10:44:26.048 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3307999999999999e-05 2024-04-26T10:44:26.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.048 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:26.048 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555156+0000", 2024-04-26T10:44:26.048 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2396000000000004e-05 2024-04-26T10:44:26.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.048 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:26.048 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556052+0000", 2024-04-26T10:44:26.048 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00089650299999999999 2024-04-26T10:44:26.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.049 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:26.049 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556439+0000", 2024-04-26T10:44:26.049 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038647900000000001 2024-04-26T10:44:26.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.049 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:26.049 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556463+0000", 2024-04-26T10:44:26.049 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4071e-05 2024-04-26T10:44:26.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.049 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:26.049 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556482+0000", 2024-04-26T10:44:26.049 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9378999999999999e-05 2024-04-26T10:44:26.049 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.050 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:26.050 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.050 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 3563440~3660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:26.050 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:26.050 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4923336650000003, 2024-04-26T10:44:26.050 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030550738000000001, 2024-04-26T10:44:26.050 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:26.050 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.050 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:26.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.050 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:26.050 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:26.051 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.051 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:26.051 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:26.051 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.051 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:26.051 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526368+0000", 2024-04-26T10:44:26.051 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:26.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.051 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:26.052 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526375+0000", 2024-04-26T10:44:26.052 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7510000000000002e-06 2024-04-26T10:44:26.052 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.052 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.052 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:26.052 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526381+0000", 2024-04-26T10:44:26.052 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3929999999999996e-06 2024-04-26T10:44:26.052 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.052 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.052 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.052 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526387+0000", 2024-04-26T10:44:26.052 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.215e-06 2024-04-26T10:44:26.052 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.052 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.053 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:26.053 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555542+0000", 2024-04-26T10:44:26.053 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029154992000000001 2024-04-26T10:44:26.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.053 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.053 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:26.053 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555610+0000", 2024-04-26T10:44:26.053 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8610999999999998e-05 2024-04-26T10:44:26.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.053 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.053 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:26.053 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555681+0000", 2024-04-26T10:44:26.053 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1072e-05 2024-04-26T10:44:26.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.054 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.054 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:26.054 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556866+0000", 2024-04-26T10:44:26.054 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001184598 2024-04-26T10:44:26.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.054 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.054 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:26.054 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556872+0000", 2024-04-26T10:44:26.054 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.55e-06 2024-04-26T10:44:26.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.054 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.054 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:26.054 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556897+0000", 2024-04-26T10:44:26.055 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.516e-05 2024-04-26T10:44:26.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.055 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.055 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:26.055 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556919+0000", 2024-04-26T10:44:26.055 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1951e-05 2024-04-26T10:44:26.055 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.055 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:26.055 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.055 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.055 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:134 3.1a 3:5e41ab69:::200.00000005:head [write 3567100~2427 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:26.055 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:26.055 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4923006000000001, 2024-04-26T10:44:26.056 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031267445999999997, 2024-04-26T10:44:26.056 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:26.056 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.056 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:26.056 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.056 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:26.056 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:26.056 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.056 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.056 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:26.056 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:26.056 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.057 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.057 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:26.057 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526401+0000", 2024-04-26T10:44:26.057 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:26.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.057 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.057 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:26.057 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526408+0000", 2024-04-26T10:44:26.057 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7769999999999997e-06 2024-04-26T10:44:26.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.057 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.057 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:26.057 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526415+0000", 2024-04-26T10:44:26.058 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0720000000000002e-06 2024-04-26T10:44:26.058 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.058 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.058 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.058 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526421+0000", 2024-04-26T10:44:26.058 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9699999999999996e-06 2024-04-26T10:44:26.058 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.058 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.058 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:26.058 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556084+0000", 2024-04-26T10:44:26.058 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029662351999999999 2024-04-26T10:44:26.058 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.058 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.058 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:26.059 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556126+0000", 2024-04-26T10:44:26.059 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2385000000000002e-05 2024-04-26T10:44:26.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.059 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.059 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:26.059 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556186+0000", 2024-04-26T10:44:26.059 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9945999999999998e-05 2024-04-26T10:44:26.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.059 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.059 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:26.060 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557598+0000", 2024-04-26T10:44:26.060 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0014121559999999999 2024-04-26T10:44:26.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.060 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.060 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:26.060 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557626+0000", 2024-04-26T10:44:26.060 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7960999999999999e-05 2024-04-26T10:44:26.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.060 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.060 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:26.060 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557650+0000", 2024-04-26T10:44:26.060 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3969999999999999e-05 2024-04-26T10:44:26.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.060 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.061 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:26.061 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557669+0000", 2024-04-26T10:44:26.061 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9262e-05 2024-04-26T10:44:26.061 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.061 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:26.061 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.061 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:135 3.1a 3:5e41ab69:::200.00000005:head [write 3569527~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:26.061 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:26.061 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4922763339999996, 2024-04-26T10:44:26.061 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031322516000000002, 2024-04-26T10:44:26.061 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:26.061 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.062 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:26.062 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.062 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:26.062 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:26.062 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.062 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.062 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:26.062 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:26.062 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.062 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.062 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:26.063 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:26.063 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:26.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.063 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.063 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:26.063 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526429+0000", 2024-04-26T10:44:26.063 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0750000000000002e-06 2024-04-26T10:44:26.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.063 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.063 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:26.063 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526435+0000", 2024-04-26T10:44:26.063 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.263e-06 2024-04-26T10:44:26.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.063 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.064 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.064 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526442+0000", 2024-04-26T10:44:26.064 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1219999999999997e-06 2024-04-26T10:44:26.064 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.064 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.064 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:26.064 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556515+0000", 2024-04-26T10:44:26.064 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030073132999999998 2024-04-26T10:44:26.064 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.064 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.064 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:26.064 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556564+0000", 2024-04-26T10:44:26.064 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8871e-05 2024-04-26T10:44:26.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.065 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.065 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:26.065 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556625+0000", 2024-04-26T10:44:26.065 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1307000000000001e-05 2024-04-26T10:44:26.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.065 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.065 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:26.065 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557678+0000", 2024-04-26T10:44:26.065 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010523100000000001 2024-04-26T10:44:26.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.065 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.065 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:26.065 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557709+0000", 2024-04-26T10:44:26.066 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1748000000000002e-05 2024-04-26T10:44:26.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.066 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.066 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:26.066 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557732+0000", 2024-04-26T10:44:26.066 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2415000000000001e-05 2024-04-26T10:44:26.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.066 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.066 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:26.066 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557749+0000", 2024-04-26T10:44:26.066 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6736999999999999e-05 2024-04-26T10:44:26.067 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.067 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:26.067 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.067 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:136 3.1a 3:5e41ab69:::200.00000005:head [write 3571449~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:26.067 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:26.067 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4922551439999996, 2024-04-26T10:44:26.067 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032180937, 2024-04-26T10:44:26.067 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:26.067 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.067 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:26.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.067 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:26.068 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:26.068 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.068 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:26.068 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:26.068 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.068 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:26.068 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:26.068 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:26.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.069 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:26.069 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526455+0000", 2024-04-26T10:44:26.069 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6429999999999995e-06 2024-04-26T10:44:26.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.069 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.069 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:26.069 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526461+0000", 2024-04-26T10:44:26.069 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:26.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.069 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.069 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.069 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526467+0000", 2024-04-26T10:44:26.069 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4389999999999999e-06 2024-04-26T10:44:26.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.070 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:26.070 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556950+0000", 2024-04-26T10:44:26.070 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030483854000000001 2024-04-26T10:44:26.070 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.070 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:26.070 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556989+0000", 2024-04-26T10:44:26.070 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8415999999999999e-05 2024-04-26T10:44:26.070 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.070 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:26.070 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557051+0000", 2024-04-26T10:44:26.070 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2088999999999995e-05 2024-04-26T10:44:26.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.071 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.071 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:26.071 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558166+0000", 2024-04-26T10:44:26.071 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001114622 2024-04-26T10:44:26.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.071 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.071 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:26.071 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558584+0000", 2024-04-26T10:44:26.071 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000418033 2024-04-26T10:44:26.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.071 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.071 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:26.071 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558609+0000", 2024-04-26T10:44:26.071 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5344999999999999e-05 2024-04-26T10:44:26.072 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.072 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:26.072 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558628+0000", 2024-04-26T10:44:26.072 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9273999999999999e-05 2024-04-26T10:44:26.072 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.072 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:26.072 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.072 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.072 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:137 3.1a 3:5e41ab69:::200.00000005:head [write 3573699~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:26.072 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:26.072 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4922314950000004, 2024-04-26T10:44:26.073 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032241530999999997, 2024-04-26T10:44:26.073 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:26.073 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.073 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:26.073 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.073 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:26.073 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:26.073 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.073 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.073 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:26.073 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:26.073 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.074 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.074 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:26.074 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526470+0000", 2024-04-26T10:44:26.074 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:26.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.074 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.074 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:26.074 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526473+0000", 2024-04-26T10:44:26.074 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.818e-06 2024-04-26T10:44:26.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.074 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.074 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:26.075 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526480+0000", 2024-04-26T10:44:26.075 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4119999999999998e-06 2024-04-26T10:44:26.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.075 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.075 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526484+0000", 2024-04-26T10:44:26.075 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6840000000000004e-06 2024-04-26T10:44:26.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.075 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:26.075 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557323+0000", 2024-04-26T10:44:26.075 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030838956000000001 2024-04-26T10:44:26.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.075 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:26.076 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557362+0000", 2024-04-26T10:44:26.076 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8343999999999997e-05 2024-04-26T10:44:26.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.076 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.076 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:26.076 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557421+0000", 2024-04-26T10:44:26.076 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9176999999999999e-05 2024-04-26T10:44:26.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.076 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.076 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:26.076 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558636+0000", 2024-04-26T10:44:26.076 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012153789999999999 2024-04-26T10:44:26.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.076 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.077 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:26.077 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558668+0000", 2024-04-26T10:44:26.077 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1452999999999999e-05 2024-04-26T10:44:26.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.077 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.077 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:26.077 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558694+0000", 2024-04-26T10:44:26.077 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6288999999999999e-05 2024-04-26T10:44:26.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.077 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.077 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:26.077 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558712+0000", 2024-04-26T10:44:26.077 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8459000000000001e-05 2024-04-26T10:44:26.077 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.078 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:26.078 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.078 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.078 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:138 3.1a 3:5e41ab69:::200.00000005:head [write 3575103~4205 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:26.078 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:26.078 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4922141760000001, 2024-04-26T10:44:26.078 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032665567999999999, 2024-04-26T10:44:26.078 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:26.078 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.078 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:26.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.078 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:26.079 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:26.079 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.079 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:26.079 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:26.079 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.079 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:26.079 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:26.079 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:26.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.079 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:26.080 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526495+0000", 2024-04-26T10:44:26.080 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7580000000000003e-06 2024-04-26T10:44:26.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.080 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.080 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:26.080 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526501+0000", 2024-04-26T10:44:26.080 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1680000000000001e-06 2024-04-26T10:44:26.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.080 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.080 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.080 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526505+0000", 2024-04-26T10:44:26.080 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.673e-06 2024-04-26T10:44:26.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.080 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.081 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:26.081 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557781+0000", 2024-04-26T10:44:26.081 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031275718000000001 2024-04-26T10:44:26.081 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.081 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.081 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:26.081 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557825+0000", 2024-04-26T10:44:26.081 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4048000000000002e-05 2024-04-26T10:44:26.081 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.081 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.081 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:26.081 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557888+0000", 2024-04-26T10:44:26.081 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2562000000000002e-05 2024-04-26T10:44:26.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.082 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.082 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:26.082 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559073+0000", 2024-04-26T10:44:26.082 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011852239999999999 2024-04-26T10:44:26.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.082 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.082 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:26.082 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559112+0000", 2024-04-26T10:44:26.082 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9226e-05 2024-04-26T10:44:26.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.082 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.082 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:26.082 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559136+0000", 2024-04-26T10:44:26.083 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3966000000000001e-05 2024-04-26T10:44:26.083 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.083 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.083 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:26.083 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559154+0000", 2024-04-26T10:44:26.083 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7575e-05 2024-04-26T10:44:26.083 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.083 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:26.083 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.083 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.083 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.083 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:139 3.1a 3:5e41ab69:::200.00000005:head [write 3579308~2255 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:26.083 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:26.083 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4921925580000002, 2024-04-26T10:44:26.084 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033424720999999998, 2024-04-26T10:44:26.084 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:26.084 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.084 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:26.084 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.084 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:26.084 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:26.084 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.084 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.084 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.084 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:26.084 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:26.084 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.084 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.084 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526509+0000", 2024-04-26T10:44:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526516+0000", 2024-04-26T10:44:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5209999999999999e-06 2024-04-26T10:44:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526522+0000", 2024-04-26T10:44:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1229999999999997e-06 2024-04-26T10:44:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526527+0000", 2024-04-26T10:44:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7849999999999999e-06 2024-04-26T10:44:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558194+0000", 2024-04-26T10:44:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031667419000000002 2024-04-26T10:44:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558234+0000", 2024-04-26T10:44:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9774999999999998e-05 2024-04-26T10:44:26.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.087 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.087 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:26.087 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558294+0000", 2024-04-26T10:44:26.087 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0242999999999999e-05 2024-04-26T10:44:26.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.087 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.087 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:26.087 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559106+0000", 2024-04-26T10:44:26.087 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00081148099999999996 2024-04-26T10:44:26.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.087 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.087 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:26.087 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559890+0000", 2024-04-26T10:44:26.088 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00078439999999999998 2024-04-26T10:44:26.088 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.088 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.088 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:26.088 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559917+0000", 2024-04-26T10:44:26.088 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7044000000000001e-05 2024-04-26T10:44:26.088 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.088 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.088 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:26.088 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559935+0000", 2024-04-26T10:44:26.088 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7448e-05 2024-04-26T10:44:26.088 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.088 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:26.088 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.089 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.089 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:140 3.1a 3:5e41ab69:::200.00000005:head [write 3581563~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:26.089 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:26.089 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4921711369999997, 2024-04-26T10:44:26.089 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033867728, 2024-04-26T10:44:26.089 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:26.089 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.089 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:26.089 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.089 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:26.089 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:26.089 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.089 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.090 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:26.090 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:26.090 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.090 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:26.090 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:26.090 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:26.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.090 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:26.090 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526538+0000", 2024-04-26T10:44:26.090 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.905e-06 2024-04-26T10:44:26.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.091 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:26.091 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526542+0000", 2024-04-26T10:44:26.091 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9550000000000002e-06 2024-04-26T10:44:26.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.091 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.091 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526545+0000", 2024-04-26T10:44:26.091 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8499999999999998e-06 2024-04-26T10:44:26.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.091 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:26.091 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558744+0000", 2024-04-26T10:44:26.091 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032198986999999998 2024-04-26T10:44:26.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.092 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:26.092 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558788+0000", 2024-04-26T10:44:26.092 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4365e-05 2024-04-26T10:44:26.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.092 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:26.092 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558854+0000", 2024-04-26T10:44:26.092 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5952999999999997e-05 2024-04-26T10:44:26.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.092 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:26.092 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559971+0000", 2024-04-26T10:44:26.092 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011172770000000001 2024-04-26T10:44:26.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.093 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:26.093 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560354+0000", 2024-04-26T10:44:26.093 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038267599999999998 2024-04-26T10:44:26.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.093 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:26.093 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560380+0000", 2024-04-26T10:44:26.093 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6140999999999999e-05 2024-04-26T10:44:26.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.094 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:26.094 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560399+0000", 2024-04-26T10:44:26.094 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9032999999999999e-05 2024-04-26T10:44:26.094 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.094 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:26.094 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.094 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:141 3.1a 3:5e41ab69:::200.00000005:head [write 3583482~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:26.094 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:26.094 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4921554779999999, 2024-04-26T10:44:26.095 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034316301, 2024-04-26T10:44:26.095 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:26.095 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.095 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:26.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.095 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:26.095 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:26.095 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.095 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:26.095 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:26.095 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.096 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:26.096 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:26.096 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:26.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.096 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:26.096 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526548+0000", 2024-04-26T10:44:26.096 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.739e-06 2024-04-26T10:44:26.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.096 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:26.096 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526551+0000", 2024-04-26T10:44:26.096 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.044e-06 2024-04-26T10:44:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526562+0000", 2024-04-26T10:44:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0370000000000001e-05 2024-04-26T10:44:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559179+0000", 2024-04-26T10:44:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032617444000000002 2024-04-26T10:44:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559220+0000", 2024-04-26T10:44:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0364999999999997e-05 2024-04-26T10:44:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559280+0000", 2024-04-26T10:44:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0569000000000002e-05 2024-04-26T10:44:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560814+0000", 2024-04-26T10:44:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015337580000000001 2024-04-26T10:44:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560820+0000", 2024-04-26T10:44:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.455e-06 2024-04-26T10:44:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560846+0000", 2024-04-26T10:44:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5228999999999998e-05 2024-04-26T10:44:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560863+0000", 2024-04-26T10:44:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7555e-05 2024-04-26T10:44:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:142 3.1a 3:5e41ab69:::200.00000005:head [write 3585931~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4921350809999998, 2024-04-26T10:44:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034372373999999997, 2024-04-26T10:44:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526573+0000", 2024-04-26T10:44:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0800000000000002e-06 2024-04-26T10:44:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526580+0000", 2024-04-26T10:44:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5799999999999997e-06 2024-04-26T10:44:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526585+0000", 2024-04-26T10:44:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2270000000000001e-06 2024-04-26T10:44:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559601+0000", 2024-04-26T10:44:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033016684999999997 2024-04-26T10:44:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559642+0000", 2024-04-26T10:44:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0321000000000002e-05 2024-04-26T10:44:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559706+0000", 2024-04-26T10:44:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4228999999999998e-05 2024-04-26T10:44:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560871+0000", 2024-04-26T10:44:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001164893 2024-04-26T10:44:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560899+0000", 2024-04-26T10:44:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560922+0000", 2024-04-26T10:44:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3337999999999999e-05 2024-04-26T10:44:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560940+0000", 2024-04-26T10:44:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7289999999999999e-05 2024-04-26T10:44:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:143 3.1a 3:5e41ab69:::200.00000005:head [write 3587331~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4921131829999998, 2024-04-26T10:44:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035256000000000003, 2024-04-26T10:44:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526592+0000", 2024-04-26T10:44:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2449999999999998e-06 2024-04-26T10:44:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526596+0000", 2024-04-26T10:44:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7000000000000002e-06 2024-04-26T10:44:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.108 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.108 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526599+0000", 2024-04-26T10:44:26.108 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6160000000000002e-06 2024-04-26T10:44:26.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.108 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:26.108 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559997+0000", 2024-04-26T10:44:26.108 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033397835000000001 2024-04-26T10:44:26.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.108 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560051+0000", 2024-04-26T10:44:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3742000000000001e-05 2024-04-26T10:44:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560112+0000", 2024-04-26T10:44:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0851999999999999e-05 2024-04-26T10:44:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561404+0000", 2024-04-26T10:44:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001291869 2024-04-26T10:44:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561797+0000", 2024-04-26T10:44:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039383000000000002 2024-04-26T10:44:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561827+0000", 2024-04-26T10:44:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9247e-05 2024-04-26T10:44:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561845+0000", 2024-04-26T10:44:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8462999999999999e-05 2024-04-26T10:44:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:144 3.1a 3:5e41ab69:::200.00000005:head [write 3588736~4987 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4919908910000004, 2024-04-26T10:44:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035224283000000002, 2024-04-26T10:44:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526718+0000", 2024-04-26T10:44:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.43e-06 2024-04-26T10:44:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526726+0000", 2024-04-26T10:44:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:44:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526729+0000", 2024-04-26T10:44:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6480000000000001e-06 2024-04-26T10:44:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560427+0000", 2024-04-26T10:44:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033697280000000003 2024-04-26T10:44:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560466+0000", 2024-04-26T10:44:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9606e-05 2024-04-26T10:44:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560525+0000", 2024-04-26T10:44:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9218000000000001e-05 2024-04-26T10:44:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561854+0000", 2024-04-26T10:44:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001328421 2024-04-26T10:44:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561887+0000", 2024-04-26T10:44:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2746000000000001e-05 2024-04-26T10:44:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561912+0000", 2024-04-26T10:44:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5126999999999998e-05 2024-04-26T10:44:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561936+0000", 2024-04-26T10:44:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4032999999999998e-05 2024-04-26T10:44:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:145 3.1a 3:5e41ab69:::200.00000005:head [write 3593723~2939 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4890718459999999, 2024-04-26T10:44:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033294394999999997, 2024-04-26T10:44:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.118 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:26.118 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529630+0000", 2024-04-26T10:44:26.118 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:26.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.118 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:26.118 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529635+0000", 2024-04-26T10:44:26.118 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7960000000000003e-06 2024-04-26T10:44:26.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.118 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:26.118 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529643+0000", 2024-04-26T10:44:26.119 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0390000000000005e-06 2024-04-26T10:44:26.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.119 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.119 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529648+0000", 2024-04-26T10:44:26.119 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9599999999999999e-06 2024-04-26T10:44:26.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.119 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:26.119 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560969+0000", 2024-04-26T10:44:26.119 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031321767 2024-04-26T10:44:26.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.119 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:26.120 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561009+0000", 2024-04-26T10:44:26.120 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9904999999999998e-05 2024-04-26T10:44:26.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.120 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:26.120 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561070+0000", 2024-04-26T10:44:26.120 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0708999999999998e-05 2024-04-26T10:44:26.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.120 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:26.120 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562352+0000", 2024-04-26T10:44:26.120 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012818440000000001 2024-04-26T10:44:26.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562867+0000", 2024-04-26T10:44:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000515665 2024-04-26T10:44:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562893+0000", 2024-04-26T10:44:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5469999999999998e-05 2024-04-26T10:44:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562925+0000", 2024-04-26T10:44:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1974999999999998e-05 2024-04-26T10:44:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:146 3.1a 3:5e41ab69:::200.00000005:head [write 3596662~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.488843632, 2024-04-26T10:44:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033178429000000002, 2024-04-26T10:44:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529858+0000", 2024-04-26T10:44:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:26.124 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.124 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:26.124 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529863+0000", 2024-04-26T10:44:26.124 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4500000000000003e-06 2024-04-26T10:44:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529874+0000", 2024-04-26T10:44:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0552e-05 2024-04-26T10:44:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529882+0000", 2024-04-26T10:44:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4449999999999996e-06 2024-04-26T10:44:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561452+0000", 2024-04-26T10:44:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031569680000000003 2024-04-26T10:44:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561511+0000", 2024-04-26T10:44:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9332e-05 2024-04-26T10:44:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561583+0000", 2024-04-26T10:44:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1730000000000006e-05 2024-04-26T10:44:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562933+0000", 2024-04-26T10:44:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013500059999999999 2024-04-26T10:44:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562976+0000", 2024-04-26T10:44:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2987e-05 2024-04-26T10:44:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563015+0000", 2024-04-26T10:44:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9453999999999999e-05 2024-04-26T10:44:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563037+0000", 2024-04-26T10:44:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1679e-05 2024-04-26T10:44:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:147 3.1a 3:5e41ab69:::200.00000005:head [write 3598061~3384 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.535041+0000", 2024-04-26T10:44:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4836615799999997, 2024-04-26T10:44:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028490299, 2024-04-26T10:44:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.535041+0000", 2024-04-26T10:44:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.130 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:26.130 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.535041+0000", 2024-04-26T10:44:26.130 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:26.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.130 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:26.130 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.535040+0000", 2024-04-26T10:44:26.130 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:26.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.131 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.131 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:26.131 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.535045+0000", 2024-04-26T10:44:26.131 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0030000000000002e-06 2024-04-26T10:44:26.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.131 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.131 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.535053+0000", 2024-04-26T10:44:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5680000000000002e-06 2024-04-26T10:44:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.535057+0000", 2024-04-26T10:44:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6779999999999999e-06 2024-04-26T10:44:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561968+0000", 2024-04-26T10:44:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.026910661999999998 2024-04-26T10:44:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562006+0000", 2024-04-26T10:44:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7842000000000001e-05 2024-04-26T10:44:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562069+0000", 2024-04-26T10:44:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3118000000000001e-05 2024-04-26T10:44:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.134 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:26.134 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563462+0000", 2024-04-26T10:44:26.134 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001393116 2024-04-26T10:44:26.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.134 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:26.134 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563490+0000", 2024-04-26T10:44:26.134 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8271000000000001e-05 2024-04-26T10:44:26.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.135 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:26.135 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563514+0000", 2024-04-26T10:44:26.135 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3964e-05 2024-04-26T10:44:26.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:26.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:26.136 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:26.136 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563531+0000", 2024-04-26T10:44:26.136 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6915e-05 2024-04-26T10:44:26.136 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.136 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:26.137 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.137 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:26.137 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:26.137 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:26.140 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:26.138+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:26.141 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:26.167 INFO:tasks.workunit.client.0.smithi049.stdout:9/38: creat d2/da/fd x:0 0 0 2024-04-26T10:44:26.168 INFO:tasks.workunit.client.0.smithi049.stdout:7/29: dwrite d2/f6 [0,4194304] 0 2024-04-26T10:44:26.168 INFO:tasks.workunit.client.0.smithi049.stdout:9/39: write d2/f3 [1255725,38594] 0 2024-04-26T10:44:26.168 INFO:tasks.workunit.client.0.smithi049.stdout:4/32: dwrite f3 [0,4194304] 0 2024-04-26T10:44:26.168 INFO:tasks.workunit.client.0.smithi049.stdout:9/40: symlink d2/da/le 0 2024-04-26T10:44:26.168 INFO:tasks.workunit.client.0.smithi049.stdout:9/41: dread d2/f3 [0,4194304] 0 2024-04-26T10:44:26.168 INFO:tasks.workunit.client.0.smithi049.stdout:4/33: dread f3 [0,4194304] 0 2024-04-26T10:44:26.169 INFO:tasks.workunit.client.0.smithi049.stdout:9/42: read d2/f3 [4170522,46156] 0 2024-04-26T10:44:26.169 INFO:tasks.workunit.client.0.smithi049.stdout:4/34: write f3 [5166187,62167] 0 2024-04-26T10:44:26.169 INFO:tasks.workunit.client.0.smithi049.stdout:9/43: dread - d2/da/fb zero size 2024-04-26T10:44:26.169 INFO:tasks.workunit.client.0.smithi049.stdout:4/35: symlink lb 0 2024-04-26T10:44:26.169 INFO:tasks.workunit.client.0.smithi049.stdout:4/36: link f9 fc 0 2024-04-26T10:44:26.169 INFO:tasks.workunit.client.0.smithi049.stdout:9/44: getdents d2/da 0 2024-04-26T10:44:26.170 INFO:tasks.workunit.client.0.smithi049.stdout:4/37: getdents . 0 2024-04-26T10:44:26.170 INFO:tasks.workunit.client.0.smithi049.stdout:4/38: chown c5 3567 1 2024-04-26T10:44:26.170 INFO:tasks.workunit.client.0.smithi049.stdout:9/45: fsync d2/fc 0 2024-04-26T10:44:26.170 INFO:tasks.workunit.client.0.smithi049.stdout:4/39: truncate f9 1062412 0 2024-04-26T10:44:26.170 INFO:tasks.workunit.client.0.smithi049.stdout:9/46: mkdir d2/da/df 0 2024-04-26T10:44:26.171 INFO:tasks.workunit.client.0.smithi049.stdout:9/47: truncate d2/fc 855399 0 2024-04-26T10:44:26.171 INFO:tasks.workunit.client.0.smithi049.stdout:9/48: chown d2/da/df 0 1 2024-04-26T10:44:26.171 INFO:tasks.workunit.client.0.smithi049.stdout:9/49: chown d2/da/le 57554102 1 2024-04-26T10:44:26.171 INFO:tasks.workunit.client.0.smithi049.stdout:4/40: fdatasync f9 0 2024-04-26T10:44:26.171 INFO:tasks.workunit.client.0.smithi049.stdout:4/41: stat c6 0 2024-04-26T10:44:26.171 INFO:tasks.workunit.client.0.smithi049.stdout:9/50: dwrite d2/f8 [0,4194304] 0 2024-04-26T10:44:26.172 INFO:tasks.workunit.client.0.smithi049.stdout:9/51: mknod d2/da/df/c10 0 2024-04-26T10:44:26.172 INFO:tasks.workunit.client.0.smithi049.stdout:9/52: mkdir d2/da/d11 0 2024-04-26T10:44:26.172 INFO:tasks.workunit.client.0.smithi049.stdout:9/53: truncate d2/da/fb 815682 0 2024-04-26T10:44:26.172 INFO:tasks.workunit.client.0.smithi049.stdout:4/42: dwrite f1 [0,4194304] 0 2024-04-26T10:44:26.172 INFO:tasks.workunit.client.0.smithi049.stdout:9/54: symlink d2/da/df/l12 0 2024-04-26T10:44:26.172 INFO:tasks.workunit.client.0.smithi049.stdout:4/43: write f1 [1499877,29475] 0 2024-04-26T10:44:26.173 INFO:tasks.workunit.client.0.smithi049.stdout:4/44: rmdir - no directory 2024-04-26T10:44:26.173 INFO:tasks.workunit.client.0.smithi049.stdout:9/55: creat d2/da/df/f13 x:0 0 0 2024-04-26T10:44:26.173 INFO:tasks.workunit.client.0.smithi049.stdout:4/45: write f9 [1575061,94569] 0 2024-04-26T10:44:26.173 INFO:tasks.workunit.client.0.smithi049.stdout:9/56: read - d2/da/fd zero size 2024-04-26T10:44:26.173 INFO:tasks.workunit.client.0.smithi049.stdout:4/46: mknod cd 0 2024-04-26T10:44:26.173 INFO:tasks.workunit.client.0.smithi049.stdout:4/47: readlink la 0 2024-04-26T10:44:26.173 INFO:tasks.workunit.client.0.smithi049.stdout:4/48: mkdir de 0 2024-04-26T10:44:26.173 INFO:tasks.workunit.client.0.smithi049.stdout:4/49: unlink f3 0 2024-04-26T10:44:26.174 INFO:tasks.workunit.client.0.smithi049.stdout:4/50: chown la 1777946146 1 2024-04-26T10:44:26.174 INFO:tasks.workunit.client.0.smithi049.stdout:4/51: write f8 [1033263,57666] 0 2024-04-26T10:44:26.174 INFO:tasks.workunit.client.0.smithi049.stdout:4/52: stat f9 0 2024-04-26T10:44:26.174 INFO:tasks.workunit.client.0.smithi049.stdout:4/53: readlink l2 0 2024-04-26T10:44:26.174 INFO:tasks.workunit.client.0.smithi049.stdout:4/54: write f8 [408345,44458] 0 2024-04-26T10:44:26.174 INFO:tasks.workunit.client.0.smithi049.stdout:4/55: creat de/ff x:0 0 0 2024-04-26T10:44:26.174 INFO:tasks.workunit.client.0.smithi049.stdout:4/56: symlink de/l10 0 2024-04-26T10:44:26.174 INFO:tasks.workunit.client.0.smithi049.stdout:4/57: chown c6 8193867 1 2024-04-26T10:44:26.175 INFO:tasks.workunit.client.0.smithi049.stdout:9/57: dread d2/da/fb [0,4194304] 0 2024-04-26T10:44:26.175 INFO:tasks.workunit.client.0.smithi049.stdout:4/58: fsync fc 0 2024-04-26T10:44:26.175 INFO:tasks.workunit.client.0.smithi049.stdout:4/59: write f7 [2274406,21591] 0 2024-04-26T10:44:26.175 INFO:tasks.workunit.client.0.smithi049.stdout:9/58: dwrite d2/da/df/f13 [0,4194304] 0 2024-04-26T10:44:26.175 INFO:tasks.workunit.client.0.smithi049.stdout:4/60: dwrite f8 [0,4194304] 0 2024-04-26T10:44:26.175 INFO:tasks.workunit.client.0.smithi049.stdout:9/59: dwrite d2/da/fd [0,4194304] 0 2024-04-26T10:44:26.175 INFO:tasks.workunit.client.0.smithi049.stdout:9/60: write d2/da/df/f13 [3583106,42562] 0 2024-04-26T10:44:26.176 INFO:tasks.workunit.client.0.smithi049.stdout:9/61: mknod d2/da/d11/c14 0 2024-04-26T10:44:26.176 INFO:tasks.workunit.client.0.smithi049.stdout:4/61: truncate f8 923286 0 2024-04-26T10:44:26.176 INFO:tasks.workunit.client.0.smithi049.stdout:4/62: creat de/f11 x:0 0 0 2024-04-26T10:44:26.176 INFO:tasks.workunit.client.0.smithi049.stdout:9/62: write d2/da/df/f13 [2343613,67162] 0 2024-04-26T10:44:26.176 INFO:tasks.workunit.client.0.smithi049.stdout:4/63: write f1 [2082215,52271] 0 2024-04-26T10:44:26.176 INFO:tasks.workunit.client.0.smithi049.stdout:9/63: fsync d2/da/fb 0 2024-04-26T10:44:26.176 INFO:tasks.workunit.client.0.smithi049.stdout:4/64: creat de/f12 x:0 0 0 2024-04-26T10:44:26.177 INFO:tasks.workunit.client.0.smithi049.stdout:4/65: fdatasync fc 0 2024-04-26T10:44:26.177 INFO:tasks.workunit.client.0.smithi049.stdout:9/64: rename d2/da/df/l12 to d2/da/l15 0 2024-04-26T10:44:26.177 INFO:tasks.workunit.client.0.smithi049.stdout:9/65: chown d2/da/l15 0 1 2024-04-26T10:44:26.177 INFO:tasks.workunit.client.0.smithi049.stdout:9/66: creat d2/da/d11/f16 x:0 0 0 2024-04-26T10:44:26.177 INFO:tasks.workunit.client.0.smithi049.stdout:9/67: read d2/fc [252765,10997] 0 2024-04-26T10:44:26.177 INFO:tasks.workunit.client.0.smithi049.stdout:9/68: write d2/da/df/f13 [1393267,1159] 0 2024-04-26T10:44:26.178 INFO:tasks.workunit.client.0.smithi049.stdout:9/69: mknod d2/da/df/c17 0 2024-04-26T10:44:26.178 INFO:tasks.workunit.client.0.smithi049.stdout:9/70: truncate d2/fc 167267 0 2024-04-26T10:44:26.178 INFO:tasks.workunit.client.0.smithi049.stdout:9/71: fdatasync d2/f3 0 2024-04-26T10:44:26.178 INFO:tasks.workunit.client.0.smithi049.stdout:9/72: dread d2/da/fb [0,4194304] 0 2024-04-26T10:44:26.178 INFO:tasks.workunit.client.0.smithi049.stdout:9/73: dread d2/da/fb [0,4194304] 0 2024-04-26T10:44:26.178 INFO:tasks.workunit.client.0.smithi049.stdout:9/74: symlink d2/l18 0 2024-04-26T10:44:26.179 INFO:tasks.workunit.client.0.smithi049.stdout:9/75: dwrite d2/f3 [4194304,4194304] 0 2024-04-26T10:44:26.179 INFO:tasks.workunit.client.0.smithi049.stdout:9/76: chown d2/da/df 823705288 1 2024-04-26T10:44:26.179 INFO:tasks.workunit.client.0.smithi049.stdout:9/77: creat d2/f19 x:0 0 0 2024-04-26T10:44:26.179 INFO:tasks.workunit.client.0.smithi049.stdout:9/78: dread d2/da/df/f13 [0,4194304] 0 2024-04-26T10:44:26.179 INFO:tasks.workunit.client.0.smithi049.stdout:9/79: write d2/f3 [5012895,71429] 0 2024-04-26T10:44:26.179 INFO:tasks.workunit.client.0.smithi049.stdout:9/80: truncate d2/da/df/f13 4535709 0 2024-04-26T10:44:26.180 INFO:tasks.workunit.client.0.smithi049.stdout:9/81: write d2/f8 [4213928,99691] 0 2024-04-26T10:44:26.180 INFO:tasks.workunit.client.0.smithi049.stdout:9/82: dread d2/da/df/f13 [0,4194304] 0 2024-04-26T10:44:26.180 INFO:tasks.workunit.client.0.smithi049.stdout:9/83: rmdir d2/da 39 2024-04-26T10:44:26.180 INFO:tasks.workunit.client.0.smithi049.stdout:9/84: chown d2/da/d11/c14 52711079 1 2024-04-26T10:44:26.180 INFO:tasks.workunit.client.0.smithi049.stdout:9/85: truncate d2/da/fd 1327474 0 2024-04-26T10:44:26.180 INFO:tasks.workunit.client.0.smithi049.stdout:9/86: rename d2/da to d2/d1a 0 2024-04-26T10:44:26.180 INFO:tasks.workunit.client.0.smithi049.stdout:9/87: rename d2/d1a/d11 to d2/d1a/d1b 0 2024-04-26T10:44:26.181 INFO:tasks.workunit.client.0.smithi049.stdout:9/88: truncate d2/d1a/df/f13 5096560 0 2024-04-26T10:44:26.181 INFO:tasks.workunit.client.0.smithi049.stdout:9/89: read - d2/d1a/d1b/f16 zero size 2024-04-26T10:44:26.181 INFO:tasks.workunit.client.0.smithi049.stdout:9/90: write d2/f19 [263526,118238] 0 2024-04-26T10:44:26.181 INFO:tasks.workunit.client.0.smithi049.stdout:9/91: rename d2 to d2/d1a/d1b/d1c 22 2024-04-26T10:44:26.181 INFO:tasks.workunit.client.0.smithi049.stdout:9/92: creat d2/d1a/df/f1d x:0 0 0 2024-04-26T10:44:26.181 INFO:tasks.workunit.client.0.smithi049.stdout:9/93: rmdir d2/d1a 39 2024-04-26T10:44:26.182 INFO:tasks.workunit.client.0.smithi049.stdout:9/94: dread d2/f19 [0,4194304] 0 2024-04-26T10:44:26.182 INFO:tasks.workunit.client.0.smithi049.stdout:9/95: truncate d2/f3 587245 0 2024-04-26T10:44:26.182 INFO:tasks.workunit.client.0.smithi049.stdout:9/96: rmdir d2 39 2024-04-26T10:44:26.182 INFO:tasks.workunit.client.0.smithi049.stdout:9/97: write d2/d1a/d1b/f16 [212582,65846] 0 2024-04-26T10:44:26.182 INFO:tasks.workunit.client.0.smithi049.stdout:9/98: unlink d2/d1a/df/f1d 0 2024-04-26T10:44:26.182 INFO:tasks.workunit.client.0.smithi049.stdout:9/99: getdents d2 0 2024-04-26T10:44:26.183 INFO:tasks.workunit.client.0.smithi049.stdout:9/100: mkdir d2/d1a/df/d1e 0 2024-04-26T10:44:26.183 INFO:tasks.workunit.client.0.smithi049.stdout:9/101: dwrite d2/d1a/fd [0,4194304] 0 2024-04-26T10:44:26.183 INFO:tasks.workunit.client.0.smithi049.stdout:9/102: truncate d2/fc 956142 0 2024-04-26T10:44:26.183 INFO:tasks.workunit.client.0.smithi049.stdout:9/103: dread d2/f19 [0,4194304] 0 2024-04-26T10:44:26.183 INFO:tasks.workunit.client.0.smithi049.stdout:9/104: readlink d2/d1a/le 0 2024-04-26T10:44:26.183 INFO:tasks.workunit.client.0.smithi049.stdout:9/105: chown d2/f8 223 1 2024-04-26T10:44:26.184 INFO:tasks.workunit.client.0.smithi049.stdout:9/106: fsync d2/f3 0 2024-04-26T10:44:26.184 INFO:tasks.workunit.client.0.smithi049.stdout:9/107: mkdir d2/d1a/d1b/d1f 0 2024-04-26T10:44:26.185 INFO:tasks.workunit.client.0.smithi049.stdout:9/108: write d2/f19 [211113,95852] 0 2024-04-26T10:44:26.185 INFO:tasks.workunit.client.0.smithi049.stdout:9/109: readlink d2/l18 0 2024-04-26T10:44:26.185 INFO:tasks.workunit.client.0.smithi049.stdout:9/110: rmdir d2/d1a/df/d1e 0 2024-04-26T10:44:26.185 INFO:tasks.workunit.client.0.smithi049.stdout:9/111: dread d2/f8 [0,4194304] 0 2024-04-26T10:44:26.185 INFO:tasks.workunit.client.0.smithi049.stdout:9/112: creat d2/f20 x:0 0 0 2024-04-26T10:44:26.185 INFO:tasks.workunit.client.0.smithi049.stdout:9/113: rename d2/f20 to d2/d1a/f21 0 2024-04-26T10:44:26.185 INFO:tasks.workunit.client.0.smithi049.stdout:9/114: readlink d2/l18 0 2024-04-26T10:44:26.185 INFO:tasks.workunit.client.0.smithi049.stdout:9/115: getdents d2/d1a/d1b/d1f 0 2024-04-26T10:44:26.185 INFO:tasks.workunit.client.0.smithi049.stdout:9/116: chown d2/d1a/fd 5 1 2024-04-26T10:44:26.185 INFO:tasks.workunit.client.0.smithi049.stdout:9/117: symlink d2/d1a/df/l22 0 2024-04-26T10:44:26.185 INFO:tasks.workunit.client.0.smithi049.stdout:9/118: unlink d2/l9 0 2024-04-26T10:44:26.185 INFO:tasks.workunit.client.0.smithi049.stdout:9/119: mknod d2/d1a/d1b/c23 0 2024-04-26T10:44:26.185 INFO:tasks.workunit.client.0.smithi049.stdout:9/120: creat d2/d1a/d1b/f24 x:0 0 0 2024-04-26T10:44:26.186 INFO:tasks.workunit.client.0.smithi049.stdout:9/121: read d2/d1a/fd [3458822,73464] 0 2024-04-26T10:44:26.186 INFO:tasks.workunit.client.0.smithi049.stdout:9/122: mkdir d2/d25 0 2024-04-26T10:44:26.186 INFO:tasks.workunit.client.0.smithi049.stdout:9/123: unlink d2/d1a/d1b/c14 0 2024-04-26T10:44:26.186 INFO:tasks.workunit.client.0.smithi049.stdout:9/124: dwrite d2/d1a/f21 [0,4194304] 0 2024-04-26T10:44:26.186 INFO:tasks.workunit.client.0.smithi049.stdout:9/125: rename d2/d1a/fb to d2/d1a/df/f26 0 2024-04-26T10:44:26.186 INFO:tasks.workunit.client.0.smithi049.stdout:9/126: stat d2/f8 0 2024-04-26T10:44:26.186 INFO:tasks.workunit.client.0.smithi049.stdout:9/127: chown d2/d1a/d1b 3 1 2024-04-26T10:44:26.186 INFO:tasks.workunit.client.0.smithi049.stdout:9/128: write d2/fc [346026,87967] 0 2024-04-26T10:44:26.186 INFO:tasks.workunit.client.0.smithi049.stdout:9/129: fdatasync d2/d1a/d1b/f24 0 2024-04-26T10:44:26.186 INFO:tasks.workunit.client.0.smithi049.stdout:9/130: write d2/d1a/df/f13 [1426646,47498] 0 2024-04-26T10:44:26.186 INFO:tasks.workunit.client.0.smithi049.stdout:9/131: creat d2/d1a/f27 x:0 0 0 2024-04-26T10:44:26.186 INFO:tasks.workunit.client.0.smithi049.stdout:9/132: truncate d2/fc 1820214 0 2024-04-26T10:44:26.186 INFO:tasks.workunit.client.0.smithi049.stdout:9/133: creat d2/d25/f28 x:0 0 0 2024-04-26T10:44:26.187 INFO:tasks.workunit.client.0.smithi049.stdout:9/134: write d2/d1a/d1b/f16 [583897,111606] 0 2024-04-26T10:44:26.187 INFO:tasks.workunit.client.0.smithi049.stdout:9/135: truncate d2/d1a/d1b/f24 776004 0 2024-04-26T10:44:26.187 INFO:tasks.workunit.client.0.smithi049.stdout:9/136: write d2/d1a/f27 [63989,55281] 0 2024-04-26T10:44:26.187 INFO:tasks.workunit.client.0.smithi049.stdout:9/137: dwrite d2/d1a/f21 [0,4194304] 0 2024-04-26T10:44:26.187 INFO:tasks.workunit.client.0.smithi049.stdout:9/138: dread - d2/d25/f28 zero size 2024-04-26T10:44:26.187 INFO:tasks.workunit.client.0.smithi049.stdout:9/139: mknod d2/d1a/df/c29 0 2024-04-26T10:44:26.187 INFO:tasks.workunit.client.0.smithi049.stdout:9/140: stat d2/d1a/df 0 2024-04-26T10:44:26.187 INFO:tasks.workunit.client.0.smithi049.stdout:9/141: dwrite d2/fc [0,4194304] 0 2024-04-26T10:44:26.187 INFO:tasks.workunit.client.0.smithi049.stdout:9/142: write d2/f3 [197208,128302] 0 2024-04-26T10:44:26.240 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:26.238+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:26.249 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:26.249 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:26.250 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:44:26.250 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:26.258 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:26.341 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:26.339+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:26.360 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:26.360 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:26.360 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:26.361 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:26.361 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:26.368 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:26.443 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:26.441+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:26.470 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:26.470 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:26.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:26.470 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:26.470 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.470 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:26.470 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:26.470 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 120.428857525, 2024-04-26T10:44:26.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010122159, 2024-04-26T10:44:26.471 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:26.471 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.471 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:26.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:26.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:26.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:26.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:26.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.472 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:26.472 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039022+0000", 2024-04-26T10:44:26.472 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:26.472 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.472 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.472 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:26.472 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039031+0000", 2024-04-26T10:44:26.472 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4860000000000003e-06 2024-04-26T10:44:26.472 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.472 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.472 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:26.473 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039039+0000", 2024-04-26T10:44:26.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9659999999999996e-06 2024-04-26T10:44:26.473 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.473 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.473 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.473 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039060+0000", 2024-04-26T10:44:26.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1036999999999999e-05 2024-04-26T10:44:26.473 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.473 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.473 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:26.473 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039640+0000", 2024-04-26T10:44:26.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00058003899999999997 2024-04-26T10:44:26.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:26.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039791+0000", 2024-04-26T10:44:26.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000150829 2024-04-26T10:44:26.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:26.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039913+0000", 2024-04-26T10:44:26.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000121684 2024-04-26T10:44:26.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:26.475 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041264+0000", 2024-04-26T10:44:26.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001351636 2024-04-26T10:44:26.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.475 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:26.475 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049090+0000", 2024-04-26T10:44:26.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0078256839999999994 2024-04-26T10:44:26.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.475 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:26.475 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049120+0000", 2024-04-26T10:44:26.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0493000000000001e-05 2024-04-26T10:44:26.476 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.476 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.476 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:26.476 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049144+0000", 2024-04-26T10:44:26.476 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3873999999999999e-05 2024-04-26T10:44:26.476 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.476 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:26.476 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.476 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.476 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.476 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:26.476 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:26.476 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 120.428813198, 2024-04-26T10:44:26.476 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010179568999999999, 2024-04-26T10:44:26.476 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:26.477 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.477 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:26.477 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.477 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:26.477 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:26.477 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.477 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.477 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.477 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:26.477 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:26.477 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.477 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.477 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.477 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:26.478 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039066+0000", 2024-04-26T10:44:26.478 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:26.478 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.478 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.478 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:26.478 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039070+0000", 2024-04-26T10:44:26.478 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7210000000000002e-06 2024-04-26T10:44:26.478 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.478 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.478 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:26.478 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039079+0000", 2024-04-26T10:44:26.478 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:44:26.478 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.478 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.479 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.479 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039085+0000", 2024-04-26T10:44:26.479 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6670000000000001e-06 2024-04-26T10:44:26.479 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.479 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.479 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:26.479 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040179+0000", 2024-04-26T10:44:26.479 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001093583 2024-04-26T10:44:26.479 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.479 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.479 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:26.479 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040256+0000", 2024-04-26T10:44:26.479 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7303000000000002e-05 2024-04-26T10:44:26.479 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.480 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.480 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:26.480 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.040382+0000", 2024-04-26T10:44:26.480 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000125857 2024-04-26T10:44:26.480 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.480 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.480 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:26.480 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.041270+0000", 2024-04-26T10:44:26.480 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00088849600000000001 2024-04-26T10:44:26.480 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.480 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.480 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:26.480 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049181+0000", 2024-04-26T10:44:26.480 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079107799999999992 2024-04-26T10:44:26.480 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.481 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.481 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:26.481 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049214+0000", 2024-04-26T10:44:26.481 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:44:26.481 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.481 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.481 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:26.481 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.049246+0000", 2024-04-26T10:44:26.481 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:44:26.481 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.481 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:26.481 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.481 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.481 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.482 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:44:26.482 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:26.482 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 120.428323384, 2024-04-26T10:44:26.482 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093199749999999994, 2024-04-26T10:44:26.482 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:26.482 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:26.482 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:26.482 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.482 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:26.482 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:26.482 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.482 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.482 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.482 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:26.483 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:26.483 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.483 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.483 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.483 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:26.483 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039556+0000", 2024-04-26T10:44:26.483 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:26.483 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.483 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.483 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:26.483 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039560+0000", 2024-04-26T10:44:26.483 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.578e-06 2024-04-26T10:44:26.483 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.483 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.484 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:26.484 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039568+0000", 2024-04-26T10:44:26.484 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8839999999999994e-06 2024-04-26T10:44:26.484 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.484 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.484 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.484 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039574+0000", 2024-04-26T10:44:26.484 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9089999999999997e-06 2024-04-26T10:44:26.484 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.484 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.484 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:26.484 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039652+0000", 2024-04-26T10:44:26.484 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.7627999999999996e-05 2024-04-26T10:44:26.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.485 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.485 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:26.485 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.039790+0000", 2024-04-26T10:44:26.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013877299999999999 2024-04-26T10:44:26.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.485 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.485 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:26.485 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:42:26.048876+0000", 2024-04-26T10:44:26.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090858229999999998 2024-04-26T10:44:26.485 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.485 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:26.485 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.486 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.486 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(client.4532.0:5 4.10 e52/37 4:09a4c37f:::10000000003.00000001:head v 52'1, mlcod=0'0)", 2024-04-26T10:44:26.486 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:26.486 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 12.992256014000001, 2024-04-26T10:44:26.486 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010754041000000001, 2024-04-26T10:44:26.486 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:26.486 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.486 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:26.486 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.486 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:26.486 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:26.486 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.486 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.487 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.487 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:26.487 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:26.487 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.487 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.487 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.487 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:26.487 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.475624+0000", 2024-04-26T10:44:26.487 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:44:26.487 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.487 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.487 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:26.487 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479849+0000", 2024-04-26T10:44:26.487 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004225716 2024-04-26T10:44:26.487 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.488 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.488 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:26.488 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479868+0000", 2024-04-26T10:44:26.488 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.8666000000000001e-05 2024-04-26T10:44:26.488 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.488 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.488 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.488 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479878+0000", 2024-04-26T10:44:26.488 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.6150000000000003e-06 2024-04-26T10:44:26.488 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.488 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.488 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:26.488 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479935+0000", 2024-04-26T10:44:26.488 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7766999999999998e-05 2024-04-26T10:44:26.489 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.489 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.489 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:26.489 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.479960+0000", 2024-04-26T10:44:26.489 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4343000000000001e-05 2024-04-26T10:44:26.489 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.489 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.489 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:26.489 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.486332+0000", 2024-04-26T10:44:26.489 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0063727610000000002 2024-04-26T10:44:26.489 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.489 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.489 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:26.489 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:13.486378+0000", 2024-04-26T10:44:26.490 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.5334000000000003e-05 2024-04-26T10:44:26.490 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.490 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:26.490 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.490 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.490 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.490 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:80 3.6 e54/37 3:654134d2:::mds0_openfiles.0:head v 54'7, mlcod=49'5)", 2024-04-26T10:44:26.490 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:21.536534+0000", 2024-04-26T10:44:26.490 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 4.9313452699999996, 2024-04-26T10:44:26.490 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.014436087, 2024-04-26T10:44:26.490 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:26.490 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.490 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:26.490 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.491 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:26.491 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.536534+0000", 2024-04-26T10:44:26.491 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.491 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.491 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.491 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:26.491 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.536534+0000", 2024-04-26T10:44:26.491 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.491 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.491 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.491 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:26.491 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.536534+0000", 2024-04-26T10:44:26.491 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:26.491 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.492 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.492 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:26.492 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.536999+0000", 2024-04-26T10:44:26.492 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00046557800000000002 2024-04-26T10:44:26.492 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.492 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.492 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:26.492 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.537008+0000", 2024-04-26T10:44:26.492 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.0990000000000005e-06 2024-04-26T10:44:26.492 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.492 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.492 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.492 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.537013+0000", 2024-04-26T10:44:26.492 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4569999999999998e-06 2024-04-26T10:44:26.492 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.493 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.493 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:26.493 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.537050+0000", 2024-04-26T10:44:26.493 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7191999999999999e-05 2024-04-26T10:44:26.493 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.493 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.493 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:26.493 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.537064+0000", 2024-04-26T10:44:26.493 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.3930999999999999e-05 2024-04-26T10:44:26.493 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.493 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.493 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:26.493 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.550933+0000", 2024-04-26T10:44:26.493 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013868660999999999 2024-04-26T10:44:26.494 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.494 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.494 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:26.494 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:21.550971+0000", 2024-04-26T10:44:26.494 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7824000000000002e-05 2024-04-26T10:44:26.494 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.494 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:26.494 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.494 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.494 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.494 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:10645 4.39 4:9d97a463:::100000030ab.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:44:26.494 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:25.914613+0000", 2024-04-26T10:44:26.494 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.55326648300000003, 2024-04-26T10:44:26.494 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010693754, 2024-04-26T10:44:26.495 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:26.495 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.495 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:26.495 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:26.495 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:26.495 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 10645 2024-04-26T10:44:26.495 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.495 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:26.495 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.495 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:26.495 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.914613+0000", 2024-04-26T10:44:26.495 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.495 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.495 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.495 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:26.496 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.914613+0000", 2024-04-26T10:44:26.496 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.496 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.496 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.496 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:26.496 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.914612+0000", 2024-04-26T10:44:26.496 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:26.496 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.496 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.496 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:26.496 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.919156+0000", 2024-04-26T10:44:26.496 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0045438190000000002 2024-04-26T10:44:26.497 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.497 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.497 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:26.497 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.919168+0000", 2024-04-26T10:44:26.497 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1369000000000001e-05 2024-04-26T10:44:26.497 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.497 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.497 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.497 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.919173+0000", 2024-04-26T10:44:26.497 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.164e-06 2024-04-26T10:44:26.497 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.497 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.497 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:26.497 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.919206+0000", 2024-04-26T10:44:26.498 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2943e-05 2024-04-26T10:44:26.498 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.498 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.498 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:26.498 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.919267+0000", 2024-04-26T10:44:26.498 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.1167999999999994e-05 2024-04-26T10:44:26.498 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.498 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.498 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:26.498 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.925195+0000", 2024-04-26T10:44:26.498 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059275969999999997 2024-04-26T10:44:26.498 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.498 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.499 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:26.499 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.925248+0000", 2024-04-26T10:44:26.499 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3708000000000001e-05 2024-04-26T10:44:26.499 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.499 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.499 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:26.499 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.925307+0000", 2024-04-26T10:44:26.499 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8746000000000003e-05 2024-04-26T10:44:26.499 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.499 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:26.499 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.499 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.499 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.499 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:10646 4.17 4:e8010137:::100000030b0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:44:26.499 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:25.919181+0000", 2024-04-26T10:44:26.500 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.54869851400000003, 2024-04-26T10:44:26.500 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.011221409, 2024-04-26T10:44:26.500 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:26.500 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.500 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:26.500 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:26.500 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:26.500 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 10646 2024-04-26T10:44:26.500 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.500 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:26.500 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.500 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:26.500 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.919181+0000", 2024-04-26T10:44:26.501 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.501 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.501 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.501 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:26.501 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.919181+0000", 2024-04-26T10:44:26.501 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.501 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.501 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.501 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:26.501 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.919181+0000", 2024-04-26T10:44:26.501 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:26.501 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.501 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.501 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:26.502 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.923990+0000", 2024-04-26T10:44:26.502 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0048096229999999998 2024-04-26T10:44:26.502 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.502 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.502 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:26.502 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.924003+0000", 2024-04-26T10:44:26.502 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2993000000000001e-05 2024-04-26T10:44:26.502 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.502 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.502 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.502 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.924010+0000", 2024-04-26T10:44:26.502 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.0160000000000003e-06 2024-04-26T10:44:26.502 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.502 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.503 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:26.503 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.924048+0000", 2024-04-26T10:44:26.503 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7616e-05 2024-04-26T10:44:26.503 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.503 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.503 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:26.504 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.924155+0000", 2024-04-26T10:44:26.504 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000106983 2024-04-26T10:44:26.504 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.504 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.504 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:26.504 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.930329+0000", 2024-04-26T10:44:26.504 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0061738640000000003 2024-04-26T10:44:26.504 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.504 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.504 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:26.504 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.930359+0000", 2024-04-26T10:44:26.504 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0337000000000001e-05 2024-04-26T10:44:26.504 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.505 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.505 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:26.505 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.930403+0000", 2024-04-26T10:44:26.505 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3438e-05 2024-04-26T10:44:26.505 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.505 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:26.505 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.505 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.505 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.505 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:10648 4.30 4:0ce23d6b:::100000030b9.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:44:26.505 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:25.924051+0000", 2024-04-26T10:44:26.505 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.543828537, 2024-04-26T10:44:26.505 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.012968370999999999, 2024-04-26T10:44:26.505 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:26.505 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.506 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:26.506 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:26.506 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:26.506 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 10648 2024-04-26T10:44:26.506 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.506 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:26.506 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.506 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:26.506 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.924051+0000", 2024-04-26T10:44:26.506 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.506 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.506 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.506 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:26.506 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.924051+0000", 2024-04-26T10:44:26.507 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.507 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.507 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.507 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:26.507 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.924051+0000", 2024-04-26T10:44:26.507 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:26.507 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.507 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.507 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:26.507 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.931634+0000", 2024-04-26T10:44:26.507 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0075829540000000003 2024-04-26T10:44:26.507 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.507 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.507 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:26.507 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.931646+0000", 2024-04-26T10:44:26.508 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2394e-05 2024-04-26T10:44:26.508 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.508 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.508 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.508 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.931653+0000", 2024-04-26T10:44:26.508 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.9099999999999999e-06 2024-04-26T10:44:26.508 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.508 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.508 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:26.508 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.931693+0000", 2024-04-26T10:44:26.508 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9455000000000001e-05 2024-04-26T10:44:26.508 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.508 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.508 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:26.509 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.931801+0000", 2024-04-26T10:44:26.509 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000108322 2024-04-26T10:44:26.509 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.509 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.509 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:26.509 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.936952+0000", 2024-04-26T10:44:26.509 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.005150979 2024-04-26T10:44:26.509 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.509 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.509 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:26.509 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.936981+0000", 2024-04-26T10:44:26.509 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8782999999999999e-05 2024-04-26T10:44:26.509 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.509 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.510 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:26.510 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.937020+0000", 2024-04-26T10:44:26.510 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8890000000000002e-05 2024-04-26T10:44:26.510 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.510 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:26.510 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.510 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.510 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.510 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:10650 4.39 4:9d97a463:::100000030ab.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:44:26.510 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:25.931665+0000", 2024-04-26T10:44:26.510 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.53621475399999996, 2024-04-26T10:44:26.510 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.01615138, 2024-04-26T10:44:26.510 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:26.510 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.511 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:26.511 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:26.511 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:26.511 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 10650 2024-04-26T10:44:26.511 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.511 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:26.511 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.511 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:26.511 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.931665+0000", 2024-04-26T10:44:26.511 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.511 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.511 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.511 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:26.511 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.931665+0000", 2024-04-26T10:44:26.511 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.512 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.512 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:26.512 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.931664+0000", 2024-04-26T10:44:26.512 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:26.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.512 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.512 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:26.512 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.940750+0000", 2024-04-26T10:44:26.512 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090856500000000007 2024-04-26T10:44:26.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.512 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.512 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:26.512 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.940777+0000", 2024-04-26T10:44:26.513 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7044999999999999e-05 2024-04-26T10:44:26.513 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.513 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.513 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.513 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.940790+0000", 2024-04-26T10:44:26.513 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2918000000000001e-05 2024-04-26T10:44:26.513 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.513 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.513 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:26.513 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.940852+0000", 2024-04-26T10:44:26.513 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2774999999999994e-05 2024-04-26T10:44:26.513 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.513 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.513 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:26.514 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.940927+0000", 2024-04-26T10:44:26.514 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4988999999999996e-05 2024-04-26T10:44:26.514 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.514 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.514 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:26.514 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.947736+0000", 2024-04-26T10:44:26.514 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068082910000000002 2024-04-26T10:44:26.514 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.514 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.514 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:26.514 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.947771+0000", 2024-04-26T10:44:26.514 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4888000000000002e-05 2024-04-26T10:44:26.514 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.514 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.515 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:26.515 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.947816+0000", 2024-04-26T10:44:26.515 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.5744000000000001e-05 2024-04-26T10:44:26.515 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.515 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:26.515 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.515 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.515 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.515 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(client.4532.0:10649 4.1c e56/37 4:38c4c24e:::100000030bb.00000000:head v 56'154, mlcod=56'152)", 2024-04-26T10:44:26.515 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:25.932515+0000", 2024-04-26T10:44:26.515 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.53536429600000002, 2024-04-26T10:44:26.515 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010626563, 2024-04-26T10:44:26.515 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:26.515 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.516 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:26.516 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.516 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:26.516 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.932515+0000", 2024-04-26T10:44:26.516 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.516 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.516 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.516 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:26.516 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.932515+0000", 2024-04-26T10:44:26.516 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.516 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.516 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.516 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:26.516 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.932514+0000", 2024-04-26T10:44:26.516 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:26.517 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.517 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.517 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:26.517 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.937297+0000", 2024-04-26T10:44:26.517 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0047831560000000002 2024-04-26T10:44:26.517 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.517 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.517 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:26.517 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.937308+0000", 2024-04-26T10:44:26.517 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0349e-05 2024-04-26T10:44:26.517 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.517 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.517 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.517 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.937314+0000", 2024-04-26T10:44:26.518 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3790000000000003e-06 2024-04-26T10:44:26.518 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.518 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.518 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:26.518 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.937344+0000", 2024-04-26T10:44:26.518 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0161000000000001e-05 2024-04-26T10:44:26.518 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.518 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.518 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:26.518 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.937371+0000", 2024-04-26T10:44:26.518 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6633000000000001e-05 2024-04-26T10:44:26.518 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.518 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.518 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:26.519 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.943103+0000", 2024-04-26T10:44:26.519 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0057319399999999996 2024-04-26T10:44:26.519 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.519 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.519 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:26.519 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.943142+0000", 2024-04-26T10:44:26.519 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9307999999999997e-05 2024-04-26T10:44:26.519 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.519 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:26.519 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.519 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.519 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.519 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:10651 4.17 4:e8010137:::100000030b0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:44:26.519 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:25.940810+0000", 2024-04-26T10:44:26.519 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.52707000999999998, 2024-04-26T10:44:26.520 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.015433064999999999, 2024-04-26T10:44:26.520 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:26.520 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.520 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:26.520 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:26.520 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:26.520 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 10651 2024-04-26T10:44:26.520 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.520 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:26.520 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.520 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:26.520 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.940810+0000", 2024-04-26T10:44:26.520 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.520 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.521 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.521 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:26.521 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.940810+0000", 2024-04-26T10:44:26.521 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.521 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.521 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.521 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:26.521 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.940808+0000", 2024-04-26T10:44:26.521 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:26.521 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.521 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.521 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:26.521 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.948431+0000", 2024-04-26T10:44:26.521 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0076227159999999999 2024-04-26T10:44:26.522 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.522 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.522 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:26.522 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.948442+0000", 2024-04-26T10:44:26.522 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1807000000000001e-05 2024-04-26T10:44:26.522 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.522 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.522 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.522 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.948448+0000", 2024-04-26T10:44:26.522 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0140000000000004e-06 2024-04-26T10:44:26.522 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.522 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.523 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:26.523 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.948484+0000", 2024-04-26T10:44:26.523 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5578999999999999e-05 2024-04-26T10:44:26.523 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.523 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.523 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:26.523 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.948549+0000", 2024-04-26T10:44:26.523 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4675e-05 2024-04-26T10:44:26.523 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.523 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.523 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:26.523 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.956116+0000", 2024-04-26T10:44:26.523 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0075675919999999997 2024-04-26T10:44:26.523 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.524 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.524 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:26.524 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.956163+0000", 2024-04-26T10:44:26.524 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6230000000000003e-05 2024-04-26T10:44:26.524 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.524 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.524 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:26.524 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.956243+0000", 2024-04-26T10:44:26.524 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.0204999999999995e-05 2024-04-26T10:44:26.524 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.524 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:26.524 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.524 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.524 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.524 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:10654 4.17 4:e8010137:::100000030b0.00000000:head [write 893575~84154] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:44:26.525 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:25.948522+0000", 2024-04-26T10:44:26.525 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.51935771200000003, 2024-04-26T10:44:26.525 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010571739, 2024-04-26T10:44:26.525 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:26.525 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.525 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:26.525 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:26.525 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:26.525 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 10654 2024-04-26T10:44:26.525 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.525 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:26.525 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.525 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:26.525 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.948522+0000", 2024-04-26T10:44:26.526 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.526 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.526 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.526 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:26.526 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.948522+0000", 2024-04-26T10:44:26.526 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.526 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.526 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.526 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:26.526 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.948522+0000", 2024-04-26T10:44:26.526 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:26.526 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.526 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.526 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:26.527 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.948553+0000", 2024-04-26T10:44:26.527 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1492999999999998e-05 2024-04-26T10:44:26.527 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.527 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.527 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:26.527 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.948559+0000", 2024-04-26T10:44:26.527 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.4190000000000001e-06 2024-04-26T10:44:26.527 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.527 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.527 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.527 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.948561+0000", 2024-04-26T10:44:26.527 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.723e-06 2024-04-26T10:44:26.527 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.527 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.528 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:26.528 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.954560+0000", 2024-04-26T10:44:26.528 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059982400000000002 2024-04-26T10:44:26.528 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.528 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.528 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:26.528 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.954618+0000", 2024-04-26T10:44:26.528 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8909999999999997e-05 2024-04-26T10:44:26.528 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.528 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.528 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:26.528 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.958903+0000", 2024-04-26T10:44:26.528 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0042844470000000003 2024-04-26T10:44:26.528 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.529 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.529 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:26.529 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.958973+0000", 2024-04-26T10:44:26.529 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.0254999999999997e-05 2024-04-26T10:44:26.529 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.529 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.529 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:26.529 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.959094+0000", 2024-04-26T10:44:26.529 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120512 2024-04-26T10:44:26.529 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.529 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:26.529 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.529 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.529 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.530 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:10660 4.17 4:e8010137:::100000030b0.00000000:head [write 0~3407872] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:44:26.530 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:25.948564+0000", 2024-04-26T10:44:26.530 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.51931578, 2024-04-26T10:44:26.530 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.012607774, 2024-04-26T10:44:26.530 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:26.530 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.530 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:26.530 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:26.530 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:26.530 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 10660 2024-04-26T10:44:26.530 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.530 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:26.530 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.530 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:26.531 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.948564+0000", 2024-04-26T10:44:26.531 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.531 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.531 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.531 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:26.531 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.948564+0000", 2024-04-26T10:44:26.531 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.531 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.531 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.531 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:26.531 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.948564+0000", 2024-04-26T10:44:26.531 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:26.531 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.531 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.532 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:26.532 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.955820+0000", 2024-04-26T10:44:26.532 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0072559479999999999 2024-04-26T10:44:26.532 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.532 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.532 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:26.532 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.955831+0000", 2024-04-26T10:44:26.532 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.133e-05 2024-04-26T10:44:26.533 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.533 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.533 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.533 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.955837+0000", 2024-04-26T10:44:26.533 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4899999999999997e-06 2024-04-26T10:44:26.533 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.533 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.533 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:26.533 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.956496+0000", 2024-04-26T10:44:26.533 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00065881999999999996 2024-04-26T10:44:26.533 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.533 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.533 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:26.533 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.956576+0000", 2024-04-26T10:44:26.534 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9906000000000004e-05 2024-04-26T10:44:26.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.534 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.534 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:26.534 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.961003+0000", 2024-04-26T10:44:26.534 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0044268830000000004 2024-04-26T10:44:26.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.534 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.534 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:26.534 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.961064+0000", 2024-04-26T10:44:26.534 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0724999999999999e-05 2024-04-26T10:44:26.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.534 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.535 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:26.535 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.961172+0000", 2024-04-26T10:44:26.535 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00010795500000000001 2024-04-26T10:44:26.535 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.535 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:26.535 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.535 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.535 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(client.4532.0:10662 4.1e e56/37 4:78e5e06c:::100000030c5.00000000:head v 56'167, mlcod=56'165)", 2024-04-26T10:44:26.535 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:25.957398+0000", 2024-04-26T10:44:26.535 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.51048140600000003, 2024-04-26T10:44:26.535 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.011788422999999999, 2024-04-26T10:44:26.535 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:26.536 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.536 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:26.536 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.536 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:26.536 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.957398+0000", 2024-04-26T10:44:26.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.536 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.536 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:26.536 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.957398+0000", 2024-04-26T10:44:26.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.536 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.536 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:26.537 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.957398+0000", 2024-04-26T10:44:26.537 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:26.537 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.537 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.537 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:26.537 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.961521+0000", 2024-04-26T10:44:26.537 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0041233329999999999 2024-04-26T10:44:26.537 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.537 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.537 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:26.537 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.961530+0000", 2024-04-26T10:44:26.537 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.183e-06 2024-04-26T10:44:26.537 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.538 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.538 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.538 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.961535+0000", 2024-04-26T10:44:26.538 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9069999999999998e-06 2024-04-26T10:44:26.538 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.538 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.538 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:26.538 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.961568+0000", 2024-04-26T10:44:26.538 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3222999999999997e-05 2024-04-26T10:44:26.538 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.538 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.538 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:26.538 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.961593+0000", 2024-04-26T10:44:26.539 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4496000000000001e-05 2024-04-26T10:44:26.539 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.539 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.539 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:26.539 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.969160+0000", 2024-04-26T10:44:26.539 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0075675400000000002 2024-04-26T10:44:26.539 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.539 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.539 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:26.539 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.969187+0000", 2024-04-26T10:44:26.539 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6475e-05 2024-04-26T10:44:26.539 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.539 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:26.539 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.540 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.540 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.540 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:10673 4.17 4:e8010137:::100000030b0.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:44:26.540 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:25.973306+0000", 2024-04-26T10:44:26.540 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.494574085, 2024-04-26T10:44:26.540 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013388861, 2024-04-26T10:44:26.540 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:26.540 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.540 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:26.540 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:26.540 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:26.540 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 10673 2024-04-26T10:44:26.540 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.541 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:26.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.541 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:26.541 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.973306+0000", 2024-04-26T10:44:26.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.541 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:26.541 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.973306+0000", 2024-04-26T10:44:26.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.541 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:26.542 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.973305+0000", 2024-04-26T10:44:26.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:26.542 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.542 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:26.542 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.981351+0000", 2024-04-26T10:44:26.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0080466770000000003 2024-04-26T10:44:26.542 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.542 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:26.542 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.981361+0000", 2024-04-26T10:44:26.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.1849999999999993e-06 2024-04-26T10:44:26.542 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.543 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.543 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.981365+0000", 2024-04-26T10:44:26.543 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3000000000000003e-06 2024-04-26T10:44:26.543 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.543 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.543 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:26.543 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.981406+0000", 2024-04-26T10:44:26.543 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0873e-05 2024-04-26T10:44:26.543 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.543 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.543 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:26.543 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.981467+0000", 2024-04-26T10:44:26.543 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.1543000000000004e-05 2024-04-26T10:44:26.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:26.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.986610+0000", 2024-04-26T10:44:26.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0051423659999999998 2024-04-26T10:44:26.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:26.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.986641+0000", 2024-04-26T10:44:26.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1405000000000002e-05 2024-04-26T10:44:26.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:26.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:25.986694+0000", 2024-04-26T10:44:26.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3389e-05 2024-04-26T10:44:26.545 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.545 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:26.545 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.545 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.545 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(client.4532.0:10686 4.12 e56/30 4:4b7d712e:::100000030d9.00000000:head v 56'171, mlcod=56'169)", 2024-04-26T10:44:26.545 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.008382+0000", 2024-04-26T10:44:26.545 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.45949757400000002, 2024-04-26T10:44:26.545 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0089588310000000004, 2024-04-26T10:44:26.545 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:26.545 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.545 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:26.545 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.545 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:26.546 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.008382+0000", 2024-04-26T10:44:26.546 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.546 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:26.546 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.008382+0000", 2024-04-26T10:44:26.546 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.546 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:26.546 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.008381+0000", 2024-04-26T10:44:26.546 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:26.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:26.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.012324+0000", 2024-04-26T10:44:26.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0039424409999999997 2024-04-26T10:44:26.547 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:26.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.012333+0000", 2024-04-26T10:44:26.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.1630000000000002e-06 2024-04-26T10:44:26.547 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.548 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.548 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.012339+0000", 2024-04-26T10:44:26.548 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.6180000000000003e-06 2024-04-26T10:44:26.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.548 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.548 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:26.548 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.012366+0000", 2024-04-26T10:44:26.548 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7591000000000001e-05 2024-04-26T10:44:26.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.548 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.548 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:26.548 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.012382+0000", 2024-04-26T10:44:26.548 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6053e-05 2024-04-26T10:44:26.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.548 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.549 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:26.549 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.017310+0000", 2024-04-26T10:44:26.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0049273959999999997 2024-04-26T10:44:26.549 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.549 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:26.549 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.017341+0000", 2024-04-26T10:44:26.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1241000000000001e-05 2024-04-26T10:44:26.549 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.549 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:26.549 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.549 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.549 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(client.4532.0:10687 4.21 e56/37 4:84251430:::100000030be.00000000:head v 56'184, mlcod=56'182)", 2024-04-26T10:44:26.550 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.014181+0000", 2024-04-26T10:44:26.550 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.45369885999999998, 2024-04-26T10:44:26.550 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093686810000000002, 2024-04-26T10:44:26.550 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:26.550 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.550 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:26.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:26.550 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.014181+0000", 2024-04-26T10:44:26.550 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.550 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:26.551 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.014181+0000", 2024-04-26T10:44:26.551 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.551 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.551 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.551 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:26.551 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.014180+0000", 2024-04-26T10:44:26.551 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:26.551 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.551 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.551 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:26.551 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.018162+0000", 2024-04-26T10:44:26.551 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0039822130000000001 2024-04-26T10:44:26.551 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.551 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.551 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:26.552 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.018172+0000", 2024-04-26T10:44:26.552 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.577e-06 2024-04-26T10:44:26.552 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.552 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.552 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.552 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.018177+0000", 2024-04-26T10:44:26.552 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8509999999999998e-06 2024-04-26T10:44:26.552 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.552 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.552 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:26.552 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.018213+0000", 2024-04-26T10:44:26.552 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6358e-05 2024-04-26T10:44:26.552 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.552 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.553 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:26.553 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.018234+0000", 2024-04-26T10:44:26.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1081e-05 2024-04-26T10:44:26.553 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.553 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.553 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:26.553 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.023523+0000", 2024-04-26T10:44:26.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052886809999999999 2024-04-26T10:44:26.553 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.553 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.553 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:26.553 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.023550+0000", 2024-04-26T10:44:26.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6871000000000001e-05 2024-04-26T10:44:26.553 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.554 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:26.554 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.554 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.554 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.554 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(client.4532.0:10701 4.3e e56/37 4:7eb070ca:::100000030e0.00000000:head v 56'167, mlcod=56'165)", 2024-04-26T10:44:26.554 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.048327+0000", 2024-04-26T10:44:26.554 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.41955276899999999, 2024-04-26T10:44:26.554 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092199039999999993, 2024-04-26T10:44:26.554 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:26.554 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.554 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:26.554 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.554 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:26.554 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.048327+0000", 2024-04-26T10:44:26.555 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.555 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:26.555 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.048327+0000", 2024-04-26T10:44:26.555 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.555 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:26.555 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.048326+0000", 2024-04-26T10:44:26.555 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:26.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:26.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.052371+0000", 2024-04-26T10:44:26.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0040441280000000001 2024-04-26T10:44:26.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.556 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:26.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.052379+0000", 2024-04-26T10:44:26.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7360000000000007e-06 2024-04-26T10:44:26.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.556 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.052403+0000", 2024-04-26T10:44:26.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3708000000000001e-05 2024-04-26T10:44:26.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.557 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.557 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:26.557 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.052440+0000", 2024-04-26T10:44:26.557 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7413000000000002e-05 2024-04-26T10:44:26.557 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.557 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.557 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:26.557 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.052465+0000", 2024-04-26T10:44:26.557 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4530000000000001e-05 2024-04-26T10:44:26.557 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.557 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.557 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:26.557 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.057518+0000", 2024-04-26T10:44:26.557 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0050529770000000002 2024-04-26T10:44:26.558 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.558 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:26.558 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.057547+0000", 2024-04-26T10:44:26.558 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8864999999999999e-05 2024-04-26T10:44:26.558 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.558 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:26.558 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.558 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.558 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(client.4532.0:10710 4.9 e56/37 4:91604622:::100000030e5.00000000:head v 56'190, mlcod=56'188)", 2024-04-26T10:44:26.558 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.068536+0000", 2024-04-26T10:44:26.558 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.39934376300000002, 2024-04-26T10:44:26.558 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090517280000000002, 2024-04-26T10:44:26.559 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:26.559 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.559 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:26.559 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.559 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:26.559 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.068536+0000", 2024-04-26T10:44:26.559 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.559 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.559 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.559 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:26.559 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.068536+0000", 2024-04-26T10:44:26.559 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.559 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.559 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.560 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:26.560 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.068536+0000", 2024-04-26T10:44:26.560 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:26.560 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.560 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.560 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:26.560 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.072342+0000", 2024-04-26T10:44:26.560 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0038062859999999999 2024-04-26T10:44:26.560 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.560 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.560 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:26.560 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.072352+0000", 2024-04-26T10:44:26.560 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0006999999999999e-05 2024-04-26T10:44:26.560 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.561 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.561 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.561 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.072357+0000", 2024-04-26T10:44:26.561 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9010000000000002e-06 2024-04-26T10:44:26.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.561 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.561 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:26.561 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.072397+0000", 2024-04-26T10:44:26.561 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9903000000000001e-05 2024-04-26T10:44:26.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.561 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.561 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:26.561 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.072421+0000", 2024-04-26T10:44:26.561 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3818000000000001e-05 2024-04-26T10:44:26.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.562 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.562 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:26.562 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.077552+0000", 2024-04-26T10:44:26.562 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0051310690000000003 2024-04-26T10:44:26.562 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.562 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.562 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:26.562 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.077588+0000", 2024-04-26T10:44:26.562 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6022999999999997e-05 2024-04-26T10:44:26.562 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.562 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:26.562 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.562 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.563 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.563 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:10735 4.39 4:9d207bac:::100000030d8.00000000:head [write 0~4194304 [3@167267]] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:44:26.563 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.151140+0000", 2024-04-26T10:44:26.563 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.31673944599999998, 2024-04-26T10:44:26.563 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00935275, 2024-04-26T10:44:26.563 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:26.563 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:26.563 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:26.563 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:26.563 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:26.563 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 10735 2024-04-26T10:44:26.563 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.563 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:26.563 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.563 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:26.564 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.151140+0000", 2024-04-26T10:44:26.564 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.564 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.564 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:26.564 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.151140+0000", 2024-04-26T10:44:26.564 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:26.564 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.564 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:26.564 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.151139+0000", 2024-04-26T10:44:26.564 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:26.564 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.565 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:26.565 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.155597+0000", 2024-04-26T10:44:26.565 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0044580399999999999 2024-04-26T10:44:26.565 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.565 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.565 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:26.565 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.155615+0000", 2024-04-26T10:44:26.565 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.8117999999999998e-05 2024-04-26T10:44:26.565 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.565 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.565 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:26.565 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.155623+0000", 2024-04-26T10:44:26.565 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4120000000000004e-06 2024-04-26T10:44:26.565 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.565 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.566 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:26.566 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.155672+0000", 2024-04-26T10:44:26.566 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9499000000000002e-05 2024-04-26T10:44:26.566 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.566 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.566 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:26.566 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.155737+0000", 2024-04-26T10:44:26.566 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4542000000000006e-05 2024-04-26T10:44:26.566 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.566 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.566 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:26.566 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.160328+0000", 2024-04-26T10:44:26.566 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0045906779999999999 2024-04-26T10:44:26.566 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.567 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.567 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:26.567 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.160391+0000", 2024-04-26T10:44:26.567 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3237000000000005e-05 2024-04-26T10:44:26.567 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:26.567 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:26.567 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:26.567 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.160493+0000", 2024-04-26T10:44:26.567 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000102132 2024-04-26T10:44:26.567 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.567 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:26.567 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.567 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:26.567 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:26.568 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:26.568 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:44:26.569 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~70s 2024-04-26T10:44:26.570 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:26.568+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:26.570 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:26.670 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:26.668+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:26.679 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:26.679 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:26.679 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:44:26.679 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:26.688 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:26.707 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:26.707 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:26.708 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:26.725 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:26.726 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:26.728 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:26.729 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:26.772 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:26.770+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:26.833 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:26.834 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:26.843 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:26.872 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:26.871+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:26.974 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:26.972+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:26.989 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:26.989 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:26.997 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:27.075 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:27.074+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:27.104 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:27.104 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:27.113 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:27.177 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:27.175+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:27.214 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:27.214 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:27.223 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:27.278 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:27.276+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:27.324 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:27.324 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:27.333 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:27.369 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:44:27.378 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:27.377+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:27.446 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:27.446 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:27.454 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:27.480 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:27.478+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:27.493 INFO:tasks.workunit.client.0.smithi049.stdout:0/11: sync 2024-04-26T10:44:27.493 INFO:tasks.workunit.client.0.smithi049.stdout:0/12: write f1 [1546407,120383] 0 2024-04-26T10:44:27.494 INFO:tasks.workunit.client.0.smithi049.stdout:0/13: write f2 [363547,97099] 0 2024-04-26T10:44:27.494 INFO:tasks.workunit.client.0.smithi049.stdout:0/14: creat f3 x:0 0 0 2024-04-26T10:44:27.495 INFO:tasks.workunit.client.0.smithi049.stdout:0/15: mknod c4 0 2024-04-26T10:44:27.500 INFO:tasks.workunit.client.0.smithi049.stdout:0/16: dwrite f1 [0,4194304] 0 2024-04-26T10:44:27.501 INFO:tasks.workunit.client.0.smithi049.stdout:0/17: symlink l5 0 2024-04-26T10:44:27.502 INFO:tasks.workunit.client.0.smithi049.stdout:0/18: symlink l6 0 2024-04-26T10:44:27.505 INFO:tasks.workunit.client.0.smithi049.stdout:0/19: symlink l7 0 2024-04-26T10:44:27.505 INFO:tasks.workunit.client.0.smithi049.stdout:0/20: dread - f3 zero size 2024-04-26T10:44:27.505 INFO:tasks.workunit.client.0.smithi049.stdout:0/21: mkdir d8 0 2024-04-26T10:44:27.505 INFO:tasks.workunit.client.0.smithi049.stdout:0/22: dread - f3 zero size 2024-04-26T10:44:27.560 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:27.560 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:27.569 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:27.581 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:27.579+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:27.675 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:27.675 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:27.681 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:27.680+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:27.684 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:27.711 INFO:tasks.workunit.client.0.smithi049.stdout:4/66: sync 2024-04-26T10:44:27.711 INFO:tasks.workunit.client.0.smithi049.stdout:2/26: sync 2024-04-26T10:44:27.711 INFO:tasks.workunit.client.0.smithi049.stdout:3/14: sync 2024-04-26T10:44:27.711 INFO:tasks.workunit.client.0.smithi049.stdout:5/22: sync 2024-04-26T10:44:27.711 INFO:tasks.workunit.client.0.smithi049.stdout:9/143: sync 2024-04-26T10:44:27.711 INFO:tasks.workunit.client.0.smithi049.stdout:8/31: sync 2024-04-26T10:44:27.711 INFO:tasks.workunit.client.0.smithi049.stdout:1/26: sync 2024-04-26T10:44:27.711 INFO:tasks.workunit.client.0.smithi049.stdout:7/30: sync 2024-04-26T10:44:27.711 INFO:tasks.workunit.client.0.smithi049.stdout:6/20: sync 2024-04-26T10:44:27.711 INFO:tasks.workunit.client.0.smithi049.stdout:7/31: fsync d2/f6 0 2024-04-26T10:44:27.712 INFO:tasks.workunit.client.0.smithi049.stdout:6/21: creat f5 x:0 0 0 2024-04-26T10:44:27.713 INFO:tasks.workunit.client.0.smithi049.stdout:5/23: chown l2 10430 1 2024-04-26T10:44:27.713 INFO:tasks.workunit.client.0.smithi049.stdout:3/15: rename f0 to f1 0 2024-04-26T10:44:27.713 INFO:tasks.workunit.client.0.smithi049.stdout:4/67: write de/ff [238591,35516] 0 2024-04-26T10:44:27.713 INFO:tasks.workunit.client.0.smithi049.stdout:6/22: fsync f4 0 2024-04-26T10:44:27.713 INFO:tasks.workunit.client.0.smithi049.stdout:1/27: chown l2 4 1 2024-04-26T10:44:27.713 INFO:tasks.workunit.client.0.smithi049.stdout:2/27: link f3 f4 0 2024-04-26T10:44:27.713 INFO:tasks.workunit.client.0.smithi049.stdout:8/32: fdatasync d2/fc 0 2024-04-26T10:44:27.713 INFO:tasks.workunit.client.0.smithi049.stdout:7/32: creat d2/fa x:0 0 0 2024-04-26T10:44:27.713 INFO:tasks.workunit.client.0.smithi049.stdout:2/28: chown f0 15 1 2024-04-26T10:44:27.714 INFO:tasks.workunit.client.0.smithi049.stdout:7/33: fsync d2/f6 0 2024-04-26T10:44:27.714 INFO:tasks.workunit.client.0.smithi049.stdout:4/68: unlink de/f11 0 2024-04-26T10:44:27.715 INFO:tasks.workunit.client.0.smithi049.stdout:2/29: creat f5 x:0 0 0 2024-04-26T10:44:27.715 INFO:tasks.workunit.client.0.smithi049.stdout:7/34: read d2/f6 [1260640,102004] 0 2024-04-26T10:44:27.715 INFO:tasks.workunit.client.0.smithi049.stdout:4/69: fsync f1 0 2024-04-26T10:44:27.718 INFO:tasks.workunit.client.0.smithi049.stdout:7/35: rename l1 to d2/d3/lb 0 2024-04-26T10:44:27.718 INFO:tasks.workunit.client.0.smithi049.stdout:5/24: dread f3 [0,4194304] 0 2024-04-26T10:44:27.719 INFO:tasks.workunit.client.0.smithi049.stdout:4/70: link la de/l13 0 2024-04-26T10:44:27.721 INFO:tasks.workunit.client.0.smithi049.stdout:1/28: dread f0 [0,4194304] 0 2024-04-26T10:44:27.722 INFO:tasks.workunit.client.0.smithi049.stdout:6/23: dwrite f0 [0,4194304] 0 2024-04-26T10:44:27.722 INFO:tasks.workunit.client.0.smithi049.stdout:8/33: dwrite d2/fe [0,4194304] 0 2024-04-26T10:44:27.725 INFO:tasks.workunit.client.0.smithi049.stdout:3/16: dwrite f1 [0,4194304] 0 2024-04-26T10:44:27.725 INFO:tasks.workunit.client.0.smithi049.stdout:6/24: write f0 [3402231,14103] 0 2024-04-26T10:44:27.727 INFO:tasks.workunit.client.0.smithi049.stdout:2/30: dwrite f3 [0,4194304] 0 2024-04-26T10:44:27.730 INFO:tasks.workunit.client.0.smithi049.stdout:4/71: dwrite fc [0,4194304] 0 2024-04-26T10:44:27.734 INFO:tasks.workunit.client.0.smithi049.stdout:7/36: creat d2/fc x:0 0 0 2024-04-26T10:44:27.735 INFO:tasks.workunit.client.0.smithi049.stdout:3/17: dwrite f1 [0,4194304] 0 2024-04-26T10:44:27.735 INFO:tasks.workunit.client.0.smithi049.stdout:5/25: creat f4 x:0 0 0 2024-04-26T10:44:27.735 INFO:tasks.workunit.client.0.smithi049.stdout:5/26: dread - f4 zero size 2024-04-26T10:44:27.736 INFO:tasks.workunit.client.0.smithi049.stdout:5/27: chown f4 0 1 2024-04-26T10:44:27.736 INFO:tasks.workunit.client.0.smithi049.stdout:2/31: dwrite f5 [0,4194304] 0 2024-04-26T10:44:27.741 INFO:tasks.workunit.client.0.smithi049.stdout:7/37: dwrite d2/fa [0,4194304] 0 2024-04-26T10:44:27.743 INFO:tasks.workunit.client.0.smithi049.stdout:3/18: creat f2 x:0 0 0 2024-04-26T10:44:27.743 INFO:tasks.workunit.client.0.smithi049.stdout:5/28: symlink l5 0 2024-04-26T10:44:27.744 INFO:tasks.workunit.client.0.smithi049.stdout:6/25: creat f6 x:0 0 0 2024-04-26T10:44:27.744 INFO:tasks.workunit.client.0.smithi049.stdout:2/32: mkdir d6 0 2024-04-26T10:44:27.744 INFO:tasks.workunit.client.0.smithi049.stdout:4/72: rmdir de 39 2024-04-26T10:44:27.744 INFO:tasks.workunit.client.0.smithi049.stdout:7/38: mkdir d2/dd 0 2024-04-26T10:44:27.744 INFO:tasks.workunit.client.0.smithi049.stdout:8/34: mkdir d2/df/d10 0 2024-04-26T10:44:27.744 INFO:tasks.workunit.client.0.smithi049.stdout:2/33: chown f2 266615033 1 2024-04-26T10:44:27.744 INFO:tasks.workunit.client.0.smithi049.stdout:3/19: mkdir d3 0 2024-04-26T10:44:27.745 INFO:tasks.workunit.client.0.smithi049.stdout:7/39: dread - d2/fc zero size 2024-04-26T10:44:27.745 INFO:tasks.workunit.client.0.smithi049.stdout:6/26: creat f7 x:0 0 0 2024-04-26T10:44:27.745 INFO:tasks.workunit.client.0.smithi049.stdout:4/73: write de/f12 [48011,18785] 0 2024-04-26T10:44:27.746 INFO:tasks.workunit.client.0.smithi049.stdout:5/29: rename l5 to l6 0 2024-04-26T10:44:27.746 INFO:tasks.workunit.client.0.smithi049.stdout:3/20: chown f2 4092 1 2024-04-26T10:44:27.746 INFO:tasks.workunit.client.0.smithi049.stdout:7/40: mkdir d2/d3/de 0 2024-04-26T10:44:27.746 INFO:tasks.workunit.client.0.smithi049.stdout:2/34: creat d6/f7 x:0 0 0 2024-04-26T10:44:27.746 INFO:tasks.workunit.client.0.smithi049.stdout:4/74: creat de/f14 x:0 0 0 2024-04-26T10:44:27.746 INFO:tasks.workunit.client.0.smithi049.stdout:6/27: fsync f1 0 2024-04-26T10:44:27.746 INFO:tasks.workunit.client.0.smithi049.stdout:7/41: chown d2/dd 217976 1 2024-04-26T10:44:27.746 INFO:tasks.workunit.client.0.smithi049.stdout:2/35: dread - f2 zero size 2024-04-26T10:44:27.747 INFO:tasks.workunit.client.0.smithi049.stdout:4/75: creat de/f15 x:0 0 0 2024-04-26T10:44:27.747 INFO:tasks.workunit.client.0.smithi049.stdout:3/21: mknod d3/c4 0 2024-04-26T10:44:27.747 INFO:tasks.workunit.client.0.smithi049.stdout:7/42: link d2/d3/l9 d2/lf 0 2024-04-26T10:44:27.748 INFO:tasks.workunit.client.0.smithi049.stdout:4/76: dread - de/f14 zero size 2024-04-26T10:44:27.748 INFO:tasks.workunit.client.0.smithi049.stdout:7/43: stat d2/fc 0 2024-04-26T10:44:27.748 INFO:tasks.workunit.client.0.smithi049.stdout:8/35: dread d2/fe [0,4194304] 0 2024-04-26T10:44:27.748 INFO:tasks.workunit.client.0.smithi049.stdout:4/77: mknod de/c16 0 2024-04-26T10:44:27.749 INFO:tasks.workunit.client.0.smithi049.stdout:8/36: chown d2/l4 0 1 2024-04-26T10:44:27.749 INFO:tasks.workunit.client.0.smithi049.stdout:4/78: mknod de/c17 0 2024-04-26T10:44:27.750 INFO:tasks.workunit.client.0.smithi049.stdout:4/79: write f1 [3822271,57149] 0 2024-04-26T10:44:27.751 INFO:tasks.workunit.client.0.smithi049.stdout:6/28: dwrite f4 [0,4194304] 0 2024-04-26T10:44:27.751 INFO:tasks.workunit.client.0.smithi049.stdout:4/80: rename c5 to de/c18 0 2024-04-26T10:44:27.754 INFO:tasks.workunit.client.0.smithi049.stdout:7/44: dwrite d2/fa [0,4194304] 0 2024-04-26T10:44:27.754 INFO:tasks.workunit.client.0.smithi049.stdout:2/36: getdents d6 0 2024-04-26T10:44:27.754 INFO:tasks.workunit.client.0.smithi049.stdout:3/22: truncate f1 570662 0 2024-04-26T10:44:27.755 INFO:tasks.workunit.client.0.smithi049.stdout:3/23: dread - f2 zero size 2024-04-26T10:44:27.756 INFO:tasks.workunit.client.0.smithi049.stdout:2/37: link d6/f7 d6/f8 0 2024-04-26T10:44:27.756 INFO:tasks.workunit.client.0.smithi049.stdout:3/24: chown d3 0 1 2024-04-26T10:44:27.757 INFO:tasks.workunit.client.0.smithi049.stdout:3/25: chown d3 92 1 2024-04-26T10:44:27.757 INFO:tasks.workunit.client.0.smithi049.stdout:2/38: mkdir d6/d9 0 2024-04-26T10:44:27.758 INFO:tasks.workunit.client.0.smithi049.stdout:2/39: mknod d6/d9/ca 0 2024-04-26T10:44:27.759 INFO:tasks.workunit.client.0.smithi049.stdout:4/81: dwrite de/f15 [0,4194304] 0 2024-04-26T10:44:27.759 INFO:tasks.workunit.client.0.smithi049.stdout:2/40: read - d6/f7 zero size 2024-04-26T10:44:27.760 INFO:tasks.workunit.client.0.smithi049.stdout:7/45: dread f0 [0,4194304] 0 2024-04-26T10:44:27.760 INFO:tasks.workunit.client.0.smithi049.stdout:4/82: mknod de/c19 0 2024-04-26T10:44:27.760 INFO:tasks.workunit.client.0.smithi049.stdout:2/41: mkdir d6/d9/db 0 2024-04-26T10:44:27.761 INFO:tasks.workunit.client.0.smithi049.stdout:4/83: write de/f12 [536617,131014] 0 2024-04-26T10:44:27.762 INFO:tasks.workunit.client.0.smithi049.stdout:7/46: truncate f0 2648221 0 2024-04-26T10:44:27.763 INFO:tasks.workunit.client.0.smithi049.stdout:3/26: dwrite f2 [0,4194304] 0 2024-04-26T10:44:27.764 INFO:tasks.workunit.client.0.smithi049.stdout:3/27: mkdir d3/d5 0 2024-04-26T10:44:27.765 INFO:tasks.workunit.client.0.smithi049.stdout:2/42: dread f5 [0,4194304] 0 2024-04-26T10:44:27.766 INFO:tasks.workunit.client.0.smithi049.stdout:3/28: dread f1 [0,4194304] 0 2024-04-26T10:44:27.767 INFO:tasks.workunit.client.0.smithi049.stdout:3/29: mkdir d3/d6 0 2024-04-26T10:44:27.767 INFO:tasks.workunit.client.0.smithi049.stdout:4/84: dwrite fc [0,4194304] 0 2024-04-26T10:44:27.768 INFO:tasks.workunit.client.0.smithi049.stdout:6/29: fsync f4 0 2024-04-26T10:44:27.769 INFO:tasks.workunit.client.0.smithi049.stdout:6/30: creat f8 x:0 0 0 2024-04-26T10:44:27.769 INFO:tasks.workunit.client.0.smithi049.stdout:2/43: dread f4 [0,4194304] 0 2024-04-26T10:44:27.769 INFO:tasks.workunit.client.0.smithi049.stdout:6/31: creat f9 x:0 0 0 2024-04-26T10:44:27.770 INFO:tasks.workunit.client.0.smithi049.stdout:6/32: readlink l3 0 2024-04-26T10:44:27.770 INFO:tasks.workunit.client.0.smithi049.stdout:7/47: dread f0 [0,4194304] 0 2024-04-26T10:44:27.772 INFO:tasks.workunit.client.0.smithi049.stdout:4/85: dread de/f15 [0,4194304] 0 2024-04-26T10:44:27.772 INFO:tasks.workunit.client.0.smithi049.stdout:4/86: stat de/c16 0 2024-04-26T10:44:27.773 INFO:tasks.workunit.client.0.smithi049.stdout:7/48: dread d2/f6 [0,4194304] 0 2024-04-26T10:44:27.774 INFO:tasks.workunit.client.0.smithi049.stdout:7/49: fsync d2/f6 0 2024-04-26T10:44:27.774 INFO:tasks.workunit.client.0.smithi049.stdout:7/50: dread - d2/fc zero size 2024-04-26T10:44:27.774 INFO:tasks.workunit.client.0.smithi049.stdout:7/51: fdatasync d2/fa 0 2024-04-26T10:44:27.775 INFO:tasks.workunit.client.0.smithi049.stdout:7/52: fsync d2/fc 0 2024-04-26T10:44:27.775 INFO:tasks.workunit.client.0.smithi049.stdout:4/87: dread de/f15 [0,4194304] 0 2024-04-26T10:44:27.775 INFO:tasks.workunit.client.0.smithi049.stdout:7/53: rmdir d2 39 2024-04-26T10:44:27.779 INFO:tasks.workunit.client.0.smithi049.stdout:4/88: symlink de/l1a 0 2024-04-26T10:44:27.779 INFO:tasks.workunit.client.0.smithi049.stdout:7/54: dread - d2/fc zero size 2024-04-26T10:44:27.779 INFO:tasks.workunit.client.0.smithi049.stdout:0/23: sync 2024-04-26T10:44:27.779 INFO:tasks.workunit.client.0.smithi049.stdout:4/89: fsync de/f12 0 2024-04-26T10:44:27.779 INFO:tasks.workunit.client.0.smithi049.stdout:2/44: dread f0 [0,4194304] 0 2024-04-26T10:44:27.779 INFO:tasks.workunit.client.0.smithi049.stdout:0/24: chown f2 243 1 2024-04-26T10:44:27.779 INFO:tasks.workunit.client.0.smithi049.stdout:4/90: read de/f15 [1534757,19042] 0 2024-04-26T10:44:27.780 INFO:tasks.workunit.client.0.smithi049.stdout:2/45: write f3 [2306911,11546] 0 2024-04-26T10:44:27.780 INFO:tasks.workunit.client.0.smithi049.stdout:0/25: creat d8/f9 x:0 0 0 2024-04-26T10:44:27.780 INFO:tasks.workunit.client.0.smithi049.stdout:4/91: mkdir de/d1b 0 2024-04-26T10:44:27.780 INFO:tasks.workunit.client.0.smithi049.stdout:3/30: fsync f2 0 2024-04-26T10:44:27.780 INFO:tasks.workunit.client.0.smithi049.stdout:2/46: creat d6/d9/fc x:0 0 0 2024-04-26T10:44:27.780 INFO:tasks.workunit.client.0.smithi049.stdout:3/31: creat d3/d6/f7 x:0 0 0 2024-04-26T10:44:27.780 INFO:tasks.workunit.client.0.smithi049.stdout:2/47: dread - d6/d9/fc zero size 2024-04-26T10:44:27.780 INFO:tasks.workunit.client.0.smithi049.stdout:3/32: fdatasync f1 0 2024-04-26T10:44:27.781 INFO:tasks.workunit.client.0.smithi049.stdout:3/33: mkdir d3/d5/d8 0 2024-04-26T10:44:27.781 INFO:tasks.workunit.client.0.smithi049.stdout:2/48: link d6/f7 d6/fd 0 2024-04-26T10:44:27.781 INFO:tasks.workunit.client.0.smithi049.stdout:2/49: chown d6/f7 0 1 2024-04-26T10:44:27.781 INFO:tasks.workunit.client.0.smithi049.stdout:3/34: chown d3/d6/f7 2621906 1 2024-04-26T10:44:27.781 INFO:tasks.workunit.client.0.smithi049.stdout:4/92: truncate f9 3589222 0 2024-04-26T10:44:27.781 INFO:tasks.workunit.client.0.smithi049.stdout:7/55: dwrite d2/f6 [4194304,4194304] 0 2024-04-26T10:44:27.782 INFO:tasks.workunit.client.0.smithi049.stdout:2/50: mknod d6/d9/db/ce 0 2024-04-26T10:44:27.782 INFO:tasks.workunit.client.0.smithi049.stdout:7/56: write d2/fa [3008006,23198] 0 2024-04-26T10:44:27.782 INFO:tasks.workunit.client.0.smithi049.stdout:2/51: chown f2 204129 1 2024-04-26T10:44:27.783 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:27.780+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:27.783 INFO:tasks.workunit.client.0.smithi049.stdout:2/52: write f2 [143743,6149] 0 2024-04-26T10:44:27.783 INFO:tasks.workunit.client.0.smithi049.stdout:7/57: link d2/fa d2/d3/f10 0 2024-04-26T10:44:27.784 INFO:tasks.workunit.client.0.smithi049.stdout:2/53: mkdir d6/d9/db/df 0 2024-04-26T10:44:27.785 INFO:tasks.workunit.client.0.smithi049.stdout:2/54: truncate f5 5005908 0 2024-04-26T10:44:27.786 INFO:tasks.workunit.client.0.smithi049.stdout:2/55: symlink d6/d9/l10 0 2024-04-26T10:44:27.786 INFO:tasks.workunit.client.0.smithi049.stdout:2/56: unlink f2 0 2024-04-26T10:44:27.787 INFO:tasks.workunit.client.0.smithi049.stdout:4/93: dwrite f7 [0,4194304] 0 2024-04-26T10:44:27.787 INFO:tasks.workunit.client.0.smithi049.stdout:7/58: dread d2/fa [0,4194304] 0 2024-04-26T10:44:27.788 INFO:tasks.workunit.client.0.smithi049.stdout:4/94: creat de/d1b/f1c x:0 0 0 2024-04-26T10:44:27.788 INFO:tasks.workunit.client.0.smithi049.stdout:7/59: write d2/d3/f10 [628661,77630] 0 2024-04-26T10:44:27.791 INFO:tasks.workunit.client.0.smithi049.stdout:2/57: write f0 [1463119,106020] 0 2024-04-26T10:44:27.792 INFO:tasks.workunit.client.0.smithi049.stdout:2/58: readlink d6/d9/l10 0 2024-04-26T10:44:27.794 INFO:tasks.workunit.client.0.smithi049.stdout:6/33: sync 2024-04-26T10:44:27.794 INFO:tasks.workunit.client.0.smithi049.stdout:8/37: sync 2024-04-26T10:44:27.794 INFO:tasks.workunit.client.0.smithi049.stdout:1/29: sync 2024-04-26T10:44:27.794 INFO:tasks.workunit.client.0.smithi049.stdout:5/30: sync 2024-04-26T10:44:27.794 INFO:tasks.workunit.client.0.smithi049.stdout:9/144: sync 2024-04-26T10:44:27.794 INFO:tasks.workunit.client.0.smithi049.stdout:0/26: sync 2024-04-26T10:44:27.794 INFO:tasks.workunit.client.0.smithi049.stdout:4/95: dwrite de/f12 [0,4194304] 0 2024-04-26T10:44:27.794 INFO:tasks.workunit.client.0.smithi049.stdout:2/59: mkdir d6/d9/db/d11 0 2024-04-26T10:44:27.795 INFO:tasks.workunit.client.0.smithi049.stdout:0/27: readlink l5 0 2024-04-26T10:44:27.795 INFO:tasks.workunit.client.0.smithi049.stdout:6/34: mkdir da 0 2024-04-26T10:44:27.795 INFO:tasks.workunit.client.0.smithi049.stdout:1/30: symlink l6 0 2024-04-26T10:44:27.795 INFO:tasks.workunit.client.0.smithi049.stdout:5/31: read f3 [1059129,42991] 0 2024-04-26T10:44:27.795 INFO:tasks.workunit.client.0.smithi049.stdout:7/60: dwrite d2/fa [0,4194304] 0 2024-04-26T10:44:27.796 INFO:tasks.workunit.client.0.smithi049.stdout:9/145: creat d2/d1a/f2a x:0 0 0 2024-04-26T10:44:27.796 INFO:tasks.workunit.client.0.smithi049.stdout:8/38: write d2/f8 [1271071,71388] 0 2024-04-26T10:44:27.797 INFO:tasks.workunit.client.0.smithi049.stdout:1/31: write f0 [1894505,7877] 0 2024-04-26T10:44:27.797 INFO:tasks.workunit.client.0.smithi049.stdout:0/28: link l6 d8/la 0 2024-04-26T10:44:27.797 INFO:tasks.workunit.client.0.smithi049.stdout:5/32: truncate f4 600305 0 2024-04-26T10:44:27.798 INFO:tasks.workunit.client.0.smithi049.stdout:6/35: truncate f1 2712634 0 2024-04-26T10:44:27.799 INFO:tasks.workunit.client.0.smithi049.stdout:1/32: symlink l7 0 2024-04-26T10:44:27.799 INFO:tasks.workunit.client.0.smithi049.stdout:8/39: readlink d2/lb 0 2024-04-26T10:44:27.800 INFO:tasks.workunit.client.0.smithi049.stdout:0/29: mkdir d8/db 0 2024-04-26T10:44:27.800 INFO:tasks.workunit.client.0.smithi049.stdout:6/36: truncate f5 360443 0 2024-04-26T10:44:27.800 INFO:tasks.workunit.client.0.smithi049.stdout:2/60: link d6/f7 d6/d9/db/df/f12 0 2024-04-26T10:44:27.800 INFO:tasks.workunit.client.0.smithi049.stdout:5/33: write f3 [1840469,67221] 0 2024-04-26T10:44:27.801 INFO:tasks.workunit.client.0.smithi049.stdout:4/96: dread fc [0,4194304] 0 2024-04-26T10:44:27.801 INFO:tasks.workunit.client.0.smithi049.stdout:8/40: mknod d2/c11 0 2024-04-26T10:44:27.802 INFO:tasks.workunit.client.0.smithi049.stdout:0/30: mknod d8/cc 0 2024-04-26T10:44:27.802 INFO:tasks.workunit.client.0.smithi049.stdout:1/33: write f0 [1138944,101509] 0 2024-04-26T10:44:27.802 INFO:tasks.workunit.client.0.smithi049.stdout:5/34: mkdir d7 0 2024-04-26T10:44:27.802 INFO:tasks.workunit.client.0.smithi049.stdout:4/97: mkdir de/d1d 0 2024-04-26T10:44:27.803 INFO:tasks.workunit.client.0.smithi049.stdout:6/37: mknod da/cb 0 2024-04-26T10:44:27.803 INFO:tasks.workunit.client.0.smithi049.stdout:0/31: dread - f3 zero size 2024-04-26T10:44:27.803 INFO:tasks.workunit.client.0.smithi049.stdout:8/41: fsync d2/fd 0 2024-04-26T10:44:27.804 INFO:tasks.workunit.client.0.smithi049.stdout:2/61: chown d6/f7 6650667 1 2024-04-26T10:44:27.804 INFO:tasks.workunit.client.0.smithi049.stdout:5/35: write f3 [1133920,93463] 0 2024-04-26T10:44:27.805 INFO:tasks.workunit.client.0.smithi049.stdout:0/32: dread - d8/f9 zero size 2024-04-26T10:44:27.806 INFO:tasks.workunit.client.0.smithi049.stdout:4/98: write f8 [206531,20851] 0 2024-04-26T10:44:27.807 INFO:tasks.workunit.client.0.smithi049.stdout:9/146: dwrite d2/d25/f28 [0,4194304] 0 2024-04-26T10:44:27.808 INFO:tasks.workunit.client.0.smithi049.stdout:7/61: dwrite d2/d3/f10 [0,4194304] 0 2024-04-26T10:44:27.808 INFO:tasks.workunit.client.0.smithi049.stdout:4/99: symlink de/d1b/l1e 0 2024-04-26T10:44:27.809 INFO:tasks.workunit.client.0.smithi049.stdout:0/33: link l6 d8/ld 0 2024-04-26T10:44:27.812 INFO:tasks.workunit.client.0.smithi049.stdout:1/34: dread f0 [0,4194304] 0 2024-04-26T10:44:27.812 INFO:tasks.workunit.client.0.smithi049.stdout:4/100: rename la to de/l1f 0 2024-04-26T10:44:27.812 INFO:tasks.workunit.client.0.smithi049.stdout:2/62: write d6/f8 [463851,63099] 0 2024-04-26T10:44:27.812 INFO:tasks.workunit.client.0.smithi049.stdout:0/34: truncate d8/f9 780323 0 2024-04-26T10:44:27.812 INFO:tasks.workunit.client.0.smithi049.stdout:4/101: chown de/d1b 14739 1 2024-04-26T10:44:27.812 INFO:tasks.workunit.client.0.smithi049.stdout:6/38: write f1 [3542704,82190] 0 2024-04-26T10:44:27.813 INFO:tasks.workunit.client.0.smithi049.stdout:1/35: chown c5 1651314 1 2024-04-26T10:44:27.813 INFO:tasks.workunit.client.0.smithi049.stdout:8/42: dread d2/f6 [0,4194304] 0 2024-04-26T10:44:27.813 INFO:tasks.workunit.client.0.smithi049.stdout:4/102: stat c4 0 2024-04-26T10:44:27.813 INFO:tasks.workunit.client.0.smithi049.stdout:0/35: chown d8/ld 122101321 1 2024-04-26T10:44:27.814 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:27.814 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:27.814 INFO:tasks.workunit.client.0.smithi049.stdout:3/35: sync 2024-04-26T10:44:27.814 INFO:tasks.workunit.client.0.smithi049.stdout:1/36: mknod c8 0 2024-04-26T10:44:27.815 INFO:tasks.workunit.client.0.smithi049.stdout:6/39: creat da/fc x:0 0 0 2024-04-26T10:44:27.815 INFO:tasks.workunit.client.0.smithi049.stdout:3/36: rmdir d3 39 2024-04-26T10:44:27.815 INFO:tasks.workunit.client.0.smithi049.stdout:4/103: write de/ff [937395,25263] 0 2024-04-26T10:44:27.816 INFO:tasks.workunit.client.0.smithi049.stdout:1/37: creat f9 x:0 0 0 2024-04-26T10:44:27.816 INFO:tasks.workunit.client.0.smithi049.stdout:6/40: fdatasync f0 0 2024-04-26T10:44:27.817 INFO:tasks.workunit.client.0.smithi049.stdout:2/63: truncate d6/d9/db/df/f12 1165358 0 2024-04-26T10:44:27.818 INFO:tasks.workunit.client.0.smithi049.stdout:4/104: mkdir de/d20 0 2024-04-26T10:44:27.818 INFO:tasks.workunit.client.0.smithi049.stdout:1/38: creat fa x:0 0 0 2024-04-26T10:44:27.818 INFO:tasks.workunit.client.0.smithi049.stdout:5/36: dread f4 [0,4194304] 0 2024-04-26T10:44:27.819 INFO:tasks.workunit.client.0.smithi049.stdout:3/37: write d3/d6/f7 [810637,116324] 0 2024-04-26T10:44:27.821 INFO:tasks.workunit.client.0.smithi049.stdout:7/62: dwrite d2/d3/f10 [0,4194304] 0 2024-04-26T10:44:27.821 INFO:tasks.workunit.client.0.smithi049.stdout:1/39: truncate f9 702004 0 2024-04-26T10:44:27.822 INFO:tasks.workunit.client.0.smithi049.stdout:2/64: creat d6/d9/db/f13 x:0 0 0 2024-04-26T10:44:27.822 INFO:tasks.workunit.client.0.smithi049.stdout:9/147: dwrite d2/d1a/f21 [0,4194304] 0 2024-04-26T10:44:27.822 INFO:tasks.workunit.client.0.smithi049.stdout:3/38: chown f2 2518018 1 2024-04-26T10:44:27.823 INFO:tasks.workunit.client.0.smithi049.stdout:5/37: rename l2 to d7/l8 0 2024-04-26T10:44:27.824 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:27.825 INFO:tasks.workunit.client.0.smithi049.stdout:1/40: creat fb x:0 0 0 2024-04-26T10:44:27.825 INFO:tasks.workunit.client.0.smithi049.stdout:0/36: truncate f1 3785589 0 2024-04-26T10:44:27.826 INFO:tasks.workunit.client.0.smithi049.stdout:8/43: dwrite d2/fd [0,4194304] 0 2024-04-26T10:44:27.826 INFO:tasks.workunit.client.0.smithi049.stdout:7/63: getdents d2/d3 0 2024-04-26T10:44:27.827 INFO:tasks.workunit.client.0.smithi049.stdout:5/38: link f4 d7/f9 0 2024-04-26T10:44:27.828 INFO:tasks.workunit.client.0.smithi049.stdout:9/148: truncate d2/f19 415378 0 2024-04-26T10:44:27.828 INFO:tasks.workunit.client.0.smithi049.stdout:1/41: symlink lc 0 2024-04-26T10:44:27.828 INFO:tasks.workunit.client.0.smithi049.stdout:1/42: fsync f9 0 2024-04-26T10:44:27.828 INFO:tasks.workunit.client.0.smithi049.stdout:3/39: rename f2 to d3/d5/d8/f9 0 2024-04-26T10:44:27.828 INFO:tasks.workunit.client.0.smithi049.stdout:0/37: mknod d8/db/ce 0 2024-04-26T10:44:27.829 INFO:tasks.workunit.client.0.smithi049.stdout:7/64: truncate f0 1685782 0 2024-04-26T10:44:27.829 INFO:tasks.workunit.client.0.smithi049.stdout:5/39: write f3 [2443184,29741] 0 2024-04-26T10:44:27.829 INFO:tasks.workunit.client.0.smithi049.stdout:8/44: rename d2/fd to d2/f12 0 2024-04-26T10:44:27.830 INFO:tasks.workunit.client.0.smithi049.stdout:0/38: symlink d8/lf 0 2024-04-26T10:44:27.831 INFO:tasks.workunit.client.0.smithi049.stdout:6/41: dwrite f7 [0,4194304] 0 2024-04-26T10:44:27.831 INFO:tasks.workunit.client.0.smithi049.stdout:3/40: symlink d3/d6/la 0 2024-04-26T10:44:27.831 INFO:tasks.workunit.client.0.smithi049.stdout:1/43: truncate f9 1712064 0 2024-04-26T10:44:27.831 INFO:tasks.workunit.client.0.smithi049.stdout:9/149: write d2/d1a/df/f13 [3596633,19726] 0 2024-04-26T10:44:27.831 INFO:tasks.workunit.client.0.smithi049.stdout:4/105: dwrite de/ff [0,4194304] 0 2024-04-26T10:44:27.831 INFO:tasks.workunit.client.0.smithi049.stdout:5/40: symlink d7/la 0 2024-04-26T10:44:27.832 INFO:tasks.workunit.client.0.smithi049.stdout:3/41: write d3/d6/f7 [165924,25144] 0 2024-04-26T10:44:27.832 INFO:tasks.workunit.client.0.smithi049.stdout:3/42: chown d3 16420889 1 2024-04-26T10:44:27.833 INFO:tasks.workunit.client.0.smithi049.stdout:6/42: mkdir da/dd 0 2024-04-26T10:44:27.833 INFO:tasks.workunit.client.0.smithi049.stdout:9/150: mknod d2/c2b 0 2024-04-26T10:44:27.833 INFO:tasks.workunit.client.0.smithi049.stdout:1/44: creat fd x:0 0 0 2024-04-26T10:44:27.834 INFO:tasks.workunit.client.0.smithi049.stdout:5/41: symlink d7/lb 0 2024-04-26T10:44:27.835 INFO:tasks.workunit.client.0.smithi049.stdout:2/65: sync 2024-04-26T10:44:27.835 INFO:tasks.workunit.client.0.smithi049.stdout:9/151: sync 2024-04-26T10:44:27.836 INFO:tasks.workunit.client.0.smithi049.stdout:3/43: fsync d3/d5/d8/f9 0 2024-04-26T10:44:27.836 INFO:tasks.workunit.client.0.smithi049.stdout:5/42: creat d7/fc x:0 0 0 2024-04-26T10:44:27.838 INFO:tasks.workunit.client.0.smithi049.stdout:4/106: dread f9 [0,4194304] 0 2024-04-26T10:44:27.838 INFO:tasks.workunit.client.0.smithi049.stdout:5/43: mknod d7/cd 0 2024-04-26T10:44:27.838 INFO:tasks.workunit.client.0.smithi049.stdout:9/152: creat d2/d1a/f2c x:0 0 0 2024-04-26T10:44:27.839 INFO:tasks.workunit.client.0.smithi049.stdout:2/66: symlink d6/d9/db/df/l14 0 2024-04-26T10:44:27.839 INFO:tasks.workunit.client.0.smithi049.stdout:3/44: mkdir d3/d5/d8/db 0 2024-04-26T10:44:27.840 INFO:tasks.workunit.client.0.smithi049.stdout:8/45: dwrite d2/f6 [0,4194304] 0 2024-04-26T10:44:27.840 INFO:tasks.workunit.client.0.smithi049.stdout:6/43: sync 2024-04-26T10:44:27.840 INFO:tasks.workunit.client.0.smithi049.stdout:7/65: sync 2024-04-26T10:44:27.842 INFO:tasks.workunit.client.0.smithi049.stdout:5/44: dread d7/f9 [0,4194304] 0 2024-04-26T10:44:27.842 INFO:tasks.workunit.client.0.smithi049.stdout:7/66: read - d2/fc zero size 2024-04-26T10:44:27.842 INFO:tasks.workunit.client.0.smithi049.stdout:2/67: write d6/f7 [249360,78458] 0 2024-04-26T10:44:27.842 INFO:tasks.workunit.client.0.smithi049.stdout:1/45: dread f0 [0,4194304] 0 2024-04-26T10:44:27.843 INFO:tasks.workunit.client.0.smithi049.stdout:9/153: mknod d2/d1a/d1b/d1f/c2d 0 2024-04-26T10:44:27.843 INFO:tasks.workunit.client.0.smithi049.stdout:5/45: mknod d7/ce 0 2024-04-26T10:44:27.843 INFO:tasks.workunit.client.0.smithi049.stdout:6/44: mkdir da/dd/de 0 2024-04-26T10:44:27.844 INFO:tasks.workunit.client.0.smithi049.stdout:0/39: dread f1 [0,4194304] 0 2024-04-26T10:44:27.844 INFO:tasks.workunit.client.0.smithi049.stdout:7/67: creat d2/dd/f11 x:0 0 0 2024-04-26T10:44:27.844 INFO:tasks.workunit.client.0.smithi049.stdout:9/154: creat d2/d25/f2e x:0 0 0 2024-04-26T10:44:27.844 INFO:tasks.workunit.client.0.smithi049.stdout:1/46: chown fa 75843331 1 2024-04-26T10:44:27.846 INFO:tasks.workunit.client.0.smithi049.stdout:6/45: creat da/ff x:0 0 0 2024-04-26T10:44:27.846 INFO:tasks.workunit.client.0.smithi049.stdout:9/155: write d2/d1a/f27 [74587,71787] 0 2024-04-26T10:44:27.846 INFO:tasks.workunit.client.0.smithi049.stdout:1/47: write fa [177793,39065] 0 2024-04-26T10:44:27.846 INFO:tasks.workunit.client.0.smithi049.stdout:5/46: creat d7/ff x:0 0 0 2024-04-26T10:44:27.847 INFO:tasks.workunit.client.0.smithi049.stdout:8/46: dread d2/fe [0,4194304] 0 2024-04-26T10:44:27.848 INFO:tasks.workunit.client.0.smithi049.stdout:4/107: truncate de/f12 3203770 0 2024-04-26T10:44:27.849 INFO:tasks.workunit.client.0.smithi049.stdout:5/47: chown d7/fc 310701 1 2024-04-26T10:44:27.850 INFO:tasks.workunit.client.0.smithi049.stdout:6/46: truncate f4 3058444 0 2024-04-26T10:44:27.851 INFO:tasks.workunit.client.0.smithi049.stdout:9/156: mknod d2/d1a/df/c2f 0 2024-04-26T10:44:27.852 INFO:tasks.workunit.client.0.smithi049.stdout:4/108: mknod de/c21 0 2024-04-26T10:44:27.854 INFO:tasks.workunit.client.0.smithi049.stdout:5/48: write d7/ff [371174,32393] 0 2024-04-26T10:44:27.854 INFO:tasks.workunit.client.0.smithi049.stdout:3/45: dwrite d3/d6/f7 [0,4194304] 0 2024-04-26T10:44:27.856 INFO:tasks.workunit.client.0.smithi049.stdout:4/109: chown c4 27 1 2024-04-26T10:44:27.856 INFO:tasks.workunit.client.0.smithi049.stdout:2/68: dwrite d6/fd [0,4194304] 0 2024-04-26T10:44:27.856 INFO:tasks.workunit.client.0.smithi049.stdout:3/46: symlink d3/lc 0 2024-04-26T10:44:27.857 INFO:tasks.workunit.client.0.smithi049.stdout:5/49: creat d7/f10 x:0 0 0 2024-04-26T10:44:27.857 INFO:tasks.workunit.client.0.smithi049.stdout:9/157: rename d2/d1a/f27 to d2/d1a/df/f30 0 2024-04-26T10:44:27.858 INFO:tasks.workunit.client.0.smithi049.stdout:4/110: chown de/c17 187 1 2024-04-26T10:44:27.858 INFO:tasks.workunit.client.0.smithi049.stdout:0/40: dwrite f2 [0,4194304] 0 2024-04-26T10:44:27.858 INFO:tasks.workunit.client.0.smithi049.stdout:5/50: stat d7/cd 0 2024-04-26T10:44:27.859 INFO:tasks.workunit.client.0.smithi049.stdout:0/41: sync 2024-04-26T10:44:27.859 INFO:tasks.workunit.client.0.smithi049.stdout:7/68: dwrite d2/d3/f10 [0,4194304] 0 2024-04-26T10:44:27.860 INFO:tasks.workunit.client.0.smithi049.stdout:2/69: mknod d6/d9/db/df/c15 0 2024-04-26T10:44:27.860 INFO:tasks.workunit.client.0.smithi049.stdout:1/48: dread f0 [0,4194304] 0 2024-04-26T10:44:27.860 INFO:tasks.workunit.client.0.smithi049.stdout:6/47: truncate f4 474740 0 2024-04-26T10:44:27.861 INFO:tasks.workunit.client.0.smithi049.stdout:3/47: mkdir d3/d5/d8/dd 0 2024-04-26T10:44:27.861 INFO:tasks.workunit.client.0.smithi049.stdout:9/158: write d2/d1a/d1b/f16 [1360725,37507] 0 2024-04-26T10:44:27.861 INFO:tasks.workunit.client.0.smithi049.stdout:5/51: write d7/f10 [826177,77169] 0 2024-04-26T10:44:27.861 INFO:tasks.workunit.client.0.smithi049.stdout:0/42: rmdir d8/db 39 2024-04-26T10:44:27.862 INFO:tasks.workunit.client.0.smithi049.stdout:1/49: creat fe x:0 0 0 2024-04-26T10:44:27.862 INFO:tasks.workunit.client.0.smithi049.stdout:2/70: read d6/f7 [3069691,64175] 0 2024-04-26T10:44:27.862 INFO:tasks.workunit.client.0.smithi049.stdout:4/111: rename de/ff to de/d20/f22 0 2024-04-26T10:44:27.862 INFO:tasks.workunit.client.0.smithi049.stdout:5/52: mknod d7/c11 0 2024-04-26T10:44:27.863 INFO:tasks.workunit.client.0.smithi049.stdout:1/50: mknod cf 0 2024-04-26T10:44:27.863 INFO:tasks.workunit.client.0.smithi049.stdout:6/48: write f8 [347469,80746] 0 2024-04-26T10:44:27.864 INFO:tasks.workunit.client.0.smithi049.stdout:7/69: creat d2/dd/f12 x:0 0 0 2024-04-26T10:44:27.864 INFO:tasks.workunit.client.0.smithi049.stdout:0/43: write f3 [776747,74735] 0 2024-04-26T10:44:27.865 INFO:tasks.workunit.client.0.smithi049.stdout:4/112: dread f8 [0,4194304] 0 2024-04-26T10:44:27.865 INFO:tasks.workunit.client.0.smithi049.stdout:2/71: write f5 [5339910,23970] 0 2024-04-26T10:44:27.866 INFO:tasks.workunit.client.0.smithi049.stdout:8/47: dwrite d2/fc [0,4194304] 0 2024-04-26T10:44:27.867 INFO:tasks.workunit.client.0.smithi049.stdout:1/51: write fa [1180197,62375] 0 2024-04-26T10:44:27.867 INFO:tasks.workunit.client.0.smithi049.stdout:3/48: rename d3/d5 to d3/de 0 2024-04-26T10:44:27.868 INFO:tasks.workunit.client.0.smithi049.stdout:0/44: truncate f1 4390077 0 2024-04-26T10:44:27.868 INFO:tasks.workunit.client.0.smithi049.stdout:7/70: truncate f0 130486 0 2024-04-26T10:44:27.869 INFO:tasks.workunit.client.0.smithi049.stdout:4/113: readlink de/l13 0 2024-04-26T10:44:27.869 INFO:tasks.workunit.client.0.smithi049.stdout:2/72: mknod d6/d9/db/c16 0 2024-04-26T10:44:27.870 INFO:tasks.workunit.client.0.smithi049.stdout:3/49: fsync d3/d6/f7 0 2024-04-26T10:44:27.870 INFO:tasks.workunit.client.0.smithi049.stdout:0/45: write f2 [2835720,45552] 0 2024-04-26T10:44:27.871 INFO:tasks.workunit.client.0.smithi049.stdout:7/71: mknod d2/d3/c13 0 2024-04-26T10:44:27.873 INFO:tasks.workunit.client.0.smithi049.stdout:7/72: stat d2/f6 0 2024-04-26T10:44:27.874 INFO:tasks.workunit.client.0.smithi049.stdout:9/159: dwrite d2/f3 [0,4194304] 0 2024-04-26T10:44:27.874 INFO:tasks.workunit.client.0.smithi049.stdout:5/53: dwrite f3 [0,4194304] 0 2024-04-26T10:44:27.875 INFO:tasks.workunit.client.0.smithi049.stdout:3/50: write d3/d6/f7 [2255725,11207] 0 2024-04-26T10:44:27.875 INFO:tasks.workunit.client.0.smithi049.stdout:6/49: truncate f7 609756 0 2024-04-26T10:44:27.875 INFO:tasks.workunit.client.0.smithi049.stdout:0/46: mknod d8/db/c10 0 2024-04-26T10:44:27.876 INFO:tasks.workunit.client.0.smithi049.stdout:9/160: mknod d2/c31 0 2024-04-26T10:44:27.876 INFO:tasks.workunit.client.0.smithi049.stdout:5/54: rename d7/la to d7/l12 0 2024-04-26T10:44:27.877 INFO:tasks.workunit.client.0.smithi049.stdout:0/47: mkdir d8/db/d11 0 2024-04-26T10:44:27.877 INFO:tasks.workunit.client.0.smithi049.stdout:6/50: truncate f0 3621691 0 2024-04-26T10:44:27.878 INFO:tasks.workunit.client.0.smithi049.stdout:7/73: read f0 [21591,65236] 0 2024-04-26T10:44:27.878 INFO:tasks.workunit.client.0.smithi049.stdout:9/161: write d2/d1a/f2a [914826,18743] 0 2024-04-26T10:44:27.879 INFO:tasks.workunit.client.0.smithi049.stdout:5/55: mknod d7/c13 0 2024-04-26T10:44:27.880 INFO:tasks.workunit.client.0.smithi049.stdout:4/114: dread de/f15 [0,4194304] 0 2024-04-26T10:44:27.880 INFO:tasks.workunit.client.0.smithi049.stdout:0/48: chown d8/db/c10 15608456 1 2024-04-26T10:44:27.881 INFO:tasks.workunit.client.0.smithi049.stdout:2/73: dwrite f4 [4194304,4194304] 0 2024-04-26T10:44:27.881 INFO:tasks.workunit.client.0.smithi049.stdout:5/56: mkdir d7/d14 0 2024-04-26T10:44:27.881 INFO:tasks.workunit.client.0.smithi049.stdout:6/51: getdents da/dd/de 0 2024-04-26T10:44:27.884 INFO:tasks.workunit.client.0.smithi049.stdout:9/162: write d2/f3 [194905,120999] 0 2024-04-26T10:44:27.885 INFO:tasks.workunit.client.0.smithi049.stdout:1/52: dread fa [0,4194304] 0 2024-04-26T10:44:27.885 INFO:tasks.workunit.client.0.smithi049.stdout:4/115: truncate de/f14 95833 0 2024-04-26T10:44:27.885 INFO:tasks.workunit.client.0.smithi049.stdout:8/48: fdatasync d2/fc 0 2024-04-26T10:44:27.885 INFO:tasks.workunit.client.0.smithi049.stdout:0/49: rename c4 to d8/db/c12 0 2024-04-26T10:44:27.885 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:27.882+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:27.886 INFO:tasks.workunit.client.0.smithi049.stdout:1/53: truncate fd 808894 0 2024-04-26T10:44:27.886 INFO:tasks.workunit.client.0.smithi049.stdout:3/51: dwrite f1 [0,4194304] 0 2024-04-26T10:44:27.886 INFO:tasks.workunit.client.0.smithi049.stdout:2/74: rename l1 to d6/d9/db/df/l17 0 2024-04-26T10:44:27.886 INFO:tasks.workunit.client.0.smithi049.stdout:3/52: sync 2024-04-26T10:44:27.888 INFO:tasks.workunit.client.0.smithi049.stdout:0/50: read f1 [1644215,2940] 0 2024-04-26T10:44:27.888 INFO:tasks.workunit.client.0.smithi049.stdout:4/116: dread de/f14 [0,4194304] 0 2024-04-26T10:44:27.888 INFO:tasks.workunit.client.0.smithi049.stdout:5/57: mknod d7/d14/c15 0 2024-04-26T10:44:27.888 INFO:tasks.workunit.client.0.smithi049.stdout:1/54: read f9 [1328160,41223] 0 2024-04-26T10:44:27.889 INFO:tasks.workunit.client.0.smithi049.stdout:6/52: link da/ff da/dd/f10 0 2024-04-26T10:44:27.889 INFO:tasks.workunit.client.0.smithi049.stdout:8/49: creat d2/df/d10/f13 x:0 0 0 2024-04-26T10:44:27.889 INFO:tasks.workunit.client.0.smithi049.stdout:0/51: mknod d8/db/c13 0 2024-04-26T10:44:27.890 INFO:tasks.workunit.client.0.smithi049.stdout:5/58: write d7/ff [1326903,13567] 0 2024-04-26T10:44:27.890 INFO:tasks.workunit.client.0.smithi049.stdout:1/55: creat f10 x:0 0 0 2024-04-26T10:44:27.891 INFO:tasks.workunit.client.0.smithi049.stdout:3/53: creat d3/de/d8/dd/ff x:0 0 0 2024-04-26T10:44:27.891 INFO:tasks.workunit.client.0.smithi049.stdout:7/74: dwrite d2/dd/f11 [0,4194304] 0 2024-04-26T10:44:27.891 INFO:tasks.workunit.client.0.smithi049.stdout:2/75: creat d6/d9/db/d11/f18 x:0 0 0 2024-04-26T10:44:27.891 INFO:tasks.workunit.client.0.smithi049.stdout:0/52: symlink d8/l14 0 2024-04-26T10:44:27.893 INFO:tasks.workunit.client.0.smithi049.stdout:5/59: readlink l6 0 2024-04-26T10:44:27.893 INFO:tasks.workunit.client.0.smithi049.stdout:7/75: stat f0 0 2024-04-26T10:44:27.893 INFO:tasks.workunit.client.0.smithi049.stdout:6/53: mkdir da/dd/de/d11 0 2024-04-26T10:44:27.893 INFO:tasks.workunit.client.0.smithi049.stdout:1/56: creat f11 x:0 0 0 2024-04-26T10:44:27.893 INFO:tasks.workunit.client.0.smithi049.stdout:5/60: stat l6 0 2024-04-26T10:44:27.894 INFO:tasks.workunit.client.0.smithi049.stdout:3/54: creat d3/d6/f10 x:0 0 0 2024-04-26T10:44:27.895 INFO:tasks.workunit.client.0.smithi049.stdout:9/163: dread d2/d1a/df/f13 [0,4194304] 0 2024-04-26T10:44:27.895 INFO:tasks.workunit.client.0.smithi049.stdout:5/61: write f3 [3144404,56099] 0 2024-04-26T10:44:27.895 INFO:tasks.workunit.client.0.smithi049.stdout:0/53: rename l5 to d8/db/l15 0 2024-04-26T10:44:27.896 INFO:tasks.workunit.client.0.smithi049.stdout:7/76: write d2/dd/f11 [4305019,16625] 0 2024-04-26T10:44:27.899 INFO:tasks.workunit.client.0.smithi049.stdout:4/117: dread de/f12 [0,4194304] 0 2024-04-26T10:44:27.905 INFO:tasks.workunit.client.0.smithi049.stdout:6/54: write f4 [988093,63379] 0 2024-04-26T10:44:27.906 INFO:tasks.workunit.client.0.smithi049.stdout:7/77: creat d2/dd/f14 x:0 0 0 2024-04-26T10:44:27.907 INFO:tasks.workunit.client.0.smithi049.stdout:4/118: write de/d1b/f1c [143411,10149] 0 2024-04-26T10:44:27.907 INFO:tasks.workunit.client.0.smithi049.stdout:9/164: creat d2/d1a/d1b/d1f/f32 x:0 0 0 2024-04-26T10:44:27.911 INFO:tasks.workunit.client.0.smithi049.stdout:2/76: dwrite f0 [0,4194304] 0 2024-04-26T10:44:27.912 INFO:tasks.workunit.client.0.smithi049.stdout:8/50: dwrite d2/df/d10/f13 [0,4194304] 0 2024-04-26T10:44:27.912 INFO:tasks.workunit.client.0.smithi049.stdout:3/55: link d3/d6/f7 d3/de/d8/db/f11 0 2024-04-26T10:44:27.913 INFO:tasks.workunit.client.0.smithi049.stdout:1/57: dwrite f11 [0,4194304] 0 2024-04-26T10:44:27.913 INFO:tasks.workunit.client.0.smithi049.stdout:7/78: readlink d2/lf 0 2024-04-26T10:44:27.914 INFO:tasks.workunit.client.0.smithi049.stdout:9/165: symlink d2/d25/l33 0 2024-04-26T10:44:27.914 INFO:tasks.workunit.client.0.smithi049.stdout:2/77: rmdir d6/d9 39 2024-04-26T10:44:27.917 INFO:tasks.workunit.client.0.smithi049.stdout:8/51: fsync d2/f9 0 2024-04-26T10:44:27.920 INFO:tasks.workunit.client.0.smithi049.stdout:0/54: dwrite d8/f9 [0,4194304] 0 2024-04-26T10:44:27.920 INFO:tasks.workunit.client.0.smithi049.stdout:6/55: dread f4 [0,4194304] 0 2024-04-26T10:44:27.921 INFO:tasks.workunit.client.0.smithi049.stdout:5/62: dwrite d7/fc [0,4194304] 0 2024-04-26T10:44:27.922 INFO:tasks.workunit.client.0.smithi049.stdout:2/78: fsync d6/f8 0 2024-04-26T10:44:27.923 INFO:tasks.workunit.client.0.smithi049.stdout:8/52: creat d2/f14 x:0 0 0 2024-04-26T10:44:27.923 INFO:tasks.workunit.client.0.smithi049.stdout:5/63: rename d7 to d7/d16 22 2024-04-26T10:44:27.923 INFO:tasks.workunit.client.0.smithi049.stdout:4/119: truncate f9 4100837 0 2024-04-26T10:44:27.926 INFO:tasks.workunit.client.0.smithi049.stdout:3/56: getdents d3/d6 0 2024-04-26T10:44:27.928 INFO:tasks.workunit.client.0.smithi049.stdout:2/79: creat d6/d9/f19 x:0 0 0 2024-04-26T10:44:27.928 INFO:tasks.workunit.client.0.smithi049.stdout:4/120: fsync f9 0 2024-04-26T10:44:27.930 INFO:tasks.workunit.client.0.smithi049.stdout:6/56: creat da/dd/de/d11/f12 x:0 0 0 2024-04-26T10:44:27.931 INFO:tasks.workunit.client.0.smithi049.stdout:2/80: rmdir d6 39 2024-04-26T10:44:27.934 INFO:tasks.workunit.client.0.smithi049.stdout:1/58: dwrite fb [0,4194304] 0 2024-04-26T10:44:27.935 INFO:tasks.workunit.client.0.smithi049.stdout:7/79: dwrite d2/f6 [0,4194304] 0 2024-04-26T10:44:27.936 INFO:tasks.workunit.client.0.smithi049.stdout:6/57: write f9 [517838,507] 0 2024-04-26T10:44:27.938 INFO:tasks.workunit.client.0.smithi049.stdout:1/59: creat f12 x:0 0 0 2024-04-26T10:44:27.938 INFO:tasks.workunit.client.0.smithi049.stdout:0/55: dwrite f3 [0,4194304] 0 2024-04-26T10:44:27.938 INFO:tasks.workunit.client.0.smithi049.stdout:3/57: truncate d3/d6/f7 1572100 0 2024-04-26T10:44:27.939 INFO:tasks.workunit.client.0.smithi049.stdout:4/121: creat de/d1d/f23 x:0 0 0 2024-04-26T10:44:27.939 INFO:tasks.workunit.client.0.smithi049.stdout:7/80: mknod d2/dd/c15 0 2024-04-26T10:44:27.939 INFO:tasks.workunit.client.0.smithi049.stdout:1/60: symlink l13 0 2024-04-26T10:44:27.940 INFO:tasks.workunit.client.0.smithi049.stdout:8/53: dread d2/f9 [0,4194304] 0 2024-04-26T10:44:27.941 INFO:tasks.workunit.client.0.smithi049.stdout:2/81: write d6/d9/fc [609915,15226] 0 2024-04-26T10:44:27.941 INFO:tasks.workunit.client.0.smithi049.stdout:9/166: dwrite d2/d1a/df/f26 [0,4194304] 0 2024-04-26T10:44:27.941 INFO:tasks.workunit.client.0.smithi049.stdout:1/61: chown c1 28428581 1 2024-04-26T10:44:27.942 INFO:tasks.workunit.client.0.smithi049.stdout:5/64: dwrite f3 [4194304,4194304] 0 2024-04-26T10:44:27.943 INFO:tasks.workunit.client.0.smithi049.stdout:0/56: symlink d8/db/d11/l16 0 2024-04-26T10:44:27.943 INFO:tasks.workunit.client.0.smithi049.stdout:1/62: read f11 [594457,11169] 0 2024-04-26T10:44:27.943 INFO:tasks.workunit.client.0.smithi049.stdout:7/81: write d2/dd/f11 [3067178,21443] 0 2024-04-26T10:44:27.943 INFO:tasks.workunit.client.0.smithi049.stdout:1/63: rmdir - no directory 2024-04-26T10:44:27.943 INFO:tasks.workunit.client.0.smithi049.stdout:1/64: fsync fd 0 2024-04-26T10:44:27.944 INFO:tasks.workunit.client.0.smithi049.stdout:8/54: rmdir d2/df/d10 39 2024-04-26T10:44:27.945 INFO:tasks.workunit.client.0.smithi049.stdout:0/57: symlink d8/db/l17 0 2024-04-26T10:44:27.945 INFO:tasks.workunit.client.0.smithi049.stdout:7/82: creat d2/d3/f16 x:0 0 0 2024-04-26T10:44:27.945 INFO:tasks.workunit.client.0.smithi049.stdout:5/65: creat d7/d14/f17 x:0 0 0 2024-04-26T10:44:27.946 INFO:tasks.workunit.client.0.smithi049.stdout:7/83: stat d2/fc 0 2024-04-26T10:44:27.946 INFO:tasks.workunit.client.0.smithi049.stdout:1/65: write f10 [239735,104069] 0 2024-04-26T10:44:27.946 INFO:tasks.workunit.client.0.smithi049.stdout:5/66: read f3 [3482979,46476] 0 2024-04-26T10:44:27.947 INFO:tasks.workunit.client.0.smithi049.stdout:1/66: stat f10 0 2024-04-26T10:44:27.947 INFO:tasks.workunit.client.0.smithi049.stdout:7/84: fdatasync d2/fc 0 2024-04-26T10:44:27.948 INFO:tasks.workunit.client.0.smithi049.stdout:0/58: chown d8/db/d11/l16 960 1 2024-04-26T10:44:27.948 INFO:tasks.workunit.client.0.smithi049.stdout:5/67: fdatasync d7/f10 0 2024-04-26T10:44:27.953 INFO:tasks.workunit.client.0.smithi049.stdout:6/58: read f9 [415351,127050] 0 2024-04-26T10:44:27.953 INFO:tasks.workunit.client.0.smithi049.stdout:1/67: symlink l14 0 2024-04-26T10:44:27.953 INFO:tasks.workunit.client.0.smithi049.stdout:0/59: readlink d8/l14 0 2024-04-26T10:44:27.953 INFO:tasks.workunit.client.0.smithi049.stdout:1/68: stat fa 0 2024-04-26T10:44:27.953 INFO:tasks.workunit.client.0.smithi049.stdout:5/68: readlink l6 0 2024-04-26T10:44:27.953 INFO:tasks.workunit.client.0.smithi049.stdout:3/58: dread f1 [0,4194304] 0 2024-04-26T10:44:27.954 INFO:tasks.workunit.client.0.smithi049.stdout:7/85: chown d2/fc 15369371 1 2024-04-26T10:44:27.954 INFO:tasks.workunit.client.0.smithi049.stdout:8/55: truncate d2/fe 2569957 0 2024-04-26T10:44:27.954 INFO:tasks.workunit.client.0.smithi049.stdout:6/59: dread - da/ff zero size 2024-04-26T10:44:27.955 INFO:tasks.workunit.client.0.smithi049.stdout:2/82: dread f3 [4194304,4194304] 0 2024-04-26T10:44:27.955 INFO:tasks.workunit.client.0.smithi049.stdout:3/59: chown d3/d6 1 1 2024-04-26T10:44:27.955 INFO:tasks.workunit.client.0.smithi049.stdout:1/69: rename lc to l15 0 2024-04-26T10:44:27.956 INFO:tasks.workunit.client.0.smithi049.stdout:5/69: mkdir d7/d14/d18 0 2024-04-26T10:44:27.956 INFO:tasks.workunit.client.0.smithi049.stdout:7/86: creat d2/dd/f17 x:0 0 0 2024-04-26T10:44:27.957 INFO:tasks.workunit.client.0.smithi049.stdout:1/70: creat f16 x:0 0 0 2024-04-26T10:44:27.957 INFO:tasks.workunit.client.0.smithi049.stdout:3/60: chown d3/c4 1 1 2024-04-26T10:44:27.958 INFO:tasks.workunit.client.0.smithi049.stdout:8/56: mknod d2/df/d10/c15 0 2024-04-26T10:44:27.958 INFO:tasks.workunit.client.0.smithi049.stdout:2/83: mknod d6/d9/c1a 0 2024-04-26T10:44:27.959 INFO:tasks.workunit.client.0.smithi049.stdout:4/122: dwrite de/f14 [0,4194304] 0 2024-04-26T10:44:27.961 INFO:tasks.workunit.client.0.smithi049.stdout:7/87: symlink d2/d3/de/l18 0 2024-04-26T10:44:27.962 INFO:tasks.workunit.client.0.smithi049.stdout:3/61: creat d3/d6/f12 x:0 0 0 2024-04-26T10:44:27.962 INFO:tasks.workunit.client.0.smithi049.stdout:4/123: chown de/d1b 221590405 1 2024-04-26T10:44:27.963 INFO:tasks.workunit.client.0.smithi049.stdout:2/84: symlink d6/d9/db/df/l1b 0 2024-04-26T10:44:27.963 INFO:tasks.workunit.client.0.smithi049.stdout:9/167: dwrite d2/d1a/df/f13 [4194304,4194304] 0 2024-04-26T10:44:27.966 INFO:tasks.workunit.client.0.smithi049.stdout:3/62: write d3/de/d8/f9 [2135563,102487] 0 2024-04-26T10:44:27.967 INFO:tasks.workunit.client.0.smithi049.stdout:7/88: mknod d2/dd/c19 0 2024-04-26T10:44:27.967 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:27.967 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:27.969 INFO:tasks.workunit.client.0.smithi049.stdout:2/85: unlink d6/d9/db/ce 0 2024-04-26T10:44:27.971 INFO:tasks.workunit.client.0.smithi049.stdout:0/60: dwrite d8/f9 [0,4194304] 0 2024-04-26T10:44:27.971 INFO:tasks.workunit.client.0.smithi049.stdout:4/124: write de/d20/f22 [1874064,59097] 0 2024-04-26T10:44:27.972 INFO:tasks.workunit.client.0.smithi049.stdout:5/70: dwrite d7/f10 [0,4194304] 0 2024-04-26T10:44:27.972 INFO:tasks.workunit.client.0.smithi049.stdout:7/89: symlink d2/d3/l1a 0 2024-04-26T10:44:27.974 INFO:tasks.workunit.client.0.smithi049.stdout:3/63: rename d3/c4 to d3/c13 0 2024-04-26T10:44:27.974 INFO:tasks.workunit.client.0.smithi049.stdout:1/71: dread f11 [0,4194304] 0 2024-04-26T10:44:27.974 INFO:tasks.workunit.client.0.smithi049.stdout:7/90: rmdir d2 39 2024-04-26T10:44:27.974 INFO:tasks.workunit.client.0.smithi049.stdout:4/125: rmdir de/d1d 39 2024-04-26T10:44:27.975 INFO:tasks.workunit.client.0.smithi049.stdout:2/86: rename d6/fd to d6/d9/db/f1c 0 2024-04-26T10:44:27.976 INFO:tasks.workunit.client.0.smithi049.stdout:3/64: symlink d3/l14 0 2024-04-26T10:44:27.977 INFO:tasks.workunit.client.0.smithi049.stdout:8/57: truncate d2/fe 686833 0 2024-04-26T10:44:27.977 INFO:tasks.workunit.client.0.smithi049.stdout:7/91: fdatasync d2/dd/f14 0 2024-04-26T10:44:27.977 INFO:tasks.workunit.client.0.smithi049.stdout:4/126: mkdir de/d20/d24 0 2024-04-26T10:44:27.978 INFO:tasks.workunit.client.0.smithi049.stdout:1/72: write fa [709117,7929] 0 2024-04-26T10:44:27.981 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:27.983 INFO:tasks.workunit.client.0.smithi049.stdout:7/92: rmdir d2/dd 39 2024-04-26T10:44:27.983 INFO:tasks.workunit.client.0.smithi049.stdout:2/87: unlink d6/d9/db/df/c15 0 2024-04-26T10:44:27.983 INFO:tasks.workunit.client.0.smithi049.stdout:8/58: fdatasync d2/f6 0 2024-04-26T10:44:27.983 INFO:tasks.workunit.client.0.smithi049.stdout:6/60: dwrite f7 [0,4194304] 0 2024-04-26T10:44:27.984 INFO:tasks.workunit.client.0.smithi049.stdout:1/73: chown l3 288549791 1 2024-04-26T10:44:27.984 INFO:tasks.workunit.client.0.smithi049.stdout:9/168: dwrite d2/d25/f2e [0,4194304] 0 2024-04-26T10:44:27.984 INFO:tasks.workunit.client.0.smithi049.stdout:4/127: write de/f14 [4040875,67014] 0 2024-04-26T10:44:27.984 INFO:tasks.workunit.client.0.smithi049.stdout:7/93: creat d2/f1b x:0 0 0 2024-04-26T10:44:27.984 INFO:tasks.workunit.client.0.smithi049.stdout:1/74: dread f0 [4194304,4194304] 0 2024-04-26T10:44:27.985 INFO:tasks.workunit.client.0.smithi049.stdout:8/59: sync 2024-04-26T10:44:27.985 INFO:tasks.workunit.client.0.smithi049.stdout:5/71: dread f3 [0,4194304] 0 2024-04-26T10:44:27.985 INFO:tasks.workunit.client.0.smithi049.stdout:6/61: sync 2024-04-26T10:44:27.985 INFO:tasks.workunit.client.0.smithi049.stdout:6/62: sync 2024-04-26T10:44:27.985 INFO:tasks.workunit.client.0.smithi049.stdout:0/61: dread f1 [0,4194304] 0 2024-04-26T10:44:27.986 INFO:tasks.workunit.client.0.smithi049.stdout:4/128: creat de/d20/f25 x:0 0 0 2024-04-26T10:44:27.986 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:27.983+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:27.987 INFO:tasks.workunit.client.0.smithi049.stdout:1/75: rename c1 to c17 0 2024-04-26T10:44:27.988 INFO:tasks.workunit.client.0.smithi049.stdout:8/60: stat d2/f6 0 2024-04-26T10:44:27.988 INFO:tasks.workunit.client.0.smithi049.stdout:0/62: read f1 [3707631,74644] 0 2024-04-26T10:44:27.989 INFO:tasks.workunit.client.0.smithi049.stdout:7/94: rmdir d2 39 2024-04-26T10:44:27.989 INFO:tasks.workunit.client.0.smithi049.stdout:5/72: truncate d7/f9 1084662 0 2024-04-26T10:44:27.989 INFO:tasks.workunit.client.0.smithi049.stdout:6/63: dread - da/dd/f10 zero size 2024-04-26T10:44:27.989 INFO:tasks.workunit.client.0.smithi049.stdout:7/95: sync 2024-04-26T10:44:27.989 INFO:tasks.workunit.client.0.smithi049.stdout:2/88: getdents d6/d9/db/d11 0 2024-04-26T10:44:27.989 INFO:tasks.workunit.client.0.smithi049.stdout:4/129: creat de/d1b/f26 x:0 0 0 2024-04-26T10:44:27.989 INFO:tasks.workunit.client.0.smithi049.stdout:1/76: rename c8 to c18 0 2024-04-26T10:44:27.989 INFO:tasks.workunit.client.0.smithi049.stdout:1/77: fdatasync fe 0 2024-04-26T10:44:27.990 INFO:tasks.workunit.client.0.smithi049.stdout:8/61: fsync d2/f9 0 2024-04-26T10:44:27.991 INFO:tasks.workunit.client.0.smithi049.stdout:5/73: write f3 [7330516,56677] 0 2024-04-26T10:44:27.992 INFO:tasks.workunit.client.0.smithi049.stdout:1/78: stat l14 0 2024-04-26T10:44:27.993 INFO:tasks.workunit.client.0.smithi049.stdout:7/96: mkdir d2/d3/de/d1c 0 2024-04-26T10:44:27.994 INFO:tasks.workunit.client.0.smithi049.stdout:9/169: dread d2/f8 [0,4194304] 0 2024-04-26T10:44:27.994 INFO:tasks.workunit.client.0.smithi049.stdout:3/65: dwrite d3/d6/f10 [0,4194304] 0 2024-04-26T10:44:27.995 INFO:tasks.workunit.client.0.smithi049.stdout:2/89: link d6/f8 d6/d9/db/d11/f1d 0 2024-04-26T10:44:27.995 INFO:tasks.workunit.client.0.smithi049.stdout:1/79: write fd [1831132,6902] 0 2024-04-26T10:44:27.995 INFO:tasks.workunit.client.0.smithi049.stdout:5/74: mknod d7/d14/d18/c19 0 2024-04-26T10:44:27.998 INFO:tasks.workunit.client.0.smithi049.stdout:3/66: mknod d3/de/c15 0 2024-04-26T10:44:27.998 INFO:tasks.workunit.client.0.smithi049.stdout:2/90: read d6/d9/db/df/f12 [3142276,63086] 0 2024-04-26T10:44:27.999 INFO:tasks.workunit.client.0.smithi049.stdout:9/170: mkdir d2/d1a/d1b/d1f/d34 0 2024-04-26T10:44:27.999 INFO:tasks.workunit.client.0.smithi049.stdout:5/75: creat d7/d14/f1a x:0 0 0 2024-04-26T10:44:27.999 INFO:tasks.workunit.client.0.smithi049.stdout:1/80: write f0 [1529539,27371] 0 2024-04-26T10:44:28.000 INFO:tasks.workunit.client.0.smithi049.stdout:7/97: creat d2/d3/de/d1c/f1d x:0 0 0 2024-04-26T10:44:28.000 INFO:tasks.workunit.client.0.smithi049.stdout:0/63: dread f2 [0,4194304] 0 2024-04-26T10:44:28.001 INFO:tasks.workunit.client.0.smithi049.stdout:5/76: fdatasync f3 0 2024-04-26T10:44:28.001 INFO:tasks.workunit.client.0.smithi049.stdout:1/81: chown f9 13037 1 2024-04-26T10:44:28.002 INFO:tasks.workunit.client.0.smithi049.stdout:1/82: rmdir - no directory 2024-04-26T10:44:28.002 INFO:tasks.workunit.client.0.smithi049.stdout:6/64: dwrite f1 [0,4194304] 0 2024-04-26T10:44:28.002 INFO:tasks.workunit.client.0.smithi049.stdout:2/91: mkdir d6/d9/db/d1e 0 2024-04-26T10:44:28.002 INFO:tasks.workunit.client.0.smithi049.stdout:0/64: fsync f3 0 2024-04-26T10:44:28.003 INFO:tasks.workunit.client.0.smithi049.stdout:7/98: creat d2/d3/de/f1e x:0 0 0 2024-04-26T10:44:28.004 INFO:tasks.workunit.client.0.smithi049.stdout:1/83: read - f12 zero size 2024-04-26T10:44:28.004 INFO:tasks.workunit.client.0.smithi049.stdout:4/130: dwrite de/f15 [4194304,4194304] 0 2024-04-26T10:44:28.004 INFO:tasks.workunit.client.0.smithi049.stdout:1/84: sync 2024-04-26T10:44:28.004 INFO:tasks.workunit.client.0.smithi049.stdout:6/65: chown da/dd/f10 13346 1 2024-04-26T10:44:28.004 INFO:tasks.workunit.client.0.smithi049.stdout:6/66: sync 2024-04-26T10:44:28.006 INFO:tasks.workunit.client.0.smithi049.stdout:8/62: write d2/fe [1001034,34715] 0 2024-04-26T10:44:28.006 INFO:tasks.workunit.client.0.smithi049.stdout:7/99: creat d2/d3/f1f x:0 0 0 2024-04-26T10:44:28.008 INFO:tasks.workunit.client.0.smithi049.stdout:1/85: rename f10 to f19 0 2024-04-26T10:44:28.008 INFO:tasks.workunit.client.0.smithi049.stdout:3/67: dread d3/d6/f10 [0,4194304] 0 2024-04-26T10:44:28.008 INFO:tasks.workunit.client.0.smithi049.stdout:5/77: read d7/ff [1171052,47878] 0 2024-04-26T10:44:28.009 INFO:tasks.workunit.client.0.smithi049.stdout:0/65: rename f1 to d8/f18 0 2024-04-26T10:44:28.009 INFO:tasks.workunit.client.0.smithi049.stdout:1/86: chown l6 1485 1 2024-04-26T10:44:28.010 INFO:tasks.workunit.client.0.smithi049.stdout:2/92: getdents d6/d9/db/d11 0 2024-04-26T10:44:28.010 INFO:tasks.workunit.client.0.smithi049.stdout:5/78: creat d7/d14/f1b x:0 0 0 2024-04-26T10:44:28.011 INFO:tasks.workunit.client.0.smithi049.stdout:7/100: truncate d2/dd/f17 678810 0 2024-04-26T10:44:28.011 INFO:tasks.workunit.client.0.smithi049.stdout:1/87: write f12 [301991,104408] 0 2024-04-26T10:44:28.012 INFO:tasks.workunit.client.0.smithi049.stdout:5/79: chown d7/lb 576 1 2024-04-26T10:44:28.012 INFO:tasks.workunit.client.0.smithi049.stdout:9/171: dwrite d2/d1a/df/f26 [0,4194304] 0 2024-04-26T10:44:28.012 INFO:tasks.workunit.client.0.smithi049.stdout:9/172: sync 2024-04-26T10:44:28.012 INFO:tasks.workunit.client.0.smithi049.stdout:2/93: dread - d6/d9/db/f13 zero size 2024-04-26T10:44:28.013 INFO:tasks.workunit.client.0.smithi049.stdout:4/131: dread de/f14 [0,4194304] 0 2024-04-26T10:44:28.013 INFO:tasks.workunit.client.0.smithi049.stdout:1/88: creat f1a x:0 0 0 2024-04-26T10:44:28.013 INFO:tasks.workunit.client.0.smithi049.stdout:3/68: dread d3/de/d8/db/f11 [0,4194304] 0 2024-04-26T10:44:28.014 INFO:tasks.workunit.client.0.smithi049.stdout:7/101: rename d2/fa to d2/d3/f20 0 2024-04-26T10:44:28.014 INFO:tasks.workunit.client.0.smithi049.stdout:1/89: fsync f16 0 2024-04-26T10:44:28.015 INFO:tasks.workunit.client.0.smithi049.stdout:9/173: chown d2/d1a/df/f13 1 1 2024-04-26T10:44:28.015 INFO:tasks.workunit.client.0.smithi049.stdout:5/80: write f4 [1201153,6391] 0 2024-04-26T10:44:28.016 INFO:tasks.workunit.client.0.smithi049.stdout:1/90: rename l3 to l1b 0 2024-04-26T10:44:28.016 INFO:tasks.workunit.client.0.smithi049.stdout:3/69: write d3/de/d8/dd/ff [826608,32564] 0 2024-04-26T10:44:28.016 INFO:tasks.workunit.client.0.smithi049.stdout:8/63: dwrite d2/f8 [0,4194304] 0 2024-04-26T10:44:28.018 INFO:tasks.workunit.client.0.smithi049.stdout:8/64: mkdir d2/d16 0 2024-04-26T10:44:28.018 INFO:tasks.workunit.client.0.smithi049.stdout:0/66: getdents d8 0 2024-04-26T10:44:28.019 INFO:tasks.workunit.client.0.smithi049.stdout:5/81: dread f4 [0,4194304] 0 2024-04-26T10:44:28.019 INFO:tasks.workunit.client.0.smithi049.stdout:6/67: fsync f1 0 2024-04-26T10:44:28.019 INFO:tasks.workunit.client.0.smithi049.stdout:8/65: fdatasync d2/df/d10/f13 0 2024-04-26T10:44:28.020 INFO:tasks.workunit.client.0.smithi049.stdout:3/70: truncate d3/de/d8/dd/ff 1364701 0 2024-04-26T10:44:28.020 INFO:tasks.workunit.client.0.smithi049.stdout:5/82: symlink d7/d14/d18/l1c 0 2024-04-26T10:44:28.020 INFO:tasks.workunit.client.0.smithi049.stdout:6/68: truncate f8 823166 0 2024-04-26T10:44:28.021 INFO:tasks.workunit.client.0.smithi049.stdout:4/132: dread f7 [0,4194304] 0 2024-04-26T10:44:28.021 INFO:tasks.workunit.client.0.smithi049.stdout:5/83: mkdir d7/d1d 0 2024-04-26T10:44:28.022 INFO:tasks.workunit.client.0.smithi049.stdout:0/67: getdents d8/db/d11 0 2024-04-26T10:44:28.022 INFO:tasks.workunit.client.0.smithi049.stdout:2/94: truncate f3 4257302 0 2024-04-26T10:44:28.022 INFO:tasks.workunit.client.0.smithi049.stdout:9/174: dread d2/d1a/df/f30 [0,4194304] 0 2024-04-26T10:44:28.022 INFO:tasks.workunit.client.0.smithi049.stdout:6/69: dread f5 [0,4194304] 0 2024-04-26T10:44:28.023 INFO:tasks.workunit.client.0.smithi049.stdout:2/95: stat d6/d9/c1a 0 2024-04-26T10:44:28.023 INFO:tasks.workunit.client.0.smithi049.stdout:3/71: creat d3/de/d8/db/f16 x:0 0 0 2024-04-26T10:44:28.024 INFO:tasks.workunit.client.0.smithi049.stdout:1/91: rename l1b to l1c 0 2024-04-26T10:44:28.025 INFO:tasks.workunit.client.0.smithi049.stdout:4/133: rename fc to de/f27 0 2024-04-26T10:44:28.025 INFO:tasks.workunit.client.0.smithi049.stdout:7/102: dwrite d2/d3/f1f [0,4194304] 0 2024-04-26T10:44:28.028 INFO:tasks.workunit.client.0.smithi049.stdout:5/84: rename f4 to d7/d14/d18/f1e 0 2024-04-26T10:44:28.029 INFO:tasks.workunit.client.0.smithi049.stdout:3/72: write d3/d6/f12 [853250,80437] 0 2024-04-26T10:44:28.029 INFO:tasks.workunit.client.0.smithi049.stdout:5/85: sync 2024-04-26T10:44:28.033 INFO:tasks.workunit.client.0.smithi049.stdout:8/66: dwrite d2/f5 [0,4194304] 0 2024-04-26T10:44:28.036 INFO:tasks.workunit.client.0.smithi049.stdout:0/68: dread f3 [0,4194304] 0 2024-04-26T10:44:28.037 INFO:tasks.workunit.client.0.smithi049.stdout:7/103: symlink d2/d3/de/d1c/l21 0 2024-04-26T10:44:28.039 INFO:tasks.workunit.client.0.smithi049.stdout:8/67: mkdir d2/d17 0 2024-04-26T10:44:28.040 INFO:tasks.workunit.client.0.smithi049.stdout:9/175: dwrite d2/d1a/df/f13 [0,4194304] 0 2024-04-26T10:44:28.040 INFO:tasks.workunit.client.0.smithi049.stdout:6/70: dwrite f8 [0,4194304] 0 2024-04-26T10:44:28.040 INFO:tasks.workunit.client.0.smithi049.stdout:3/73: dread d3/de/d8/db/f11 [0,4194304] 0 2024-04-26T10:44:28.041 INFO:tasks.workunit.client.0.smithi049.stdout:5/86: mkdir d7/d1d/d1f 0 2024-04-26T10:44:28.041 INFO:tasks.workunit.client.0.smithi049.stdout:1/92: dwrite fb [0,4194304] 0 2024-04-26T10:44:28.041 INFO:tasks.workunit.client.0.smithi049.stdout:0/69: rename d8/cc to d8/db/d11/c19 0 2024-04-26T10:44:28.042 INFO:tasks.workunit.client.0.smithi049.stdout:8/68: chown d2/df/d10 15 1 2024-04-26T10:44:28.042 INFO:tasks.workunit.client.0.smithi049.stdout:2/96: dwrite d6/d9/db/f13 [0,4194304] 0 2024-04-26T10:44:28.043 INFO:tasks.workunit.client.0.smithi049.stdout:7/104: creat d2/f22 x:0 0 0 2024-04-26T10:44:28.045 INFO:tasks.workunit.client.0.smithi049.stdout:1/93: unlink c18 0 2024-04-26T10:44:28.045 INFO:tasks.workunit.client.0.smithi049.stdout:6/71: creat da/dd/f13 x:0 0 0 2024-04-26T10:44:28.045 INFO:tasks.workunit.client.0.smithi049.stdout:9/176: rename d2/f3 to d2/d1a/df/f35 0 2024-04-26T10:44:28.046 INFO:tasks.workunit.client.0.smithi049.stdout:2/97: symlink d6/d9/l1f 0 2024-04-26T10:44:28.046 INFO:tasks.workunit.client.0.smithi049.stdout:6/72: readlink l3 0 2024-04-26T10:44:28.047 INFO:tasks.workunit.client.0.smithi049.stdout:4/134: dwrite de/f12 [0,4194304] 0 2024-04-26T10:44:28.049 INFO:tasks.workunit.client.0.smithi049.stdout:1/94: mkdir d1d 0 2024-04-26T10:44:28.050 INFO:tasks.workunit.client.0.smithi049.stdout:8/69: mkdir d2/df/d18 0 2024-04-26T10:44:28.051 INFO:tasks.workunit.client.0.smithi049.stdout:9/177: unlink d2/fc 0 2024-04-26T10:44:28.053 INFO:tasks.workunit.client.0.smithi049.stdout:2/98: rmdir d6/d9/db/d11 39 2024-04-26T10:44:28.053 INFO:tasks.workunit.client.0.smithi049.stdout:1/95: write f1a [922780,44526] 0 2024-04-26T10:44:28.053 INFO:tasks.workunit.client.0.smithi049.stdout:4/135: truncate de/d1b/f26 436052 0 2024-04-26T10:44:28.053 INFO:tasks.workunit.client.0.smithi049.stdout:6/73: mkdir da/dd/de/d14 0 2024-04-26T10:44:28.053 INFO:tasks.workunit.client.0.smithi049.stdout:8/70: read d2/fc [2268307,96253] 0 2024-04-26T10:44:28.056 INFO:tasks.workunit.client.0.smithi049.stdout:9/178: chown d2/d1a/le 385025 1 2024-04-26T10:44:28.056 INFO:tasks.workunit.client.0.smithi049.stdout:4/136: creat de/d20/f28 x:0 0 0 2024-04-26T10:44:28.057 INFO:tasks.workunit.client.0.smithi049.stdout:3/74: dwrite d3/d6/f12 [0,4194304] 0 2024-04-26T10:44:28.057 INFO:tasks.workunit.client.0.smithi049.stdout:6/74: mkdir da/dd/d15 0 2024-04-26T10:44:28.058 INFO:tasks.workunit.client.0.smithi049.stdout:7/105: dwrite d2/d3/f16 [0,4194304] 0 2024-04-26T10:44:28.058 INFO:tasks.workunit.client.0.smithi049.stdout:5/87: dwrite d7/ff [0,4194304] 0 2024-04-26T10:44:28.058 INFO:tasks.workunit.client.0.smithi049.stdout:8/71: write d2/f8 [1058447,37471] 0 2024-04-26T10:44:28.058 INFO:tasks.workunit.client.0.smithi049.stdout:1/96: rmdir d1d 0 2024-04-26T10:44:28.059 INFO:tasks.workunit.client.0.smithi049.stdout:9/179: truncate d2/d1a/f2a 1813628 0 2024-04-26T10:44:28.059 INFO:tasks.workunit.client.0.smithi049.stdout:8/72: fdatasync d2/f9 0 2024-04-26T10:44:28.059 INFO:tasks.workunit.client.0.smithi049.stdout:7/106: symlink d2/dd/l23 0 2024-04-26T10:44:28.059 INFO:tasks.workunit.client.0.smithi049.stdout:1/97: mkdir d1e 0 2024-04-26T10:44:28.060 INFO:tasks.workunit.client.0.smithi049.stdout:4/137: chown de/d1d/f23 7 1 2024-04-26T10:44:28.060 INFO:tasks.workunit.client.0.smithi049.stdout:6/75: truncate da/ff 217034 0 2024-04-26T10:44:28.060 INFO:tasks.workunit.client.0.smithi049.stdout:3/75: creat d3/de/d8/f17 x:0 0 0 2024-04-26T10:44:28.060 INFO:tasks.workunit.client.0.smithi049.stdout:9/180: mknod d2/d25/c36 0 2024-04-26T10:44:28.062 INFO:tasks.workunit.client.0.smithi049.stdout:1/98: write f0 [5484564,87093] 0 2024-04-26T10:44:28.062 INFO:tasks.workunit.client.0.smithi049.stdout:2/99: dread d6/f8 [0,4194304] 0 2024-04-26T10:44:28.062 INFO:tasks.workunit.client.0.smithi049.stdout:0/70: dread d8/f18 [0,4194304] 0 2024-04-26T10:44:28.062 INFO:tasks.workunit.client.0.smithi049.stdout:7/107: mknod d2/d3/de/c24 0 2024-04-26T10:44:28.062 INFO:tasks.workunit.client.0.smithi049.stdout:8/73: mkdir d2/d16/d19 0 2024-04-26T10:44:28.063 INFO:tasks.workunit.client.0.smithi049.stdout:1/99: sync 2024-04-26T10:44:28.063 INFO:tasks.workunit.client.0.smithi049.stdout:9/181: read d2/d1a/f21 [2956011,39558] 0 2024-04-26T10:44:28.063 INFO:tasks.workunit.client.0.smithi049.stdout:8/74: chown d2/f12 12 1 2024-04-26T10:44:28.063 INFO:tasks.workunit.client.0.smithi049.stdout:7/108: chown d2/d3/f20 0 1 2024-04-26T10:44:28.063 INFO:tasks.workunit.client.0.smithi049.stdout:2/100: chown d6/f7 10884 1 2024-04-26T10:44:28.064 INFO:tasks.workunit.client.0.smithi049.stdout:4/138: getdents de/d1d 0 2024-04-26T10:44:28.064 INFO:tasks.workunit.client.0.smithi049.stdout:0/71: creat d8/f1a x:0 0 0 2024-04-26T10:44:28.064 INFO:tasks.workunit.client.0.smithi049.stdout:7/109: dread - d2/d3/de/f1e zero size 2024-04-26T10:44:28.065 INFO:tasks.workunit.client.0.smithi049.stdout:4/139: write f7 [2806178,55647] 0 2024-04-26T10:44:28.065 INFO:tasks.workunit.client.0.smithi049.stdout:9/182: symlink d2/d1a/d1b/d1f/d34/l37 0 2024-04-26T10:44:28.065 INFO:tasks.workunit.client.0.smithi049.stdout:1/100: creat d1e/f1f x:0 0 0 2024-04-26T10:44:28.066 INFO:tasks.workunit.client.0.smithi049.stdout:7/110: readlink d2/d3/l8 0 2024-04-26T10:44:28.066 INFO:tasks.workunit.client.0.smithi049.stdout:2/101: mknod d6/d9/db/d11/c20 0 2024-04-26T10:44:28.067 INFO:tasks.workunit.client.0.smithi049.stdout:1/101: mkdir d1e/d20 0 2024-04-26T10:44:28.067 INFO:tasks.workunit.client.0.smithi049.stdout:0/72: mkdir d8/db/d11/d1b 0 2024-04-26T10:44:28.067 INFO:tasks.workunit.client.0.smithi049.stdout:4/140: fdatasync de/d1d/f23 0 2024-04-26T10:44:28.068 INFO:tasks.workunit.client.0.smithi049.stdout:7/111: dread - d2/f22 zero size 2024-04-26T10:44:28.068 INFO:tasks.workunit.client.0.smithi049.stdout:3/76: fsync d3/de/d8/f17 0 2024-04-26T10:44:28.069 INFO:tasks.workunit.client.0.smithi049.stdout:5/88: truncate d7/f10 421572 0 2024-04-26T10:44:28.070 INFO:tasks.workunit.client.0.smithi049.stdout:6/76: dwrite f8 [4194304,4194304] 0 2024-04-26T10:44:28.070 INFO:tasks.workunit.client.0.smithi049.stdout:6/77: sync 2024-04-26T10:44:28.070 INFO:tasks.workunit.client.0.smithi049.stdout:1/102: symlink d1e/l21 0 2024-04-26T10:44:28.071 INFO:tasks.workunit.client.0.smithi049.stdout:0/73: mkdir d8/db/d11/d1c 0 2024-04-26T10:44:28.071 INFO:tasks.workunit.client.0.smithi049.stdout:1/103: readlink l4 0 2024-04-26T10:44:28.071 INFO:tasks.workunit.client.0.smithi049.stdout:7/112: unlink d2/dd/l23 0 2024-04-26T10:44:28.073 INFO:tasks.workunit.client.0.smithi049.stdout:2/102: creat d6/d9/db/d1e/f21 x:0 0 0 2024-04-26T10:44:28.073 INFO:tasks.workunit.client.0.smithi049.stdout:6/78: symlink da/l16 0 2024-04-26T10:44:28.073 INFO:tasks.workunit.client.0.smithi049.stdout:8/75: dwrite d2/fe [0,4194304] 0 2024-04-26T10:44:28.073 INFO:tasks.workunit.client.0.smithi049.stdout:5/89: write d7/d14/f1b [1018474,115845] 0 2024-04-26T10:44:28.073 INFO:tasks.workunit.client.0.smithi049.stdout:3/77: fsync d3/de/d8/db/f16 0 2024-04-26T10:44:28.074 INFO:tasks.workunit.client.0.smithi049.stdout:7/113: mkdir d2/dd/d25 0 2024-04-26T10:44:28.075 INFO:tasks.workunit.client.0.smithi049.stdout:8/76: mkdir d2/d1a 0 2024-04-26T10:44:28.075 INFO:tasks.workunit.client.0.smithi049.stdout:7/114: dread f0 [0,4194304] 0 2024-04-26T10:44:28.075 INFO:tasks.workunit.client.0.smithi049.stdout:5/90: mkdir d7/d1d/d20 0 2024-04-26T10:44:28.076 INFO:tasks.workunit.client.0.smithi049.stdout:7/115: sync 2024-04-26T10:44:28.076 INFO:tasks.workunit.client.0.smithi049.stdout:8/77: chown d2/df/d18 14718850 1 2024-04-26T10:44:28.076 INFO:tasks.workunit.client.0.smithi049.stdout:6/79: write f9 [1352888,75505] 0 2024-04-26T10:44:28.077 INFO:tasks.workunit.client.0.smithi049.stdout:4/141: dread de/d1b/f26 [0,4194304] 0 2024-04-26T10:44:28.077 INFO:tasks.workunit.client.0.smithi049.stdout:9/183: dwrite d2/d1a/d1b/f16 [0,4194304] 0 2024-04-26T10:44:28.078 INFO:tasks.workunit.client.0.smithi049.stdout:5/91: creat d7/d14/d18/f21 x:0 0 0 2024-04-26T10:44:28.078 INFO:tasks.workunit.client.0.smithi049.stdout:6/80: truncate f6 548489 0 2024-04-26T10:44:28.080 INFO:tasks.workunit.client.0.smithi049.stdout:7/116: link d2/d3/f20 d2/dd/f26 0 2024-04-26T10:44:28.080 INFO:tasks.workunit.client.0.smithi049.stdout:1/104: read f1a [560333,8972] 0 2024-04-26T10:44:28.081 INFO:tasks.workunit.client.0.smithi049.stdout:0/74: write d8/f18 [136954,56827] 0 2024-04-26T10:44:28.081 INFO:tasks.workunit.client.0.smithi049.stdout:8/78: getdents d2/df/d10 0 2024-04-26T10:44:28.082 INFO:tasks.workunit.client.0.smithi049.stdout:8/79: sync 2024-04-26T10:44:28.082 INFO:tasks.workunit.client.0.smithi049.stdout:9/184: write d2/d1a/d1b/f24 [1594381,12876] 0 2024-04-26T10:44:28.082 INFO:tasks.workunit.client.0.smithi049.stdout:7/117: unlink d2/d3/f1f 0 2024-04-26T10:44:28.082 INFO:tasks.workunit.client.0.smithi049.stdout:7/118: sync 2024-04-26T10:44:28.083 INFO:tasks.workunit.client.0.smithi049.stdout:1/105: symlink d1e/d20/l22 0 2024-04-26T10:44:28.084 INFO:tasks.workunit.client.0.smithi049.stdout:3/78: dwrite d3/de/d8/f9 [4194304,4194304] 0 2024-04-26T10:44:28.084 INFO:tasks.workunit.client.0.smithi049.stdout:9/185: fdatasync d2/d1a/fd 0 2024-04-26T10:44:28.085 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:28.084+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:28.086 INFO:tasks.workunit.client.0.smithi049.stdout:2/103: truncate f0 382835 0 2024-04-26T10:44:28.086 INFO:tasks.workunit.client.0.smithi049.stdout:3/79: chown d3/de/d8 1581 1 2024-04-26T10:44:28.086 INFO:tasks.workunit.client.0.smithi049.stdout:3/80: sync 2024-04-26T10:44:28.088 INFO:tasks.workunit.client.0.smithi049.stdout:9/186: creat d2/d1a/f38 x:0 0 0 2024-04-26T10:44:28.088 INFO:tasks.workunit.client.0.smithi049.stdout:7/119: mkdir d2/dd/d25/d27 0 2024-04-26T10:44:28.088 INFO:tasks.workunit.client.0.smithi049.stdout:5/92: dwrite d7/ff [0,4194304] 0 2024-04-26T10:44:28.089 INFO:tasks.workunit.client.0.smithi049.stdout:6/81: write da/ff [317922,49004] 0 2024-04-26T10:44:28.090 INFO:tasks.workunit.client.0.smithi049.stdout:1/106: read fd [1273187,41828] 0 2024-04-26T10:44:28.091 INFO:tasks.workunit.client.0.smithi049.stdout:7/120: chown d2/f1b 586101 1 2024-04-26T10:44:28.091 INFO:tasks.workunit.client.0.smithi049.stdout:3/81: unlink d3/d6/la 0 2024-04-26T10:44:28.091 INFO:tasks.workunit.client.0.smithi049.stdout:4/142: dwrite de/d1b/f1c [0,4194304] 0 2024-04-26T10:44:28.092 INFO:tasks.workunit.client.0.smithi049.stdout:5/93: mkdir d7/d1d/d1f/d22 0 2024-04-26T10:44:28.093 INFO:tasks.workunit.client.0.smithi049.stdout:7/121: symlink d2/dd/d25/l28 0 2024-04-26T10:44:28.093 INFO:tasks.workunit.client.0.smithi049.stdout:0/75: dread f2 [0,4194304] 0 2024-04-26T10:44:28.093 INFO:tasks.workunit.client.0.smithi049.stdout:4/143: symlink de/d20/d24/l29 0 2024-04-26T10:44:28.094 INFO:tasks.workunit.client.0.smithi049.stdout:1/107: rename l15 to d1e/d20/l23 0 2024-04-26T10:44:28.094 INFO:tasks.workunit.client.0.smithi049.stdout:8/80: dwrite d2/f5 [0,4194304] 0 2024-04-26T10:44:28.095 INFO:tasks.workunit.client.0.smithi049.stdout:1/108: stat f11 0 2024-04-26T10:44:28.095 INFO:tasks.workunit.client.0.smithi049.stdout:5/94: fsync d7/d14/f1b 0 2024-04-26T10:44:28.095 INFO:tasks.workunit.client.0.smithi049.stdout:1/109: sync 2024-04-26T10:44:28.096 INFO:tasks.workunit.client.0.smithi049.stdout:0/76: mknod d8/db/c1d 0 2024-04-26T10:44:28.096 INFO:tasks.workunit.client.0.smithi049.stdout:3/82: rename d3/d6/f7 to d3/de/d8/dd/f18 0 2024-04-26T10:44:28.096 INFO:tasks.workunit.client.0.smithi049.stdout:7/122: creat d2/d3/de/f29 x:0 0 0 2024-04-26T10:44:28.096 INFO:tasks.workunit.client.0.smithi049.stdout:4/144: symlink de/d20/d24/l2a 0 2024-04-26T10:44:28.097 INFO:tasks.workunit.client.0.smithi049.stdout:2/104: write f0 [319582,47748] 0 2024-04-26T10:44:28.099 INFO:tasks.workunit.client.0.smithi049.stdout:1/110: write f1a [1161541,50952] 0 2024-04-26T10:44:28.099 INFO:tasks.workunit.client.0.smithi049.stdout:4/145: write f1 [1461349,79973] 0 2024-04-26T10:44:28.099 INFO:tasks.workunit.client.0.smithi049.stdout:7/123: dread - d2/dd/f14 zero size 2024-04-26T10:44:28.099 INFO:tasks.workunit.client.0.smithi049.stdout:5/95: rename d7/d14/d18/f21 to d7/f23 0 2024-04-26T10:44:28.100 INFO:tasks.workunit.client.0.smithi049.stdout:9/187: dwrite d2/f8 [0,4194304] 0 2024-04-26T10:44:28.100 INFO:tasks.workunit.client.0.smithi049.stdout:1/111: unlink c5 0 2024-04-26T10:44:28.100 INFO:tasks.workunit.client.0.smithi049.stdout:6/82: dwrite f9 [0,4194304] 0 2024-04-26T10:44:28.101 INFO:tasks.workunit.client.0.smithi049.stdout:4/146: chown de/c16 106 1 2024-04-26T10:44:28.101 INFO:tasks.workunit.client.0.smithi049.stdout:2/105: readlink d6/d9/db/df/l17 0 2024-04-26T10:44:28.102 INFO:tasks.workunit.client.0.smithi049.stdout:9/188: readlink d2/d25/l33 0 2024-04-26T10:44:28.102 INFO:tasks.workunit.client.0.smithi049.stdout:6/83: chown da/dd/f13 303489783 1 2024-04-26T10:44:28.103 INFO:tasks.workunit.client.0.smithi049.stdout:4/147: write de/f12 [2453293,125730] 0 2024-04-26T10:44:28.104 INFO:tasks.workunit.client.0.smithi049.stdout:1/112: mknod d1e/d20/c24 0 2024-04-26T10:44:28.104 INFO:tasks.workunit.client.0.smithi049.stdout:5/96: creat d7/d1d/d20/f24 x:0 0 0 2024-04-26T10:44:28.106 INFO:tasks.workunit.client.0.smithi049.stdout:7/124: unlink d2/d3/de/d1c/f1d 0 2024-04-26T10:44:28.106 INFO:tasks.workunit.client.0.smithi049.stdout:3/83: dread d3/de/d8/db/f11 [0,4194304] 0 2024-04-26T10:44:28.106 INFO:tasks.workunit.client.0.smithi049.stdout:1/113: unlink l14 0 2024-04-26T10:44:28.106 INFO:tasks.workunit.client.0.smithi049.stdout:9/189: creat d2/d1a/d1b/d1f/f39 x:0 0 0 2024-04-26T10:44:28.106 INFO:tasks.workunit.client.0.smithi049.stdout:6/84: write da/ff [711117,82741] 0 2024-04-26T10:44:28.106 INFO:tasks.workunit.client.0.smithi049.stdout:8/81: dread d2/f5 [0,4194304] 0 2024-04-26T10:44:28.108 INFO:tasks.workunit.client.0.smithi049.stdout:2/106: link d6/f7 d6/d9/db/df/f22 0 2024-04-26T10:44:28.108 INFO:tasks.workunit.client.0.smithi049.stdout:0/77: dwrite f3 [0,4194304] 0 2024-04-26T10:44:28.108 INFO:tasks.workunit.client.0.smithi049.stdout:1/114: chown l1c 10 1 2024-04-26T10:44:28.108 INFO:tasks.workunit.client.0.smithi049.stdout:5/97: mknod d7/d1d/d1f/c25 0 2024-04-26T10:44:28.108 INFO:tasks.workunit.client.0.smithi049.stdout:7/125: creat d2/d3/f2a x:0 0 0 2024-04-26T10:44:28.108 INFO:tasks.workunit.client.0.smithi049.stdout:3/84: chown d3/de/c15 188 1 2024-04-26T10:44:28.109 INFO:tasks.workunit.client.0.smithi049.stdout:8/82: write d2/df/d10/f13 [4714917,107437] 0 2024-04-26T10:44:28.110 INFO:tasks.workunit.client.0.smithi049.stdout:5/98: creat d7/f26 x:0 0 0 2024-04-26T10:44:28.110 INFO:tasks.workunit.client.0.smithi049.stdout:1/115: symlink d1e/l25 0 2024-04-26T10:44:28.111 INFO:tasks.workunit.client.0.smithi049.stdout:0/78: mkdir d8/d1e 0 2024-04-26T10:44:28.111 INFO:tasks.workunit.client.0.smithi049.stdout:3/85: rename d3/de to d3/d19 0 2024-04-26T10:44:28.112 INFO:tasks.workunit.client.0.smithi049.stdout:0/79: fsync d8/f18 0 2024-04-26T10:44:28.113 INFO:tasks.workunit.client.0.smithi049.stdout:8/83: chown d2/df/d10/c15 388195 1 2024-04-26T10:44:28.113 INFO:tasks.workunit.client.0.smithi049.stdout:5/99: link f3 d7/d1d/f27 0 2024-04-26T10:44:28.113 INFO:tasks.workunit.client.0.smithi049.stdout:7/126: getdents d2 0 2024-04-26T10:44:28.114 INFO:tasks.workunit.client.0.smithi049.stdout:8/84: creat d2/f1b x:0 0 0 2024-04-26T10:44:28.115 INFO:tasks.workunit.client.0.smithi049.stdout:3/86: symlink d3/l1a 0 2024-04-26T10:44:28.115 INFO:tasks.workunit.client.0.smithi049.stdout:0/80: chown d8/db/d11/d1c 118 1 2024-04-26T10:44:28.115 INFO:tasks.workunit.client.0.smithi049.stdout:3/87: sync 2024-04-26T10:44:28.118 INFO:tasks.workunit.client.0.smithi049.stdout:9/190: dread d2/d1a/d1b/f16 [0,4194304] 0 2024-04-26T10:44:28.119 INFO:tasks.workunit.client.0.smithi049.stdout:6/85: dwrite da/ff [0,4194304] 0 2024-04-26T10:44:28.119 INFO:tasks.workunit.client.0.smithi049.stdout:0/81: mknod d8/db/c1f 0 2024-04-26T10:44:28.119 INFO:tasks.workunit.client.0.smithi049.stdout:4/148: dwrite de/f14 [0,4194304] 0 2024-04-26T10:44:28.120 INFO:tasks.workunit.client.0.smithi049.stdout:7/127: creat d2/dd/d25/d27/f2b x:0 0 0 2024-04-26T10:44:28.121 INFO:tasks.workunit.client.0.smithi049.stdout:2/107: dread d6/f7 [0,4194304] 0 2024-04-26T10:44:28.122 INFO:tasks.workunit.client.0.smithi049.stdout:1/116: dwrite fb [0,4194304] 0 2024-04-26T10:44:28.124 INFO:tasks.workunit.client.0.smithi049.stdout:7/128: write d2/dd/d25/d27/f2b [635809,62330] 0 2024-04-26T10:44:28.125 INFO:tasks.workunit.client.0.smithi049.stdout:9/191: rename d2/d1a/le to d2/d25/l3a 0 2024-04-26T10:44:28.126 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:28.126 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:28.126 INFO:tasks.workunit.client.0.smithi049.stdout:1/117: mkdir d1e/d20/d26 0 2024-04-26T10:44:28.127 INFO:tasks.workunit.client.0.smithi049.stdout:1/118: sync 2024-04-26T10:44:28.127 INFO:tasks.workunit.client.0.smithi049.stdout:0/82: truncate d8/f18 1729688 0 2024-04-26T10:44:28.128 INFO:tasks.workunit.client.0.smithi049.stdout:5/100: dwrite d7/f23 [0,4194304] 0 2024-04-26T10:44:28.128 INFO:tasks.workunit.client.0.smithi049.stdout:8/85: dread d2/fe [0,4194304] 0 2024-04-26T10:44:28.128 INFO:tasks.workunit.client.0.smithi049.stdout:2/108: truncate f3 4606858 0 2024-04-26T10:44:28.128 INFO:tasks.workunit.client.0.smithi049.stdout:9/192: stat d2/d1a/df/c17 0 2024-04-26T10:44:28.131 INFO:tasks.workunit.client.0.smithi049.stdout:5/101: chown l6 46154 1 2024-04-26T10:44:28.132 INFO:tasks.workunit.client.0.smithi049.stdout:0/83: write f2 [3140039,20291] 0 2024-04-26T10:44:28.133 INFO:tasks.workunit.client.0.smithi049.stdout:4/149: dread f7 [0,4194304] 0 2024-04-26T10:44:28.133 INFO:tasks.workunit.client.0.smithi049.stdout:7/129: write d2/d3/f20 [4989265,64796] 0 2024-04-26T10:44:28.134 INFO:tasks.workunit.client.0.smithi049.stdout:2/109: symlink d6/d9/db/df/l23 0 2024-04-26T10:44:28.134 INFO:tasks.workunit.client.0.smithi049.stdout:6/86: dwrite da/dd/f13 [0,4194304] 0 2024-04-26T10:44:28.134 INFO:tasks.workunit.client.0.smithi049.stdout:8/86: mknod d2/d1a/c1c 0 2024-04-26T10:44:28.135 INFO:tasks.workunit.client.0.smithi049.stdout:2/110: fdatasync f5 0 2024-04-26T10:44:28.135 INFO:tasks.workunit.client.0.smithi049.stdout:0/84: chown d8/lf 128274276 1 2024-04-26T10:44:28.137 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:28.138 INFO:tasks.workunit.client.0.smithi049.stdout:7/130: creat d2/f2c x:0 0 0 2024-04-26T10:44:28.138 INFO:tasks.workunit.client.0.smithi049.stdout:5/102: rename d7/lb to d7/d1d/d20/l28 0 2024-04-26T10:44:28.138 INFO:tasks.workunit.client.0.smithi049.stdout:3/88: dwrite d3/d19/d8/dd/f18 [0,4194304] 0 2024-04-26T10:44:28.138 INFO:tasks.workunit.client.0.smithi049.stdout:4/150: link f9 de/d1b/f2b 0 2024-04-26T10:44:28.138 INFO:tasks.workunit.client.0.smithi049.stdout:8/87: mknod d2/d1a/c1d 0 2024-04-26T10:44:28.139 INFO:tasks.workunit.client.0.smithi049.stdout:2/111: dread - d6/d9/f19 zero size 2024-04-26T10:44:28.139 INFO:tasks.workunit.client.0.smithi049.stdout:6/87: dread f5 [0,4194304] 0 2024-04-26T10:44:28.140 INFO:tasks.workunit.client.0.smithi049.stdout:0/85: mknod d8/db/d11/c20 0 2024-04-26T10:44:28.140 INFO:tasks.workunit.client.0.smithi049.stdout:6/88: stat f1 0 2024-04-26T10:44:28.140 INFO:tasks.workunit.client.0.smithi049.stdout:3/89: readlink d3/lc 0 2024-04-26T10:44:28.141 INFO:tasks.workunit.client.0.smithi049.stdout:8/88: creat d2/d1a/f1e x:0 0 0 2024-04-26T10:44:28.141 INFO:tasks.workunit.client.0.smithi049.stdout:2/112: stat d6/f8 0 2024-04-26T10:44:28.141 INFO:tasks.workunit.client.0.smithi049.stdout:1/119: dwrite fe [0,4194304] 0 2024-04-26T10:44:28.142 INFO:tasks.workunit.client.0.smithi049.stdout:9/193: dwrite d2/d1a/df/f30 [0,4194304] 0 2024-04-26T10:44:28.143 INFO:tasks.workunit.client.0.smithi049.stdout:6/89: rename da/cb to da/c17 0 2024-04-26T10:44:28.143 INFO:tasks.workunit.client.0.smithi049.stdout:3/90: mknod d3/d19/d8/db/c1b 0 2024-04-26T10:44:28.144 INFO:tasks.workunit.client.0.smithi049.stdout:8/89: mknod d2/df/c1f 0 2024-04-26T10:44:28.144 INFO:tasks.workunit.client.0.smithi049.stdout:0/86: creat d8/db/d11/f21 x:0 0 0 2024-04-26T10:44:28.144 INFO:tasks.workunit.client.0.smithi049.stdout:2/113: unlink d6/d9/db/d11/c20 0 2024-04-26T10:44:28.144 INFO:tasks.workunit.client.0.smithi049.stdout:6/90: read f4 [578745,105565] 0 2024-04-26T10:44:28.144 INFO:tasks.workunit.client.0.smithi049.stdout:5/103: dread f3 [4194304,4194304] 0 2024-04-26T10:44:28.145 INFO:tasks.workunit.client.0.smithi049.stdout:9/194: chown d2/d1a/d1b/f16 108386995 1 2024-04-26T10:44:28.146 INFO:tasks.workunit.client.0.smithi049.stdout:8/90: rename d2/c11 to d2/d16/d19/c20 0 2024-04-26T10:44:28.146 INFO:tasks.workunit.client.0.smithi049.stdout:5/104: creat d7/d1d/d1f/f29 x:0 0 0 2024-04-26T10:44:28.146 INFO:tasks.workunit.client.0.smithi049.stdout:8/91: sync 2024-04-26T10:44:28.146 INFO:tasks.workunit.client.0.smithi049.stdout:1/120: dread fa [0,4194304] 0 2024-04-26T10:44:28.147 INFO:tasks.workunit.client.0.smithi049.stdout:6/91: getdents da/dd 0 2024-04-26T10:44:28.147 INFO:tasks.workunit.client.0.smithi049.stdout:0/87: link d8/ld d8/db/d11/d1b/l22 0 2024-04-26T10:44:28.147 INFO:tasks.workunit.client.0.smithi049.stdout:8/92: mknod d2/d16/d19/c21 0 2024-04-26T10:44:28.148 INFO:tasks.workunit.client.0.smithi049.stdout:5/105: read d7/d14/d18/f1e [126835,108303] 0 2024-04-26T10:44:28.149 INFO:tasks.workunit.client.0.smithi049.stdout:3/91: truncate d3/d6/f12 3134814 0 2024-04-26T10:44:28.150 INFO:tasks.workunit.client.0.smithi049.stdout:5/106: fsync d7/f10 0 2024-04-26T10:44:28.150 INFO:tasks.workunit.client.0.smithi049.stdout:1/121: getdents d1e/d20 0 2024-04-26T10:44:28.150 INFO:tasks.workunit.client.0.smithi049.stdout:0/88: mknod d8/db/d11/d1c/c23 0 2024-04-26T10:44:28.151 INFO:tasks.workunit.client.0.smithi049.stdout:5/107: symlink d7/d14/l2a 0 2024-04-26T10:44:28.151 INFO:tasks.workunit.client.0.smithi049.stdout:3/92: write d3/d19/d8/f9 [3437587,109226] 0 2024-04-26T10:44:28.152 INFO:tasks.workunit.client.0.smithi049.stdout:2/114: dwrite f0 [0,4194304] 0 2024-04-26T10:44:28.153 INFO:tasks.workunit.client.0.smithi049.stdout:0/89: creat d8/d1e/f24 x:0 0 0 2024-04-26T10:44:28.153 INFO:tasks.workunit.client.0.smithi049.stdout:5/108: mkdir d7/d14/d18/d2b 0 2024-04-26T10:44:28.154 INFO:tasks.workunit.client.0.smithi049.stdout:3/93: write d3/d19/d8/f17 [463884,64665] 0 2024-04-26T10:44:28.155 INFO:tasks.workunit.client.0.smithi049.stdout:6/92: dread da/ff [0,4194304] 0 2024-04-26T10:44:28.155 INFO:tasks.workunit.client.0.smithi049.stdout:7/131: read d2/dd/f17 [150776,116535] 0 2024-04-26T10:44:28.155 INFO:tasks.workunit.client.0.smithi049.stdout:0/90: creat d8/db/f25 x:0 0 0 2024-04-26T10:44:28.156 INFO:tasks.workunit.client.0.smithi049.stdout:8/93: dwrite d2/f14 [0,4194304] 0 2024-04-26T10:44:28.156 INFO:tasks.workunit.client.0.smithi049.stdout:2/115: creat d6/d9/db/f24 x:0 0 0 2024-04-26T10:44:28.156 INFO:tasks.workunit.client.0.smithi049.stdout:5/109: symlink d7/d14/d18/l2c 0 2024-04-26T10:44:28.158 INFO:tasks.workunit.client.0.smithi049.stdout:6/93: dread - da/dd/de/d11/f12 zero size 2024-04-26T10:44:28.158 INFO:tasks.workunit.client.0.smithi049.stdout:7/132: symlink d2/dd/d25/l2d 0 2024-04-26T10:44:28.159 INFO:tasks.workunit.client.0.smithi049.stdout:5/110: readlink d7/d1d/d20/l28 0 2024-04-26T10:44:28.160 INFO:tasks.workunit.client.0.smithi049.stdout:1/122: dwrite f1a [0,4194304] 0 2024-04-26T10:44:28.160 INFO:tasks.workunit.client.0.smithi049.stdout:1/123: sync 2024-04-26T10:44:28.160 INFO:tasks.workunit.client.0.smithi049.stdout:7/133: symlink d2/dd/d25/l2e 0 2024-04-26T10:44:28.160 INFO:tasks.workunit.client.0.smithi049.stdout:1/124: stat l7 0 2024-04-26T10:44:28.161 INFO:tasks.workunit.client.0.smithi049.stdout:5/111: symlink d7/d14/d18/l2d 0 2024-04-26T10:44:28.162 INFO:tasks.workunit.client.0.smithi049.stdout:6/94: link f5 da/dd/de/f18 0 2024-04-26T10:44:28.162 INFO:tasks.workunit.client.0.smithi049.stdout:3/94: dread d3/d6/f10 [0,4194304] 0 2024-04-26T10:44:28.162 INFO:tasks.workunit.client.0.smithi049.stdout:5/112: readlink d7/l8 0 2024-04-26T10:44:28.163 INFO:tasks.workunit.client.0.smithi049.stdout:0/91: getdents d8/db 0 2024-04-26T10:44:28.164 INFO:tasks.workunit.client.0.smithi049.stdout:2/116: dread d6/f7 [0,4194304] 0 2024-04-26T10:44:28.165 INFO:tasks.workunit.client.0.smithi049.stdout:6/95: creat da/f19 x:0 0 0 2024-04-26T10:44:28.165 INFO:tasks.workunit.client.0.smithi049.stdout:0/92: mkdir d8/db/d26 0 2024-04-26T10:44:28.166 INFO:tasks.workunit.client.0.smithi049.stdout:2/117: dread - d6/d9/db/d11/f18 zero size 2024-04-26T10:44:28.166 INFO:tasks.workunit.client.0.smithi049.stdout:8/94: dwrite d2/fc [4194304,4194304] 0 2024-04-26T10:44:28.166 INFO:tasks.workunit.client.0.smithi049.stdout:3/95: rename d3/d19/d8/f17 to d3/f1c 0 2024-04-26T10:44:28.167 INFO:tasks.workunit.client.0.smithi049.stdout:0/93: dread - d8/f1a zero size 2024-04-26T10:44:28.167 INFO:tasks.workunit.client.0.smithi049.stdout:1/125: dread f9 [0,4194304] 0 2024-04-26T10:44:28.167 INFO:tasks.workunit.client.0.smithi049.stdout:3/96: stat d3/d6 0 2024-04-26T10:44:28.167 INFO:tasks.workunit.client.0.smithi049.stdout:6/96: truncate f0 2517376 0 2024-04-26T10:44:28.167 INFO:tasks.workunit.client.0.smithi049.stdout:2/118: chown d6/d9/ca 18769537 1 2024-04-26T10:44:28.168 INFO:tasks.workunit.client.0.smithi049.stdout:0/94: write f3 [112775,28219] 0 2024-04-26T10:44:28.169 INFO:tasks.workunit.client.0.smithi049.stdout:1/126: rename d1e/l25 to d1e/l27 0 2024-04-26T10:44:28.169 INFO:tasks.workunit.client.0.smithi049.stdout:6/97: rename da/dd/d15 to da/dd/de/d1a 0 2024-04-26T10:44:28.170 INFO:tasks.workunit.client.0.smithi049.stdout:2/119: symlink d6/d9/l25 0 2024-04-26T10:44:28.170 INFO:tasks.workunit.client.0.smithi049.stdout:0/95: fsync d8/db/f25 0 2024-04-26T10:44:28.171 INFO:tasks.workunit.client.0.smithi049.stdout:5/113: dread d7/ff [0,4194304] 0 2024-04-26T10:44:28.171 INFO:tasks.workunit.client.0.smithi049.stdout:3/97: symlink d3/d19/d8/db/l1d 0 2024-04-26T10:44:28.171 INFO:tasks.workunit.client.0.smithi049.stdout:7/134: dwrite d2/d3/f16 [0,4194304] 0 2024-04-26T10:44:28.171 INFO:tasks.workunit.client.0.smithi049.stdout:6/98: creat da/f1b x:0 0 0 2024-04-26T10:44:28.173 INFO:tasks.workunit.client.0.smithi049.stdout:1/127: link fa d1e/d20/f28 0 2024-04-26T10:44:28.173 INFO:tasks.workunit.client.0.smithi049.stdout:0/96: mknod d8/d1e/c27 0 2024-04-26T10:44:28.173 INFO:tasks.workunit.client.0.smithi049.stdout:0/97: fdatasync f2 0 2024-04-26T10:44:28.174 INFO:tasks.workunit.client.0.smithi049.stdout:3/98: creat d3/d19/d8/f1e x:0 0 0 2024-04-26T10:44:28.175 INFO:tasks.workunit.client.0.smithi049.stdout:2/120: rename d6/d9/db/df/l14 to d6/l26 0 2024-04-26T10:44:28.175 INFO:tasks.workunit.client.0.smithi049.stdout:2/121: sync 2024-04-26T10:44:28.176 INFO:tasks.workunit.client.0.smithi049.stdout:8/95: dwrite f1 [0,4194304] 0 2024-04-26T10:44:28.176 INFO:tasks.workunit.client.0.smithi049.stdout:1/128: getdents d1e/d20/d26 0 2024-04-26T10:44:28.176 INFO:tasks.workunit.client.0.smithi049.stdout:0/98: rename d8/f1a to d8/db/f28 0 2024-04-26T10:44:28.177 INFO:tasks.workunit.client.0.smithi049.stdout:3/99: write d3/d19/d8/f9 [1581642,10414] 0 2024-04-26T10:44:28.178 INFO:tasks.workunit.client.0.smithi049.stdout:2/122: chown d6/d9/db/f13 202051 1 2024-04-26T10:44:28.179 INFO:tasks.workunit.client.0.smithi049.stdout:6/99: dread f1 [0,4194304] 0 2024-04-26T10:44:28.179 INFO:tasks.workunit.client.0.smithi049.stdout:1/129: symlink d1e/d20/l29 0 2024-04-26T10:44:28.180 INFO:tasks.workunit.client.0.smithi049.stdout:8/96: link d2/f5 d2/d1a/f22 0 2024-04-26T10:44:28.180 INFO:tasks.workunit.client.0.smithi049.stdout:2/123: creat d6/d9/f27 x:0 0 0 2024-04-26T10:44:28.181 INFO:tasks.workunit.client.0.smithi049.stdout:2/124: fsync f5 0 2024-04-26T10:44:28.181 INFO:tasks.workunit.client.0.smithi049.stdout:0/99: link d8/db/l17 d8/db/d11/l29 0 2024-04-26T10:44:28.181 INFO:tasks.workunit.client.0.smithi049.stdout:1/130: chown d1e/d20/l29 120574949 1 2024-04-26T10:44:28.181 INFO:tasks.workunit.client.0.smithi049.stdout:8/97: chown d2/d1a/f22 7441 1 2024-04-26T10:44:28.182 INFO:tasks.workunit.client.0.smithi049.stdout:6/100: chown da/dd/de/f18 1 1 2024-04-26T10:44:28.182 INFO:tasks.workunit.client.0.smithi049.stdout:2/125: stat d6/f7 0 2024-04-26T10:44:28.182 INFO:tasks.workunit.client.0.smithi049.stdout:7/135: dwrite d2/dd/f11 [4194304,4194304] 0 2024-04-26T10:44:28.182 INFO:tasks.workunit.client.0.smithi049.stdout:3/100: link d3/d19/d8/db/l1d d3/d19/d8/dd/l1f 0 2024-04-26T10:44:28.183 INFO:tasks.workunit.client.0.smithi049.stdout:6/101: mknod da/c1c 0 2024-04-26T10:44:28.184 INFO:tasks.workunit.client.0.smithi049.stdout:2/126: mknod d6/d9/c28 0 2024-04-26T10:44:28.184 INFO:tasks.workunit.client.0.smithi049.stdout:1/131: symlink d1e/d20/d26/l2a 0 2024-04-26T10:44:28.184 INFO:tasks.workunit.client.0.smithi049.stdout:0/100: rename d8/db/f28 to d8/d1e/f2a 0 2024-04-26T10:44:28.185 INFO:tasks.workunit.client.0.smithi049.stdout:5/114: dwrite d7/d1d/f27 [4194304,4194304] 0 2024-04-26T10:44:28.185 INFO:tasks.workunit.client.0.smithi049.stdout:2/127: chown d6/d9/ca 11620392 1 2024-04-26T10:44:28.186 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:28.184+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:28.190 INFO:tasks.workunit.client.0.smithi049.stdout:1/132: symlink d1e/d20/d26/l2b 0 2024-04-26T10:44:28.190 INFO:tasks.workunit.client.0.smithi049.stdout:4/151: dread f1 [0,4194304] 0 2024-04-26T10:44:28.191 INFO:tasks.workunit.client.0.smithi049.stdout:0/101: creat d8/d1e/f2b x:0 0 0 2024-04-26T10:44:28.191 INFO:tasks.workunit.client.0.smithi049.stdout:5/115: rename d7/d14/d18/l2d to d7/l2e 0 2024-04-26T10:44:28.191 INFO:tasks.workunit.client.0.smithi049.stdout:1/133: stat d1e/d20/d26/l2b 0 2024-04-26T10:44:28.191 INFO:tasks.workunit.client.0.smithi049.stdout:7/136: getdents d2/d3/de/d1c 0 2024-04-26T10:44:28.191 INFO:tasks.workunit.client.0.smithi049.stdout:6/102: getdents da/dd/de/d1a 0 2024-04-26T10:44:28.191 INFO:tasks.workunit.client.0.smithi049.stdout:8/98: dwrite d2/df/d10/f13 [0,4194304] 0 2024-04-26T10:44:28.192 INFO:tasks.workunit.client.0.smithi049.stdout:3/101: dwrite d3/d6/f10 [0,4194304] 0 2024-04-26T10:44:28.192 INFO:tasks.workunit.client.0.smithi049.stdout:1/134: fdatasync f11 0 2024-04-26T10:44:28.192 INFO:tasks.workunit.client.0.smithi049.stdout:2/128: creat d6/f29 x:0 0 0 2024-04-26T10:44:28.192 INFO:tasks.workunit.client.0.smithi049.stdout:7/137: read d2/d3/f16 [956312,3570] 0 2024-04-26T10:44:28.192 INFO:tasks.workunit.client.0.smithi049.stdout:5/116: creat d7/d1d/d20/f2f x:0 0 0 2024-04-26T10:44:28.193 INFO:tasks.workunit.client.0.smithi049.stdout:6/103: creat da/dd/f1d x:0 0 0 2024-04-26T10:44:28.193 INFO:tasks.workunit.client.0.smithi049.stdout:7/138: rmdir d2/dd/d25/d27 39 2024-04-26T10:44:28.193 INFO:tasks.workunit.client.0.smithi049.stdout:0/102: rename d8/db/l15 to d8/db/d11/d1b/l2c 0 2024-04-26T10:44:28.193 INFO:tasks.workunit.client.0.smithi049.stdout:6/104: creat da/dd/f1e x:0 0 0 2024-04-26T10:44:28.193 INFO:tasks.workunit.client.0.smithi049.stdout:3/102: write d3/d19/d8/db/f16 [657634,93439] 0 2024-04-26T10:44:28.194 INFO:tasks.workunit.client.0.smithi049.stdout:2/129: write d6/d9/db/d1e/f21 [860116,77927] 0 2024-04-26T10:44:28.194 INFO:tasks.workunit.client.0.smithi049.stdout:7/139: mknod d2/d3/de/d1c/c2f 0 2024-04-26T10:44:28.194 INFO:tasks.workunit.client.0.smithi049.stdout:5/117: link d7/d14/d18/f1e d7/d1d/f30 0 2024-04-26T10:44:28.196 INFO:tasks.workunit.client.0.smithi049.stdout:6/105: fsync da/dd/de/d11/f12 0 2024-04-26T10:44:28.196 INFO:tasks.workunit.client.0.smithi049.stdout:1/135: dread d1e/d20/f28 [0,4194304] 0 2024-04-26T10:44:28.196 INFO:tasks.workunit.client.0.smithi049.stdout:8/99: truncate d2/f12 311270 0 2024-04-26T10:44:28.196 INFO:tasks.workunit.client.0.smithi049.stdout:3/103: write d3/d6/f10 [5236042,90637] 0 2024-04-26T10:44:28.196 INFO:tasks.workunit.client.0.smithi049.stdout:0/103: truncate d8/d1e/f2a 194204 0 2024-04-26T10:44:28.198 INFO:tasks.workunit.client.0.smithi049.stdout:1/136: write fd [1678607,57104] 0 2024-04-26T10:44:28.198 INFO:tasks.workunit.client.0.smithi049.stdout:9/195: dread d2/d1a/fd [0,4194304] 0 2024-04-26T10:44:28.198 INFO:tasks.workunit.client.0.smithi049.stdout:8/100: mkdir d2/df/d10/d23 0 2024-04-26T10:44:28.198 INFO:tasks.workunit.client.0.smithi049.stdout:3/104: read d3/f1c [525331,73147] 0 2024-04-26T10:44:28.199 INFO:tasks.workunit.client.0.smithi049.stdout:5/118: write d7/d14/d18/f1e [1379901,64707] 0 2024-04-26T10:44:28.199 INFO:tasks.workunit.client.0.smithi049.stdout:6/106: symlink da/dd/de/d11/l1f 0 2024-04-26T10:44:28.199 INFO:tasks.workunit.client.0.smithi049.stdout:2/130: rename d6/d9/db/d11/f18 to d6/d9/db/d1e/f2a 0 2024-04-26T10:44:28.199 INFO:tasks.workunit.client.0.smithi049.stdout:4/152: dwrite f8 [0,4194304] 0 2024-04-26T10:44:28.200 INFO:tasks.workunit.client.0.smithi049.stdout:1/137: mknod d1e/d20/c2c 0 2024-04-26T10:44:28.200 INFO:tasks.workunit.client.0.smithi049.stdout:3/105: symlink d3/d19/l20 0 2024-04-26T10:44:28.200 INFO:tasks.workunit.client.0.smithi049.stdout:8/101: write d2/f8 [4891913,118946] 0 2024-04-26T10:44:28.200 INFO:tasks.workunit.client.0.smithi049.stdout:5/119: mkdir d7/d1d/d31 0 2024-04-26T10:44:28.201 INFO:tasks.workunit.client.0.smithi049.stdout:1/138: creat d1e/f2d x:0 0 0 2024-04-26T10:44:28.201 INFO:tasks.workunit.client.0.smithi049.stdout:4/153: creat de/d1b/f2c x:0 0 0 2024-04-26T10:44:28.203 INFO:tasks.workunit.client.0.smithi049.stdout:5/120: chown d7/d14/d18 14 1 2024-04-26T10:44:28.204 INFO:tasks.workunit.client.0.smithi049.stdout:9/196: link d2/d1a/l15 d2/d1a/df/l3b 0 2024-04-26T10:44:28.204 INFO:tasks.workunit.client.0.smithi049.stdout:3/106: rename d3/d19/d8/db to d3/d6/d21 0 2024-04-26T10:44:28.206 INFO:tasks.workunit.client.0.smithi049.stdout:7/140: dread d2/d3/f16 [0,4194304] 0 2024-04-26T10:44:28.207 INFO:tasks.workunit.client.0.smithi049.stdout:9/197: truncate d2/d1a/df/f30 4584791 0 2024-04-26T10:44:28.208 INFO:tasks.workunit.client.0.smithi049.stdout:5/121: rename d7/d14/d18/l2c to d7/d1d/d1f/l32 0 2024-04-26T10:44:28.209 INFO:tasks.workunit.client.0.smithi049.stdout:7/141: read - d2/d3/de/f1e zero size 2024-04-26T10:44:28.210 INFO:tasks.workunit.client.0.smithi049.stdout:0/104: truncate d8/f9 2229064 0 2024-04-26T10:44:28.212 INFO:tasks.workunit.client.0.smithi049.stdout:2/131: dwrite d6/d9/fc [0,4194304] 0 2024-04-26T10:44:28.213 INFO:tasks.workunit.client.0.smithi049.stdout:1/139: dwrite f1a [0,4194304] 0 2024-04-26T10:44:28.213 INFO:tasks.workunit.client.0.smithi049.stdout:6/107: dwrite f4 [0,4194304] 0 2024-04-26T10:44:28.214 INFO:tasks.workunit.client.0.smithi049.stdout:4/154: dread f1 [0,4194304] 0 2024-04-26T10:44:28.214 INFO:tasks.workunit.client.0.smithi049.stdout:5/122: rename d7/c13 to d7/d14/d18/d2b/c33 0 2024-04-26T10:44:28.214 INFO:tasks.workunit.client.0.smithi049.stdout:0/105: creat d8/db/d26/f2d x:0 0 0 2024-04-26T10:44:28.215 INFO:tasks.workunit.client.0.smithi049.stdout:8/102: dwrite d2/f6 [0,4194304] 0 2024-04-26T10:44:28.215 INFO:tasks.workunit.client.0.smithi049.stdout:7/142: creat d2/dd/d25/d27/f30 x:0 0 0 2024-04-26T10:44:28.215 INFO:tasks.workunit.client.0.smithi049.stdout:1/140: rename l2 to d1e/d20/l2e 0 2024-04-26T10:44:28.215 INFO:tasks.workunit.client.0.smithi049.stdout:0/106: write f3 [601856,33238] 0 2024-04-26T10:44:28.216 INFO:tasks.workunit.client.0.smithi049.stdout:5/123: fdatasync d7/f26 0 2024-04-26T10:44:28.216 INFO:tasks.workunit.client.0.smithi049.stdout:4/155: chown de/d1b/f2b 26020704 1 2024-04-26T10:44:28.216 INFO:tasks.workunit.client.0.smithi049.stdout:8/103: creat d2/df/d10/d23/f24 x:0 0 0 2024-04-26T10:44:28.217 INFO:tasks.workunit.client.0.smithi049.stdout:4/156: mknod de/d1d/c2d 0 2024-04-26T10:44:28.218 INFO:tasks.workunit.client.0.smithi049.stdout:0/107: write d8/db/d26/f2d [988392,32306] 0 2024-04-26T10:44:28.218 INFO:tasks.workunit.client.0.smithi049.stdout:5/124: rename d7/d1d/d31 to d7/d1d/d34 0 2024-04-26T10:44:28.219 INFO:tasks.workunit.client.0.smithi049.stdout:4/157: creat de/d20/f2e x:0 0 0 2024-04-26T10:44:28.219 INFO:tasks.workunit.client.0.smithi049.stdout:8/104: creat d2/d16/d19/f25 x:0 0 0 2024-04-26T10:44:28.220 INFO:tasks.workunit.client.0.smithi049.stdout:1/141: dread d1e/d20/f28 [0,4194304] 0 2024-04-26T10:44:28.220 INFO:tasks.workunit.client.0.smithi049.stdout:9/198: dwrite d2/d1a/d1b/f16 [0,4194304] 0 2024-04-26T10:44:28.221 INFO:tasks.workunit.client.0.smithi049.stdout:5/125: getdents d7/d14/d18 0 2024-04-26T10:44:28.221 INFO:tasks.workunit.client.0.smithi049.stdout:1/142: mknod d1e/d20/d26/c2f 0 2024-04-26T10:44:28.222 INFO:tasks.workunit.client.0.smithi049.stdout:8/105: getdents d2/d17 0 2024-04-26T10:44:28.222 INFO:tasks.workunit.client.0.smithi049.stdout:9/199: unlink d2/d1a/df/c10 0 2024-04-26T10:44:28.223 INFO:tasks.workunit.client.0.smithi049.stdout:2/132: write d6/d9/db/f1c [4863065,114628] 0 2024-04-26T10:44:28.223 INFO:tasks.workunit.client.0.smithi049.stdout:6/108: write f0 [1070172,23326] 0 2024-04-26T10:44:28.225 INFO:tasks.workunit.client.0.smithi049.stdout:9/200: chown d2/d1a/df/l22 917 1 2024-04-26T10:44:28.225 INFO:tasks.workunit.client.0.smithi049.stdout:5/126: rename d7/f23 to d7/d1d/d1f/d22/f35 0 2024-04-26T10:44:28.226 INFO:tasks.workunit.client.0.smithi049.stdout:1/143: dread d1e/d20/f28 [0,4194304] 0 2024-04-26T10:44:28.228 INFO:tasks.workunit.client.0.smithi049.stdout:9/201: fdatasync d2/d25/f28 0 2024-04-26T10:44:28.228 INFO:tasks.workunit.client.0.smithi049.stdout:0/108: dwrite d8/db/d11/f21 [0,4194304] 0 2024-04-26T10:44:28.228 INFO:tasks.workunit.client.0.smithi049.stdout:8/106: rename d2/df/c1f to d2/d16/d19/c26 0 2024-04-26T10:44:28.228 INFO:tasks.workunit.client.0.smithi049.stdout:4/158: dread de/f14 [0,4194304] 0 2024-04-26T10:44:28.230 INFO:tasks.workunit.client.0.smithi049.stdout:1/144: creat d1e/d20/d26/f30 x:0 0 0 2024-04-26T10:44:28.231 INFO:tasks.workunit.client.0.smithi049.stdout:4/159: chown de/f14 39 1 2024-04-26T10:44:28.233 INFO:tasks.workunit.client.0.smithi049.stdout:2/133: dwrite d6/f29 [0,4194304] 0 2024-04-26T10:44:28.233 INFO:tasks.workunit.client.0.smithi049.stdout:9/202: truncate d2/d1a/d1b/d1f/f39 884023 0 2024-04-26T10:44:28.234 INFO:tasks.workunit.client.0.smithi049.stdout:6/109: dwrite da/fc [0,4194304] 0 2024-04-26T10:44:28.234 INFO:tasks.workunit.client.0.smithi049.stdout:4/160: write de/d20/f2e [708694,49798] 0 2024-04-26T10:44:28.235 INFO:tasks.workunit.client.0.smithi049.stdout:1/145: fsync f9 0 2024-04-26T10:44:28.235 INFO:tasks.workunit.client.0.smithi049.stdout:8/107: chown d2/d16/d19/c26 10909256 1 2024-04-26T10:44:28.236 INFO:tasks.workunit.client.0.smithi049.stdout:3/107: dread d3/d19/d8/dd/ff [0,4194304] 0 2024-04-26T10:44:28.236 INFO:tasks.workunit.client.0.smithi049.stdout:9/203: creat d2/f3c x:0 0 0 2024-04-26T10:44:28.236 INFO:tasks.workunit.client.0.smithi049.stdout:6/110: write f0 [1167407,64369] 0 2024-04-26T10:44:28.237 INFO:tasks.workunit.client.0.smithi049.stdout:8/108: mkdir d2/d1a/d27 0 2024-04-26T10:44:28.238 INFO:tasks.workunit.client.0.smithi049.stdout:5/127: dwrite d7/d1d/f30 [0,4194304] 0 2024-04-26T10:44:28.238 INFO:tasks.workunit.client.0.smithi049.stdout:3/108: mkdir d3/d19/d22 0 2024-04-26T10:44:28.238 INFO:tasks.workunit.client.0.smithi049.stdout:1/146: chown d1e/d20/l29 26945897 1 2024-04-26T10:44:28.239 INFO:tasks.workunit.client.0.smithi049.stdout:8/109: write d2/f6 [3598218,113428] 0 2024-04-26T10:44:28.239 INFO:tasks.workunit.client.0.smithi049.stdout:2/134: getdents d6/d9/db/df 0 2024-04-26T10:44:28.239 INFO:tasks.workunit.client.0.smithi049.stdout:1/147: creat d1e/f31 x:0 0 0 2024-04-26T10:44:28.240 INFO:tasks.workunit.client.0.smithi049.stdout:3/109: mkdir d3/d23 0 2024-04-26T10:44:28.240 INFO:tasks.workunit.client.0.smithi049.stdout:5/128: creat d7/d1d/d20/f36 x:0 0 0 2024-04-26T10:44:28.240 INFO:tasks.workunit.client.0.smithi049.stdout:0/109: truncate d8/f9 75738 0 2024-04-26T10:44:28.241 INFO:tasks.workunit.client.0.smithi049.stdout:3/110: stat d3/d19/d22 0 2024-04-26T10:44:28.241 INFO:tasks.workunit.client.0.smithi049.stdout:9/204: getdents d2/d25 0 2024-04-26T10:44:28.242 INFO:tasks.workunit.client.0.smithi049.stdout:2/135: mknod d6/d9/db/c2b 0 2024-04-26T10:44:28.242 INFO:tasks.workunit.client.0.smithi049.stdout:0/110: write d8/db/f25 [190799,25757] 0 2024-04-26T10:44:28.242 INFO:tasks.workunit.client.0.smithi049.stdout:5/129: mkdir d7/d1d/d34/d37 0 2024-04-26T10:44:28.242 INFO:tasks.workunit.client.0.smithi049.stdout:3/111: unlink d3/d6/d21/f11 0 2024-04-26T10:44:28.243 INFO:tasks.workunit.client.0.smithi049.stdout:2/136: sync 2024-04-26T10:44:28.243 INFO:tasks.workunit.client.0.smithi049.stdout:0/111: readlink d8/l14 0 2024-04-26T10:44:28.243 INFO:tasks.workunit.client.0.smithi049.stdout:3/112: chown d3/lc 435975477 1 2024-04-26T10:44:28.243 INFO:tasks.workunit.client.0.smithi049.stdout:9/205: creat d2/d1a/d1b/d1f/f3d x:0 0 0 2024-04-26T10:44:28.244 INFO:tasks.workunit.client.0.smithi049.stdout:5/130: creat d7/d14/f38 x:0 0 0 2024-04-26T10:44:28.245 INFO:tasks.workunit.client.0.smithi049.stdout:6/111: dwrite f4 [0,4194304] 0 2024-04-26T10:44:28.247 INFO:tasks.workunit.client.0.smithi049.stdout:1/148: dwrite f19 [0,4194304] 0 2024-04-26T10:44:28.247 INFO:tasks.workunit.client.0.smithi049.stdout:8/110: dread d2/f8 [0,4194304] 0 2024-04-26T10:44:28.248 INFO:tasks.workunit.client.0.smithi049.stdout:3/113: creat d3/d23/f24 x:0 0 0 2024-04-26T10:44:28.249 INFO:tasks.workunit.client.0.smithi049.stdout:5/131: getdents d7/d1d/d34/d37 0 2024-04-26T10:44:28.249 INFO:tasks.workunit.client.0.smithi049.stdout:8/111: write d2/f6 [3102026,130305] 0 2024-04-26T10:44:28.250 INFO:tasks.workunit.client.0.smithi049.stdout:3/114: unlink d3/d6/d21/f16 0 2024-04-26T10:44:28.250 INFO:tasks.workunit.client.0.smithi049.stdout:5/132: chown d7/d14 4 1 2024-04-26T10:44:28.250 INFO:tasks.workunit.client.0.smithi049.stdout:8/112: chown d2/df/d10 7 1 2024-04-26T10:44:28.250 INFO:tasks.workunit.client.0.smithi049.stdout:0/112: dread d8/d1e/f2a [0,4194304] 0 2024-04-26T10:44:28.251 INFO:tasks.workunit.client.0.smithi049.stdout:6/112: dread f4 [0,4194304] 0 2024-04-26T10:44:28.251 INFO:tasks.workunit.client.0.smithi049.stdout:5/133: chown d7/d14/d18/f1e 7316769 1 2024-04-26T10:44:28.251 INFO:tasks.workunit.client.0.smithi049.stdout:3/115: chown d3/d6/d21/c1b 1720 1 2024-04-26T10:44:28.253 INFO:tasks.workunit.client.0.smithi049.stdout:8/113: write d2/d16/d19/f25 [76916,100023] 0 2024-04-26T10:44:28.253 INFO:tasks.workunit.client.0.smithi049.stdout:4/161: truncate de/f14 2226401 0 2024-04-26T10:44:28.253 INFO:tasks.workunit.client.0.smithi049.stdout:5/134: truncate f3 9215703 0 2024-04-26T10:44:28.253 INFO:tasks.workunit.client.0.smithi049.stdout:5/135: sync 2024-04-26T10:44:28.254 INFO:tasks.workunit.client.0.smithi049.stdout:9/206: dwrite d2/d1a/d1b/d1f/f32 [0,4194304] 0 2024-04-26T10:44:28.254 INFO:tasks.workunit.client.0.smithi049.stdout:6/113: rename da/dd/de/d14 to da/d20 0 2024-04-26T10:44:28.255 INFO:tasks.workunit.client.0.smithi049.stdout:5/136: dread - d7/d1d/d1f/f29 zero size 2024-04-26T10:44:28.256 INFO:tasks.workunit.client.0.smithi049.stdout:4/162: symlink de/d20/d24/l2f 0 2024-04-26T10:44:28.256 INFO:tasks.workunit.client.0.smithi049.stdout:9/207: chown d2/d1a/d1b/d1f 430 1 2024-04-26T10:44:28.256 INFO:tasks.workunit.client.0.smithi049.stdout:3/116: link d3/d19/c15 d3/d19/c25 0 2024-04-26T10:44:28.256 INFO:tasks.workunit.client.0.smithi049.stdout:6/114: mknod da/d20/c21 0 2024-04-26T10:44:28.256 INFO:tasks.workunit.client.0.smithi049.stdout:8/114: link d2/f12 d2/d1a/f28 0 2024-04-26T10:44:28.257 INFO:tasks.workunit.client.0.smithi049.stdout:5/137: unlink d7/l2e 0 2024-04-26T10:44:28.257 INFO:tasks.workunit.client.0.smithi049.stdout:3/117: truncate d3/f1c 538691 0 2024-04-26T10:44:28.258 INFO:tasks.workunit.client.0.smithi049.stdout:4/163: chown de/d20/d24/l29 1862525383 1 2024-04-26T10:44:28.258 INFO:tasks.workunit.client.0.smithi049.stdout:9/208: write d2/d1a/d1b/d1f/f32 [1765138,97852] 0 2024-04-26T10:44:28.258 INFO:tasks.workunit.client.0.smithi049.stdout:6/115: mkdir da/d20/d22 0 2024-04-26T10:44:28.258 INFO:tasks.workunit.client.0.smithi049.stdout:0/113: dwrite f2 [4194304,4194304] 0 2024-04-26T10:44:28.259 INFO:tasks.workunit.client.0.smithi049.stdout:5/138: mknod d7/d14/d18/c39 0 2024-04-26T10:44:28.259 INFO:tasks.workunit.client.0.smithi049.stdout:6/116: dread - da/f19 zero size 2024-04-26T10:44:28.259 INFO:tasks.workunit.client.0.smithi049.stdout:9/209: read d2/d1a/df/f26 [3021185,48545] 0 2024-04-26T10:44:28.260 INFO:tasks.workunit.client.0.smithi049.stdout:5/139: symlink d7/d1d/d34/l3a 0 2024-04-26T10:44:28.260 INFO:tasks.workunit.client.0.smithi049.stdout:4/164: rename de/d1d/c2d to de/d1d/c30 0 2024-04-26T10:44:28.260 INFO:tasks.workunit.client.0.smithi049.stdout:6/117: symlink da/dd/de/d11/l23 0 2024-04-26T10:44:28.261 INFO:tasks.workunit.client.0.smithi049.stdout:5/140: readlink d7/l8 0 2024-04-26T10:44:28.261 INFO:tasks.workunit.client.0.smithi049.stdout:1/149: write f9 [2242816,10816] 0 2024-04-26T10:44:28.261 INFO:tasks.workunit.client.0.smithi049.stdout:1/150: dread - f16 zero size 2024-04-26T10:44:28.262 INFO:tasks.workunit.client.0.smithi049.stdout:5/141: chown d7/cd 3 1 2024-04-26T10:44:28.262 INFO:tasks.workunit.client.0.smithi049.stdout:6/118: creat da/dd/de/d1a/f24 x:0 0 0 2024-04-26T10:44:28.263 INFO:tasks.workunit.client.0.smithi049.stdout:5/142: creat d7/d1d/d1f/f3b x:0 0 0 2024-04-26T10:44:28.265 INFO:tasks.workunit.client.0.smithi049.stdout:5/143: read d7/d1d/d1f/d22/f35 [4094524,64607] 0 2024-04-26T10:44:28.265 INFO:tasks.workunit.client.0.smithi049.stdout:3/118: dwrite d3/d6/f10 [4194304,4194304] 0 2024-04-26T10:44:28.266 INFO:tasks.workunit.client.0.smithi049.stdout:9/210: dread d2/d1a/df/f30 [0,4194304] 0 2024-04-26T10:44:28.266 INFO:tasks.workunit.client.0.smithi049.stdout:3/119: mkdir d3/d19/d26 0 2024-04-26T10:44:28.266 INFO:tasks.workunit.client.0.smithi049.stdout:5/144: getdents d7/d1d/d34/d37 0 2024-04-26T10:44:28.268 INFO:tasks.workunit.client.0.smithi049.stdout:9/211: creat d2/d25/f3e x:0 0 0 2024-04-26T10:44:28.268 INFO:tasks.workunit.client.0.smithi049.stdout:3/120: unlink d3/d19/d8/f1e 0 2024-04-26T10:44:28.268 INFO:tasks.workunit.client.0.smithi049.stdout:8/115: rmdir d2 39 2024-04-26T10:44:28.268 INFO:tasks.workunit.client.0.smithi049.stdout:5/145: rename d7/cd to d7/d14/c3c 0 2024-04-26T10:44:28.269 INFO:tasks.workunit.client.0.smithi049.stdout:8/116: stat d2/f14 0 2024-04-26T10:44:28.270 INFO:tasks.workunit.client.0.smithi049.stdout:6/119: dwrite da/ff [0,4194304] 0 2024-04-26T10:44:28.270 INFO:tasks.workunit.client.0.smithi049.stdout:3/121: mknod d3/d19/d8/c27 0 2024-04-26T10:44:28.270 INFO:tasks.workunit.client.0.smithi049.stdout:7/143: dread d2/f6 [0,4194304] 0 2024-04-26T10:44:28.271 INFO:tasks.workunit.client.0.smithi049.stdout:5/146: getdents d7/d1d/d1f/d22 0 2024-04-26T10:44:28.272 INFO:tasks.workunit.client.0.smithi049.stdout:7/144: fsync d2/dd/d25/d27/f30 0 2024-04-26T10:44:28.272 INFO:tasks.workunit.client.0.smithi049.stdout:8/117: rename d2/d1a/c1c to d2/d17/c29 0 2024-04-26T10:44:28.272 INFO:tasks.workunit.client.0.smithi049.stdout:1/151: truncate fd 1514529 0 2024-04-26T10:44:28.272 INFO:tasks.workunit.client.0.smithi049.stdout:8/118: unlink d2/lb 0 2024-04-26T10:44:28.274 INFO:tasks.workunit.client.0.smithi049.stdout:8/119: mkdir d2/df/d18/d2a 0 2024-04-26T10:44:28.274 INFO:tasks.workunit.client.0.smithi049.stdout:6/120: dread da/ff [0,4194304] 0 2024-04-26T10:44:28.276 INFO:tasks.workunit.client.0.smithi049.stdout:9/212: dwrite d2/d1a/d1b/d1f/f32 [0,4194304] 0 2024-04-26T10:44:28.278 INFO:tasks.workunit.client.0.smithi049.stdout:3/122: truncate d3/f1c 304710 0 2024-04-26T10:44:28.279 INFO:tasks.workunit.client.0.smithi049.stdout:7/145: truncate d2/d3/f10 1433631 0 2024-04-26T10:44:28.280 INFO:tasks.workunit.client.0.smithi049.stdout:1/152: dwrite f11 [0,4194304] 0 2024-04-26T10:44:28.282 INFO:tasks.workunit.client.0.smithi049.stdout:5/147: dwrite d7/d1d/f27 [4194304,4194304] 0 2024-04-26T10:44:28.282 INFO:tasks.workunit.client.0.smithi049.stdout:8/120: truncate d2/fc 7513352 0 2024-04-26T10:44:28.283 INFO:tasks.workunit.client.0.smithi049.stdout:6/121: dread da/ff [0,4194304] 0 2024-04-26T10:44:28.284 INFO:tasks.workunit.client.0.smithi049.stdout:4/165: dwrite de/f14 [0,4194304] 0 2024-04-26T10:44:28.284 INFO:tasks.workunit.client.0.smithi049.stdout:0/114: dread d8/f9 [0,4194304] 0 2024-04-26T10:44:28.284 INFO:tasks.workunit.client.0.smithi049.stdout:3/123: rename d3/d23/f24 to d3/d6/d21/f28 0 2024-04-26T10:44:28.285 INFO:tasks.workunit.client.0.smithi049.stdout:5/148: stat d7/d14/d18/d2b/c33 0 2024-04-26T10:44:28.285 INFO:tasks.workunit.client.0.smithi049.stdout:7/146: creat d2/dd/d25/f31 x:0 0 0 2024-04-26T10:44:28.286 INFO:tasks.workunit.client.0.smithi049.stdout:5/149: chown d7/d1d/d1f/f29 0 1 2024-04-26T10:44:28.286 INFO:tasks.workunit.client.0.smithi049.stdout:4/166: write de/d20/f2e [1423352,129436] 0 2024-04-26T10:44:28.287 INFO:tasks.workunit.client.0.smithi049.stdout:6/122: creat da/d20/d22/f25 x:0 0 0 2024-04-26T10:44:28.287 INFO:tasks.workunit.client.0.smithi049.stdout:7/147: symlink d2/dd/d25/d27/l32 0 2024-04-26T10:44:28.287 INFO:tasks.workunit.client.0.smithi049.stdout:3/124: mkdir d3/d19/d26/d29 0 2024-04-26T10:44:28.287 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:28.286+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:28.289 INFO:tasks.workunit.client.0.smithi049.stdout:9/213: dread d2/d1a/df/f30 [0,4194304] 0 2024-04-26T10:44:28.289 INFO:tasks.workunit.client.0.smithi049.stdout:4/167: chown de/d1d/c30 6694 1 2024-04-26T10:44:28.289 INFO:tasks.workunit.client.0.smithi049.stdout:7/148: stat d2/d3/de/d1c/c2f 0 2024-04-26T10:44:28.289 INFO:tasks.workunit.client.0.smithi049.stdout:3/125: creat d3/f2a x:0 0 0 2024-04-26T10:44:28.290 INFO:tasks.workunit.client.0.smithi049.stdout:5/150: mknod d7/d1d/d34/d37/c3d 0 2024-04-26T10:44:28.291 INFO:tasks.workunit.client.0.smithi049.stdout:4/168: read de/d1b/f2b [3886991,39269] 0 2024-04-26T10:44:28.293 INFO:tasks.workunit.client.0.smithi049.stdout:9/214: creat d2/d1a/d1b/d1f/f3f x:0 0 0 2024-04-26T10:44:28.293 INFO:tasks.workunit.client.0.smithi049.stdout:3/126: creat d3/d19/d26/f2b x:0 0 0 2024-04-26T10:44:28.293 INFO:tasks.workunit.client.0.smithi049.stdout:5/151: mkdir d7/d1d/d34/d37/d3e 0 2024-04-26T10:44:28.293 INFO:tasks.workunit.client.0.smithi049.stdout:8/121: dwrite d2/fe [0,4194304] 0 2024-04-26T10:44:28.295 INFO:tasks.workunit.client.0.smithi049.stdout:4/169: rename de/f12 to de/d20/d24/f31 0 2024-04-26T10:44:28.296 INFO:tasks.workunit.client.0.smithi049.stdout:3/127: rmdir d3/d19 39 2024-04-26T10:44:28.297 INFO:tasks.workunit.client.0.smithi049.stdout:5/152: mkdir d7/d14/d18/d2b/d3f 0 2024-04-26T10:44:28.297 INFO:tasks.workunit.client.0.smithi049.stdout:6/123: dwrite da/dd/f10 [4194304,4194304] 0 2024-04-26T10:44:28.298 INFO:tasks.workunit.client.0.smithi049.stdout:0/115: dread d8/db/d26/f2d [0,4194304] 0 2024-04-26T10:44:28.299 INFO:tasks.workunit.client.0.smithi049.stdout:2/137: dread f3 [0,4194304] 0 2024-04-26T10:44:28.299 INFO:tasks.workunit.client.0.smithi049.stdout:5/153: fsync d7/d1d/d20/f24 0 2024-04-26T10:44:28.299 INFO:tasks.workunit.client.0.smithi049.stdout:4/170: link de/f14 de/d20/d24/f32 0 2024-04-26T10:44:28.299 INFO:tasks.workunit.client.0.smithi049.stdout:3/128: rename d3/lc to d3/d19/d22/l2c 0 2024-04-26T10:44:28.299 INFO:tasks.workunit.client.0.smithi049.stdout:6/124: chown da/d20/c21 32248 1 2024-04-26T10:44:28.300 INFO:tasks.workunit.client.0.smithi049.stdout:2/138: read f5 [2549167,11410] 0 2024-04-26T10:44:28.301 INFO:tasks.workunit.client.0.smithi049.stdout:8/122: dread d2/f6 [0,4194304] 0 2024-04-26T10:44:28.302 INFO:tasks.workunit.client.0.smithi049.stdout:5/154: creat d7/d1d/d34/d37/d3e/f40 x:0 0 0 2024-04-26T10:44:28.302 INFO:tasks.workunit.client.0.smithi049.stdout:7/149: read d2/d3/f10 [806236,115620] 0 2024-04-26T10:44:28.302 INFO:tasks.workunit.client.0.smithi049.stdout:0/116: rename d8/db/d11/l29 to d8/db/d26/l2e 0 2024-04-26T10:44:28.303 INFO:tasks.workunit.client.0.smithi049.stdout:1/153: dwrite fd [0,4194304] 0 2024-04-26T10:44:28.303 INFO:tasks.workunit.client.0.smithi049.stdout:5/155: symlink d7/d1d/d20/l41 0 2024-04-26T10:44:28.304 INFO:tasks.workunit.client.0.smithi049.stdout:6/125: rename da/d20 to da/dd/de/d26 0 2024-04-26T10:44:28.304 INFO:tasks.workunit.client.0.smithi049.stdout:0/117: read d8/db/d11/f21 [820830,97259] 0 2024-04-26T10:44:28.305 INFO:tasks.workunit.client.0.smithi049.stdout:1/154: rmdir d1e/d20 39 2024-04-26T10:44:28.305 INFO:tasks.workunit.client.0.smithi049.stdout:5/156: write d7/d1d/d20/f24 [58439,110472] 0 2024-04-26T10:44:28.307 INFO:tasks.workunit.client.0.smithi049.stdout:1/155: write d1e/f2d [819206,35976] 0 2024-04-26T10:44:28.307 INFO:tasks.workunit.client.0.smithi049.stdout:0/118: write d8/db/d26/f2d [220439,98187] 0 2024-04-26T10:44:28.307 INFO:tasks.workunit.client.0.smithi049.stdout:6/126: sync 2024-04-26T10:44:28.307 INFO:tasks.workunit.client.0.smithi049.stdout:2/139: dread d6/d9/db/d11/f1d [0,4194304] 0 2024-04-26T10:44:28.307 INFO:tasks.workunit.client.0.smithi049.stdout:8/123: dread d2/f5 [0,4194304] 0 2024-04-26T10:44:28.308 INFO:tasks.workunit.client.0.smithi049.stdout:4/171: truncate de/d1b/f2b 3307734 0 2024-04-26T10:44:28.308 INFO:tasks.workunit.client.0.smithi049.stdout:3/129: read d3/d19/d8/f9 [2635889,76596] 0 2024-04-26T10:44:28.308 INFO:tasks.workunit.client.0.smithi049.stdout:5/157: link d7/d14/f1b d7/d1d/d34/d37/d3e/f42 0 2024-04-26T10:44:28.310 INFO:tasks.workunit.client.0.smithi049.stdout:0/119: rename d8/db/d11/c20 to d8/db/c2f 0 2024-04-26T10:44:28.311 INFO:tasks.workunit.client.0.smithi049.stdout:4/172: chown de/d20/f22 35 1 2024-04-26T10:44:28.313 INFO:tasks.workunit.client.0.smithi049.stdout:5/158: truncate d7/d1d/f30 5091628 0 2024-04-26T10:44:28.313 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:28.314 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:28.314 INFO:tasks.workunit.client.0.smithi049.stdout:0/120: symlink d8/db/d11/l30 0 2024-04-26T10:44:28.319 INFO:tasks.workunit.client.0.smithi049.stdout:1/156: dwrite d1e/f2d [0,4194304] 0 2024-04-26T10:44:28.320 INFO:tasks.workunit.client.0.smithi049.stdout:9/215: dwrite d2/d1a/df/f30 [0,4194304] 0 2024-04-26T10:44:28.320 INFO:tasks.workunit.client.0.smithi049.stdout:4/173: rename de/l13 to de/d20/l33 0 2024-04-26T10:44:28.320 INFO:tasks.workunit.client.0.smithi049.stdout:5/159: write d7/d1d/d20/f2f [898850,56188] 0 2024-04-26T10:44:28.320 INFO:tasks.workunit.client.0.smithi049.stdout:7/150: dwrite f0 [0,4194304] 0 2024-04-26T10:44:28.323 INFO:tasks.workunit.client.0.smithi049.stdout:6/127: dwrite da/f19 [0,4194304] 0 2024-04-26T10:44:28.323 INFO:tasks.workunit.client.0.smithi049.stdout:0/121: chown d8/db/l17 2004 1 2024-04-26T10:44:28.324 INFO:tasks.workunit.client.0.smithi049.stdout:8/124: dread d2/f14 [0,4194304] 0 2024-04-26T10:44:28.324 INFO:tasks.workunit.client.0.smithi049.stdout:2/140: dwrite d6/d9/f19 [0,4194304] 0 2024-04-26T10:44:28.324 INFO:tasks.workunit.client.0.smithi049.stdout:1/157: truncate f19 4562145 0 2024-04-26T10:44:28.324 INFO:tasks.workunit.client.0.smithi049.stdout:4/174: readlink de/d20/d24/l2a 0 2024-04-26T10:44:28.324 INFO:tasks.workunit.client.0.smithi049.stdout:7/151: creat d2/f33 x:0 0 0 2024-04-26T10:44:28.325 INFO:tasks.workunit.client.0.smithi049.stdout:5/160: creat d7/f43 x:0 0 0 2024-04-26T10:44:28.325 INFO:tasks.workunit.client.0.smithi049.stdout:3/130: dread d3/d6/f10 [0,4194304] 0 2024-04-26T10:44:28.325 INFO:tasks.workunit.client.0.smithi049.stdout:3/131: sync 2024-04-26T10:44:28.325 INFO:tasks.workunit.client.0.smithi049.stdout:6/128: truncate da/dd/de/d1a/f24 680183 0 2024-04-26T10:44:28.325 INFO:tasks.workunit.client.0.smithi049.stdout:8/125: truncate d2/f5 5078057 0 2024-04-26T10:44:28.326 INFO:tasks.workunit.client.0.smithi049.stdout:3/132: creat d3/d19/d22/f2d x:0 0 0 2024-04-26T10:44:28.326 INFO:tasks.workunit.client.0.smithi049.stdout:8/126: chown d2/d1a 3429069 1 2024-04-26T10:44:28.326 INFO:tasks.workunit.client.0.smithi049.stdout:8/127: stat d2/fe 0 2024-04-26T10:44:28.326 INFO:tasks.workunit.client.0.smithi049.stdout:3/133: mkdir d3/d19/d22/d2e 0 2024-04-26T10:44:28.327 INFO:tasks.workunit.client.0.smithi049.stdout:6/129: rename da/dd/de/d1a to da/dd/de/d26/d27 0 2024-04-26T10:44:28.327 INFO:tasks.workunit.client.0.smithi049.stdout:8/128: write d2/f14 [2608884,107063] 0 2024-04-26T10:44:28.328 INFO:tasks.workunit.client.0.smithi049.stdout:3/134: mkdir d3/d23/d2f 0 2024-04-26T10:44:28.328 INFO:tasks.workunit.client.0.smithi049.stdout:6/130: symlink da/dd/l28 0 2024-04-26T10:44:28.328 INFO:tasks.workunit.client.0.smithi049.stdout:8/129: rmdir d2/d1a 39 2024-04-26T10:44:28.329 INFO:tasks.workunit.client.0.smithi049.stdout:6/131: readlink da/dd/l28 0 2024-04-26T10:44:28.329 INFO:tasks.workunit.client.0.smithi049.stdout:8/130: dread - d2/d1a/f1e zero size 2024-04-26T10:44:28.330 INFO:tasks.workunit.client.0.smithi049.stdout:8/131: readlink d2/l4 0 2024-04-26T10:44:28.330 INFO:tasks.workunit.client.0.smithi049.stdout:8/132: stat d2/d16/d19/c26 0 2024-04-26T10:44:28.331 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:28.332 INFO:tasks.workunit.client.0.smithi049.stdout:0/122: symlink d8/db/d11/d1b/l31 0 2024-04-26T10:44:28.333 INFO:tasks.workunit.client.0.smithi049.stdout:9/216: read d2/d1a/f2a [935994,109429] 0 2024-04-26T10:44:28.333 INFO:tasks.workunit.client.0.smithi049.stdout:7/152: chown d2/f6 16322 1 2024-04-26T10:44:28.333 INFO:tasks.workunit.client.0.smithi049.stdout:5/161: dwrite d7/d1d/d1f/d22/f35 [0,4194304] 0 2024-04-26T10:44:28.334 INFO:tasks.workunit.client.0.smithi049.stdout:3/135: dwrite d3/f2a [0,4194304] 0 2024-04-26T10:44:28.334 INFO:tasks.workunit.client.0.smithi049.stdout:9/217: mkdir d2/d40 0 2024-04-26T10:44:28.335 INFO:tasks.workunit.client.0.smithi049.stdout:4/175: read de/d20/d24/f31 [358541,89525] 0 2024-04-26T10:44:28.335 INFO:tasks.workunit.client.0.smithi049.stdout:7/153: stat d2/d3/l1a 0 2024-04-26T10:44:28.336 INFO:tasks.workunit.client.0.smithi049.stdout:5/162: creat d7/f44 x:0 0 0 2024-04-26T10:44:28.336 INFO:tasks.workunit.client.0.smithi049.stdout:0/123: chown d8/db/d11/d1b/l22 52 1 2024-04-26T10:44:28.337 INFO:tasks.workunit.client.0.smithi049.stdout:9/218: write d2/f3c [357211,100130] 0 2024-04-26T10:44:28.338 INFO:tasks.workunit.client.0.smithi049.stdout:0/124: fsync d8/db/f25 0 2024-04-26T10:44:28.338 INFO:tasks.workunit.client.0.smithi049.stdout:6/132: truncate f6 541770 0 2024-04-26T10:44:28.338 INFO:tasks.workunit.client.0.smithi049.stdout:5/163: dread - d7/d1d/d1f/f3b zero size 2024-04-26T10:44:28.338 INFO:tasks.workunit.client.0.smithi049.stdout:7/154: creat d2/d3/f34 x:0 0 0 2024-04-26T10:44:28.340 INFO:tasks.workunit.client.0.smithi049.stdout:1/158: dread f11 [0,4194304] 0 2024-04-26T10:44:28.341 INFO:tasks.workunit.client.0.smithi049.stdout:9/219: symlink d2/d1a/df/l41 0 2024-04-26T10:44:28.341 INFO:tasks.workunit.client.0.smithi049.stdout:8/133: write d2/d1a/f22 [4801249,35766] 0 2024-04-26T10:44:28.341 INFO:tasks.workunit.client.0.smithi049.stdout:7/155: dread - d2/f1b zero size 2024-04-26T10:44:28.341 INFO:tasks.workunit.client.0.smithi049.stdout:5/164: symlink d7/d14/d18/l45 0 2024-04-26T10:44:28.342 INFO:tasks.workunit.client.0.smithi049.stdout:2/141: dwrite d6/d9/db/f24 [0,4194304] 0 2024-04-26T10:44:28.342 INFO:tasks.workunit.client.0.smithi049.stdout:0/125: creat d8/db/d11/f32 x:0 0 0 2024-04-26T10:44:28.342 INFO:tasks.workunit.client.0.smithi049.stdout:1/159: truncate fa 1422457 0 2024-04-26T10:44:28.343 INFO:tasks.workunit.client.0.smithi049.stdout:7/156: dread - d2/d3/f34 zero size 2024-04-26T10:44:28.343 INFO:tasks.workunit.client.0.smithi049.stdout:9/220: chown d2/l18 75 1 2024-04-26T10:44:28.343 INFO:tasks.workunit.client.0.smithi049.stdout:8/134: rmdir d2/d16 39 2024-04-26T10:44:28.343 INFO:tasks.workunit.client.0.smithi049.stdout:3/136: dwrite f1 [0,4194304] 0 2024-04-26T10:44:28.343 INFO:tasks.workunit.client.0.smithi049.stdout:2/142: fdatasync f3 0 2024-04-26T10:44:28.344 INFO:tasks.workunit.client.0.smithi049.stdout:5/165: rename d7/d1d/d20/f2f to d7/d14/d18/f46 0 2024-04-26T10:44:28.345 INFO:tasks.workunit.client.0.smithi049.stdout:8/135: readlink d2/l4 0 2024-04-26T10:44:28.345 INFO:tasks.workunit.client.0.smithi049.stdout:6/133: dread da/dd/de/d26/d27/f24 [0,4194304] 0 2024-04-26T10:44:28.345 INFO:tasks.workunit.client.0.smithi049.stdout:4/176: write f7 [2515644,91694] 0 2024-04-26T10:44:28.345 INFO:tasks.workunit.client.0.smithi049.stdout:1/160: creat d1e/d20/f32 x:0 0 0 2024-04-26T10:44:28.345 INFO:tasks.workunit.client.0.smithi049.stdout:9/221: mkdir d2/d1a/d42 0 2024-04-26T10:44:28.346 INFO:tasks.workunit.client.0.smithi049.stdout:4/177: readlink l2 0 2024-04-26T10:44:28.346 INFO:tasks.workunit.client.0.smithi049.stdout:3/137: symlink d3/l30 0 2024-04-26T10:44:28.346 INFO:tasks.workunit.client.0.smithi049.stdout:1/161: rmdir d1e/d20/d26 39 2024-04-26T10:44:28.346 INFO:tasks.workunit.client.0.smithi049.stdout:9/222: chown d2/d1a/df/c29 81912286 1 2024-04-26T10:44:28.347 INFO:tasks.workunit.client.0.smithi049.stdout:6/134: chown da/dd/de/d11/f12 0 1 2024-04-26T10:44:28.347 INFO:tasks.workunit.client.0.smithi049.stdout:4/178: write f1 [4079357,113100] 0 2024-04-26T10:44:28.347 INFO:tasks.workunit.client.0.smithi049.stdout:8/136: creat d2/df/d18/d2a/f2b x:0 0 0 2024-04-26T10:44:28.348 INFO:tasks.workunit.client.0.smithi049.stdout:8/137: rmdir d2/d17 39 2024-04-26T10:44:28.348 INFO:tasks.workunit.client.0.smithi049.stdout:4/179: chown de/d20/f25 24161 1 2024-04-26T10:44:28.348 INFO:tasks.workunit.client.0.smithi049.stdout:6/135: mkdir da/dd/de/d26/d29 0 2024-04-26T10:44:28.348 INFO:tasks.workunit.client.0.smithi049.stdout:8/138: stat d2/df/d10 0 2024-04-26T10:44:28.348 INFO:tasks.workunit.client.0.smithi049.stdout:5/166: dread d7/d1d/d20/f24 [0,4194304] 0 2024-04-26T10:44:28.348 INFO:tasks.workunit.client.0.smithi049.stdout:9/223: read d2/f8 [3775359,43921] 0 2024-04-26T10:44:28.349 INFO:tasks.workunit.client.0.smithi049.stdout:6/136: write da/f19 [4982541,30231] 0 2024-04-26T10:44:28.350 INFO:tasks.workunit.client.0.smithi049.stdout:5/167: write d7/d14/d18/f46 [740451,100004] 0 2024-04-26T10:44:28.350 INFO:tasks.workunit.client.0.smithi049.stdout:1/162: dread fd [0,4194304] 0 2024-04-26T10:44:28.351 INFO:tasks.workunit.client.0.smithi049.stdout:2/143: truncate d6/f8 641911 0 2024-04-26T10:44:28.351 INFO:tasks.workunit.client.0.smithi049.stdout:7/157: write d2/dd/f26 [2016123,21116] 0 2024-04-26T10:44:28.351 INFO:tasks.workunit.client.0.smithi049.stdout:4/180: getdents de/d1b 0 2024-04-26T10:44:28.351 INFO:tasks.workunit.client.0.smithi049.stdout:8/139: rename d2/f9 to d2/d1a/d27/f2c 0 2024-04-26T10:44:28.352 INFO:tasks.workunit.client.0.smithi049.stdout:5/168: symlink d7/l47 0 2024-04-26T10:44:28.352 INFO:tasks.workunit.client.0.smithi049.stdout:9/224: rename d2/d1a/df/f35 to d2/d1a/d1b/d1f/f43 0 2024-04-26T10:44:28.352 INFO:tasks.workunit.client.0.smithi049.stdout:4/181: write f1 [4425420,102551] 0 2024-04-26T10:44:28.352 INFO:tasks.workunit.client.0.smithi049.stdout:7/158: readlink d2/d3/l9 0 2024-04-26T10:44:28.353 INFO:tasks.workunit.client.0.smithi049.stdout:2/144: rmdir d6/d9/db 39 2024-04-26T10:44:28.353 INFO:tasks.workunit.client.0.smithi049.stdout:1/163: creat d1e/d20/d26/f33 x:0 0 0 2024-04-26T10:44:28.354 INFO:tasks.workunit.client.0.smithi049.stdout:9/225: mknod d2/d1a/c44 0 2024-04-26T10:44:28.354 INFO:tasks.workunit.client.0.smithi049.stdout:4/182: dread - de/d1d/f23 zero size 2024-04-26T10:44:28.354 INFO:tasks.workunit.client.0.smithi049.stdout:4/183: sync 2024-04-26T10:44:28.354 INFO:tasks.workunit.client.0.smithi049.stdout:7/159: symlink d2/l35 0 2024-04-26T10:44:28.355 INFO:tasks.workunit.client.0.smithi049.stdout:9/226: unlink d2/f19 0 2024-04-26T10:44:28.355 INFO:tasks.workunit.client.0.smithi049.stdout:1/164: write f0 [2494446,40929] 0 2024-04-26T10:44:28.356 INFO:tasks.workunit.client.0.smithi049.stdout:5/169: rename d7/d14/d18/d2b/d3f to d7/d14/d18/d48 0 2024-04-26T10:44:28.356 INFO:tasks.workunit.client.0.smithi049.stdout:4/184: rmdir de/d1d 39 2024-04-26T10:44:28.356 INFO:tasks.workunit.client.0.smithi049.stdout:6/137: truncate da/dd/f10 782863 0 2024-04-26T10:44:28.357 INFO:tasks.workunit.client.0.smithi049.stdout:7/160: creat d2/d3/de/d1c/f36 x:0 0 0 2024-04-26T10:44:28.357 INFO:tasks.workunit.client.0.smithi049.stdout:0/126: dread d8/db/f25 [0,4194304] 0 2024-04-26T10:44:28.357 INFO:tasks.workunit.client.0.smithi049.stdout:4/185: unlink de/c16 0 2024-04-26T10:44:28.358 INFO:tasks.workunit.client.0.smithi049.stdout:9/227: creat d2/d1a/f45 x:0 0 0 2024-04-26T10:44:28.359 INFO:tasks.workunit.client.0.smithi049.stdout:3/138: dwrite d3/d19/d8/dd/f18 [0,4194304] 0 2024-04-26T10:44:28.359 INFO:tasks.workunit.client.0.smithi049.stdout:1/165: mknod d1e/d20/d26/c34 0 2024-04-26T10:44:28.360 INFO:tasks.workunit.client.0.smithi049.stdout:7/161: write d2/fc [172720,15302] 0 2024-04-26T10:44:28.360 INFO:tasks.workunit.client.0.smithi049.stdout:8/140: dwrite d2/f8 [0,4194304] 0 2024-04-26T10:44:28.360 INFO:tasks.workunit.client.0.smithi049.stdout:9/228: readlink d2/d25/l33 0 2024-04-26T10:44:28.361 INFO:tasks.workunit.client.0.smithi049.stdout:0/127: creat d8/db/f33 x:0 0 0 2024-04-26T10:44:28.362 INFO:tasks.workunit.client.0.smithi049.stdout:6/138: write da/dd/de/d26/d22/f25 [690237,125526] 0 2024-04-26T10:44:28.362 INFO:tasks.workunit.client.0.smithi049.stdout:4/186: creat de/d1b/f34 x:0 0 0 2024-04-26T10:44:28.363 INFO:tasks.workunit.client.0.smithi049.stdout:4/187: readlink de/l1a 0 2024-04-26T10:44:28.364 INFO:tasks.workunit.client.0.smithi049.stdout:7/162: stat d2/d3/lb 0 2024-04-26T10:44:28.365 INFO:tasks.workunit.client.0.smithi049.stdout:9/229: symlink d2/l46 0 2024-04-26T10:44:28.365 INFO:tasks.workunit.client.0.smithi049.stdout:5/170: write d7/d1d/d34/d37/d3e/f42 [332454,104694] 0 2024-04-26T10:44:28.365 INFO:tasks.workunit.client.0.smithi049.stdout:6/139: read da/dd/de/f18 [72265,89605] 0 2024-04-26T10:44:28.366 INFO:tasks.workunit.client.0.smithi049.stdout:9/230: dread - d2/d25/f3e zero size 2024-04-26T10:44:28.367 INFO:tasks.workunit.client.0.smithi049.stdout:8/141: read d2/d16/d19/f25 [142971,102454] 0 2024-04-26T10:44:28.367 INFO:tasks.workunit.client.0.smithi049.stdout:6/140: chown da/dd/de/d26/d29 16330 1 2024-04-26T10:44:28.367 INFO:tasks.workunit.client.0.smithi049.stdout:2/145: dwrite d6/f7 [0,4194304] 0 2024-04-26T10:44:28.368 INFO:tasks.workunit.client.0.smithi049.stdout:5/171: stat d7/l12 0 2024-04-26T10:44:28.369 INFO:tasks.workunit.client.0.smithi049.stdout:7/163: symlink d2/l37 0 2024-04-26T10:44:28.369 INFO:tasks.workunit.client.0.smithi049.stdout:3/139: getdents d3/d23 0 2024-04-26T10:44:28.371 INFO:tasks.workunit.client.0.smithi049.stdout:5/172: dread - d7/d1d/d34/d37/d3e/f40 zero size 2024-04-26T10:44:28.372 INFO:tasks.workunit.client.0.smithi049.stdout:6/141: creat da/dd/f2a x:0 0 0 2024-04-26T10:44:28.372 INFO:tasks.workunit.client.0.smithi049.stdout:1/166: dwrite f9 [0,4194304] 0 2024-04-26T10:44:28.373 INFO:tasks.workunit.client.0.smithi049.stdout:3/140: chown d3/d19/c15 2 1 2024-04-26T10:44:28.374 INFO:teuthology.orchestra.run.smithi049.stderr:noscrub is unset 2024-04-26T10:44:28.374 INFO:tasks.workunit.client.0.smithi049.stdout:7/164: mkdir d2/dd/d38 0 2024-04-26T10:44:28.374 INFO:tasks.workunit.client.0.smithi049.stdout:2/146: rmdir d6/d9/db/d11 39 2024-04-26T10:44:28.374 INFO:tasks.workunit.client.0.smithi049.stdout:5/173: readlink d7/d14/l2a 0 2024-04-26T10:44:28.375 INFO:tasks.workunit.client.0.smithi049.stdout:7/165: fsync d2/d3/f2a 0 2024-04-26T10:44:28.377 INFO:tasks.workunit.client.0.smithi049.stdout:9/231: dwrite d2/d1a/f45 [0,4194304] 0 2024-04-26T10:44:28.379 INFO:tasks.workunit.client.0.smithi049.stdout:2/147: write d6/f7 [1734564,3532] 0 2024-04-26T10:44:28.380 INFO:tasks.workunit.client.0.smithi049.stdout:4/188: dwrite de/d1b/f26 [0,4194304] 0 2024-04-26T10:44:28.381 INFO:tasks.workunit.client.0.smithi049.stdout:9/232: creat d2/d1a/df/f47 x:0 0 0 2024-04-26T10:44:28.382 INFO:tasks.workunit.client.0.smithi049.stdout:2/148: chown d6/d9/db/df/f22 996 1 2024-04-26T10:44:28.383 INFO:tasks.workunit.client.0.smithi049.stdout:0/128: dwrite d8/f18 [0,4194304] 0 2024-04-26T10:44:28.385 INFO:tasks.workunit.client.0.smithi049.stdout:2/149: chown d6/d9/l1f 988014 1 2024-04-26T10:44:28.385 INFO:tasks.workunit.client.0.smithi049.stdout:1/167: dwrite f11 [4194304,4194304] 0 2024-04-26T10:44:28.387 INFO:tasks.workunit.client.0.smithi049.stdout:1/168: unlink f1a 0 2024-04-26T10:44:28.388 INFO:tasks.workunit.client.0.smithi049.stdout:3/141: dwrite d3/d19/d8/dd/f18 [4194304,4194304] 0 2024-04-26T10:44:28.389 INFO:tasks.workunit.client.0.smithi049.stdout:6/142: truncate f8 2291381 0 2024-04-26T10:44:28.389 INFO:tasks.workunit.client.0.smithi049.stdout:8/142: dwrite d2/d1a/f28 [0,4194304] 0 2024-04-26T10:44:28.390 INFO:tasks.workunit.client.0.smithi049.stdout:6/143: dread - da/dd/f1d zero size 2024-04-26T10:44:28.390 INFO:tasks.workunit.client.0.smithi049.stdout:2/150: chown d6/d9/db/df/l1b 2393 1 2024-04-26T10:44:28.390 INFO:tasks.workunit.client.0.smithi049.stdout:4/189: truncate f8 270841 0 2024-04-26T10:44:28.392 INFO:tasks.workunit.client.0.smithi049.stdout:4/190: chown l2 123017 1 2024-04-26T10:44:28.392 INFO:tasks.workunit.client.0.smithi049.stdout:8/143: symlink d2/df/d10/l2d 0 2024-04-26T10:44:28.393 INFO:tasks.workunit.client.0.smithi049.stdout:0/129: getdents d8/db/d11/d1c 0 2024-04-26T10:44:28.393 INFO:tasks.workunit.client.0.smithi049.stdout:6/144: chown da/dd/de/d26/d27 3731 1 2024-04-26T10:44:28.394 INFO:tasks.workunit.client.0.smithi049.stdout:1/169: write fa [2236949,23993] 0 2024-04-26T10:44:28.394 INFO:tasks.workunit.client.0.smithi049.stdout:2/151: chown d6/l26 2376 1 2024-04-26T10:44:28.394 INFO:tasks.workunit.client.0.smithi049.stdout:3/142: creat d3/d19/d22/d2e/f31 x:0 0 0 2024-04-26T10:44:28.394 INFO:tasks.workunit.client.0.smithi049.stdout:9/233: dwrite d2/d1a/d1b/f16 [4194304,4194304] 0 2024-04-26T10:44:28.394 INFO:tasks.workunit.client.0.smithi049.stdout:8/144: creat d2/d16/f2e x:0 0 0 2024-04-26T10:44:28.395 INFO:tasks.workunit.client.0.smithi049.stdout:0/130: read d8/db/d26/f2d [361839,67815] 0 2024-04-26T10:44:28.395 INFO:tasks.workunit.client.0.smithi049.stdout:5/174: dwrite d7/f10 [0,4194304] 0 2024-04-26T10:44:28.398 INFO:tasks.workunit.client.0.smithi049.stdout:3/143: rename d3/f2a to d3/d19/d8/f32 0 2024-04-26T10:44:28.398 INFO:tasks.workunit.client.0.smithi049.stdout:6/145: truncate da/fc 4665794 0 2024-04-26T10:44:28.398 INFO:tasks.workunit.client.0.smithi049.stdout:9/234: chown d2/d1a/df/f26 9044894 1 2024-04-26T10:44:28.398 INFO:tasks.workunit.client.0.smithi049.stdout:1/170: mknod d1e/d20/c35 0 2024-04-26T10:44:28.398 INFO:tasks.workunit.client.0.smithi049.stdout:0/131: stat d8/db/d11/d1b 0 2024-04-26T10:44:28.398 INFO:tasks.workunit.client.0.smithi049.stdout:3/144: chown d3/l14 3 1 2024-04-26T10:44:28.399 INFO:tasks.workunit.client.0.smithi049.stdout:8/145: creat d2/f2f x:0 0 0 2024-04-26T10:44:28.400 INFO:tasks.workunit.client.0.smithi049.stdout:0/132: rename d8 to d8/db/d34 22 2024-04-26T10:44:28.400 INFO:tasks.workunit.client.0.smithi049.stdout:1/171: creat d1e/d20/d26/f36 x:0 0 0 2024-04-26T10:44:28.400 INFO:tasks.workunit.client.0.smithi049.stdout:8/146: write d2/d16/f2e [140474,95284] 0 2024-04-26T10:44:28.401 INFO:tasks.workunit.client.0.smithi049.stdout:5/175: getdents d7/d1d/d34/d37 0 2024-04-26T10:44:28.402 INFO:tasks.workunit.client.0.smithi049.stdout:0/133: creat d8/db/d11/d1b/f35 x:0 0 0 2024-04-26T10:44:28.402 INFO:tasks.workunit.client.0.smithi049.stdout:5/176: write d7/d1d/f27 [7024451,115665] 0 2024-04-26T10:44:28.402 INFO:tasks.workunit.client.0.smithi049.stdout:8/147: mkdir d2/df/d18/d30 0 2024-04-26T10:44:28.404 INFO:tasks.workunit.client.0.smithi049.stdout:1/172: getdents d1e/d20 0 2024-04-26T10:44:28.404 INFO:tasks.workunit.client.0.smithi049.stdout:5/177: fsync d7/d14/d18/f46 0 2024-04-26T10:44:28.404 INFO:tasks.workunit.client.0.smithi049.stdout:0/134: unlink d8/db/d11/d1b/f35 0 2024-04-26T10:44:28.404 INFO:tasks.workunit.client.0.smithi049.stdout:5/178: write f3 [6873312,71266] 0 2024-04-26T10:44:28.404 INFO:tasks.workunit.client.0.smithi049.stdout:1/173: mkdir d1e/d20/d26/d37 0 2024-04-26T10:44:28.405 INFO:tasks.workunit.client.0.smithi049.stdout:2/152: truncate d6/d9/f19 2223117 0 2024-04-26T10:44:28.406 INFO:tasks.workunit.client.0.smithi049.stdout:2/153: fdatasync d6/f29 0 2024-04-26T10:44:28.406 INFO:tasks.workunit.client.0.smithi049.stdout:7/166: read d2/fc [137468,116945] 0 2024-04-26T10:44:28.407 INFO:tasks.workunit.client.0.smithi049.stdout:0/135: link d8/db/d11/f21 d8/db/d11/d1c/f36 0 2024-04-26T10:44:28.410 INFO:tasks.workunit.client.0.smithi049.stdout:0/136: rename d8/lf to d8/d1e/l37 0 2024-04-26T10:44:28.410 INFO:tasks.workunit.client.0.smithi049.stdout:7/167: truncate d2/dd/d25/d27/f30 81817 0 2024-04-26T10:44:28.410 INFO:tasks.workunit.client.0.smithi049.stdout:8/148: dwrite d2/f5 [0,4194304] 0 2024-04-26T10:44:28.410 INFO:tasks.workunit.client.0.smithi049.stdout:2/154: getdents d6/d9 0 2024-04-26T10:44:28.413 INFO:tasks.workunit.client.0.smithi049.stdout:1/174: dwrite d1e/d20/f28 [0,4194304] 0 2024-04-26T10:44:28.414 INFO:tasks.workunit.client.0.smithi049.stdout:9/235: dwrite d2/d1a/f2a [0,4194304] 0 2024-04-26T10:44:28.415 INFO:tasks.workunit.client.0.smithi049.stdout:8/149: truncate d2/d16/d19/f25 190277 0 2024-04-26T10:44:28.415 INFO:tasks.workunit.client.0.smithi049.stdout:7/168: link d2/l37 d2/dd/d25/d27/l39 0 2024-04-26T10:44:28.415 INFO:tasks.workunit.client.0.smithi049.stdout:1/175: write d1e/f1f [375495,38194] 0 2024-04-26T10:44:28.415 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:28.413+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:28.416 INFO:tasks.workunit.client.0.smithi049.stdout:2/155: getdents d6/d9/db/d1e 0 2024-04-26T10:44:28.416 INFO:tasks.workunit.client.0.smithi049.stdout:7/169: write d2/f33 [279962,19283] 0 2024-04-26T10:44:28.416 INFO:tasks.workunit.client.0.smithi049.stdout:0/137: dread d8/f18 [0,4194304] 0 2024-04-26T10:44:28.416 INFO:tasks.workunit.client.0.smithi049.stdout:9/236: truncate d2/d1a/df/f47 715227 0 2024-04-26T10:44:28.417 INFO:tasks.workunit.client.0.smithi049.stdout:8/150: rename d2/d1a/f28 to d2/df/d10/d23/f31 0 2024-04-26T10:44:28.417 INFO:tasks.workunit.client.0.smithi049.stdout:2/156: write d6/d9/db/df/f22 [3847178,30522] 0 2024-04-26T10:44:28.417 INFO:tasks.workunit.client.0.smithi049.stdout:8/151: symlink d2/df/l32 0 2024-04-26T10:44:28.419 INFO:tasks.workunit.client.0.smithi049.stdout:9/237: truncate d2/d1a/d1b/d1f/f3d 557728 0 2024-04-26T10:44:28.420 INFO:tasks.workunit.client.0.smithi049.stdout:8/152: rmdir d2/df/d18/d2a 39 2024-04-26T10:44:28.420 INFO:tasks.workunit.client.0.smithi049.stdout:9/238: mknod d2/d1a/df/c48 0 2024-04-26T10:44:28.421 INFO:tasks.workunit.client.0.smithi049.stdout:2/157: symlink d6/d9/db/d11/l2c 0 2024-04-26T10:44:28.421 INFO:tasks.workunit.client.0.smithi049.stdout:7/170: read d2/d3/f20 [1797328,94367] 0 2024-04-26T10:44:28.422 INFO:tasks.workunit.client.0.smithi049.stdout:8/153: write d2/fe [1762433,86779] 0 2024-04-26T10:44:28.422 INFO:tasks.workunit.client.0.smithi049.stdout:1/176: dwrite d1e/d20/d26/f36 [0,4194304] 0 2024-04-26T10:44:28.423 INFO:tasks.workunit.client.0.smithi049.stdout:4/191: dread de/d20/f22 [0,4194304] 0 2024-04-26T10:44:28.424 INFO:tasks.workunit.client.0.smithi049.stdout:0/138: dwrite d8/db/d11/f32 [0,4194304] 0 2024-04-26T10:44:28.424 INFO:tasks.workunit.client.0.smithi049.stdout:1/177: creat d1e/d20/f38 x:0 0 0 2024-04-26T10:44:28.424 INFO:tasks.workunit.client.0.smithi049.stdout:2/158: link d6/l26 d6/d9/l2d 0 2024-04-26T10:44:28.426 INFO:tasks.workunit.client.0.smithi049.stdout:0/139: rename d8/db/d11/d1c/f36 to d8/db/d26/f38 0 2024-04-26T10:44:28.427 INFO:tasks.workunit.client.0.smithi049.stdout:0/140: unlink d8/db/d11/f21 0 2024-04-26T10:44:28.428 INFO:tasks.workunit.client.0.smithi049.stdout:4/192: write f8 [985528,49938] 0 2024-04-26T10:44:28.429 INFO:tasks.workunit.client.0.smithi049.stdout:0/141: stat d8/db/d11/d1b/l31 0 2024-04-26T10:44:28.429 INFO:tasks.workunit.client.0.smithi049.stdout:8/154: dwrite d2/f12 [0,4194304] 0 2024-04-26T10:44:28.429 INFO:tasks.workunit.client.0.smithi049.stdout:9/239: dread d2/d1a/d1b/d1f/f3d [0,4194304] 0 2024-04-26T10:44:28.431 INFO:tasks.workunit.client.0.smithi049.stdout:7/171: dwrite d2/d3/de/f29 [0,4194304] 0 2024-04-26T10:44:28.431 INFO:tasks.workunit.client.0.smithi049.stdout:2/159: getdents d6/d9/db/d1e 0 2024-04-26T10:44:28.431 INFO:tasks.workunit.client.0.smithi049.stdout:1/178: write d1e/d20/d26/f30 [631543,75127] 0 2024-04-26T10:44:28.431 INFO:tasks.workunit.client.0.smithi049.stdout:4/193: rename de/d1b/f2b to de/d20/f35 0 2024-04-26T10:44:28.431 INFO:tasks.workunit.client.0.smithi049.stdout:6/146: sync 2024-04-26T10:44:28.432 INFO:tasks.workunit.client.0.smithi049.stdout:9/240: mkdir d2/d1a/d1b/d1f/d49 0 2024-04-26T10:44:28.432 INFO:tasks.workunit.client.0.smithi049.stdout:8/155: rename d2/df/d10/d23/f24 to d2/d16/d19/f33 0 2024-04-26T10:44:28.433 INFO:tasks.workunit.client.0.smithi049.stdout:4/194: mknod de/d20/d24/c36 0 2024-04-26T10:44:28.434 INFO:tasks.workunit.client.0.smithi049.stdout:2/160: symlink d6/d9/l2e 0 2024-04-26T10:44:28.434 INFO:tasks.workunit.client.0.smithi049.stdout:6/147: creat da/f2b x:0 0 0 2024-04-26T10:44:28.434 INFO:tasks.workunit.client.0.smithi049.stdout:7/172: link d2/d3/l8 d2/dd/d38/l3a 0 2024-04-26T10:44:28.434 INFO:tasks.workunit.client.0.smithi049.stdout:8/156: chown d2/d1a/f22 12071 1 2024-04-26T10:44:28.434 INFO:tasks.workunit.client.0.smithi049.stdout:0/142: dread d8/db/d26/f2d [0,4194304] 0 2024-04-26T10:44:28.435 INFO:tasks.workunit.client.0.smithi049.stdout:0/143: chown d8/db/ce 199 1 2024-04-26T10:44:28.436 INFO:tasks.workunit.client.0.smithi049.stdout:6/148: symlink da/dd/de/d26/d27/l2c 0 2024-04-26T10:44:28.436 INFO:tasks.workunit.client.0.smithi049.stdout:4/195: creat de/f37 x:0 0 0 2024-04-26T10:44:28.436 INFO:tasks.workunit.client.0.smithi049.stdout:7/173: mknod d2/dd/d25/d27/c3b 0 2024-04-26T10:44:28.436 INFO:tasks.workunit.client.0.smithi049.stdout:0/144: unlink d8/db/l17 0 2024-04-26T10:44:28.437 INFO:tasks.workunit.client.0.smithi049.stdout:7/174: creat d2/d3/f3c x:0 0 0 2024-04-26T10:44:28.437 INFO:tasks.workunit.client.0.smithi049.stdout:6/149: rmdir da/dd/de/d11 39 2024-04-26T10:44:28.438 INFO:tasks.workunit.client.0.smithi049.stdout:9/241: dread d2/d1a/f2a [0,4194304] 0 2024-04-26T10:44:28.438 INFO:tasks.workunit.client.0.smithi049.stdout:2/161: dread d6/d9/db/f1c [0,4194304] 0 2024-04-26T10:44:28.439 INFO:tasks.workunit.client.0.smithi049.stdout:9/242: chown d2/d1a/df/l22 68723 1 2024-04-26T10:44:28.439 INFO:tasks.workunit.client.0.smithi049.stdout:7/175: rename d2/d3/f10 to d2/dd/d38/f3d 0 2024-04-26T10:44:28.439 INFO:tasks.workunit.client.0.smithi049.stdout:2/162: creat d6/f2f x:0 0 0 2024-04-26T10:44:28.439 INFO:tasks.workunit.client.0.smithi049.stdout:9/243: creat d2/d1a/df/f4a x:0 0 0 2024-04-26T10:44:28.440 INFO:tasks.workunit.client.0.smithi049.stdout:7/176: write d2/f22 [932461,95007] 0 2024-04-26T10:44:28.440 INFO:tasks.workunit.client.0.smithi049.stdout:2/163: mkdir d6/d30 0 2024-04-26T10:44:28.441 INFO:tasks.workunit.client.0.smithi049.stdout:9/244: write d2/d1a/d1b/d1f/f3f [258061,94739] 0 2024-04-26T10:44:28.441 INFO:tasks.workunit.client.0.smithi049.stdout:1/179: truncate fe 2411961 0 2024-04-26T10:44:28.441 INFO:tasks.workunit.client.0.smithi049.stdout:7/177: unlink d2/dd/f17 0 2024-04-26T10:44:28.442 INFO:tasks.workunit.client.0.smithi049.stdout:9/245: chown d2/d1a/df/f30 4267 1 2024-04-26T10:44:28.442 INFO:tasks.workunit.client.0.smithi049.stdout:1/180: rename l7 to d1e/d20/d26/l39 0 2024-04-26T10:44:28.442 INFO:tasks.workunit.client.0.smithi049.stdout:8/157: truncate d2/f8 2662722 0 2024-04-26T10:44:28.443 INFO:tasks.workunit.client.0.smithi049.stdout:1/181: creat d1e/f3a x:0 0 0 2024-04-26T10:44:28.443 INFO:tasks.workunit.client.0.smithi049.stdout:8/158: write f1 [2120531,11484] 0 2024-04-26T10:44:28.444 INFO:tasks.workunit.client.0.smithi049.stdout:2/164: dread d6/f7 [0,4194304] 0 2024-04-26T10:44:28.445 INFO:tasks.workunit.client.0.smithi049.stdout:1/182: write f12 [1213261,60350] 0 2024-04-26T10:44:28.446 INFO:tasks.workunit.client.0.smithi049.stdout:8/159: mkdir d2/d17/d34 0 2024-04-26T10:44:28.446 INFO:tasks.workunit.client.0.smithi049.stdout:6/150: write f8 [461571,43674] 0 2024-04-26T10:44:28.446 INFO:tasks.workunit.client.0.smithi049.stdout:3/145: dread d3/d6/f12 [0,4194304] 0 2024-04-26T10:44:28.446 INFO:tasks.workunit.client.0.smithi049.stdout:0/145: write d8/db/d26/f38 [4606408,79976] 0 2024-04-26T10:44:28.446 INFO:tasks.workunit.client.0.smithi049.stdout:1/183: readlink d1e/d20/l22 0 2024-04-26T10:44:28.447 INFO:tasks.workunit.client.0.smithi049.stdout:2/165: mkdir d6/d9/db/df/d31 0 2024-04-26T10:44:28.447 INFO:tasks.workunit.client.0.smithi049.stdout:6/151: chown da/l16 429210 1 2024-04-26T10:44:28.448 INFO:tasks.workunit.client.0.smithi049.stdout:8/160: creat d2/df/d18/d2a/f35 x:0 0 0 2024-04-26T10:44:28.448 INFO:tasks.workunit.client.0.smithi049.stdout:3/146: read d3/f1c [29125,116706] 0 2024-04-26T10:44:28.449 INFO:tasks.workunit.client.0.smithi049.stdout:1/184: write d1e/f3a [548646,100833] 0 2024-04-26T10:44:28.449 INFO:tasks.workunit.client.0.smithi049.stdout:7/178: dwrite d2/d3/de/d1c/f36 [0,4194304] 0 2024-04-26T10:44:28.449 INFO:tasks.workunit.client.0.smithi049.stdout:4/196: dread de/d20/f2e [0,4194304] 0 2024-04-26T10:44:28.449 INFO:tasks.workunit.client.0.smithi049.stdout:8/161: chown d2/f2f 7024706 1 2024-04-26T10:44:28.450 INFO:tasks.workunit.client.0.smithi049.stdout:2/166: mkdir d6/d32 0 2024-04-26T10:44:28.450 INFO:tasks.workunit.client.0.smithi049.stdout:6/152: mkdir da/dd/de/d26/d22/d2d 0 2024-04-26T10:44:28.450 INFO:tasks.workunit.client.0.smithi049.stdout:7/179: readlink d2/d3/l1a 0 2024-04-26T10:44:28.450 INFO:tasks.workunit.client.0.smithi049.stdout:4/197: mkdir de/d20/d38 0 2024-04-26T10:44:28.452 INFO:tasks.workunit.client.0.smithi049.stdout:9/246: truncate d2/d1a/d1b/d1f/f43 3391616 0 2024-04-26T10:44:28.453 INFO:tasks.workunit.client.0.smithi049.stdout:7/180: creat d2/d3/de/d1c/f3e x:0 0 0 2024-04-26T10:44:28.453 INFO:tasks.workunit.client.0.smithi049.stdout:0/146: mkdir d8/db/d26/d39 0 2024-04-26T10:44:28.454 INFO:tasks.workunit.client.0.smithi049.stdout:3/147: link d3/d19/d8/c27 d3/c33 0 2024-04-26T10:44:28.454 INFO:tasks.workunit.client.0.smithi049.stdout:6/153: write da/dd/de/f18 [1033940,102223] 0 2024-04-26T10:44:28.455 INFO:tasks.workunit.client.0.smithi049.stdout:7/181: creat d2/dd/f3f x:0 0 0 2024-04-26T10:44:28.455 INFO:tasks.workunit.client.0.smithi049.stdout:8/162: read d2/d1a/d27/f2c [6499205,92205] 0 2024-04-26T10:44:28.455 INFO:tasks.workunit.client.0.smithi049.stdout:2/167: link d6/d9/c28 d6/d9/db/d1e/c33 0 2024-04-26T10:44:28.455 INFO:tasks.workunit.client.0.smithi049.stdout:3/148: mkdir d3/d19/d8/d34 0 2024-04-26T10:44:28.456 INFO:tasks.workunit.client.0.smithi049.stdout:8/163: dread - d2/d16/d19/f33 zero size 2024-04-26T10:44:28.457 INFO:tasks.workunit.client.0.smithi049.stdout:1/185: dread d1e/f2d [0,4194304] 0 2024-04-26T10:44:28.457 INFO:tasks.workunit.client.0.smithi049.stdout:0/147: link l6 d8/l3a 0 2024-04-26T10:44:28.457 INFO:tasks.workunit.client.0.smithi049.stdout:7/182: creat d2/dd/d38/f40 x:0 0 0 2024-04-26T10:44:28.457 INFO:tasks.workunit.client.0.smithi049.stdout:2/168: mkdir d6/d9/db/d34 0 2024-04-26T10:44:28.459 INFO:tasks.workunit.client.0.smithi049.stdout:1/186: link f12 d1e/f3b 0 2024-04-26T10:44:28.459 INFO:tasks.workunit.client.0.smithi049.stdout:2/169: write d6/f7 [273958,126643] 0 2024-04-26T10:44:28.459 INFO:tasks.workunit.client.0.smithi049.stdout:7/183: creat d2/d3/de/f41 x:0 0 0 2024-04-26T10:44:28.460 INFO:tasks.workunit.client.0.smithi049.stdout:5/179: sync 2024-04-26T10:44:28.460 INFO:tasks.workunit.client.0.smithi049.stdout:9/247: dwrite d2/d1a/f38 [0,4194304] 0 2024-04-26T10:44:28.461 INFO:tasks.workunit.client.0.smithi049.stdout:2/170: stat d6/d30 0 2024-04-26T10:44:28.461 INFO:tasks.workunit.client.0.smithi049.stdout:6/154: write da/ff [602847,59807] 0 2024-04-26T10:44:28.462 INFO:tasks.workunit.client.0.smithi049.stdout:4/198: dwrite de/d1d/f23 [0,4194304] 0 2024-04-26T10:44:28.463 INFO:tasks.workunit.client.0.smithi049.stdout:0/148: rename d8/db/c2f to d8/db/d11/d1c/c3b 0 2024-04-26T10:44:28.463 INFO:tasks.workunit.client.0.smithi049.stdout:1/187: mkdir d1e/d20/d26/d3c 0 2024-04-26T10:44:28.464 INFO:tasks.workunit.client.0.smithi049.stdout:5/180: creat d7/d14/d18/d48/f49 x:0 0 0 2024-04-26T10:44:28.464 INFO:tasks.workunit.client.0.smithi049.stdout:1/188: write f9 [2978626,17789] 0 2024-04-26T10:44:28.465 INFO:tasks.workunit.client.0.smithi049.stdout:2/171: mkdir d6/d9/db/d35 0 2024-04-26T10:44:28.465 INFO:tasks.workunit.client.0.smithi049.stdout:9/248: creat d2/d40/f4b x:0 0 0 2024-04-26T10:44:28.465 INFO:tasks.workunit.client.0.smithi049.stdout:6/155: mknod da/dd/de/d26/c2e 0 2024-04-26T10:44:28.466 INFO:tasks.workunit.client.0.smithi049.stdout:7/184: link d2/dd/c15 d2/d3/de/c42 0 2024-04-26T10:44:28.467 INFO:tasks.workunit.client.0.smithi049.stdout:3/149: dwrite d3/d6/f10 [0,4194304] 0 2024-04-26T10:44:28.467 INFO:tasks.workunit.client.0.smithi049.stdout:4/199: sync 2024-04-26T10:44:28.467 INFO:tasks.workunit.client.0.smithi049.stdout:2/172: symlink d6/l36 0 2024-04-26T10:44:28.468 INFO:tasks.workunit.client.0.smithi049.stdout:1/189: chown d1e/d20/l2e 12 1 2024-04-26T10:44:28.468 INFO:tasks.workunit.client.0.smithi049.stdout:5/181: creat d7/d1d/d34/d37/f4a x:0 0 0 2024-04-26T10:44:28.468 INFO:tasks.workunit.client.0.smithi049.stdout:7/185: mknod d2/d3/c43 0 2024-04-26T10:44:28.468 INFO:tasks.workunit.client.0.smithi049.stdout:4/200: fdatasync de/f37 0 2024-04-26T10:44:28.469 INFO:tasks.workunit.client.0.smithi049.stdout:8/164: dwrite d2/d1a/d27/f2c [0,4194304] 0 2024-04-26T10:44:28.469 INFO:tasks.workunit.client.0.smithi049.stdout:9/249: write d2/d1a/d1b/d1f/f3d [1083045,79144] 0 2024-04-26T10:44:28.470 INFO:tasks.workunit.client.0.smithi049.stdout:5/182: dread - d7/d1d/d20/f36 zero size 2024-04-26T10:44:28.470 INFO:tasks.workunit.client.0.smithi049.stdout:2/173: symlink d6/d30/l37 0 2024-04-26T10:44:28.471 INFO:tasks.workunit.client.0.smithi049.stdout:1/190: creat d1e/d20/d26/d3c/f3d x:0 0 0 2024-04-26T10:44:28.471 INFO:tasks.workunit.client.0.smithi049.stdout:6/156: rename f6 to da/dd/de/d26/d22/d2d/f2f 0 2024-04-26T10:44:28.472 INFO:tasks.workunit.client.0.smithi049.stdout:4/201: dread - de/d1b/f34 zero size 2024-04-26T10:44:28.472 INFO:tasks.workunit.client.0.smithi049.stdout:2/174: chown d6/f7 31 1 2024-04-26T10:44:28.472 INFO:tasks.workunit.client.0.smithi049.stdout:6/157: fsync f5 0 2024-04-26T10:44:28.472 INFO:tasks.workunit.client.0.smithi049.stdout:7/186: creat d2/dd/d38/f44 x:0 0 0 2024-04-26T10:44:28.473 INFO:tasks.workunit.client.0.smithi049.stdout:6/158: readlink l3 0 2024-04-26T10:44:28.473 INFO:tasks.workunit.client.0.smithi049.stdout:7/187: stat d2/d3/l1a 0 2024-04-26T10:44:28.473 INFO:tasks.workunit.client.0.smithi049.stdout:0/149: dwrite f3 [0,4194304] 0 2024-04-26T10:44:28.473 INFO:tasks.workunit.client.0.smithi049.stdout:5/183: chown d7/d1d/d1f/c25 2025631345 1 2024-04-26T10:44:28.474 INFO:tasks.workunit.client.0.smithi049.stdout:4/202: symlink de/d20/l39 0 2024-04-26T10:44:28.474 INFO:tasks.workunit.client.0.smithi049.stdout:7/188: write d2/dd/f12 [233418,54725] 0 2024-04-26T10:44:28.476 INFO:tasks.workunit.client.0.smithi049.stdout:0/150: symlink d8/db/l3c 0 2024-04-26T10:44:28.476 INFO:tasks.workunit.client.0.smithi049.stdout:2/175: mkdir d6/d9/db/d34/d38 0 2024-04-26T10:44:28.477 INFO:tasks.workunit.client.0.smithi049.stdout:8/165: truncate d2/f14 905656 0 2024-04-26T10:44:28.478 INFO:tasks.workunit.client.0.smithi049.stdout:6/159: mknod da/dd/de/d26/d29/c30 0 2024-04-26T10:44:28.478 INFO:tasks.workunit.client.0.smithi049.stdout:7/189: chown d2/d3/de/d1c/f36 109329 1 2024-04-26T10:44:28.478 INFO:tasks.workunit.client.0.smithi049.stdout:0/151: truncate d8/d1e/f2a 594427 0 2024-04-26T10:44:28.479 INFO:tasks.workunit.client.0.smithi049.stdout:4/203: symlink de/d20/l3a 0 2024-04-26T10:44:28.479 INFO:tasks.workunit.client.0.smithi049.stdout:2/176: symlink d6/d9/db/d1e/l39 0 2024-04-26T10:44:28.479 INFO:tasks.workunit.client.0.smithi049.stdout:8/166: chown d2/d1a/d27/f2c 1340652760 1 2024-04-26T10:44:28.480 INFO:tasks.workunit.client.0.smithi049.stdout:0/152: unlink d8/db/c10 0 2024-04-26T10:44:28.480 INFO:tasks.workunit.client.0.smithi049.stdout:3/150: dwrite d3/d19/d22/f2d [0,4194304] 0 2024-04-26T10:44:28.480 INFO:tasks.workunit.client.0.smithi049.stdout:6/160: creat da/dd/de/d26/d29/f31 x:0 0 0 2024-04-26T10:44:28.481 INFO:tasks.workunit.client.0.smithi049.stdout:3/151: sync 2024-04-26T10:44:28.481 INFO:tasks.workunit.client.0.smithi049.stdout:2/177: write d6/d9/f27 [865798,45396] 0 2024-04-26T10:44:28.481 INFO:tasks.workunit.client.0.smithi049.stdout:1/191: dwrite d1e/d20/d26/d3c/f3d [0,4194304] 0 2024-04-26T10:44:28.483 INFO:tasks.workunit.client.0.smithi049.stdout:1/192: readlink d1e/l21 0 2024-04-26T10:44:28.483 INFO:tasks.workunit.client.0.smithi049.stdout:6/161: write da/dd/f10 [1813990,97552] 0 2024-04-26T10:44:28.484 INFO:tasks.workunit.client.0.smithi049.stdout:2/178: stat d6/d9/db/df/f22 0 2024-04-26T10:44:28.484 INFO:tasks.workunit.client.0.smithi049.stdout:8/167: getdents d2/d16/d19 0 2024-04-26T10:44:28.484 INFO:tasks.workunit.client.0.smithi049.stdout:1/193: symlink d1e/d20/l3e 0 2024-04-26T10:44:28.485 INFO:tasks.workunit.client.0.smithi049.stdout:8/168: stat d2/f12 0 2024-04-26T10:44:28.485 INFO:tasks.workunit.client.0.smithi049.stdout:2/179: creat d6/d32/f3a x:0 0 0 2024-04-26T10:44:28.485 INFO:tasks.workunit.client.0.smithi049.stdout:2/180: sync 2024-04-26T10:44:28.486 INFO:tasks.workunit.client.0.smithi049.stdout:1/194: write d1e/d20/f38 [623691,72928] 0 2024-04-26T10:44:28.488 INFO:tasks.workunit.client.0.smithi049.stdout:1/195: fdatasync d1e/f3a 0 2024-04-26T10:44:28.488 INFO:tasks.workunit.client.0.smithi049.stdout:1/196: sync 2024-04-26T10:44:28.488 INFO:tasks.workunit.client.0.smithi049.stdout:2/181: unlink d6/d9/l25 0 2024-04-26T10:44:28.488 INFO:tasks.workunit.client.0.smithi049.stdout:3/152: dread d3/d19/d8/dd/f18 [0,4194304] 0 2024-04-26T10:44:28.488 INFO:tasks.workunit.client.0.smithi049.stdout:6/162: truncate da/dd/de/d26/d22/d2d/f2f 1228514 0 2024-04-26T10:44:28.488 INFO:tasks.workunit.client.0.smithi049.stdout:2/182: rmdir d6/d30 39 2024-04-26T10:44:28.488 INFO:tasks.workunit.client.0.smithi049.stdout:3/153: fsync d3/d6/f12 0 2024-04-26T10:44:28.489 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:28.486+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:28.489 INFO:tasks.workunit.client.0.smithi049.stdout:6/163: creat da/f32 x:0 0 0 2024-04-26T10:44:28.490 INFO:tasks.workunit.client.0.smithi049.stdout:4/204: getdents de/d20 0 2024-04-26T10:44:28.490 INFO:tasks.workunit.client.0.smithi049.stdout:1/197: creat d1e/d20/d26/d3c/f3f x:0 0 0 2024-04-26T10:44:28.490 INFO:tasks.workunit.client.0.smithi049.stdout:7/190: write d2/d3/f16 [2090166,36971] 0 2024-04-26T10:44:28.490 INFO:tasks.workunit.client.0.smithi049.stdout:2/183: creat d6/f3b x:0 0 0 2024-04-26T10:44:28.490 INFO:tasks.workunit.client.0.smithi049.stdout:3/154: write d3/d19/d22/d2e/f31 [675697,28983] 0 2024-04-26T10:44:28.491 INFO:tasks.workunit.client.0.smithi049.stdout:5/184: dread d7/d1d/d34/d37/d3e/f42 [0,4194304] 0 2024-04-26T10:44:28.492 INFO:tasks.workunit.client.0.smithi049.stdout:8/169: truncate d2/f12 3054335 0 2024-04-26T10:44:28.493 INFO:tasks.workunit.client.0.smithi049.stdout:7/191: mkdir d2/dd/d45 0 2024-04-26T10:44:28.493 INFO:tasks.workunit.client.0.smithi049.stdout:2/184: write d6/d9/f27 [1709468,26536] 0 2024-04-26T10:44:28.493 INFO:tasks.workunit.client.0.smithi049.stdout:3/155: symlink d3/d23/l35 0 2024-04-26T10:44:28.495 INFO:tasks.workunit.client.0.smithi049.stdout:6/164: link da/dd/de/d26/d29/c30 da/dd/de/d26/d29/c33 0 2024-04-26T10:44:28.495 INFO:tasks.workunit.client.0.smithi049.stdout:8/170: fdatasync d2/f12 0 2024-04-26T10:44:28.496 INFO:tasks.workunit.client.0.smithi049.stdout:2/185: rmdir d6/d9/db/df 39 2024-04-26T10:44:28.496 INFO:tasks.workunit.client.0.smithi049.stdout:3/156: symlink d3/d19/d26/d29/l36 0 2024-04-26T10:44:28.496 INFO:tasks.workunit.client.0.smithi049.stdout:0/153: dwrite d8/f9 [0,4194304] 0 2024-04-26T10:44:28.496 INFO:tasks.workunit.client.0.smithi049.stdout:7/192: write d2/d3/de/d1c/f36 [2687701,18526] 0 2024-04-26T10:44:28.498 INFO:tasks.workunit.client.0.smithi049.stdout:7/193: readlink d2/d3/l9 0 2024-04-26T10:44:28.499 INFO:tasks.workunit.client.0.smithi049.stdout:8/171: creat d2/df/f36 x:0 0 0 2024-04-26T10:44:28.499 INFO:tasks.workunit.client.0.smithi049.stdout:4/205: dwrite f7 [0,4194304] 0 2024-04-26T10:44:28.499 INFO:tasks.workunit.client.0.smithi049.stdout:2/186: truncate f5 3574309 0 2024-04-26T10:44:28.499 INFO:tasks.workunit.client.0.smithi049.stdout:0/154: stat d8/d1e/l37 0 2024-04-26T10:44:28.500 INFO:tasks.workunit.client.0.smithi049.stdout:7/194: rename d2 to d2/dd/d25/d46 22 2024-04-26T10:44:28.501 INFO:tasks.workunit.client.0.smithi049.stdout:1/198: write d1e/f3b [210259,66249] 0 2024-04-26T10:44:28.502 INFO:tasks.workunit.client.0.smithi049.stdout:5/185: dwrite d7/d14/f1a [0,4194304] 0 2024-04-26T10:44:28.503 INFO:tasks.workunit.client.0.smithi049.stdout:8/172: unlink d2/f8 0 2024-04-26T10:44:28.503 INFO:tasks.workunit.client.0.smithi049.stdout:7/195: rmdir d2/d3 39 2024-04-26T10:44:28.503 INFO:tasks.workunit.client.0.smithi049.stdout:4/206: creat de/d20/d38/f3b x:0 0 0 2024-04-26T10:44:28.506 INFO:tasks.workunit.client.0.smithi049.stdout:4/207: fdatasync de/d20/f2e 0 2024-04-26T10:44:28.507 INFO:tasks.workunit.client.0.smithi049.stdout:6/165: dwrite da/ff [0,4194304] 0 2024-04-26T10:44:28.507 INFO:tasks.workunit.client.0.smithi049.stdout:5/186: link d7/d1d/d1f/f29 d7/d14/d18/d2b/f4b 0 2024-04-26T10:44:28.507 INFO:tasks.workunit.client.0.smithi049.stdout:2/187: dread d6/d9/db/d11/f1d [0,4194304] 0 2024-04-26T10:44:28.509 INFO:tasks.workunit.client.0.smithi049.stdout:9/250: dread d2/d25/f28 [0,4194304] 0 2024-04-26T10:44:28.509 INFO:tasks.workunit.client.0.smithi049.stdout:4/208: mknod de/c3c 0 2024-04-26T10:44:28.511 INFO:tasks.workunit.client.0.smithi049.stdout:8/173: dread d2/f6 [0,4194304] 0 2024-04-26T10:44:28.513 INFO:tasks.workunit.client.0.smithi049.stdout:0/155: dread d8/db/d26/f38 [0,4194304] 0 2024-04-26T10:44:28.513 INFO:tasks.workunit.client.0.smithi049.stdout:4/209: symlink de/d20/d24/l3d 0 2024-04-26T10:44:28.513 INFO:tasks.workunit.client.0.smithi049.stdout:8/174: stat d2/df/f36 0 2024-04-26T10:44:28.513 INFO:tasks.workunit.client.0.smithi049.stdout:9/251: write d2/d1a/f45 [4067642,38490] 0 2024-04-26T10:44:28.513 INFO:tasks.workunit.client.0.smithi049.stdout:1/199: dwrite f9 [0,4194304] 0 2024-04-26T10:44:28.513 INFO:tasks.workunit.client.0.smithi049.stdout:6/166: rename da/dd/de/d26/d29/c30 to da/dd/de/d11/c34 0 2024-04-26T10:44:28.515 INFO:tasks.workunit.client.0.smithi049.stdout:7/196: dwrite d2/f22 [0,4194304] 0 2024-04-26T10:44:28.515 INFO:tasks.workunit.client.0.smithi049.stdout:4/210: unlink de/f37 0 2024-04-26T10:44:28.516 INFO:tasks.workunit.client.0.smithi049.stdout:8/175: mknod d2/d17/c37 0 2024-04-26T10:44:28.516 INFO:tasks.workunit.client.0.smithi049.stdout:0/156: creat d8/f3d x:0 0 0 2024-04-26T10:44:28.518 INFO:tasks.workunit.client.0.smithi049.stdout:6/167: creat da/f35 x:0 0 0 2024-04-26T10:44:28.518 INFO:tasks.workunit.client.0.smithi049.stdout:9/252: truncate d2/d40/f4b 638058 0 2024-04-26T10:44:28.519 INFO:tasks.workunit.client.0.smithi049.stdout:4/211: write de/d1b/f26 [3877873,39073] 0 2024-04-26T10:44:28.519 INFO:tasks.workunit.client.0.smithi049.stdout:1/200: mknod d1e/d20/c40 0 2024-04-26T10:44:28.520 INFO:tasks.workunit.client.0.smithi049.stdout:8/176: creat d2/d17/f38 x:0 0 0 2024-04-26T10:44:28.520 INFO:tasks.workunit.client.0.smithi049.stdout:5/187: dwrite d7/d1d/d34/d37/d3e/f40 [0,4194304] 0 2024-04-26T10:44:28.521 INFO:tasks.workunit.client.0.smithi049.stdout:7/197: read - d2/d3/de/f1e zero size 2024-04-26T10:44:28.521 INFO:tasks.workunit.client.0.smithi049.stdout:0/157: truncate d8/db/d11/f32 4783870 0 2024-04-26T10:44:28.523 INFO:tasks.workunit.client.0.smithi049.stdout:5/188: rename d7/d1d/d1f/c25 to d7/d14/d18/d2b/c4c 0 2024-04-26T10:44:28.523 INFO:tasks.workunit.client.0.smithi049.stdout:4/212: write de/d1b/f2c [262786,120894] 0 2024-04-26T10:44:28.523 INFO:tasks.workunit.client.0.smithi049.stdout:2/188: dwrite d6/d9/db/df/f12 [0,4194304] 0 2024-04-26T10:44:28.524 INFO:tasks.workunit.client.0.smithi049.stdout:2/189: write d6/f2f [847987,75685] 0 2024-04-26T10:44:28.525 INFO:tasks.workunit.client.0.smithi049.stdout:7/198: getdents d2/d3 0 2024-04-26T10:44:28.525 INFO:tasks.workunit.client.0.smithi049.stdout:4/213: symlink de/d1b/l3e 0 2024-04-26T10:44:28.526 INFO:tasks.workunit.client.0.smithi049.stdout:5/189: mknod d7/d1d/d1f/d22/c4d 0 2024-04-26T10:44:28.527 INFO:tasks.workunit.client.0.smithi049.stdout:0/158: truncate d8/f18 1073408 0 2024-04-26T10:44:28.528 INFO:tasks.workunit.client.0.smithi049.stdout:4/214: write de/d20/f2e [1892941,100135] 0 2024-04-26T10:44:28.529 INFO:tasks.workunit.client.0.smithi049.stdout:6/168: dwrite f4 [0,4194304] 0 2024-04-26T10:44:28.529 INFO:tasks.workunit.client.0.smithi049.stdout:2/190: truncate d6/d9/db/f13 4602725 0 2024-04-26T10:44:28.530 INFO:tasks.workunit.client.0.smithi049.stdout:1/201: dwrite fd [0,4194304] 0 2024-04-26T10:44:28.531 INFO:tasks.workunit.client.0.smithi049.stdout:4/215: rmdir de/d20/d24 39 2024-04-26T10:44:28.532 INFO:tasks.workunit.client.0.smithi049.stdout:8/177: dwrite d2/d16/d19/f33 [0,4194304] 0 2024-04-26T10:44:28.534 INFO:tasks.workunit.client.0.smithi049.stdout:4/216: mkdir de/d3f 0 2024-04-26T10:44:28.534 INFO:tasks.workunit.client.0.smithi049.stdout:5/190: getdents d7/d1d/d1f 0 2024-04-26T10:44:28.534 INFO:tasks.workunit.client.0.smithi049.stdout:6/169: getdents da/dd/de/d26 0 2024-04-26T10:44:28.534 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:28.535 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:28.535 INFO:tasks.workunit.client.0.smithi049.stdout:1/202: getdents d1e/d20/d26/d3c 0 2024-04-26T10:44:28.535 INFO:tasks.workunit.client.0.smithi049.stdout:4/217: read - de/d20/f28 zero size 2024-04-26T10:44:28.536 INFO:tasks.workunit.client.0.smithi049.stdout:5/191: chown d7/d1d/f27 118358599 1 2024-04-26T10:44:28.536 INFO:tasks.workunit.client.0.smithi049.stdout:5/192: chown d7/c11 63 1 2024-04-26T10:44:28.536 INFO:tasks.workunit.client.0.smithi049.stdout:8/178: dread d2/f12 [0,4194304] 0 2024-04-26T10:44:28.536 INFO:tasks.workunit.client.0.smithi049.stdout:6/170: fdatasync da/dd/f10 0 2024-04-26T10:44:28.536 INFO:tasks.workunit.client.0.smithi049.stdout:1/203: getdents d1e/d20/d26/d37 0 2024-04-26T10:44:28.536 INFO:tasks.workunit.client.0.smithi049.stdout:8/179: dread - d2/f2f zero size 2024-04-26T10:44:28.537 INFO:tasks.workunit.client.0.smithi049.stdout:4/218: rename de/d1d/f23 to de/d1b/f40 0 2024-04-26T10:44:28.538 INFO:tasks.workunit.client.0.smithi049.stdout:5/193: mkdir d7/d1d/d1f/d4e 0 2024-04-26T10:44:28.539 INFO:tasks.workunit.client.0.smithi049.stdout:5/194: rmdir d7/d14/d18/d2b 39 2024-04-26T10:44:28.541 INFO:tasks.workunit.client.0.smithi049.stdout:0/159: truncate f3 3033331 0 2024-04-26T10:44:28.541 INFO:tasks.workunit.client.0.smithi049.stdout:7/199: truncate d2/d3/de/d1c/f36 1863948 0 2024-04-26T10:44:28.542 INFO:tasks.workunit.client.0.smithi049.stdout:0/160: dread - d8/d1e/f2b zero size 2024-04-26T10:44:28.542 INFO:tasks.workunit.client.0.smithi049.stdout:1/204: dwrite fd [4194304,4194304] 0 2024-04-26T10:44:28.542 INFO:tasks.workunit.client.0.smithi049.stdout:6/171: dwrite da/f32 [0,4194304] 0 2024-04-26T10:44:28.543 INFO:tasks.workunit.client.0.smithi049.stdout:1/205: dread - f16 zero size 2024-04-26T10:44:28.545 INFO:tasks.workunit.client.0.smithi049.stdout:8/180: truncate d2/d16/f2e 49042 0 2024-04-26T10:44:28.546 INFO:tasks.workunit.client.0.smithi049.stdout:7/200: link d2/d3/de/d1c/c2f d2/dd/d45/c47 0 2024-04-26T10:44:28.546 INFO:tasks.workunit.client.0.smithi049.stdout:6/172: link l3 da/dd/de/d26/d22/d2d/l36 0 2024-04-26T10:44:28.546 INFO:tasks.workunit.client.0.smithi049.stdout:1/206: rename d1e/d20/d26/f36 to d1e/d20/f41 0 2024-04-26T10:44:28.546 INFO:tasks.workunit.client.0.smithi049.stdout:0/161: getdents d8/db/d11 0 2024-04-26T10:44:28.547 INFO:tasks.workunit.client.0.smithi049.stdout:8/181: mknod d2/df/d18/c39 0 2024-04-26T10:44:28.547 INFO:tasks.workunit.client.0.smithi049.stdout:7/201: write d2/d3/f2a [261951,17370] 0 2024-04-26T10:44:28.547 INFO:tasks.workunit.client.0.smithi049.stdout:0/162: symlink d8/db/l3e 0 2024-04-26T10:44:28.547 INFO:tasks.workunit.client.0.smithi049.stdout:7/202: mkdir d2/dd/d48 0 2024-04-26T10:44:28.548 INFO:tasks.workunit.client.0.smithi049.stdout:0/163: mknod d8/d1e/c3f 0 2024-04-26T10:44:28.548 INFO:tasks.workunit.client.0.smithi049.stdout:2/191: fsync d6/f7 0 2024-04-26T10:44:28.549 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:28.550 INFO:tasks.workunit.client.0.smithi049.stdout:0/164: dread - d8/db/f33 zero size 2024-04-26T10:44:28.550 INFO:tasks.workunit.client.0.smithi049.stdout:5/195: write d7/d1d/d1f/f29 [227514,113635] 0 2024-04-26T10:44:28.550 INFO:tasks.workunit.client.0.smithi049.stdout:2/192: write f0 [1949410,104829] 0 2024-04-26T10:44:28.552 INFO:tasks.workunit.client.0.smithi049.stdout:6/173: dread da/ff [0,4194304] 0 2024-04-26T10:44:28.553 INFO:tasks.workunit.client.0.smithi049.stdout:0/165: truncate d8/d1e/f24 982429 0 2024-04-26T10:44:28.556 INFO:tasks.workunit.client.0.smithi049.stdout:1/207: dwrite f0 [4194304,4194304] 0 2024-04-26T10:44:28.556 INFO:tasks.workunit.client.0.smithi049.stdout:8/182: dwrite d2/df/d10/f13 [0,4194304] 0 2024-04-26T10:44:28.556 INFO:tasks.workunit.client.0.smithi049.stdout:7/203: dwrite d2/d3/f16 [0,4194304] 0 2024-04-26T10:44:28.558 INFO:tasks.workunit.client.0.smithi049.stdout:2/193: link d6/d9/c28 d6/d9/db/d34/c3c 0 2024-04-26T10:44:28.558 INFO:tasks.workunit.client.0.smithi049.stdout:7/204: rmdir d2/d3/de 39 2024-04-26T10:44:28.558 INFO:tasks.workunit.client.0.smithi049.stdout:8/183: creat d2/d16/f3a x:0 0 0 2024-04-26T10:44:28.558 INFO:tasks.workunit.client.0.smithi049.stdout:0/166: creat d8/db/d26/f40 x:0 0 0 2024-04-26T10:44:28.559 INFO:tasks.workunit.client.0.smithi049.stdout:0/167: chown d8/db/d11/d1c 661 1 2024-04-26T10:44:28.559 INFO:tasks.workunit.client.0.smithi049.stdout:2/194: write d6/d9/fc [3595593,54201] 0 2024-04-26T10:44:28.560 INFO:tasks.workunit.client.0.smithi049.stdout:6/174: dread f4 [0,4194304] 0 2024-04-26T10:44:28.561 INFO:tasks.workunit.client.0.smithi049.stdout:3/157: dread d3/d19/d8/f9 [4194304,4194304] 0 2024-04-26T10:44:28.561 INFO:tasks.workunit.client.0.smithi049.stdout:5/196: truncate d7/d1d/d34/d37/d3e/f40 1966873 0 2024-04-26T10:44:28.561 INFO:tasks.workunit.client.0.smithi049.stdout:8/184: write d2/df/d18/d2a/f2b [1039300,82315] 0 2024-04-26T10:44:28.562 INFO:tasks.workunit.client.0.smithi049.stdout:7/205: creat d2/f49 x:0 0 0 2024-04-26T10:44:28.562 INFO:tasks.workunit.client.0.smithi049.stdout:0/168: unlink d8/l3a 0 2024-04-26T10:44:28.562 INFO:tasks.workunit.client.0.smithi049.stdout:2/195: chown d6/d9/db/df/f12 6552 1 2024-04-26T10:44:28.562 INFO:tasks.workunit.client.0.smithi049.stdout:3/158: write f1 [5203566,82862] 0 2024-04-26T10:44:28.563 INFO:tasks.workunit.client.0.smithi049.stdout:1/208: dread f11 [4194304,4194304] 0 2024-04-26T10:44:28.563 INFO:tasks.workunit.client.0.smithi049.stdout:2/196: stat d6/d9/db/df/f22 0 2024-04-26T10:44:28.563 INFO:tasks.workunit.client.0.smithi049.stdout:7/206: mknod d2/c4a 0 2024-04-26T10:44:28.563 INFO:tasks.workunit.client.0.smithi049.stdout:6/175: creat da/dd/de/d26/d22/d2d/f37 x:0 0 0 2024-04-26T10:44:28.564 INFO:tasks.workunit.client.0.smithi049.stdout:0/169: truncate d8/db/f25 912724 0 2024-04-26T10:44:28.564 INFO:tasks.workunit.client.0.smithi049.stdout:1/209: write fb [2586848,23805] 0 2024-04-26T10:44:28.564 INFO:tasks.workunit.client.0.smithi049.stdout:5/197: creat d7/d1d/d34/d37/f4f x:0 0 0 2024-04-26T10:44:28.565 INFO:tasks.workunit.client.0.smithi049.stdout:8/185: creat d2/df/d10/f3b x:0 0 0 2024-04-26T10:44:28.567 INFO:tasks.workunit.client.0.smithi049.stdout:2/197: rmdir d6/d9/db/df 39 2024-04-26T10:44:28.567 INFO:tasks.workunit.client.0.smithi049.stdout:1/210: write fa [4047043,44517] 0 2024-04-26T10:44:28.567 INFO:tasks.workunit.client.0.smithi049.stdout:0/170: mkdir d8/d41 0 2024-04-26T10:44:28.567 INFO:tasks.workunit.client.0.smithi049.stdout:5/198: symlink d7/d1d/d34/d37/l50 0 2024-04-26T10:44:28.567 INFO:tasks.workunit.client.0.smithi049.stdout:0/171: stat l7 0 2024-04-26T10:44:28.567 INFO:tasks.workunit.client.0.smithi049.stdout:8/186: write d2/fc [1932477,109804] 0 2024-04-26T10:44:28.567 INFO:tasks.workunit.client.0.smithi049.stdout:1/211: chown d1e/d20/d26 47 1 2024-04-26T10:44:28.567 INFO:tasks.workunit.client.0.smithi049.stdout:7/207: rename d2/d3/de/f41 to d2/d3/de/f4b 0 2024-04-26T10:44:28.568 INFO:tasks.workunit.client.0.smithi049.stdout:2/198: truncate f4 4966075 0 2024-04-26T10:44:28.569 INFO:tasks.workunit.client.0.smithi049.stdout:6/176: write da/dd/de/d26/d29/f31 [451727,41260] 0 2024-04-26T10:44:28.569 INFO:tasks.workunit.client.0.smithi049.stdout:1/212: chown f9 19551728 1 2024-04-26T10:44:28.569 INFO:tasks.workunit.client.0.smithi049.stdout:7/208: fdatasync d2/d3/de/f1e 0 2024-04-26T10:44:28.569 INFO:tasks.workunit.client.0.smithi049.stdout:2/199: truncate d6/f3b 475659 0 2024-04-26T10:44:28.569 INFO:tasks.workunit.client.0.smithi049.stdout:4/219: dread de/d1b/f1c [0,4194304] 0 2024-04-26T10:44:28.569 INFO:tasks.workunit.client.0.smithi049.stdout:5/199: creat d7/d1d/d1f/f51 x:0 0 0 2024-04-26T10:44:28.570 INFO:tasks.workunit.client.0.smithi049.stdout:6/177: rmdir da/dd/de/d26/d22 39 2024-04-26T10:44:28.570 INFO:tasks.workunit.client.0.smithi049.stdout:1/213: readlink d1e/d20/l29 0 2024-04-26T10:44:28.571 INFO:tasks.workunit.client.0.smithi049.stdout:7/209: dread - d2/f2c zero size 2024-04-26T10:44:28.571 INFO:tasks.workunit.client.0.smithi049.stdout:3/159: dread d3/d19/d22/d2e/f31 [0,4194304] 0 2024-04-26T10:44:28.571 INFO:tasks.workunit.client.0.smithi049.stdout:2/200: write d6/d9/db/f1c [4621231,104289] 0 2024-04-26T10:44:28.571 INFO:tasks.workunit.client.0.smithi049.stdout:6/178: chown da/dd/de/d26/d29/f31 336 1 2024-04-26T10:44:28.572 INFO:tasks.workunit.client.0.smithi049.stdout:1/214: creat d1e/d20/d26/d37/f42 x:0 0 0 2024-04-26T10:44:28.572 INFO:tasks.workunit.client.0.smithi049.stdout:2/201: write d6/f3b [1197952,17730] 0 2024-04-26T10:44:28.572 INFO:tasks.workunit.client.0.smithi049.stdout:5/200: link d7/l12 d7/d1d/d1f/l52 0 2024-04-26T10:44:28.573 INFO:tasks.workunit.client.0.smithi049.stdout:6/179: unlink da/c1c 0 2024-04-26T10:44:28.573 INFO:tasks.workunit.client.0.smithi049.stdout:0/172: dread d8/db/d26/f38 [0,4194304] 0 2024-04-26T10:44:28.573 INFO:tasks.workunit.client.0.smithi049.stdout:5/201: mkdir d7/d53 0 2024-04-26T10:44:28.574 INFO:tasks.workunit.client.0.smithi049.stdout:3/160: write d3/d19/d26/f2b [197056,126608] 0 2024-04-26T10:44:28.574 INFO:tasks.workunit.client.0.smithi049.stdout:1/215: write f16 [954815,85955] 0 2024-04-26T10:44:28.576 INFO:tasks.workunit.client.0.smithi049.stdout:8/187: write d2/f14 [1794505,67784] 0 2024-04-26T10:44:28.577 INFO:tasks.workunit.client.0.smithi049.stdout:3/161: write d3/d6/f10 [3251978,78579] 0 2024-04-26T10:44:28.577 INFO:tasks.workunit.client.0.smithi049.stdout:6/180: rmdir da/dd/de/d26/d29 39 2024-04-26T10:44:28.577 INFO:tasks.workunit.client.0.smithi049.stdout:9/253: dread d2/d1a/f21 [0,4194304] 0 2024-04-26T10:44:28.578 INFO:tasks.workunit.client.0.smithi049.stdout:1/216: truncate d1e/d20/f38 1354137 0 2024-04-26T10:44:28.578 INFO:tasks.workunit.client.0.smithi049.stdout:5/202: mkdir d7/d1d/d34/d37/d54 0 2024-04-26T10:44:28.578 INFO:tasks.workunit.client.0.smithi049.stdout:4/220: dwrite de/f15 [8388608,4194304] 0 2024-04-26T10:44:28.578 INFO:tasks.workunit.client.0.smithi049.stdout:0/173: mkdir d8/d42 0 2024-04-26T10:44:28.579 INFO:tasks.workunit.client.0.smithi049.stdout:3/162: mknod d3/d19/c37 0 2024-04-26T10:44:28.579 INFO:tasks.workunit.client.0.smithi049.stdout:7/210: dwrite d2/f6 [0,4194304] 0 2024-04-26T10:44:28.579 INFO:tasks.workunit.client.0.smithi049.stdout:5/203: fdatasync d7/d14/d18/d48/f49 0 2024-04-26T10:44:28.580 INFO:tasks.workunit.client.0.smithi049.stdout:8/188: unlink d2/df/d10/f3b 0 2024-04-26T10:44:28.581 INFO:tasks.workunit.client.0.smithi049.stdout:1/217: symlink d1e/d20/d26/l43 0 2024-04-26T10:44:28.583 INFO:tasks.workunit.client.0.smithi049.stdout:9/254: creat d2/d1a/d1b/f4c x:0 0 0 2024-04-26T10:44:28.583 INFO:tasks.workunit.client.0.smithi049.stdout:4/221: write de/d20/f22 [2514512,65077] 0 2024-04-26T10:44:28.584 INFO:tasks.workunit.client.0.smithi049.stdout:2/202: link d6/d9/l2e d6/d30/l3d 0 2024-04-26T10:44:28.585 INFO:tasks.workunit.client.0.smithi049.stdout:3/163: symlink d3/l38 0 2024-04-26T10:44:28.585 INFO:tasks.workunit.client.0.smithi049.stdout:1/218: write d1e/d20/d26/f33 [466942,116323] 0 2024-04-26T10:44:28.585 INFO:tasks.workunit.client.0.smithi049.stdout:9/255: mknod d2/c4d 0 2024-04-26T10:44:28.586 INFO:tasks.workunit.client.0.smithi049.stdout:3/164: symlink d3/d19/d22/d2e/l39 0 2024-04-26T10:44:28.586 INFO:tasks.workunit.client.0.smithi049.stdout:6/181: truncate da/dd/de/d26/d22/d2d/f2f 1812274 0 2024-04-26T10:44:28.588 INFO:tasks.workunit.client.0.smithi049.stdout:4/222: truncate de/d20/d38/f3b 824412 0 2024-04-26T10:44:28.588 INFO:tasks.workunit.client.0.smithi049.stdout:1/219: creat d1e/f44 x:0 0 0 2024-04-26T10:44:28.588 INFO:tasks.workunit.client.0.smithi049.stdout:0/174: dwrite d8/d1e/f2b [0,4194304] 0 2024-04-26T10:44:28.589 INFO:tasks.workunit.client.0.smithi049.stdout:3/165: read d3/d6/f12 [3006537,67307] 0 2024-04-26T10:44:28.589 INFO:tasks.workunit.client.0.smithi049.stdout:6/182: creat da/f38 x:0 0 0 2024-04-26T10:44:28.589 INFO:tasks.workunit.client.0.smithi049.stdout:8/189: dread d2/d16/d19/f33 [0,4194304] 0 2024-04-26T10:44:28.589 INFO:tasks.workunit.client.0.smithi049.stdout:0/175: unlink l0 0 2024-04-26T10:44:28.592 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:28.590+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:28.592 INFO:tasks.workunit.client.0.smithi049.stdout:4/223: write de/d20/f22 [1168303,30053] 0 2024-04-26T10:44:28.594 INFO:tasks.workunit.client.0.smithi049.stdout:1/220: getdents d1e/d20/d26/d3c 0 2024-04-26T10:44:28.594 INFO:tasks.workunit.client.0.smithi049.stdout:3/166: write d3/d19/d8/f32 [2204249,81456] 0 2024-04-26T10:44:28.594 INFO:tasks.workunit.client.0.smithi049.stdout:8/190: symlink d2/df/d10/l3c 0 2024-04-26T10:44:28.594 INFO:tasks.workunit.client.0.smithi049.stdout:1/221: chown d1e/f3b 173 1 2024-04-26T10:44:28.594 INFO:tasks.workunit.client.0.smithi049.stdout:8/191: chown d2/d16/f3a 1908280 1 2024-04-26T10:44:28.595 INFO:tasks.workunit.client.0.smithi049.stdout:1/222: chown l4 6088906 1 2024-04-26T10:44:28.595 INFO:tasks.workunit.client.0.smithi049.stdout:3/167: creat d3/d19/d22/d2e/f3a x:0 0 0 2024-04-26T10:44:28.596 INFO:tasks.workunit.client.0.smithi049.stdout:1/223: read fa [2429568,78545] 0 2024-04-26T10:44:28.596 INFO:tasks.workunit.client.0.smithi049.stdout:5/204: dread d7/d14/d18/f46 [0,4194304] 0 2024-04-26T10:44:28.596 INFO:tasks.workunit.client.0.smithi049.stdout:2/203: dwrite d6/f2f [0,4194304] 0 2024-04-26T10:44:28.597 INFO:tasks.workunit.client.0.smithi049.stdout:3/168: mknod d3/d6/c3b 0 2024-04-26T10:44:28.598 INFO:tasks.workunit.client.0.smithi049.stdout:1/224: readlink d1e/d20/l23 0 2024-04-26T10:44:28.598 INFO:tasks.workunit.client.0.smithi049.stdout:6/183: dwrite da/f1b [0,4194304] 0 2024-04-26T10:44:28.598 INFO:tasks.workunit.client.0.smithi049.stdout:3/169: read d3/d19/d26/f2b [294071,8863] 0 2024-04-26T10:44:28.598 INFO:tasks.workunit.client.0.smithi049.stdout:5/205: dread - d7/d1d/d20/f36 zero size 2024-04-26T10:44:28.602 INFO:tasks.workunit.client.0.smithi049.stdout:4/224: dread de/d1b/f1c [0,4194304] 0 2024-04-26T10:44:28.602 INFO:tasks.workunit.client.0.smithi049.stdout:5/206: readlink d7/d1d/d20/l41 0 2024-04-26T10:44:28.602 INFO:tasks.workunit.client.0.smithi049.stdout:4/225: fdatasync f7 0 2024-04-26T10:44:28.602 INFO:tasks.workunit.client.0.smithi049.stdout:1/225: creat d1e/f45 x:0 0 0 2024-04-26T10:44:28.603 INFO:tasks.workunit.client.0.smithi049.stdout:6/184: rename f4 to da/dd/de/d26/d22/f39 0 2024-04-26T10:44:28.603 INFO:tasks.workunit.client.0.smithi049.stdout:3/170: fsync d3/d19/d8/f32 0 2024-04-26T10:44:28.603 INFO:tasks.workunit.client.0.smithi049.stdout:4/226: symlink de/d20/d24/l41 0 2024-04-26T10:44:28.604 INFO:tasks.workunit.client.0.smithi049.stdout:6/185: symlink da/dd/de/d26/d22/l3a 0 2024-04-26T10:44:28.604 INFO:tasks.workunit.client.0.smithi049.stdout:2/204: dwrite d6/d9/f27 [0,4194304] 0 2024-04-26T10:44:28.607 INFO:tasks.workunit.client.0.smithi049.stdout:3/171: truncate d3/d19/d8/f9 9009158 0 2024-04-26T10:44:28.607 INFO:tasks.workunit.client.0.smithi049.stdout:0/176: dwrite f3 [0,4194304] 0 2024-04-26T10:44:28.609 INFO:tasks.workunit.client.0.smithi049.stdout:2/205: fsync f4 0 2024-04-26T10:44:28.609 INFO:tasks.workunit.client.0.smithi049.stdout:4/227: rename c4 to de/c42 0 2024-04-26T10:44:28.609 INFO:tasks.workunit.client.0.smithi049.stdout:5/207: dwrite d7/f26 [0,4194304] 0 2024-04-26T10:44:28.610 INFO:tasks.workunit.client.0.smithi049.stdout:1/226: dwrite d1e/f2d [0,4194304] 0 2024-04-26T10:44:28.611 INFO:tasks.workunit.client.0.smithi049.stdout:3/172: creat d3/d23/d2f/f3c x:0 0 0 2024-04-26T10:44:28.612 INFO:tasks.workunit.client.0.smithi049.stdout:7/211: dread d2/dd/d38/f3d [0,4194304] 0 2024-04-26T10:44:28.615 INFO:tasks.workunit.client.0.smithi049.stdout:3/173: rename d3/d19/d26/d29/l36 to d3/d19/d22/d2e/l3d 0 2024-04-26T10:44:28.615 INFO:tasks.workunit.client.0.smithi049.stdout:7/212: unlink d2/dd/d25/d27/l32 0 2024-04-26T10:44:28.616 INFO:tasks.workunit.client.0.smithi049.stdout:3/174: creat d3/d19/d26/d29/f3e x:0 0 0 2024-04-26T10:44:28.616 INFO:tasks.workunit.client.0.smithi049.stdout:6/186: dwrite da/dd/de/d26/d29/f31 [0,4194304] 0 2024-04-26T10:44:28.617 INFO:tasks.workunit.client.0.smithi049.stdout:0/177: read d8/db/f25 [603198,114197] 0 2024-04-26T10:44:28.617 INFO:tasks.workunit.client.0.smithi049.stdout:7/213: rename d2/d3/de/f29 to d2/dd/d38/f4c 0 2024-04-26T10:44:28.618 INFO:tasks.workunit.client.0.smithi049.stdout:4/228: dwrite de/d20/f2e [0,4194304] 0 2024-04-26T10:44:28.619 INFO:tasks.workunit.client.0.smithi049.stdout:0/178: creat d8/d42/f43 x:0 0 0 2024-04-26T10:44:28.619 INFO:tasks.workunit.client.0.smithi049.stdout:9/256: dread d2/d1a/d1b/f24 [0,4194304] 0 2024-04-26T10:44:28.620 INFO:tasks.workunit.client.0.smithi049.stdout:9/257: dread - d2/d1a/f2c zero size 2024-04-26T10:44:28.622 INFO:tasks.workunit.client.0.smithi049.stdout:4/229: write de/d20/d24/f31 [665463,93023] 0 2024-04-26T10:44:28.622 INFO:tasks.workunit.client.0.smithi049.stdout:9/258: mknod d2/d1a/d1b/d1f/d49/c4e 0 2024-04-26T10:44:28.623 INFO:tasks.workunit.client.0.smithi049.stdout:4/230: rename l2 to de/l43 0 2024-04-26T10:44:28.625 INFO:tasks.workunit.client.0.smithi049.stdout:0/179: dwrite d8/db/d11/f32 [0,4194304] 0 2024-04-26T10:44:28.626 INFO:tasks.workunit.client.0.smithi049.stdout:0/180: truncate d8/f3d 894021 0 2024-04-26T10:44:28.626 INFO:tasks.workunit.client.0.smithi049.stdout:5/208: sync 2024-04-26T10:44:28.627 INFO:tasks.workunit.client.0.smithi049.stdout:9/259: dread d2/d1a/f2a [0,4194304] 0 2024-04-26T10:44:28.627 INFO:tasks.workunit.client.0.smithi049.stdout:3/175: read d3/d19/d8/f9 [8903021,126967] 0 2024-04-26T10:44:28.628 INFO:tasks.workunit.client.0.smithi049.stdout:7/214: write d2/d3/de/d1c/f36 [66070,63939] 0 2024-04-26T10:44:28.628 INFO:tasks.workunit.client.0.smithi049.stdout:0/181: getdents d8 0 2024-04-26T10:44:28.628 INFO:tasks.workunit.client.0.smithi049.stdout:5/209: symlink d7/d1d/d34/d37/d3e/l55 0 2024-04-26T10:44:28.630 INFO:tasks.workunit.client.0.smithi049.stdout:3/176: link d3/d19/d8/f32 d3/d6/d21/f3f 0 2024-04-26T10:44:28.630 INFO:tasks.workunit.client.0.smithi049.stdout:4/231: dwrite de/d20/d24/f31 [4194304,4194304] 0 2024-04-26T10:44:28.630 INFO:tasks.workunit.client.0.smithi049.stdout:7/215: mkdir d2/d3/de/d1c/d4d 0 2024-04-26T10:44:28.633 INFO:tasks.workunit.client.0.smithi049.stdout:3/177: write d3/d19/d26/d29/f3e [830683,103487] 0 2024-04-26T10:44:28.634 INFO:tasks.workunit.client.0.smithi049.stdout:7/216: write d2/d3/de/f1e [638146,46135] 0 2024-04-26T10:44:28.635 INFO:tasks.workunit.client.0.smithi049.stdout:2/206: dread f5 [0,4194304] 0 2024-04-26T10:44:28.637 INFO:tasks.workunit.client.0.smithi049.stdout:7/217: write d2/dd/d25/d27/f2b [372762,100675] 0 2024-04-26T10:44:28.638 INFO:tasks.workunit.client.0.smithi049.stdout:9/260: dwrite d2/d1a/f21 [0,4194304] 0 2024-04-26T10:44:28.638 INFO:tasks.workunit.client.0.smithi049.stdout:5/210: dwrite d7/d1d/d34/d37/f4f [0,4194304] 0 2024-04-26T10:44:28.639 INFO:tasks.workunit.client.0.smithi049.stdout:2/207: truncate d6/d9/db/f24 4722802 0 2024-04-26T10:44:28.639 INFO:tasks.workunit.client.0.smithi049.stdout:3/178: rmdir d3/d19/d8 39 2024-04-26T10:44:28.639 INFO:tasks.workunit.client.0.smithi049.stdout:0/182: dwrite d8/db/d26/f38 [0,4194304] 0 2024-04-26T10:44:28.640 INFO:tasks.workunit.client.0.smithi049.stdout:8/192: dread d2/f14 [0,4194304] 0 2024-04-26T10:44:28.640 INFO:tasks.workunit.client.0.smithi049.stdout:4/232: dwrite de/d1b/f26 [0,4194304] 0 2024-04-26T10:44:28.641 INFO:tasks.workunit.client.0.smithi049.stdout:0/183: chown d8/db/d26 1 1 2024-04-26T10:44:28.641 INFO:tasks.workunit.client.0.smithi049.stdout:9/261: read d2/d1a/d1b/d1f/f3d [512955,88856] 0 2024-04-26T10:44:28.641 INFO:tasks.workunit.client.0.smithi049.stdout:5/211: mknod d7/d1d/d20/c56 0 2024-04-26T10:44:28.643 INFO:tasks.workunit.client.0.smithi049.stdout:3/179: rename d3/f1c to d3/f40 0 2024-04-26T10:44:28.643 INFO:tasks.workunit.client.0.smithi049.stdout:5/212: chown d7/c11 1830474328 1 2024-04-26T10:44:28.643 INFO:tasks.workunit.client.0.smithi049.stdout:9/262: symlink d2/d1a/d1b/d1f/l4f 0 2024-04-26T10:44:28.644 INFO:tasks.workunit.client.0.smithi049.stdout:4/233: write de/d1b/f40 [2858877,89289] 0 2024-04-26T10:44:28.647 INFO:tasks.workunit.client.0.smithi049.stdout:3/180: creat d3/d19/d26/f41 x:0 0 0 2024-04-26T10:44:28.650 INFO:tasks.workunit.client.0.smithi049.stdout:5/213: write d7/d14/d18/d48/f49 [782274,124130] 0 2024-04-26T10:44:28.651 INFO:tasks.workunit.client.0.smithi049.stdout:8/193: dwrite d2/d16/f3a [0,4194304] 0 2024-04-26T10:44:28.652 INFO:tasks.workunit.client.0.smithi049.stdout:0/184: dwrite d8/d42/f43 [0,4194304] 0 2024-04-26T10:44:28.653 INFO:tasks.workunit.client.0.smithi049.stdout:2/208: dwrite d6/d9/f27 [0,4194304] 0 2024-04-26T10:44:28.654 INFO:tasks.workunit.client.0.smithi049.stdout:7/218: fdatasync d2/dd/d25/d27/f2b 0 2024-04-26T10:44:28.655 INFO:tasks.workunit.client.0.smithi049.stdout:7/219: chown d2/dd/d25/l28 9800974 1 2024-04-26T10:44:28.657 INFO:tasks.workunit.client.0.smithi049.stdout:7/220: fdatasync d2/d3/de/d1c/f3e 0 2024-04-26T10:44:28.659 INFO:tasks.workunit.client.0.smithi049.stdout:0/185: dwrite d8/d42/f43 [0,4194304] 0 2024-04-26T10:44:28.660 INFO:tasks.workunit.client.0.smithi049.stdout:2/209: dwrite d6/f29 [0,4194304] 0 2024-04-26T10:44:28.669 INFO:tasks.workunit.client.0.smithi049.stdout:4/234: mknod de/d20/d24/c44 0 2024-04-26T10:44:28.669 INFO:tasks.workunit.client.0.smithi049.stdout:9/263: rename d2/d1a/d1b/c23 to d2/d1a/d1b/d1f/c50 0 2024-04-26T10:44:28.669 INFO:tasks.workunit.client.0.smithi049.stdout:3/181: truncate d3/d19/d26/f2b 137503 0 2024-04-26T10:44:28.669 INFO:tasks.workunit.client.0.smithi049.stdout:5/214: mknod d7/d1d/d34/c57 0 2024-04-26T10:44:28.670 INFO:tasks.workunit.client.0.smithi049.stdout:2/210: readlink d6/l26 0 2024-04-26T10:44:28.670 INFO:tasks.workunit.client.0.smithi049.stdout:7/221: rename d2/dd/d25/d27/f2b to d2/d3/de/d1c/f4e 0 2024-04-26T10:44:28.670 INFO:tasks.workunit.client.0.smithi049.stdout:4/235: write de/d1b/f2c [1268095,41427] 0 2024-04-26T10:44:28.670 INFO:tasks.workunit.client.0.smithi049.stdout:3/182: chown d3/d19/d8 5976182 1 2024-04-26T10:44:28.671 INFO:tasks.workunit.client.0.smithi049.stdout:8/194: read d2/df/d18/d2a/f2b [645680,43812] 0 2024-04-26T10:44:28.671 INFO:tasks.workunit.client.0.smithi049.stdout:3/183: stat d3/l1a 0 2024-04-26T10:44:28.671 INFO:tasks.workunit.client.0.smithi049.stdout:4/236: dread - de/d1b/f34 zero size 2024-04-26T10:44:28.671 INFO:tasks.workunit.client.0.smithi049.stdout:8/195: dread - d2/d1a/f1e zero size 2024-04-26T10:44:28.673 INFO:tasks.workunit.client.0.smithi049.stdout:8/196: rmdir d2/d1a/d27 39 2024-04-26T10:44:28.673 INFO:tasks.workunit.client.0.smithi049.stdout:3/184: rename d3/d19/d22/d2e/f3a to d3/d6/f42 0 2024-04-26T10:44:28.674 INFO:tasks.workunit.client.0.smithi049.stdout:8/197: read - d2/d1a/f1e zero size 2024-04-26T10:44:28.676 INFO:tasks.workunit.client.0.smithi049.stdout:7/222: dwrite d2/d3/f34 [0,4194304] 0 2024-04-26T10:44:28.678 INFO:tasks.workunit.client.0.smithi049.stdout:4/237: dwrite de/d1b/f1c [0,4194304] 0 2024-04-26T10:44:28.679 INFO:tasks.workunit.client.0.smithi049.stdout:7/223: creat d2/f4f x:0 0 0 2024-04-26T10:44:28.680 INFO:tasks.workunit.client.0.smithi049.stdout:8/198: dwrite f1 [4194304,4194304] 0 2024-04-26T10:44:28.680 INFO:tasks.workunit.client.0.smithi049.stdout:4/238: unlink de/f14 0 2024-04-26T10:44:28.681 INFO:tasks.workunit.client.0.smithi049.stdout:7/224: chown d2/dd/d45/c47 355838973 1 2024-04-26T10:44:28.682 INFO:tasks.workunit.client.0.smithi049.stdout:4/239: read de/d20/f2e [2757387,12146] 0 2024-04-26T10:44:28.682 INFO:tasks.workunit.client.0.smithi049.stdout:8/199: write d2/d1a/d27/f2c [1406223,113951] 0 2024-04-26T10:44:28.683 INFO:tasks.workunit.client.0.smithi049.stdout:7/225: link d2/dd/c19 d2/d3/de/c50 0 2024-04-26T10:44:28.683 INFO:tasks.workunit.client.0.smithi049.stdout:4/240: chown de/d20/l33 388 1 2024-04-26T10:44:28.683 INFO:tasks.workunit.client.0.smithi049.stdout:7/226: dread - d2/dd/d38/f44 zero size 2024-04-26T10:44:28.684 INFO:tasks.workunit.client.0.smithi049.stdout:8/200: chown d2/df/d18/c39 153157 1 2024-04-26T10:44:28.684 INFO:tasks.workunit.client.0.smithi049.stdout:7/227: write d2/d3/de/d1c/f3e [458677,61646] 0 2024-04-26T10:44:28.684 INFO:tasks.workunit.client.0.smithi049.stdout:8/201: rmdir d2/df/d18/d2a 39 2024-04-26T10:44:28.685 INFO:tasks.workunit.client.0.smithi049.stdout:9/264: sync 2024-04-26T10:44:28.686 INFO:tasks.workunit.client.0.smithi049.stdout:7/228: truncate d2/f1b 558503 0 2024-04-26T10:44:28.687 INFO:tasks.workunit.client.0.smithi049.stdout:9/265: write d2/d1a/d1b/f24 [852065,45458] 0 2024-04-26T10:44:28.688 INFO:tasks.workunit.client.0.smithi049.stdout:8/202: truncate d2/df/d18/d2a/f2b 1847364 0 2024-04-26T10:44:28.689 INFO:tasks.workunit.client.0.smithi049.stdout:8/203: fdatasync d2/df/f36 0 2024-04-26T10:44:28.689 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:28.688+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:28.689 INFO:tasks.workunit.client.0.smithi049.stdout:4/241: dwrite de/d1b/f2c [0,4194304] 0 2024-04-26T10:44:28.691 INFO:tasks.workunit.client.0.smithi049.stdout:4/242: creat de/d20/d38/f45 x:0 0 0 2024-04-26T10:44:28.692 INFO:tasks.workunit.client.0.smithi049.stdout:4/243: stat de/c19 0 2024-04-26T10:44:28.692 INFO:tasks.workunit.client.0.smithi049.stdout:9/266: dread d2/d25/f28 [0,4194304] 0 2024-04-26T10:44:28.693 INFO:tasks.workunit.client.0.smithi049.stdout:7/229: dwrite d2/f2c [0,4194304] 0 2024-04-26T10:44:28.693 INFO:tasks.workunit.client.0.smithi049.stdout:4/244: write de/f27 [2704577,66737] 0 2024-04-26T10:44:28.694 INFO:tasks.workunit.client.0.smithi049.stdout:4/245: creat de/d20/d38/f46 x:0 0 0 2024-04-26T10:44:28.694 INFO:tasks.workunit.client.0.smithi049.stdout:9/267: symlink d2/d1a/d1b/d1f/l51 0 2024-04-26T10:44:28.695 INFO:tasks.workunit.client.0.smithi049.stdout:9/268: chown d2/d1a/df/c17 30261962 1 2024-04-26T10:44:28.695 INFO:tasks.workunit.client.0.smithi049.stdout:6/187: dread da/fc [0,4194304] 0 2024-04-26T10:44:28.697 INFO:tasks.workunit.client.0.smithi049.stdout:9/269: creat d2/d1a/d1b/f52 x:0 0 0 2024-04-26T10:44:28.697 INFO:tasks.workunit.client.0.smithi049.stdout:4/246: dread f9 [0,4194304] 0 2024-04-26T10:44:28.701 INFO:tasks.workunit.client.0.smithi049.stdout:4/247: dread f7 [0,4194304] 0 2024-04-26T10:44:28.703 INFO:tasks.workunit.client.0.smithi049.stdout:4/248: write f1 [2981174,100054] 0 2024-04-26T10:44:28.703 INFO:tasks.workunit.client.0.smithi049.stdout:4/249: chown de/f15 1981 1 2024-04-26T10:44:28.704 INFO:tasks.workunit.client.0.smithi049.stdout:1/227: dread f19 [0,4194304] 0 2024-04-26T10:44:28.705 INFO:tasks.workunit.client.0.smithi049.stdout:4/250: write de/d20/d24/f31 [8344271,68126] 0 2024-04-26T10:44:28.707 INFO:tasks.workunit.client.0.smithi049.stdout:0/186: dread f2 [0,4194304] 0 2024-04-26T10:44:28.708 INFO:tasks.workunit.client.0.smithi049.stdout:0/187: fdatasync d8/d1e/f2b 0 2024-04-26T10:44:28.710 INFO:tasks.workunit.client.0.smithi049.stdout:7/230: sync 2024-04-26T10:44:28.710 INFO:tasks.workunit.client.0.smithi049.stdout:2/211: dread d6/d9/f19 [0,4194304] 0 2024-04-26T10:44:28.711 INFO:tasks.workunit.client.0.smithi049.stdout:7/231: write d2/d3/de/f1e [911665,50] 0 2024-04-26T10:44:28.713 INFO:tasks.workunit.client.0.smithi049.stdout:7/232: write d2/dd/f12 [121200,97665] 0 2024-04-26T10:44:28.717 INFO:tasks.workunit.client.0.smithi049.stdout:2/212: dwrite d6/f2f [0,4194304] 0 2024-04-26T10:44:28.722 INFO:tasks.workunit.client.0.smithi049.stdout:5/215: truncate d7/d14/d18/d48/f49 449576 0 2024-04-26T10:44:28.724 INFO:tasks.workunit.client.0.smithi049.stdout:8/204: write d2/d16/d19/f25 [268113,124491] 0 2024-04-26T10:44:28.724 INFO:tasks.workunit.client.0.smithi049.stdout:9/270: truncate d2/d1a/d1b/f24 1325681 0 2024-04-26T10:44:28.724 INFO:tasks.workunit.client.0.smithi049.stdout:4/251: dread de/d20/f22 [0,4194304] 0 2024-04-26T10:44:28.724 INFO:tasks.workunit.client.0.smithi049.stdout:7/233: creat d2/d3/de/f51 x:0 0 0 2024-04-26T10:44:28.725 INFO:tasks.workunit.client.0.smithi049.stdout:9/271: mkdir d2/d40/d53 0 2024-04-26T10:44:28.725 INFO:tasks.workunit.client.0.smithi049.stdout:4/252: mknod de/d1b/c47 0 2024-04-26T10:44:28.725 INFO:tasks.workunit.client.0.smithi049.stdout:9/272: sync 2024-04-26T10:44:28.726 INFO:tasks.workunit.client.0.smithi049.stdout:5/216: symlink d7/d14/d18/d2b/l58 0 2024-04-26T10:44:28.726 INFO:tasks.workunit.client.0.smithi049.stdout:7/234: write d2/fc [22791,10816] 0 2024-04-26T10:44:28.726 INFO:tasks.workunit.client.0.smithi049.stdout:0/188: write d8/db/d26/f2d [1978342,130238] 0 2024-04-26T10:44:28.726 INFO:tasks.workunit.client.0.smithi049.stdout:4/253: stat de/d3f 0 2024-04-26T10:44:28.726 INFO:tasks.workunit.client.0.smithi049.stdout:1/228: getdents d1e 0 2024-04-26T10:44:28.726 INFO:tasks.workunit.client.0.smithi049.stdout:4/254: dread - de/d20/f28 zero size 2024-04-26T10:44:28.727 INFO:tasks.workunit.client.0.smithi049.stdout:1/229: chown d1e/l21 7700130 1 2024-04-26T10:44:28.727 INFO:tasks.workunit.client.0.smithi049.stdout:9/273: mkdir d2/d1a/d1b/d1f/d34/d54 0 2024-04-26T10:44:28.727 INFO:tasks.workunit.client.0.smithi049.stdout:7/235: chown d2/dd/d25/l2e 7543564 1 2024-04-26T10:44:28.728 INFO:tasks.workunit.client.0.smithi049.stdout:4/255: mkdir de/d3f/d48 0 2024-04-26T10:44:28.728 INFO:tasks.workunit.client.0.smithi049.stdout:1/230: chown d1e/d20/d26/f30 1 1 2024-04-26T10:44:28.728 INFO:tasks.workunit.client.0.smithi049.stdout:7/236: creat d2/d3/f52 x:0 0 0 2024-04-26T10:44:28.729 INFO:tasks.workunit.client.0.smithi049.stdout:7/237: sync 2024-04-26T10:44:28.729 INFO:tasks.workunit.client.0.smithi049.stdout:9/274: rename d2/d25/l3a to d2/d25/l55 0 2024-04-26T10:44:28.730 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:44:28.731 INFO:tasks.workunit.client.0.smithi049.stdout:6/188: dread f8 [0,4194304] 0 2024-04-26T10:44:28.731 INFO:tasks.workunit.client.0.smithi049.stdout:0/189: truncate d8/d1e/f2a 459362 0 2024-04-26T10:44:28.731 INFO:tasks.workunit.client.0.smithi049.stdout:1/231: chown d1e/d20/d26/l2a 1007268 1 2024-04-26T10:44:28.731 INFO:tasks.workunit.client.0.smithi049.stdout:4/256: write de/f15 [10714158,66769] 0 2024-04-26T10:44:28.733 INFO:tasks.workunit.client.0.smithi049.stdout:4/257: read de/f27 [3941652,127938] 0 2024-04-26T10:44:28.733 INFO:tasks.workunit.client.0.smithi049.stdout:3/185: dread d3/d6/f10 [4194304,4194304] 0 2024-04-26T10:44:28.734 INFO:tasks.workunit.client.0.smithi049.stdout:9/275: creat d2/d1a/df/f56 x:0 0 0 2024-04-26T10:44:28.734 INFO:tasks.workunit.client.0.smithi049.stdout:8/205: dwrite d2/df/d18/d2a/f2b [0,4194304] 0 2024-04-26T10:44:28.734 INFO:tasks.workunit.client.0.smithi049.stdout:5/217: dwrite d7/d14/f38 [0,4194304] 0 2024-04-26T10:44:28.734 INFO:tasks.workunit.client.0.smithi049.stdout:7/238: chown d2/dd/d25/d27/f30 26412 1 2024-04-26T10:44:28.734 INFO:tasks.workunit.client.0.smithi049.stdout:1/232: symlink d1e/l46 0 2024-04-26T10:44:28.734 INFO:tasks.workunit.client.0.smithi049.stdout:0/190: rename d8/d1e/f24 to d8/db/d11/d1b/f44 0 2024-04-26T10:44:28.734 INFO:tasks.workunit.client.0.smithi049.stdout:6/189: symlink da/dd/de/d26/d29/l3b 0 2024-04-26T10:44:28.735 INFO:tasks.workunit.client.0.smithi049.stdout:4/258: write de/d1b/f2c [1298502,82497] 0 2024-04-26T10:44:28.735 INFO:tasks.workunit.client.0.smithi049.stdout:8/206: chown d2/d16/f2e 2 1 2024-04-26T10:44:28.735 INFO:tasks.workunit.client.0.smithi049.stdout:7/239: write d2/d3/f3c [616214,64537] 0 2024-04-26T10:44:28.736 INFO:tasks.workunit.client.0.smithi049.stdout:4/259: fdatasync de/d1b/f1c 0 2024-04-26T10:44:28.738 INFO:tasks.workunit.client.0.smithi049.stdout:8/207: creat d2/d17/f3d x:0 0 0 2024-04-26T10:44:28.739 INFO:tasks.workunit.client.0.smithi049.stdout:6/190: mknod da/dd/de/d26/d22/c3c 0 2024-04-26T10:44:28.739 INFO:tasks.workunit.client.0.smithi049.stdout:3/186: mknod d3/d19/d8/d34/c43 0 2024-04-26T10:44:28.739 INFO:tasks.workunit.client.0.smithi049.stdout:9/276: creat d2/d1a/d1b/d1f/d34/d54/f57 x:0 0 0 2024-04-26T10:44:28.739 INFO:tasks.workunit.client.0.smithi049.stdout:0/191: truncate d8/d1e/f2b 286239 0 2024-04-26T10:44:28.740 INFO:tasks.workunit.client.0.smithi049.stdout:1/233: creat d1e/d20/d26/f47 x:0 0 0 2024-04-26T10:44:28.740 INFO:tasks.workunit.client.0.smithi049.stdout:7/240: creat d2/f53 x:0 0 0 2024-04-26T10:44:28.741 INFO:tasks.workunit.client.0.smithi049.stdout:8/208: chown d2/df/d10/f13 2080038 1 2024-04-26T10:44:28.742 INFO:tasks.workunit.client.0.smithi049.stdout:0/192: rmdir d8/db/d26 39 2024-04-26T10:44:28.742 INFO:tasks.workunit.client.0.smithi049.stdout:3/187: creat d3/d19/d8/d34/f44 x:0 0 0 2024-04-26T10:44:28.743 INFO:tasks.workunit.client.0.smithi049.stdout:6/191: creat da/dd/de/d26/d29/f3d x:0 0 0 2024-04-26T10:44:28.743 INFO:tasks.workunit.client.0.smithi049.stdout:1/234: write d1e/d20/d26/f33 [64427,98632] 0 2024-04-26T10:44:28.744 INFO:tasks.workunit.client.0.smithi049.stdout:7/241: write d2/d3/f20 [43587,82363] 0 2024-04-26T10:44:28.745 INFO:tasks.workunit.client.0.smithi049.stdout:9/277: rename d2/d1a/c44 to d2/d1a/d1b/d1f/c58 0 2024-04-26T10:44:28.745 INFO:tasks.workunit.client.0.smithi049.stdout:0/193: mknod d8/db/c45 0 2024-04-26T10:44:28.745 INFO:tasks.workunit.client.0.smithi049.stdout:5/218: dwrite d7/d1d/d1f/f3b [0,4194304] 0 2024-04-26T10:44:28.747 INFO:tasks.workunit.client.0.smithi049.stdout:8/209: creat d2/d1a/f3e x:0 0 0 2024-04-26T10:44:28.747 INFO:tasks.workunit.client.0.smithi049.stdout:4/260: dwrite de/f15 [0,4194304] 0 2024-04-26T10:44:28.747 INFO:tasks.workunit.client.0.smithi049.stdout:7/242: write d2/dd/d25/f31 [400555,130575] 0 2024-04-26T10:44:28.748 INFO:tasks.workunit.client.0.smithi049.stdout:8/210: unlink d2/d1a/c1d 0 2024-04-26T10:44:28.748 INFO:tasks.workunit.client.0.smithi049.stdout:5/219: symlink d7/d14/d18/l59 0 2024-04-26T10:44:28.749 INFO:tasks.workunit.client.0.smithi049.stdout:1/235: read f9 [2474979,104663] 0 2024-04-26T10:44:28.749 INFO:tasks.workunit.client.0.smithi049.stdout:9/278: creat d2/d1a/d1b/d1f/d34/d54/f59 x:0 0 0 2024-04-26T10:44:28.749 INFO:tasks.workunit.client.0.smithi049.stdout:0/194: symlink d8/db/d11/d1c/l46 0 2024-04-26T10:44:28.749 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:28.749 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:28.750 INFO:tasks.workunit.client.0.smithi049.stdout:4/261: readlink de/d20/d24/l3d 0 2024-04-26T10:44:28.751 INFO:tasks.workunit.client.0.smithi049.stdout:1/236: symlink d1e/d20/d26/l48 0 2024-04-26T10:44:28.751 INFO:tasks.workunit.client.0.smithi049.stdout:8/211: creat d2/df/f3f x:0 0 0 2024-04-26T10:44:28.752 INFO:tasks.workunit.client.0.smithi049.stdout:9/279: symlink d2/d40/d53/l5a 0 2024-04-26T10:44:28.752 INFO:tasks.workunit.client.0.smithi049.stdout:7/243: mknod d2/dd/d45/c54 0 2024-04-26T10:44:28.752 INFO:tasks.workunit.client.0.smithi049.stdout:5/220: symlink d7/d14/d18/l5a 0 2024-04-26T10:44:28.752 INFO:tasks.workunit.client.0.smithi049.stdout:6/192: dread da/ff [0,4194304] 0 2024-04-26T10:44:28.752 INFO:tasks.workunit.client.0.smithi049.stdout:5/221: unlink d7/f10 0 2024-04-26T10:44:28.754 INFO:tasks.workunit.client.0.smithi049.stdout:8/212: read - d2/d17/f38 zero size 2024-04-26T10:44:28.754 INFO:tasks.workunit.client.0.smithi049.stdout:7/244: write d2/d3/f2a [195096,10135] 0 2024-04-26T10:44:28.754 INFO:tasks.workunit.client.0.smithi049.stdout:9/280: mknod d2/c5b 0 2024-04-26T10:44:28.754 INFO:tasks.workunit.client.0.smithi049.stdout:7/245: fsync d2/f2c 0 2024-04-26T10:44:28.755 INFO:tasks.workunit.client.0.smithi049.stdout:6/193: creat da/dd/de/d11/f3e x:0 0 0 2024-04-26T10:44:28.755 INFO:tasks.workunit.client.0.smithi049.stdout:1/237: mknod d1e/d20/d26/c49 0 2024-04-26T10:44:28.755 INFO:tasks.workunit.client.0.smithi049.stdout:8/213: mkdir d2/d17/d34/d40 0 2024-04-26T10:44:28.755 INFO:tasks.workunit.client.0.smithi049.stdout:9/281: chown d2/d1a/l15 0 1 2024-04-26T10:44:28.756 INFO:tasks.workunit.client.0.smithi049.stdout:4/262: dread f9 [0,4194304] 0 2024-04-26T10:44:28.756 INFO:tasks.workunit.client.0.smithi049.stdout:6/194: readlink da/dd/de/d26/d22/d2d/l36 0 2024-04-26T10:44:28.756 INFO:tasks.workunit.client.0.smithi049.stdout:5/222: mknod d7/d1d/d1f/d4e/c5b 0 2024-04-26T10:44:28.756 INFO:tasks.workunit.client.0.smithi049.stdout:1/238: write d1e/d20/f41 [3229599,78691] 0 2024-04-26T10:44:28.756 INFO:tasks.workunit.client.0.smithi049.stdout:7/246: getdents d2/dd/d25/d27 0 2024-04-26T10:44:28.757 INFO:tasks.workunit.client.0.smithi049.stdout:5/223: fsync d7/f44 0 2024-04-26T10:44:28.757 INFO:tasks.workunit.client.0.smithi049.stdout:4/263: symlink de/d20/d38/l49 0 2024-04-26T10:44:28.759 INFO:tasks.workunit.client.0.smithi049.stdout:0/195: truncate d8/f9 4113125 0 2024-04-26T10:44:28.760 INFO:tasks.workunit.client.0.smithi049.stdout:9/282: link d2/d25/l55 d2/d1a/df/l5c 0 2024-04-26T10:44:28.760 INFO:tasks.workunit.client.0.smithi049.stdout:8/214: dread d2/d16/d19/f33 [0,4194304] 0 2024-04-26T10:44:28.762 INFO:tasks.workunit.client.0.smithi049.stdout:5/224: creat d7/d1d/d34/d37/d54/f5c x:0 0 0 2024-04-26T10:44:28.762 INFO:tasks.workunit.client.0.smithi049.stdout:0/196: creat d8/db/d11/d1c/f47 x:0 0 0 2024-04-26T10:44:28.762 INFO:tasks.workunit.client.0.smithi049.stdout:1/239: rename d1e/f3a to d1e/d20/f4a 0 2024-04-26T10:44:28.762 INFO:tasks.workunit.client.0.smithi049.stdout:3/188: sync 2024-04-26T10:44:28.762 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:28.763 INFO:tasks.workunit.client.0.smithi049.stdout:5/225: fdatasync d7/d1d/d1f/f51 0 2024-04-26T10:44:28.763 INFO:tasks.workunit.client.0.smithi049.stdout:8/215: write d2/df/f36 [818540,20353] 0 2024-04-26T10:44:28.763 INFO:tasks.workunit.client.0.smithi049.stdout:3/189: chown d3/d19 176 1 2024-04-26T10:44:28.764 INFO:tasks.workunit.client.0.smithi049.stdout:7/247: dread d2/f33 [0,4194304] 0 2024-04-26T10:44:28.766 INFO:tasks.workunit.client.0.smithi049.stdout:2/213: dread d6/d9/db/df/f12 [0,4194304] 0 2024-04-26T10:44:28.766 INFO:tasks.workunit.client.0.smithi049.stdout:6/195: dwrite da/f32 [4194304,4194304] 0 2024-04-26T10:44:28.766 INFO:tasks.workunit.client.0.smithi049.stdout:8/216: fdatasync d2/df/d18/d2a/f2b 0 2024-04-26T10:44:28.766 INFO:tasks.workunit.client.0.smithi049.stdout:0/197: creat d8/db/d11/d1c/f48 x:0 0 0 2024-04-26T10:44:28.766 INFO:tasks.workunit.client.0.smithi049.stdout:5/226: unlink d7/d14/d18/c39 0 2024-04-26T10:44:28.767 INFO:tasks.workunit.client.0.smithi049.stdout:7/248: chown d2/dd/d38/f40 67090477 1 2024-04-26T10:44:28.768 INFO:tasks.workunit.client.0.smithi049.stdout:3/190: readlink d3/d19/d22/d2e/l3d 0 2024-04-26T10:44:28.769 INFO:tasks.workunit.client.0.smithi049.stdout:7/249: chown d2/dd/d45 1268 1 2024-04-26T10:44:28.769 INFO:tasks.workunit.client.0.smithi049.stdout:4/264: dread de/d20/f2e [0,4194304] 0 2024-04-26T10:44:28.769 INFO:tasks.workunit.client.0.smithi049.stdout:6/196: fsync f8 0 2024-04-26T10:44:28.769 INFO:tasks.workunit.client.0.smithi049.stdout:9/283: dwrite d2/f3c [0,4194304] 0 2024-04-26T10:44:28.770 INFO:tasks.workunit.client.0.smithi049.stdout:5/227: mkdir d7/d1d/d34/d5d 0 2024-04-26T10:44:28.770 INFO:tasks.workunit.client.0.smithi049.stdout:2/214: write d6/d9/db/d1e/f2a [323622,28187] 0 2024-04-26T10:44:28.770 INFO:tasks.workunit.client.0.smithi049.stdout:0/198: truncate d8/db/d26/f2d 3122536 0 2024-04-26T10:44:28.771 INFO:tasks.workunit.client.0.smithi049.stdout:6/197: write f0 [2510408,37396] 0 2024-04-26T10:44:28.772 INFO:tasks.workunit.client.0.smithi049.stdout:8/217: creat d2/df/d18/f41 x:0 0 0 2024-04-26T10:44:28.772 INFO:tasks.workunit.client.0.smithi049.stdout:5/228: chown d7/d1d/d1f/f51 589 1 2024-04-26T10:44:28.772 INFO:tasks.workunit.client.0.smithi049.stdout:4/265: creat de/d3f/f4a x:0 0 0 2024-04-26T10:44:28.774 INFO:tasks.workunit.client.0.smithi049.stdout:1/240: getdents d1e/d20/d26/d37 0 2024-04-26T10:44:28.774 INFO:tasks.workunit.client.0.smithi049.stdout:6/198: rmdir da/dd/de/d26/d22/d2d 39 2024-04-26T10:44:28.775 INFO:tasks.workunit.client.0.smithi049.stdout:2/215: write d6/d9/db/d1e/f2a [126824,68685] 0 2024-04-26T10:44:28.776 INFO:tasks.workunit.client.0.smithi049.stdout:8/218: mkdir d2/d16/d19/d42 0 2024-04-26T10:44:28.776 INFO:tasks.workunit.client.0.smithi049.stdout:1/241: fdatasync d1e/d20/d26/d3c/f3d 0 2024-04-26T10:44:28.776 INFO:tasks.workunit.client.0.smithi049.stdout:9/284: getdents d2/d1a/d1b/d1f 0 2024-04-26T10:44:28.776 INFO:tasks.workunit.client.0.smithi049.stdout:0/199: link d8/db/d11/d1c/f47 d8/db/f49 0 2024-04-26T10:44:28.777 INFO:tasks.workunit.client.0.smithi049.stdout:2/216: chown d6/l36 1 1 2024-04-26T10:44:28.777 INFO:tasks.workunit.client.0.smithi049.stdout:7/250: dwrite f0 [4194304,4194304] 0 2024-04-26T10:44:28.778 INFO:tasks.workunit.client.0.smithi049.stdout:5/229: dread d7/d1d/f30 [4194304,4194304] 0 2024-04-26T10:44:28.778 INFO:tasks.workunit.client.0.smithi049.stdout:3/191: link d3/d19/d8/c27 d3/d19/d8/dd/c45 0 2024-04-26T10:44:28.778 INFO:tasks.workunit.client.0.smithi049.stdout:4/266: mkdir de/d20/d4b 0 2024-04-26T10:44:28.778 INFO:tasks.workunit.client.0.smithi049.stdout:6/199: truncate da/dd/f1d 731657 0 2024-04-26T10:44:28.779 INFO:tasks.workunit.client.0.smithi049.stdout:9/285: write d2/d1a/d1b/d1f/d34/d54/f59 [999838,32785] 0 2024-04-26T10:44:28.779 INFO:tasks.workunit.client.0.smithi049.stdout:0/200: write d8/db/d26/f2d [3633227,92385] 0 2024-04-26T10:44:28.779 INFO:tasks.workunit.client.0.smithi049.stdout:6/200: chown da/dd/de/d11 299 1 2024-04-26T10:44:28.780 INFO:tasks.workunit.client.0.smithi049.stdout:4/267: read - de/d20/f25 zero size 2024-04-26T10:44:28.780 INFO:tasks.workunit.client.0.smithi049.stdout:8/219: getdents d2/df/d10/d23 0 2024-04-26T10:44:28.781 INFO:tasks.workunit.client.0.smithi049.stdout:3/192: write d3/d6/f42 [757401,83850] 0 2024-04-26T10:44:28.782 INFO:tasks.workunit.client.0.smithi049.stdout:9/286: fsync d2/d1a/df/f47 0 2024-04-26T10:44:28.782 INFO:tasks.workunit.client.0.smithi049.stdout:1/242: truncate f11 2376432 0 2024-04-26T10:44:28.782 INFO:tasks.workunit.client.0.smithi049.stdout:5/230: readlink d7/d14/l2a 0 2024-04-26T10:44:28.782 INFO:tasks.workunit.client.0.smithi049.stdout:2/217: write d6/d9/f19 [376678,29414] 0 2024-04-26T10:44:28.783 INFO:tasks.workunit.client.0.smithi049.stdout:4/268: fsync de/d1b/f1c 0 2024-04-26T10:44:28.783 INFO:tasks.workunit.client.0.smithi049.stdout:6/201: symlink da/dd/de/d26/d29/l3f 0 2024-04-26T10:44:28.783 INFO:tasks.workunit.client.0.smithi049.stdout:8/220: chown d2/d16/d19/d42 3545467 1 2024-04-26T10:44:28.783 INFO:tasks.workunit.client.0.smithi049.stdout:5/231: readlink d7/d14/d18/l5a 0 2024-04-26T10:44:28.783 INFO:tasks.workunit.client.0.smithi049.stdout:3/193: mkdir d3/d19/d22/d46 0 2024-04-26T10:44:28.783 INFO:tasks.workunit.client.0.smithi049.stdout:9/287: mkdir d2/d40/d5d 0 2024-04-26T10:44:28.784 INFO:tasks.workunit.client.0.smithi049.stdout:4/269: symlink de/d20/d24/l4c 0 2024-04-26T10:44:28.785 INFO:tasks.workunit.client.0.smithi049.stdout:8/221: mknod d2/d17/c43 0 2024-04-26T10:44:28.785 INFO:tasks.workunit.client.0.smithi049.stdout:3/194: mknod d3/d19/c47 0 2024-04-26T10:44:28.785 INFO:tasks.workunit.client.0.smithi049.stdout:7/251: dwrite d2/f2c [0,4194304] 0 2024-04-26T10:44:28.787 INFO:tasks.workunit.client.0.smithi049.stdout:3/195: unlink f1 0 2024-04-26T10:44:28.789 INFO:tasks.workunit.client.0.smithi049.stdout:7/252: creat d2/dd/d45/f55 x:0 0 0 2024-04-26T10:44:28.789 INFO:tasks.workunit.client.0.smithi049.stdout:2/218: getdents d6/d9/db/df 0 2024-04-26T10:44:28.789 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:28.787+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:28.790 INFO:tasks.workunit.client.0.smithi049.stdout:5/232: write d7/d1d/d34/d37/d3e/f40 [2400505,22430] 0 2024-04-26T10:44:28.791 INFO:tasks.workunit.client.0.smithi049.stdout:8/222: rename d2/f5 to d2/d17/d34/f44 0 2024-04-26T10:44:28.792 INFO:tasks.workunit.client.0.smithi049.stdout:7/253: write d2/d3/de/f1e [490745,26410] 0 2024-04-26T10:44:28.794 INFO:tasks.workunit.client.0.smithi049.stdout:8/223: write d2/f14 [818174,129167] 0 2024-04-26T10:44:28.795 INFO:tasks.workunit.client.0.smithi049.stdout:6/202: dwrite da/dd/de/d26/d29/f31 [4194304,4194304] 0 2024-04-26T10:44:28.796 INFO:tasks.workunit.client.0.smithi049.stdout:5/233: rename d7/d14/l2a to d7/d1d/d1f/l5e 0 2024-04-26T10:44:28.796 INFO:tasks.workunit.client.0.smithi049.stdout:8/224: read - d2/d1a/f1e zero size 2024-04-26T10:44:28.797 INFO:tasks.workunit.client.0.smithi049.stdout:9/288: dwrite d2/d1a/df/f56 [0,4194304] 0 2024-04-26T10:44:28.798 INFO:tasks.workunit.client.0.smithi049.stdout:7/254: creat d2/d3/f56 x:0 0 0 2024-04-26T10:44:28.798 INFO:tasks.workunit.client.0.smithi049.stdout:6/203: unlink da/dd/l28 0 2024-04-26T10:44:28.799 INFO:tasks.workunit.client.0.smithi049.stdout:5/234: creat d7/d14/d18/d48/f5f x:0 0 0 2024-04-26T10:44:28.799 INFO:tasks.workunit.client.0.smithi049.stdout:8/225: symlink d2/d17/l45 0 2024-04-26T10:44:28.799 INFO:tasks.workunit.client.0.smithi049.stdout:9/289: rmdir d2/d1a/df 39 2024-04-26T10:44:28.800 INFO:tasks.workunit.client.0.smithi049.stdout:3/196: dwrite d3/d19/d8/dd/ff [0,4194304] 0 2024-04-26T10:44:28.800 INFO:tasks.workunit.client.0.smithi049.stdout:8/226: fdatasync d2/d17/f3d 0 2024-04-26T10:44:28.801 INFO:tasks.workunit.client.0.smithi049.stdout:2/219: dwrite d6/d9/db/df/f22 [4194304,4194304] 0 2024-04-26T10:44:28.801 INFO:tasks.workunit.client.0.smithi049.stdout:5/235: rmdir d7/d1d/d34/d5d 0 2024-04-26T10:44:28.802 INFO:tasks.workunit.client.0.smithi049.stdout:6/204: symlink da/dd/de/d26/l40 0 2024-04-26T10:44:28.802 INFO:tasks.workunit.client.0.smithi049.stdout:3/197: read - d3/d19/d8/d34/f44 zero size 2024-04-26T10:44:28.802 INFO:tasks.workunit.client.0.smithi049.stdout:9/290: creat d2/d1a/f5e x:0 0 0 2024-04-26T10:44:28.802 INFO:tasks.workunit.client.0.smithi049.stdout:0/201: sync 2024-04-26T10:44:28.802 INFO:tasks.workunit.client.0.smithi049.stdout:4/270: sync 2024-04-26T10:44:28.807 INFO:tasks.workunit.client.0.smithi049.stdout:5/236: mkdir d7/d1d/d34/d37/d3e/d60 0 2024-04-26T10:44:28.807 INFO:tasks.workunit.client.0.smithi049.stdout:6/205: fsync f0 0 2024-04-26T10:44:28.807 INFO:tasks.workunit.client.0.smithi049.stdout:2/220: rename d6/l26 to d6/d9/db/df/l3e 0 2024-04-26T10:44:28.807 INFO:tasks.workunit.client.0.smithi049.stdout:8/227: truncate d2/df/d10/d23/f31 3625066 0 2024-04-26T10:44:28.807 INFO:tasks.workunit.client.0.smithi049.stdout:3/198: getdents d3 0 2024-04-26T10:44:28.807 INFO:tasks.workunit.client.0.smithi049.stdout:6/206: readlink da/dd/de/d11/l1f 0 2024-04-26T10:44:28.807 INFO:tasks.workunit.client.0.smithi049.stdout:5/237: chown d7/d1d/d1f/f51 1 1 2024-04-26T10:44:28.808 INFO:tasks.workunit.client.0.smithi049.stdout:8/228: creat d2/f46 x:0 0 0 2024-04-26T10:44:28.808 INFO:tasks.workunit.client.0.smithi049.stdout:7/255: read f0 [2923792,752] 0 2024-04-26T10:44:28.808 INFO:tasks.workunit.client.0.smithi049.stdout:4/271: rename de/d20/d24/l2f to de/d1d/l4d 0 2024-04-26T10:44:28.809 INFO:tasks.workunit.client.0.smithi049.stdout:5/238: symlink d7/l61 0 2024-04-26T10:44:28.809 INFO:tasks.workunit.client.0.smithi049.stdout:3/199: truncate d3/d6/f42 1351957 0 2024-04-26T10:44:28.809 INFO:tasks.workunit.client.0.smithi049.stdout:0/202: truncate d8/d42/f43 659450 0 2024-04-26T10:44:28.810 INFO:tasks.workunit.client.0.smithi049.stdout:6/207: rename da/dd/de/d26/d22/f39 to da/dd/f41 0 2024-04-26T10:44:28.811 INFO:tasks.workunit.client.0.smithi049.stdout:3/200: read d3/f40 [75095,52159] 0 2024-04-26T10:44:28.811 INFO:tasks.workunit.client.0.smithi049.stdout:5/239: mknod d7/d1d/d20/c62 0 2024-04-26T10:44:28.813 INFO:tasks.workunit.client.0.smithi049.stdout:0/203: creat d8/db/d11/d1b/f4a x:0 0 0 2024-04-26T10:44:28.814 INFO:tasks.workunit.client.0.smithi049.stdout:9/291: dwrite d2/d25/f2e [0,4194304] 0 2024-04-26T10:44:28.814 INFO:tasks.workunit.client.0.smithi049.stdout:6/208: mkdir da/dd/de/d42 0 2024-04-26T10:44:28.814 INFO:tasks.workunit.client.0.smithi049.stdout:2/221: dwrite d6/d32/f3a [0,4194304] 0 2024-04-26T10:44:28.814 INFO:tasks.workunit.client.0.smithi049.stdout:5/240: readlink d7/d1d/d34/d37/d3e/l55 0 2024-04-26T10:44:28.815 INFO:tasks.workunit.client.0.smithi049.stdout:0/204: fsync d8/f3d 0 2024-04-26T10:44:28.815 INFO:tasks.workunit.client.0.smithi049.stdout:7/256: dread d2/dd/f26 [0,4194304] 0 2024-04-26T10:44:28.816 INFO:tasks.workunit.client.0.smithi049.stdout:4/272: dread de/d20/f2e [0,4194304] 0 2024-04-26T10:44:28.817 INFO:tasks.workunit.client.0.smithi049.stdout:5/241: fdatasync d7/d14/d18/f46 0 2024-04-26T10:44:28.818 INFO:tasks.workunit.client.0.smithi049.stdout:3/201: dread d3/d19/d26/f2b [0,4194304] 0 2024-04-26T10:44:28.821 INFO:tasks.workunit.client.0.smithi049.stdout:2/222: mkdir d6/d9/db/d34/d38/d3f 0 2024-04-26T10:44:28.822 INFO:tasks.workunit.client.0.smithi049.stdout:8/229: dwrite d2/d17/f3d [0,4194304] 0 2024-04-26T10:44:28.822 INFO:tasks.workunit.client.0.smithi049.stdout:7/257: creat d2/dd/d25/d27/f57 x:0 0 0 2024-04-26T10:44:28.822 INFO:tasks.workunit.client.0.smithi049.stdout:9/292: truncate d2/d1a/d1b/f24 1332147 0 2024-04-26T10:44:28.822 INFO:tasks.workunit.client.0.smithi049.stdout:5/242: symlink d7/d1d/d1f/d22/l63 0 2024-04-26T10:44:28.822 INFO:tasks.workunit.client.0.smithi049.stdout:2/223: readlink d6/d30/l37 0 2024-04-26T10:44:28.822 INFO:tasks.workunit.client.0.smithi049.stdout:3/202: chown d3/d6/f12 5195321 1 2024-04-26T10:44:28.822 INFO:tasks.workunit.client.0.smithi049.stdout:5/243: creat d7/f64 x:0 0 0 2024-04-26T10:44:28.822 INFO:tasks.workunit.client.0.smithi049.stdout:0/205: dread d8/db/d11/d1b/f44 [0,4194304] 0 2024-04-26T10:44:28.823 INFO:tasks.workunit.client.0.smithi049.stdout:0/206: fdatasync d8/db/d26/f2d 0 2024-04-26T10:44:28.823 INFO:tasks.workunit.client.0.smithi049.stdout:5/244: mkdir d7/d1d/d1f/d4e/d65 0 2024-04-26T10:44:28.823 INFO:tasks.workunit.client.0.smithi049.stdout:3/203: rename d3/d19/d8/dd/ff to d3/d19/d26/f48 0 2024-04-26T10:44:28.825 INFO:tasks.workunit.client.0.smithi049.stdout:7/258: rmdir d2/dd/d25 39 2024-04-26T10:44:28.827 INFO:tasks.workunit.client.0.smithi049.stdout:5/245: mkdir d7/d66 0 2024-04-26T10:44:28.828 INFO:tasks.workunit.client.0.smithi049.stdout:8/230: dread d2/d16/d19/f33 [0,4194304] 0 2024-04-26T10:44:28.828 INFO:tasks.workunit.client.0.smithi049.stdout:1/243: dread f0 [4194304,4194304] 0 2024-04-26T10:44:28.828 INFO:tasks.workunit.client.0.smithi049.stdout:7/259: symlink d2/d3/de/l58 0 2024-04-26T10:44:28.829 INFO:tasks.workunit.client.0.smithi049.stdout:2/224: dread d6/d32/f3a [0,4194304] 0 2024-04-26T10:44:28.830 INFO:tasks.workunit.client.0.smithi049.stdout:8/231: fsync d2/d1a/f1e 0 2024-04-26T10:44:28.831 INFO:tasks.workunit.client.0.smithi049.stdout:0/207: truncate f3 1321289 0 2024-04-26T10:44:28.832 INFO:tasks.workunit.client.0.smithi049.stdout:9/293: dwrite d2/f8 [0,4194304] 0 2024-04-26T10:44:28.832 INFO:tasks.workunit.client.0.smithi049.stdout:8/232: dread - d2/f2f zero size 2024-04-26T10:44:28.832 INFO:tasks.workunit.client.0.smithi049.stdout:5/246: symlink d7/d53/l67 0 2024-04-26T10:44:28.833 INFO:tasks.workunit.client.0.smithi049.stdout:1/244: chown d1e/d20/d26/d3c/f3f 46 1 2024-04-26T10:44:28.833 INFO:tasks.workunit.client.0.smithi049.stdout:2/225: fdatasync d6/d9/db/df/f12 0 2024-04-26T10:44:28.833 INFO:tasks.workunit.client.0.smithi049.stdout:7/260: creat d2/dd/d48/f59 x:0 0 0 2024-04-26T10:44:28.833 INFO:tasks.workunit.client.0.smithi049.stdout:4/273: dwrite de/d20/d24/f32 [0,4194304] 0 2024-04-26T10:44:28.834 INFO:tasks.workunit.client.0.smithi049.stdout:8/233: mkdir d2/df/d10/d47 0 2024-04-26T10:44:28.834 INFO:tasks.workunit.client.0.smithi049.stdout:7/261: stat d2/dd/f3f 0 2024-04-26T10:44:28.834 INFO:tasks.workunit.client.0.smithi049.stdout:9/294: chown d2/d1a/d1b/d1f/l51 213652975 1 2024-04-26T10:44:28.835 INFO:tasks.workunit.client.0.smithi049.stdout:1/245: rename f19 to d1e/d20/d26/f4b 0 2024-04-26T10:44:28.835 INFO:tasks.workunit.client.0.smithi049.stdout:7/262: dread - d2/f53 zero size 2024-04-26T10:44:28.837 INFO:tasks.workunit.client.0.smithi049.stdout:1/246: chown f12 119830 1 2024-04-26T10:44:28.837 INFO:tasks.workunit.client.0.smithi049.stdout:8/234: creat d2/df/d18/d2a/f48 x:0 0 0 2024-04-26T10:44:28.837 INFO:tasks.workunit.client.0.smithi049.stdout:3/204: dwrite d3/d19/d22/f2d [4194304,4194304] 0 2024-04-26T10:44:28.837 INFO:tasks.workunit.client.0.smithi049.stdout:0/208: getdents d8/db/d26 0 2024-04-26T10:44:28.838 INFO:tasks.workunit.client.0.smithi049.stdout:2/226: creat d6/d9/db/d34/d38/d3f/f40 x:0 0 0 2024-04-26T10:44:28.838 INFO:tasks.workunit.client.0.smithi049.stdout:5/247: mknod d7/d14/d18/c68 0 2024-04-26T10:44:28.839 INFO:tasks.workunit.client.0.smithi049.stdout:0/209: chown d8/db/d11 713 1 2024-04-26T10:44:28.839 INFO:tasks.workunit.client.0.smithi049.stdout:8/235: chown d2/d16/d19/d42 4065578 1 2024-04-26T10:44:28.841 INFO:tasks.workunit.client.0.smithi049.stdout:8/236: fdatasync d2/d1a/d27/f2c 0 2024-04-26T10:44:28.842 INFO:tasks.workunit.client.0.smithi049.stdout:5/248: symlink d7/d1d/d34/d37/d3e/d60/l69 0 2024-04-26T10:44:28.845 INFO:tasks.workunit.client.0.smithi049.stdout:8/237: mknod d2/c49 0 2024-04-26T10:44:28.845 INFO:tasks.workunit.client.0.smithi049.stdout:0/210: getdents d8/db/d11/d1c 0 2024-04-26T10:44:28.847 INFO:tasks.workunit.client.0.smithi049.stdout:2/227: truncate d6/d9/fc 3883653 0 2024-04-26T10:44:28.847 INFO:tasks.workunit.client.0.smithi049.stdout:5/249: write d7/d14/d18/d2b/f4b [244043,74955] 0 2024-04-26T10:44:28.849 INFO:tasks.workunit.client.0.smithi049.stdout:8/238: readlink d2/df/d10/l3c 0 2024-04-26T10:44:28.849 INFO:tasks.workunit.client.0.smithi049.stdout:4/274: dwrite f7 [0,4194304] 0 2024-04-26T10:44:28.850 INFO:tasks.workunit.client.0.smithi049.stdout:3/205: dwrite d3/d23/d2f/f3c [0,4194304] 0 2024-04-26T10:44:28.850 INFO:tasks.workunit.client.0.smithi049.stdout:8/239: chown d2/d16 1797690 1 2024-04-26T10:44:28.851 INFO:tasks.workunit.client.0.smithi049.stdout:5/250: readlink d7/d1d/d1f/l52 0 2024-04-26T10:44:28.852 INFO:tasks.workunit.client.0.smithi049.stdout:9/295: dwrite d2/d1a/d1b/f24 [0,4194304] 0 2024-04-26T10:44:28.852 INFO:tasks.workunit.client.0.smithi049.stdout:0/211: link l6 d8/db/d11/d1b/l4b 0 2024-04-26T10:44:28.852 INFO:tasks.workunit.client.0.smithi049.stdout:8/240: readlink d2/df/l32 0 2024-04-26T10:44:28.853 INFO:tasks.workunit.client.0.smithi049.stdout:1/247: dwrite d1e/d20/d26/f33 [0,4194304] 0 2024-04-26T10:44:28.853 INFO:tasks.workunit.client.0.smithi049.stdout:5/251: dread - d7/f44 zero size 2024-04-26T10:44:28.853 INFO:tasks.workunit.client.0.smithi049.stdout:6/209: dread f1 [0,4194304] 0 2024-04-26T10:44:28.854 INFO:tasks.workunit.client.0.smithi049.stdout:3/206: truncate d3/d19/d26/f48 4198079 0 2024-04-26T10:44:28.855 INFO:tasks.workunit.client.0.smithi049.stdout:1/248: write d1e/d20/d26/f47 [33752,108708] 0 2024-04-26T10:44:28.859 INFO:tasks.workunit.client.0.smithi049.stdout:4/275: dwrite de/d20/d24/f31 [4194304,4194304] 0 2024-04-26T10:44:28.859 INFO:tasks.workunit.client.0.smithi049.stdout:9/296: rename d2/d25/c36 to d2/d1a/d1b/c5f 0 2024-04-26T10:44:28.861 INFO:tasks.workunit.client.0.smithi049.stdout:2/228: truncate d6/d9/db/df/f12 4948516 0 2024-04-26T10:44:28.861 INFO:tasks.workunit.client.0.smithi049.stdout:3/207: write d3/d19/d22/d2e/f31 [1752946,75919] 0 2024-04-26T10:44:28.861 INFO:tasks.workunit.client.0.smithi049.stdout:9/297: fsync d2/d1a/d1b/d1f/f32 0 2024-04-26T10:44:28.862 INFO:tasks.workunit.client.0.smithi049.stdout:5/252: rename d7/l47 to d7/d1d/l6a 0 2024-04-26T10:44:28.862 INFO:tasks.workunit.client.0.smithi049.stdout:9/298: sync 2024-04-26T10:44:28.862 INFO:tasks.workunit.client.0.smithi049.stdout:5/253: sync 2024-04-26T10:44:28.863 INFO:tasks.workunit.client.0.smithi049.stdout:6/210: dwrite da/f32 [0,4194304] 0 2024-04-26T10:44:28.864 INFO:tasks.workunit.client.0.smithi049.stdout:2/229: fdatasync d6/d9/db/d11/f1d 0 2024-04-26T10:44:28.864 INFO:tasks.workunit.client.0.smithi049.stdout:1/249: rename d1e/d20/l2e to d1e/d20/d26/d3c/l4c 0 2024-04-26T10:44:28.865 INFO:tasks.workunit.client.0.smithi049.stdout:9/299: mkdir d2/d25/d60 0 2024-04-26T10:44:28.865 INFO:tasks.workunit.client.0.smithi049.stdout:3/208: chown d3/d19/c15 22 1 2024-04-26T10:44:28.866 INFO:tasks.workunit.client.0.smithi049.stdout:5/254: symlink d7/d1d/d1f/d4e/d65/l6b 0 2024-04-26T10:44:28.866 INFO:tasks.workunit.client.0.smithi049.stdout:1/250: fsync d1e/f31 0 2024-04-26T10:44:28.867 INFO:tasks.workunit.client.0.smithi049.stdout:9/300: readlink d2/l46 0 2024-04-26T10:44:28.868 INFO:tasks.workunit.client.0.smithi049.stdout:3/209: creat d3/d19/d8/f49 x:0 0 0 2024-04-26T10:44:28.869 INFO:tasks.workunit.client.0.smithi049.stdout:0/212: dwrite d8/db/f49 [0,4194304] 0 2024-04-26T10:44:28.870 INFO:tasks.workunit.client.0.smithi049.stdout:3/210: chown d3/d6/c3b 1106 1 2024-04-26T10:44:28.870 INFO:tasks.workunit.client.0.smithi049.stdout:1/251: write d1e/f45 [28265,62646] 0 2024-04-26T10:44:28.871 INFO:tasks.workunit.client.0.smithi049.stdout:5/255: write d7/d1d/d34/d37/d54/f5c [783170,105185] 0 2024-04-26T10:44:28.871 INFO:tasks.workunit.client.0.smithi049.stdout:9/301: write d2/d1a/df/f47 [919457,44885] 0 2024-04-26T10:44:28.871 INFO:tasks.workunit.client.0.smithi049.stdout:2/230: rename d6/d9/db/d34/c3c to d6/d9/c41 0 2024-04-26T10:44:28.873 INFO:tasks.workunit.client.0.smithi049.stdout:4/276: dwrite de/f27 [0,4194304] 0 2024-04-26T10:44:28.874 INFO:tasks.workunit.client.0.smithi049.stdout:3/211: chown d3/d6/f10 9085 1 2024-04-26T10:44:28.876 INFO:tasks.workunit.client.0.smithi049.stdout:4/277: fsync f1 0 2024-04-26T10:44:28.876 INFO:tasks.workunit.client.0.smithi049.stdout:9/302: write d2/d1a/df/f47 [566716,124288] 0 2024-04-26T10:44:28.876 INFO:tasks.workunit.client.0.smithi049.stdout:6/211: dwrite da/dd/f41 [0,4194304] 0 2024-04-26T10:44:28.877 INFO:tasks.workunit.client.0.smithi049.stdout:2/231: chown d6/d9/db/d11/f1d 1 1 2024-04-26T10:44:28.880 INFO:tasks.workunit.client.0.smithi049.stdout:4/278: symlink de/d20/l4e 0 2024-04-26T10:44:28.880 INFO:tasks.workunit.client.0.smithi049.stdout:0/213: dread f2 [0,4194304] 0 2024-04-26T10:44:28.881 INFO:tasks.workunit.client.0.smithi049.stdout:3/212: creat d3/d19/d22/d46/f4a x:0 0 0 2024-04-26T10:44:28.882 INFO:tasks.workunit.client.0.smithi049.stdout:9/303: creat d2/d1a/d42/f61 x:0 0 0 2024-04-26T10:44:28.882 INFO:tasks.workunit.client.0.smithi049.stdout:2/232: truncate f4 1602273 0 2024-04-26T10:44:28.882 INFO:tasks.workunit.client.0.smithi049.stdout:5/256: link d7/d1d/d20/l28 d7/d53/l6c 0 2024-04-26T10:44:28.882 INFO:tasks.workunit.client.0.smithi049.stdout:4/279: symlink de/d20/d4b/l4f 0 2024-04-26T10:44:28.883 INFO:tasks.workunit.client.0.smithi049.stdout:2/233: chown d6/d32 2950 1 2024-04-26T10:44:28.883 INFO:tasks.workunit.client.0.smithi049.stdout:2/234: sync 2024-04-26T10:44:28.883 INFO:tasks.workunit.client.0.smithi049.stdout:9/304: mknod d2/d25/c62 0 2024-04-26T10:44:28.884 INFO:tasks.workunit.client.0.smithi049.stdout:5/257: mknod d7/d1d/d34/c6d 0 2024-04-26T10:44:28.884 INFO:tasks.workunit.client.0.smithi049.stdout:3/213: chown d3/d19/d8/dd/f18 4871 1 2024-04-26T10:44:28.885 INFO:tasks.workunit.client.0.smithi049.stdout:1/252: dwrite d1e/f45 [0,4194304] 0 2024-04-26T10:44:28.885 INFO:tasks.workunit.client.0.smithi049.stdout:4/280: write de/d3f/f4a [556782,67127] 0 2024-04-26T10:44:28.887 INFO:tasks.workunit.client.0.smithi049.stdout:2/235: truncate d6/d9/db/f1c 5317128 0 2024-04-26T10:44:28.887 INFO:tasks.workunit.client.0.smithi049.stdout:6/212: dread da/dd/f41 [0,4194304] 0 2024-04-26T10:44:28.888 INFO:tasks.workunit.client.0.smithi049.stdout:4/281: readlink de/d20/l33 0 2024-04-26T10:44:28.888 INFO:tasks.workunit.client.0.smithi049.stdout:9/305: creat d2/d1a/d1b/d1f/d34/d54/f63 x:0 0 0 2024-04-26T10:44:28.888 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:28.888 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:28.889 INFO:tasks.workunit.client.0.smithi049.stdout:5/258: creat d7/d14/d18/f6e x:0 0 0 2024-04-26T10:44:28.889 INFO:tasks.workunit.client.0.smithi049.stdout:1/253: mkdir d1e/d20/d4d 0 2024-04-26T10:44:28.890 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:28.888+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:28.890 INFO:tasks.workunit.client.0.smithi049.stdout:0/214: dwrite d8/db/d26/f40 [0,4194304] 0 2024-04-26T10:44:28.891 INFO:tasks.workunit.client.0.smithi049.stdout:2/236: creat d6/d9/db/d34/d38/d3f/f42 x:0 0 0 2024-04-26T10:44:28.891 INFO:tasks.workunit.client.0.smithi049.stdout:4/282: mkdir de/d20/d24/d50 0 2024-04-26T10:44:28.891 INFO:tasks.workunit.client.0.smithi049.stdout:6/213: creat da/dd/de/d11/f43 x:0 0 0 2024-04-26T10:44:28.891 INFO:tasks.workunit.client.0.smithi049.stdout:3/214: rename d3/d19/d8/dd/l1f to d3/d6/d21/l4b 0 2024-04-26T10:44:28.892 INFO:tasks.workunit.client.0.smithi049.stdout:1/254: chown d1e/f44 19210918 1 2024-04-26T10:44:28.892 INFO:tasks.workunit.client.0.smithi049.stdout:0/215: chown d8/db/d26/d39 5 1 2024-04-26T10:44:28.892 INFO:tasks.workunit.client.0.smithi049.stdout:3/215: chown d3/d19/c37 354 1 2024-04-26T10:44:28.893 INFO:tasks.workunit.client.0.smithi049.stdout:2/237: creat d6/d9/db/d11/f43 x:0 0 0 2024-04-26T10:44:28.893 INFO:tasks.workunit.client.0.smithi049.stdout:5/259: getdents d7/d53 0 2024-04-26T10:44:28.893 INFO:tasks.workunit.client.0.smithi049.stdout:0/216: creat d8/d1e/f4c x:0 0 0 2024-04-26T10:44:28.893 INFO:tasks.workunit.client.0.smithi049.stdout:1/255: chown d1e/f1f 61992490 1 2024-04-26T10:44:28.894 INFO:tasks.workunit.client.0.smithi049.stdout:6/214: truncate da/dd/de/f18 624885 0 2024-04-26T10:44:28.894 INFO:tasks.workunit.client.0.smithi049.stdout:5/260: write d7/f26 [1408338,123296] 0 2024-04-26T10:44:28.895 INFO:tasks.workunit.client.0.smithi049.stdout:3/216: creat d3/d19/d22/d2e/f4c x:0 0 0 2024-04-26T10:44:28.895 INFO:tasks.workunit.client.0.smithi049.stdout:2/238: unlink d6/d9/db/c16 0 2024-04-26T10:44:28.896 INFO:tasks.workunit.client.0.smithi049.stdout:6/215: symlink da/dd/de/d42/l44 0 2024-04-26T10:44:28.896 INFO:tasks.workunit.client.0.smithi049.stdout:4/283: dread f7 [0,4194304] 0 2024-04-26T10:44:28.896 INFO:tasks.workunit.client.0.smithi049.stdout:2/239: write d6/d9/db/f24 [2601224,119345] 0 2024-04-26T10:44:28.897 INFO:tasks.workunit.client.0.smithi049.stdout:7/263: dread d2/f22 [0,4194304] 0 2024-04-26T10:44:28.897 INFO:tasks.workunit.client.0.smithi049.stdout:3/217: dread - d3/d19/d8/d34/f44 zero size 2024-04-26T10:44:28.898 INFO:tasks.workunit.client.0.smithi049.stdout:2/240: mknod d6/d32/c44 0 2024-04-26T10:44:28.898 INFO:tasks.workunit.client.0.smithi049.stdout:8/241: dread d2/df/d10/d23/f31 [0,4194304] 0 2024-04-26T10:44:28.899 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:28.900 INFO:tasks.workunit.client.0.smithi049.stdout:5/261: rename d7/d1d/d34/d37/d54 to d7/d1d/d1f/d4e/d65/d6f 0 2024-04-26T10:44:28.900 INFO:tasks.workunit.client.0.smithi049.stdout:3/218: truncate d3/d19/d22/d2e/f4c 717753 0 2024-04-26T10:44:28.900 INFO:tasks.workunit.client.0.smithi049.stdout:8/242: mknod d2/df/c4a 0 2024-04-26T10:44:28.901 INFO:tasks.workunit.client.0.smithi049.stdout:4/284: rename de/c19 to de/d20/d24/d50/c51 0 2024-04-26T10:44:28.901 INFO:tasks.workunit.client.0.smithi049.stdout:5/262: mknod d7/c70 0 2024-04-26T10:44:28.903 INFO:tasks.workunit.client.0.smithi049.stdout:3/219: fdatasync d3/d19/d22/f2d 0 2024-04-26T10:44:28.903 INFO:tasks.workunit.client.0.smithi049.stdout:8/243: fsync d2/df/d18/d2a/f2b 0 2024-04-26T10:44:28.904 INFO:tasks.workunit.client.0.smithi049.stdout:5/263: dread - d7/d1d/d1f/f51 zero size 2024-04-26T10:44:28.904 INFO:tasks.workunit.client.0.smithi049.stdout:4/285: chown de/d20/l39 1037481 1 2024-04-26T10:44:28.904 INFO:tasks.workunit.client.0.smithi049.stdout:6/216: dread f1 [0,4194304] 0 2024-04-26T10:44:28.906 INFO:tasks.workunit.client.0.smithi049.stdout:8/244: creat d2/d16/f4b x:0 0 0 2024-04-26T10:44:28.907 INFO:tasks.workunit.client.0.smithi049.stdout:5/264: chown d7/d14/d18/d2b/f4b 0 1 2024-04-26T10:44:28.907 INFO:tasks.workunit.client.0.smithi049.stdout:7/264: dwrite d2/f53 [0,4194304] 0 2024-04-26T10:44:28.907 INFO:tasks.workunit.client.0.smithi049.stdout:8/245: stat d2 0 2024-04-26T10:44:28.908 INFO:tasks.workunit.client.0.smithi049.stdout:3/220: dread d3/f40 [0,4194304] 0 2024-04-26T10:44:28.908 INFO:tasks.workunit.client.0.smithi049.stdout:5/265: chown d7/d14/d18 3 1 2024-04-26T10:44:28.909 INFO:tasks.workunit.client.0.smithi049.stdout:6/217: dread - da/dd/de/d26/d22/d2d/f37 zero size 2024-04-26T10:44:28.910 INFO:tasks.workunit.client.0.smithi049.stdout:2/241: dwrite d6/d9/db/d11/f1d [4194304,4194304] 0 2024-04-26T10:44:28.911 INFO:tasks.workunit.client.0.smithi049.stdout:5/266: symlink d7/d1d/l71 0 2024-04-26T10:44:28.911 INFO:tasks.workunit.client.0.smithi049.stdout:6/218: dread - da/dd/f2a zero size 2024-04-26T10:44:28.912 INFO:tasks.workunit.client.0.smithi049.stdout:5/267: write d7/f64 [612722,64270] 0 2024-04-26T10:44:28.912 INFO:tasks.workunit.client.0.smithi049.stdout:3/221: write d3/d19/d26/f41 [470351,68342] 0 2024-04-26T10:44:28.914 INFO:tasks.workunit.client.0.smithi049.stdout:7/265: getdents d2/dd/d48 0 2024-04-26T10:44:28.914 INFO:tasks.workunit.client.0.smithi049.stdout:2/242: write d6/d32/f3a [2318142,24989] 0 2024-04-26T10:44:28.915 INFO:tasks.workunit.client.0.smithi049.stdout:6/219: readlink da/dd/de/d42/l44 0 2024-04-26T10:44:28.916 INFO:tasks.workunit.client.0.smithi049.stdout:2/243: read d6/d32/f3a [613496,120070] 0 2024-04-26T10:44:28.916 INFO:tasks.workunit.client.0.smithi049.stdout:4/286: dwrite de/d1b/f34 [0,4194304] 0 2024-04-26T10:44:28.917 INFO:tasks.workunit.client.0.smithi049.stdout:5/268: creat d7/d1d/d34/d37/d3e/d60/f72 x:0 0 0 2024-04-26T10:44:28.917 INFO:tasks.workunit.client.0.smithi049.stdout:3/222: write d3/d19/d8/dd/f18 [7603522,74962] 0 2024-04-26T10:44:28.917 INFO:tasks.workunit.client.0.smithi049.stdout:7/266: symlink d2/dd/d25/d27/l5a 0 2024-04-26T10:44:28.919 INFO:tasks.workunit.client.0.smithi049.stdout:4/287: mkdir de/d3f/d52 0 2024-04-26T10:44:28.919 INFO:tasks.workunit.client.0.smithi049.stdout:6/220: write da/dd/de/d26/d22/f25 [679578,118527] 0 2024-04-26T10:44:28.920 INFO:tasks.workunit.client.0.smithi049.stdout:3/223: mknod d3/d6/d21/c4d 0 2024-04-26T10:44:28.920 INFO:tasks.workunit.client.0.smithi049.stdout:5/269: creat d7/d66/f73 x:0 0 0 2024-04-26T10:44:28.921 INFO:tasks.workunit.client.0.smithi049.stdout:8/246: dwrite d2/fe [0,4194304] 0 2024-04-26T10:44:28.922 INFO:tasks.workunit.client.0.smithi049.stdout:3/224: fdatasync d3/d19/d26/f2b 0 2024-04-26T10:44:28.922 INFO:tasks.workunit.client.0.smithi049.stdout:0/217: dread d8/f9 [0,4194304] 0 2024-04-26T10:44:28.924 INFO:tasks.workunit.client.0.smithi049.stdout:4/288: mknod de/d3f/d52/c53 0 2024-04-26T10:44:28.924 INFO:tasks.workunit.client.0.smithi049.stdout:7/267: dread d2/dd/d25/f31 [0,4194304] 0 2024-04-26T10:44:28.924 INFO:tasks.workunit.client.0.smithi049.stdout:5/270: chown d7/d53/l67 33368 1 2024-04-26T10:44:28.924 INFO:tasks.workunit.client.0.smithi049.stdout:8/247: write d2/f2f [372787,115094] 0 2024-04-26T10:44:28.924 INFO:tasks.workunit.client.0.smithi049.stdout:6/221: rename da/dd/de/d11/f12 to da/dd/de/d26/f45 0 2024-04-26T10:44:28.925 INFO:tasks.workunit.client.0.smithi049.stdout:6/222: chown da/dd/f1e 7758207 1 2024-04-26T10:44:28.926 INFO:tasks.workunit.client.0.smithi049.stdout:7/268: write d2/d3/f3c [998045,29839] 0 2024-04-26T10:44:28.926 INFO:tasks.workunit.client.0.smithi049.stdout:4/289: creat de/f54 x:0 0 0 2024-04-26T10:44:28.926 INFO:tasks.workunit.client.0.smithi049.stdout:8/248: write d2/d16/f4b [639921,42295] 0 2024-04-26T10:44:28.929 INFO:tasks.workunit.client.0.smithi049.stdout:6/223: mknod da/dd/de/d26/c46 0 2024-04-26T10:44:28.930 INFO:tasks.workunit.client.0.smithi049.stdout:9/306: dread d2/d1a/df/f30 [0,4194304] 0 2024-04-26T10:44:28.930 INFO:tasks.workunit.client.0.smithi049.stdout:8/249: write d2/df/d10/d23/f31 [2092535,954] 0 2024-04-26T10:44:28.930 INFO:tasks.workunit.client.0.smithi049.stdout:2/244: dwrite d6/d9/db/d34/d38/d3f/f42 [0,4194304] 0 2024-04-26T10:44:28.931 INFO:tasks.workunit.client.0.smithi049.stdout:9/307: dread - d2/d1a/d42/f61 zero size 2024-04-26T10:44:28.934 INFO:tasks.workunit.client.0.smithi049.stdout:6/224: write da/dd/de/f18 [609674,20624] 0 2024-04-26T10:44:28.935 INFO:tasks.workunit.client.0.smithi049.stdout:2/245: dread - d6/d9/db/d11/f43 zero size 2024-04-26T10:44:28.936 INFO:tasks.workunit.client.0.smithi049.stdout:4/290: dwrite de/d20/f35 [0,4194304] 0 2024-04-26T10:44:28.936 INFO:tasks.workunit.client.0.smithi049.stdout:0/218: dwrite d8/d1e/f2a [0,4194304] 0 2024-04-26T10:44:28.936 INFO:tasks.workunit.client.0.smithi049.stdout:9/308: chown d2/d1a/l15 0 1 2024-04-26T10:44:28.939 INFO:tasks.workunit.client.0.smithi049.stdout:7/269: dwrite d2/dd/d25/d27/f30 [0,4194304] 0 2024-04-26T10:44:28.939 INFO:tasks.workunit.client.0.smithi049.stdout:4/291: unlink de/d20/f28 0 2024-04-26T10:44:28.940 INFO:tasks.workunit.client.0.smithi049.stdout:9/309: mkdir d2/d1a/d1b/d1f/d64 0 2024-04-26T10:44:28.940 INFO:tasks.workunit.client.0.smithi049.stdout:0/219: mkdir d8/db/d11/d1b/d4d 0 2024-04-26T10:44:28.940 INFO:tasks.workunit.client.0.smithi049.stdout:6/225: write da/f38 [664622,62524] 0 2024-04-26T10:44:28.941 INFO:tasks.workunit.client.0.smithi049.stdout:1/256: dread d1e/d20/d26/d3c/f3d [0,4194304] 0 2024-04-26T10:44:28.942 INFO:tasks.workunit.client.0.smithi049.stdout:2/246: write d6/d9/db/d1e/f2a [884678,60630] 0 2024-04-26T10:44:28.942 INFO:tasks.workunit.client.0.smithi049.stdout:4/292: fdatasync de/d20/d38/f45 0 2024-04-26T10:44:28.942 INFO:tasks.workunit.client.0.smithi049.stdout:1/257: creat d1e/d20/d26/d37/f4e x:0 0 0 2024-04-26T10:44:28.943 INFO:tasks.workunit.client.0.smithi049.stdout:8/250: dwrite d2/d1a/f22 [0,4194304] 0 2024-04-26T10:44:28.944 INFO:tasks.workunit.client.0.smithi049.stdout:0/220: unlink d8/db/d11/d1b/l2c 0 2024-04-26T10:44:28.944 INFO:tasks.workunit.client.0.smithi049.stdout:6/226: write da/dd/de/d26/d29/f31 [6042418,86063] 0 2024-04-26T10:44:28.944 INFO:tasks.workunit.client.0.smithi049.stdout:4/293: mkdir de/d1b/d55 0 2024-04-26T10:44:28.945 INFO:tasks.workunit.client.0.smithi049.stdout:2/247: fdatasync d6/d9/db/f13 0 2024-04-26T10:44:28.945 INFO:tasks.workunit.client.0.smithi049.stdout:9/310: rename d2/d1a/d1b/d1f/l4f to d2/d1a/d1b/d1f/d34/l65 0 2024-04-26T10:44:28.946 INFO:tasks.workunit.client.0.smithi049.stdout:8/251: unlink d2/f46 0 2024-04-26T10:44:28.946 INFO:tasks.workunit.client.0.smithi049.stdout:0/221: creat d8/d1e/f4e x:0 0 0 2024-04-26T10:44:28.946 INFO:tasks.workunit.client.0.smithi049.stdout:6/227: write f8 [2326607,57244] 0 2024-04-26T10:44:28.946 INFO:tasks.workunit.client.0.smithi049.stdout:1/258: creat d1e/d20/d26/d3c/f4f x:0 0 0 2024-04-26T10:44:28.947 INFO:tasks.workunit.client.0.smithi049.stdout:1/259: stat fa 0 2024-04-26T10:44:28.948 INFO:tasks.workunit.client.0.smithi049.stdout:7/270: dwrite d2/fc [0,4194304] 0 2024-04-26T10:44:28.949 INFO:tasks.workunit.client.0.smithi049.stdout:6/228: fdatasync da/dd/de/f18 0 2024-04-26T10:44:28.949 INFO:tasks.workunit.client.0.smithi049.stdout:0/222: fdatasync d8/db/d26/f38 0 2024-04-26T10:44:28.950 INFO:tasks.workunit.client.0.smithi049.stdout:8/252: symlink d2/df/d18/l4c 0 2024-04-26T10:44:28.950 INFO:tasks.workunit.client.0.smithi049.stdout:2/248: write d6/d9/db/d11/f1d [533699,54633] 0 2024-04-26T10:44:28.952 INFO:tasks.workunit.client.0.smithi049.stdout:6/229: mkdir da/dd/d47 0 2024-04-26T10:44:28.954 INFO:tasks.workunit.client.0.smithi049.stdout:5/271: sync 2024-04-26T10:44:28.954 INFO:tasks.workunit.client.0.smithi049.stdout:0/223: sync 2024-04-26T10:44:28.954 INFO:tasks.workunit.client.0.smithi049.stdout:4/294: dread de/f27 [0,4194304] 0 2024-04-26T10:44:28.955 INFO:tasks.workunit.client.0.smithi049.stdout:6/230: readlink da/dd/de/d42/l44 0 2024-04-26T10:44:28.956 INFO:tasks.workunit.client.0.smithi049.stdout:5/272: rename d7/f26 to d7/f74 0 2024-04-26T10:44:28.957 INFO:tasks.workunit.client.0.smithi049.stdout:7/271: write d2/dd/d38/f3d [639173,17045] 0 2024-04-26T10:44:28.958 INFO:tasks.workunit.client.0.smithi049.stdout:4/295: fsync de/d20/d38/f3b 0 2024-04-26T10:44:28.958 INFO:tasks.workunit.client.0.smithi049.stdout:0/224: rename l7 to d8/db/d26/d39/l4f 0 2024-04-26T10:44:28.958 INFO:tasks.workunit.client.0.smithi049.stdout:5/273: readlink d7/l12 0 2024-04-26T10:44:28.960 INFO:tasks.workunit.client.0.smithi049.stdout:9/311: dwrite d2/d1a/df/f30 [0,4194304] 0 2024-04-26T10:44:28.961 INFO:tasks.workunit.client.0.smithi049.stdout:1/260: dwrite d1e/f3b [0,4194304] 0 2024-04-26T10:44:28.966 INFO:tasks.workunit.client.0.smithi049.stdout:6/231: creat da/dd/d47/f48 x:0 0 0 2024-04-26T10:44:28.967 INFO:tasks.workunit.client.0.smithi049.stdout:7/272: symlink d2/dd/d25/l5b 0 2024-04-26T10:44:28.967 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:28.967 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:28.968 INFO:tasks.workunit.client.0.smithi049.stdout:8/253: dwrite d2/f1b [0,4194304] 0 2024-04-26T10:44:28.968 INFO:tasks.workunit.client.0.smithi049.stdout:0/225: creat d8/db/d11/d1c/f50 x:0 0 0 2024-04-26T10:44:28.968 INFO:tasks.workunit.client.0.smithi049.stdout:4/296: mkdir de/d3f/d48/d56 0 2024-04-26T10:44:28.968 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:28.971 INFO:tasks.workunit.client.0.smithi049.stdout:4/297: fdatasync f8 0 2024-04-26T10:44:28.971 INFO:tasks.workunit.client.0.smithi049.stdout:2/249: dwrite d6/f3b [0,4194304] 0 2024-04-26T10:44:28.971 INFO:tasks.workunit.client.0.smithi049.stdout:5/274: creat d7/d1d/d1f/d4e/d65/f75 x:0 0 0 2024-04-26T10:44:28.971 INFO:tasks.workunit.client.0.smithi049.stdout:1/261: creat d1e/f50 x:0 0 0 2024-04-26T10:44:28.972 INFO:tasks.workunit.client.0.smithi049.stdout:6/232: creat da/dd/d47/f49 x:0 0 0 2024-04-26T10:44:28.972 INFO:tasks.workunit.client.0.smithi049.stdout:7/273: mkdir d2/dd/d48/d5c 0 2024-04-26T10:44:28.972 INFO:tasks.workunit.client.0.smithi049.stdout:8/254: stat d2/df/d10/l3c 0 2024-04-26T10:44:28.972 INFO:tasks.workunit.client.0.smithi049.stdout:6/233: rename da/dd/de/d26/d22/d2d to da/d4a 0 2024-04-26T10:44:28.972 INFO:tasks.workunit.client.0.smithi049.stdout:4/298: symlink de/d1b/l57 0 2024-04-26T10:44:28.972 INFO:tasks.workunit.client.0.smithi049.stdout:8/255: creat d2/d16/d19/f4d x:0 0 0 2024-04-26T10:44:28.972 INFO:tasks.workunit.client.0.smithi049.stdout:0/226: link d8/db/l3e d8/db/d26/d39/l51 0 2024-04-26T10:44:28.972 INFO:tasks.workunit.client.0.smithi049.stdout:5/275: link d7/d14/d18/c68 d7/d1d/d1f/d4e/d65/d6f/c76 0 2024-04-26T10:44:28.972 INFO:tasks.workunit.client.0.smithi049.stdout:8/256: creat d2/d16/d19/d42/f4e x:0 0 0 2024-04-26T10:44:28.972 INFO:tasks.workunit.client.0.smithi049.stdout:6/234: creat da/dd/de/d26/d27/f4b x:0 0 0 2024-04-26T10:44:28.972 INFO:tasks.workunit.client.0.smithi049.stdout:0/227: creat d8/f52 x:0 0 0 2024-04-26T10:44:28.972 INFO:tasks.workunit.client.0.smithi049.stdout:9/312: read d2/d1a/d1b/d1f/f43 [2853423,100767] 0 2024-04-26T10:44:28.972 INFO:tasks.workunit.client.0.smithi049.stdout:5/276: mkdir d7/d1d/d1f/d4e/d77 0 2024-04-26T10:44:28.973 INFO:tasks.workunit.client.0.smithi049.stdout:6/235: readlink da/dd/de/d26/l40 0 2024-04-26T10:44:28.973 INFO:tasks.workunit.client.0.smithi049.stdout:8/257: symlink d2/df/d18/d2a/l4f 0 2024-04-26T10:44:28.975 INFO:tasks.workunit.client.0.smithi049.stdout:6/236: readlink da/dd/de/d42/l44 0 2024-04-26T10:44:28.976 INFO:tasks.workunit.client.0.smithi049.stdout:7/274: dwrite d2/f1b [0,4194304] 0 2024-04-26T10:44:28.978 INFO:tasks.workunit.client.0.smithi049.stdout:8/258: write d2/d17/f38 [675212,12264] 0 2024-04-26T10:44:28.978 INFO:tasks.workunit.client.0.smithi049.stdout:9/313: rename d2/d1a/d1b/d1f/d34/d54 to d2/d1a/d66 0 2024-04-26T10:44:28.978 INFO:tasks.workunit.client.0.smithi049.stdout:4/299: dwrite f7 [0,4194304] 0 2024-04-26T10:44:28.979 INFO:tasks.workunit.client.0.smithi049.stdout:1/262: dread d1e/d20/d26/f30 [0,4194304] 0 2024-04-26T10:44:28.980 INFO:tasks.workunit.client.0.smithi049.stdout:8/259: write d2/f12 [4091932,35698] 0 2024-04-26T10:44:28.980 INFO:tasks.workunit.client.0.smithi049.stdout:6/237: write da/dd/f41 [1295675,68427] 0 2024-04-26T10:44:28.980 INFO:tasks.workunit.client.0.smithi049.stdout:3/225: dread d3/d19/d8/f9 [4194304,4194304] 0 2024-04-26T10:44:28.980 INFO:tasks.workunit.client.0.smithi049.stdout:7/275: mkdir d2/dd/d38/d5d 0 2024-04-26T10:44:28.981 INFO:tasks.workunit.client.0.smithi049.stdout:4/300: chown de/d20/d24/l3d 39051 1 2024-04-26T10:44:28.981 INFO:tasks.workunit.client.0.smithi049.stdout:1/263: chown d1e/d20/l23 1 1 2024-04-26T10:44:28.981 INFO:tasks.workunit.client.0.smithi049.stdout:8/260: mkdir d2/d1a/d50 0 2024-04-26T10:44:28.982 INFO:tasks.workunit.client.0.smithi049.stdout:4/301: chown de/l1a 3 1 2024-04-26T10:44:28.983 INFO:tasks.workunit.client.0.smithi049.stdout:5/277: dwrite d7/d1d/d1f/d4e/d65/f75 [0,4194304] 0 2024-04-26T10:44:28.983 INFO:tasks.workunit.client.0.smithi049.stdout:3/226: rename d3/d6/d21 to d3/d19/d22/d46/d4e 0 2024-04-26T10:44:28.984 INFO:tasks.workunit.client.0.smithi049.stdout:7/276: readlink d2/d3/l8 0 2024-04-26T10:44:28.986 INFO:tasks.workunit.client.0.smithi049.stdout:7/277: stat d2/d3/f34 0 2024-04-26T10:44:28.986 INFO:tasks.workunit.client.0.smithi049.stdout:1/264: write d1e/f3b [1949476,13055] 0 2024-04-26T10:44:28.990 INFO:tasks.workunit.client.0.smithi049.stdout:1/265: write d1e/f44 [599998,95085] 0 2024-04-26T10:44:28.991 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:28.989+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:28.992 INFO:tasks.workunit.client.0.smithi049.stdout:6/238: dwrite da/dd/de/d26/d29/f31 [4194304,4194304] 0 2024-04-26T10:44:28.992 INFO:tasks.workunit.client.0.smithi049.stdout:3/227: write d3/d19/d22/d46/d4e/f3f [1402845,21213] 0 2024-04-26T10:44:28.992 INFO:tasks.workunit.client.0.smithi049.stdout:5/278: truncate d7/d1d/f27 7008664 0 2024-04-26T10:44:28.992 INFO:tasks.workunit.client.0.smithi049.stdout:1/266: creat d1e/d20/d26/f51 x:0 0 0 2024-04-26T10:44:28.992 INFO:tasks.workunit.client.0.smithi049.stdout:8/261: dwrite d2/df/f36 [0,4194304] 0 2024-04-26T10:44:28.994 INFO:tasks.workunit.client.0.smithi049.stdout:4/302: dwrite de/d1b/f34 [4194304,4194304] 0 2024-04-26T10:44:28.996 INFO:tasks.workunit.client.0.smithi049.stdout:5/279: creat d7/d53/f78 x:0 0 0 2024-04-26T10:44:28.998 INFO:tasks.workunit.client.0.smithi049.stdout:1/267: chown d1e/d20/d26/l2b 448 1 2024-04-26T10:44:28.998 INFO:tasks.workunit.client.0.smithi049.stdout:3/228: truncate d3/d19/d8/f49 408344 0 2024-04-26T10:44:28.998 INFO:tasks.workunit.client.0.smithi049.stdout:6/239: mkdir da/dd/de/d26/d22/d4c 0 2024-04-26T10:44:28.998 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:28.999 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:29.000 INFO:tasks.workunit.client.0.smithi049.stdout:7/278: dwrite d2/f1b [0,4194304] 0 2024-04-26T10:44:29.000 INFO:tasks.workunit.client.0.smithi049.stdout:3/229: readlink d3/l38 0 2024-04-26T10:44:29.000 INFO:tasks.workunit.client.0.smithi049.stdout:6/240: fdatasync da/dd/f1d 0 2024-04-26T10:44:29.000 INFO:tasks.workunit.client.0.smithi049.stdout:1/268: link cf d1e/d20/c52 0 2024-04-26T10:44:29.000 INFO:tasks.workunit.client.0.smithi049.stdout:7/279: read - d2/dd/d48/f59 zero size 2024-04-26T10:44:29.000 INFO:tasks.workunit.client.0.smithi049.stdout:6/241: rename da to da/dd/de/d26/d29/d4d 22 2024-04-26T10:44:29.000 INFO:tasks.workunit.client.0.smithi049.stdout:3/230: dread d3/f40 [0,4194304] 0 2024-04-26T10:44:29.001 INFO:tasks.workunit.client.0.smithi049.stdout:1/269: creat d1e/d20/d4d/f53 x:0 0 0 2024-04-26T10:44:29.001 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:29.002 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:29.002 INFO:tasks.workunit.client.0.smithi049.stdout:6/242: unlink da/dd/de/d26/d29/l3b 0 2024-04-26T10:44:29.003 INFO:tasks.workunit.client.0.smithi049.stdout:3/231: mknod d3/d19/d8/c4f 0 2024-04-26T10:44:29.003 INFO:tasks.workunit.client.0.smithi049.stdout:5/280: truncate d7/d14/d18/d2b/f4b 211105 0 2024-04-26T10:44:29.003 INFO:tasks.workunit.client.0.smithi049.stdout:1/270: mkdir d1e/d20/d26/d3c/d54 0 2024-04-26T10:44:29.003 INFO:tasks.workunit.client.0.smithi049.stdout:2/250: sync 2024-04-26T10:44:29.003 INFO:tasks.workunit.client.0.smithi049.stdout:3/232: symlink d3/d19/d8/l50 0 2024-04-26T10:44:29.003 INFO:tasks.workunit.client.0.smithi049.stdout:9/314: sync 2024-04-26T10:44:29.004 INFO:tasks.workunit.client.0.smithi049.stdout:3/233: creat d3/d19/d8/d34/f51 x:0 0 0 2024-04-26T10:44:29.004 INFO:tasks.workunit.client.0.smithi049.stdout:1/271: truncate d1e/f1f 578012 0 2024-04-26T10:44:29.004 INFO:tasks.workunit.client.0.smithi049.stdout:2/251: chown d6/d9/db/d34/d38/d3f/f40 614930 1 2024-04-26T10:44:29.004 INFO:tasks.workunit.client.0.smithi049.stdout:9/315: write d2/d1a/df/f30 [5201580,50600] 0 2024-04-26T10:44:29.006 INFO:tasks.workunit.client.0.smithi049.stdout:3/234: link d3/d19/d22/d46/d4e/c4d d3/d19/d8/c52 0 2024-04-26T10:44:29.007 INFO:tasks.workunit.client.0.smithi049.stdout:7/280: dread d2/dd/f12 [0,4194304] 0 2024-04-26T10:44:29.008 INFO:tasks.workunit.client.0.smithi049.stdout:5/281: dwrite d7/d1d/d34/d37/d3e/d60/f72 [0,4194304] 0 2024-04-26T10:44:29.010 INFO:tasks.workunit.client.0.smithi049.stdout:2/252: write d6/d9/fc [42644,109551] 0 2024-04-26T10:44:29.010 INFO:tasks.workunit.client.0.smithi049.stdout:7/281: dread d2/dd/d25/f31 [0,4194304] 0 2024-04-26T10:44:29.011 INFO:tasks.workunit.client.0.smithi049.stdout:7/282: symlink d2/dd/d25/l5e 0 2024-04-26T10:44:29.011 INFO:tasks.workunit.client.0.smithi049.stdout:2/253: write d6/d9/db/f24 [1807960,66209] 0 2024-04-26T10:44:29.011 INFO:tasks.workunit.client.0.smithi049.stdout:3/235: dread d3/d23/d2f/f3c [0,4194304] 0 2024-04-26T10:44:29.013 INFO:tasks.workunit.client.0.smithi049.stdout:3/236: creat d3/d19/d22/d46/f53 x:0 0 0 2024-04-26T10:44:29.014 INFO:tasks.workunit.client.0.smithi049.stdout:7/283: creat d2/dd/d48/d5c/f5f x:0 0 0 2024-04-26T10:44:29.014 INFO:tasks.workunit.client.0.smithi049.stdout:3/237: write d3/d19/d26/d29/f3e [1461013,28817] 0 2024-04-26T10:44:29.015 INFO:tasks.workunit.client.0.smithi049.stdout:7/284: symlink d2/dd/d25/d27/l60 0 2024-04-26T10:44:29.015 INFO:tasks.workunit.client.0.smithi049.stdout:3/238: write d3/d6/f42 [2231686,63344] 0 2024-04-26T10:44:29.016 INFO:tasks.workunit.client.0.smithi049.stdout:5/282: dwrite f3 [0,4194304] 0 2024-04-26T10:44:29.017 INFO:tasks.workunit.client.0.smithi049.stdout:5/283: creat d7/d1d/d34/f79 x:0 0 0 2024-04-26T10:44:29.018 INFO:tasks.workunit.client.0.smithi049.stdout:5/284: write d7/d1d/d1f/d4e/d65/f75 [4535932,12757] 0 2024-04-26T10:44:29.023 INFO:tasks.workunit.client.0.smithi049.stdout:0/228: dread d8/db/d26/f38 [0,4194304] 0 2024-04-26T10:44:29.024 INFO:tasks.workunit.client.0.smithi049.stdout:5/285: dwrite d7/d53/f78 [0,4194304] 0 2024-04-26T10:44:29.024 INFO:tasks.workunit.client.0.smithi049.stdout:0/229: chown d8/db/c45 84175 1 2024-04-26T10:44:29.027 INFO:tasks.workunit.client.0.smithi049.stdout:4/303: dread de/d20/f22 [0,4194304] 0 2024-04-26T10:44:29.028 INFO:tasks.workunit.client.0.smithi049.stdout:3/239: dread d3/d19/d22/d2e/f31 [0,4194304] 0 2024-04-26T10:44:29.028 INFO:tasks.workunit.client.0.smithi049.stdout:4/304: unlink cd 0 2024-04-26T10:44:29.028 INFO:tasks.workunit.client.0.smithi049.stdout:5/286: truncate d7/d1d/d1f/d4e/d65/f75 4107871 0 2024-04-26T10:44:29.029 INFO:tasks.workunit.client.0.smithi049.stdout:1/272: dread d1e/d20/f4a [0,4194304] 0 2024-04-26T10:44:29.030 INFO:tasks.workunit.client.0.smithi049.stdout:5/287: fsync d7/d14/d18/d2b/f4b 0 2024-04-26T10:44:29.030 INFO:tasks.workunit.client.0.smithi049.stdout:3/240: link d3/d19/d22/d2e/l3d d3/d19/d26/d29/l54 0 2024-04-26T10:44:29.031 INFO:tasks.workunit.client.0.smithi049.stdout:5/288: write d7/d1d/d34/f79 [866649,64607] 0 2024-04-26T10:44:29.032 INFO:tasks.workunit.client.0.smithi049.stdout:3/241: getdents d3/d19/d26 0 2024-04-26T10:44:29.033 INFO:tasks.workunit.client.0.smithi049.stdout:1/273: truncate fd 8176061 0 2024-04-26T10:44:29.033 INFO:tasks.workunit.client.0.smithi049.stdout:4/305: dwrite de/f54 [0,4194304] 0 2024-04-26T10:44:29.033 INFO:tasks.workunit.client.0.smithi049.stdout:5/289: fdatasync d7/d1d/d1f/f29 0 2024-04-26T10:44:29.034 INFO:tasks.workunit.client.0.smithi049.stdout:3/242: rename d3/d19/d22 to d3/d19/d8/d55 0 2024-04-26T10:44:29.035 INFO:tasks.workunit.client.0.smithi049.stdout:4/306: creat de/d20/d38/f58 x:0 0 0 2024-04-26T10:44:29.035 INFO:tasks.workunit.client.0.smithi049.stdout:7/285: dread d2/dd/d38/f4c [0,4194304] 0 2024-04-26T10:44:29.035 INFO:tasks.workunit.client.0.smithi049.stdout:5/290: creat d7/d1d/d34/d37/d3e/d60/f7a x:0 0 0 2024-04-26T10:44:29.038 INFO:tasks.workunit.client.0.smithi049.stdout:3/243: fsync d3/d19/d8/d55/d2e/f31 0 2024-04-26T10:44:29.038 INFO:tasks.workunit.client.0.smithi049.stdout:5/291: mkdir d7/d1d/d34/d37/d3e/d7b 0 2024-04-26T10:44:29.038 INFO:tasks.workunit.client.0.smithi049.stdout:7/286: creat d2/d3/de/d1c/f61 x:0 0 0 2024-04-26T10:44:29.039 INFO:tasks.workunit.client.0.smithi049.stdout:1/274: getdents d1e/d20/d26/d3c 0 2024-04-26T10:44:29.039 INFO:tasks.workunit.client.0.smithi049.stdout:4/307: rmdir de/d3f/d48/d56 0 2024-04-26T10:44:29.040 INFO:tasks.workunit.client.0.smithi049.stdout:1/275: stat d1e/d20/d26 0 2024-04-26T10:44:29.040 INFO:tasks.workunit.client.0.smithi049.stdout:7/287: fdatasync d2/f22 0 2024-04-26T10:44:29.040 INFO:tasks.workunit.client.0.smithi049.stdout:4/308: fsync de/d1b/f1c 0 2024-04-26T10:44:29.041 INFO:tasks.workunit.client.0.smithi049.stdout:3/244: write d3/d19/d8/f9 [8334792,123019] 0 2024-04-26T10:44:29.041 INFO:tasks.workunit.client.0.smithi049.stdout:7/288: dread - d2/dd/d48/f59 zero size 2024-04-26T10:44:29.041 INFO:tasks.workunit.client.0.smithi049.stdout:1/276: symlink d1e/d20/d26/l55 0 2024-04-26T10:44:29.042 INFO:tasks.workunit.client.0.smithi049.stdout:4/309: rmdir de/d1b/d55 0 2024-04-26T10:44:29.043 INFO:tasks.workunit.client.0.smithi049.stdout:7/289: write d2/dd/d25/f31 [51035,113626] 0 2024-04-26T10:44:29.043 INFO:tasks.workunit.client.0.smithi049.stdout:3/245: link d3/d19/d26/f41 d3/f56 0 2024-04-26T10:44:29.043 INFO:tasks.workunit.client.0.smithi049.stdout:4/310: stat de/d3f/d52 0 2024-04-26T10:44:29.043 INFO:tasks.workunit.client.0.smithi049.stdout:4/311: creat de/d1d/f59 x:0 0 0 2024-04-26T10:44:29.045 INFO:tasks.workunit.client.0.smithi049.stdout:8/262: dread f1 [0,4194304] 0 2024-04-26T10:44:29.046 INFO:tasks.workunit.client.0.smithi049.stdout:8/263: chown d2/d17/d34 253918 1 2024-04-26T10:44:29.046 INFO:tasks.workunit.client.0.smithi049.stdout:4/312: dread de/d20/d24/f32 [0,4194304] 0 2024-04-26T10:44:29.046 INFO:tasks.workunit.client.0.smithi049.stdout:7/290: rmdir d2/d3 39 2024-04-26T10:44:29.047 INFO:tasks.workunit.client.0.smithi049.stdout:8/264: fdatasync f1 0 2024-04-26T10:44:29.048 INFO:tasks.workunit.client.0.smithi049.stdout:7/291: creat d2/dd/d48/d5c/f62 x:0 0 0 2024-04-26T10:44:29.048 INFO:tasks.workunit.client.0.smithi049.stdout:6/243: dread da/f19 [0,4194304] 0 2024-04-26T10:44:29.048 INFO:tasks.workunit.client.0.smithi049.stdout:8/265: mknod d2/df/d10/c51 0 2024-04-26T10:44:29.048 INFO:tasks.workunit.client.0.smithi049.stdout:3/246: creat d3/d19/d8/f57 x:0 0 0 2024-04-26T10:44:29.048 INFO:tasks.workunit.client.0.smithi049.stdout:4/313: getdents de/d3f 0 2024-04-26T10:44:29.049 INFO:tasks.workunit.client.0.smithi049.stdout:6/244: creat da/dd/de/f4e x:0 0 0 2024-04-26T10:44:29.049 INFO:tasks.workunit.client.0.smithi049.stdout:9/316: dread d2/d1a/d1b/f16 [4194304,4194304] 0 2024-04-26T10:44:29.050 INFO:tasks.workunit.client.0.smithi049.stdout:3/247: write d3/d6/f10 [1664248,119263] 0 2024-04-26T10:44:29.051 INFO:tasks.workunit.client.0.smithi049.stdout:9/317: write d2/f3c [1478475,60035] 0 2024-04-26T10:44:29.051 INFO:tasks.workunit.client.0.smithi049.stdout:3/248: mkdir d3/d19/d26/d58 0 2024-04-26T10:44:29.052 INFO:tasks.workunit.client.0.smithi049.stdout:9/318: stat d2/d1a/d42 0 2024-04-26T10:44:29.053 INFO:tasks.workunit.client.0.smithi049.stdout:3/249: write d3/d19/d8/f57 [940866,31915] 0 2024-04-26T10:44:29.054 INFO:tasks.workunit.client.0.smithi049.stdout:9/319: rename d2/d1a/f21 to d2/d1a/d42/f67 0 2024-04-26T10:44:29.055 INFO:tasks.workunit.client.0.smithi049.stdout:3/250: readlink d3/d19/d8/d55/d46/d4e/l1d 0 2024-04-26T10:44:29.055 INFO:tasks.workunit.client.0.smithi049.stdout:9/320: fsync d2/d25/f3e 0 2024-04-26T10:44:29.056 INFO:tasks.workunit.client.0.smithi049.stdout:6/245: dwrite da/fc [0,4194304] 0 2024-04-26T10:44:29.059 INFO:tasks.workunit.client.0.smithi049.stdout:4/314: dwrite de/d20/f2e [0,4194304] 0 2024-04-26T10:44:29.059 INFO:tasks.workunit.client.0.smithi049.stdout:2/254: dread d6/d9/db/f1c [0,4194304] 0 2024-04-26T10:44:29.059 INFO:tasks.workunit.client.0.smithi049.stdout:3/251: link d3/d19/c47 d3/d19/d26/c59 0 2024-04-26T10:44:29.059 INFO:tasks.workunit.client.0.smithi049.stdout:6/246: mknod da/dd/de/d26/c4f 0 2024-04-26T10:44:29.059 INFO:tasks.workunit.client.0.smithi049.stdout:6/247: stat da/dd/de/d26/d22/d4c 0 2024-04-26T10:44:29.059 INFO:tasks.workunit.client.0.smithi049.stdout:3/252: creat d3/d19/d26/f5a x:0 0 0 2024-04-26T10:44:29.059 INFO:tasks.workunit.client.0.smithi049.stdout:4/315: unlink de/c42 0 2024-04-26T10:44:29.059 INFO:tasks.workunit.client.0.smithi049.stdout:4/316: chown lb 2 1 2024-04-26T10:44:29.060 INFO:tasks.workunit.client.0.smithi049.stdout:6/248: getdents da/dd/de/d42 0 2024-04-26T10:44:29.060 INFO:tasks.workunit.client.0.smithi049.stdout:3/253: link d3/d19/c15 d3/d19/d26/d29/c5b 0 2024-04-26T10:44:29.061 INFO:tasks.workunit.client.0.smithi049.stdout:4/317: readlink de/l43 0 2024-04-26T10:44:29.062 INFO:tasks.workunit.client.0.smithi049.stdout:7/292: dread d2/f33 [0,4194304] 0 2024-04-26T10:44:29.062 INFO:tasks.workunit.client.0.smithi049.stdout:4/318: fsync f9 0 2024-04-26T10:44:29.062 INFO:tasks.workunit.client.0.smithi049.stdout:9/321: dread d2/d1a/d1b/d1f/f39 [0,4194304] 0 2024-04-26T10:44:29.063 INFO:tasks.workunit.client.0.smithi049.stdout:4/319: mknod de/d1b/c5a 0 2024-04-26T10:44:29.063 INFO:tasks.workunit.client.0.smithi049.stdout:9/322: symlink d2/d25/d60/l68 0 2024-04-26T10:44:29.063 INFO:tasks.workunit.client.0.smithi049.stdout:2/255: dwrite d6/d9/db/df/f12 [4194304,4194304] 0 2024-04-26T10:44:29.064 INFO:tasks.workunit.client.0.smithi049.stdout:4/320: truncate de/d1d/f59 264266 0 2024-04-26T10:44:29.064 INFO:tasks.workunit.client.0.smithi049.stdout:9/323: mknod d2/d1a/df/c69 0 2024-04-26T10:44:29.064 INFO:tasks.workunit.client.0.smithi049.stdout:2/256: read d6/d9/db/f1c [3578040,6801] 0 2024-04-26T10:44:29.065 INFO:tasks.workunit.client.0.smithi049.stdout:9/324: readlink d2/d25/l33 0 2024-04-26T10:44:29.065 INFO:tasks.workunit.client.0.smithi049.stdout:6/249: dread da/fc [0,4194304] 0 2024-04-26T10:44:29.065 INFO:tasks.workunit.client.0.smithi049.stdout:4/321: rename de/d20/d24/l4c to de/d1d/l5b 0 2024-04-26T10:44:29.066 INFO:tasks.workunit.client.0.smithi049.stdout:6/250: dread - da/dd/f1e zero size 2024-04-26T10:44:29.066 INFO:tasks.workunit.client.0.smithi049.stdout:9/325: fdatasync d2/d1a/d1b/f16 0 2024-04-26T10:44:29.066 INFO:tasks.workunit.client.0.smithi049.stdout:2/257: creat d6/d9/db/d34/d38/d3f/f45 x:0 0 0 2024-04-26T10:44:29.066 INFO:tasks.workunit.client.0.smithi049.stdout:2/258: chown d6 0 1 2024-04-26T10:44:29.067 INFO:tasks.workunit.client.0.smithi049.stdout:9/326: mknod d2/d40/c6a 0 2024-04-26T10:44:29.067 INFO:tasks.workunit.client.0.smithi049.stdout:2/259: write d6/d9/f19 [2284890,71345] 0 2024-04-26T10:44:29.067 INFO:tasks.workunit.client.0.smithi049.stdout:6/251: rename da/dd/de/d26/c21 to da/dd/de/d26/d29/c50 0 2024-04-26T10:44:29.068 INFO:tasks.workunit.client.0.smithi049.stdout:9/327: write d2/d1a/f45 [4499544,90214] 0 2024-04-26T10:44:29.068 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:29.068 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:29.068 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:29.068 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:29.069 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:29.069 INFO:tasks.workunit.client.0.smithi049.stdout:2/260: rename d6/d30 to d6/d30/d46 22 2024-04-26T10:44:29.069 INFO:tasks.workunit.client.0.smithi049.stdout:9/328: readlink d2/d25/l33 0 2024-04-26T10:44:29.069 INFO:tasks.workunit.client.0.smithi049.stdout:9/329: creat d2/d25/f6b x:0 0 0 2024-04-26T10:44:29.069 INFO:tasks.workunit.client.0.smithi049.stdout:0/230: sync 2024-04-26T10:44:29.069 INFO:tasks.workunit.client.0.smithi049.stdout:2/261: mknod d6/d9/c47 0 2024-04-26T10:44:29.070 INFO:tasks.workunit.client.0.smithi049.stdout:6/252: link da/dd/f1d da/dd/de/d26/d27/f51 0 2024-04-26T10:44:29.070 INFO:tasks.workunit.client.0.smithi049.stdout:4/322: truncate de/f54 3148314 0 2024-04-26T10:44:29.070 INFO:tasks.workunit.client.0.smithi049.stdout:0/231: stat d8/db/d26/f2d 0 2024-04-26T10:44:29.070 INFO:tasks.workunit.client.0.smithi049.stdout:9/330: write d2/d25/f6b [770134,89772] 0 2024-04-26T10:44:29.070 INFO:tasks.workunit.client.0.smithi049.stdout:2/262: chown d6/d9/db/d34/d38/d3f 3394 1 2024-04-26T10:44:29.071 INFO:tasks.workunit.client.0.smithi049.stdout:0/232: dread - d8/db/f33 zero size 2024-04-26T10:44:29.071 INFO:tasks.workunit.client.0.smithi049.stdout:9/331: rmdir d2/d1a/d1b 39 2024-04-26T10:44:29.071 INFO:tasks.workunit.client.0.smithi049.stdout:4/323: mkdir de/d20/d24/d5c 0 2024-04-26T10:44:29.071 INFO:tasks.workunit.client.0.smithi049.stdout:6/253: rename da/dd/f1d to da/dd/de/d26/d29/f52 0 2024-04-26T10:44:29.072 INFO:tasks.workunit.client.0.smithi049.stdout:0/233: symlink d8/db/d26/d39/l53 0 2024-04-26T10:44:29.072 INFO:tasks.workunit.client.0.smithi049.stdout:9/332: creat d2/d1a/d66/f6c x:0 0 0 2024-04-26T10:44:29.072 INFO:tasks.workunit.client.0.smithi049.stdout:4/324: write de/d1d/f59 [741874,110936] 0 2024-04-26T10:44:29.073 INFO:tasks.workunit.client.0.smithi049.stdout:2/263: truncate d6/d9/db/d34/d38/d3f/f45 848280 0 2024-04-26T10:44:29.073 INFO:tasks.workunit.client.0.smithi049.stdout:0/234: creat d8/d42/f54 x:0 0 0 2024-04-26T10:44:29.073 INFO:tasks.workunit.client.0.smithi049.stdout:2/264: write d6/d32/f3a [3877208,7461] 0 2024-04-26T10:44:29.074 INFO:tasks.workunit.client.0.smithi049.stdout:4/325: creat de/d3f/f5d x:0 0 0 2024-04-26T10:44:29.074 INFO:tasks.workunit.client.0.smithi049.stdout:9/333: mkdir d2/d1a/d1b/d1f/d34/d6d 0 2024-04-26T10:44:29.074 INFO:tasks.workunit.client.0.smithi049.stdout:0/235: mknod d8/db/d26/d39/c55 0 2024-04-26T10:44:29.075 INFO:tasks.workunit.client.0.smithi049.stdout:9/334: write d2/d1a/f45 [4841673,69577] 0 2024-04-26T10:44:29.075 INFO:tasks.workunit.client.0.smithi049.stdout:6/254: dread f1 [0,4194304] 0 2024-04-26T10:44:29.075 INFO:tasks.workunit.client.0.smithi049.stdout:4/326: read de/d1b/f40 [1387382,54831] 0 2024-04-26T10:44:29.075 INFO:tasks.workunit.client.0.smithi049.stdout:2/265: getdents d6/d9/db/d34/d38 0 2024-04-26T10:44:29.076 INFO:tasks.workunit.client.0.smithi049.stdout:4/327: chown f9 202227 1 2024-04-26T10:44:29.076 INFO:tasks.workunit.client.0.smithi049.stdout:9/335: write d2/d1a/d1b/f24 [4202368,109467] 0 2024-04-26T10:44:29.076 INFO:tasks.workunit.client.0.smithi049.stdout:2/266: stat d6/d9/db/df/l23 0 2024-04-26T10:44:29.076 INFO:tasks.workunit.client.0.smithi049.stdout:6/255: creat da/dd/de/d26/d22/d4c/f53 x:0 0 0 2024-04-26T10:44:29.077 INFO:tasks.workunit.client.0.smithi049.stdout:9/336: readlink d2/d1a/d1b/d1f/l51 0 2024-04-26T10:44:29.077 INFO:tasks.workunit.client.0.smithi049.stdout:0/236: write d8/f9 [2043465,39730] 0 2024-04-26T10:44:29.078 INFO:tasks.workunit.client.0.smithi049.stdout:9/337: fsync d2/d1a/d1b/d1f/f43 0 2024-04-26T10:44:29.078 INFO:tasks.workunit.client.0.smithi049.stdout:2/267: rename d6/d9/db/df/l23 to d6/d9/db/d1e/l48 0 2024-04-26T10:44:29.078 INFO:tasks.workunit.client.0.smithi049.stdout:0/237: symlink d8/db/d26/l56 0 2024-04-26T10:44:29.079 INFO:tasks.workunit.client.0.smithi049.stdout:6/256: creat da/dd/de/d26/d22/f54 x:0 0 0 2024-04-26T10:44:29.079 INFO:tasks.workunit.client.0.smithi049.stdout:9/338: fsync d2/d1a/df/f47 0 2024-04-26T10:44:29.079 INFO:tasks.workunit.client.0.smithi049.stdout:4/328: dread de/d3f/f4a [0,4194304] 0 2024-04-26T10:44:29.080 INFO:tasks.workunit.client.0.smithi049.stdout:6/257: unlink da/dd/de/d26/d27/f51 0 2024-04-26T10:44:29.081 INFO:tasks.workunit.client.0.smithi049.stdout:4/329: mkdir de/d1b/d5e 0 2024-04-26T10:44:29.081 INFO:tasks.workunit.client.0.smithi049.stdout:9/339: link d2/d1a/d66/f57 d2/d1a/d1b/d1f/d64/f6e 0 2024-04-26T10:44:29.082 INFO:tasks.workunit.client.0.smithi049.stdout:4/330: fdatasync de/d20/d38/f58 0 2024-04-26T10:44:29.082 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:29.083 INFO:tasks.workunit.client.0.smithi049.stdout:9/340: dread - d2/d1a/df/f4a zero size 2024-04-26T10:44:29.083 INFO:tasks.workunit.client.0.smithi049.stdout:0/238: dread d8/f9 [0,4194304] 0 2024-04-26T10:44:29.083 INFO:tasks.workunit.client.0.smithi049.stdout:0/239: read - d8/d1e/f4c zero size 2024-04-26T10:44:29.084 INFO:tasks.workunit.client.0.smithi049.stdout:9/341: symlink d2/d1a/d1b/d1f/d49/l6f 0 2024-04-26T10:44:29.084 INFO:tasks.workunit.client.0.smithi049.stdout:4/331: link de/d1b/l3e de/d20/d4b/l5f 0 2024-04-26T10:44:29.085 INFO:tasks.workunit.client.0.smithi049.stdout:6/258: dwrite da/f1b [0,4194304] 0 2024-04-26T10:44:29.085 INFO:tasks.workunit.client.0.smithi049.stdout:4/332: write de/d20/f35 [2484841,46808] 0 2024-04-26T10:44:29.086 INFO:tasks.workunit.client.0.smithi049.stdout:0/240: creat d8/db/d11/d1b/d4d/f57 x:0 0 0 2024-04-26T10:44:29.086 INFO:tasks.workunit.client.0.smithi049.stdout:9/342: getdents d2/d1a/d1b/d1f/d34/d6d 0 2024-04-26T10:44:29.086 INFO:tasks.workunit.client.0.smithi049.stdout:6/259: truncate da/d4a/f37 921095 0 2024-04-26T10:44:29.086 INFO:tasks.workunit.client.0.smithi049.stdout:0/241: fdatasync d8/f18 0 2024-04-26T10:44:29.087 INFO:tasks.workunit.client.0.smithi049.stdout:9/343: write d2/d1a/df/f56 [2397146,87302] 0 2024-04-26T10:44:29.090 INFO:tasks.workunit.client.0.smithi049.stdout:2/268: dread d6/d9/db/f24 [0,4194304] 0 2024-04-26T10:44:29.091 INFO:tasks.workunit.client.0.smithi049.stdout:6/260: creat da/dd/de/d26/d22/f55 x:0 0 0 2024-04-26T10:44:29.091 INFO:tasks.workunit.client.0.smithi049.stdout:0/242: creat d8/db/d26/d39/f58 x:0 0 0 2024-04-26T10:44:29.091 INFO:tasks.workunit.client.0.smithi049.stdout:9/344: getdents d2/d1a/d1b/d1f 0 2024-04-26T10:44:29.092 INFO:tasks.workunit.client.0.smithi049.stdout:2/269: chown d6/d9/db/d11/f1d 588 1 2024-04-26T10:44:29.092 INFO:tasks.workunit.client.0.smithi049.stdout:0/243: creat d8/db/f59 x:0 0 0 2024-04-26T10:44:29.092 INFO:tasks.workunit.client.0.smithi049.stdout:6/261: creat da/dd/de/d26/d22/f56 x:0 0 0 2024-04-26T10:44:29.092 INFO:tasks.workunit.client.0.smithi049.stdout:9/345: link d2/d1a/df/l22 d2/d40/d5d/l70 0 2024-04-26T10:44:29.092 INFO:tasks.workunit.client.0.smithi049.stdout:6/262: symlink da/l57 0 2024-04-26T10:44:29.092 INFO:tasks.workunit.client.0.smithi049.stdout:0/244: mknod d8/db/d11/d1c/c5a 0 2024-04-26T10:44:29.093 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:29.090+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:29.093 INFO:tasks.workunit.client.0.smithi049.stdout:6/263: dread - da/dd/d47/f49 zero size 2024-04-26T10:44:29.093 INFO:tasks.workunit.client.0.smithi049.stdout:9/346: creat d2/d1a/d66/f71 x:0 0 0 2024-04-26T10:44:29.094 INFO:tasks.workunit.client.0.smithi049.stdout:0/245: creat d8/db/d11/d1c/f5b x:0 0 0 2024-04-26T10:44:29.094 INFO:tasks.workunit.client.0.smithi049.stdout:9/347: link d2/d1a/d1b/f16 d2/d1a/d42/f72 0 2024-04-26T10:44:29.094 INFO:tasks.workunit.client.0.smithi049.stdout:0/246: link d8/db/d11/l16 d8/d42/l5c 0 2024-04-26T10:44:29.094 INFO:tasks.workunit.client.0.smithi049.stdout:0/247: symlink d8/l5d 0 2024-04-26T10:44:29.095 INFO:tasks.workunit.client.0.smithi049.stdout:0/248: creat d8/db/d11/d1b/d4d/f5e x:0 0 0 2024-04-26T10:44:29.096 INFO:tasks.workunit.client.0.smithi049.stdout:6/264: truncate da/f1b 567246 0 2024-04-26T10:44:29.096 INFO:tasks.workunit.client.0.smithi049.stdout:0/249: symlink d8/l5f 0 2024-04-26T10:44:29.096 INFO:tasks.workunit.client.0.smithi049.stdout:1/277: sync 2024-04-26T10:44:29.096 INFO:tasks.workunit.client.0.smithi049.stdout:8/266: sync 2024-04-26T10:44:29.096 INFO:tasks.workunit.client.0.smithi049.stdout:7/293: sync 2024-04-26T10:44:29.096 INFO:tasks.workunit.client.0.smithi049.stdout:5/292: sync 2024-04-26T10:44:29.096 INFO:tasks.workunit.client.0.smithi049.stdout:3/254: sync 2024-04-26T10:44:29.097 INFO:tasks.workunit.client.0.smithi049.stdout:5/293: dread - d7/f43 zero size 2024-04-26T10:44:29.097 INFO:tasks.workunit.client.0.smithi049.stdout:6/265: rename da/dd to da/dd/de/d26/d27/d58 22 2024-04-26T10:44:29.097 INFO:tasks.workunit.client.0.smithi049.stdout:8/267: creat d2/d16/f52 x:0 0 0 2024-04-26T10:44:29.097 INFO:tasks.workunit.client.0.smithi049.stdout:0/250: chown d8/ld 680 1 2024-04-26T10:44:29.097 INFO:tasks.workunit.client.0.smithi049.stdout:7/294: dread - d2/d3/f56 zero size 2024-04-26T10:44:29.097 INFO:tasks.workunit.client.0.smithi049.stdout:1/278: mknod d1e/d20/d4d/c56 0 2024-04-26T10:44:29.097 INFO:tasks.workunit.client.0.smithi049.stdout:8/268: fsync d2/f2f 0 2024-04-26T10:44:29.098 INFO:tasks.workunit.client.0.smithi049.stdout:6/266: symlink da/dd/de/d26/l59 0 2024-04-26T10:44:29.098 INFO:tasks.workunit.client.0.smithi049.stdout:1/279: mkdir d1e/d20/d26/d57 0 2024-04-26T10:44:29.098 INFO:tasks.workunit.client.0.smithi049.stdout:5/294: rename d7/d14/d18/c19 to d7/d14/c7c 0 2024-04-26T10:44:29.099 INFO:tasks.workunit.client.0.smithi049.stdout:8/269: stat d2/df/d10/c51 0 2024-04-26T10:44:29.099 INFO:tasks.workunit.client.0.smithi049.stdout:3/255: link d3/d19/d8/c27 d3/d19/d8/d55/c5c 0 2024-04-26T10:44:29.099 INFO:tasks.workunit.client.0.smithi049.stdout:5/295: creat d7/d66/f7d x:0 0 0 2024-04-26T10:44:29.099 INFO:tasks.workunit.client.0.smithi049.stdout:1/280: creat d1e/d20/d26/d37/f58 x:0 0 0 2024-04-26T10:44:29.099 INFO:tasks.workunit.client.0.smithi049.stdout:8/270: symlink d2/d1a/l53 0 2024-04-26T10:44:29.100 INFO:tasks.workunit.client.0.smithi049.stdout:3/256: write d3/d6/f42 [3291654,42736] 0 2024-04-26T10:44:29.101 INFO:tasks.workunit.client.0.smithi049.stdout:5/296: creat d7/d53/f7e x:0 0 0 2024-04-26T10:44:29.101 INFO:tasks.workunit.client.0.smithi049.stdout:3/257: chown d3/d19/d8 265191 1 2024-04-26T10:44:29.105 INFO:tasks.workunit.client.0.smithi049.stdout:5/297: rename d7/d1d/d20/l41 to d7/d53/l7f 0 2024-04-26T10:44:29.105 INFO:tasks.workunit.client.0.smithi049.stdout:1/281: mkdir d1e/d20/d26/d3c/d54/d59 0 2024-04-26T10:44:29.106 INFO:tasks.workunit.client.0.smithi049.stdout:3/258: mknod d3/d19/d8/d55/d2e/c5d 0 2024-04-26T10:44:29.106 INFO:tasks.workunit.client.0.smithi049.stdout:0/251: dwrite d8/db/d11/d1b/d4d/f5e [0,4194304] 0 2024-04-26T10:44:29.106 INFO:tasks.workunit.client.0.smithi049.stdout:7/295: dwrite d2/d3/de/d1c/f61 [0,4194304] 0 2024-04-26T10:44:29.107 INFO:tasks.workunit.client.0.smithi049.stdout:6/267: dwrite da/dd/de/d26/f45 [0,4194304] 0 2024-04-26T10:44:29.107 INFO:tasks.workunit.client.0.smithi049.stdout:5/298: mkdir d7/d1d/d1f/d4e/d80 0 2024-04-26T10:44:29.108 INFO:tasks.workunit.client.0.smithi049.stdout:3/259: mknod d3/d23/d2f/c5e 0 2024-04-26T10:44:29.108 INFO:tasks.workunit.client.0.smithi049.stdout:1/282: rename d1e/d20/f4a to d1e/d20/d26/d3c/d54/f5a 0 2024-04-26T10:44:29.108 INFO:tasks.workunit.client.0.smithi049.stdout:0/252: rename d8/db/d11/d1b to d8/db/d11/d1b/d60 22 2024-04-26T10:44:29.109 INFO:tasks.workunit.client.0.smithi049.stdout:1/283: dread - d1e/d20/d4d/f53 zero size 2024-04-26T10:44:29.110 INFO:tasks.workunit.client.0.smithi049.stdout:3/260: mkdir d3/d19/d26/d5f 0 2024-04-26T10:44:29.110 INFO:tasks.workunit.client.0.smithi049.stdout:6/268: getdents da/dd/de/d26/d22/d4c 0 2024-04-26T10:44:29.112 INFO:tasks.workunit.client.0.smithi049.stdout:0/253: symlink d8/db/d11/d1b/d4d/l61 0 2024-04-26T10:44:29.112 INFO:tasks.workunit.client.0.smithi049.stdout:5/299: truncate d7/d14/d18/f1e 966727 0 2024-04-26T10:44:29.113 INFO:tasks.workunit.client.0.smithi049.stdout:1/284: creat d1e/d20/d26/d37/f5b x:0 0 0 2024-04-26T10:44:29.113 INFO:tasks.workunit.client.0.smithi049.stdout:0/254: creat d8/d42/f62 x:0 0 0 2024-04-26T10:44:29.113 INFO:tasks.workunit.client.0.smithi049.stdout:5/300: creat d7/f81 x:0 0 0 2024-04-26T10:44:29.114 INFO:tasks.workunit.client.0.smithi049.stdout:6/269: write da/dd/de/d11/f43 [64964,100449] 0 2024-04-26T10:44:29.114 INFO:tasks.workunit.client.0.smithi049.stdout:8/271: dread d2/d1a/f22 [4194304,4194304] 0 2024-04-26T10:44:29.114 INFO:tasks.workunit.client.0.smithi049.stdout:3/261: link d3/d6/c3b d3/d19/d8/c60 0 2024-04-26T10:44:29.115 INFO:tasks.workunit.client.0.smithi049.stdout:0/255: symlink d8/db/d11/d1b/d4d/l63 0 2024-04-26T10:44:29.116 INFO:tasks.workunit.client.0.smithi049.stdout:6/270: write da/dd/de/d26/d22/f56 [859976,44554] 0 2024-04-26T10:44:29.116 INFO:tasks.workunit.client.0.smithi049.stdout:7/296: dwrite d2/f6 [8388608,4194304] 0 2024-04-26T10:44:29.116 INFO:tasks.workunit.client.0.smithi049.stdout:5/301: write d7/d1d/d20/f24 [574031,54904] 0 2024-04-26T10:44:29.116 INFO:tasks.workunit.client.0.smithi049.stdout:3/262: write d3/d19/d8/f9 [4078546,116644] 0 2024-04-26T10:44:29.118 INFO:tasks.workunit.client.0.smithi049.stdout:7/297: chown d2/d3/f16 616491 1 2024-04-26T10:44:29.119 INFO:tasks.workunit.client.0.smithi049.stdout:6/271: truncate da/dd/de/d26/d22/d4c/f53 580108 0 2024-04-26T10:44:29.120 INFO:tasks.workunit.client.0.smithi049.stdout:5/302: mknod d7/d1d/d34/d37/d3e/c82 0 2024-04-26T10:44:29.120 INFO:tasks.workunit.client.0.smithi049.stdout:7/298: truncate d2/dd/d38/f40 717249 0 2024-04-26T10:44:29.122 INFO:tasks.workunit.client.0.smithi049.stdout:2/270: sync 2024-04-26T10:44:29.122 INFO:tasks.workunit.client.0.smithi049.stdout:9/348: sync 2024-04-26T10:44:29.122 INFO:tasks.workunit.client.0.smithi049.stdout:4/333: sync 2024-04-26T10:44:29.122 INFO:tasks.workunit.client.0.smithi049.stdout:0/256: write d8/d42/f43 [413975,55304] 0 2024-04-26T10:44:29.122 INFO:tasks.workunit.client.0.smithi049.stdout:8/272: dwrite d2/df/f3f [0,4194304] 0 2024-04-26T10:44:29.122 INFO:tasks.workunit.client.0.smithi049.stdout:5/303: mknod d7/d1d/d1f/d4e/c83 0 2024-04-26T10:44:29.124 INFO:tasks.workunit.client.0.smithi049.stdout:1/285: dwrite d1e/d20/d26/f47 [0,4194304] 0 2024-04-26T10:44:29.124 INFO:tasks.workunit.client.0.smithi049.stdout:7/299: write d2/fc [270994,57868] 0 2024-04-26T10:44:29.126 INFO:tasks.workunit.client.0.smithi049.stdout:2/271: truncate d6/d9/db/d1e/f21 1248084 0 2024-04-26T10:44:29.127 INFO:tasks.workunit.client.0.smithi049.stdout:8/273: creat d2/df/d18/d2a/f54 x:0 0 0 2024-04-26T10:44:29.127 INFO:tasks.workunit.client.0.smithi049.stdout:7/300: symlink d2/d3/de/l63 0 2024-04-26T10:44:29.128 INFO:tasks.workunit.client.0.smithi049.stdout:1/286: write f9 [2257656,65201] 0 2024-04-26T10:44:29.129 INFO:tasks.workunit.client.0.smithi049.stdout:7/301: chown d2 6756871 1 2024-04-26T10:44:29.129 INFO:tasks.workunit.client.0.smithi049.stdout:0/257: rename d8/db/d11/d1b/d4d/f57 to d8/db/d11/d1b/d4d/f64 0 2024-04-26T10:44:29.129 INFO:tasks.workunit.client.0.smithi049.stdout:9/349: rename d2/d1a/df/l41 to d2/d1a/l73 0 2024-04-26T10:44:29.129 INFO:tasks.workunit.client.0.smithi049.stdout:3/263: dwrite d3/d19/d8/d55/d46/d4e/f28 [0,4194304] 0 2024-04-26T10:44:29.129 INFO:tasks.workunit.client.0.smithi049.stdout:2/272: fdatasync d6/d9/db/f24 0 2024-04-26T10:44:29.129 INFO:tasks.workunit.client.0.smithi049.stdout:8/274: truncate d2/f2f 968447 0 2024-04-26T10:44:29.130 INFO:tasks.workunit.client.0.smithi049.stdout:1/287: unlink d1e/d20/l29 0 2024-04-26T10:44:29.130 INFO:tasks.workunit.client.0.smithi049.stdout:9/350: stat d2/d1a/d1b/d1f/d34 0 2024-04-26T10:44:29.130 INFO:tasks.workunit.client.0.smithi049.stdout:1/288: sync 2024-04-26T10:44:29.130 INFO:tasks.workunit.client.0.smithi049.stdout:0/258: creat d8/db/d11/f65 x:0 0 0 2024-04-26T10:44:29.130 INFO:tasks.workunit.client.0.smithi049.stdout:6/272: dwrite da/f32 [0,4194304] 0 2024-04-26T10:44:29.131 INFO:tasks.workunit.client.0.smithi049.stdout:2/273: symlink d6/d30/l49 0 2024-04-26T10:44:29.131 INFO:tasks.workunit.client.0.smithi049.stdout:0/259: chown d8/d1e 12801287 1 2024-04-26T10:44:29.132 INFO:tasks.workunit.client.0.smithi049.stdout:9/351: read d2/d1a/d1b/d1f/f39 [70453,7944] 0 2024-04-26T10:44:29.132 INFO:tasks.workunit.client.0.smithi049.stdout:3/264: rename d3/d23/d2f/c5e to d3/d19/d8/d55/d46/c61 0 2024-04-26T10:44:29.132 INFO:tasks.workunit.client.0.smithi049.stdout:1/289: mknod d1e/d20/d26/d57/c5c 0 2024-04-26T10:44:29.133 INFO:tasks.workunit.client.0.smithi049.stdout:1/290: sync 2024-04-26T10:44:29.133 INFO:tasks.workunit.client.0.smithi049.stdout:2/274: unlink d6/d9/db/df/f22 0 2024-04-26T10:44:29.133 INFO:tasks.workunit.client.0.smithi049.stdout:6/273: write da/dd/f13 [1823569,37375] 0 2024-04-26T10:44:29.133 INFO:tasks.workunit.client.0.smithi049.stdout:0/260: stat d8/db/d11/d1c/c3b 0 2024-04-26T10:44:29.134 INFO:tasks.workunit.client.0.smithi049.stdout:1/291: readlink d1e/d20/d26/l2a 0 2024-04-26T10:44:29.135 INFO:tasks.workunit.client.0.smithi049.stdout:6/274: write da/dd/f1e [24612,6428] 0 2024-04-26T10:44:29.137 INFO:tasks.workunit.client.0.smithi049.stdout:4/334: dread de/d20/d38/f3b [0,4194304] 0 2024-04-26T10:44:29.137 INFO:tasks.workunit.client.0.smithi049.stdout:9/352: rename d2/d1a/d66 to d2/d25/d74 0 2024-04-26T10:44:29.137 INFO:tasks.workunit.client.0.smithi049.stdout:8/275: dread d2/f1b [0,4194304] 0 2024-04-26T10:44:29.139 INFO:tasks.workunit.client.0.smithi049.stdout:7/302: dwrite d2/d3/f34 [0,4194304] 0 2024-04-26T10:44:29.141 INFO:tasks.workunit.client.0.smithi049.stdout:2/275: truncate d6/f3b 281278 0 2024-04-26T10:44:29.142 INFO:tasks.workunit.client.0.smithi049.stdout:9/353: unlink d2/d1a/d1b/d1f/l51 0 2024-04-26T10:44:29.145 INFO:tasks.workunit.client.0.smithi049.stdout:8/276: write d2/d16/f2e [289821,41118] 0 2024-04-26T10:44:29.148 INFO:tasks.workunit.client.0.smithi049.stdout:3/265: dwrite d3/d19/d8/d55/d46/d4e/f28 [0,4194304] 0 2024-04-26T10:44:29.149 INFO:tasks.workunit.client.0.smithi049.stdout:7/303: truncate d2/f6 9065512 0 2024-04-26T10:44:29.149 INFO:tasks.workunit.client.0.smithi049.stdout:9/354: write d2/d1a/df/f47 [1065193,26184] 0 2024-04-26T10:44:29.149 INFO:tasks.workunit.client.0.smithi049.stdout:8/277: fdatasync d2/df/f36 0 2024-04-26T10:44:29.150 INFO:tasks.workunit.client.0.smithi049.stdout:1/292: dwrite d1e/d20/d26/f51 [0,4194304] 0 2024-04-26T10:44:29.150 INFO:tasks.workunit.client.0.smithi049.stdout:6/275: dwrite da/f1b [0,4194304] 0 2024-04-26T10:44:29.151 INFO:tasks.workunit.client.0.smithi049.stdout:6/276: sync 2024-04-26T10:44:29.151 INFO:tasks.workunit.client.0.smithi049.stdout:0/261: dwrite d8/db/d26/d39/f58 [0,4194304] 0 2024-04-26T10:44:29.151 INFO:tasks.workunit.client.0.smithi049.stdout:4/335: dwrite de/d20/f22 [0,4194304] 0 2024-04-26T10:44:29.151 INFO:tasks.workunit.client.0.smithi049.stdout:7/304: rmdir d2/dd/d48 39 2024-04-26T10:44:29.151 INFO:tasks.workunit.client.0.smithi049.stdout:9/355: chown d2/d1a/f45 0 1 2024-04-26T10:44:29.152 INFO:tasks.workunit.client.0.smithi049.stdout:8/278: read - d2/df/d18/d2a/f54 zero size 2024-04-26T10:44:29.152 INFO:tasks.workunit.client.0.smithi049.stdout:9/356: fdatasync d2/d25/d74/f71 0 2024-04-26T10:44:29.153 INFO:tasks.workunit.client.0.smithi049.stdout:0/262: mkdir d8/d66 0 2024-04-26T10:44:29.153 INFO:tasks.workunit.client.0.smithi049.stdout:3/266: symlink d3/d19/d8/d55/l62 0 2024-04-26T10:44:29.154 INFO:tasks.workunit.client.0.smithi049.stdout:1/293: truncate d1e/d20/d26/d3c/f3f 122078 0 2024-04-26T10:44:29.154 INFO:tasks.workunit.client.0.smithi049.stdout:9/357: symlink d2/d1a/d1b/d1f/d49/l75 0 2024-04-26T10:44:29.154 INFO:tasks.workunit.client.0.smithi049.stdout:8/279: write d2/f14 [2542699,70674] 0 2024-04-26T10:44:29.154 INFO:tasks.workunit.client.0.smithi049.stdout:5/304: dread d7/d1d/d1f/d4e/d65/d6f/f5c [0,4194304] 0 2024-04-26T10:44:29.154 INFO:tasks.workunit.client.0.smithi049.stdout:0/263: creat d8/d1e/f67 x:0 0 0 2024-04-26T10:44:29.155 INFO:tasks.workunit.client.0.smithi049.stdout:1/294: chown l13 7948 1 2024-04-26T10:44:29.155 INFO:tasks.workunit.client.0.smithi049.stdout:7/305: creat d2/f64 x:0 0 0 2024-04-26T10:44:29.157 INFO:tasks.workunit.client.0.smithi049.stdout:4/336: creat de/d20/f60 x:0 0 0 2024-04-26T10:44:29.157 INFO:tasks.workunit.client.0.smithi049.stdout:0/264: mknod d8/d42/c68 0 2024-04-26T10:44:29.157 INFO:tasks.workunit.client.0.smithi049.stdout:5/305: mkdir d7/d66/d84 0 2024-04-26T10:44:29.157 INFO:tasks.workunit.client.0.smithi049.stdout:7/306: rmdir d2/dd/d48 39 2024-04-26T10:44:29.157 INFO:tasks.workunit.client.0.smithi049.stdout:8/280: link d2/df/d18/f41 d2/d16/d19/f55 0 2024-04-26T10:44:29.158 INFO:tasks.workunit.client.0.smithi049.stdout:1/295: chown d1e/d20/c35 207 1 2024-04-26T10:44:29.158 INFO:tasks.workunit.client.0.smithi049.stdout:0/265: fsync f3 0 2024-04-26T10:44:29.158 INFO:tasks.workunit.client.0.smithi049.stdout:4/337: creat de/d20/d24/f61 x:0 0 0 2024-04-26T10:44:29.159 INFO:tasks.workunit.client.0.smithi049.stdout:5/306: write d7/d53/f7e [811238,18315] 0 2024-04-26T10:44:29.160 INFO:tasks.workunit.client.0.smithi049.stdout:4/338: chown de/d3f/d48 42700729 1 2024-04-26T10:44:29.160 INFO:tasks.workunit.client.0.smithi049.stdout:8/281: creat d2/d16/f56 x:0 0 0 2024-04-26T10:44:29.160 INFO:tasks.workunit.client.0.smithi049.stdout:0/266: unlink d8/db/f59 0 2024-04-26T10:44:29.161 INFO:tasks.workunit.client.0.smithi049.stdout:7/307: mknod d2/dd/d48/d5c/c65 0 2024-04-26T10:44:29.161 INFO:tasks.workunit.client.0.smithi049.stdout:5/307: write f3 [7141553,99543] 0 2024-04-26T10:44:29.162 INFO:tasks.workunit.client.0.smithi049.stdout:3/267: dwrite d3/d19/d8/f9 [8388608,4194304] 0 2024-04-26T10:44:29.163 INFO:tasks.workunit.client.0.smithi049.stdout:4/339: write de/d20/d38/f3b [1117041,41146] 0 2024-04-26T10:44:29.164 INFO:tasks.workunit.client.0.smithi049.stdout:7/308: creat d2/dd/f66 x:0 0 0 2024-04-26T10:44:29.164 INFO:tasks.workunit.client.0.smithi049.stdout:8/282: rename d2/d16/d19/f33 to d2/d17/d34/d40/f57 0 2024-04-26T10:44:29.164 INFO:tasks.workunit.client.0.smithi049.stdout:4/340: write de/d20/f2e [2022483,61222] 0 2024-04-26T10:44:29.165 INFO:tasks.workunit.client.0.smithi049.stdout:1/296: read d1e/d20/d26/d3c/f3f [92135,103100] 0 2024-04-26T10:44:29.165 INFO:tasks.workunit.client.0.smithi049.stdout:7/309: read - d2/dd/f14 zero size 2024-04-26T10:44:29.165 INFO:tasks.workunit.client.0.smithi049.stdout:9/358: dwrite d2/d1a/f2a [4194304,4194304] 0 2024-04-26T10:44:29.166 INFO:tasks.workunit.client.0.smithi049.stdout:8/283: dread - d2/d16/d19/f4d zero size 2024-04-26T10:44:29.166 INFO:tasks.workunit.client.0.smithi049.stdout:0/267: rmdir d8/db 39 2024-04-26T10:44:29.166 INFO:tasks.workunit.client.0.smithi049.stdout:7/310: stat d2/dd/f3f 0 2024-04-26T10:44:29.167 INFO:tasks.workunit.client.0.smithi049.stdout:1/297: write d1e/d20/d26/d3c/f4f [1026641,30558] 0 2024-04-26T10:44:29.168 INFO:tasks.workunit.client.0.smithi049.stdout:4/341: mkdir de/d3f/d48/d62 0 2024-04-26T10:44:29.168 INFO:tasks.workunit.client.0.smithi049.stdout:0/268: dread - d8/d1e/f4c zero size 2024-04-26T10:44:29.168 INFO:tasks.workunit.client.0.smithi049.stdout:9/359: stat d2/d1a/l73 0 2024-04-26T10:44:29.168 INFO:tasks.workunit.client.0.smithi049.stdout:8/284: mknod d2/df/d18/d2a/c58 0 2024-04-26T10:44:29.169 INFO:tasks.workunit.client.0.smithi049.stdout:9/360: readlink d2/d1a/df/l3b 0 2024-04-26T10:44:29.169 INFO:tasks.workunit.client.0.smithi049.stdout:1/298: stat d1e/d20/d26/d3c/f3d 0 2024-04-26T10:44:29.170 INFO:tasks.workunit.client.0.smithi049.stdout:4/342: creat de/f63 x:0 0 0 2024-04-26T10:44:29.170 INFO:tasks.workunit.client.0.smithi049.stdout:5/308: dwrite d7/d1d/d20/f24 [0,4194304] 0 2024-04-26T10:44:29.170 INFO:tasks.workunit.client.0.smithi049.stdout:7/311: link d2/dd/d25/l28 d2/l67 0 2024-04-26T10:44:29.170 INFO:tasks.workunit.client.0.smithi049.stdout:0/269: readlink d8/db/d11/d1c/l46 0 2024-04-26T10:44:29.171 INFO:tasks.workunit.client.0.smithi049.stdout:3/268: truncate d3/d19/d26/f48 1652617 0 2024-04-26T10:44:29.172 INFO:tasks.workunit.client.0.smithi049.stdout:7/312: symlink d2/dd/d45/l68 0 2024-04-26T10:44:29.172 INFO:tasks.workunit.client.0.smithi049.stdout:0/270: write d8/db/d26/f38 [1242160,7872] 0 2024-04-26T10:44:29.173 INFO:tasks.workunit.client.0.smithi049.stdout:5/309: fsync d7/d1d/d1f/f29 0 2024-04-26T10:44:29.173 INFO:tasks.workunit.client.0.smithi049.stdout:1/299: creat d1e/d20/d26/d37/f5d x:0 0 0 2024-04-26T10:44:29.173 INFO:tasks.workunit.client.0.smithi049.stdout:9/361: rename d2/d25/d74/f57 to d2/d25/d60/f76 0 2024-04-26T10:44:29.173 INFO:tasks.workunit.client.0.smithi049.stdout:3/269: write d3/d19/d8/d34/f44 [92059,121597] 0 2024-04-26T10:44:29.174 INFO:tasks.workunit.client.0.smithi049.stdout:1/300: stat d1e/f50 0 2024-04-26T10:44:29.174 INFO:tasks.workunit.client.0.smithi049.stdout:0/271: creat d8/d66/f69 x:0 0 0 2024-04-26T10:44:29.174 INFO:tasks.workunit.client.0.smithi049.stdout:0/272: sync 2024-04-26T10:44:29.175 INFO:tasks.workunit.client.0.smithi049.stdout:5/310: write d7/d14/d18/f46 [1668904,56081] 0 2024-04-26T10:44:29.175 INFO:tasks.workunit.client.0.smithi049.stdout:7/313: write d2/dd/d25/d27/f30 [4519777,29448] 0 2024-04-26T10:44:29.175 INFO:tasks.workunit.client.0.smithi049.stdout:3/270: mknod d3/d19/c63 0 2024-04-26T10:44:29.176 INFO:tasks.workunit.client.0.smithi049.stdout:0/273: mkdir d8/d1e/d6a 0 2024-04-26T10:44:29.176 INFO:tasks.workunit.client.0.smithi049.stdout:0/274: mkdir d8/d1e/d6b 0 2024-04-26T10:44:29.177 INFO:tasks.workunit.client.0.smithi049.stdout:0/275: creat d8/d42/f6c x:0 0 0 2024-04-26T10:44:29.177 INFO:tasks.workunit.client.0.smithi049.stdout:5/311: rename d7/d14/d18/l1c to d7/d14/d18/l85 0 2024-04-26T10:44:29.180 INFO:tasks.workunit.client.0.smithi049.stdout:2/276: dread f5 [0,4194304] 0 2024-04-26T10:44:29.180 INFO:tasks.workunit.client.0.smithi049.stdout:7/314: truncate d2/d3/de/f1e 119859 0 2024-04-26T10:44:29.183 INFO:tasks.workunit.client.0.smithi049.stdout:5/312: truncate d7/d14/d18/d2b/f4b 48963 0 2024-04-26T10:44:29.183 INFO:tasks.workunit.client.0.smithi049.stdout:7/315: dread - d2/dd/f14 zero size 2024-04-26T10:44:29.183 INFO:tasks.workunit.client.0.smithi049.stdout:2/277: stat d6/d9/db/d11 0 2024-04-26T10:44:29.184 INFO:tasks.workunit.client.0.smithi049.stdout:3/271: dwrite d3/d19/d8/dd/f18 [0,4194304] 0 2024-04-26T10:44:29.185 INFO:tasks.workunit.client.0.smithi049.stdout:3/272: fdatasync d3/d6/f10 0 2024-04-26T10:44:29.186 INFO:tasks.workunit.client.0.smithi049.stdout:0/276: dwrite d8/f52 [0,4194304] 0 2024-04-26T10:44:29.186 INFO:tasks.workunit.client.0.smithi049.stdout:9/362: dwrite d2/d1a/d1b/d1f/d64/f6e [0,4194304] 0 2024-04-26T10:44:29.187 INFO:tasks.workunit.client.0.smithi049.stdout:5/313: mknod d7/d1d/d20/c86 0 2024-04-26T10:44:29.187 INFO:tasks.workunit.client.0.smithi049.stdout:7/316: creat d2/dd/d48/f69 x:0 0 0 2024-04-26T10:44:29.188 INFO:tasks.workunit.client.0.smithi049.stdout:2/278: unlink d6/d9/l2d 0 2024-04-26T10:44:29.188 INFO:tasks.workunit.client.0.smithi049.stdout:3/273: creat d3/d19/d8/d34/f64 x:0 0 0 2024-04-26T10:44:29.188 INFO:tasks.workunit.client.0.smithi049.stdout:5/314: fdatasync d7/d1d/d34/d37/d3e/f40 0 2024-04-26T10:44:29.188 INFO:tasks.workunit.client.0.smithi049.stdout:0/277: truncate d8/db/d26/f38 5023222 0 2024-04-26T10:44:29.189 INFO:tasks.workunit.client.0.smithi049.stdout:7/317: symlink d2/dd/d38/l6a 0 2024-04-26T10:44:29.189 INFO:tasks.workunit.client.0.smithi049.stdout:2/279: mkdir d6/d32/d4a 0 2024-04-26T10:44:29.190 INFO:tasks.workunit.client.0.smithi049.stdout:9/363: link d2/d1a/fd d2/d25/d74/f77 0 2024-04-26T10:44:29.190 INFO:tasks.workunit.client.0.smithi049.stdout:5/315: mknod d7/c87 0 2024-04-26T10:44:29.190 INFO:tasks.workunit.client.0.smithi049.stdout:3/274: read d3/d6/f42 [1288620,6787] 0 2024-04-26T10:44:29.191 INFO:tasks.workunit.client.0.smithi049.stdout:7/318: chown d2/f49 1058 1 2024-04-26T10:44:29.191 INFO:tasks.workunit.client.0.smithi049.stdout:3/275: chown d3 36905816 1 2024-04-26T10:44:29.191 INFO:tasks.workunit.client.0.smithi049.stdout:0/278: write d8/db/d11/f32 [3047236,111407] 0 2024-04-26T10:44:29.192 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:29.191+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:29.192 INFO:tasks.workunit.client.0.smithi049.stdout:3/276: stat d3/d19/d8/d55/d46/f4a 0 2024-04-26T10:44:29.193 INFO:tasks.workunit.client.0.smithi049.stdout:0/279: read - d8/db/d11/d1b/d4d/f64 zero size 2024-04-26T10:44:29.193 INFO:tasks.workunit.client.0.smithi049.stdout:5/316: getdents d7/d66 0 2024-04-26T10:44:29.193 INFO:tasks.workunit.client.0.smithi049.stdout:0/280: chown d8/db 417698 1 2024-04-26T10:44:29.195 INFO:tasks.workunit.client.0.smithi049.stdout:5/317: creat d7/f88 x:0 0 0 2024-04-26T10:44:29.195 INFO:tasks.workunit.client.0.smithi049.stdout:3/277: unlink d3/d19/d8/c27 0 2024-04-26T10:44:29.195 INFO:tasks.workunit.client.0.smithi049.stdout:6/277: dread da/dd/de/d26/d29/f31 [0,4194304] 0 2024-04-26T10:44:29.195 INFO:tasks.workunit.client.0.smithi049.stdout:7/319: link d2/lf d2/dd/l6b 0 2024-04-26T10:44:29.195 INFO:tasks.workunit.client.0.smithi049.stdout:0/281: fsync d8/db/d11/d1b/f4a 0 2024-04-26T10:44:29.197 INFO:tasks.workunit.client.0.smithi049.stdout:2/280: dread d6/d9/db/d11/f1d [0,4194304] 0 2024-04-26T10:44:29.197 INFO:tasks.workunit.client.0.smithi049.stdout:9/364: dwrite d2/d25/d74/f71 [0,4194304] 0 2024-04-26T10:44:29.198 INFO:tasks.workunit.client.0.smithi049.stdout:5/318: creat d7/d14/d18/f89 x:0 0 0 2024-04-26T10:44:29.199 INFO:tasks.workunit.client.0.smithi049.stdout:6/278: rename da/dd/de/d26/d27 to da/dd/de/d42/d5a 0 2024-04-26T10:44:29.199 INFO:tasks.workunit.client.0.smithi049.stdout:5/319: read - d7/d1d/d34/d37/f4a zero size 2024-04-26T10:44:29.199 INFO:tasks.workunit.client.0.smithi049.stdout:9/365: creat d2/d40/f78 x:0 0 0 2024-04-26T10:44:29.200 INFO:tasks.workunit.client.0.smithi049.stdout:2/281: write d6/d9/db/f1c [537001,5903] 0 2024-04-26T10:44:29.200 INFO:tasks.workunit.client.0.smithi049.stdout:1/301: dread fe [0,4194304] 0 2024-04-26T10:44:29.200 INFO:tasks.workunit.client.0.smithi049.stdout:4/343: dread de/d1b/f1c [0,4194304] 0 2024-04-26T10:44:29.200 INFO:tasks.workunit.client.0.smithi049.stdout:3/278: read d3/d19/d8/f32 [1915841,91744] 0 2024-04-26T10:44:29.201 INFO:tasks.workunit.client.0.smithi049.stdout:8/285: dread d2/f6 [0,4194304] 0 2024-04-26T10:44:29.203 INFO:tasks.workunit.client.0.smithi049.stdout:5/320: unlink d7/d14/c15 0 2024-04-26T10:44:29.203 INFO:tasks.workunit.client.0.smithi049.stdout:9/366: write d2/d25/d74/f6c [1039324,52576] 0 2024-04-26T10:44:29.203 INFO:tasks.workunit.client.0.smithi049.stdout:6/279: creat da/dd/de/d26/d22/d4c/f5b x:0 0 0 2024-04-26T10:44:29.204 INFO:tasks.workunit.client.0.smithi049.stdout:8/286: write d2/d17/f3d [2822442,43708] 0 2024-04-26T10:44:29.204 INFO:tasks.workunit.client.0.smithi049.stdout:4/344: symlink de/d20/d24/d50/l64 0 2024-04-26T10:44:29.204 INFO:tasks.workunit.client.0.smithi049.stdout:8/287: sync 2024-04-26T10:44:29.204 INFO:tasks.workunit.client.0.smithi049.stdout:3/279: write d3/d23/d2f/f3c [510116,32786] 0 2024-04-26T10:44:29.205 INFO:tasks.workunit.client.0.smithi049.stdout:0/282: dwrite d8/db/d11/d1b/f44 [0,4194304] 0 2024-04-26T10:44:29.205 INFO:tasks.workunit.client.0.smithi049.stdout:1/302: write d1e/d20/f41 [5108430,95482] 0 2024-04-26T10:44:29.205 INFO:tasks.workunit.client.0.smithi049.stdout:5/321: chown d7/d14/d18/l85 15852894 1 2024-04-26T10:44:29.205 INFO:tasks.workunit.client.0.smithi049.stdout:1/303: sync 2024-04-26T10:44:29.205 INFO:tasks.workunit.client.0.smithi049.stdout:9/367: write d2/d1a/d1b/d1f/d64/f6e [969830,86760] 0 2024-04-26T10:44:29.206 INFO:tasks.workunit.client.0.smithi049.stdout:0/283: write d8/db/f33 [60459,33675] 0 2024-04-26T10:44:29.206 INFO:tasks.workunit.client.0.smithi049.stdout:2/282: rename d6/d9/l10 to d6/d9/db/d34/d38/l4b 0 2024-04-26T10:44:29.206 INFO:tasks.workunit.client.0.smithi049.stdout:8/288: mkdir d2/d17/d34/d40/d59 0 2024-04-26T10:44:29.207 INFO:tasks.workunit.client.0.smithi049.stdout:8/289: stat f1 0 2024-04-26T10:44:29.207 INFO:tasks.workunit.client.0.smithi049.stdout:2/283: read f5 [3538691,52681] 0 2024-04-26T10:44:29.207 INFO:tasks.workunit.client.0.smithi049.stdout:6/280: truncate da/dd/de/d42/d5a/f24 26160 0 2024-04-26T10:44:29.208 INFO:tasks.workunit.client.0.smithi049.stdout:0/284: dread - d8/db/d11/f65 zero size 2024-04-26T10:44:29.208 INFO:tasks.workunit.client.0.smithi049.stdout:4/345: rename de/d20/d38/l49 to de/d3f/d48/l65 0 2024-04-26T10:44:29.208 INFO:tasks.workunit.client.0.smithi049.stdout:5/322: creat d7/d14/d18/f8a x:0 0 0 2024-04-26T10:44:29.209 INFO:tasks.workunit.client.0.smithi049.stdout:6/281: creat da/dd/f5c x:0 0 0 2024-04-26T10:44:29.209 INFO:tasks.workunit.client.0.smithi049.stdout:2/284: creat d6/d9/db/df/f4c x:0 0 0 2024-04-26T10:44:29.209 INFO:tasks.workunit.client.0.smithi049.stdout:3/280: unlink d3/d19/d8/d55/c5c 0 2024-04-26T10:44:29.211 INFO:tasks.workunit.client.0.smithi049.stdout:8/290: creat d2/df/f5a x:0 0 0 2024-04-26T10:44:29.212 INFO:tasks.workunit.client.0.smithi049.stdout:5/323: creat d7/d1d/d1f/d4e/d65/d6f/f8b x:0 0 0 2024-04-26T10:44:29.212 INFO:tasks.workunit.client.0.smithi049.stdout:8/291: stat d2/d16/f2e 0 2024-04-26T10:44:29.213 INFO:tasks.workunit.client.0.smithi049.stdout:3/281: mkdir d3/d19/d26/d65 0 2024-04-26T10:44:29.213 INFO:tasks.workunit.client.0.smithi049.stdout:6/282: link da/dd/f10 da/dd/de/d11/f5d 0 2024-04-26T10:44:29.213 INFO:tasks.workunit.client.0.smithi049.stdout:4/346: truncate f1 2140510 0 2024-04-26T10:44:29.214 INFO:tasks.workunit.client.0.smithi049.stdout:5/324: fdatasync d7/d1d/d1f/f3b 0 2024-04-26T10:44:29.215 INFO:tasks.workunit.client.0.smithi049.stdout:9/368: dwrite d2/d40/f78 [0,4194304] 0 2024-04-26T10:44:29.215 INFO:tasks.workunit.client.0.smithi049.stdout:4/347: symlink de/l66 0 2024-04-26T10:44:29.216 INFO:tasks.workunit.client.0.smithi049.stdout:2/285: rename d6/d9/ca to d6/d9/db/d34/c4d 0 2024-04-26T10:44:29.216 INFO:tasks.workunit.client.0.smithi049.stdout:0/285: truncate d8/db/d26/f40 1650220 0 2024-04-26T10:44:29.217 INFO:tasks.workunit.client.0.smithi049.stdout:4/348: stat de/d1b/c5a 0 2024-04-26T10:44:29.217 INFO:tasks.workunit.client.0.smithi049.stdout:1/304: dwrite fd [4194304,4194304] 0 2024-04-26T10:44:29.217 INFO:tasks.workunit.client.0.smithi049.stdout:3/282: getdents d3/d19/d26/d5f 0 2024-04-26T10:44:29.218 INFO:tasks.workunit.client.0.smithi049.stdout:6/283: creat da/dd/de/d42/d5a/f5e x:0 0 0 2024-04-26T10:44:29.223 INFO:tasks.workunit.client.0.smithi049.stdout:0/286: rmdir d8/db 39 2024-04-26T10:44:29.223 INFO:tasks.workunit.client.0.smithi049.stdout:5/325: symlink d7/d14/d18/l8c 0 2024-04-26T10:44:29.223 INFO:tasks.workunit.client.0.smithi049.stdout:1/305: read - d1e/d20/d26/d37/f4e zero size 2024-04-26T10:44:29.223 INFO:tasks.workunit.client.0.smithi049.stdout:3/283: mknod d3/d19/d26/d29/c66 0 2024-04-26T10:44:29.223 INFO:tasks.workunit.client.0.smithi049.stdout:4/349: chown de/d20/d24/c36 4133083 1 2024-04-26T10:44:29.223 INFO:tasks.workunit.client.0.smithi049.stdout:7/320: dread f0 [0,4194304] 0 2024-04-26T10:44:29.224 INFO:tasks.workunit.client.0.smithi049.stdout:6/284: creat da/dd/de/d42/f5f x:0 0 0 2024-04-26T10:44:29.224 INFO:tasks.workunit.client.0.smithi049.stdout:5/326: fsync d7/d14/f17 0 2024-04-26T10:44:29.224 INFO:tasks.workunit.client.0.smithi049.stdout:3/284: chown d3/d19 311 1 2024-04-26T10:44:29.224 INFO:tasks.workunit.client.0.smithi049.stdout:9/369: rename d2/d25/f28 to d2/d1a/f79 0 2024-04-26T10:44:29.224 INFO:tasks.workunit.client.0.smithi049.stdout:0/287: write f2 [6140499,69986] 0 2024-04-26T10:44:29.224 INFO:tasks.workunit.client.0.smithi049.stdout:8/292: dwrite d2/df/f3f [0,4194304] 0 2024-04-26T10:44:29.224 INFO:tasks.workunit.client.0.smithi049.stdout:4/350: symlink de/d1b/d5e/l67 0 2024-04-26T10:44:29.224 INFO:tasks.workunit.client.0.smithi049.stdout:1/306: chown cf 28060374 1 2024-04-26T10:44:29.226 INFO:tasks.workunit.client.0.smithi049.stdout:8/293: creat d2/d17/d34/f5b x:0 0 0 2024-04-26T10:44:29.227 INFO:tasks.workunit.client.0.smithi049.stdout:3/285: symlink d3/d19/d8/d55/l67 0 2024-04-26T10:44:29.227 INFO:tasks.workunit.client.0.smithi049.stdout:2/286: dwrite d6/d9/db/d34/d38/d3f/f40 [0,4194304] 0 2024-04-26T10:44:29.229 INFO:tasks.workunit.client.0.smithi049.stdout:1/307: truncate fe 75960 0 2024-04-26T10:44:29.230 INFO:tasks.workunit.client.0.smithi049.stdout:8/294: write d2/d16/f52 [985244,3666] 0 2024-04-26T10:44:29.231 INFO:tasks.workunit.client.0.smithi049.stdout:6/285: dwrite f1 [0,4194304] 0 2024-04-26T10:44:29.232 INFO:tasks.workunit.client.0.smithi049.stdout:0/288: link d8/db/c1d d8/d41/c6d 0 2024-04-26T10:44:29.233 INFO:tasks.workunit.client.0.smithi049.stdout:3/286: symlink d3/d19/d26/d5f/l68 0 2024-04-26T10:44:29.233 INFO:tasks.workunit.client.0.smithi049.stdout:2/287: creat d6/d32/d4a/f4e x:0 0 0 2024-04-26T10:44:29.233 INFO:tasks.workunit.client.0.smithi049.stdout:9/370: dread d2/d1a/d1b/d1f/d64/f6e [0,4194304] 0 2024-04-26T10:44:29.235 INFO:tasks.workunit.client.0.smithi049.stdout:7/321: dwrite d2/d3/de/d1c/f36 [0,4194304] 0 2024-04-26T10:44:29.236 INFO:tasks.workunit.client.0.smithi049.stdout:6/286: write da/dd/de/d26/d29/f3d [159421,70516] 0 2024-04-26T10:44:29.236 INFO:tasks.workunit.client.0.smithi049.stdout:4/351: dread de/d20/f2e [0,4194304] 0 2024-04-26T10:44:29.237 INFO:tasks.workunit.client.0.smithi049.stdout:5/327: dwrite d7/d1d/d34/d37/d3e/d60/f7a [0,4194304] 0 2024-04-26T10:44:29.238 INFO:tasks.workunit.client.0.smithi049.stdout:8/295: getdents d2/df/d10/d23 0 2024-04-26T10:44:29.238 INFO:tasks.workunit.client.0.smithi049.stdout:9/371: mkdir d2/d1a/d1b/d7a 0 2024-04-26T10:44:29.238 INFO:tasks.workunit.client.0.smithi049.stdout:2/288: mknod d6/d9/db/d11/c4f 0 2024-04-26T10:44:29.238 INFO:tasks.workunit.client.0.smithi049.stdout:4/352: fsync de/f15 0 2024-04-26T10:44:29.239 INFO:tasks.workunit.client.0.smithi049.stdout:6/287: mknod da/dd/de/c60 0 2024-04-26T10:44:29.239 INFO:tasks.workunit.client.0.smithi049.stdout:7/322: truncate d2/dd/d38/f44 856391 0 2024-04-26T10:44:29.239 INFO:tasks.workunit.client.0.smithi049.stdout:8/296: chown d2/df/f5a 36797875 1 2024-04-26T10:44:29.240 INFO:tasks.workunit.client.0.smithi049.stdout:9/372: creat d2/d1a/d1b/d1f/d64/f7b x:0 0 0 2024-04-26T10:44:29.241 INFO:tasks.workunit.client.0.smithi049.stdout:0/289: dwrite d8/f52 [0,4194304] 0 2024-04-26T10:44:29.245 INFO:tasks.workunit.client.0.smithi049.stdout:9/373: write d2/d1a/df/f13 [3000098,92280] 0 2024-04-26T10:44:29.246 INFO:tasks.workunit.client.0.smithi049.stdout:0/290: creat d8/db/d26/d39/f6e x:0 0 0 2024-04-26T10:44:29.247 INFO:tasks.workunit.client.0.smithi049.stdout:9/374: write d2/f8 [2805011,79126] 0 2024-04-26T10:44:29.247 INFO:tasks.workunit.client.0.smithi049.stdout:5/328: dwrite d7/f44 [0,4194304] 0 2024-04-26T10:44:29.247 INFO:tasks.workunit.client.0.smithi049.stdout:0/291: fsync d8/db/d26/f38 0 2024-04-26T10:44:29.248 INFO:tasks.workunit.client.0.smithi049.stdout:5/329: mknod d7/d1d/c8d 0 2024-04-26T10:44:29.248 INFO:tasks.workunit.client.0.smithi049.stdout:9/375: readlink d2/d1a/df/l22 0 2024-04-26T10:44:29.248 INFO:tasks.workunit.client.0.smithi049.stdout:7/323: read d2/d3/de/d1c/f4e [521542,84995] 0 2024-04-26T10:44:29.250 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:29.250 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:29.250 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:29.250 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:29.250 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.250 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:323 3.13 3:ceffbd45:::200.0000000a:head [write 1305474~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:29.250 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.512986+0000", 2024-04-26T10:44:29.251 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 2.7351931929999997, 2024-04-26T10:44:29.251 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020372398999999999, 2024-04-26T10:44:29.251 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:29.251 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.251 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:29.251 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.251 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:29.251 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.512986+0000", 2024-04-26T10:44:29.251 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.251 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.251 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.251 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:29.251 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.512986+0000", 2024-04-26T10:44:29.251 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.252 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.252 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.252 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:29.252 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.512986+0000", 2024-04-26T10:44:29.252 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:44:29.252 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.252 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.252 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:29.252 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.512988+0000", 2024-04-26T10:44:29.252 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.72e-06 2024-04-26T10:44:29.252 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.252 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.252 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:29.252 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.512991+0000", 2024-04-26T10:44:29.253 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.943e-06 2024-04-26T10:44:29.253 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.253 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.253 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.253 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.512993+0000", 2024-04-26T10:44:29.253 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.5280000000000002e-06 2024-04-26T10:44:29.253 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.253 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.253 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:29.253 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.530694+0000", 2024-04-26T10:44:29.253 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.017701009 2024-04-26T10:44:29.253 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.253 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.253 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:29.253 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.530737+0000", 2024-04-26T10:44:29.254 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2069e-05 2024-04-26T10:44:29.254 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.254 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.254 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:29.254 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533297+0000", 2024-04-26T10:44:29.254 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.002560189 2024-04-26T10:44:29.254 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.254 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.254 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:29.254 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533318+0000", 2024-04-26T10:44:29.254 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1469999999999999e-05 2024-04-26T10:44:29.254 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.254 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.255 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:29.255 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533359+0000", 2024-04-26T10:44:29.255 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0676999999999997e-05 2024-04-26T10:44:29.255 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.255 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:29.255 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.255 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.255 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.255 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:324 3.13 3:ceffbd45:::200.0000000a:head [write 1306876~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:29.255 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.512996+0000", 2024-04-26T10:44:29.255 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 2.7351841339999998, 2024-04-26T10:44:29.255 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021240868999999999, 2024-04-26T10:44:29.255 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:29.255 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.256 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:29.256 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.256 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:29.256 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.512996+0000", 2024-04-26T10:44:29.256 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.256 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.256 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.256 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:29.256 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.512996+0000", 2024-04-26T10:44:29.257 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.257 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.257 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.257 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:29.258 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.512995+0000", 2024-04-26T10:44:29.258 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:44:29.258 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.258 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.258 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:29.258 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.512999+0000", 2024-04-26T10:44:29.258 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7479999999999999e-06 2024-04-26T10:44:29.259 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.259 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.259 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:29.259 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513002+0000", 2024-04-26T10:44:29.259 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0809999999999998e-06 2024-04-26T10:44:29.259 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.259 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.259 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.259 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513005+0000", 2024-04-26T10:44:29.259 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.852e-06 2024-04-26T10:44:29.259 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.259 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.259 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:29.259 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.531109+0000", 2024-04-26T10:44:29.259 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018104250999999998 2024-04-26T10:44:29.260 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.260 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.260 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:29.260 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.531154+0000", 2024-04-26T10:44:29.260 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4681999999999997e-05 2024-04-26T10:44:29.260 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.260 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.260 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:29.260 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534163+0000", 2024-04-26T10:44:29.260 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0030088039999999999 2024-04-26T10:44:29.260 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.260 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.260 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:29.261 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534190+0000", 2024-04-26T10:44:29.261 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7271e-05 2024-04-26T10:44:29.261 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.261 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.261 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:29.261 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534236+0000", 2024-04-26T10:44:29.261 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6383e-05 2024-04-26T10:44:29.261 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.261 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:29.261 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.261 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.261 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.261 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:325 3.13 3:ceffbd45:::200.0000000a:head [write 1308279~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:29.261 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513022+0000", 2024-04-26T10:44:29.261 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 2.735157144, 2024-04-26T10:44:29.262 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021276212999999999, 2024-04-26T10:44:29.262 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:29.262 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.262 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:29.262 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.262 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:29.262 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513022+0000", 2024-04-26T10:44:29.262 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.262 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.262 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.262 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:29.262 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513022+0000", 2024-04-26T10:44:29.262 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.262 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.263 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.263 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:29.263 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513022+0000", 2024-04-26T10:44:29.263 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:29.263 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.263 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.263 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:29.263 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513025+0000", 2024-04-26T10:44:29.263 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.345e-06 2024-04-26T10:44:29.263 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.263 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.264 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:29.264 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513028+0000", 2024-04-26T10:44:29.264 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8240000000000001e-06 2024-04-26T10:44:29.264 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.264 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.264 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.264 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513031+0000", 2024-04-26T10:44:29.264 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8009999999999999e-06 2024-04-26T10:44:29.265 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.265 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.265 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:29.265 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.531588+0000", 2024-04-26T10:44:29.265 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018557015999999999 2024-04-26T10:44:29.265 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.265 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.265 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:29.265 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.531636+0000", 2024-04-26T10:44:29.265 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7540000000000002e-05 2024-04-26T10:44:29.265 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.265 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.265 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:29.265 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534242+0000", 2024-04-26T10:44:29.265 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0026059270000000001 2024-04-26T10:44:29.266 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.266 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.266 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:29.266 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534266+0000", 2024-04-26T10:44:29.266 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4493000000000001e-05 2024-04-26T10:44:29.266 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.266 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.266 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:29.266 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534299+0000", 2024-04-26T10:44:29.266 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2527999999999998e-05 2024-04-26T10:44:29.266 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.266 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:29.267 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.267 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.267 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.267 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:326 3.13 3:ceffbd45:::200.0000000a:head [write 1309682~2254 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:29.267 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513037+0000", 2024-04-26T10:44:29.267 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 2.7351429299999999, 2024-04-26T10:44:29.267 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021329988000000001, 2024-04-26T10:44:29.267 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:29.267 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.267 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:29.267 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.267 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:29.268 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513037+0000", 2024-04-26T10:44:29.268 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.268 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.268 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.268 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:29.268 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513037+0000", 2024-04-26T10:44:29.268 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.268 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.268 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.268 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:29.268 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513036+0000", 2024-04-26T10:44:29.268 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967296 2024-04-26T10:44:29.268 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.268 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.269 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:29.269 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513039+0000", 2024-04-26T10:44:29.269 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.278e-06 2024-04-26T10:44:29.269 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.269 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.269 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:29.269 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513042+0000", 2024-04-26T10:44:29.269 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3000000000000002e-06 2024-04-26T10:44:29.269 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.269 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.269 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.269 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513045+0000", 2024-04-26T10:44:29.269 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6970000000000002e-06 2024-04-26T10:44:29.270 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.270 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.270 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:29.270 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.531917+0000", 2024-04-26T10:44:29.270 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018872521999999999 2024-04-26T10:44:29.270 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.270 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.270 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:29.270 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.531960+0000", 2024-04-26T10:44:29.270 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.32e-05 2024-04-26T10:44:29.270 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.270 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.270 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:29.271 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534303+0000", 2024-04-26T10:44:29.271 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0023428049999999999 2024-04-26T10:44:29.271 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.271 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.271 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:29.271 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534332+0000", 2024-04-26T10:44:29.271 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8872000000000001e-05 2024-04-26T10:44:29.271 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.271 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.271 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:29.271 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534367+0000", 2024-04-26T10:44:29.271 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4548000000000002e-05 2024-04-26T10:44:29.271 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.272 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:29.272 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.272 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.272 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.272 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:327 3.13 3:ceffbd45:::200.0000000a:head [write 1311936~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:29.272 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513051+0000", 2024-04-26T10:44:29.272 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 2.7351283579999999, 2024-04-26T10:44:29.272 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021375795999999999, 2024-04-26T10:44:29.272 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:29.272 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.272 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:29.272 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.272 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:29.272 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513051+0000", 2024-04-26T10:44:29.273 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.273 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.273 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.273 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:29.273 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513051+0000", 2024-04-26T10:44:29.273 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.273 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.273 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.273 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:29.273 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513051+0000", 2024-04-26T10:44:29.273 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:29.273 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.273 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.273 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:29.274 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513060+0000", 2024-04-26T10:44:29.274 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7360000000000007e-06 2024-04-26T10:44:29.274 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.274 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.274 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:29.274 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513067+0000", 2024-04-26T10:44:29.274 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.2620000000000001e-06 2024-04-26T10:44:29.274 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.274 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.274 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.274 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513071+0000", 2024-04-26T10:44:29.274 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4959999999999998e-06 2024-04-26T10:44:29.274 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.274 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.275 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:29.275 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.532393+0000", 2024-04-26T10:44:29.275 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.019321584999999999 2024-04-26T10:44:29.275 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.275 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.275 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:29.275 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.532456+0000", 2024-04-26T10:44:29.275 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2669999999999995e-05 2024-04-26T10:44:29.275 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.275 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.275 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:29.275 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534371+0000", 2024-04-26T10:44:29.276 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001915047 2024-04-26T10:44:29.276 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.276 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.276 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:29.276 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534392+0000", 2024-04-26T10:44:29.276 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1225000000000001e-05 2024-04-26T10:44:29.276 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.276 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.276 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:29.276 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534427+0000", 2024-04-26T10:44:29.276 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5091e-05 2024-04-26T10:44:29.276 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.276 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:29.276 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.277 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.277 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.277 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:328 3.13 3:ceffbd45:::200.0000000a:head [write 1313335~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:29.277 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513079+0000", 2024-04-26T10:44:29.277 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 2.735100171, 2024-04-26T10:44:29.277 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022173196999999999, 2024-04-26T10:44:29.277 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:29.277 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.277 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:29.277 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.277 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:29.277 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513079+0000", 2024-04-26T10:44:29.277 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.277 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.278 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.278 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:29.278 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513079+0000", 2024-04-26T10:44:29.278 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.278 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.278 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.278 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:29.278 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513079+0000", 2024-04-26T10:44:29.278 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:29.278 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.278 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.278 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:29.278 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513082+0000", 2024-04-26T10:44:29.279 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6309999999999999e-06 2024-04-26T10:44:29.279 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.279 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.279 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:29.279 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513089+0000", 2024-04-26T10:44:29.279 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7170000000000002e-06 2024-04-26T10:44:29.279 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.279 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.279 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.279 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513096+0000", 2024-04-26T10:44:29.279 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.2479999999999999e-06 2024-04-26T10:44:29.279 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.279 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.279 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:29.280 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.532884+0000", 2024-04-26T10:44:29.280 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.019787967 2024-04-26T10:44:29.280 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.280 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.280 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:29.280 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.532932+0000", 2024-04-26T10:44:29.280 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8467999999999997e-05 2024-04-26T10:44:29.280 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.280 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.280 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:29.280 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535181+0000", 2024-04-26T10:44:29.280 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022492689999999999 2024-04-26T10:44:29.280 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.281 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.281 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:29.281 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535206+0000", 2024-04-26T10:44:29.281 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4711000000000001e-05 2024-04-26T10:44:29.281 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.281 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.281 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:29.281 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535253+0000", 2024-04-26T10:44:29.281 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6501000000000001e-05 2024-04-26T10:44:29.281 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.281 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:29.281 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.281 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.281 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.282 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:329 3.13 3:ceffbd45:::200.0000000a:head [write 1314738~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:29.282 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513103+0000", 2024-04-26T10:44:29.282 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 2.735076898, 2024-04-26T10:44:29.282 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022212274000000001, 2024-04-26T10:44:29.282 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:29.282 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.282 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:29.282 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.282 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:29.282 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513103+0000", 2024-04-26T10:44:29.282 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.282 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.282 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.282 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:29.283 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513103+0000", 2024-04-26T10:44:29.283 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.283 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.283 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.283 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:29.283 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513102+0000", 2024-04-26T10:44:29.283 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:29.283 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.283 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.283 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:29.283 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513106+0000", 2024-04-26T10:44:29.283 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1889999999999999e-06 2024-04-26T10:44:29.283 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.283 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.283 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:29.284 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513113+0000", 2024-04-26T10:44:29.284 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.328e-06 2024-04-26T10:44:29.284 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.284 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.284 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.284 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513118+0000", 2024-04-26T10:44:29.284 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6149999999999999e-06 2024-04-26T10:44:29.284 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.284 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.284 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:29.284 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533387+0000", 2024-04-26T10:44:29.284 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020269862 2024-04-26T10:44:29.284 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.284 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.285 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:29.285 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533445+0000", 2024-04-26T10:44:29.285 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7568999999999997e-05 2024-04-26T10:44:29.285 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.285 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.285 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:29.285 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535257+0000", 2024-04-26T10:44:29.285 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00181237 2024-04-26T10:44:29.285 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.285 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.285 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:29.285 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535280+0000", 2024-04-26T10:44:29.285 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.2578999999999998e-05 2024-04-26T10:44:29.285 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.286 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.286 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:29.286 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535315+0000", 2024-04-26T10:44:29.286 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5132000000000002e-05 2024-04-26T10:44:29.286 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.286 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:29.286 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.286 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.286 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.286 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:330 3.13 3:ceffbd45:::200.0000000a:head [write 1316140~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:29.286 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:29.286 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 2.73504002, 2024-04-26T10:44:29.286 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022245654, 2024-04-26T10:44:29.286 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:29.287 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.287 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:29.287 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.287 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:29.287 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:29.287 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.287 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.287 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.287 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:29.287 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:29.287 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.287 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.287 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.287 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:29.288 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513139+0000", 2024-04-26T10:44:29.288 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:29.288 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.288 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.288 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:29.288 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513149+0000", 2024-04-26T10:44:29.288 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7550000000000006e-06 2024-04-26T10:44:29.288 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.288 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.288 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:29.288 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513157+0000", 2024-04-26T10:44:29.288 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1089999999999998e-06 2024-04-26T10:44:29.288 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.288 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.289 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.289 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513167+0000", 2024-04-26T10:44:29.289 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0539e-05 2024-04-26T10:44:29.289 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.289 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.289 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:29.289 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533830+0000", 2024-04-26T10:44:29.289 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020662852999999998 2024-04-26T10:44:29.289 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.289 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.289 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:29.289 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533875+0000", 2024-04-26T10:44:29.289 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.5071999999999998e-05 2024-04-26T10:44:29.289 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.289 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.290 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:29.290 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535319+0000", 2024-04-26T10:44:29.290 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001443578 2024-04-26T10:44:29.290 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.290 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.290 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:29.290 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535346+0000", 2024-04-26T10:44:29.290 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7415000000000001e-05 2024-04-26T10:44:29.290 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.290 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.290 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:29.290 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535385+0000", 2024-04-26T10:44:29.290 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8912999999999998e-05 2024-04-26T10:44:29.290 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.291 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:29.291 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.291 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.291 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.291 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:331 3.13 3:ceffbd45:::200.0000000a:head [write 1318049~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:29.291 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:29.291 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 2.7350006919999998, 2024-04-26T10:44:29.291 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023524521, 2024-04-26T10:44:29.292 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:29.292 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.292 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:29.292 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.292 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:29.292 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:29.292 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.292 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.292 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.292 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:29.292 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:29.292 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.292 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.292 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.293 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:29.293 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513178+0000", 2024-04-26T10:44:29.293 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:29.293 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.293 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.293 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:29.293 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513183+0000", 2024-04-26T10:44:29.293 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2549999999999999e-06 2024-04-26T10:44:29.293 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.293 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.293 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:29.293 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513190+0000", 2024-04-26T10:44:29.293 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8460000000000002e-06 2024-04-26T10:44:29.293 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.294 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.294 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.294 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513195+0000", 2024-04-26T10:44:29.294 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3630000000000002e-06 2024-04-26T10:44:29.294 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.294 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.294 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:29.294 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534463+0000", 2024-04-26T10:44:29.294 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021267823000000002 2024-04-26T10:44:29.294 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.294 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.294 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:29.294 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534520+0000", 2024-04-26T10:44:29.294 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7510000000000003e-05 2024-04-26T10:44:29.295 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.295 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.295 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:29.295 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536634+0000", 2024-04-26T10:44:29.295 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0021138900000000002 2024-04-26T10:44:29.295 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.295 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.295 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:29.295 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536663+0000", 2024-04-26T10:44:29.295 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8884e-05 2024-04-26T10:44:29.295 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.295 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.295 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:29.295 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536703+0000", 2024-04-26T10:44:29.295 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0479000000000003e-05 2024-04-26T10:44:29.296 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.296 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:29.296 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.296 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.296 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.296 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:332 3.13 3:ceffbd45:::200.0000000a:head [write 1319462~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:29.296 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:29.296 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 2.7349658589999999, 2024-04-26T10:44:29.296 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024543230999999999, 2024-04-26T10:44:29.296 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:29.296 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.296 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:29.296 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.296 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:29.297 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:29.297 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.297 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.297 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.297 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:29.297 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:29.297 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.297 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.297 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.297 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:29.297 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513213+0000", 2024-04-26T10:44:29.297 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:29.297 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.297 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.297 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:29.298 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513217+0000", 2024-04-26T10:44:29.298 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:44:29.298 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.298 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.298 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:29.298 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513229+0000", 2024-04-26T10:44:29.298 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2051e-05 2024-04-26T10:44:29.298 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.298 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.298 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.298 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513236+0000", 2024-04-26T10:44:29.298 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4470000000000003e-06 2024-04-26T10:44:29.298 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.299 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.299 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:29.299 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534891+0000", 2024-04-26T10:44:29.299 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021655863000000001 2024-04-26T10:44:29.299 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.299 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.299 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:29.299 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534933+0000", 2024-04-26T10:44:29.299 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1596e-05 2024-04-26T10:44:29.299 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.299 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.299 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:29.299 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537677+0000", 2024-04-26T10:44:29.300 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027440989999999998 2024-04-26T10:44:29.300 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.300 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.300 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:29.300 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537721+0000", 2024-04-26T10:44:29.300 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3813999999999998e-05 2024-04-26T10:44:29.300 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.300 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.300 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:29.300 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537757+0000", 2024-04-26T10:44:29.300 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6022999999999997e-05 2024-04-26T10:44:29.300 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.300 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:29.300 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.301 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.301 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.301 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:333 3.13 3:ceffbd45:::200.0000000a:head [write 1320870~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:29.301 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:29.301 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 2.7349229400000001, 2024-04-26T10:44:29.301 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024557151999999999, 2024-04-26T10:44:29.301 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:29.301 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.301 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:29.301 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.301 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:29.301 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:29.301 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.302 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.302 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.302 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:29.302 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:29.302 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.302 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.302 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.302 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:29.302 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513256+0000", 2024-04-26T10:44:29.302 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:29.302 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.302 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.302 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:29.302 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513260+0000", 2024-04-26T10:44:29.303 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6550000000000002e-06 2024-04-26T10:44:29.303 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.303 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.303 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:29.303 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513273+0000", 2024-04-26T10:44:29.303 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2965e-05 2024-04-26T10:44:29.303 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.303 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.303 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.303 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513279+0000", 2024-04-26T10:44:29.303 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:44:29.303 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.303 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.303 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:29.304 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535411+0000", 2024-04-26T10:44:29.304 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022132233000000001 2024-04-26T10:44:29.304 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.304 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.304 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:29.304 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535479+0000", 2024-04-26T10:44:29.304 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7554999999999999e-05 2024-04-26T10:44:29.304 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.304 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.304 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:29.304 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537762+0000", 2024-04-26T10:44:29.304 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022836499999999999 2024-04-26T10:44:29.304 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.304 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.304 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:29.305 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537783+0000", 2024-04-26T10:44:29.305 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0364e-05 2024-04-26T10:44:29.305 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.305 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.305 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:29.305 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537814+0000", 2024-04-26T10:44:29.305 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1170000000000001e-05 2024-04-26T10:44:29.305 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.305 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:29.305 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.305 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.305 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.305 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:334 3.13 3:ceffbd45:::200.0000000a:head [write 1322273~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:29.305 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:29.306 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 2.733086181, 2024-04-26T10:44:29.306 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022778731999999999, 2024-04-26T10:44:29.306 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:29.306 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.306 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:29.306 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.306 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:29.306 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:29.306 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.306 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.306 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.306 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:29.306 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:29.306 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.306 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.307 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.307 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:29.307 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:29.307 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:29.307 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.307 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.307 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:29.307 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515099+0000", 2024-04-26T10:44:29.307 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6599999999999998e-06 2024-04-26T10:44:29.307 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.307 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.307 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:29.307 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515112+0000", 2024-04-26T10:44:29.307 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2707e-05 2024-04-26T10:44:29.308 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.308 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.308 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.308 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515120+0000", 2024-04-26T10:44:29.308 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8509999999999999e-06 2024-04-26T10:44:29.308 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.308 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.308 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:29.308 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535792+0000", 2024-04-26T10:44:29.308 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020672209 2024-04-26T10:44:29.308 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.308 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.308 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:29.308 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535833+0000", 2024-04-26T10:44:29.309 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1415000000000002e-05 2024-04-26T10:44:29.309 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.309 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.309 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:29.309 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537818+0000", 2024-04-26T10:44:29.309 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0019850900000000001 2024-04-26T10:44:29.309 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.309 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.309 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:29.309 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537839+0000", 2024-04-26T10:44:29.309 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0068000000000002e-05 2024-04-26T10:44:29.309 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.309 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.310 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:29.310 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537872+0000", 2024-04-26T10:44:29.310 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3680999999999998e-05 2024-04-26T10:44:29.310 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.310 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:29.310 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.310 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.310 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.310 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:335 3.13 3:ceffbd45:::200.0000000a:head [write 1325230~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:29.310 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:29.310 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 2.7330470820000001, 2024-04-26T10:44:29.310 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023487081, 2024-04-26T10:44:29.310 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:29.310 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.311 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:29.311 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.311 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:29.311 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:29.311 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.311 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.311 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.311 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:29.311 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:29.311 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.311 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.311 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.311 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:29.311 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515132+0000", 2024-04-26T10:44:29.311 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:29.312 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.312 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.312 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:29.312 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515136+0000", 2024-04-26T10:44:29.312 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0860000000000004e-06 2024-04-26T10:44:29.312 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.312 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.312 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:29.312 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515143+0000", 2024-04-26T10:44:29.312 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.0400000000000004e-06 2024-04-26T10:44:29.312 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.312 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.312 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.312 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515149+0000", 2024-04-26T10:44:29.313 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0789999999999997e-06 2024-04-26T10:44:29.313 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.313 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.313 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:29.313 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536200+0000", 2024-04-26T10:44:29.313 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021050993 2024-04-26T10:44:29.313 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.313 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.313 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:29.313 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536253+0000", 2024-04-26T10:44:29.313 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.2643999999999999e-05 2024-04-26T10:44:29.313 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.313 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.313 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:29.314 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538560+0000", 2024-04-26T10:44:29.314 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0023073389999999998 2024-04-26T10:44:29.314 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.314 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.314 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:29.314 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538584+0000", 2024-04-26T10:44:29.314 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3893999999999999e-05 2024-04-26T10:44:29.314 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.314 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.314 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:29.314 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538620+0000", 2024-04-26T10:44:29.314 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5611000000000002e-05 2024-04-26T10:44:29.314 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.314 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:29.315 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.315 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.315 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.315 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:336 3.13 3:ceffbd45:::200.0000000a:head [write 1327147~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:29.315 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:29.315 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 2.7317146270000001, 2024-04-26T10:44:29.315 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027687066, 2024-04-26T10:44:29.315 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:29.315 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.315 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:29.315 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.315 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:29.315 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:29.315 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.316 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.316 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.316 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:29.316 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:29.316 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.316 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.317 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.317 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:29.317 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516464+0000", 2024-04-26T10:44:29.317 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:29.317 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.317 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.317 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:29.317 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516491+0000", 2024-04-26T10:44:29.317 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6539000000000001e-05 2024-04-26T10:44:29.317 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.317 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.317 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:29.317 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516500+0000", 2024-04-26T10:44:29.318 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5480000000000007e-06 2024-04-26T10:44:29.318 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.318 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.318 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.318 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516511+0000", 2024-04-26T10:44:29.318 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0719e-05 2024-04-26T10:44:29.318 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.318 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.318 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:29.318 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536737+0000", 2024-04-26T10:44:29.318 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020225770000000001 2024-04-26T10:44:29.318 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.318 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.318 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:29.319 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536783+0000", 2024-04-26T10:44:29.319 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6168999999999998e-05 2024-04-26T10:44:29.319 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.319 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.319 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:29.319 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544080+0000", 2024-04-26T10:44:29.319 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0072966799999999998 2024-04-26T10:44:29.319 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.319 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.319 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:29.319 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544111+0000", 2024-04-26T10:44:29.319 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1056999999999998e-05 2024-04-26T10:44:29.319 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.319 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.320 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:29.320 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544152+0000", 2024-04-26T10:44:29.320 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1452000000000002e-05 2024-04-26T10:44:29.320 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.320 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:29.320 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.320 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.320 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.320 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:337 3.13 3:ceffbd45:::200.0000000a:head [write 1342136~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:29.320 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:29.320 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 2.7316616890000001, 2024-04-26T10:44:29.320 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027711237, 2024-04-26T10:44:29.320 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:29.320 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.321 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:29.321 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.321 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:29.321 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:29.321 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.321 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.321 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.321 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:29.321 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:29.321 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.321 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.321 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.321 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:29.321 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516517+0000", 2024-04-26T10:44:29.322 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:29.322 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.322 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.322 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:29.322 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516521+0000", 2024-04-26T10:44:29.322 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6200000000000001e-06 2024-04-26T10:44:29.322 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.322 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.322 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:29.322 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516528+0000", 2024-04-26T10:44:29.322 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8639999999999998e-06 2024-04-26T10:44:29.322 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.322 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.323 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.323 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516533+0000", 2024-04-26T10:44:29.323 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6310000000000002e-06 2024-04-26T10:44:29.323 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.323 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.323 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:29.323 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537231+0000", 2024-04-26T10:44:29.323 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020698613000000001 2024-04-26T10:44:29.323 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.323 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.323 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:29.323 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537273+0000", 2024-04-26T10:44:29.323 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1529000000000002e-05 2024-04-26T10:44:29.323 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.324 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.324 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:29.324 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544157+0000", 2024-04-26T10:44:29.324 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068847090000000001 2024-04-26T10:44:29.324 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.324 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.324 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:29.324 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544180+0000", 2024-04-26T10:44:29.324 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.2532e-05 2024-04-26T10:44:29.324 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.324 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.324 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:29.324 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544229+0000", 2024-04-26T10:44:29.324 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9190000000000002e-05 2024-04-26T10:44:29.324 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.325 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:29.325 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.325 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.325 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.325 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:338 3.13 3:ceffbd45:::200.0000000a:head [write 1344569~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:29.325 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:29.325 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 2.7309954360000002, 2024-04-26T10:44:29.325 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027105598000000002, 2024-04-26T10:44:29.325 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:29.325 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.325 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:29.325 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.325 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:29.325 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:29.325 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.325 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.326 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.326 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:29.326 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:29.326 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.326 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.326 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.326 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:29.326 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517183+0000", 2024-04-26T10:44:29.326 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:29.326 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.326 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.326 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:29.326 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517188+0000", 2024-04-26T10:44:29.327 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7389999999999999e-06 2024-04-26T10:44:29.327 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.327 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.327 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:29.327 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517199+0000", 2024-04-26T10:44:29.327 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0652000000000001e-05 2024-04-26T10:44:29.327 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.327 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.327 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.327 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517206+0000", 2024-04-26T10:44:29.327 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6610000000000003e-06 2024-04-26T10:44:29.327 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.327 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.327 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:29.328 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537905+0000", 2024-04-26T10:44:29.328 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020699662000000001 2024-04-26T10:44:29.328 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.328 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.328 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:29.328 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537956+0000", 2024-04-26T10:44:29.328 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0954e-05 2024-04-26T10:44:29.328 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.328 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.328 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:29.328 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544233+0000", 2024-04-26T10:44:29.328 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062773009999999999 2024-04-26T10:44:29.328 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.328 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.329 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:29.329 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544258+0000", 2024-04-26T10:44:29.329 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4434999999999999e-05 2024-04-26T10:44:29.329 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.329 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.329 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:29.329 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544290+0000", 2024-04-26T10:44:29.329 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1918000000000002e-05 2024-04-26T10:44:29.329 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.329 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:29.329 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.329 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.329 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.330 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:339 3.13 3:ceffbd45:::200.0000000a:head [write 1346485~4322 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:29.330 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:29.330 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 2.7300569430000001, 2024-04-26T10:44:29.330 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026221617999999999, 2024-04-26T10:44:29.330 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:29.330 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.330 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:29.330 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.330 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:29.330 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:29.330 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.330 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.330 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.331 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:29.331 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:29.331 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.331 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.331 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.331 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:29.331 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518122+0000", 2024-04-26T10:44:29.331 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:29.331 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.331 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.331 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:29.331 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518129+0000", 2024-04-26T10:44:29.331 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.43e-06 2024-04-26T10:44:29.331 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.332 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.332 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:29.332 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518138+0000", 2024-04-26T10:44:29.332 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9129999999999992e-06 2024-04-26T10:44:29.332 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.332 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.332 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.332 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518144+0000", 2024-04-26T10:44:29.332 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.1419999999999998e-06 2024-04-26T10:44:29.332 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.332 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.332 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:29.332 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538232+0000", 2024-04-26T10:44:29.332 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020087383 2024-04-26T10:44:29.332 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.333 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.333 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:29.333 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538274+0000", 2024-04-26T10:44:29.333 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2602999999999999e-05 2024-04-26T10:44:29.333 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.333 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.333 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:29.333 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544294+0000", 2024-04-26T10:44:29.333 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060194059999999997 2024-04-26T10:44:29.333 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.333 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.333 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:29.333 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544314+0000", 2024-04-26T10:44:29.333 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0091000000000001e-05 2024-04-26T10:44:29.334 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.334 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.334 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:29.334 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544344+0000", 2024-04-26T10:44:29.334 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0446e-05 2024-04-26T10:44:29.334 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.334 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:29.334 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.334 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.334 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.334 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:340 3.13 3:ceffbd45:::200.0000000a:head [write 1350807~2768 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:29.334 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:29.334 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 2.7275727070000002, 2024-04-26T10:44:29.335 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023795594, 2024-04-26T10:44:29.335 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:29.335 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.335 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:29.335 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.335 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:29.335 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:29.335 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.335 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.335 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.335 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:29.335 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:29.335 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.335 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.335 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.336 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:29.336 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520606+0000", 2024-04-26T10:44:29.336 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:29.336 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.336 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.336 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:29.336 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520612+0000", 2024-04-26T10:44:29.336 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.835e-06 2024-04-26T10:44:29.336 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.336 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.336 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:29.336 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520622+0000", 2024-04-26T10:44:29.336 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0173999999999999e-05 2024-04-26T10:44:29.336 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.336 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.337 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.337 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520629+0000", 2024-04-26T10:44:29.337 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7460000000000003e-06 2024-04-26T10:44:29.337 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.337 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.337 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:29.337 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538651+0000", 2024-04-26T10:44:29.337 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018022474 2024-04-26T10:44:29.337 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.337 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.337 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:29.337 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538697+0000", 2024-04-26T10:44:29.337 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6183999999999997e-05 2024-04-26T10:44:29.337 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.338 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.338 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:29.338 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544348+0000", 2024-04-26T10:44:29.338 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0056503509999999996 2024-04-26T10:44:29.338 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.338 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.338 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:29.338 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544369+0000", 2024-04-26T10:44:29.338 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1064999999999999e-05 2024-04-26T10:44:29.338 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.338 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.339 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:29.339 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544403+0000", 2024-04-26T10:44:29.339 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3695000000000002e-05 2024-04-26T10:44:29.339 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.339 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:29.339 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.339 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.339 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.339 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:341 3.13 3:ceffbd45:::200.0000000a:head [write 1353575~3816 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:29.339 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:29.339 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 2.7268374519999998, 2024-04-26T10:44:29.339 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023114967, 2024-04-26T10:44:29.339 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:29.339 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.340 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:29.340 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.340 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:29.340 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:29.340 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.340 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.340 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.340 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:29.340 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:29.340 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.340 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.340 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.340 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:29.340 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521341+0000", 2024-04-26T10:44:29.341 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:29.341 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.341 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.341 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:29.341 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521349+0000", 2024-04-26T10:44:29.341 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1550000000000001e-06 2024-04-26T10:44:29.341 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.341 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.341 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:29.341 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521358+0000", 2024-04-26T10:44:29.341 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.1500000000000005e-06 2024-04-26T10:44:29.341 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.341 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.341 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.341 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521364+0000", 2024-04-26T10:44:29.342 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3289999999999999e-06 2024-04-26T10:44:29.342 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.342 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.342 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:29.342 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539010+0000", 2024-04-26T10:44:29.342 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.017645965999999999 2024-04-26T10:44:29.342 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.342 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.342 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:29.342 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539051+0000", 2024-04-26T10:44:29.342 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.053e-05 2024-04-26T10:44:29.342 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.342 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.342 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:29.343 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544407+0000", 2024-04-26T10:44:29.343 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053560209999999999 2024-04-26T10:44:29.343 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.343 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.343 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:29.343 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544427+0000", 2024-04-26T10:44:29.343 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0228e-05 2024-04-26T10:44:29.343 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.343 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.343 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:29.343 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544457+0000", 2024-04-26T10:44:29.343 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0375e-05 2024-04-26T10:44:29.343 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.343 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:29.344 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.344 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.344 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.344 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11582 4.2f 4:f76ba295:::10000003252.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:29.344 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:29.344 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.25322190700000002, 2024-04-26T10:44:29.344 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024553994999999999, 2024-04-26T10:44:29.344 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:29.344 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.344 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:29.344 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:29.344 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:29.344 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11582 2024-04-26T10:44:29.344 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.345 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:29.345 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.345 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:29.345 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:29.345 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.345 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.345 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.345 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:29.345 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:29.345 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:29.345 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.345 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.345 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:29.346 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994957+0000", 2024-04-26T10:44:29.346 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:29.346 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.346 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.346 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:29.346 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002755+0000", 2024-04-26T10:44:29.346 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0077984719999999999 2024-04-26T10:44:29.346 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.346 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.346 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:29.346 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002770+0000", 2024-04-26T10:44:29.346 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4956e-05 2024-04-26T10:44:29.346 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.346 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.347 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.347 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002777+0000", 2024-04-26T10:44:29.347 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1899999999999998e-06 2024-04-26T10:44:29.347 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.347 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.347 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:29.347 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002833+0000", 2024-04-26T10:44:29.347 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5189999999999998e-05 2024-04-26T10:44:29.347 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.347 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.347 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:29.347 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002977+0000", 2024-04-26T10:44:29.347 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014444100000000001 2024-04-26T10:44:29.347 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.347 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.348 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:29.348 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.003108+0000", 2024-04-26T10:44:29.348 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000131068 2024-04-26T10:44:29.348 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.348 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.348 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:29.348 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.009040+0000", 2024-04-26T10:44:29.348 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059314149999999998 2024-04-26T10:44:29.348 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.348 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.348 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:29.348 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019462+0000", 2024-04-26T10:44:29.348 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010422803 2024-04-26T10:44:29.348 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.348 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.349 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:29.349 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019490+0000", 2024-04-26T10:44:29.349 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7773999999999999e-05 2024-04-26T10:44:29.349 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:29.349 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:29.349 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:29.349 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019512+0000", 2024-04-26T10:44:29.349 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1611999999999999e-05 2024-04-26T10:44:29.349 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.349 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:29.349 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.349 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:29.349 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:29.349 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:29.352 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:29.349+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:29.352 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:29.371 INFO:tasks.workunit.client.0.smithi049.stdout:2/289: dwrite d6/d32/d4a/f4e [0,4194304] 0 2024-04-26T10:44:29.371 INFO:tasks.workunit.client.0.smithi049.stdout:6/288: dwrite da/dd/de/d26/d22/f25 [0,4194304] 0 2024-04-26T10:44:29.371 INFO:tasks.workunit.client.0.smithi049.stdout:6/289: chown da/dd/de/d26/d22/f54 22 1 2024-04-26T10:44:29.371 INFO:tasks.workunit.client.0.smithi049.stdout:8/297: truncate d2/f14 2274484 0 2024-04-26T10:44:29.371 INFO:tasks.workunit.client.0.smithi049.stdout:4/353: dread de/d1d/f59 [0,4194304] 0 2024-04-26T10:44:29.371 INFO:tasks.workunit.client.0.smithi049.stdout:0/292: rmdir d8/db/d26/d39 39 2024-04-26T10:44:29.371 INFO:tasks.workunit.client.0.smithi049.stdout:4/354: sync 2024-04-26T10:44:29.372 INFO:tasks.workunit.client.0.smithi049.stdout:9/376: symlink d2/d1a/l7c 0 2024-04-26T10:44:29.372 INFO:tasks.workunit.client.0.smithi049.stdout:5/330: rename d7/d1d/d34/f79 to d7/d1d/d34/f8e 0 2024-04-26T10:44:29.372 INFO:tasks.workunit.client.0.smithi049.stdout:4/355: fsync de/d1b/f26 0 2024-04-26T10:44:29.372 INFO:tasks.workunit.client.0.smithi049.stdout:6/290: rmdir da/dd/de/d26/d29 39 2024-04-26T10:44:29.372 INFO:tasks.workunit.client.0.smithi049.stdout:9/377: symlink d2/d1a/l7d 0 2024-04-26T10:44:29.372 INFO:tasks.workunit.client.0.smithi049.stdout:4/356: readlink de/d20/l33 0 2024-04-26T10:44:29.372 INFO:tasks.workunit.client.0.smithi049.stdout:8/298: truncate d2/d16/d19/f55 802541 0 2024-04-26T10:44:29.372 INFO:tasks.workunit.client.0.smithi049.stdout:6/291: rmdir da/d4a 39 2024-04-26T10:44:29.372 INFO:tasks.workunit.client.0.smithi049.stdout:5/331: link d7/d14/d18/f89 d7/d1d/d1f/f8f 0 2024-04-26T10:44:29.372 INFO:tasks.workunit.client.0.smithi049.stdout:9/378: symlink d2/d1a/d1b/d1f/d34/l7e 0 2024-04-26T10:44:29.372 INFO:tasks.workunit.client.0.smithi049.stdout:0/293: truncate d8/db/d11/d1b/d4d/f64 895643 0 2024-04-26T10:44:29.372 INFO:tasks.workunit.client.0.smithi049.stdout:8/299: write d2/d16/d19/f4d [337374,40665] 0 2024-04-26T10:44:29.372 INFO:tasks.workunit.client.0.smithi049.stdout:7/324: dwrite d2/d3/de/d1c/f3e [0,4194304] 0 2024-04-26T10:44:29.372 INFO:tasks.workunit.client.0.smithi049.stdout:9/379: creat d2/d1a/d1b/f7f x:0 0 0 2024-04-26T10:44:29.373 INFO:tasks.workunit.client.0.smithi049.stdout:4/357: dread de/d3f/f4a [0,4194304] 0 2024-04-26T10:44:29.373 INFO:tasks.workunit.client.0.smithi049.stdout:0/294: mkdir d8/db/d26/d6f 0 2024-04-26T10:44:29.373 INFO:tasks.workunit.client.0.smithi049.stdout:8/300: chown d2/d17/c29 652 1 2024-04-26T10:44:29.373 INFO:tasks.workunit.client.0.smithi049.stdout:9/380: getdents d2/d40 0 2024-04-26T10:44:29.373 INFO:tasks.workunit.client.0.smithi049.stdout:7/325: rename d2/d3/de/c42 to d2/d3/de/c6c 0 2024-04-26T10:44:29.373 INFO:tasks.workunit.client.0.smithi049.stdout:4/358: link lb de/d20/d24/l68 0 2024-04-26T10:44:29.373 INFO:tasks.workunit.client.0.smithi049.stdout:9/381: unlink d2/d1a/df/c29 0 2024-04-26T10:44:29.373 INFO:tasks.workunit.client.0.smithi049.stdout:9/382: sync 2024-04-26T10:44:29.373 INFO:tasks.workunit.client.0.smithi049.stdout:5/332: dwrite d7/d1d/d34/d37/f4f [0,4194304] 0 2024-04-26T10:44:29.373 INFO:tasks.workunit.client.0.smithi049.stdout:7/326: truncate d2/dd/f66 1010438 0 2024-04-26T10:44:29.373 INFO:tasks.workunit.client.0.smithi049.stdout:4/359: symlink de/d20/d24/l69 0 2024-04-26T10:44:29.373 INFO:tasks.workunit.client.0.smithi049.stdout:0/295: dread d8/f18 [0,4194304] 0 2024-04-26T10:44:29.373 INFO:tasks.workunit.client.0.smithi049.stdout:9/383: creat d2/d1a/d1b/d7a/f80 x:0 0 0 2024-04-26T10:44:29.373 INFO:tasks.workunit.client.0.smithi049.stdout:7/327: rmdir d2/dd/d38 39 2024-04-26T10:44:29.374 INFO:tasks.workunit.client.0.smithi049.stdout:1/308: dread d1e/d20/d26/d3c/f4f [0,4194304] 0 2024-04-26T10:44:29.374 INFO:tasks.workunit.client.0.smithi049.stdout:6/292: dread da/d4a/f2f [0,4194304] 0 2024-04-26T10:44:29.374 INFO:tasks.workunit.client.0.smithi049.stdout:5/333: symlink d7/d14/l90 0 2024-04-26T10:44:29.374 INFO:tasks.workunit.client.0.smithi049.stdout:4/360: truncate f7 5037945 0 2024-04-26T10:44:29.374 INFO:tasks.workunit.client.0.smithi049.stdout:8/301: dwrite d2/d1a/f1e [0,4194304] 0 2024-04-26T10:44:29.374 INFO:tasks.workunit.client.0.smithi049.stdout:5/334: dread - d7/d14/f17 zero size 2024-04-26T10:44:29.374 INFO:tasks.workunit.client.0.smithi049.stdout:0/296: unlink d8/db/f49 0 2024-04-26T10:44:29.374 INFO:tasks.workunit.client.0.smithi049.stdout:7/328: mknod d2/d3/de/d1c/c6d 0 2024-04-26T10:44:29.374 INFO:tasks.workunit.client.0.smithi049.stdout:9/384: write d2/d1a/df/f56 [1529733,41250] 0 2024-04-26T10:44:29.374 INFO:tasks.workunit.client.0.smithi049.stdout:0/297: chown d8/d1e/l37 42309148 1 2024-04-26T10:44:29.374 INFO:tasks.workunit.client.0.smithi049.stdout:7/329: fdatasync d2/dd/d48/d5c/f62 0 2024-04-26T10:44:29.374 INFO:tasks.workunit.client.0.smithi049.stdout:1/309: creat d1e/d20/d26/d3c/d54/d59/f5e x:0 0 0 2024-04-26T10:44:29.374 INFO:tasks.workunit.client.0.smithi049.stdout:1/310: sync 2024-04-26T10:44:29.374 INFO:tasks.workunit.client.0.smithi049.stdout:2/290: dread d6/d9/db/f13 [0,4194304] 0 2024-04-26T10:44:29.375 INFO:tasks.workunit.client.0.smithi049.stdout:9/385: truncate d2/d1a/d1b/f52 580483 0 2024-04-26T10:44:29.375 INFO:tasks.workunit.client.0.smithi049.stdout:0/298: write d8/db/d26/f2d [4007128,13449] 0 2024-04-26T10:44:29.375 INFO:tasks.workunit.client.0.smithi049.stdout:7/330: symlink d2/d3/de/d1c/d4d/l6e 0 2024-04-26T10:44:29.375 INFO:tasks.workunit.client.0.smithi049.stdout:2/291: creat d6/d9/db/d34/f50 x:0 0 0 2024-04-26T10:44:29.375 INFO:tasks.workunit.client.0.smithi049.stdout:9/386: chown d2/d1a/d1b/d1f/c50 35 1 2024-04-26T10:44:29.375 INFO:tasks.workunit.client.0.smithi049.stdout:4/361: dwrite f8 [0,4194304] 0 2024-04-26T10:44:29.375 INFO:tasks.workunit.client.0.smithi049.stdout:6/293: dwrite da/dd/de/d26/d22/f55 [0,4194304] 0 2024-04-26T10:44:29.375 INFO:tasks.workunit.client.0.smithi049.stdout:7/331: chown d2/dd/d25/l28 66918 1 2024-04-26T10:44:29.375 INFO:tasks.workunit.client.0.smithi049.stdout:0/299: dread - d8/db/d11/d1b/f4a zero size 2024-04-26T10:44:29.375 INFO:tasks.workunit.client.0.smithi049.stdout:5/335: dwrite d7/d14/f17 [0,4194304] 0 2024-04-26T10:44:29.375 INFO:tasks.workunit.client.0.smithi049.stdout:4/362: chown de/d1b/d5e 153896602 1 2024-04-26T10:44:29.375 INFO:tasks.workunit.client.0.smithi049.stdout:4/363: unlink de/l1f 0 2024-04-26T10:44:29.375 INFO:tasks.workunit.client.0.smithi049.stdout:5/336: chown d7/f74 602 1 2024-04-26T10:44:29.375 INFO:tasks.workunit.client.0.smithi049.stdout:8/302: dwrite d2/df/d18/d2a/f35 [0,4194304] 0 2024-04-26T10:44:29.376 INFO:tasks.workunit.client.0.smithi049.stdout:9/387: write d2/d25/d74/f6c [1716485,67731] 0 2024-04-26T10:44:29.376 INFO:tasks.workunit.client.0.smithi049.stdout:6/294: creat da/dd/d47/f61 x:0 0 0 2024-04-26T10:44:29.376 INFO:tasks.workunit.client.0.smithi049.stdout:7/332: truncate d2/dd/f26 2293033 0 2024-04-26T10:44:29.376 INFO:tasks.workunit.client.0.smithi049.stdout:9/388: stat d2/d25/f6b 0 2024-04-26T10:44:29.376 INFO:tasks.workunit.client.0.smithi049.stdout:8/303: readlink d2/df/d10/l3c 0 2024-04-26T10:44:29.376 INFO:tasks.workunit.client.0.smithi049.stdout:0/300: truncate d8/d42/f6c 578034 0 2024-04-26T10:44:29.376 INFO:tasks.workunit.client.0.smithi049.stdout:5/337: chown d7/d1d/d34/c57 0 1 2024-04-26T10:44:29.376 INFO:tasks.workunit.client.0.smithi049.stdout:1/311: dwrite d1e/d20/d26/f30 [0,4194304] 0 2024-04-26T10:44:29.376 INFO:tasks.workunit.client.0.smithi049.stdout:9/389: chown d2/l18 403131719 1 2024-04-26T10:44:29.376 INFO:tasks.workunit.client.0.smithi049.stdout:8/304: symlink d2/df/l5c 0 2024-04-26T10:44:29.376 INFO:tasks.workunit.client.0.smithi049.stdout:7/333: write d2/d3/de/f4b [712437,96952] 0 2024-04-26T10:44:29.376 INFO:tasks.workunit.client.0.smithi049.stdout:2/292: dread d6/d9/db/f1c [0,4194304] 0 2024-04-26T10:44:29.376 INFO:tasks.workunit.client.0.smithi049.stdout:9/390: symlink d2/d40/l81 0 2024-04-26T10:44:29.376 INFO:tasks.workunit.client.0.smithi049.stdout:0/301: symlink d8/db/d26/d6f/l70 0 2024-04-26T10:44:29.377 INFO:tasks.workunit.client.0.smithi049.stdout:8/305: symlink d2/d17/l5d 0 2024-04-26T10:44:29.377 INFO:tasks.workunit.client.0.smithi049.stdout:5/338: rename d7/d1d/d34/d37 to d7/d1d/d1f/d4e/d65/d6f/d91 0 2024-04-26T10:44:29.377 INFO:tasks.workunit.client.0.smithi049.stdout:0/302: readlink d8/ld 0 2024-04-26T10:44:29.377 INFO:tasks.workunit.client.0.smithi049.stdout:4/364: dwrite de/d1b/f40 [0,4194304] 0 2024-04-26T10:44:29.377 INFO:tasks.workunit.client.0.smithi049.stdout:3/287: dread d3/d6/f10 [4194304,4194304] 0 2024-04-26T10:44:29.377 INFO:tasks.workunit.client.0.smithi049.stdout:6/295: dwrite da/dd/f5c [0,4194304] 0 2024-04-26T10:44:29.377 INFO:tasks.workunit.client.0.smithi049.stdout:7/334: rename d2/dd/d45/f55 to d2/dd/d38/f6f 0 2024-04-26T10:44:29.377 INFO:tasks.workunit.client.0.smithi049.stdout:9/391: mknod d2/d1a/d1b/d1f/d64/c82 0 2024-04-26T10:44:29.377 INFO:tasks.workunit.client.0.smithi049.stdout:5/339: unlink d7/d14/d18/c68 0 2024-04-26T10:44:29.377 INFO:tasks.workunit.client.0.smithi049.stdout:4/365: truncate de/f63 700789 0 2024-04-26T10:44:29.377 INFO:tasks.workunit.client.0.smithi049.stdout:1/312: dwrite d1e/d20/d26/f30 [0,4194304] 0 2024-04-26T10:44:29.377 INFO:tasks.workunit.client.0.smithi049.stdout:4/366: chown de 4 1 2024-04-26T10:44:29.377 INFO:tasks.workunit.client.0.smithi049.stdout:6/296: write da/dd/de/d26/f45 [1814843,114348] 0 2024-04-26T10:44:29.377 INFO:tasks.workunit.client.0.smithi049.stdout:5/340: write d7/d1d/d20/f24 [2802079,7398] 0 2024-04-26T10:44:29.378 INFO:tasks.workunit.client.0.smithi049.stdout:9/392: mknod d2/d1a/df/c83 0 2024-04-26T10:44:29.378 INFO:tasks.workunit.client.0.smithi049.stdout:6/297: mkdir da/dd/d62 0 2024-04-26T10:44:29.378 INFO:tasks.workunit.client.0.smithi049.stdout:2/293: dread d6/d32/d4a/f4e [0,4194304] 0 2024-04-26T10:44:29.378 INFO:tasks.workunit.client.0.smithi049.stdout:8/306: read f1 [4821382,58679] 0 2024-04-26T10:44:29.378 INFO:tasks.workunit.client.0.smithi049.stdout:6/298: dread - da/dd/de/d26/d22/d4c/f5b zero size 2024-04-26T10:44:29.378 INFO:tasks.workunit.client.0.smithi049.stdout:2/294: truncate d6/d9/db/d34/d38/d3f/f45 1838205 0 2024-04-26T10:44:29.378 INFO:tasks.workunit.client.0.smithi049.stdout:5/341: creat d7/d1d/d1f/d4e/d65/f92 x:0 0 0 2024-04-26T10:44:29.378 INFO:tasks.workunit.client.0.smithi049.stdout:1/313: rename d1e/f2d to d1e/d20/d4d/f5f 0 2024-04-26T10:44:29.378 INFO:tasks.workunit.client.0.smithi049.stdout:2/295: stat d6/d9/db/d34/d38/d3f/f42 0 2024-04-26T10:44:29.378 INFO:tasks.workunit.client.0.smithi049.stdout:8/307: mkdir d2/d1a/d27/d5e 0 2024-04-26T10:44:29.378 INFO:tasks.workunit.client.0.smithi049.stdout:6/299: creat da/d4a/f63 x:0 0 0 2024-04-26T10:44:29.378 INFO:tasks.workunit.client.0.smithi049.stdout:8/308: sync 2024-04-26T10:44:29.378 INFO:tasks.workunit.client.0.smithi049.stdout:2/296: fsync d6/d32/f3a 0 2024-04-26T10:44:29.379 INFO:tasks.workunit.client.0.smithi049.stdout:8/309: fdatasync d2/df/f3f 0 2024-04-26T10:44:29.379 INFO:tasks.workunit.client.0.smithi049.stdout:6/300: stat da/dd/de/d42/d5a/l2c 0 2024-04-26T10:44:29.379 INFO:tasks.workunit.client.0.smithi049.stdout:6/301: sync 2024-04-26T10:44:29.379 INFO:tasks.workunit.client.0.smithi049.stdout:1/314: unlink d1e/d20/d26/f47 0 2024-04-26T10:44:29.379 INFO:tasks.workunit.client.0.smithi049.stdout:4/367: link de/c18 de/d20/d4b/c6a 0 2024-04-26T10:44:29.379 INFO:tasks.workunit.client.0.smithi049.stdout:2/297: write d6/d9/db/f13 [1655124,47648] 0 2024-04-26T10:44:29.379 INFO:tasks.workunit.client.0.smithi049.stdout:8/310: truncate f1 6035725 0 2024-04-26T10:44:29.379 INFO:tasks.workunit.client.0.smithi049.stdout:5/342: creat d7/d1d/d1f/d4e/d77/f93 x:0 0 0 2024-04-26T10:44:29.379 INFO:tasks.workunit.client.0.smithi049.stdout:2/298: readlink d6/l36 0 2024-04-26T10:44:29.379 INFO:tasks.workunit.client.0.smithi049.stdout:1/315: creat d1e/d20/d4d/f60 x:0 0 0 2024-04-26T10:44:29.379 INFO:tasks.workunit.client.0.smithi049.stdout:8/311: readlink d2/df/l5c 0 2024-04-26T10:44:29.379 INFO:tasks.workunit.client.0.smithi049.stdout:9/393: write d2/d1a/d1b/d1f/f3d [1855358,109158] 0 2024-04-26T10:44:29.379 INFO:tasks.workunit.client.0.smithi049.stdout:2/299: truncate f4 2628268 0 2024-04-26T10:44:29.379 INFO:tasks.workunit.client.0.smithi049.stdout:6/302: creat da/dd/de/d26/f64 x:0 0 0 2024-04-26T10:44:29.379 INFO:tasks.workunit.client.0.smithi049.stdout:1/316: mknod d1e/d20/d26/d3c/d54/d59/c61 0 2024-04-26T10:44:29.380 INFO:tasks.workunit.client.0.smithi049.stdout:9/394: fdatasync d2/d1a/d42/f67 0 2024-04-26T10:44:29.380 INFO:tasks.workunit.client.0.smithi049.stdout:2/300: chown d6/f8 308 1 2024-04-26T10:44:29.380 INFO:tasks.workunit.client.0.smithi049.stdout:8/312: fdatasync d2/df/d18/d2a/f2b 0 2024-04-26T10:44:29.380 INFO:tasks.workunit.client.0.smithi049.stdout:1/317: mkdir d1e/d62 0 2024-04-26T10:44:29.380 INFO:tasks.workunit.client.0.smithi049.stdout:9/395: chown d2/d1a/d1b/d1f/d64 2922861 1 2024-04-26T10:44:29.380 INFO:tasks.workunit.client.0.smithi049.stdout:8/313: write d2/d16/f52 [34535,130332] 0 2024-04-26T10:44:29.380 INFO:tasks.workunit.client.0.smithi049.stdout:2/301: unlink f0 0 2024-04-26T10:44:29.380 INFO:tasks.workunit.client.0.smithi049.stdout:7/335: dread d2/dd/d38/f40 [0,4194304] 0 2024-04-26T10:44:29.380 INFO:tasks.workunit.client.0.smithi049.stdout:9/396: fsync d2/d1a/f2c 0 2024-04-26T10:44:29.380 INFO:tasks.workunit.client.0.smithi049.stdout:6/303: creat da/dd/de/d42/d5a/f65 x:0 0 0 2024-04-26T10:44:29.380 INFO:tasks.workunit.client.0.smithi049.stdout:8/314: fdatasync d2/df/d10/d23/f31 0 2024-04-26T10:44:29.380 INFO:tasks.workunit.client.0.smithi049.stdout:2/302: creat d6/d32/d4a/f51 x:0 0 0 2024-04-26T10:44:29.380 INFO:tasks.workunit.client.0.smithi049.stdout:7/336: stat d2/dd/d45/c47 0 2024-04-26T10:44:29.380 INFO:tasks.workunit.client.0.smithi049.stdout:4/368: dwrite de/d20/d24/f61 [0,4194304] 0 2024-04-26T10:44:29.381 INFO:tasks.workunit.client.0.smithi049.stdout:1/318: rename d1e/d20/d26/d37/f42 to d1e/d20/d26/f63 0 2024-04-26T10:44:29.381 INFO:tasks.workunit.client.0.smithi049.stdout:9/397: write d2/d1a/d1b/d1f/f3d [1935304,23177] 0 2024-04-26T10:44:29.381 INFO:tasks.workunit.client.0.smithi049.stdout:6/304: unlink da/dd/de/d26/c2e 0 2024-04-26T10:44:29.381 INFO:tasks.workunit.client.0.smithi049.stdout:2/303: creat d6/d9/f52 x:0 0 0 2024-04-26T10:44:29.381 INFO:tasks.workunit.client.0.smithi049.stdout:4/369: creat de/d3f/d48/d62/f6b x:0 0 0 2024-04-26T10:44:29.381 INFO:tasks.workunit.client.0.smithi049.stdout:7/337: rmdir d2/dd/d38/d5d 0 2024-04-26T10:44:29.381 INFO:tasks.workunit.client.0.smithi049.stdout:2/304: symlink d6/d32/l53 0 2024-04-26T10:44:29.381 INFO:tasks.workunit.client.0.smithi049.stdout:4/370: write de/d1b/f40 [2391570,29571] 0 2024-04-26T10:44:29.381 INFO:tasks.workunit.client.0.smithi049.stdout:7/338: mknod d2/dd/d48/c70 0 2024-04-26T10:44:29.381 INFO:tasks.workunit.client.0.smithi049.stdout:2/305: truncate d6/d9/f19 2589519 0 2024-04-26T10:44:29.381 INFO:tasks.workunit.client.0.smithi049.stdout:8/315: read d2/d16/f2e [67033,48008] 0 2024-04-26T10:44:29.381 INFO:tasks.workunit.client.0.smithi049.stdout:1/319: dwrite d1e/f1f [0,4194304] 0 2024-04-26T10:44:29.381 INFO:tasks.workunit.client.0.smithi049.stdout:6/305: read da/fc [2093151,100528] 0 2024-04-26T10:44:29.381 INFO:tasks.workunit.client.0.smithi049.stdout:4/371: rmdir de/d1d 39 2024-04-26T10:44:29.381 INFO:tasks.workunit.client.0.smithi049.stdout:7/339: readlink d2/d3/de/l58 0 2024-04-26T10:44:29.382 INFO:tasks.workunit.client.0.smithi049.stdout:2/306: creat d6/d9/db/d11/f54 x:0 0 0 2024-04-26T10:44:29.382 INFO:tasks.workunit.client.0.smithi049.stdout:6/306: rename f0 to da/dd/d47/f66 0 2024-04-26T10:44:29.382 INFO:tasks.workunit.client.0.smithi049.stdout:1/320: symlink d1e/d20/d26/d3c/l64 0 2024-04-26T10:44:29.382 INFO:tasks.workunit.client.0.smithi049.stdout:7/340: symlink d2/dd/d25/d27/l71 0 2024-04-26T10:44:29.382 INFO:tasks.workunit.client.0.smithi049.stdout:0/303: dread f2 [0,4194304] 0 2024-04-26T10:44:29.382 INFO:tasks.workunit.client.0.smithi049.stdout:4/372: dread - de/d20/d38/f58 zero size 2024-04-26T10:44:29.382 INFO:tasks.workunit.client.0.smithi049.stdout:2/307: mknod d6/d30/c55 0 2024-04-26T10:44:29.382 INFO:tasks.workunit.client.0.smithi049.stdout:0/304: mkdir d8/d66/d71 0 2024-04-26T10:44:29.382 INFO:tasks.workunit.client.0.smithi049.stdout:1/321: write d1e/d20/d26/d37/f58 [996662,41291] 0 2024-04-26T10:44:29.382 INFO:tasks.workunit.client.0.smithi049.stdout:4/373: mkdir de/d1b/d5e/d6c 0 2024-04-26T10:44:29.382 INFO:tasks.workunit.client.0.smithi049.stdout:2/308: unlink d6/d32/f3a 0 2024-04-26T10:44:29.382 INFO:tasks.workunit.client.0.smithi049.stdout:6/307: mkdir da/dd/d62/d67 0 2024-04-26T10:44:29.382 INFO:tasks.workunit.client.0.smithi049.stdout:4/374: fdatasync de/f63 0 2024-04-26T10:44:29.382 INFO:tasks.workunit.client.0.smithi049.stdout:1/322: chown d1e/d20/c24 47399896 1 2024-04-26T10:44:29.383 INFO:tasks.workunit.client.0.smithi049.stdout:6/308: symlink da/dd/de/d26/l68 0 2024-04-26T10:44:29.383 INFO:tasks.workunit.client.0.smithi049.stdout:1/323: chown d1e/d20/f41 3 1 2024-04-26T10:44:29.383 INFO:tasks.workunit.client.0.smithi049.stdout:2/309: getdents d6/d9/db/df 0 2024-04-26T10:44:29.383 INFO:tasks.workunit.client.0.smithi049.stdout:6/309: dread - da/dd/de/d11/f3e zero size 2024-04-26T10:44:29.383 INFO:tasks.workunit.client.0.smithi049.stdout:3/288: dread d3/d19/d8/d55/f2d [0,4194304] 0 2024-04-26T10:44:29.383 INFO:tasks.workunit.client.0.smithi049.stdout:2/310: mknod d6/d32/d4a/c56 0 2024-04-26T10:44:29.383 INFO:tasks.workunit.client.0.smithi049.stdout:1/324: rename f9 to d1e/d20/d26/d3c/d54/d59/f65 0 2024-04-26T10:44:29.383 INFO:tasks.workunit.client.0.smithi049.stdout:6/310: write da/f19 [2737709,62790] 0 2024-04-26T10:44:29.383 INFO:tasks.workunit.client.0.smithi049.stdout:2/311: chown d6/d9/db/d11/c4f 2700571 1 2024-04-26T10:44:29.383 INFO:tasks.workunit.client.0.smithi049.stdout:6/311: creat da/dd/de/d42/f69 x:0 0 0 2024-04-26T10:44:29.383 INFO:tasks.workunit.client.0.smithi049.stdout:0/305: dwrite d8/db/f25 [0,4194304] 0 2024-04-26T10:44:29.383 INFO:tasks.workunit.client.0.smithi049.stdout:2/312: creat d6/d9/db/d11/f57 x:0 0 0 2024-04-26T10:44:29.383 INFO:tasks.workunit.client.0.smithi049.stdout:4/375: getdents de/d1b/d5e 0 2024-04-26T10:44:29.383 INFO:tasks.workunit.client.0.smithi049.stdout:0/306: truncate d8/db/d11/d1b/f4a 221745 0 2024-04-26T10:44:29.384 INFO:tasks.workunit.client.0.smithi049.stdout:4/376: symlink de/d1b/d5e/l6d 0 2024-04-26T10:44:29.384 INFO:tasks.workunit.client.0.smithi049.stdout:3/289: dwrite d3/d6/f12 [0,4194304] 0 2024-04-26T10:44:29.384 INFO:tasks.workunit.client.0.smithi049.stdout:5/343: dread d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d60/f72 [0,4194304] 0 2024-04-26T10:44:29.384 INFO:tasks.workunit.client.0.smithi049.stdout:4/377: link de/d20/d24/l29 de/l6e 0 2024-04-26T10:44:29.384 INFO:tasks.workunit.client.0.smithi049.stdout:6/312: dread da/dd/de/d26/d29/f52 [0,4194304] 0 2024-04-26T10:44:29.384 INFO:tasks.workunit.client.0.smithi049.stdout:2/313: dwrite d6/d9/db/d11/f1d [8388608,4194304] 0 2024-04-26T10:44:29.384 INFO:tasks.workunit.client.0.smithi049.stdout:6/313: mknod da/dd/de/d42/d5a/c6a 0 2024-04-26T10:44:29.384 INFO:tasks.workunit.client.0.smithi049.stdout:2/314: creat d6/d9/db/d34/d38/d3f/f58 x:0 0 0 2024-04-26T10:44:29.384 INFO:tasks.workunit.client.0.smithi049.stdout:4/378: rename de/d20/d24/d50/c51 to de/d3f/d48/c6f 0 2024-04-26T10:44:29.384 INFO:tasks.workunit.client.0.smithi049.stdout:6/314: chown f7 2344818 1 2024-04-26T10:44:29.384 INFO:tasks.workunit.client.0.smithi049.stdout:2/315: symlink d6/d9/db/d35/l59 0 2024-04-26T10:44:29.384 INFO:tasks.workunit.client.0.smithi049.stdout:4/379: rename de/d1d/l5b to de/d3f/l70 0 2024-04-26T10:44:29.384 INFO:tasks.workunit.client.0.smithi049.stdout:3/290: dread d3/d19/d8/f57 [0,4194304] 0 2024-04-26T10:44:29.384 INFO:tasks.workunit.client.0.smithi049.stdout:4/380: fdatasync de/d1b/f26 0 2024-04-26T10:44:29.385 INFO:tasks.workunit.client.0.smithi049.stdout:6/315: rename da/dd/de/f4e to da/dd/f6b 0 2024-04-26T10:44:29.385 INFO:tasks.workunit.client.0.smithi049.stdout:3/291: creat d3/d19/d26/d5f/f69 x:0 0 0 2024-04-26T10:44:29.385 INFO:tasks.workunit.client.0.smithi049.stdout:3/292: write d3/d23/d2f/f3c [1996803,83353] 0 2024-04-26T10:44:29.385 INFO:tasks.workunit.client.0.smithi049.stdout:9/398: sync 2024-04-26T10:44:29.385 INFO:tasks.workunit.client.0.smithi049.stdout:9/399: dread - d2/d1a/d42/f61 zero size 2024-04-26T10:44:29.385 INFO:tasks.workunit.client.0.smithi049.stdout:6/316: dwrite da/dd/de/d42/d5a/f65 [0,4194304] 0 2024-04-26T10:44:29.385 INFO:tasks.workunit.client.0.smithi049.stdout:4/381: dwrite de/d1b/f1c [0,4194304] 0 2024-04-26T10:44:29.385 INFO:tasks.workunit.client.0.smithi049.stdout:4/382: mknod de/c71 0 2024-04-26T10:44:29.385 INFO:tasks.workunit.client.0.smithi049.stdout:7/341: dread d2/d3/f20 [0,4194304] 0 2024-04-26T10:44:29.385 INFO:tasks.workunit.client.0.smithi049.stdout:3/293: dwrite d3/d19/d8/d55/d46/d4e/f28 [4194304,4194304] 0 2024-04-26T10:44:29.385 INFO:tasks.workunit.client.0.smithi049.stdout:4/383: mkdir de/d1b/d5e/d72 0 2024-04-26T10:44:29.385 INFO:tasks.workunit.client.0.smithi049.stdout:7/342: link d2/d3/de/f4b d2/d3/f72 0 2024-04-26T10:44:29.385 INFO:tasks.workunit.client.0.smithi049.stdout:9/400: dread d2/d1a/d1b/d1f/d64/f6e [0,4194304] 0 2024-04-26T10:44:29.385 INFO:tasks.workunit.client.0.smithi049.stdout:7/343: fsync d2/dd/f11 0 2024-04-26T10:44:29.385 INFO:tasks.workunit.client.0.smithi049.stdout:9/401: rename d2/d1a/df to d2/d1a/df/d84 22 2024-04-26T10:44:29.386 INFO:tasks.workunit.client.0.smithi049.stdout:9/402: chown d2/d40/d53/l5a 13066825 1 2024-04-26T10:44:29.386 INFO:tasks.workunit.client.0.smithi049.stdout:7/344: rename d2/d3/de/l63 to d2/dd/d38/l73 0 2024-04-26T10:44:29.386 INFO:tasks.workunit.client.0.smithi049.stdout:6/317: dread da/dd/de/d26/d29/f31 [4194304,4194304] 0 2024-04-26T10:44:29.386 INFO:tasks.workunit.client.0.smithi049.stdout:9/403: chown d2/d40/l81 108545 1 2024-04-26T10:44:29.386 INFO:tasks.workunit.client.0.smithi049.stdout:6/318: creat da/f6c x:0 0 0 2024-04-26T10:44:29.386 INFO:tasks.workunit.client.0.smithi049.stdout:3/294: dwrite d3/d19/d8/f57 [0,4194304] 0 2024-04-26T10:44:29.386 INFO:tasks.workunit.client.0.smithi049.stdout:6/319: dread - da/dd/d47/f49 zero size 2024-04-26T10:44:29.386 INFO:tasks.workunit.client.0.smithi049.stdout:7/345: rename d2/d3/de/d1c/f4e to d2/f74 0 2024-04-26T10:44:29.386 INFO:tasks.workunit.client.0.smithi049.stdout:3/295: mkdir d3/d23/d2f/d6a 0 2024-04-26T10:44:29.386 INFO:tasks.workunit.client.0.smithi049.stdout:6/320: creat da/dd/d62/f6d x:0 0 0 2024-04-26T10:44:29.386 INFO:tasks.workunit.client.0.smithi049.stdout:8/316: dread d2/df/f36 [0,4194304] 0 2024-04-26T10:44:29.386 INFO:tasks.workunit.client.0.smithi049.stdout:9/404: creat d2/d1a/d1b/d1f/d64/f85 x:0 0 0 2024-04-26T10:44:29.386 INFO:tasks.workunit.client.0.smithi049.stdout:7/346: creat d2/dd/d25/f75 x:0 0 0 2024-04-26T10:44:29.386 INFO:tasks.workunit.client.0.smithi049.stdout:8/317: write d2/df/d18/d2a/f48 [175356,72814] 0 2024-04-26T10:44:29.390 INFO:tasks.workunit.client.0.smithi049.stdout:9/405: creat d2/d40/d53/f86 x:0 0 0 2024-04-26T10:44:29.390 INFO:tasks.workunit.client.0.smithi049.stdout:3/296: rename d3/d19 to d3/d23/d2f/d6a/d6b 0 2024-04-26T10:44:29.391 INFO:tasks.workunit.client.0.smithi049.stdout:7/347: symlink d2/dd/d48/d5c/l76 0 2024-04-26T10:44:29.391 INFO:tasks.workunit.client.0.smithi049.stdout:8/318: creat d2/df/d10/d23/f5f x:0 0 0 2024-04-26T10:44:29.391 INFO:tasks.workunit.client.0.smithi049.stdout:1/325: dread f11 [0,4194304] 0 2024-04-26T10:44:29.391 INFO:tasks.workunit.client.0.smithi049.stdout:5/344: dread d7/d1d/d1f/d4e/d65/d6f/d91/d3e/f42 [0,4194304] 0 2024-04-26T10:44:29.391 INFO:tasks.workunit.client.0.smithi049.stdout:1/326: chown d1e/d20/d26 27599758 1 2024-04-26T10:44:29.391 INFO:tasks.workunit.client.0.smithi049.stdout:7/348: write d2/dd/d25/d27/f57 [97717,130756] 0 2024-04-26T10:44:29.391 INFO:tasks.workunit.client.0.smithi049.stdout:8/319: rename d2/df/l5c to d2/d1a/d27/d5e/l60 0 2024-04-26T10:44:29.391 INFO:tasks.workunit.client.0.smithi049.stdout:5/345: symlink d7/d14/d18/d2b/l94 0 2024-04-26T10:44:29.391 INFO:tasks.workunit.client.0.smithi049.stdout:1/327: symlink d1e/d20/d26/d57/l66 0 2024-04-26T10:44:29.391 INFO:tasks.workunit.client.0.smithi049.stdout:2/316: dread f3 [0,4194304] 0 2024-04-26T10:44:29.391 INFO:tasks.workunit.client.0.smithi049.stdout:7/349: write d2/dd/d48/d5c/f62 [385384,95388] 0 2024-04-26T10:44:29.391 INFO:tasks.workunit.client.0.smithi049.stdout:5/346: mkdir d7/d1d/d1f/d95 0 2024-04-26T10:44:29.391 INFO:tasks.workunit.client.0.smithi049.stdout:8/320: write d2/d16/d19/f25 [872146,4783] 0 2024-04-26T10:44:29.391 INFO:tasks.workunit.client.0.smithi049.stdout:1/328: dread - d1e/d20/d26/f63 zero size 2024-04-26T10:44:29.392 INFO:tasks.workunit.client.0.smithi049.stdout:9/406: dwrite d2/d40/d53/f86 [0,4194304] 0 2024-04-26T10:44:29.392 INFO:tasks.workunit.client.0.smithi049.stdout:2/317: chown d6/d9/c28 747 1 2024-04-26T10:44:29.392 INFO:tasks.workunit.client.0.smithi049.stdout:6/321: dwrite da/d4a/f2f [0,4194304] 0 2024-04-26T10:44:29.392 INFO:tasks.workunit.client.0.smithi049.stdout:5/347: chown d7/d53/f7e 59254 1 2024-04-26T10:44:29.392 INFO:tasks.workunit.client.0.smithi049.stdout:8/321: read - d2/d16/d19/d42/f4e zero size 2024-04-26T10:44:29.392 INFO:tasks.workunit.client.0.smithi049.stdout:0/307: dread d8/f9 [0,4194304] 0 2024-04-26T10:44:29.392 INFO:tasks.workunit.client.0.smithi049.stdout:9/407: chown d2/d25/l55 69997890 1 2024-04-26T10:44:29.392 INFO:tasks.workunit.client.0.smithi049.stdout:5/348: chown d7/d14/d18/d48/f5f 5250 1 2024-04-26T10:44:29.392 INFO:tasks.workunit.client.0.smithi049.stdout:3/297: truncate d3/d23/d2f/d6a/d6b/d26/f41 135195 0 2024-04-26T10:44:29.392 INFO:tasks.workunit.client.0.smithi049.stdout:7/350: creat d2/d3/f77 x:0 0 0 2024-04-26T10:44:29.392 INFO:tasks.workunit.client.0.smithi049.stdout:0/308: creat d8/d1e/f72 x:0 0 0 2024-04-26T10:44:29.392 INFO:tasks.workunit.client.0.smithi049.stdout:8/322: symlink d2/d1a/d50/l61 0 2024-04-26T10:44:29.392 INFO:tasks.workunit.client.0.smithi049.stdout:9/408: write d2/d25/d74/f77 [270904,43558] 0 2024-04-26T10:44:29.392 INFO:tasks.workunit.client.0.smithi049.stdout:2/318: creat d6/d9/db/d34/f5a x:0 0 0 2024-04-26T10:44:29.393 INFO:tasks.workunit.client.0.smithi049.stdout:5/349: write d7/d1d/d1f/d4e/d77/f93 [641601,20144] 0 2024-04-26T10:44:29.393 INFO:tasks.workunit.client.0.smithi049.stdout:0/309: creat d8/db/d11/d1b/d4d/f73 x:0 0 0 2024-04-26T10:44:29.393 INFO:tasks.workunit.client.0.smithi049.stdout:3/298: mknod d3/d23/d2f/d6a/d6b/d26/d5f/c6c 0 2024-04-26T10:44:29.393 INFO:tasks.workunit.client.0.smithi049.stdout:7/351: link d2/d3/c43 d2/dd/d48/c78 0 2024-04-26T10:44:29.393 INFO:tasks.workunit.client.0.smithi049.stdout:9/409: dread - d2/d25/d74/f63 zero size 2024-04-26T10:44:29.393 INFO:tasks.workunit.client.0.smithi049.stdout:8/323: truncate d2/df/d18/d2a/f54 1014614 0 2024-04-26T10:44:29.393 INFO:tasks.workunit.client.0.smithi049.stdout:0/310: fdatasync d8/db/d11/d1b/f44 0 2024-04-26T10:44:29.393 INFO:tasks.workunit.client.0.smithi049.stdout:5/350: write d7/d1d/d1f/d4e/d77/f93 [1552892,18600] 0 2024-04-26T10:44:29.393 INFO:tasks.workunit.client.0.smithi049.stdout:1/329: dwrite d1e/d20/d26/f33 [0,4194304] 0 2024-04-26T10:44:29.393 INFO:tasks.workunit.client.0.smithi049.stdout:9/410: rmdir d2/d40/d5d 39 2024-04-26T10:44:29.393 INFO:tasks.workunit.client.0.smithi049.stdout:7/352: write d2/f2c [3063691,25737] 0 2024-04-26T10:44:29.394 INFO:tasks.workunit.client.0.smithi049.stdout:0/311: write d8/db/f25 [2416645,102265] 0 2024-04-26T10:44:29.394 INFO:tasks.workunit.client.0.smithi049.stdout:8/324: rmdir d2/d1a/d27/d5e 39 2024-04-26T10:44:29.394 INFO:tasks.workunit.client.0.smithi049.stdout:3/299: creat d3/d23/d2f/d6a/d6b/d26/f6d x:0 0 0 2024-04-26T10:44:29.394 INFO:tasks.workunit.client.0.smithi049.stdout:4/384: dread de/d1b/f2c [0,4194304] 0 2024-04-26T10:44:29.395 INFO:tasks.workunit.client.0.smithi049.stdout:9/411: getdents d2/d25/d74 0 2024-04-26T10:44:29.395 INFO:tasks.workunit.client.0.smithi049.stdout:7/353: dread d2/d3/de/f1e [0,4194304] 0 2024-04-26T10:44:29.395 INFO:tasks.workunit.client.0.smithi049.stdout:8/325: readlink d2/d1a/d27/d5e/l60 0 2024-04-26T10:44:29.396 INFO:tasks.workunit.client.0.smithi049.stdout:3/300: chown d3/d23/d2f/d6a/d6b/d8/f32 283 1 2024-04-26T10:44:29.396 INFO:tasks.workunit.client.0.smithi049.stdout:4/385: mkdir de/d1b/d5e/d72/d73 0 2024-04-26T10:44:29.397 INFO:tasks.workunit.client.0.smithi049.stdout:8/326: readlink d2/d1a/l53 0 2024-04-26T10:44:29.397 INFO:tasks.workunit.client.0.smithi049.stdout:7/354: fsync d2/dd/f12 0 2024-04-26T10:44:29.397 INFO:tasks.workunit.client.0.smithi049.stdout:0/312: dread d8/d42/f43 [0,4194304] 0 2024-04-26T10:44:29.398 INFO:tasks.workunit.client.0.smithi049.stdout:5/351: dwrite d7/d1d/d1f/d22/f35 [0,4194304] 0 2024-04-26T10:44:29.399 INFO:tasks.workunit.client.0.smithi049.stdout:4/386: write de/d20/d38/f3b [1709194,90414] 0 2024-04-26T10:44:29.399 INFO:tasks.workunit.client.0.smithi049.stdout:8/327: write d2/d16/f2e [1197928,42295] 0 2024-04-26T10:44:29.400 INFO:tasks.workunit.client.0.smithi049.stdout:3/301: chown d3/d23/d2f/d6a/d6b/d8/dd/f18 46 1 2024-04-26T10:44:29.401 INFO:tasks.workunit.client.0.smithi049.stdout:0/313: truncate d8/db/d11/d1c/f5b 1015008 0 2024-04-26T10:44:29.401 INFO:tasks.workunit.client.0.smithi049.stdout:0/314: chown d8/d66/d71 118 1 2024-04-26T10:44:29.402 INFO:tasks.workunit.client.0.smithi049.stdout:4/387: rename de/l43 to de/d20/d4b/l74 0 2024-04-26T10:44:29.402 INFO:tasks.workunit.client.0.smithi049.stdout:1/330: dwrite fe [0,4194304] 0 2024-04-26T10:44:29.403 INFO:tasks.workunit.client.0.smithi049.stdout:5/352: symlink d7/d1d/d1f/d4e/d65/d6f/d91/d3e/l96 0 2024-04-26T10:44:29.404 INFO:tasks.workunit.client.0.smithi049.stdout:3/302: mknod d3/d23/d2f/d6a/d6b/d8/d34/c6e 0 2024-04-26T10:44:29.404 INFO:tasks.workunit.client.0.smithi049.stdout:4/388: creat de/d3f/d52/f75 x:0 0 0 2024-04-26T10:44:29.404 INFO:tasks.workunit.client.0.smithi049.stdout:0/315: rename d8/db/d26/f38 to d8/f74 0 2024-04-26T10:44:29.405 INFO:tasks.workunit.client.0.smithi049.stdout:5/353: mknod d7/d1d/d1f/d4e/d65/d6f/d91/c97 0 2024-04-26T10:44:29.405 INFO:tasks.workunit.client.0.smithi049.stdout:4/389: mkdir de/d20/d4b/d76 0 2024-04-26T10:44:29.406 INFO:tasks.workunit.client.0.smithi049.stdout:0/316: dread - d8/db/d11/d1b/d4d/f73 zero size 2024-04-26T10:44:29.406 INFO:tasks.workunit.client.0.smithi049.stdout:8/328: dread d2/df/d18/d2a/f35 [0,4194304] 0 2024-04-26T10:44:29.406 INFO:tasks.workunit.client.0.smithi049.stdout:5/354: creat d7/d1d/d1f/d4e/f98 x:0 0 0 2024-04-26T10:44:29.406 INFO:tasks.workunit.client.0.smithi049.stdout:4/390: mknod de/d20/c77 0 2024-04-26T10:44:29.407 INFO:tasks.workunit.client.0.smithi049.stdout:8/329: creat d2/df/f62 x:0 0 0 2024-04-26T10:44:29.408 INFO:tasks.workunit.client.0.smithi049.stdout:8/330: readlink d2/df/d18/l4c 0 2024-04-26T10:44:29.408 INFO:tasks.workunit.client.0.smithi049.stdout:4/391: creat de/d1d/f78 x:0 0 0 2024-04-26T10:44:29.408 INFO:tasks.workunit.client.0.smithi049.stdout:3/303: link d3/d23/d2f/d6a/d6b/d8/d55/d2e/c5d d3/d23/d2f/d6a/d6b/d26/c6f 0 2024-04-26T10:44:29.412 INFO:tasks.workunit.client.0.smithi049.stdout:3/304: mkdir d3/d23/d2f/d6a/d6b/d26/d65/d70 0 2024-04-26T10:44:29.414 INFO:tasks.workunit.client.0.smithi049.stdout:2/319: dread f5 [0,4194304] 0 2024-04-26T10:44:29.414 INFO:tasks.workunit.client.0.smithi049.stdout:6/322: dread da/f19 [0,4194304] 0 2024-04-26T10:44:29.415 INFO:tasks.workunit.client.0.smithi049.stdout:0/317: dwrite d8/db/d11/d1b/d4d/f5e [0,4194304] 0 2024-04-26T10:44:29.416 INFO:tasks.workunit.client.0.smithi049.stdout:5/355: dwrite d7/f74 [0,4194304] 0 2024-04-26T10:44:29.416 INFO:tasks.workunit.client.0.smithi049.stdout:8/331: dwrite d2/fc [4194304,4194304] 0 2024-04-26T10:44:29.417 INFO:tasks.workunit.client.0.smithi049.stdout:0/318: fsync d8/d1e/f2a 0 2024-04-26T10:44:29.417 INFO:tasks.workunit.client.0.smithi049.stdout:2/320: readlink d6/d9/db/d34/d38/l4b 0 2024-04-26T10:44:29.418 INFO:tasks.workunit.client.0.smithi049.stdout:8/332: readlink d2/df/d18/l4c 0 2024-04-26T10:44:29.418 INFO:tasks.workunit.client.0.smithi049.stdout:4/392: dwrite de/d20/f22 [0,4194304] 0 2024-04-26T10:44:29.418 INFO:tasks.workunit.client.0.smithi049.stdout:6/323: truncate da/d4a/f63 366233 0 2024-04-26T10:44:29.422 INFO:tasks.workunit.client.0.smithi049.stdout:4/393: stat de/d1b/l57 0 2024-04-26T10:44:29.422 INFO:tasks.workunit.client.0.smithi049.stdout:2/321: dread - d6/d9/db/d34/d38/d3f/f58 zero size 2024-04-26T10:44:29.422 INFO:tasks.workunit.client.0.smithi049.stdout:6/324: truncate da/f6c 814128 0 2024-04-26T10:44:29.422 INFO:tasks.workunit.client.0.smithi049.stdout:2/322: fdatasync d6/f29 0 2024-04-26T10:44:29.422 INFO:tasks.workunit.client.0.smithi049.stdout:0/319: mknod d8/db/d26/c75 0 2024-04-26T10:44:29.422 INFO:tasks.workunit.client.0.smithi049.stdout:8/333: creat d2/df/d18/d30/f63 x:0 0 0 2024-04-26T10:44:29.423 INFO:tasks.workunit.client.0.smithi049.stdout:2/323: fsync d6/d32/d4a/f51 0 2024-04-26T10:44:29.423 INFO:tasks.workunit.client.0.smithi049.stdout:6/325: creat da/d4a/f6e x:0 0 0 2024-04-26T10:44:29.424 INFO:tasks.workunit.client.0.smithi049.stdout:3/305: dwrite d3/d23/d2f/d6a/d6b/d8/d55/d2e/f4c [0,4194304] 0 2024-04-26T10:44:29.425 INFO:tasks.workunit.client.0.smithi049.stdout:2/324: dread - d6/d9/db/df/f4c zero size 2024-04-26T10:44:29.426 INFO:tasks.workunit.client.0.smithi049.stdout:8/334: getdents d2/d17/d34/d40/d59 0 2024-04-26T10:44:29.426 INFO:tasks.workunit.client.0.smithi049.stdout:2/325: mknod d6/c5b 0 2024-04-26T10:44:29.426 INFO:tasks.workunit.client.0.smithi049.stdout:6/326: link da/dd/d47/f61 da/dd/de/d26/f6f 0 2024-04-26T10:44:29.426 INFO:tasks.workunit.client.0.smithi049.stdout:5/356: dwrite d7/d14/d18/d48/f49 [0,4194304] 0 2024-04-26T10:44:29.427 INFO:tasks.workunit.client.0.smithi049.stdout:3/306: symlink d3/d23/d2f/d6a/d6b/d8/d55/d46/l71 0 2024-04-26T10:44:29.427 INFO:tasks.workunit.client.0.smithi049.stdout:8/335: mkdir d2/d17/d34/d40/d64 0 2024-04-26T10:44:29.427 INFO:tasks.workunit.client.0.smithi049.stdout:6/327: mknod da/dd/de/d26/d29/c70 0 2024-04-26T10:44:29.428 INFO:tasks.workunit.client.0.smithi049.stdout:8/336: unlink d2/d16/d19/c20 0 2024-04-26T10:44:29.428 INFO:tasks.workunit.client.0.smithi049.stdout:3/307: readlink d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/l1d 0 2024-04-26T10:44:29.429 INFO:tasks.workunit.client.0.smithi049.stdout:8/337: write d2/f1b [1895419,76916] 0 2024-04-26T10:44:29.430 INFO:tasks.workunit.client.0.smithi049.stdout:8/338: write d2/d16/f56 [189542,74699] 0 2024-04-26T10:44:29.430 INFO:tasks.workunit.client.0.smithi049.stdout:4/394: dread de/f63 [0,4194304] 0 2024-04-26T10:44:29.431 INFO:tasks.workunit.client.0.smithi049.stdout:8/339: creat d2/d16/d19/d42/f65 x:0 0 0 2024-04-26T10:44:29.433 INFO:tasks.workunit.client.0.smithi049.stdout:6/328: dwrite da/dd/f5c [0,4194304] 0 2024-04-26T10:44:29.433 INFO:tasks.workunit.client.0.smithi049.stdout:8/340: creat d2/df/d10/f66 x:0 0 0 2024-04-26T10:44:29.435 INFO:tasks.workunit.client.0.smithi049.stdout:4/395: dwrite de/d1b/f34 [4194304,4194304] 0 2024-04-26T10:44:29.436 INFO:tasks.workunit.client.0.smithi049.stdout:6/329: dread da/dd/de/d42/d5a/f24 [0,4194304] 0 2024-04-26T10:44:29.436 INFO:tasks.workunit.client.0.smithi049.stdout:9/412: sync 2024-04-26T10:44:29.437 INFO:tasks.workunit.client.0.smithi049.stdout:3/308: sync 2024-04-26T10:44:29.438 INFO:tasks.workunit.client.0.smithi049.stdout:4/396: getdents de/d20/d38 0 2024-04-26T10:44:29.440 INFO:tasks.workunit.client.0.smithi049.stdout:9/413: truncate d2/d1a/f5e 765110 0 2024-04-26T10:44:29.440 INFO:tasks.workunit.client.0.smithi049.stdout:4/397: fsync f7 0 2024-04-26T10:44:29.440 INFO:tasks.workunit.client.0.smithi049.stdout:3/309: truncate d3/d23/d2f/d6a/d6b/d26/f6d 105797 0 2024-04-26T10:44:29.440 INFO:tasks.workunit.client.0.smithi049.stdout:6/330: read f8 [112807,129750] 0 2024-04-26T10:44:29.440 INFO:tasks.workunit.client.0.smithi049.stdout:0/320: dread d8/db/d26/f40 [0,4194304] 0 2024-04-26T10:44:29.440 INFO:tasks.workunit.client.0.smithi049.stdout:3/310: stat d3/d23/d2f/f3c 0 2024-04-26T10:44:29.441 INFO:tasks.workunit.client.0.smithi049.stdout:0/321: chown d8/db/f33 13303 1 2024-04-26T10:44:29.441 INFO:tasks.workunit.client.0.smithi049.stdout:4/398: dread de/d3f/f4a [0,4194304] 0 2024-04-26T10:44:29.442 INFO:tasks.workunit.client.0.smithi049.stdout:6/331: rename da/dd/de/d26/d29/c70 to da/dd/de/d42/c71 0 2024-04-26T10:44:29.443 INFO:tasks.workunit.client.0.smithi049.stdout:0/322: write d8/db/d11/d1c/f5b [327829,9460] 0 2024-04-26T10:44:29.443 INFO:tasks.workunit.client.0.smithi049.stdout:4/399: mknod de/d1b/d5e/d6c/c79 0 2024-04-26T10:44:29.443 INFO:tasks.workunit.client.0.smithi049.stdout:6/332: dread - da/d4a/f6e zero size 2024-04-26T10:44:29.444 INFO:tasks.workunit.client.0.smithi049.stdout:4/400: creat de/d1b/f7a x:0 0 0 2024-04-26T10:44:29.444 INFO:tasks.workunit.client.0.smithi049.stdout:0/323: write d8/db/d11/f32 [717265,3571] 0 2024-04-26T10:44:29.445 INFO:tasks.workunit.client.0.smithi049.stdout:1/331: dread fd [0,4194304] 0 2024-04-26T10:44:29.446 INFO:tasks.workunit.client.0.smithi049.stdout:8/341: dread d2/d16/f2e [0,4194304] 0 2024-04-26T10:44:29.447 INFO:tasks.workunit.client.0.smithi049.stdout:6/333: rename da/dd/f41 to da/dd/de/d26/f72 0 2024-04-26T10:44:29.447 INFO:tasks.workunit.client.0.smithi049.stdout:0/324: write d8/db/d26/d39/f6e [442411,121381] 0 2024-04-26T10:44:29.447 INFO:tasks.workunit.client.0.smithi049.stdout:1/332: rmdir d1e/d20/d26/d37 39 2024-04-26T10:44:29.448 INFO:tasks.workunit.client.0.smithi049.stdout:8/342: mknod d2/df/d18/d30/c67 0 2024-04-26T10:44:29.448 INFO:tasks.workunit.client.0.smithi049.stdout:1/333: fsync d1e/d20/d26/f33 0 2024-04-26T10:44:29.448 INFO:tasks.workunit.client.0.smithi049.stdout:3/311: dwrite d3/d23/d2f/d6a/d6b/d8/d34/f51 [0,4194304] 0 2024-04-26T10:44:29.448 INFO:tasks.workunit.client.0.smithi049.stdout:8/343: fdatasync d2/df/f3f 0 2024-04-26T10:44:29.448 INFO:tasks.workunit.client.0.smithi049.stdout:0/325: creat d8/f76 x:0 0 0 2024-04-26T10:44:29.448 INFO:tasks.workunit.client.0.smithi049.stdout:6/334: write da/dd/d47/f66 [1536671,64748] 0 2024-04-26T10:44:29.449 INFO:tasks.workunit.client.0.smithi049.stdout:1/334: mkdir d1e/d20/d67 0 2024-04-26T10:44:29.450 INFO:tasks.workunit.client.0.smithi049.stdout:6/335: write da/dd/d47/f48 [116753,84694] 0 2024-04-26T10:44:29.450 INFO:tasks.workunit.client.0.smithi049.stdout:3/312: chown d3/d23/d2f/d6a/d6b/d26/c6f 2156 1 2024-04-26T10:44:29.451 INFO:tasks.workunit.client.0.smithi049.stdout:6/336: write da/dd/de/d42/d5a/f5e [443460,122844] 0 2024-04-26T10:44:29.452 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:29.450+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:29.452 INFO:tasks.workunit.client.0.smithi049.stdout:0/326: link d8/d1e/c3f d8/d1e/d6a/c77 0 2024-04-26T10:44:29.452 INFO:tasks.workunit.client.0.smithi049.stdout:1/335: mkdir d1e/d20/d26/d3c/d54/d59/d68 0 2024-04-26T10:44:29.453 INFO:tasks.workunit.client.0.smithi049.stdout:0/327: symlink d8/db/d11/d1b/l78 0 2024-04-26T10:44:29.454 INFO:tasks.workunit.client.0.smithi049.stdout:8/344: dwrite d2/df/d18/d2a/f54 [0,4194304] 0 2024-04-26T10:44:29.457 INFO:tasks.workunit.client.0.smithi049.stdout:8/345: fdatasync d2/d16/f2e 0 2024-04-26T10:44:29.458 INFO:tasks.workunit.client.0.smithi049.stdout:1/336: getdents d1e/d20/d26/d37 0 2024-04-26T10:44:29.458 INFO:tasks.workunit.client.0.smithi049.stdout:3/313: dwrite d3/d23/d2f/d6a/d6b/d26/d5f/f69 [0,4194304] 0 2024-04-26T10:44:29.459 INFO:tasks.workunit.client.0.smithi049.stdout:2/326: dread d6/f2f [0,4194304] 0 2024-04-26T10:44:29.460 INFO:tasks.workunit.client.0.smithi049.stdout:4/401: fdatasync de/d1b/f34 0 2024-04-26T10:44:29.461 INFO:tasks.workunit.client.0.smithi049.stdout:0/328: dwrite d8/db/d11/d1c/f5b [0,4194304] 0 2024-04-26T10:44:29.462 INFO:tasks.workunit.client.0.smithi049.stdout:2/327: creat d6/d9/db/df/d31/f5c x:0 0 0 2024-04-26T10:44:29.463 INFO:tasks.workunit.client.0.smithi049.stdout:4/402: mknod de/c7b 0 2024-04-26T10:44:29.463 INFO:tasks.workunit.client.0.smithi049.stdout:7/355: sync 2024-04-26T10:44:29.463 INFO:tasks.workunit.client.0.smithi049.stdout:5/357: sync 2024-04-26T10:44:29.463 INFO:tasks.workunit.client.0.smithi049.stdout:9/414: sync 2024-04-26T10:44:29.463 INFO:tasks.workunit.client.0.smithi049.stdout:6/337: sync 2024-04-26T10:44:29.464 INFO:tasks.workunit.client.0.smithi049.stdout:0/329: write d8/db/d11/f65 [706174,79427] 0 2024-04-26T10:44:29.464 INFO:tasks.workunit.client.0.smithi049.stdout:0/330: sync 2024-04-26T10:44:29.465 INFO:tasks.workunit.client.0.smithi049.stdout:2/328: chown d6/d9/db/df/f4c 15 1 2024-04-26T10:44:29.466 INFO:tasks.workunit.client.0.smithi049.stdout:4/403: chown de/d20/l3a 11 1 2024-04-26T10:44:29.466 INFO:tasks.workunit.client.0.smithi049.stdout:2/329: readlink d6/l36 0 2024-04-26T10:44:29.466 INFO:tasks.workunit.client.0.smithi049.stdout:6/338: dread - da/dd/de/d26/f6f zero size 2024-04-26T10:44:29.466 INFO:tasks.workunit.client.0.smithi049.stdout:1/337: dwrite d1e/f1f [0,4194304] 0 2024-04-26T10:44:29.467 INFO:tasks.workunit.client.0.smithi049.stdout:8/346: dwrite d2/fc [0,4194304] 0 2024-04-26T10:44:29.468 INFO:tasks.workunit.client.0.smithi049.stdout:1/338: chown d1e/d20/c40 126117 1 2024-04-26T10:44:29.468 INFO:tasks.workunit.client.0.smithi049.stdout:7/356: symlink d2/dd/d48/d5c/l79 0 2024-04-26T10:44:29.468 INFO:tasks.workunit.client.0.smithi049.stdout:2/330: write d6/d9/db/d34/f50 [136283,130839] 0 2024-04-26T10:44:29.469 INFO:tasks.workunit.client.0.smithi049.stdout:1/339: chown l13 701275712 1 2024-04-26T10:44:29.469 INFO:tasks.workunit.client.0.smithi049.stdout:1/340: sync 2024-04-26T10:44:29.469 INFO:tasks.workunit.client.0.smithi049.stdout:8/347: creat d2/d17/d34/f68 x:0 0 0 2024-04-26T10:44:29.470 INFO:tasks.workunit.client.0.smithi049.stdout:1/341: stat d1e/d20/d26 0 2024-04-26T10:44:29.470 INFO:tasks.workunit.client.0.smithi049.stdout:1/342: stat d1e/d20/c35 0 2024-04-26T10:44:29.471 INFO:tasks.workunit.client.0.smithi049.stdout:4/404: creat de/d1b/d5e/d72/d73/f7c x:0 0 0 2024-04-26T10:44:29.471 INFO:tasks.workunit.client.0.smithi049.stdout:2/331: rmdir d6/d32 39 2024-04-26T10:44:29.472 INFO:tasks.workunit.client.0.smithi049.stdout:4/405: fdatasync de/d1b/f34 0 2024-04-26T10:44:29.472 INFO:tasks.workunit.client.0.smithi049.stdout:1/343: mkdir d1e/d20/d26/d37/d69 0 2024-04-26T10:44:29.473 INFO:tasks.workunit.client.0.smithi049.stdout:4/406: creat de/d20/d4b/f7d x:0 0 0 2024-04-26T10:44:29.474 INFO:tasks.workunit.client.0.smithi049.stdout:1/344: symlink d1e/d20/d26/d3c/l6a 0 2024-04-26T10:44:29.474 INFO:tasks.workunit.client.0.smithi049.stdout:4/407: write de/f63 [1637406,80621] 0 2024-04-26T10:44:29.474 INFO:tasks.workunit.client.0.smithi049.stdout:1/345: write d1e/d20/d26/d3c/d54/d59/f65 [3039507,43103] 0 2024-04-26T10:44:29.474 INFO:tasks.workunit.client.0.smithi049.stdout:6/339: dwrite da/dd/d47/f61 [0,4194304] 0 2024-04-26T10:44:29.474 INFO:tasks.workunit.client.0.smithi049.stdout:4/408: unlink de/d20/d24/l29 0 2024-04-26T10:44:29.476 INFO:tasks.workunit.client.0.smithi049.stdout:4/409: write de/d20/d24/f31 [3313428,988] 0 2024-04-26T10:44:29.476 INFO:tasks.workunit.client.0.smithi049.stdout:6/340: symlink da/dd/de/d26/l73 0 2024-04-26T10:44:29.476 INFO:tasks.workunit.client.0.smithi049.stdout:1/346: creat d1e/d20/f6b x:0 0 0 2024-04-26T10:44:29.477 INFO:tasks.workunit.client.0.smithi049.stdout:1/347: write d1e/d20/f6b [741772,16526] 0 2024-04-26T10:44:29.477 INFO:tasks.workunit.client.0.smithi049.stdout:6/341: creat da/dd/de/d42/d5a/f74 x:0 0 0 2024-04-26T10:44:29.477 INFO:tasks.workunit.client.0.smithi049.stdout:6/342: sync 2024-04-26T10:44:29.479 INFO:tasks.workunit.client.0.smithi049.stdout:4/410: dread de/d1b/f34 [4194304,4194304] 0 2024-04-26T10:44:29.480 INFO:tasks.workunit.client.0.smithi049.stdout:4/411: readlink de/d3f/d48/l65 0 2024-04-26T10:44:29.480 INFO:tasks.workunit.client.0.smithi049.stdout:2/332: dread d6/f3b [0,4194304] 0 2024-04-26T10:44:29.480 INFO:tasks.workunit.client.0.smithi049.stdout:8/348: dread d2/df/d18/d2a/f48 [0,4194304] 0 2024-04-26T10:44:29.482 INFO:tasks.workunit.client.0.smithi049.stdout:8/349: rename d2/d16/f3a to d2/d17/f69 0 2024-04-26T10:44:29.483 INFO:tasks.workunit.client.0.smithi049.stdout:7/357: dread d2/dd/d25/f31 [0,4194304] 0 2024-04-26T10:44:29.484 INFO:tasks.workunit.client.0.smithi049.stdout:8/350: mknod d2/d17/d34/d40/d64/c6a 0 2024-04-26T10:44:29.485 INFO:tasks.workunit.client.0.smithi049.stdout:7/358: creat d2/dd/d48/d5c/f7a x:0 0 0 2024-04-26T10:44:29.486 INFO:tasks.workunit.client.0.smithi049.stdout:6/343: write da/dd/de/d26/d22/f25 [4511495,14558] 0 2024-04-26T10:44:29.486 INFO:tasks.workunit.client.0.smithi049.stdout:8/351: chown d2/d17/c29 5541 1 2024-04-26T10:44:29.486 INFO:tasks.workunit.client.0.smithi049.stdout:4/412: dread de/d1b/f1c [0,4194304] 0 2024-04-26T10:44:29.486 INFO:tasks.workunit.client.0.smithi049.stdout:8/352: stat d2/d1a/d50/l61 0 2024-04-26T10:44:29.487 INFO:tasks.workunit.client.0.smithi049.stdout:7/359: symlink d2/d3/l7b 0 2024-04-26T10:44:29.487 INFO:tasks.workunit.client.0.smithi049.stdout:2/333: dwrite d6/d9/db/df/f4c [0,4194304] 0 2024-04-26T10:44:29.488 INFO:tasks.workunit.client.0.smithi049.stdout:7/360: fsync d2/d3/f2a 0 2024-04-26T10:44:29.490 INFO:tasks.workunit.client.0.smithi049.stdout:2/334: creat d6/d9/db/d11/f5d x:0 0 0 2024-04-26T10:44:29.490 INFO:tasks.workunit.client.0.smithi049.stdout:7/361: symlink d2/d3/de/l7c 0 2024-04-26T10:44:29.490 INFO:tasks.workunit.client.0.smithi049.stdout:6/344: link da/dd/de/d26/d22/d4c/f53 da/dd/de/f75 0 2024-04-26T10:44:29.490 INFO:tasks.workunit.client.0.smithi049.stdout:8/353: truncate d2/df/d10/d23/f31 3521818 0 2024-04-26T10:44:29.490 INFO:tasks.workunit.client.0.smithi049.stdout:2/335: unlink d6/f7 0 2024-04-26T10:44:29.494 INFO:tasks.workunit.client.0.smithi049.stdout:3/314: dread d3/d23/d2f/d6a/d6b/d8/dd/f18 [0,4194304] 0 2024-04-26T10:44:29.494 INFO:tasks.workunit.client.0.smithi049.stdout:6/345: rename da/c17 to da/dd/de/c76 0 2024-04-26T10:44:29.495 INFO:tasks.workunit.client.0.smithi049.stdout:8/354: mknod d2/c6b 0 2024-04-26T10:44:29.497 INFO:tasks.workunit.client.0.smithi049.stdout:9/415: dread d2/f3c [0,4194304] 0 2024-04-26T10:44:29.497 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:29.497 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:29.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.497 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:12089 4.2b 4:d5496710:::100000033cf.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:29.497 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:29.488228+0000", 2024-04-26T10:44:29.497 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.0079722850000000008, 2024-04-26T10:44:29.497 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080076039999999998, 2024-04-26T10:44:29.497 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:29.498 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:44:29.498 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:29.498 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:29.498 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:29.498 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 12089 2024-04-26T10:44:29.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.498 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:29.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.498 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:29.498 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:29.488228+0000", 2024-04-26T10:44:29.498 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.498 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:29.499 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:29.488228+0000", 2024-04-26T10:44:29.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.499 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:29.499 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:29.488227+0000", 2024-04-26T10:44:29.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:29.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.499 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:29.499 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:29.492792+0000", 2024-04-26T10:44:29.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0045651229999999999 2024-04-26T10:44:29.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.499 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:29.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:29.492804+0000", 2024-04-26T10:44:29.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2442999999999999e-05 2024-04-26T10:44:29.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.500 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:29.492810+0000", 2024-04-26T10:44:29.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5509999999999999e-06 2024-04-26T10:44:29.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.500 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:29.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:29.492857+0000", 2024-04-26T10:44:29.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7605999999999998e-05 2024-04-26T10:44:29.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:29.501 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:29.493010+0000", 2024-04-26T10:44:29.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000152165 2024-04-26T10:44:29.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:29.501 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:29.493208+0000", 2024-04-26T10:44:29.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000198865 2024-04-26T10:44:29.501 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.501 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:29.501 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.501 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:12093 4.10 4:0b02e9d1:::10000003132.00000001:head [read 0~4194304 [2@0]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:29.502 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:29.493241+0000", 2024-04-26T10:44:29.502 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.0029591819999999999, 2024-04-26T10:44:29.502 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030713289999999998, 2024-04-26T10:44:29.502 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:29.502 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:29.502 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:29.502 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:29.502 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:29.502 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 12093 2024-04-26T10:44:29.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.502 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:29.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.502 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:29.502 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:29.493241+0000", 2024-04-26T10:44:29.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.503 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:29.503 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:29.493241+0000", 2024-04-26T10:44:29.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.503 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:29.503 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:29.493240+0000", 2024-04-26T10:44:29.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:29.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.503 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:29.503 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:29.493244+0000", 2024-04-26T10:44:29.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6e-06 2024-04-26T10:44:29.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:29.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:29.493254+0000", 2024-04-26T10:44:29.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6530000000000006e-06 2024-04-26T10:44:29.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:29.493262+0000", 2024-04-26T10:44:29.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6510000000000001e-06 2024-04-26T10:44:29.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:29.505 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:29.493314+0000", 2024-04-26T10:44:29.505 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2008000000000001e-05 2024-04-26T10:44:29.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.505 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:29.505 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:29.493401+0000", 2024-04-26T10:44:29.505 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7268000000000005e-05 2024-04-26T10:44:29.505 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.505 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:29.505 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.505 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.505 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-26T10:44:29.505 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 2 2024-04-26T10:44:29.505 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:29.508 INFO:tasks.workunit.client.0.smithi049.stdout:3/315: stat d3/d23/d2f/d6a/d6b/d8/d55/l67 0 2024-04-26T10:44:29.508 INFO:tasks.workunit.client.0.smithi049.stdout:8/355: chown d2/d17/c43 423167988 1 2024-04-26T10:44:29.509 INFO:tasks.workunit.client.0.smithi049.stdout:7/362: dwrite d2/dd/d48/f69 [0,4194304] 0 2024-04-26T10:44:29.509 INFO:tasks.workunit.client.0.smithi049.stdout:0/331: dread d8/db/d26/f2d [0,4194304] 0 2024-04-26T10:44:29.509 INFO:tasks.workunit.client.0.smithi049.stdout:2/336: dwrite d6/d9/f19 [0,4194304] 0 2024-04-26T10:44:29.509 INFO:tasks.workunit.client.0.smithi049.stdout:9/416: rmdir d2/d1a/df 39 2024-04-26T10:44:29.509 INFO:tasks.workunit.client.0.smithi049.stdout:3/316: creat d3/d23/d2f/d6a/d6b/d26/d29/f72 x:0 0 0 2024-04-26T10:44:29.509 INFO:tasks.workunit.client.0.smithi049.stdout:5/358: dread d7/d1d/d1f/f3b [0,4194304] 0 2024-04-26T10:44:29.509 INFO:tasks.workunit.client.0.smithi049.stdout:9/417: chown d2/d25/d74/f63 10918 1 2024-04-26T10:44:29.509 INFO:tasks.workunit.client.0.smithi049.stdout:8/356: rename d2/d1a/d27 to d2/df/d10/d23/d6c 0 2024-04-26T10:44:29.509 INFO:tasks.workunit.client.0.smithi049.stdout:2/337: rmdir d6/d32/d4a 39 2024-04-26T10:44:29.509 INFO:tasks.workunit.client.0.smithi049.stdout:6/346: link da/dd/de/d42/d5a/f74 da/dd/de/d26/d22/f77 0 2024-04-26T10:44:29.509 INFO:tasks.workunit.client.0.smithi049.stdout:4/413: dwrite de/d20/d38/f58 [0,4194304] 0 2024-04-26T10:44:29.509 INFO:tasks.workunit.client.0.smithi049.stdout:7/363: creat d2/dd/d25/f7d x:0 0 0 2024-04-26T10:44:29.509 INFO:tasks.workunit.client.0.smithi049.stdout:4/414: write f8 [5008788,70388] 0 2024-04-26T10:44:29.509 INFO:tasks.workunit.client.0.smithi049.stdout:8/357: mknod d2/d17/c6d 0 2024-04-26T10:44:29.510 INFO:tasks.workunit.client.0.smithi049.stdout:6/347: rmdir da/d4a 39 2024-04-26T10:44:29.510 INFO:tasks.workunit.client.0.smithi049.stdout:2/338: rmdir d6/d9/db/d35 39 2024-04-26T10:44:29.510 INFO:tasks.workunit.client.0.smithi049.stdout:8/358: chown d2/d1a 235 1 2024-04-26T10:44:29.511 INFO:tasks.workunit.client.0.smithi049.stdout:5/359: mknod d7/d1d/d1f/d4e/d80/c99 0 2024-04-26T10:44:29.511 INFO:tasks.workunit.client.0.smithi049.stdout:2/339: read - d6/d9/db/df/d31/f5c zero size 2024-04-26T10:44:29.511 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:29.512 INFO:tasks.workunit.client.0.smithi049.stdout:0/332: dwrite d8/d1e/f4c [0,4194304] 0 2024-04-26T10:44:29.512 INFO:tasks.workunit.client.0.smithi049.stdout:7/364: getdents d2/dd/d48 0 2024-04-26T10:44:29.514 INFO:tasks.workunit.client.0.smithi049.stdout:9/418: dread d2/d25/d60/f76 [0,4194304] 0 2024-04-26T10:44:29.514 INFO:tasks.workunit.client.0.smithi049.stdout:0/333: chown d8/db/d26/d6f/l70 954846362 1 2024-04-26T10:44:29.514 INFO:tasks.workunit.client.0.smithi049.stdout:3/317: dwrite d3/d23/d2f/d6a/d6b/d26/f6d [0,4194304] 0 2024-04-26T10:44:29.514 INFO:tasks.workunit.client.0.smithi049.stdout:6/348: write da/dd/f10 [3950623,124845] 0 2024-04-26T10:44:29.514 INFO:tasks.workunit.client.0.smithi049.stdout:7/365: symlink d2/dd/d38/l7e 0 2024-04-26T10:44:29.514 INFO:tasks.workunit.client.0.smithi049.stdout:2/340: unlink d6/d9/db/df/l3e 0 2024-04-26T10:44:29.515 INFO:tasks.workunit.client.0.smithi049.stdout:0/334: readlink d8/d1e/l37 0 2024-04-26T10:44:29.515 INFO:tasks.workunit.client.0.smithi049.stdout:5/360: getdents d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d7b 0 2024-04-26T10:44:29.516 INFO:tasks.workunit.client.0.smithi049.stdout:9/419: creat d2/d1a/df/f87 x:0 0 0 2024-04-26T10:44:29.516 INFO:tasks.workunit.client.0.smithi049.stdout:6/349: symlink da/dd/de/l78 0 2024-04-26T10:44:29.516 INFO:tasks.workunit.client.0.smithi049.stdout:7/366: rmdir d2/d3/de/d1c/d4d 39 2024-04-26T10:44:29.518 INFO:tasks.workunit.client.0.smithi049.stdout:5/361: creat d7/d1d/d1f/f9a x:0 0 0 2024-04-26T10:44:29.519 INFO:tasks.workunit.client.0.smithi049.stdout:0/335: write d8/d42/f6c [1617368,91884] 0 2024-04-26T10:44:29.519 INFO:tasks.workunit.client.0.smithi049.stdout:7/367: fdatasync d2/dd/f11 0 2024-04-26T10:44:29.519 INFO:tasks.workunit.client.0.smithi049.stdout:3/318: mknod d3/d23/d2f/d6a/d6b/d26/d65/d70/c73 0 2024-04-26T10:44:29.519 INFO:tasks.workunit.client.0.smithi049.stdout:3/319: sync 2024-04-26T10:44:29.519 INFO:tasks.workunit.client.0.smithi049.stdout:2/341: getdents d6/d32/d4a 0 2024-04-26T10:44:29.519 INFO:tasks.workunit.client.0.smithi049.stdout:9/420: symlink d2/d1a/d1b/d1f/d34/l88 0 2024-04-26T10:44:29.520 INFO:tasks.workunit.client.0.smithi049.stdout:2/342: stat d6/d9/f19 0 2024-04-26T10:44:29.520 INFO:tasks.workunit.client.0.smithi049.stdout:5/362: creat d7/d66/d84/f9b x:0 0 0 2024-04-26T10:44:29.520 INFO:tasks.workunit.client.0.smithi049.stdout:7/368: write d2/d3/f3c [1570339,16601] 0 2024-04-26T10:44:29.520 INFO:tasks.workunit.client.0.smithi049.stdout:8/359: dwrite d2/f12 [0,4194304] 0 2024-04-26T10:44:29.520 INFO:tasks.workunit.client.0.smithi049.stdout:0/336: chown d8/db/c1f 166 1 2024-04-26T10:44:29.520 INFO:tasks.workunit.client.0.smithi049.stdout:5/363: fdatasync d7/d53/f78 0 2024-04-26T10:44:29.521 INFO:tasks.workunit.client.0.smithi049.stdout:0/337: mknod d8/c79 0 2024-04-26T10:44:29.521 INFO:tasks.workunit.client.0.smithi049.stdout:7/369: dread - d2/dd/d48/d5c/f7a zero size 2024-04-26T10:44:29.522 INFO:tasks.workunit.client.0.smithi049.stdout:1/348: dread d1e/d20/d26/d3c/f3d [0,4194304] 0 2024-04-26T10:44:29.522 INFO:tasks.workunit.client.0.smithi049.stdout:8/360: getdents d2/d1a/d50 0 2024-04-26T10:44:29.522 INFO:tasks.workunit.client.0.smithi049.stdout:2/343: rename d6/d9/db/d34/d38/d3f/f58 to d6/d30/f5e 0 2024-04-26T10:44:29.523 INFO:tasks.workunit.client.0.smithi049.stdout:1/349: stat d1e/l27 0 2024-04-26T10:44:29.524 INFO:tasks.workunit.client.0.smithi049.stdout:2/344: stat d6/d32/d4a 0 2024-04-26T10:44:29.524 INFO:tasks.workunit.client.0.smithi049.stdout:5/364: truncate d7/d1d/d1f/f51 443799 0 2024-04-26T10:44:29.524 INFO:tasks.workunit.client.0.smithi049.stdout:9/421: write d2/d1a/d1b/d1f/f39 [591633,40266] 0 2024-04-26T10:44:29.525 INFO:tasks.workunit.client.0.smithi049.stdout:3/320: truncate d3/d23/d2f/d6a/d6b/d26/d29/f3e 549226 0 2024-04-26T10:44:29.525 INFO:tasks.workunit.client.0.smithi049.stdout:8/361: rmdir d2/d17/d34/d40/d59 0 2024-04-26T10:44:29.525 INFO:tasks.workunit.client.0.smithi049.stdout:2/345: read - d6/d9/db/d34/f5a zero size 2024-04-26T10:44:29.525 INFO:tasks.workunit.client.0.smithi049.stdout:1/350: creat d1e/d20/d67/f6c x:0 0 0 2024-04-26T10:44:29.527 INFO:tasks.workunit.client.0.smithi049.stdout:1/351: unlink d1e/d20/d26/d57/c5c 0 2024-04-26T10:44:29.528 INFO:tasks.workunit.client.0.smithi049.stdout:0/338: dwrite d8/d66/f69 [0,4194304] 0 2024-04-26T10:44:29.529 INFO:tasks.workunit.client.0.smithi049.stdout:2/346: getdents d6/d9/db/d11 0 2024-04-26T10:44:29.530 INFO:tasks.workunit.client.0.smithi049.stdout:1/352: write d1e/d20/d26/f51 [1825381,93854] 0 2024-04-26T10:44:29.531 INFO:tasks.workunit.client.0.smithi049.stdout:2/347: mkdir d6/d9/d5f 0 2024-04-26T10:44:29.532 INFO:tasks.workunit.client.0.smithi049.stdout:2/348: write d6/d9/fc [4048160,48169] 0 2024-04-26T10:44:29.532 INFO:tasks.workunit.client.0.smithi049.stdout:0/339: truncate d8/d1e/f4e 350037 0 2024-04-26T10:44:29.533 INFO:tasks.workunit.client.0.smithi049.stdout:9/422: dwrite d2/d1a/d1b/d7a/f80 [0,4194304] 0 2024-04-26T10:44:29.534 INFO:tasks.workunit.client.0.smithi049.stdout:9/423: mknod d2/d25/d60/c89 0 2024-04-26T10:44:29.535 INFO:tasks.workunit.client.0.smithi049.stdout:9/424: write d2/d1a/df/f26 [4269670,103213] 0 2024-04-26T10:44:29.536 INFO:tasks.workunit.client.0.smithi049.stdout:9/425: mkdir d2/d1a/d8a 0 2024-04-26T10:44:29.538 INFO:tasks.workunit.client.0.smithi049.stdout:9/426: unlink d2/d1a/d1b/d1f/d64/c82 0 2024-04-26T10:44:29.538 INFO:tasks.workunit.client.0.smithi049.stdout:8/362: read d2/f6 [1095492,129617] 0 2024-04-26T10:44:29.539 INFO:tasks.workunit.client.0.smithi049.stdout:9/427: symlink d2/d1a/l8b 0 2024-04-26T10:44:29.539 INFO:tasks.workunit.client.0.smithi049.stdout:8/363: dread - d2/d16/d19/d42/f4e zero size 2024-04-26T10:44:29.540 INFO:tasks.workunit.client.0.smithi049.stdout:9/428: symlink d2/d1a/d1b/d1f/l8c 0 2024-04-26T10:44:29.540 INFO:tasks.workunit.client.0.smithi049.stdout:8/364: creat d2/df/d10/d23/f6e x:0 0 0 2024-04-26T10:44:29.541 INFO:tasks.workunit.client.0.smithi049.stdout:9/429: write d2/d1a/d1b/f24 [840568,80945] 0 2024-04-26T10:44:29.541 INFO:tasks.workunit.client.0.smithi049.stdout:8/365: symlink d2/df/d18/l6f 0 2024-04-26T10:44:29.542 INFO:tasks.workunit.client.0.smithi049.stdout:8/366: mknod d2/df/d18/c70 0 2024-04-26T10:44:29.543 INFO:tasks.workunit.client.0.smithi049.stdout:8/367: creat d2/d17/d34/d40/f71 x:0 0 0 2024-04-26T10:44:29.543 INFO:tasks.workunit.client.0.smithi049.stdout:8/368: chown d2/d1a/d50/l61 100 1 2024-04-26T10:44:29.544 INFO:tasks.workunit.client.0.smithi049.stdout:5/365: sync 2024-04-26T10:44:29.545 INFO:tasks.workunit.client.0.smithi049.stdout:8/369: getdents d2/d16 0 2024-04-26T10:44:29.545 INFO:tasks.workunit.client.0.smithi049.stdout:8/370: chown d2/df 244 1 2024-04-26T10:44:29.546 INFO:tasks.workunit.client.0.smithi049.stdout:5/366: rename d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d60/l69 to d7/d66/l9c 0 2024-04-26T10:44:29.546 INFO:tasks.workunit.client.0.smithi049.stdout:9/430: write d2/d1a/d1b/f16 [5613964,55970] 0 2024-04-26T10:44:29.547 INFO:tasks.workunit.client.0.smithi049.stdout:2/349: dread d6/f29 [0,4194304] 0 2024-04-26T10:44:29.548 INFO:tasks.workunit.client.0.smithi049.stdout:5/367: write d7/d14/f38 [3092756,113099] 0 2024-04-26T10:44:29.548 INFO:tasks.workunit.client.0.smithi049.stdout:9/431: fsync d2/d1a/d1b/d1f/f43 0 2024-04-26T10:44:29.549 INFO:tasks.workunit.client.0.smithi049.stdout:2/350: write d6/d9/f19 [3166546,89183] 0 2024-04-26T10:44:29.550 INFO:tasks.workunit.client.0.smithi049.stdout:9/432: write d2/d25/f3e [794150,79414] 0 2024-04-26T10:44:29.550 INFO:tasks.workunit.client.0.smithi049.stdout:2/351: readlink d6/d32/l53 0 2024-04-26T10:44:29.551 INFO:tasks.workunit.client.0.smithi049.stdout:9/433: write d2/f3c [3116409,43403] 0 2024-04-26T10:44:29.551 INFO:tasks.workunit.client.0.smithi049.stdout:8/371: dread d2/df/d18/d2a/f54 [0,4194304] 0 2024-04-26T10:44:29.552 INFO:tasks.workunit.client.0.smithi049.stdout:2/352: write d6/d9/db/d34/d38/d3f/f45 [1949912,88818] 0 2024-04-26T10:44:29.553 INFO:tasks.workunit.client.0.smithi049.stdout:4/415: dread de/f15 [4194304,4194304] 0 2024-04-26T10:44:29.553 INFO:tasks.workunit.client.0.smithi049.stdout:2/353: readlink d6/d9/db/d35/l59 0 2024-04-26T10:44:29.554 INFO:tasks.workunit.client.0.smithi049.stdout:5/368: dread d7/d1d/d1f/d22/f35 [0,4194304] 0 2024-04-26T10:44:29.555 INFO:tasks.workunit.client.0.smithi049.stdout:4/416: creat de/d20/f7e x:0 0 0 2024-04-26T10:44:29.556 INFO:tasks.workunit.client.0.smithi049.stdout:5/369: truncate d7/d1d/d1f/f8f 240232 0 2024-04-26T10:44:29.557 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:29.555+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:29.557 INFO:tasks.workunit.client.0.smithi049.stdout:6/350: dread da/dd/de/d26/d29/f31 [0,4194304] 0 2024-04-26T10:44:29.557 INFO:tasks.workunit.client.0.smithi049.stdout:2/354: mkdir d6/d9/db/d34/d38/d3f/d60 0 2024-04-26T10:44:29.558 INFO:tasks.workunit.client.0.smithi049.stdout:6/351: creat da/dd/d47/f79 x:0 0 0 2024-04-26T10:44:29.560 INFO:tasks.workunit.client.0.smithi049.stdout:8/372: dwrite d2/df/f62 [0,4194304] 0 2024-04-26T10:44:29.560 INFO:tasks.workunit.client.0.smithi049.stdout:6/352: chown da/dd/d47 583234 1 2024-04-26T10:44:29.560 INFO:tasks.workunit.client.0.smithi049.stdout:9/434: dwrite d2/d1a/df/f26 [0,4194304] 0 2024-04-26T10:44:29.562 INFO:tasks.workunit.client.0.smithi049.stdout:7/370: dread d2/d3/de/d1c/f3e [0,4194304] 0 2024-04-26T10:44:29.562 INFO:tasks.workunit.client.0.smithi049.stdout:4/417: rename de/d3f/f4a to de/d1b/d5e/d72/f7f 0 2024-04-26T10:44:29.562 INFO:tasks.workunit.client.0.smithi049.stdout:8/373: write d2/f2f [1487167,60961] 0 2024-04-26T10:44:29.565 INFO:tasks.workunit.client.0.smithi049.stdout:9/435: write d2/d1a/d1b/d1f/f43 [2990665,31083] 0 2024-04-26T10:44:29.565 INFO:tasks.workunit.client.0.smithi049.stdout:8/374: creat d2/df/d18/d30/f72 x:0 0 0 2024-04-26T10:44:29.566 INFO:tasks.workunit.client.0.smithi049.stdout:7/371: getdents d2/dd/d45 0 2024-04-26T10:44:29.566 INFO:tasks.workunit.client.0.smithi049.stdout:4/418: rename de/d1b/d5e/l6d to de/d20/l80 0 2024-04-26T10:44:29.566 INFO:tasks.workunit.client.0.smithi049.stdout:5/370: dwrite d7/d1d/d1f/d4e/d65/d6f/d91/d3e/f42 [0,4194304] 0 2024-04-26T10:44:29.567 INFO:tasks.workunit.client.0.smithi049.stdout:7/372: rmdir d2/d3/de 39 2024-04-26T10:44:29.568 INFO:tasks.workunit.client.0.smithi049.stdout:4/419: chown de/d20/d4b/l4f 81434902 1 2024-04-26T10:44:29.568 INFO:tasks.workunit.client.0.smithi049.stdout:5/371: creat d7/d53/f9d x:0 0 0 2024-04-26T10:44:29.568 INFO:tasks.workunit.client.0.smithi049.stdout:6/353: dwrite da/dd/de/d11/f3e [0,4194304] 0 2024-04-26T10:44:29.568 INFO:tasks.workunit.client.0.smithi049.stdout:9/436: symlink d2/d1a/d8a/l8d 0 2024-04-26T10:44:29.569 INFO:tasks.workunit.client.0.smithi049.stdout:7/373: mkdir d2/dd/d7f 0 2024-04-26T10:44:29.569 INFO:tasks.workunit.client.0.smithi049.stdout:5/372: readlink d7/d1d/d1f/d4e/d65/d6f/d91/d3e/l55 0 2024-04-26T10:44:29.570 INFO:tasks.workunit.client.0.smithi049.stdout:4/420: rename de/d1b/l1e to de/d3f/d48/d62/l81 0 2024-04-26T10:44:29.571 INFO:tasks.workunit.client.0.smithi049.stdout:6/354: mknod da/dd/de/d42/c7a 0 2024-04-26T10:44:29.571 INFO:tasks.workunit.client.0.smithi049.stdout:9/437: creat d2/d1a/d1b/d1f/d34/d6d/f8e x:0 0 0 2024-04-26T10:44:29.571 INFO:tasks.workunit.client.0.smithi049.stdout:6/355: sync 2024-04-26T10:44:29.571 INFO:tasks.workunit.client.0.smithi049.stdout:7/374: getdents d2/d3 0 2024-04-26T10:44:29.574 INFO:tasks.workunit.client.0.smithi049.stdout:4/421: truncate de/f15 2226345 0 2024-04-26T10:44:29.574 INFO:tasks.workunit.client.0.smithi049.stdout:9/438: write d2/d40/f78 [1577492,36324] 0 2024-04-26T10:44:29.575 INFO:tasks.workunit.client.0.smithi049.stdout:6/356: read - da/dd/de/d26/f64 zero size 2024-04-26T10:44:29.575 INFO:tasks.workunit.client.0.smithi049.stdout:6/357: stat da/dd/de/c60 0 2024-04-26T10:44:29.575 INFO:tasks.workunit.client.0.smithi049.stdout:5/373: rename d7/d1d/d1f/d22/l63 to d7/d1d/d1f/d4e/d65/d6f/l9e 0 2024-04-26T10:44:29.575 INFO:tasks.workunit.client.0.smithi049.stdout:3/321: dread d3/d23/d2f/d6a/d6b/d8/f32 [0,4194304] 0 2024-04-26T10:44:29.575 INFO:tasks.workunit.client.0.smithi049.stdout:7/375: rename d2/d3/lb to d2/dd/d38/l80 0 2024-04-26T10:44:29.575 INFO:tasks.workunit.client.0.smithi049.stdout:9/439: link d2/d25/f2e d2/d1a/d1b/d1f/f8f 0 2024-04-26T10:44:29.576 INFO:tasks.workunit.client.0.smithi049.stdout:5/374: getdents d7/d14/d18/d2b 0 2024-04-26T10:44:29.576 INFO:tasks.workunit.client.0.smithi049.stdout:9/440: mknod d2/d1a/d1b/c90 0 2024-04-26T10:44:29.577 INFO:tasks.workunit.client.0.smithi049.stdout:9/441: sync 2024-04-26T10:44:29.577 INFO:tasks.workunit.client.0.smithi049.stdout:5/375: chown d7/d14/d18/l8c 7712 1 2024-04-26T10:44:29.577 INFO:tasks.workunit.client.0.smithi049.stdout:9/442: fsync d2/d1a/f38 0 2024-04-26T10:44:29.578 INFO:tasks.workunit.client.0.smithi049.stdout:3/322: link d3/d23/d2f/d6a/d6b/d8/c60 d3/d23/d2f/d6a/d6b/d8/c74 0 2024-04-26T10:44:29.578 INFO:tasks.workunit.client.0.smithi049.stdout:6/358: truncate da/dd/de/d26/f72 442299 0 2024-04-26T10:44:29.578 INFO:tasks.workunit.client.0.smithi049.stdout:4/422: dwrite de/d20/d4b/f7d [0,4194304] 0 2024-04-26T10:44:29.579 INFO:tasks.workunit.client.0.smithi049.stdout:9/443: write d2/d1a/df/f4a [293618,82] 0 2024-04-26T10:44:29.580 INFO:tasks.workunit.client.0.smithi049.stdout:4/423: symlink de/d1b/d5e/d6c/l82 0 2024-04-26T10:44:29.581 INFO:tasks.workunit.client.0.smithi049.stdout:7/376: rename d2/d3/de/f4b to d2/dd/d25/f81 0 2024-04-26T10:44:29.581 INFO:tasks.workunit.client.0.smithi049.stdout:5/376: mkdir d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d9f 0 2024-04-26T10:44:29.581 INFO:tasks.workunit.client.0.smithi049.stdout:6/359: getdents da/dd 0 2024-04-26T10:44:29.581 INFO:tasks.workunit.client.0.smithi049.stdout:4/424: chown de/c21 15 1 2024-04-26T10:44:29.582 INFO:tasks.workunit.client.0.smithi049.stdout:3/323: rename d3/d6/f12 to d3/d23/f75 0 2024-04-26T10:44:29.582 INFO:tasks.workunit.client.0.smithi049.stdout:7/377: dread d2/d3/de/f1e [0,4194304] 0 2024-04-26T10:44:29.583 INFO:tasks.workunit.client.0.smithi049.stdout:6/360: mkdir da/dd/d47/d7b 0 2024-04-26T10:44:29.583 INFO:tasks.workunit.client.0.smithi049.stdout:4/425: unlink de/d1b/f26 0 2024-04-26T10:44:29.583 INFO:tasks.workunit.client.0.smithi049.stdout:6/361: readlink da/l57 0 2024-04-26T10:44:29.583 INFO:tasks.workunit.client.0.smithi049.stdout:2/355: read d6/d9/db/d34/d38/d3f/f45 [803401,116380] 0 2024-04-26T10:44:29.584 INFO:tasks.workunit.client.0.smithi049.stdout:3/324: creat d3/f76 x:0 0 0 2024-04-26T10:44:29.584 INFO:tasks.workunit.client.0.smithi049.stdout:6/362: rmdir da/dd/de/d11 39 2024-04-26T10:44:29.585 INFO:tasks.workunit.client.0.smithi049.stdout:8/375: read d2/d16/f4b [680950,57262] 0 2024-04-26T10:44:29.585 INFO:tasks.workunit.client.0.smithi049.stdout:7/378: dread d2/dd/d25/f31 [0,4194304] 0 2024-04-26T10:44:29.586 INFO:tasks.workunit.client.0.smithi049.stdout:6/363: chown da/dd/d62/d67 8127718 1 2024-04-26T10:44:29.586 INFO:tasks.workunit.client.0.smithi049.stdout:4/426: rename de/d20/d24/c44 to de/d1b/d5e/c83 0 2024-04-26T10:44:29.586 INFO:tasks.workunit.client.0.smithi049.stdout:2/356: symlink d6/d9/db/d34/d38/d3f/l61 0 2024-04-26T10:44:29.587 INFO:tasks.workunit.client.0.smithi049.stdout:3/325: fsync d3/d23/d2f/d6a/d6b/d8/d55/d46/f4a 0 2024-04-26T10:44:29.587 INFO:tasks.workunit.client.0.smithi049.stdout:5/377: dwrite d7/f81 [0,4194304] 0 2024-04-26T10:44:29.587 INFO:tasks.workunit.client.0.smithi049.stdout:8/376: mknod d2/c73 0 2024-04-26T10:44:29.587 INFO:tasks.workunit.client.0.smithi049.stdout:4/427: chown de/d20/f7e 4429 1 2024-04-26T10:44:29.588 INFO:tasks.workunit.client.0.smithi049.stdout:7/379: fdatasync d2/d3/de/d1c/f36 0 2024-04-26T10:44:29.589 INFO:tasks.workunit.client.0.smithi049.stdout:2/357: creat d6/d9/db/d11/f62 x:0 0 0 2024-04-26T10:44:29.589 INFO:tasks.workunit.client.0.smithi049.stdout:6/364: chown da/dd/de/d42/d5a/f65 6 1 2024-04-26T10:44:29.590 INFO:tasks.workunit.client.0.smithi049.stdout:1/353: dread d1e/d20/f41 [0,4194304] 0 2024-04-26T10:44:29.590 INFO:tasks.workunit.client.0.smithi049.stdout:7/380: dread - d2/f49 zero size 2024-04-26T10:44:29.590 INFO:tasks.workunit.client.0.smithi049.stdout:3/326: symlink d3/d23/d2f/d6a/d6b/d26/d29/l77 0 2024-04-26T10:44:29.590 INFO:tasks.workunit.client.0.smithi049.stdout:5/378: mkdir d7/d1d/d1f/d4e/da0 0 2024-04-26T10:44:29.591 INFO:tasks.workunit.client.0.smithi049.stdout:4/428: rename de/d20 to de/d1b/d5e/d72/d73/d84 0 2024-04-26T10:44:29.591 INFO:tasks.workunit.client.0.smithi049.stdout:7/381: fdatasync d2/dd/d48/f69 0 2024-04-26T10:44:29.591 INFO:tasks.workunit.client.0.smithi049.stdout:2/358: symlink d6/d9/db/d34/d38/l63 0 2024-04-26T10:44:29.592 INFO:tasks.workunit.client.0.smithi049.stdout:3/327: chown d3/d23/d2f/d6a/d6b/d8/d55/d2e 7633581 1 2024-04-26T10:44:29.592 INFO:tasks.workunit.client.0.smithi049.stdout:6/365: mknod da/dd/de/d26/c7c 0 2024-04-26T10:44:29.592 INFO:tasks.workunit.client.0.smithi049.stdout:6/366: readlink l3 0 2024-04-26T10:44:29.593 INFO:tasks.workunit.client.0.smithi049.stdout:7/382: write d2/f33 [996320,27004] 0 2024-04-26T10:44:29.594 INFO:tasks.workunit.client.0.smithi049.stdout:5/379: link d7/d1d/d1f/d4e/d65/f75 d7/d1d/d1f/d4e/d65/fa1 0 2024-04-26T10:44:29.595 INFO:tasks.workunit.client.0.smithi049.stdout:6/367: rmdir da/dd/d62/d67 0 2024-04-26T10:44:29.596 INFO:tasks.workunit.client.0.smithi049.stdout:8/377: dwrite d2/df/d10/f66 [0,4194304] 0 2024-04-26T10:44:29.596 INFO:tasks.workunit.client.0.smithi049.stdout:3/328: truncate d3/d23/d2f/d6a/d6b/d8/f49 602526 0 2024-04-26T10:44:29.596 INFO:tasks.workunit.client.0.smithi049.stdout:7/383: mkdir d2/dd/d45/d82 0 2024-04-26T10:44:29.597 INFO:tasks.workunit.client.0.smithi049.stdout:5/380: write d7/d14/f1a [1240620,10372] 0 2024-04-26T10:44:29.597 INFO:tasks.workunit.client.0.smithi049.stdout:2/359: rename d6/d9/db/d34/d38/d3f/f40 to d6/f64 0 2024-04-26T10:44:29.597 INFO:tasks.workunit.client.0.smithi049.stdout:0/340: dread d8/d1e/f2a [0,4194304] 0 2024-04-26T10:44:29.599 INFO:tasks.workunit.client.0.smithi049.stdout:5/381: rmdir d7/d14/d18 39 2024-04-26T10:44:29.599 INFO:tasks.workunit.client.0.smithi049.stdout:1/354: dread d1e/d20/f41 [0,4194304] 0 2024-04-26T10:44:29.599 INFO:tasks.workunit.client.0.smithi049.stdout:7/384: dread - d2/d3/f52 zero size 2024-04-26T10:44:29.599 INFO:tasks.workunit.client.0.smithi049.stdout:3/329: chown d3/d23/d2f/d6a/d6b/d8/f9 2880 1 2024-04-26T10:44:29.600 INFO:tasks.workunit.client.0.smithi049.stdout:8/378: rename d2/d16/f52 to d2/df/d18/f74 0 2024-04-26T10:44:29.600 INFO:tasks.workunit.client.0.smithi049.stdout:0/341: fdatasync d8/db/d11/d1b/d4d/f64 0 2024-04-26T10:44:29.602 INFO:tasks.workunit.client.0.smithi049.stdout:6/368: rename da/dd/de/d26/d29/f52 to da/dd/de/d26/d22/f7d 0 2024-04-26T10:44:29.602 INFO:tasks.workunit.client.0.smithi049.stdout:8/379: fdatasync d2/df/d10/d23/f6e 0 2024-04-26T10:44:29.602 INFO:tasks.workunit.client.0.smithi049.stdout:2/360: read d6/d9/db/d11/f1d [9120737,45001] 0 2024-04-26T10:44:29.603 INFO:tasks.workunit.client.0.smithi049.stdout:4/429: dwrite de/d1b/d5e/d72/d73/d84/d24/f61 [4194304,4194304] 0 2024-04-26T10:44:29.603 INFO:tasks.workunit.client.0.smithi049.stdout:7/385: unlink d2/dd/d25/d27/f30 0 2024-04-26T10:44:29.604 INFO:tasks.workunit.client.0.smithi049.stdout:3/330: symlink d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/l78 0 2024-04-26T10:44:29.605 INFO:tasks.workunit.client.0.smithi049.stdout:0/342: rmdir d8/d66/d71 0 2024-04-26T10:44:29.605 INFO:tasks.workunit.client.0.smithi049.stdout:2/361: rename d6/d30/f5e to d6/d30/f65 0 2024-04-26T10:44:29.607 INFO:tasks.workunit.client.0.smithi049.stdout:6/369: creat da/dd/de/d11/f7e x:0 0 0 2024-04-26T10:44:29.608 INFO:tasks.workunit.client.0.smithi049.stdout:2/362: stat d6/d32/d4a/f4e 0 2024-04-26T10:44:29.608 INFO:tasks.workunit.client.0.smithi049.stdout:4/430: creat de/d1b/d5e/d72/d73/f85 x:0 0 0 2024-04-26T10:44:29.609 INFO:tasks.workunit.client.0.smithi049.stdout:7/386: creat d2/dd/d45/d82/f83 x:0 0 0 2024-04-26T10:44:29.610 INFO:tasks.workunit.client.0.smithi049.stdout:2/363: dread - d6/d32/d4a/f51 zero size 2024-04-26T10:44:29.611 INFO:tasks.workunit.client.0.smithi049.stdout:1/355: dwrite d1e/d20/d26/f63 [0,4194304] 0 2024-04-26T10:44:29.611 INFO:tasks.workunit.client.0.smithi049.stdout:3/331: chown d3/d23/d2f/d6a/d6b/d8/d55/l2c 0 1 2024-04-26T10:44:29.611 INFO:tasks.workunit.client.0.smithi049.stdout:5/382: dwrite d7/d1d/d1f/d4e/d65/fa1 [0,4194304] 0 2024-04-26T10:44:29.612 INFO:tasks.workunit.client.0.smithi049.stdout:7/387: chown d2/dd/d48/c78 50597 1 2024-04-26T10:44:29.612 INFO:tasks.workunit.client.0.smithi049.stdout:2/364: mknod d6/d30/c66 0 2024-04-26T10:44:29.612 INFO:tasks.workunit.client.0.smithi049.stdout:0/343: link d8/db/d26/l2e d8/d1e/l7a 0 2024-04-26T10:44:29.613 INFO:tasks.workunit.client.0.smithi049.stdout:8/380: dwrite d2/d1a/f3e [0,4194304] 0 2024-04-26T10:44:29.613 INFO:tasks.workunit.client.0.smithi049.stdout:1/356: symlink d1e/d20/d4d/l6d 0 2024-04-26T10:44:29.613 INFO:tasks.workunit.client.0.smithi049.stdout:3/332: mknod d3/d23/d2f/c79 0 2024-04-26T10:44:29.613 INFO:tasks.workunit.client.0.smithi049.stdout:6/370: link l3 da/dd/de/d11/l7f 0 2024-04-26T10:44:29.614 INFO:tasks.workunit.client.0.smithi049.stdout:7/388: read d2/d3/f3c [1563181,825] 0 2024-04-26T10:44:29.614 INFO:tasks.workunit.client.0.smithi049.stdout:4/431: truncate f8 3122434 0 2024-04-26T10:44:29.614 INFO:tasks.workunit.client.0.smithi049.stdout:5/383: creat d7/d1d/fa2 x:0 0 0 2024-04-26T10:44:29.614 INFO:tasks.workunit.client.0.smithi049.stdout:2/365: rmdir d6/d9/db/d1e 39 2024-04-26T10:44:29.615 INFO:tasks.workunit.client.0.smithi049.stdout:3/333: unlink d3/d23/d2f/f3c 0 2024-04-26T10:44:29.616 INFO:tasks.workunit.client.0.smithi049.stdout:6/371: creat da/dd/d47/f80 x:0 0 0 2024-04-26T10:44:29.616 INFO:tasks.workunit.client.0.smithi049.stdout:0/344: creat d8/db/d26/f7b x:0 0 0 2024-04-26T10:44:29.616 INFO:tasks.workunit.client.0.smithi049.stdout:8/381: mkdir d2/df/d10/d47/d75 0 2024-04-26T10:44:29.616 INFO:tasks.workunit.client.0.smithi049.stdout:2/366: creat d6/d9/d5f/f67 x:0 0 0 2024-04-26T10:44:29.617 INFO:tasks.workunit.client.0.smithi049.stdout:1/357: write d1e/d20/d26/d3c/f4f [954101,5767] 0 2024-04-26T10:44:29.617 INFO:tasks.workunit.client.0.smithi049.stdout:6/372: fsync da/dd/de/d11/f7e 0 2024-04-26T10:44:29.618 INFO:tasks.workunit.client.0.smithi049.stdout:5/384: truncate d7/d1d/f30 1925863 0 2024-04-26T10:44:29.618 INFO:tasks.workunit.client.0.smithi049.stdout:6/373: read - da/dd/de/d42/f5f zero size 2024-04-26T10:44:29.619 INFO:tasks.workunit.client.0.smithi049.stdout:0/345: link d8/db/c1f d8/db/d11/c7c 0 2024-04-26T10:44:29.619 INFO:tasks.workunit.client.0.smithi049.stdout:8/382: link d2/df/d18/d2a/l4f d2/d17/l76 0 2024-04-26T10:44:29.620 INFO:tasks.workunit.client.0.smithi049.stdout:6/374: write da/f1b [2088588,76922] 0 2024-04-26T10:44:29.620 INFO:tasks.workunit.client.0.smithi049.stdout:5/385: mknod d7/d14/d18/d48/ca3 0 2024-04-26T10:44:29.620 INFO:tasks.workunit.client.0.smithi049.stdout:0/346: symlink d8/db/d11/d1c/l7d 0 2024-04-26T10:44:29.621 INFO:tasks.workunit.client.0.smithi049.stdout:8/383: chown d2/df/d10/d23/d6c/f2c 125393823 1 2024-04-26T10:44:29.621 INFO:tasks.workunit.client.0.smithi049.stdout:2/367: rename d6/d9/db/d1e/c33 to d6/c68 0 2024-04-26T10:44:29.622 INFO:tasks.workunit.client.0.smithi049.stdout:6/375: creat da/dd/d47/d7b/f81 x:0 0 0 2024-04-26T10:44:29.622 INFO:tasks.workunit.client.0.smithi049.stdout:5/386: rename d7/f44 to d7/d1d/d20/fa4 0 2024-04-26T10:44:29.622 INFO:tasks.workunit.client.0.smithi049.stdout:8/384: chown d2/df/d18/d2a/f54 378141356 1 2024-04-26T10:44:29.622 INFO:tasks.workunit.client.0.smithi049.stdout:2/368: read d6/d9/db/d1e/f21 [592347,43299] 0 2024-04-26T10:44:29.623 INFO:tasks.workunit.client.0.smithi049.stdout:1/358: fsync d1e/d20/d26/f63 0 2024-04-26T10:44:29.627 INFO:tasks.workunit.client.0.smithi049.stdout:8/385: readlink d2/df/d18/l6f 0 2024-04-26T10:44:29.627 INFO:tasks.workunit.client.0.smithi049.stdout:5/387: chown d7/d1d/d1f/d4e/d77/f93 376 1 2024-04-26T10:44:29.627 INFO:tasks.workunit.client.0.smithi049.stdout:6/376: fsync da/dd/de/d42/d5a/f5e 0 2024-04-26T10:44:29.627 INFO:tasks.workunit.client.0.smithi049.stdout:4/432: read f9 [1718221,2025] 0 2024-04-26T10:44:29.627 INFO:tasks.workunit.client.0.smithi049.stdout:2/369: mkdir d6/d32/d69 0 2024-04-26T10:44:29.627 INFO:tasks.workunit.client.0.smithi049.stdout:1/359: mkdir d1e/d20/d26/d37/d6e 0 2024-04-26T10:44:29.627 INFO:tasks.workunit.client.0.smithi049.stdout:8/386: fdatasync d2/df/d18/d30/f63 0 2024-04-26T10:44:29.627 INFO:tasks.workunit.client.0.smithi049.stdout:5/388: dread - d7/d1d/d1f/d4e/d65/f92 zero size 2024-04-26T10:44:29.628 INFO:tasks.workunit.client.0.smithi049.stdout:0/347: dwrite d8/d1e/f72 [0,4194304] 0 2024-04-26T10:44:29.628 INFO:tasks.workunit.client.0.smithi049.stdout:4/433: rename de/c7b to de/c86 0 2024-04-26T10:44:29.628 INFO:tasks.workunit.client.0.smithi049.stdout:8/387: rmdir d2/d1a/d50 39 2024-04-26T10:44:29.629 INFO:tasks.workunit.client.0.smithi049.stdout:6/377: getdents da/dd/d47/d7b 0 2024-04-26T10:44:29.629 INFO:tasks.workunit.client.0.smithi049.stdout:0/348: unlink d8/db/d11/d1c/f50 0 2024-04-26T10:44:29.629 INFO:tasks.workunit.client.0.smithi049.stdout:5/389: getdents d7/d1d 0 2024-04-26T10:44:29.629 INFO:tasks.workunit.client.0.smithi049.stdout:8/388: symlink d2/d17/d34/d40/l77 0 2024-04-26T10:44:29.630 INFO:tasks.workunit.client.0.smithi049.stdout:5/390: symlink d7/d1d/d1f/d4e/la5 0 2024-04-26T10:44:29.630 INFO:tasks.workunit.client.0.smithi049.stdout:0/349: truncate d8/d1e/f67 434952 0 2024-04-26T10:44:29.631 INFO:tasks.workunit.client.0.smithi049.stdout:6/378: fsync da/f19 0 2024-04-26T10:44:29.631 INFO:tasks.workunit.client.0.smithi049.stdout:4/434: dread - de/d1b/d5e/d72/d73/d84/d38/f45 zero size 2024-04-26T10:44:29.631 INFO:tasks.workunit.client.0.smithi049.stdout:0/350: stat d8 0 2024-04-26T10:44:29.631 INFO:tasks.workunit.client.0.smithi049.stdout:5/391: write d7/d1d/d1f/f51 [355499,4860] 0 2024-04-26T10:44:29.632 INFO:tasks.workunit.client.0.smithi049.stdout:6/379: chown da/f35 2921 1 2024-04-26T10:44:29.632 INFO:tasks.workunit.client.0.smithi049.stdout:8/389: link d2/df/d18/c39 d2/d1a/c78 0 2024-04-26T10:44:29.633 INFO:tasks.workunit.client.0.smithi049.stdout:6/380: unlink f5 0 2024-04-26T10:44:29.634 INFO:tasks.workunit.client.0.smithi049.stdout:0/351: rename d8/d1e/l37 to d8/db/d11/d1b/l7e 0 2024-04-26T10:44:29.634 INFO:tasks.workunit.client.0.smithi049.stdout:9/444: dread d2/d1a/d42/f72 [0,4194304] 0 2024-04-26T10:44:29.634 INFO:tasks.workunit.client.0.smithi049.stdout:2/370: dwrite d6/d9/f52 [0,4194304] 0 2024-04-26T10:44:29.635 INFO:tasks.workunit.client.0.smithi049.stdout:8/390: write d2/d17/d34/d40/f57 [646105,43694] 0 2024-04-26T10:44:29.635 INFO:tasks.workunit.client.0.smithi049.stdout:4/435: rename de/d1b/d5e/d72/d73/d84/d24/c36 to de/d3f/d48/c87 0 2024-04-26T10:44:29.635 INFO:tasks.workunit.client.0.smithi049.stdout:6/381: symlink da/dd/de/d11/l82 0 2024-04-26T10:44:29.635 INFO:tasks.workunit.client.0.smithi049.stdout:5/392: truncate f3 3109305 0 2024-04-26T10:44:29.636 INFO:tasks.workunit.client.0.smithi049.stdout:0/352: symlink d8/db/d11/d1c/l7f 0 2024-04-26T10:44:29.636 INFO:tasks.workunit.client.0.smithi049.stdout:9/445: chown d2/d1a/d1b/d1f/d49/c4e 19 1 2024-04-26T10:44:29.636 INFO:tasks.workunit.client.0.smithi049.stdout:4/436: fdatasync de/d3f/f5d 0 2024-04-26T10:44:29.636 INFO:tasks.workunit.client.0.smithi049.stdout:8/391: fdatasync d2/d17/d34/f44 0 2024-04-26T10:44:29.636 INFO:tasks.workunit.client.0.smithi049.stdout:9/446: read - d2/d1a/d1b/f4c zero size 2024-04-26T10:44:29.636 INFO:tasks.workunit.client.0.smithi049.stdout:6/382: write da/dd/f2a [214178,87814] 0 2024-04-26T10:44:29.638 INFO:tasks.workunit.client.0.smithi049.stdout:5/393: dread d7/d14/d18/f89 [0,4194304] 0 2024-04-26T10:44:29.638 INFO:tasks.workunit.client.0.smithi049.stdout:0/353: creat d8/db/d11/d1b/d4d/f80 x:0 0 0 2024-04-26T10:44:29.638 INFO:tasks.workunit.client.0.smithi049.stdout:9/447: fdatasync d2/d25/f2e 0 2024-04-26T10:44:29.638 INFO:tasks.workunit.client.0.smithi049.stdout:8/392: symlink d2/d1a/l79 0 2024-04-26T10:44:29.638 INFO:tasks.workunit.client.0.smithi049.stdout:4/437: mkdir de/d1b/d5e/d72/d73/d88 0 2024-04-26T10:44:29.638 INFO:tasks.workunit.client.0.smithi049.stdout:6/383: creat da/dd/d62/f83 x:0 0 0 2024-04-26T10:44:29.639 INFO:tasks.workunit.client.0.smithi049.stdout:8/393: mknod d2/d16/c7a 0 2024-04-26T10:44:29.639 INFO:tasks.workunit.client.0.smithi049.stdout:9/448: stat d2/d1a/l73 0 2024-04-26T10:44:29.639 INFO:tasks.workunit.client.0.smithi049.stdout:6/384: chown da/dd/de/d42/d5a/l2c 58568 1 2024-04-26T10:44:29.639 INFO:tasks.workunit.client.0.smithi049.stdout:9/449: chown d2/d25/d74/f77 255474716 1 2024-04-26T10:44:29.645 INFO:tasks.workunit.client.0.smithi049.stdout:5/394: dwrite d7/d14/d18/d48/f5f [0,4194304] 0 2024-04-26T10:44:29.645 INFO:tasks.workunit.client.0.smithi049.stdout:9/450: truncate d2/d40/d53/f86 4098410 0 2024-04-26T10:44:29.645 INFO:tasks.workunit.client.0.smithi049.stdout:8/394: dwrite d2/df/f62 [0,4194304] 0 2024-04-26T10:44:29.646 INFO:tasks.workunit.client.0.smithi049.stdout:5/395: chown d7/d1d/d34/f8e 3209004 1 2024-04-26T10:44:29.646 INFO:tasks.workunit.client.0.smithi049.stdout:8/395: chown d2/df/f36 512203327 1 2024-04-26T10:44:29.646 INFO:tasks.workunit.client.0.smithi049.stdout:9/451: write d2/d1a/df/f30 [6148601,84207] 0 2024-04-26T10:44:29.647 INFO:tasks.workunit.client.0.smithi049.stdout:4/438: dwrite de/d1b/d5e/d72/d73/d84/d24/f61 [0,4194304] 0 2024-04-26T10:44:29.651 INFO:tasks.workunit.client.0.smithi049.stdout:9/452: chown d2/d1a/d1b/f4c 2367 1 2024-04-26T10:44:29.652 INFO:tasks.workunit.client.0.smithi049.stdout:8/396: write d2/df/d10/f66 [2510748,67734] 0 2024-04-26T10:44:29.652 INFO:tasks.workunit.client.0.smithi049.stdout:6/385: dread da/dd/de/d26/d22/d4c/f53 [0,4194304] 0 2024-04-26T10:44:29.652 INFO:tasks.workunit.client.0.smithi049.stdout:3/334: dread d3/d23/d2f/d6a/d6b/d26/f48 [0,4194304] 0 2024-04-26T10:44:29.653 INFO:tasks.workunit.client.0.smithi049.stdout:9/453: fdatasync d2/d1a/d1b/d7a/f80 0 2024-04-26T10:44:29.654 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:29.651+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:29.655 INFO:tasks.workunit.client.0.smithi049.stdout:9/454: stat d2/d1a/df/c2f 0 2024-04-26T10:44:29.655 INFO:tasks.workunit.client.0.smithi049.stdout:3/335: read d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/f3f [3987144,97073] 0 2024-04-26T10:44:29.655 INFO:tasks.workunit.client.0.smithi049.stdout:9/455: chown d2/d1a/d1b/d1f/f3d 28855 1 2024-04-26T10:44:29.656 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:29.656 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:29.656 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:29.657 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:29.657 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:29.657 INFO:tasks.workunit.client.0.smithi049.stdout:5/396: symlink d7/d1d/d1f/d4e/d80/la6 0 2024-04-26T10:44:29.664 INFO:tasks.workunit.client.0.smithi049.stdout:1/360: sync 2024-04-26T10:44:29.666 INFO:tasks.workunit.client.0.smithi049.stdout:8/397: mknod d2/df/d10/c7b 0 2024-04-26T10:44:29.666 INFO:tasks.workunit.client.0.smithi049.stdout:6/386: mkdir da/dd/d47/d7b/d84 0 2024-04-26T10:44:29.666 INFO:tasks.workunit.client.0.smithi049.stdout:9/456: symlink d2/d1a/d1b/d1f/d34/d6d/l91 0 2024-04-26T10:44:29.666 INFO:tasks.workunit.client.0.smithi049.stdout:7/389: dread d2/f53 [0,4194304] 0 2024-04-26T10:44:29.666 INFO:tasks.workunit.client.0.smithi049.stdout:4/439: creat de/d1b/d5e/d72/d73/d88/f89 x:0 0 0 2024-04-26T10:44:29.667 INFO:tasks.workunit.client.0.smithi049.stdout:7/390: fdatasync d2/dd/f66 0 2024-04-26T10:44:29.667 INFO:tasks.workunit.client.0.smithi049.stdout:5/397: dread d7/d14/d18/f46 [0,4194304] 0 2024-04-26T10:44:29.668 INFO:tasks.workunit.client.0.smithi049.stdout:6/387: chown da/dd/de/d42/c71 971737 1 2024-04-26T10:44:29.669 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:29.672 INFO:tasks.workunit.client.0.smithi049.stdout:4/440: fsync de/d1b/d5e/d72/d73/d84/f2e 0 2024-04-26T10:44:29.672 INFO:tasks.workunit.client.0.smithi049.stdout:5/398: creat d7/d1d/d1f/d4e/d65/d6f/d91/d3e/fa7 x:0 0 0 2024-04-26T10:44:29.672 INFO:tasks.workunit.client.0.smithi049.stdout:6/388: rename da/f6c to da/dd/de/d42/f85 0 2024-04-26T10:44:29.674 INFO:tasks.workunit.client.0.smithi049.stdout:9/457: dwrite d2/d1a/d1b/d7a/f80 [0,4194304] 0 2024-04-26T10:44:29.675 INFO:tasks.workunit.client.0.smithi049.stdout:3/336: dwrite d3/d6/f42 [0,4194304] 0 2024-04-26T10:44:29.675 INFO:tasks.workunit.client.0.smithi049.stdout:1/361: dwrite d1e/f31 [0,4194304] 0 2024-04-26T10:44:29.675 INFO:tasks.workunit.client.0.smithi049.stdout:5/399: creat d7/d1d/d20/fa8 x:0 0 0 2024-04-26T10:44:29.675 INFO:tasks.workunit.client.0.smithi049.stdout:6/389: mknod da/dd/de/d42/c86 0 2024-04-26T10:44:29.676 INFO:tasks.workunit.client.0.smithi049.stdout:3/337: fdatasync d3/d23/d2f/d6a/d6b/d8/d55/d46/f53 0 2024-04-26T10:44:29.676 INFO:tasks.workunit.client.0.smithi049.stdout:1/362: dread - d1e/d20/d26/d37/f4e zero size 2024-04-26T10:44:29.677 INFO:tasks.workunit.client.0.smithi049.stdout:3/338: write d3/f76 [68014,55098] 0 2024-04-26T10:44:29.677 INFO:tasks.workunit.client.0.smithi049.stdout:9/458: creat d2/d1a/d42/f92 x:0 0 0 2024-04-26T10:44:29.678 INFO:tasks.workunit.client.0.smithi049.stdout:5/400: rename d7/d14/d18/f8a to d7/d1d/d1f/d4e/d65/d6f/d91/d3e/fa9 0 2024-04-26T10:44:29.679 INFO:tasks.workunit.client.0.smithi049.stdout:4/441: dwrite de/d1b/d5e/d72/d73/d84/d38/f58 [0,4194304] 0 2024-04-26T10:44:29.680 INFO:tasks.workunit.client.0.smithi049.stdout:1/363: read d1e/d20/d26/f33 [1518303,71611] 0 2024-04-26T10:44:29.683 INFO:tasks.workunit.client.0.smithi049.stdout:6/390: dwrite da/dd/de/d26/f6f [0,4194304] 0 2024-04-26T10:44:29.686 INFO:tasks.workunit.client.0.smithi049.stdout:3/339: dread d3/d23/d2f/d6a/d6b/d26/f6d [0,4194304] 0 2024-04-26T10:44:29.688 INFO:tasks.workunit.client.0.smithi049.stdout:9/459: dwrite d2/d1a/f79 [0,4194304] 0 2024-04-26T10:44:29.690 INFO:tasks.workunit.client.0.smithi049.stdout:5/401: creat d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d60/faa x:0 0 0 2024-04-26T10:44:29.693 INFO:tasks.workunit.client.0.smithi049.stdout:6/391: symlink da/dd/l87 0 2024-04-26T10:44:29.694 INFO:tasks.workunit.client.0.smithi049.stdout:2/371: sync 2024-04-26T10:44:29.694 INFO:tasks.workunit.client.0.smithi049.stdout:0/354: sync 2024-04-26T10:44:29.694 INFO:tasks.workunit.client.0.smithi049.stdout:7/391: sync 2024-04-26T10:44:29.695 INFO:tasks.workunit.client.0.smithi049.stdout:6/392: write da/dd/de/d26/f6f [3580744,1341] 0 2024-04-26T10:44:29.697 INFO:tasks.workunit.client.0.smithi049.stdout:6/393: write da/dd/f1e [717970,49895] 0 2024-04-26T10:44:29.700 INFO:tasks.workunit.client.0.smithi049.stdout:3/340: creat d3/d23/d2f/d6a/d6b/d26/f7a x:0 0 0 2024-04-26T10:44:29.701 INFO:tasks.workunit.client.0.smithi049.stdout:0/355: dwrite d8/d42/f62 [0,4194304] 0 2024-04-26T10:44:29.701 INFO:tasks.workunit.client.0.smithi049.stdout:8/398: truncate d2/d1a/f1e 956984 0 2024-04-26T10:44:29.701 INFO:tasks.workunit.client.0.smithi049.stdout:2/372: dwrite d6/f29 [4194304,4194304] 0 2024-04-26T10:44:29.703 INFO:tasks.workunit.client.0.smithi049.stdout:9/460: creat d2/d1a/d1b/d1f/d49/f93 x:0 0 0 2024-04-26T10:44:29.703 INFO:tasks.workunit.client.0.smithi049.stdout:2/373: chown d6/d32/d4a 11114 1 2024-04-26T10:44:29.704 INFO:tasks.workunit.client.0.smithi049.stdout:1/364: rename d1e/d20/d26/f30 to d1e/f6f 0 2024-04-26T10:44:29.704 INFO:tasks.workunit.client.0.smithi049.stdout:4/442: creat de/d1b/d5e/d72/d73/d84/f8a x:0 0 0 2024-04-26T10:44:29.705 INFO:tasks.workunit.client.0.smithi049.stdout:8/399: mkdir d2/d16/d19/d42/d7c 0 2024-04-26T10:44:29.705 INFO:tasks.workunit.client.0.smithi049.stdout:0/356: mknod d8/db/d11/d1c/c81 0 2024-04-26T10:44:29.705 INFO:tasks.workunit.client.0.smithi049.stdout:1/365: readlink d1e/l46 0 2024-04-26T10:44:29.705 INFO:tasks.workunit.client.0.smithi049.stdout:9/461: write d2/d1a/d1b/f16 [8572791,112406] 0 2024-04-26T10:44:29.705 INFO:tasks.workunit.client.0.smithi049.stdout:0/357: chown d8/f9 21372712 1 2024-04-26T10:44:29.705 INFO:tasks.workunit.client.0.smithi049.stdout:1/366: chown d1e/d20/d26/d57/l66 246 1 2024-04-26T10:44:29.708 INFO:tasks.workunit.client.0.smithi049.stdout:7/392: mknod d2/dd/c84 0 2024-04-26T10:44:29.708 INFO:tasks.workunit.client.0.smithi049.stdout:6/394: symlink da/d4a/l88 0 2024-04-26T10:44:29.708 INFO:tasks.workunit.client.0.smithi049.stdout:5/402: truncate d7/d1d/f27 3201287 0 2024-04-26T10:44:29.708 INFO:tasks.workunit.client.0.smithi049.stdout:9/462: creat d2/d1a/d1b/d1f/d49/f94 x:0 0 0 2024-04-26T10:44:29.708 INFO:tasks.workunit.client.0.smithi049.stdout:1/367: mkdir d1e/d20/d4d/d70 0 2024-04-26T10:44:29.708 INFO:tasks.workunit.client.0.smithi049.stdout:2/374: mkdir d6/d9/db/d11/d6a 0 2024-04-26T10:44:29.709 INFO:tasks.workunit.client.0.smithi049.stdout:4/443: unlink de/d1d/f59 0 2024-04-26T10:44:29.709 INFO:tasks.workunit.client.0.smithi049.stdout:3/341: dread d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/f3f [0,4194304] 0 2024-04-26T10:44:29.709 INFO:tasks.workunit.client.0.smithi049.stdout:7/393: fsync d2/dd/f14 0 2024-04-26T10:44:29.709 INFO:tasks.workunit.client.0.smithi049.stdout:0/358: truncate d8/f3d 474672 0 2024-04-26T10:44:29.710 INFO:tasks.workunit.client.0.smithi049.stdout:4/444: chown de/d3f/d48/d62 564418 1 2024-04-26T10:44:29.710 INFO:tasks.workunit.client.0.smithi049.stdout:9/463: rename d2/d1a/df/f4a to d2/d1a/f95 0 2024-04-26T10:44:29.713 INFO:tasks.workunit.client.0.smithi049.stdout:4/445: mkdir de/d3f/d48/d8b 0 2024-04-26T10:44:29.715 INFO:tasks.workunit.client.0.smithi049.stdout:0/359: write f3 [1873570,18974] 0 2024-04-26T10:44:29.715 INFO:tasks.workunit.client.0.smithi049.stdout:6/395: read da/dd/f1e [459861,106434] 0 2024-04-26T10:44:29.715 INFO:tasks.workunit.client.0.smithi049.stdout:5/403: truncate d7/d1d/d1f/d4e/d77/f93 392888 0 2024-04-26T10:44:29.715 INFO:tasks.workunit.client.0.smithi049.stdout:8/400: dwrite d2/d16/d19/f25 [0,4194304] 0 2024-04-26T10:44:29.715 INFO:tasks.workunit.client.0.smithi049.stdout:4/446: fsync de/d1b/d5e/d72/d73/d84/f25 0 2024-04-26T10:44:29.715 INFO:tasks.workunit.client.0.smithi049.stdout:9/464: symlink d2/d1a/d8a/l96 0 2024-04-26T10:44:29.716 INFO:tasks.workunit.client.0.smithi049.stdout:3/342: rename d3/d23/d2f/d6a/d6b/d8/d55/d46/f53 to d3/d23/d2f/d6a/d6b/d26/d58/f7b 0 2024-04-26T10:44:29.717 INFO:tasks.workunit.client.0.smithi049.stdout:9/465: symlink d2/d25/d74/l97 0 2024-04-26T10:44:29.717 INFO:tasks.workunit.client.0.smithi049.stdout:1/368: dwrite d1e/d20/d26/d37/f5d [0,4194304] 0 2024-04-26T10:44:29.717 INFO:tasks.workunit.client.0.smithi049.stdout:6/396: symlink da/dd/de/d26/d22/l89 0 2024-04-26T10:44:29.718 INFO:tasks.workunit.client.0.smithi049.stdout:8/401: creat d2/df/d10/d47/d75/f7d x:0 0 0 2024-04-26T10:44:29.718 INFO:tasks.workunit.client.0.smithi049.stdout:4/447: rmdir de/d1b/d5e/d72 39 2024-04-26T10:44:29.719 INFO:tasks.workunit.client.0.smithi049.stdout:6/397: chown da/d4a/l88 4 1 2024-04-26T10:44:29.719 INFO:tasks.workunit.client.0.smithi049.stdout:9/466: write d2/d1a/f79 [2938278,76399] 0 2024-04-26T10:44:29.719 INFO:tasks.workunit.client.0.smithi049.stdout:7/394: dwrite d2/dd/f66 [0,4194304] 0 2024-04-26T10:44:29.719 INFO:tasks.workunit.client.0.smithi049.stdout:8/402: fdatasync d2/d17/f3d 0 2024-04-26T10:44:29.720 INFO:tasks.workunit.client.0.smithi049.stdout:9/467: creat d2/d25/d74/f98 x:0 0 0 2024-04-26T10:44:29.720 INFO:tasks.workunit.client.0.smithi049.stdout:7/395: symlink d2/dd/d38/l85 0 2024-04-26T10:44:29.721 INFO:tasks.workunit.client.0.smithi049.stdout:6/398: write da/dd/f5c [2245512,102689] 0 2024-04-26T10:44:29.721 INFO:tasks.workunit.client.0.smithi049.stdout:8/403: chown d2/f14 4606 1 2024-04-26T10:44:29.722 INFO:tasks.workunit.client.0.smithi049.stdout:9/468: mknod d2/d1a/d1b/d1f/d49/c99 0 2024-04-26T10:44:29.722 INFO:tasks.workunit.client.0.smithi049.stdout:7/396: symlink d2/dd/d48/l86 0 2024-04-26T10:44:29.723 INFO:tasks.workunit.client.0.smithi049.stdout:8/404: creat d2/d1a/f7e x:0 0 0 2024-04-26T10:44:29.724 INFO:tasks.workunit.client.0.smithi049.stdout:7/397: write d2/d3/de/f51 [158626,94066] 0 2024-04-26T10:44:29.724 INFO:tasks.workunit.client.0.smithi049.stdout:5/404: dwrite d7/d1d/d1f/d4e/d65/d6f/f8b [0,4194304] 0 2024-04-26T10:44:29.725 INFO:tasks.workunit.client.0.smithi049.stdout:7/398: write d2/f1b [2227134,64382] 0 2024-04-26T10:44:29.725 INFO:tasks.workunit.client.0.smithi049.stdout:6/399: dread da/d4a/f37 [0,4194304] 0 2024-04-26T10:44:29.726 INFO:tasks.workunit.client.0.smithi049.stdout:6/400: chown da/d4a/f63 1479841 1 2024-04-26T10:44:29.726 INFO:tasks.workunit.client.0.smithi049.stdout:2/375: dread d6/d9/db/f24 [0,4194304] 0 2024-04-26T10:44:29.727 INFO:tasks.workunit.client.0.smithi049.stdout:8/405: rmdir d2/d17 39 2024-04-26T10:44:29.728 INFO:tasks.workunit.client.0.smithi049.stdout:8/406: fdatasync d2/df/f5a 0 2024-04-26T10:44:29.728 INFO:tasks.workunit.client.0.smithi049.stdout:7/399: symlink d2/dd/l87 0 2024-04-26T10:44:29.729 INFO:tasks.workunit.client.0.smithi049.stdout:6/401: fsync da/f32 0 2024-04-26T10:44:29.729 INFO:tasks.workunit.client.0.smithi049.stdout:2/376: creat d6/d9/f6b x:0 0 0 2024-04-26T10:44:29.729 INFO:tasks.workunit.client.0.smithi049.stdout:7/400: fdatasync d2/dd/d48/d5c/f5f 0 2024-04-26T10:44:29.729 INFO:tasks.workunit.client.0.smithi049.stdout:8/407: mkdir d2/d17/d34/d40/d7f 0 2024-04-26T10:44:29.729 INFO:tasks.workunit.client.0.smithi049.stdout:6/402: write da/dd/de/d26/f64 [823904,78625] 0 2024-04-26T10:44:29.729 INFO:tasks.workunit.client.0.smithi049.stdout:5/405: chown d7/d1d/d1f/l5e 2681152 1 2024-04-26T10:44:29.730 INFO:tasks.workunit.client.0.smithi049.stdout:4/448: read f9 [1127346,102095] 0 2024-04-26T10:44:29.730 INFO:tasks.workunit.client.0.smithi049.stdout:2/377: write d6/f29 [8779550,115072] 0 2024-04-26T10:44:29.732 INFO:tasks.workunit.client.0.smithi049.stdout:5/406: fsync d7/d14/d18/d48/f49 0 2024-04-26T10:44:29.732 INFO:tasks.workunit.client.0.smithi049.stdout:6/403: creat da/dd/f8a x:0 0 0 2024-04-26T10:44:29.732 INFO:tasks.workunit.client.0.smithi049.stdout:0/360: dread d8/d1e/f2b [0,4194304] 0 2024-04-26T10:44:29.732 INFO:tasks.workunit.client.0.smithi049.stdout:7/401: write d2/dd/d25/f31 [559110,22108] 0 2024-04-26T10:44:29.732 INFO:tasks.workunit.client.0.smithi049.stdout:4/449: rmdir de/d3f/d48 39 2024-04-26T10:44:29.733 INFO:tasks.workunit.client.0.smithi049.stdout:3/343: dread d3/d23/d2f/d6a/d6b/d8/d34/f44 [0,4194304] 0 2024-04-26T10:44:29.733 INFO:tasks.workunit.client.0.smithi049.stdout:8/408: chown d2/d1a/f1e 0 1 2024-04-26T10:44:29.733 INFO:tasks.workunit.client.0.smithi049.stdout:2/378: creat d6/d9/db/d34/f6c x:0 0 0 2024-04-26T10:44:29.733 INFO:tasks.workunit.client.0.smithi049.stdout:0/361: write d8/f52 [5021690,6036] 0 2024-04-26T10:44:29.733 INFO:tasks.workunit.client.0.smithi049.stdout:8/409: fdatasync d2/df/d18/d2a/f2b 0 2024-04-26T10:44:29.734 INFO:tasks.workunit.client.0.smithi049.stdout:6/404: rename f7 to da/dd/de/d26/d22/d4c/f8b 0 2024-04-26T10:44:29.734 INFO:tasks.workunit.client.0.smithi049.stdout:0/362: creat d8/db/d26/d39/f82 x:0 0 0 2024-04-26T10:44:29.734 INFO:tasks.workunit.client.0.smithi049.stdout:5/407: rename d7/d1d/d1f/d4e/d65/d6f/d91/d3e/fa9 to d7/fab 0 2024-04-26T10:44:29.735 INFO:tasks.workunit.client.0.smithi049.stdout:6/405: mknod da/dd/c8c 0 2024-04-26T10:44:29.735 INFO:tasks.workunit.client.0.smithi049.stdout:5/408: mknod d7/d66/cac 0 2024-04-26T10:44:29.736 INFO:tasks.workunit.client.0.smithi049.stdout:0/363: getdents d8 0 2024-04-26T10:44:29.737 INFO:tasks.workunit.client.0.smithi049.stdout:5/409: fdatasync d7/d14/d18/f46 0 2024-04-26T10:44:29.737 INFO:tasks.workunit.client.0.smithi049.stdout:2/379: dwrite d6/d9/db/df/f4c [0,4194304] 0 2024-04-26T10:44:29.738 INFO:tasks.workunit.client.0.smithi049.stdout:7/402: dwrite d2/fc [0,4194304] 0 2024-04-26T10:44:29.738 INFO:tasks.workunit.client.0.smithi049.stdout:8/410: truncate d2/df/d10/f13 3375172 0 2024-04-26T10:44:29.739 INFO:tasks.workunit.client.0.smithi049.stdout:0/364: write d8/db/d26/d39/f82 [168282,53672] 0 2024-04-26T10:44:29.740 INFO:tasks.workunit.client.0.smithi049.stdout:5/410: chown d7/d1d/d1f/d4e/d65/fa1 1355790 1 2024-04-26T10:44:29.743 INFO:tasks.workunit.client.0.smithi049.stdout:2/380: mknod d6/d9/db/c6d 0 2024-04-26T10:44:29.743 INFO:tasks.workunit.client.0.smithi049.stdout:0/365: write d8/db/d26/d39/f58 [3984036,31257] 0 2024-04-26T10:44:29.745 INFO:tasks.workunit.client.0.smithi049.stdout:3/344: dwrite d3/d23/d2f/d6a/d6b/d26/f48 [0,4194304] 0 2024-04-26T10:44:29.745 INFO:tasks.workunit.client.0.smithi049.stdout:6/406: dwrite da/dd/de/f18 [0,4194304] 0 2024-04-26T10:44:29.745 INFO:tasks.workunit.client.0.smithi049.stdout:2/381: stat d6/d9/db/d35/l59 0 2024-04-26T10:44:29.746 INFO:tasks.workunit.client.0.smithi049.stdout:8/411: link d2/df/d10/l2d d2/d16/d19/d42/d7c/l80 0 2024-04-26T10:44:29.747 INFO:tasks.workunit.client.0.smithi049.stdout:0/366: getdents d8/db/d26/d6f 0 2024-04-26T10:44:29.747 INFO:tasks.workunit.client.0.smithi049.stdout:6/407: dread - da/dd/f8a zero size 2024-04-26T10:44:29.747 INFO:tasks.workunit.client.0.smithi049.stdout:3/345: read d3/f76 [70708,56333] 0 2024-04-26T10:44:29.747 INFO:tasks.workunit.client.0.smithi049.stdout:2/382: readlink d6/d9/l1f 0 2024-04-26T10:44:29.748 INFO:tasks.workunit.client.0.smithi049.stdout:7/403: dwrite d2/dd/d38/f44 [0,4194304] 0 2024-04-26T10:44:29.748 INFO:tasks.workunit.client.0.smithi049.stdout:5/411: truncate d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d60/faa 379743 0 2024-04-26T10:44:29.748 INFO:tasks.workunit.client.0.smithi049.stdout:0/367: write d8/f9 [1759267,43476] 0 2024-04-26T10:44:29.750 INFO:tasks.workunit.client.0.smithi049.stdout:8/412: rename d2/d17/l45 to d2/df/d10/d23/d6c/l81 0 2024-04-26T10:44:29.750 INFO:tasks.workunit.client.0.smithi049.stdout:3/346: chown d3/d23/d2f/d6a/d6b/d26/d29/l77 12 1 2024-04-26T10:44:29.750 INFO:tasks.workunit.client.0.smithi049.stdout:5/412: mkdir d7/d1d/d1f/d4e/dad 0 2024-04-26T10:44:29.750 INFO:tasks.workunit.client.0.smithi049.stdout:0/368: creat d8/db/d11/f83 x:0 0 0 2024-04-26T10:44:29.750 INFO:tasks.workunit.client.0.smithi049.stdout:6/408: getdents da/dd/de/d26 0 2024-04-26T10:44:29.752 INFO:tasks.workunit.client.0.smithi049.stdout:5/413: chown d7/d1d/d1f/d4e/d65/d6f/d91/d3e 38455379 1 2024-04-26T10:44:29.752 INFO:tasks.workunit.client.0.smithi049.stdout:2/383: write d6/d9/db/d11/f1d [1673976,118264] 0 2024-04-26T10:44:29.752 INFO:tasks.workunit.client.0.smithi049.stdout:8/413: rename d2/l4 to d2/d16/l82 0 2024-04-26T10:44:29.753 INFO:tasks.workunit.client.0.smithi049.stdout:0/369: chown d8/db/d11/l16 26625 1 2024-04-26T10:44:29.755 INFO:tasks.workunit.client.0.smithi049.stdout:8/414: stat d2/d1a/d50/l61 0 2024-04-26T10:44:29.755 INFO:tasks.workunit.client.0.smithi049.stdout:4/450: sync 2024-04-26T10:44:29.755 INFO:tasks.workunit.client.0.smithi049.stdout:2/384: chown d6/d9/d5f 610622 1 2024-04-26T10:44:29.755 INFO:tasks.workunit.client.0.smithi049.stdout:6/409: creat da/dd/de/d26/d22/f8d x:0 0 0 2024-04-26T10:44:29.756 INFO:tasks.workunit.client.0.smithi049.stdout:7/404: dwrite d2/dd/d25/f75 [0,4194304] 0 2024-04-26T10:44:29.756 INFO:tasks.workunit.client.0.smithi049.stdout:8/415: rename d2/d17/f38 to d2/df/f83 0 2024-04-26T10:44:29.758 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:29.756+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:29.759 INFO:tasks.workunit.client.0.smithi049.stdout:8/416: creat d2/df/d18/d2a/f84 x:0 0 0 2024-04-26T10:44:29.759 INFO:tasks.workunit.client.0.smithi049.stdout:6/410: rename da/dd/de/d42/d5a/f24 to da/dd/de/d42/d5a/f8e 0 2024-04-26T10:44:29.759 INFO:tasks.workunit.client.0.smithi049.stdout:2/385: getdents d6/d9/db/df 0 2024-04-26T10:44:29.762 INFO:tasks.workunit.client.0.smithi049.stdout:5/414: dwrite d7/d1d/d20/f24 [0,4194304] 0 2024-04-26T10:44:29.763 INFO:tasks.workunit.client.0.smithi049.stdout:0/370: dwrite d8/db/d11/f83 [0,4194304] 0 2024-04-26T10:44:29.763 INFO:tasks.workunit.client.0.smithi049.stdout:2/386: write d6/d9/db/f13 [3547884,111944] 0 2024-04-26T10:44:29.764 INFO:tasks.workunit.client.0.smithi049.stdout:8/417: link d2/d1a/f1e d2/d16/d19/f85 0 2024-04-26T10:44:29.765 INFO:tasks.workunit.client.0.smithi049.stdout:0/371: chown d8/db/d11/d1b/d4d 1023383 1 2024-04-26T10:44:29.765 INFO:tasks.workunit.client.0.smithi049.stdout:2/387: readlink d6/d9/l2e 0 2024-04-26T10:44:29.767 INFO:tasks.workunit.client.0.smithi049.stdout:1/369: dread d1e/f3b [0,4194304] 0 2024-04-26T10:44:29.767 INFO:tasks.workunit.client.0.smithi049.stdout:4/451: dwrite de/d1b/d5e/d72/d73/d88/f89 [0,4194304] 0 2024-04-26T10:44:29.767 INFO:tasks.workunit.client.0.smithi049.stdout:7/405: dwrite d2/dd/d25/f75 [0,4194304] 0 2024-04-26T10:44:29.767 INFO:tasks.workunit.client.0.smithi049.stdout:8/418: rmdir d2/d17/d34/d40 39 2024-04-26T10:44:29.767 INFO:tasks.workunit.client.0.smithi049.stdout:2/388: write d6/d9/db/df/f4c [3815302,80953] 0 2024-04-26T10:44:29.768 INFO:tasks.workunit.client.0.smithi049.stdout:5/415: write d7/d14/d18/d48/f5f [4191630,53413] 0 2024-04-26T10:44:29.769 INFO:tasks.workunit.client.0.smithi049.stdout:2/389: read - d6/d9/f6b zero size 2024-04-26T10:44:29.770 INFO:tasks.workunit.client.0.smithi049.stdout:8/419: write d2/df/f83 [670725,46524] 0 2024-04-26T10:44:29.770 INFO:tasks.workunit.client.0.smithi049.stdout:0/372: getdents d8 0 2024-04-26T10:44:29.771 INFO:tasks.workunit.client.0.smithi049.stdout:2/390: rename d6/d9/db/d1e/f2a to d6/d30/f6e 0 2024-04-26T10:44:29.771 INFO:tasks.workunit.client.0.smithi049.stdout:8/420: write d2/df/d10/f66 [1994154,6941] 0 2024-04-26T10:44:29.772 INFO:tasks.workunit.client.0.smithi049.stdout:2/391: mknod d6/d32/c6f 0 2024-04-26T10:44:29.772 INFO:tasks.workunit.client.0.smithi049.stdout:9/469: dread d2/d1a/df/f13 [0,4194304] 0 2024-04-26T10:44:29.773 INFO:tasks.workunit.client.0.smithi049.stdout:0/373: rmdir d8/d1e/d6b 0 2024-04-26T10:44:29.773 INFO:tasks.workunit.client.0.smithi049.stdout:2/392: fsync d6/d30/f65 0 2024-04-26T10:44:29.774 INFO:tasks.workunit.client.0.smithi049.stdout:8/421: write d2/df/d18/d2a/f48 [1023266,20967] 0 2024-04-26T10:44:29.774 INFO:tasks.workunit.client.0.smithi049.stdout:0/374: chown d8/db/d11/d1b/f44 2542 1 2024-04-26T10:44:29.775 INFO:tasks.workunit.client.0.smithi049.stdout:9/470: chown d2/d1a/d1b/d1f/c50 24222 1 2024-04-26T10:44:29.776 INFO:tasks.workunit.client.0.smithi049.stdout:8/422: mknod d2/d17/d34/c86 0 2024-04-26T10:44:29.776 INFO:tasks.workunit.client.0.smithi049.stdout:2/393: creat d6/d9/db/f70 x:0 0 0 2024-04-26T10:44:29.776 INFO:tasks.workunit.client.0.smithi049.stdout:9/471: fsync d2/d1a/f95 0 2024-04-26T10:44:29.779 INFO:tasks.workunit.client.0.smithi049.stdout:9/472: chown d2/d1a/f5e 1 1 2024-04-26T10:44:29.779 INFO:tasks.workunit.client.0.smithi049.stdout:4/452: dwrite de/d1b/d5e/d72/d73/d84/f35 [4194304,4194304] 0 2024-04-26T10:44:29.779 INFO:tasks.workunit.client.0.smithi049.stdout:0/375: getdents d8/db/d11/d1b 0 2024-04-26T10:44:29.779 INFO:tasks.workunit.client.0.smithi049.stdout:8/423: getdents d2/d16/d19 0 2024-04-26T10:44:29.779 INFO:tasks.workunit.client.0.smithi049.stdout:9/473: mknod d2/d1a/d1b/d1f/d64/c9a 0 2024-04-26T10:44:29.781 INFO:tasks.workunit.client.0.smithi049.stdout:0/376: getdents d8/db/d26/d39 0 2024-04-26T10:44:29.781 INFO:tasks.workunit.client.0.smithi049.stdout:6/411: sync 2024-04-26T10:44:29.781 INFO:tasks.workunit.client.0.smithi049.stdout:5/416: sync 2024-04-26T10:44:29.781 INFO:tasks.workunit.client.0.smithi049.stdout:4/453: sync 2024-04-26T10:44:29.781 INFO:tasks.workunit.client.0.smithi049.stdout:0/377: sync 2024-04-26T10:44:29.781 INFO:tasks.workunit.client.0.smithi049.stdout:8/424: getdents d2/df/d18/d2a 0 2024-04-26T10:44:29.781 INFO:tasks.workunit.client.0.smithi049.stdout:9/474: creat d2/d1a/d1b/d7a/f9b x:0 0 0 2024-04-26T10:44:29.782 INFO:tasks.workunit.client.0.smithi049.stdout:6/412: truncate da/dd/f5c 4698715 0 2024-04-26T10:44:29.782 INFO:tasks.workunit.client.0.smithi049.stdout:0/378: mkdir d8/d66/d84 0 2024-04-26T10:44:29.783 INFO:tasks.workunit.client.0.smithi049.stdout:5/417: truncate d7/d53/f9d 568733 0 2024-04-26T10:44:29.784 INFO:tasks.workunit.client.0.smithi049.stdout:9/475: mkdir d2/d1a/d9c 0 2024-04-26T10:44:29.784 INFO:tasks.workunit.client.0.smithi049.stdout:2/394: dwrite d6/d9/db/df/d31/f5c [0,4194304] 0 2024-04-26T10:44:29.784 INFO:tasks.workunit.client.0.smithi049.stdout:1/370: read d1e/d20/d26/d3c/d54/f5a [294843,34298] 0 2024-04-26T10:44:29.785 INFO:tasks.workunit.client.0.smithi049.stdout:8/425: truncate d2/df/d10/f13 4350701 0 2024-04-26T10:44:29.786 INFO:tasks.workunit.client.0.smithi049.stdout:1/371: write d1e/d20/d26/f51 [1544050,762] 0 2024-04-26T10:44:29.787 INFO:tasks.workunit.client.0.smithi049.stdout:2/395: write d6/d9/db/f1c [8195249,120262] 0 2024-04-26T10:44:29.787 INFO:tasks.workunit.client.0.smithi049.stdout:6/413: getdents da/dd/d47/d7b 0 2024-04-26T10:44:29.787 INFO:tasks.workunit.client.0.smithi049.stdout:9/476: mknod d2/d1a/d1b/d1f/c9d 0 2024-04-26T10:44:29.787 INFO:tasks.workunit.client.0.smithi049.stdout:4/454: rename de/d1b/d5e/d72/d73/d84/d24/f32 to de/d1b/d5e/d72/d73/d84/f8c 0 2024-04-26T10:44:29.788 INFO:tasks.workunit.client.0.smithi049.stdout:2/396: readlink d6/d30/l37 0 2024-04-26T10:44:29.788 INFO:tasks.workunit.client.0.smithi049.stdout:6/414: chown da/dd/de/d26/d29 99885 1 2024-04-26T10:44:29.790 INFO:tasks.workunit.client.0.smithi049.stdout:2/397: symlink d6/d9/db/d35/l71 0 2024-04-26T10:44:29.791 INFO:tasks.workunit.client.0.smithi049.stdout:0/379: dwrite d8/db/f33 [0,4194304] 0 2024-04-26T10:44:29.791 INFO:tasks.workunit.client.0.smithi049.stdout:6/415: write da/dd/de/d26/d22/f54 [161314,121378] 0 2024-04-26T10:44:29.792 INFO:tasks.workunit.client.0.smithi049.stdout:6/416: write da/dd/de/d42/f69 [664967,118479] 0 2024-04-26T10:44:29.792 INFO:tasks.workunit.client.0.smithi049.stdout:0/380: fsync d8/db/d26/f40 0 2024-04-26T10:44:29.795 INFO:tasks.workunit.client.0.smithi049.stdout:1/372: dwrite d1e/d20/d4d/f5f [0,4194304] 0 2024-04-26T10:44:29.795 INFO:tasks.workunit.client.0.smithi049.stdout:9/477: write d2/d1a/d1b/d1f/f8f [94454,97961] 0 2024-04-26T10:44:29.796 INFO:tasks.workunit.client.0.smithi049.stdout:1/373: write fe [144253,3099] 0 2024-04-26T10:44:29.797 INFO:tasks.workunit.client.0.smithi049.stdout:4/455: fdatasync de/d1b/d5e/d72/d73/d88/f89 0 2024-04-26T10:44:29.798 INFO:tasks.workunit.client.0.smithi049.stdout:9/478: mknod d2/d1a/d1b/d1f/d64/c9e 0 2024-04-26T10:44:29.798 INFO:tasks.workunit.client.0.smithi049.stdout:2/398: dwrite d6/d9/db/d34/f5a [0,4194304] 0 2024-04-26T10:44:29.798 INFO:tasks.workunit.client.0.smithi049.stdout:1/374: chown d1e/d20/d26/d37/f58 204 1 2024-04-26T10:44:29.798 INFO:tasks.workunit.client.0.smithi049.stdout:4/456: chown de/d1b/f40 4 1 2024-04-26T10:44:29.800 INFO:tasks.workunit.client.0.smithi049.stdout:9/479: unlink d2/d40/f4b 0 2024-04-26T10:44:29.800 INFO:tasks.workunit.client.0.smithi049.stdout:2/399: chown d6/d9/db/d11/f5d 675050147 1 2024-04-26T10:44:29.802 INFO:tasks.workunit.client.0.smithi049.stdout:1/375: creat d1e/d62/f71 x:0 0 0 2024-04-26T10:44:29.802 INFO:tasks.workunit.client.0.smithi049.stdout:4/457: chown de/d3f/d48/c87 316935 1 2024-04-26T10:44:29.802 INFO:tasks.workunit.client.0.smithi049.stdout:0/381: dread d8/db/d11/f83 [0,4194304] 0 2024-04-26T10:44:29.802 INFO:tasks.workunit.client.0.smithi049.stdout:2/400: mknod d6/d32/d4a/c72 0 2024-04-26T10:44:29.802 INFO:tasks.workunit.client.0.smithi049.stdout:4/458: chown de/d3f/d48/d62 0 1 2024-04-26T10:44:29.802 INFO:tasks.workunit.client.0.smithi049.stdout:9/480: rename d2/d25/d74/f77 to d2/d1a/d1b/d1f/d64/f9f 0 2024-04-26T10:44:29.802 INFO:tasks.workunit.client.0.smithi049.stdout:0/382: symlink d8/d42/l85 0 2024-04-26T10:44:29.802 INFO:tasks.workunit.client.0.smithi049.stdout:1/376: truncate d1e/d20/d67/f6c 673958 0 2024-04-26T10:44:29.803 INFO:tasks.workunit.client.0.smithi049.stdout:2/401: mkdir d6/d9/db/d34/d38/d73 0 2024-04-26T10:44:29.803 INFO:tasks.workunit.client.0.smithi049.stdout:0/383: write d8/d1e/f2a [2389399,113558] 0 2024-04-26T10:44:29.803 INFO:tasks.workunit.client.0.smithi049.stdout:4/459: creat de/f8d x:0 0 0 2024-04-26T10:44:29.803 INFO:tasks.workunit.client.0.smithi049.stdout:1/377: creat d1e/f72 x:0 0 0 2024-04-26T10:44:29.804 INFO:tasks.workunit.client.0.smithi049.stdout:0/384: write d8/db/f25 [3236560,73054] 0 2024-04-26T10:44:29.805 INFO:tasks.workunit.client.0.smithi049.stdout:4/460: chown de/d1d/l4d 303918 1 2024-04-26T10:44:29.805 INFO:tasks.workunit.client.0.smithi049.stdout:2/402: link d6/d32/d4a/c56 d6/d9/db/d34/d38/c74 0 2024-04-26T10:44:29.805 INFO:tasks.workunit.client.0.smithi049.stdout:0/385: write d8/db/d11/d1b/d4d/f5e [2251540,59358] 0 2024-04-26T10:44:29.806 INFO:tasks.workunit.client.0.smithi049.stdout:2/403: mknod d6/d32/d4a/c75 0 2024-04-26T10:44:29.806 INFO:tasks.workunit.client.0.smithi049.stdout:0/386: rename d8/db/d26/f2d to d8/d66/f86 0 2024-04-26T10:44:29.807 INFO:tasks.workunit.client.0.smithi049.stdout:4/461: write de/d1b/d5e/d72/d73/d84/f22 [3330372,83602] 0 2024-04-26T10:44:29.807 INFO:tasks.workunit.client.0.smithi049.stdout:8/426: dread d2/df/d18/f74 [0,4194304] 0 2024-04-26T10:44:29.808 INFO:tasks.workunit.client.0.smithi049.stdout:8/427: chown d2/df/d18/d2a/f54 1 1 2024-04-26T10:44:29.808 INFO:tasks.workunit.client.0.smithi049.stdout:4/462: mknod de/d1b/d5e/d72/d73/d84/d24/d50/c8e 0 2024-04-26T10:44:29.809 INFO:tasks.workunit.client.0.smithi049.stdout:6/417: dread da/dd/de/d26/f72 [0,4194304] 0 2024-04-26T10:44:29.809 INFO:tasks.workunit.client.0.smithi049.stdout:4/463: readlink lb 0 2024-04-26T10:44:29.809 INFO:tasks.workunit.client.0.smithi049.stdout:8/428: mknod d2/d16/d19/d42/c87 0 2024-04-26T10:44:29.810 INFO:tasks.workunit.client.0.smithi049.stdout:2/404: getdents d6/d32/d4a 0 2024-04-26T10:44:29.811 INFO:tasks.workunit.client.0.smithi049.stdout:4/464: chown de/d3f/d48/l65 787291 1 2024-04-26T10:44:29.812 INFO:tasks.workunit.client.0.smithi049.stdout:2/405: fdatasync d6/d9/db/d34/d38/d3f/f45 0 2024-04-26T10:44:29.813 INFO:tasks.workunit.client.0.smithi049.stdout:5/418: dread d7/d1d/d34/f8e [0,4194304] 0 2024-04-26T10:44:29.814 INFO:tasks.workunit.client.0.smithi049.stdout:4/465: unlink de/f27 0 2024-04-26T10:44:29.814 INFO:tasks.workunit.client.0.smithi049.stdout:8/429: truncate d2/d17/f69 2085981 0 2024-04-26T10:44:29.815 INFO:tasks.workunit.client.0.smithi049.stdout:0/387: dwrite d8/d42/f54 [0,4194304] 0 2024-04-26T10:44:29.815 INFO:tasks.workunit.client.0.smithi049.stdout:2/406: unlink d6/d9/db/d35/l71 0 2024-04-26T10:44:29.817 INFO:tasks.workunit.client.0.smithi049.stdout:2/407: readlink d6/d9/db/d1e/l39 0 2024-04-26T10:44:29.818 INFO:tasks.workunit.client.0.smithi049.stdout:6/418: dwrite da/dd/de/d42/d5a/f5e [0,4194304] 0 2024-04-26T10:44:29.818 INFO:tasks.workunit.client.0.smithi049.stdout:8/430: rename d2/d1a/d50 to d2/d16/d88 0 2024-04-26T10:44:29.818 INFO:tasks.workunit.client.0.smithi049.stdout:5/419: creat d7/d1d/d1f/d4e/d65/d6f/d91/fae x:0 0 0 2024-04-26T10:44:29.820 INFO:tasks.workunit.client.0.smithi049.stdout:6/419: fdatasync da/dd/d47/f80 0 2024-04-26T10:44:29.820 INFO:tasks.workunit.client.0.smithi049.stdout:4/466: truncate de/d1b/d5e/d72/d73/d84/f2e 3287660 0 2024-04-26T10:44:29.820 INFO:tasks.workunit.client.0.smithi049.stdout:3/347: dread d3/d23/d2f/d6a/d6b/d8/d34/f51 [0,4194304] 0 2024-04-26T10:44:29.821 INFO:tasks.workunit.client.0.smithi049.stdout:2/408: creat d6/d9/f76 x:0 0 0 2024-04-26T10:44:29.822 INFO:tasks.workunit.client.0.smithi049.stdout:8/431: rename d2/df/d18 to d2/d89 0 2024-04-26T10:44:29.822 INFO:tasks.workunit.client.0.smithi049.stdout:5/420: read - d7/d1d/d1f/d4e/d65/f92 zero size 2024-04-26T10:44:29.822 INFO:tasks.workunit.client.0.smithi049.stdout:2/409: chown d6/d32/c44 253435131 1 2024-04-26T10:44:29.822 INFO:tasks.workunit.client.0.smithi049.stdout:6/420: rmdir da/dd/d47 39 2024-04-26T10:44:29.824 INFO:tasks.workunit.client.0.smithi049.stdout:6/421: dread - da/d4a/f6e zero size 2024-04-26T10:44:29.824 INFO:tasks.workunit.client.0.smithi049.stdout:3/348: chown d3/d23/d2f/d6a/d6b/d26/d29/l54 2693 1 2024-04-26T10:44:29.824 INFO:tasks.workunit.client.0.smithi049.stdout:2/410: chown d6/d9/db/d11/l2c 35 1 2024-04-26T10:44:29.824 INFO:tasks.workunit.client.0.smithi049.stdout:4/467: fsync de/d1b/d5e/d72/d73/d84/f2e 0 2024-04-26T10:44:29.825 INFO:tasks.workunit.client.0.smithi049.stdout:6/422: fsync da/f35 0 2024-04-26T10:44:29.825 INFO:tasks.workunit.client.0.smithi049.stdout:5/421: creat d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d60/faf x:0 0 0 2024-04-26T10:44:29.825 INFO:tasks.workunit.client.0.smithi049.stdout:0/388: dwrite d8/d42/f43 [0,4194304] 0 2024-04-26T10:44:29.825 INFO:tasks.workunit.client.0.smithi049.stdout:2/411: stat d6/d9/fc 0 2024-04-26T10:44:29.826 INFO:tasks.workunit.client.0.smithi049.stdout:8/432: dread d2/d89/f41 [0,4194304] 0 2024-04-26T10:44:29.826 INFO:tasks.workunit.client.0.smithi049.stdout:0/389: stat d8/d42 0 2024-04-26T10:44:29.827 INFO:tasks.workunit.client.0.smithi049.stdout:4/468: rmdir de/d1d 39 2024-04-26T10:44:29.827 INFO:tasks.workunit.client.0.smithi049.stdout:2/412: readlink d6/d30/l49 0 2024-04-26T10:44:29.827 INFO:tasks.workunit.client.0.smithi049.stdout:7/406: dread f0 [4194304,4194304] 0 2024-04-26T10:44:29.827 INFO:tasks.workunit.client.0.smithi049.stdout:3/349: stat d3/d23/d2f/d6a/d6b/d8/f57 0 2024-04-26T10:44:29.827 INFO:tasks.workunit.client.0.smithi049.stdout:6/423: chown da/dd/f8a 6331 1 2024-04-26T10:44:29.827 INFO:tasks.workunit.client.0.smithi049.stdout:5/422: write d7/d14/d18/d48/f49 [2584169,121489] 0 2024-04-26T10:44:29.828 INFO:tasks.workunit.client.0.smithi049.stdout:0/390: write d8/db/d26/d39/f58 [1526349,9390] 0 2024-04-26T10:44:29.829 INFO:tasks.workunit.client.0.smithi049.stdout:7/407: read - d2/dd/d25/f7d zero size 2024-04-26T10:44:29.829 INFO:tasks.workunit.client.0.smithi049.stdout:2/413: write d6/d9/f52 [1896804,110647] 0 2024-04-26T10:44:29.829 INFO:tasks.workunit.client.0.smithi049.stdout:6/424: fsync da/dd/de/d42/d5a/f65 0 2024-04-26T10:44:29.830 INFO:tasks.workunit.client.0.smithi049.stdout:5/423: unlink d7/l8 0 2024-04-26T10:44:29.830 INFO:tasks.workunit.client.0.smithi049.stdout:9/481: dread d2/f3c [0,4194304] 0 2024-04-26T10:44:29.830 INFO:tasks.workunit.client.0.smithi049.stdout:0/391: chown d8/d42/f43 107571 1 2024-04-26T10:44:29.836 INFO:tasks.workunit.client.0.smithi049.stdout:7/408: creat d2/dd/d48/f88 x:0 0 0 2024-04-26T10:44:29.836 INFO:tasks.workunit.client.0.smithi049.stdout:6/425: creat da/dd/de/d26/d29/f8f x:0 0 0 2024-04-26T10:44:29.836 INFO:tasks.workunit.client.0.smithi049.stdout:3/350: creat d3/d23/d2f/d6a/d6b/d8/dd/f7c x:0 0 0 2024-04-26T10:44:29.836 INFO:tasks.workunit.client.0.smithi049.stdout:9/482: chown d2/d1a/d1b/d1f/d49/f94 3537 1 2024-04-26T10:44:29.836 INFO:tasks.workunit.client.0.smithi049.stdout:9/483: read d2/f3c [1679183,79161] 0 2024-04-26T10:44:29.836 INFO:tasks.workunit.client.0.smithi049.stdout:7/409: write d2/d3/de/d1c/f3e [558648,110400] 0 2024-04-26T10:44:29.836 INFO:tasks.workunit.client.0.smithi049.stdout:6/426: getdents da/dd 0 2024-04-26T10:44:29.837 INFO:tasks.workunit.client.0.smithi049.stdout:3/351: rmdir d3/d23/d2f/d6a/d6b/d26/d29 39 2024-04-26T10:44:29.837 INFO:tasks.workunit.client.0.smithi049.stdout:5/424: write d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d60/faa [343847,40045] 0 2024-04-26T10:44:29.837 INFO:tasks.workunit.client.0.smithi049.stdout:4/469: dwrite de/d1b/d5e/d72/f7f [0,4194304] 0 2024-04-26T10:44:29.838 INFO:tasks.workunit.client.0.smithi049.stdout:2/414: dwrite d6/d9/db/df/f12 [8388608,4194304] 0 2024-04-26T10:44:29.838 INFO:tasks.workunit.client.0.smithi049.stdout:6/427: symlink da/dd/de/d26/d22/d4c/l90 0 2024-04-26T10:44:29.839 INFO:tasks.workunit.client.0.smithi049.stdout:3/352: write d3/d23/d2f/d6a/d6b/d8/d34/f44 [758453,26171] 0 2024-04-26T10:44:29.840 INFO:tasks.workunit.client.0.smithi049.stdout:0/392: dwrite d8/d42/f6c [0,4194304] 0 2024-04-26T10:44:29.840 INFO:tasks.workunit.client.0.smithi049.stdout:6/428: write da/dd/de/d26/f64 [1817934,15630] 0 2024-04-26T10:44:29.841 INFO:tasks.workunit.client.0.smithi049.stdout:1/378: dread d1e/d20/d26/d3c/d54/d59/f65 [0,4194304] 0 2024-04-26T10:44:29.843 INFO:tasks.workunit.client.0.smithi049.stdout:9/484: dread d2/d1a/d1b/f52 [0,4194304] 0 2024-04-26T10:44:29.843 INFO:tasks.workunit.client.0.smithi049.stdout:5/425: truncate d7/f64 335965 0 2024-04-26T10:44:29.843 INFO:tasks.workunit.client.0.smithi049.stdout:2/415: rename d6/d9/db/df/l17 to d6/d9/db/d34/d38/l77 0 2024-04-26T10:44:29.843 INFO:tasks.workunit.client.0.smithi049.stdout:0/393: unlink d8/db/d11/d1b/d4d/f73 0 2024-04-26T10:44:29.844 INFO:tasks.workunit.client.0.smithi049.stdout:7/410: link d2/dd/d38/l7e d2/d3/de/d1c/d4d/l89 0 2024-04-26T10:44:29.845 INFO:tasks.workunit.client.0.smithi049.stdout:6/429: creat da/f91 x:0 0 0 2024-04-26T10:44:29.846 INFO:tasks.workunit.client.0.smithi049.stdout:9/485: write d2/d25/f3e [745086,8000] 0 2024-04-26T10:44:29.846 INFO:tasks.workunit.client.0.smithi049.stdout:5/426: read d7/d1d/d20/f24 [2545695,123401] 0 2024-04-26T10:44:29.846 INFO:tasks.workunit.client.0.smithi049.stdout:0/394: creat d8/db/d11/d1b/d4d/f87 x:0 0 0 2024-04-26T10:44:29.846 INFO:tasks.workunit.client.0.smithi049.stdout:2/416: dread - d6/d9/db/d11/f57 zero size 2024-04-26T10:44:29.846 INFO:tasks.workunit.client.0.smithi049.stdout:3/353: rename d3/d23/d2f/d6a/d6b/d26/f41 to d3/d23/d2f/d6a/d6b/d26/d29/f7d 0 2024-04-26T10:44:29.847 INFO:tasks.workunit.client.0.smithi049.stdout:7/411: stat d2/dd/d25/d27/l39 0 2024-04-26T10:44:29.847 INFO:tasks.workunit.client.0.smithi049.stdout:4/470: dwrite de/d1b/d5e/d72/d73/d84/d24/f61 [4194304,4194304] 0 2024-04-26T10:44:29.847 INFO:tasks.workunit.client.0.smithi049.stdout:9/486: fsync d2/d1a/f95 0 2024-04-26T10:44:29.848 INFO:tasks.workunit.client.0.smithi049.stdout:5/427: creat d7/d1d/d1f/d4e/d65/fb0 x:0 0 0 2024-04-26T10:44:29.849 INFO:tasks.workunit.client.0.smithi049.stdout:4/471: chown de/c21 58 1 2024-04-26T10:44:29.849 INFO:tasks.workunit.client.0.smithi049.stdout:6/430: mkdir da/dd/d47/d7b/d84/d92 0 2024-04-26T10:44:29.849 INFO:tasks.workunit.client.0.smithi049.stdout:9/487: readlink d2/d1a/df/l3b 0 2024-04-26T10:44:29.849 INFO:tasks.workunit.client.0.smithi049.stdout:2/417: mknod d6/d9/db/d34/d38/d3f/c78 0 2024-04-26T10:44:29.850 INFO:tasks.workunit.client.0.smithi049.stdout:3/354: write d3/d23/d2f/d6a/d6b/d26/f6d [3317123,114849] 0 2024-04-26T10:44:29.851 INFO:tasks.workunit.client.0.smithi049.stdout:0/395: getdents d8 0 2024-04-26T10:44:29.851 INFO:tasks.workunit.client.0.smithi049.stdout:2/418: creat d6/f79 x:0 0 0 2024-04-26T10:44:29.852 INFO:tasks.workunit.client.0.smithi049.stdout:5/428: dread d7/d14/d18/d2b/f4b [0,4194304] 0 2024-04-26T10:44:29.852 INFO:tasks.workunit.client.0.smithi049.stdout:4/472: truncate de/d1b/d5e/d72/d73/f85 216387 0 2024-04-26T10:44:29.852 INFO:tasks.workunit.client.0.smithi049.stdout:0/396: sync 2024-04-26T10:44:29.853 INFO:tasks.workunit.client.0.smithi049.stdout:2/419: truncate f5 121163 0 2024-04-26T10:44:29.853 INFO:tasks.workunit.client.0.smithi049.stdout:3/355: getdents d3 0 2024-04-26T10:44:29.855 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:29.853+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:29.855 INFO:tasks.workunit.client.0.smithi049.stdout:0/397: rmdir d8/d42 39 2024-04-26T10:44:29.856 INFO:tasks.workunit.client.0.smithi049.stdout:2/420: truncate f3 513596 0 2024-04-26T10:44:29.856 INFO:tasks.workunit.client.0.smithi049.stdout:8/433: dread d2/f14 [0,4194304] 0 2024-04-26T10:44:29.857 INFO:tasks.workunit.client.0.smithi049.stdout:7/412: dwrite d2/dd/d25/d27/f57 [0,4194304] 0 2024-04-26T10:44:29.857 INFO:tasks.workunit.client.0.smithi049.stdout:5/429: creat d7/d1d/d1f/d4e/d80/fb1 x:0 0 0 2024-04-26T10:44:29.859 INFO:tasks.workunit.client.0.smithi049.stdout:0/398: write d8/f74 [2477467,69168] 0 2024-04-26T10:44:29.859 INFO:tasks.workunit.client.0.smithi049.stdout:2/421: symlink d6/d9/db/d34/l7a 0 2024-04-26T10:44:29.859 INFO:tasks.workunit.client.0.smithi049.stdout:7/413: truncate d2/f49 545918 0 2024-04-26T10:44:29.859 INFO:tasks.workunit.client.0.smithi049.stdout:3/356: rename d3/d23/d2f/d6a/d6b/d8/d55/d2e/c5d to d3/d23/d2f/c7e 0 2024-04-26T10:44:29.859 INFO:tasks.workunit.client.0.smithi049.stdout:9/488: dwrite d2/d1a/d1b/d7a/f9b [0,4194304] 0 2024-04-26T10:44:29.860 INFO:tasks.workunit.client.0.smithi049.stdout:7/414: chown d2/f33 3896 1 2024-04-26T10:44:29.861 INFO:tasks.workunit.client.0.smithi049.stdout:0/399: write d8/db/d11/d1c/f5b [2981348,45444] 0 2024-04-26T10:44:29.861 INFO:tasks.workunit.client.0.smithi049.stdout:7/415: rmdir d2/dd/d48 39 2024-04-26T10:44:29.862 INFO:tasks.workunit.client.0.smithi049.stdout:4/473: dread de/d1b/d5e/d72/f7f [0,4194304] 0 2024-04-26T10:44:29.862 INFO:tasks.workunit.client.0.smithi049.stdout:9/489: chown d2/d1a/d1b/d7a/f80 3334 1 2024-04-26T10:44:29.862 INFO:tasks.workunit.client.0.smithi049.stdout:3/357: creat d3/d23/d2f/d6a/f7f x:0 0 0 2024-04-26T10:44:29.863 INFO:tasks.workunit.client.0.smithi049.stdout:0/400: symlink d8/l88 0 2024-04-26T10:44:29.863 INFO:tasks.workunit.client.0.smithi049.stdout:9/490: fdatasync d2/d1a/f45 0 2024-04-26T10:44:29.863 INFO:tasks.workunit.client.0.smithi049.stdout:4/474: fsync f7 0 2024-04-26T10:44:29.863 INFO:tasks.workunit.client.0.smithi049.stdout:8/434: read d2/d16/d19/f85 [198875,36847] 0 2024-04-26T10:44:29.864 INFO:tasks.workunit.client.0.smithi049.stdout:4/475: dread - de/f8d zero size 2024-04-26T10:44:29.865 INFO:tasks.workunit.client.0.smithi049.stdout:7/416: write d2/f22 [4444480,29135] 0 2024-04-26T10:44:29.865 INFO:tasks.workunit.client.0.smithi049.stdout:8/435: write d2/fe [1926672,89885] 0 2024-04-26T10:44:29.866 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:80 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.3408041019999999, 2024-04-26T10:44:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029259192, 2024-04-26T10:44:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522252+0000", 2024-04-26T10:44:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523121+0000", 2024-04-26T10:44:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00086885100000000002 2024-04-26T10:44:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523133+0000", 2024-04-26T10:44:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2109999999999999e-05 2024-04-26T10:44:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523139+0000", 2024-04-26T10:44:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.541e-06 2024-04-26T10:44:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523176+0000", 2024-04-26T10:44:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6847999999999997e-05 2024-04-26T10:44:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523240+0000", 2024-04-26T10:44:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3941000000000003e-05 2024-04-26T10:44:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.536390+0000", 2024-04-26T10:44:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013150811 2024-04-26T10:44:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551071+0000", 2024-04-26T10:44:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014680021 2024-04-26T10:44:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551428+0000", 2024-04-26T10:44:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00035703900000000002 2024-04-26T10:44:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551462+0000", 2024-04-26T10:44:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4337e-05 2024-04-26T10:44:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551513+0000", 2024-04-26T10:44:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0875000000000003e-05 2024-04-26T10:44:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:129 3.1a 3:5e41ab69:::200.00000005:head [write 3557843~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.3367460320000006, 2024-04-26T10:44:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029108253000000001, 2024-04-26T10:44:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526311+0000", 2024-04-26T10:44:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526315+0000", 2024-04-26T10:44:29.874 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4809999999999998e-06 2024-04-26T10:44:29.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.874 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:29.874 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526319+0000", 2024-04-26T10:44:29.874 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0690000000000003e-06 2024-04-26T10:44:29.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.874 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.874 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526321+0000", 2024-04-26T10:44:29.874 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4880000000000001e-06 2024-04-26T10:44:29.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.874 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:29.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553856+0000", 2024-04-26T10:44:29.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027534916 2024-04-26T10:44:29.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:29.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553900+0000", 2024-04-26T10:44:29.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3954e-05 2024-04-26T10:44:29.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:29.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553962+0000", 2024-04-26T10:44:29.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1519000000000005e-05 2024-04-26T10:44:29.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.876 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:29.876 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555348+0000", 2024-04-26T10:44:29.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013864579999999999 2024-04-26T10:44:29.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.876 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:29.876 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555378+0000", 2024-04-26T10:44:29.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9441000000000002e-05 2024-04-26T10:44:29.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.876 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:29.876 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555401+0000", 2024-04-26T10:44:29.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2815000000000001e-05 2024-04-26T10:44:29.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.877 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:29.877 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555420+0000", 2024-04-26T10:44:29.877 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9341e-05 2024-04-26T10:44:29.877 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.877 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:29.877 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.877 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:130 3.1a 3:5e41ab69:::200.00000005:head [write 3559243~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:29.877 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:29.877 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.3367341970000002, 2024-04-26T10:44:29.877 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029188316999999998, 2024-04-26T10:44:29.877 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:29.877 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.878 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:29.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.878 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:29.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:29.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.878 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:29.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:29.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.878 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:29.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:29.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:29.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:29.879 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526325+0000", 2024-04-26T10:44:29.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4899999999999999e-06 2024-04-26T10:44:29.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:29.879 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526327+0000", 2024-04-26T10:44:29.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.745e-06 2024-04-26T10:44:29.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.880 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526330+0000", 2024-04-26T10:44:29.880 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5620000000000002e-06 2024-04-26T10:44:29.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.880 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:29.880 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554200+0000", 2024-04-26T10:44:29.880 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027869541000000001 2024-04-26T10:44:29.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.880 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:29.880 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554244+0000", 2024-04-26T10:44:29.880 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4464e-05 2024-04-26T10:44:29.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:29.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554304+0000", 2024-04-26T10:44:29.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9457999999999999e-05 2024-04-26T10:44:29.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:29.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555453+0000", 2024-04-26T10:44:29.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011494000000000001 2024-04-26T10:44:29.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:29.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555457+0000", 2024-04-26T10:44:29.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1779999999999996e-06 2024-04-26T10:44:29.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.882 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:29.882 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555480+0000", 2024-04-26T10:44:29.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2802e-05 2024-04-26T10:44:29.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.882 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:29.882 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555512+0000", 2024-04-26T10:44:29.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1885999999999999e-05 2024-04-26T10:44:29.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.882 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:29.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.883 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:131 3.1a 3:5e41ab69:::200.00000005:head [write 3560642~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:29.883 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:29.883 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.3367256170000008, 2024-04-26T10:44:29.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029683102999999999, 2024-04-26T10:44:29.883 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:29.883 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.883 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:29.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:29.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:29.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:29.884 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:29.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.884 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:29.884 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:29.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:29.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.884 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:29.884 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526336+0000", 2024-04-26T10:44:29.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.681e-06 2024-04-26T10:44:29.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:29.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526338+0000", 2024-04-26T10:44:29.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8430000000000001e-06 2024-04-26T10:44:29.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526341+0000", 2024-04-26T10:44:29.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6180000000000002e-06 2024-04-26T10:44:29.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:29.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554745+0000", 2024-04-26T10:44:29.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028404088000000001 2024-04-26T10:44:29.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:29.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554788+0000", 2024-04-26T10:44:29.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2738999999999999e-05 2024-04-26T10:44:29.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:29.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554849+0000", 2024-04-26T10:44:29.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1362e-05 2024-04-26T10:44:29.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:29.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555963+0000", 2024-04-26T10:44:29.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001113597 2024-04-26T10:44:29.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:29.887 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555969+0000", 2024-04-26T10:44:29.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6900000000000003e-06 2024-04-26T10:44:29.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:29.887 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555995+0000", 2024-04-26T10:44:29.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5165999999999999e-05 2024-04-26T10:44:29.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:29.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556015+0000", 2024-04-26T10:44:29.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0522000000000001e-05 2024-04-26T10:44:29.888 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.888 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:29.888 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.888 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:132 3.1a 3:5e41ab69:::200.00000005:head [write 3562043~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:29.888 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:29.888 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.3367053519999992, 2024-04-26T10:44:29.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030129895, 2024-04-26T10:44:29.889 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:29.889 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.889 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:29.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.889 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:29.889 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:29.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.889 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:29.889 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:29.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:29.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:29.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:29.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:29.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526354+0000", 2024-04-26T10:44:29.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8560000000000001e-06 2024-04-26T10:44:29.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:29.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526359+0000", 2024-04-26T10:44:29.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4700000000000001e-06 2024-04-26T10:44:29.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526365+0000", 2024-04-26T10:44:29.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2120000000000002e-06 2024-04-26T10:44:29.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:29.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555050+0000", 2024-04-26T10:44:29.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028685458 2024-04-26T10:44:29.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:29.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555093+0000", 2024-04-26T10:44:29.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3307999999999999e-05 2024-04-26T10:44:29.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:29.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555156+0000", 2024-04-26T10:44:29.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2396000000000004e-05 2024-04-26T10:44:29.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:29.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556052+0000", 2024-04-26T10:44:29.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00089650299999999999 2024-04-26T10:44:29.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:29.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556439+0000", 2024-04-26T10:44:29.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038647900000000001 2024-04-26T10:44:29.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:29.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556463+0000", 2024-04-26T10:44:29.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4071e-05 2024-04-26T10:44:29.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:29.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556482+0000", 2024-04-26T10:44:29.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9378999999999999e-05 2024-04-26T10:44:29.894 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.894 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:29.894 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.894 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 3563440~3660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:29.895 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:29.895 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.3366889579999999, 2024-04-26T10:44:29.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030550738000000001, 2024-04-26T10:44:29.895 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:29.895 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.895 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:29.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:29.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:29.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:29.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:29.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:29.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526368+0000", 2024-04-26T10:44:29.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:29.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:29.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526375+0000", 2024-04-26T10:44:29.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7510000000000002e-06 2024-04-26T10:44:29.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:29.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526381+0000", 2024-04-26T10:44:29.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3929999999999996e-06 2024-04-26T10:44:29.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526387+0000", 2024-04-26T10:44:29.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.215e-06 2024-04-26T10:44:29.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:29.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555542+0000", 2024-04-26T10:44:29.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029154992000000001 2024-04-26T10:44:29.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:29.898 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555610+0000", 2024-04-26T10:44:29.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8610999999999998e-05 2024-04-26T10:44:29.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:29.898 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555681+0000", 2024-04-26T10:44:29.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1072e-05 2024-04-26T10:44:29.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:29.898 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556866+0000", 2024-04-26T10:44:29.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001184598 2024-04-26T10:44:29.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:29.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556872+0000", 2024-04-26T10:44:29.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.55e-06 2024-04-26T10:44:29.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:29.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556897+0000", 2024-04-26T10:44:29.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.516e-05 2024-04-26T10:44:29.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:29.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556919+0000", 2024-04-26T10:44:29.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1951e-05 2024-04-26T10:44:29.900 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.900 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:29.900 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.900 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:134 3.1a 3:5e41ab69:::200.00000005:head [write 3567100~2427 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:29.900 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:29.900 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.3366558929999997, 2024-04-26T10:44:29.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031267445999999997, 2024-04-26T10:44:29.900 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:29.900 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.901 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:29.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:29.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:29.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:29.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:29.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:29.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526401+0000", 2024-04-26T10:44:29.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:29.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:29.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526408+0000", 2024-04-26T10:44:29.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7769999999999997e-06 2024-04-26T10:44:29.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:29.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526415+0000", 2024-04-26T10:44:29.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0720000000000002e-06 2024-04-26T10:44:29.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526421+0000", 2024-04-26T10:44:29.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9699999999999996e-06 2024-04-26T10:44:29.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:29.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556084+0000", 2024-04-26T10:44:29.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029662351999999999 2024-04-26T10:44:29.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:29.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556126+0000", 2024-04-26T10:44:29.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2385000000000002e-05 2024-04-26T10:44:29.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:29.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556186+0000", 2024-04-26T10:44:29.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9945999999999998e-05 2024-04-26T10:44:29.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:29.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557598+0000", 2024-04-26T10:44:29.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0014121559999999999 2024-04-26T10:44:29.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:29.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557626+0000", 2024-04-26T10:44:29.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7960999999999999e-05 2024-04-26T10:44:29.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:29.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557650+0000", 2024-04-26T10:44:29.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3969999999999999e-05 2024-04-26T10:44:29.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:29.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557669+0000", 2024-04-26T10:44:29.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9262e-05 2024-04-26T10:44:29.905 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.905 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:29.906 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.906 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:135 3.1a 3:5e41ab69:::200.00000005:head [write 3569527~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:29.906 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:29.906 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.3366316269999992, 2024-04-26T10:44:29.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031322516000000002, 2024-04-26T10:44:29.906 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:29.906 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.906 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:29.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:29.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:29.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:29.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:29.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:29.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:29.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:29.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:29.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526429+0000", 2024-04-26T10:44:29.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0750000000000002e-06 2024-04-26T10:44:29.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:29.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526435+0000", 2024-04-26T10:44:29.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.263e-06 2024-04-26T10:44:29.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526442+0000", 2024-04-26T10:44:29.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1219999999999997e-06 2024-04-26T10:44:29.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:29.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556515+0000", 2024-04-26T10:44:29.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030073132999999998 2024-04-26T10:44:29.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:29.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556564+0000", 2024-04-26T10:44:29.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8871e-05 2024-04-26T10:44:29.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:29.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556625+0000", 2024-04-26T10:44:29.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1307000000000001e-05 2024-04-26T10:44:29.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:29.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557678+0000", 2024-04-26T10:44:29.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010523100000000001 2024-04-26T10:44:29.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:29.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557709+0000", 2024-04-26T10:44:29.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1748000000000002e-05 2024-04-26T10:44:29.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:29.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557732+0000", 2024-04-26T10:44:29.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2415000000000001e-05 2024-04-26T10:44:29.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:29.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557749+0000", 2024-04-26T10:44:29.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6736999999999999e-05 2024-04-26T10:44:29.911 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.911 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:29.911 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.911 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:136 3.1a 3:5e41ab69:::200.00000005:head [write 3571449~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:29.911 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:29.911 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.3366104369999992, 2024-04-26T10:44:29.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032180937, 2024-04-26T10:44:29.912 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:29.912 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.912 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:29.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:29.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:29.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:29.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:29.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:29.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:29.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:29.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:29.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526455+0000", 2024-04-26T10:44:29.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6429999999999995e-06 2024-04-26T10:44:29.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:29.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526461+0000", 2024-04-26T10:44:29.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:29.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526467+0000", 2024-04-26T10:44:29.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4389999999999999e-06 2024-04-26T10:44:29.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:29.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556950+0000", 2024-04-26T10:44:29.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030483854000000001 2024-04-26T10:44:29.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:29.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556989+0000", 2024-04-26T10:44:29.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8415999999999999e-05 2024-04-26T10:44:29.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:29.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557051+0000", 2024-04-26T10:44:29.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2088999999999995e-05 2024-04-26T10:44:29.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:29.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558166+0000", 2024-04-26T10:44:29.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001114622 2024-04-26T10:44:29.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:29.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558584+0000", 2024-04-26T10:44:29.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000418033 2024-04-26T10:44:29.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:29.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558609+0000", 2024-04-26T10:44:29.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5344999999999999e-05 2024-04-26T10:44:29.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:29.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558628+0000", 2024-04-26T10:44:29.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9273999999999999e-05 2024-04-26T10:44:29.916 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.916 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:29.917 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.917 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:137 3.1a 3:5e41ab69:::200.00000005:head [write 3573699~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:29.917 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:29.917 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.336586788, 2024-04-26T10:44:29.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032241530999999997, 2024-04-26T10:44:29.917 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:29.917 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.917 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:29.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:29.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:29.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:29.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:29.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:29.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526470+0000", 2024-04-26T10:44:29.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:29.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:29.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526473+0000", 2024-04-26T10:44:29.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.818e-06 2024-04-26T10:44:29.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:29.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526480+0000", 2024-04-26T10:44:29.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4119999999999998e-06 2024-04-26T10:44:29.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526484+0000", 2024-04-26T10:44:29.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6840000000000004e-06 2024-04-26T10:44:29.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:29.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557323+0000", 2024-04-26T10:44:29.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030838956000000001 2024-04-26T10:44:29.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:29.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557362+0000", 2024-04-26T10:44:29.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8343999999999997e-05 2024-04-26T10:44:29.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:29.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557421+0000", 2024-04-26T10:44:29.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9176999999999999e-05 2024-04-26T10:44:29.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:29.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558636+0000", 2024-04-26T10:44:29.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012153789999999999 2024-04-26T10:44:29.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:29.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558668+0000", 2024-04-26T10:44:29.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1452999999999999e-05 2024-04-26T10:44:29.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:29.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558694+0000", 2024-04-26T10:44:29.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6288999999999999e-05 2024-04-26T10:44:29.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:29.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558712+0000", 2024-04-26T10:44:29.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8459000000000001e-05 2024-04-26T10:44:29.922 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.922 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:29.922 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.922 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:138 3.1a 3:5e41ab69:::200.00000005:head [write 3575103~4205 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:29.922 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:29.922 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.3365694690000005, 2024-04-26T10:44:29.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032665567999999999, 2024-04-26T10:44:29.922 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:29.922 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.923 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:29.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:29.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:29.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:29.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:29.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:29.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:29.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:29.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:29.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526495+0000", 2024-04-26T10:44:29.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7580000000000003e-06 2024-04-26T10:44:29.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:29.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526501+0000", 2024-04-26T10:44:29.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1680000000000001e-06 2024-04-26T10:44:29.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526505+0000", 2024-04-26T10:44:29.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.673e-06 2024-04-26T10:44:29.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:29.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557781+0000", 2024-04-26T10:44:29.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031275718000000001 2024-04-26T10:44:29.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:29.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557825+0000", 2024-04-26T10:44:29.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4048000000000002e-05 2024-04-26T10:44:29.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:29.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557888+0000", 2024-04-26T10:44:29.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2562000000000002e-05 2024-04-26T10:44:29.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:29.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559073+0000", 2024-04-26T10:44:29.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011852239999999999 2024-04-26T10:44:29.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:29.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559112+0000", 2024-04-26T10:44:29.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9226e-05 2024-04-26T10:44:29.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:29.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559136+0000", 2024-04-26T10:44:29.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3966000000000001e-05 2024-04-26T10:44:29.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:29.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559154+0000", 2024-04-26T10:44:29.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7575e-05 2024-04-26T10:44:29.927 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.927 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:29.927 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.928 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:139 3.1a 3:5e41ab69:::200.00000005:head [write 3579308~2255 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:29.928 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:29.928 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.3365478510000006, 2024-04-26T10:44:29.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033424720999999998, 2024-04-26T10:44:29.928 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:29.928 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.928 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:29.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:29.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:29.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:29.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:29.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:29.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526509+0000", 2024-04-26T10:44:29.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:29.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:29.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526516+0000", 2024-04-26T10:44:29.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5209999999999999e-06 2024-04-26T10:44:29.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:29.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526522+0000", 2024-04-26T10:44:29.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1229999999999997e-06 2024-04-26T10:44:29.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526527+0000", 2024-04-26T10:44:29.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7849999999999999e-06 2024-04-26T10:44:29.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:29.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558194+0000", 2024-04-26T10:44:29.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031667419000000002 2024-04-26T10:44:29.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:29.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558234+0000", 2024-04-26T10:44:29.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9774999999999998e-05 2024-04-26T10:44:29.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:29.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558294+0000", 2024-04-26T10:44:29.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0242999999999999e-05 2024-04-26T10:44:29.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:29.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559106+0000", 2024-04-26T10:44:29.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00081148099999999996 2024-04-26T10:44:29.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:29.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559890+0000", 2024-04-26T10:44:29.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00078439999999999998 2024-04-26T10:44:29.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:29.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559917+0000", 2024-04-26T10:44:29.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7044000000000001e-05 2024-04-26T10:44:29.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:29.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559935+0000", 2024-04-26T10:44:29.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7448e-05 2024-04-26T10:44:29.933 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.933 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:29.933 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.933 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:140 3.1a 3:5e41ab69:::200.00000005:head [write 3581563~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:29.933 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:29.933 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.3365264299999993, 2024-04-26T10:44:29.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033867728, 2024-04-26T10:44:29.933 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:29.934 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.934 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:29.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:29.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:29.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:29.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:29.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:29.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:29.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:29.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:29.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526538+0000", 2024-04-26T10:44:29.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.905e-06 2024-04-26T10:44:29.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:29.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526542+0000", 2024-04-26T10:44:29.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9550000000000002e-06 2024-04-26T10:44:29.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526545+0000", 2024-04-26T10:44:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8499999999999998e-06 2024-04-26T10:44:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558744+0000", 2024-04-26T10:44:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032198986999999998 2024-04-26T10:44:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:29.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558788+0000", 2024-04-26T10:44:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4365e-05 2024-04-26T10:44:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558854+0000", 2024-04-26T10:44:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5952999999999997e-05 2024-04-26T10:44:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559971+0000", 2024-04-26T10:44:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011172770000000001 2024-04-26T10:44:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560354+0000", 2024-04-26T10:44:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038267599999999998 2024-04-26T10:44:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560380+0000", 2024-04-26T10:44:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6140999999999999e-05 2024-04-26T10:44:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560399+0000", 2024-04-26T10:44:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9032999999999999e-05 2024-04-26T10:44:29.938 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:141 3.1a 3:5e41ab69:::200.00000005:head [write 3583482~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.3365107710000004, 2024-04-26T10:44:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034316301, 2024-04-26T10:44:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:29.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526548+0000", 2024-04-26T10:44:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.739e-06 2024-04-26T10:44:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526551+0000", 2024-04-26T10:44:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.044e-06 2024-04-26T10:44:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526562+0000", 2024-04-26T10:44:29.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0370000000000001e-05 2024-04-26T10:44:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559179+0000", 2024-04-26T10:44:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032617444000000002 2024-04-26T10:44:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559220+0000", 2024-04-26T10:44:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0364999999999997e-05 2024-04-26T10:44:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559280+0000", 2024-04-26T10:44:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0569000000000002e-05 2024-04-26T10:44:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560814+0000", 2024-04-26T10:44:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015337580000000001 2024-04-26T10:44:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560820+0000", 2024-04-26T10:44:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.455e-06 2024-04-26T10:44:29.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560846+0000", 2024-04-26T10:44:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5228999999999998e-05 2024-04-26T10:44:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560863+0000", 2024-04-26T10:44:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7555e-05 2024-04-26T10:44:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:142 3.1a 3:5e41ab69:::200.00000005:head [write 3585931~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.3364903740000003, 2024-04-26T10:44:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034372373999999997, 2024-04-26T10:44:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:29.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526573+0000", 2024-04-26T10:44:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0800000000000002e-06 2024-04-26T10:44:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526580+0000", 2024-04-26T10:44:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5799999999999997e-06 2024-04-26T10:44:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526585+0000", 2024-04-26T10:44:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2270000000000001e-06 2024-04-26T10:44:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559601+0000", 2024-04-26T10:44:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033016684999999997 2024-04-26T10:44:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559642+0000", 2024-04-26T10:44:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0321000000000002e-05 2024-04-26T10:44:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559706+0000", 2024-04-26T10:44:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4228999999999998e-05 2024-04-26T10:44:29.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560871+0000", 2024-04-26T10:44:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001164893 2024-04-26T10:44:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560899+0000", 2024-04-26T10:44:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560922+0000", 2024-04-26T10:44:29.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3337999999999999e-05 2024-04-26T10:44:29.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.950 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:29.950 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560940+0000", 2024-04-26T10:44:29.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7289999999999999e-05 2024-04-26T10:44:29.950 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.950 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:29.950 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:143 3.1a 3:5e41ab69:::200.00000005:head [write 3587331~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.3364684760000003, 2024-04-26T10:44:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035256000000000003, 2024-04-26T10:44:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:29.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526592+0000", 2024-04-26T10:44:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2449999999999998e-06 2024-04-26T10:44:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526596+0000", 2024-04-26T10:44:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7000000000000002e-06 2024-04-26T10:44:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526599+0000", 2024-04-26T10:44:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6160000000000002e-06 2024-04-26T10:44:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559997+0000", 2024-04-26T10:44:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033397835000000001 2024-04-26T10:44:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560051+0000", 2024-04-26T10:44:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3742000000000001e-05 2024-04-26T10:44:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560112+0000", 2024-04-26T10:44:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0851999999999999e-05 2024-04-26T10:44:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561404+0000", 2024-04-26T10:44:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001291869 2024-04-26T10:44:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561797+0000", 2024-04-26T10:44:29.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039383000000000002 2024-04-26T10:44:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561827+0000", 2024-04-26T10:44:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9247e-05 2024-04-26T10:44:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561845+0000", 2024-04-26T10:44:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8462999999999999e-05 2024-04-26T10:44:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:144 3.1a 3:5e41ab69:::200.00000005:head [write 3588736~4987 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.3363461839999999, 2024-04-26T10:44:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035224283000000002, 2024-04-26T10:44:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:29.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526718+0000", 2024-04-26T10:44:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.43e-06 2024-04-26T10:44:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526726+0000", 2024-04-26T10:44:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:44:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526729+0000", 2024-04-26T10:44:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6480000000000001e-06 2024-04-26T10:44:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:29.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560427+0000", 2024-04-26T10:44:29.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033697280000000003 2024-04-26T10:44:29.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:29.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560466+0000", 2024-04-26T10:44:29.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9606e-05 2024-04-26T10:44:29.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:29.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560525+0000", 2024-04-26T10:44:29.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9218000000000001e-05 2024-04-26T10:44:29.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:29.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561854+0000", 2024-04-26T10:44:29.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001328421 2024-04-26T10:44:29.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:29.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561887+0000", 2024-04-26T10:44:29.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2746000000000001e-05 2024-04-26T10:44:29.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:29.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561912+0000", 2024-04-26T10:44:29.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5126999999999998e-05 2024-04-26T10:44:29.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:29.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561936+0000", 2024-04-26T10:44:29.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4032999999999998e-05 2024-04-26T10:44:29.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.962 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:29.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.962 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:145 3.1a 3:5e41ab69:::200.00000005:head [write 3593723~2939 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:29.962 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:29.962 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.3334271389999994, 2024-04-26T10:44:29.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033294394999999997, 2024-04-26T10:44:29.963 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:29.963 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.963 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:29.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:29.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:29.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:29.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:29.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:29.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529630+0000", 2024-04-26T10:44:29.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:29.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:29.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529635+0000", 2024-04-26T10:44:29.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7960000000000003e-06 2024-04-26T10:44:29.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:29.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529643+0000", 2024-04-26T10:44:29.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0390000000000005e-06 2024-04-26T10:44:29.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529648+0000", 2024-04-26T10:44:29.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9599999999999999e-06 2024-04-26T10:44:29.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:29.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560969+0000", 2024-04-26T10:44:29.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031321767 2024-04-26T10:44:29.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:29.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561009+0000", 2024-04-26T10:44:29.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9904999999999998e-05 2024-04-26T10:44:29.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:29.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561070+0000", 2024-04-26T10:44:29.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0708999999999998e-05 2024-04-26T10:44:29.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:29.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562352+0000", 2024-04-26T10:44:29.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012818440000000001 2024-04-26T10:44:29.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:29.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562867+0000", 2024-04-26T10:44:29.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000515665 2024-04-26T10:44:29.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:29.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562893+0000", 2024-04-26T10:44:29.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5469999999999998e-05 2024-04-26T10:44:29.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:29.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562925+0000", 2024-04-26T10:44:29.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1974999999999998e-05 2024-04-26T10:44:29.967 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.967 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:29.968 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.968 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:146 3.1a 3:5e41ab69:::200.00000005:head [write 3596662~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:29.968 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:29.968 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.3331989249999996, 2024-04-26T10:44:29.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033178429000000002, 2024-04-26T10:44:29.968 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:29.968 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.968 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:29.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:29.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:29.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:29.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:29.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:29.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529858+0000", 2024-04-26T10:44:29.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:29.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:29.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529863+0000", 2024-04-26T10:44:29.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4500000000000003e-06 2024-04-26T10:44:29.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:29.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529874+0000", 2024-04-26T10:44:29.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0552e-05 2024-04-26T10:44:29.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529882+0000", 2024-04-26T10:44:29.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4449999999999996e-06 2024-04-26T10:44:29.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:29.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561452+0000", 2024-04-26T10:44:29.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031569680000000003 2024-04-26T10:44:29.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:29.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561511+0000", 2024-04-26T10:44:29.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9332e-05 2024-04-26T10:44:29.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:29.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561583+0000", 2024-04-26T10:44:29.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1730000000000006e-05 2024-04-26T10:44:29.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:29.972 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562933+0000", 2024-04-26T10:44:29.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013500059999999999 2024-04-26T10:44:29.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:29.972 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562976+0000", 2024-04-26T10:44:29.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2987e-05 2024-04-26T10:44:29.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:29.972 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563015+0000", 2024-04-26T10:44:29.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9453999999999999e-05 2024-04-26T10:44:29.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:29.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563037+0000", 2024-04-26T10:44:29.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1679e-05 2024-04-26T10:44:29.973 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.973 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:29.973 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.973 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:277 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:29.973 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:29.973 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.3481882220000001, 2024-04-26T10:44:29.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030430563000000001, 2024-04-26T10:44:29.974 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:29.974 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:29.974 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:29.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:29.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:29.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:29.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:29.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:29.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:29.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514867+0000", 2024-04-26T10:44:29.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:29.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:29.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515460+0000", 2024-04-26T10:44:29.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00059285800000000004 2024-04-26T10:44:29.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:29.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515474+0000", 2024-04-26T10:44:29.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3933e-05 2024-04-26T10:44:29.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:29.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515481+0000", 2024-04-26T10:44:29.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:29.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:29.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515522+0000", 2024-04-26T10:44:29.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1369000000000003e-05 2024-04-26T10:44:29.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:29.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515591+0000", 2024-04-26T10:44:29.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9377999999999999e-05 2024-04-26T10:44:29.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:29.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.526440+0000", 2024-04-26T10:44:29.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010848837 2024-04-26T10:44:29.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:29.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.543866+0000", 2024-04-26T10:44:29.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017426288000000002 2024-04-26T10:44:29.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:29.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545193+0000", 2024-04-26T10:44:29.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001326111 2024-04-26T10:44:29.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:29.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545229+0000", 2024-04-26T10:44:29.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6390999999999998e-05 2024-04-26T10:44:29.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:29.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:29.983 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:29.983 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545300+0000", 2024-04-26T10:44:29.983 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1073000000000002e-05 2024-04-26T10:44:29.983 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.983 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:29.983 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.983 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:29.983 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:29.983 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:29.986 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:29.986 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:29.983+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:30.011 INFO:tasks.workunit.client.0.smithi049.stdout:0/401: symlink d8/d41/l89 0 2024-04-26T10:44:30.011 INFO:tasks.workunit.client.0.smithi049.stdout:9/491: rename d2/d1a/df/f47 to d2/d25/d60/fa0 0 2024-04-26T10:44:30.011 INFO:tasks.workunit.client.0.smithi049.stdout:0/402: sync 2024-04-26T10:44:30.011 INFO:tasks.workunit.client.0.smithi049.stdout:7/417: fsync d2/f74 0 2024-04-26T10:44:30.011 INFO:tasks.workunit.client.0.smithi049.stdout:3/358: link d3/d23/d2f/d6a/d6b/d26/f48 d3/d23/d2f/d6a/d6b/d8/f80 0 2024-04-26T10:44:30.011 INFO:tasks.workunit.client.0.smithi049.stdout:8/436: write d2/d17/f3d [4106387,41250] 0 2024-04-26T10:44:30.011 INFO:tasks.workunit.client.0.smithi049.stdout:2/422: dwrite d6/d9/db/d11/f5d [0,4194304] 0 2024-04-26T10:44:30.011 INFO:tasks.workunit.client.0.smithi049.stdout:0/403: creat d8/d41/f8a x:0 0 0 2024-04-26T10:44:30.012 INFO:tasks.workunit.client.0.smithi049.stdout:9/492: creat d2/d25/fa1 x:0 0 0 2024-04-26T10:44:30.012 INFO:tasks.workunit.client.0.smithi049.stdout:9/493: chown d2/d1a/d8a 78964 1 2024-04-26T10:44:30.012 INFO:tasks.workunit.client.0.smithi049.stdout:2/423: chown d6/f79 322 1 2024-04-26T10:44:30.012 INFO:tasks.workunit.client.0.smithi049.stdout:9/494: chown d2/d25 11 1 2024-04-26T10:44:30.012 INFO:tasks.workunit.client.0.smithi049.stdout:0/404: dread - d8/db/d11/d1b/d4d/f87 zero size 2024-04-26T10:44:30.012 INFO:tasks.workunit.client.0.smithi049.stdout:7/418: rename d2/dd/d48/d5c/f62 to d2/dd/d45/d82/f8a 0 2024-04-26T10:44:30.012 INFO:tasks.workunit.client.0.smithi049.stdout:2/424: dread - d6/d9/d5f/f67 zero size 2024-04-26T10:44:30.012 INFO:tasks.workunit.client.0.smithi049.stdout:0/405: creat d8/db/d11/d1b/f8b x:0 0 0 2024-04-26T10:44:30.012 INFO:tasks.workunit.client.0.smithi049.stdout:4/476: dwrite de/d1b/d5e/d72/d73/d84/f35 [8388608,4194304] 0 2024-04-26T10:44:30.012 INFO:tasks.workunit.client.0.smithi049.stdout:2/425: mkdir d6/d9/db/d34/d7b 0 2024-04-26T10:44:30.012 INFO:tasks.workunit.client.0.smithi049.stdout:2/426: sync 2024-04-26T10:44:30.012 INFO:tasks.workunit.client.0.smithi049.stdout:0/406: write d8/d1e/f4e [992650,2901] 0 2024-04-26T10:44:30.012 INFO:tasks.workunit.client.0.smithi049.stdout:8/437: dwrite d2/f12 [4194304,4194304] 0 2024-04-26T10:44:30.012 INFO:tasks.workunit.client.0.smithi049.stdout:2/427: stat d6/d30/f6e 0 2024-04-26T10:44:30.013 INFO:tasks.workunit.client.0.smithi049.stdout:4/477: write de/d1b/d5e/d72/d73/f7c [1007700,57844] 0 2024-04-26T10:44:30.013 INFO:tasks.workunit.client.0.smithi049.stdout:0/407: chown d8/d1e/f67 17785533 1 2024-04-26T10:44:30.013 INFO:tasks.workunit.client.0.smithi049.stdout:7/419: dread d2/dd/d25/d27/f57 [0,4194304] 0 2024-04-26T10:44:30.013 INFO:tasks.workunit.client.0.smithi049.stdout:8/438: getdents d2/d16/d19/d42 0 2024-04-26T10:44:30.013 INFO:tasks.workunit.client.0.smithi049.stdout:0/408: creat d8/d66/d84/f8c x:0 0 0 2024-04-26T10:44:30.013 INFO:tasks.workunit.client.0.smithi049.stdout:0/409: fdatasync d8/db/d11/f65 0 2024-04-26T10:44:30.013 INFO:tasks.workunit.client.0.smithi049.stdout:8/439: dread - d2/df/f5a zero size 2024-04-26T10:44:30.013 INFO:tasks.workunit.client.0.smithi049.stdout:8/440: creat d2/f8a x:0 0 0 2024-04-26T10:44:30.013 INFO:tasks.workunit.client.0.smithi049.stdout:0/410: read f3 [983169,96010] 0 2024-04-26T10:44:30.013 INFO:tasks.workunit.client.0.smithi049.stdout:4/478: dwrite de/d3f/d48/d62/f6b [0,4194304] 0 2024-04-26T10:44:30.013 INFO:tasks.workunit.client.0.smithi049.stdout:3/359: dread d3/d23/d2f/d6a/d6b/d26/d5f/f69 [0,4194304] 0 2024-04-26T10:44:30.013 INFO:tasks.workunit.client.0.smithi049.stdout:0/411: chown d8/db/d26/d39/f58 3176786 1 2024-04-26T10:44:30.013 INFO:tasks.workunit.client.0.smithi049.stdout:7/420: dwrite d2/dd/d48/d5c/f7a [0,4194304] 0 2024-04-26T10:44:30.013 INFO:tasks.workunit.client.0.smithi049.stdout:8/441: mknod d2/d17/d34/d40/d64/c8b 0 2024-04-26T10:44:30.014 INFO:tasks.workunit.client.0.smithi049.stdout:4/479: write de/f63 [1562111,46230] 0 2024-04-26T10:44:30.014 INFO:tasks.workunit.client.0.smithi049.stdout:7/421: symlink d2/d3/de/l8b 0 2024-04-26T10:44:30.014 INFO:tasks.workunit.client.0.smithi049.stdout:1/379: dread d1e/d20/d26/f4b [0,4194304] 0 2024-04-26T10:44:30.014 INFO:tasks.workunit.client.0.smithi049.stdout:8/442: write d2/d16/f2e [775565,6738] 0 2024-04-26T10:44:30.014 INFO:tasks.workunit.client.0.smithi049.stdout:3/360: creat d3/d23/d2f/d6a/d6b/d26/d58/f81 x:0 0 0 2024-04-26T10:44:30.014 INFO:tasks.workunit.client.0.smithi049.stdout:0/412: symlink d8/db/d11/d1c/l8d 0 2024-04-26T10:44:30.014 INFO:tasks.workunit.client.0.smithi049.stdout:7/422: unlink d2/dd/c19 0 2024-04-26T10:44:30.014 INFO:tasks.workunit.client.0.smithi049.stdout:8/443: fdatasync f1 0 2024-04-26T10:44:30.014 INFO:tasks.workunit.client.0.smithi049.stdout:1/380: chown d1e/d20/d26/d3c/d54/d59 275796 1 2024-04-26T10:44:30.014 INFO:tasks.workunit.client.0.smithi049.stdout:7/423: fdatasync d2/dd/d38/f6f 0 2024-04-26T10:44:30.014 INFO:tasks.workunit.client.0.smithi049.stdout:1/381: mkdir d1e/d20/d26/d3c/d54/d59/d73 0 2024-04-26T10:44:30.014 INFO:tasks.workunit.client.0.smithi049.stdout:8/444: mknod d2/df/c8c 0 2024-04-26T10:44:30.014 INFO:tasks.workunit.client.0.smithi049.stdout:1/382: symlink d1e/l74 0 2024-04-26T10:44:30.014 INFO:tasks.workunit.client.0.smithi049.stdout:4/480: rename de/d1b/d5e/d72/d73/d84/d24/l68 to de/d1d/l8f 0 2024-04-26T10:44:30.015 INFO:tasks.workunit.client.0.smithi049.stdout:7/424: getdents d2/dd/d48 0 2024-04-26T10:44:30.015 INFO:tasks.workunit.client.0.smithi049.stdout:0/413: write d8/db/d26/f40 [1012171,127059] 0 2024-04-26T10:44:30.015 INFO:tasks.workunit.client.0.smithi049.stdout:1/383: mkdir d1e/d20/d26/d37/d69/d75 0 2024-04-26T10:44:30.015 INFO:tasks.workunit.client.0.smithi049.stdout:1/384: write d1e/f72 [454347,4479] 0 2024-04-26T10:44:30.015 INFO:tasks.workunit.client.0.smithi049.stdout:7/425: write d2/dd/d38/f40 [1259138,53450] 0 2024-04-26T10:44:30.015 INFO:tasks.workunit.client.0.smithi049.stdout:0/414: mknod d8/db/d26/d6f/c8e 0 2024-04-26T10:44:30.015 INFO:tasks.workunit.client.0.smithi049.stdout:0/415: sync 2024-04-26T10:44:30.015 INFO:tasks.workunit.client.0.smithi049.stdout:7/426: read d2/dd/d25/d27/f57 [1291581,110246] 0 2024-04-26T10:44:30.015 INFO:tasks.workunit.client.0.smithi049.stdout:8/445: dwrite d2/d16/d19/d42/f4e [0,4194304] 0 2024-04-26T10:44:30.015 INFO:tasks.workunit.client.0.smithi049.stdout:0/416: creat d8/db/d26/d39/f8f x:0 0 0 2024-04-26T10:44:30.015 INFO:tasks.workunit.client.0.smithi049.stdout:3/361: dwrite d3/d23/d2f/d6a/d6b/d8/d55/d2e/f31 [0,4194304] 0 2024-04-26T10:44:30.015 INFO:tasks.workunit.client.0.smithi049.stdout:8/446: chown d2/c73 154 1 2024-04-26T10:44:30.015 INFO:tasks.workunit.client.0.smithi049.stdout:9/495: read d2/f8 [4088338,122632] 0 2024-04-26T10:44:30.015 INFO:tasks.workunit.client.0.smithi049.stdout:6/431: dread da/f1b [0,4194304] 0 2024-04-26T10:44:30.016 INFO:tasks.workunit.client.0.smithi049.stdout:3/362: chown d3/d23/d2f/d6a/d6b/d26 44996049 1 2024-04-26T10:44:30.016 INFO:tasks.workunit.client.0.smithi049.stdout:4/481: dwrite de/d1b/d5e/d72/d73/f7c [0,4194304] 0 2024-04-26T10:44:30.016 INFO:tasks.workunit.client.0.smithi049.stdout:9/496: dread - d2/d1a/d1b/d1f/d64/f7b zero size 2024-04-26T10:44:30.016 INFO:tasks.workunit.client.0.smithi049.stdout:6/432: chown da/dd/f2a 387 1 2024-04-26T10:44:30.016 INFO:tasks.workunit.client.0.smithi049.stdout:0/417: mknod d8/d41/c90 0 2024-04-26T10:44:30.016 INFO:tasks.workunit.client.0.smithi049.stdout:8/447: mknod d2/d16/d88/c8d 0 2024-04-26T10:44:30.016 INFO:tasks.workunit.client.0.smithi049.stdout:6/433: dread - da/f2b zero size 2024-04-26T10:44:30.016 INFO:tasks.workunit.client.0.smithi049.stdout:3/363: mkdir d3/d23/d2f/d6a/d6b/d8/d82 0 2024-04-26T10:44:30.016 INFO:tasks.workunit.client.0.smithi049.stdout:7/427: creat d2/f8c x:0 0 0 2024-04-26T10:44:30.016 INFO:tasks.workunit.client.0.smithi049.stdout:9/497: fsync d2/d1a/df/f56 0 2024-04-26T10:44:30.016 INFO:tasks.workunit.client.0.smithi049.stdout:1/385: dwrite d1e/d20/d26/d3c/d54/d59/f65 [0,4194304] 0 2024-04-26T10:44:30.016 INFO:tasks.workunit.client.0.smithi049.stdout:0/418: creat d8/d66/f91 x:0 0 0 2024-04-26T10:44:30.016 INFO:tasks.workunit.client.0.smithi049.stdout:8/448: creat d2/d16/f8e x:0 0 0 2024-04-26T10:44:30.016 INFO:tasks.workunit.client.0.smithi049.stdout:0/419: unlink d8/d1e/f4e 0 2024-04-26T10:44:30.017 INFO:tasks.workunit.client.0.smithi049.stdout:4/482: rename de/d1b/d5e/d6c to de/d1b/d5e/d90 0 2024-04-26T10:44:30.017 INFO:tasks.workunit.client.0.smithi049.stdout:9/498: creat d2/d1a/d1b/d1f/d64/fa2 x:0 0 0 2024-04-26T10:44:30.017 INFO:tasks.workunit.client.0.smithi049.stdout:3/364: read - d3/d23/d2f/d6a/d6b/d8/d55/d46/f4a zero size 2024-04-26T10:44:30.017 INFO:tasks.workunit.client.0.smithi049.stdout:6/434: write da/fc [5340066,108552] 0 2024-04-26T10:44:30.017 INFO:tasks.workunit.client.0.smithi049.stdout:3/365: sync 2024-04-26T10:44:30.017 INFO:tasks.workunit.client.0.smithi049.stdout:8/449: write d2/d16/d19/f55 [102343,39053] 0 2024-04-26T10:44:30.017 INFO:tasks.workunit.client.0.smithi049.stdout:7/428: chown d2/d3/de/d1c/d4d/l89 10015658 1 2024-04-26T10:44:30.017 INFO:tasks.workunit.client.0.smithi049.stdout:4/483: rename f9 to de/d3f/d48/d62/f91 0 2024-04-26T10:44:30.017 INFO:tasks.workunit.client.0.smithi049.stdout:9/499: stat d2/d1a/d1b/c90 0 2024-04-26T10:44:30.017 INFO:tasks.workunit.client.0.smithi049.stdout:3/366: stat d3/d23/d2f/d6a/d6b/c47 0 2024-04-26T10:44:30.017 INFO:tasks.workunit.client.0.smithi049.stdout:6/435: unlink da/dd/de/d26/d22/l89 0 2024-04-26T10:44:30.017 INFO:tasks.workunit.client.0.smithi049.stdout:6/436: symlink da/dd/d47/l93 0 2024-04-26T10:44:30.017 INFO:tasks.workunit.client.0.smithi049.stdout:3/367: creat d3/d23/d2f/d6a/d6b/d8/d34/f83 x:0 0 0 2024-04-26T10:44:30.017 INFO:tasks.workunit.client.0.smithi049.stdout:4/484: fsync de/d1b/d5e/d72/d73/d84/f7e 0 2024-04-26T10:44:30.018 INFO:tasks.workunit.client.0.smithi049.stdout:1/386: dwrite fd [4194304,4194304] 0 2024-04-26T10:44:30.018 INFO:tasks.workunit.client.0.smithi049.stdout:0/420: dwrite d8/db/d11/d1b/f4a [0,4194304] 0 2024-04-26T10:44:30.018 INFO:tasks.workunit.client.0.smithi049.stdout:5/430: dread d7/d1d/f30 [0,4194304] 0 2024-04-26T10:44:30.018 INFO:tasks.workunit.client.0.smithi049.stdout:9/500: rmdir d2/d1a/d1b 39 2024-04-26T10:44:30.018 INFO:tasks.workunit.client.0.smithi049.stdout:6/437: creat da/d4a/f94 x:0 0 0 2024-04-26T10:44:30.018 INFO:tasks.workunit.client.0.smithi049.stdout:0/421: unlink d8/d41/l89 0 2024-04-26T10:44:30.018 INFO:tasks.workunit.client.0.smithi049.stdout:7/429: dwrite d2/d3/f77 [0,4194304] 0 2024-04-26T10:44:30.018 INFO:tasks.workunit.client.0.smithi049.stdout:9/501: write d2/d1a/d1b/f52 [165103,54179] 0 2024-04-26T10:44:30.018 INFO:tasks.workunit.client.0.smithi049.stdout:5/431: mkdir d7/d1d/d1f/d4e/d65/d6f/db2 0 2024-04-26T10:44:30.019 INFO:tasks.workunit.client.0.smithi049.stdout:8/450: dwrite d2/d17/d34/f5b [0,4194304] 0 2024-04-26T10:44:30.019 INFO:tasks.workunit.client.0.smithi049.stdout:0/422: write d8/d66/f86 [2346736,96347] 0 2024-04-26T10:44:30.019 INFO:tasks.workunit.client.0.smithi049.stdout:7/430: chown d2/d3/de/l18 2308 1 2024-04-26T10:44:30.019 INFO:tasks.workunit.client.0.smithi049.stdout:4/485: read de/d1b/f2c [4091066,109763] 0 2024-04-26T10:44:30.019 INFO:tasks.workunit.client.0.smithi049.stdout:6/438: truncate da/dd/d47/f79 991923 0 2024-04-26T10:44:30.019 INFO:tasks.workunit.client.0.smithi049.stdout:7/431: read d2/dd/d25/f75 [3777090,19229] 0 2024-04-26T10:44:30.019 INFO:tasks.workunit.client.0.smithi049.stdout:9/502: write d2/d1a/d1b/d1f/f3d [1393973,12279] 0 2024-04-26T10:44:30.019 INFO:tasks.workunit.client.0.smithi049.stdout:6/439: chown da/dd/de/d26/l59 419119 1 2024-04-26T10:44:30.019 INFO:tasks.workunit.client.0.smithi049.stdout:1/387: truncate d1e/f1f 703767 0 2024-04-26T10:44:30.019 INFO:tasks.workunit.client.0.smithi049.stdout:0/423: mknod d8/d41/c92 0 2024-04-26T10:44:30.019 INFO:tasks.workunit.client.0.smithi049.stdout:0/424: sync 2024-04-26T10:44:30.020 INFO:tasks.workunit.client.0.smithi049.stdout:8/451: creat d2/d89/d30/f8f x:0 0 0 2024-04-26T10:44:30.020 INFO:tasks.workunit.client.0.smithi049.stdout:5/432: write d7/ff [1070813,30054] 0 2024-04-26T10:44:30.020 INFO:tasks.workunit.client.0.smithi049.stdout:1/388: symlink d1e/d20/d26/d37/d69/l76 0 2024-04-26T10:44:30.020 INFO:tasks.workunit.client.0.smithi049.stdout:4/486: unlink de/d1b/d5e/d72/d73/d84/l80 0 2024-04-26T10:44:30.020 INFO:tasks.workunit.client.0.smithi049.stdout:0/425: mkdir d8/db/d93 0 2024-04-26T10:44:30.020 INFO:tasks.workunit.client.0.smithi049.stdout:5/433: mkdir d7/d1d/d1f/d4e/dad/db3 0 2024-04-26T10:44:30.020 INFO:tasks.workunit.client.0.smithi049.stdout:8/452: link d2/d17/l5d d2/d16/l90 0 2024-04-26T10:44:30.020 INFO:tasks.workunit.client.0.smithi049.stdout:0/426: chown d8/db/d11/c19 94 1 2024-04-26T10:44:30.020 INFO:tasks.workunit.client.0.smithi049.stdout:1/389: link d1e/f44 d1e/d20/d26/d37/f77 0 2024-04-26T10:44:30.020 INFO:tasks.workunit.client.0.smithi049.stdout:4/487: rmdir de/d1b/d5e/d72/d73/d84/d4b 39 2024-04-26T10:44:30.021 INFO:tasks.workunit.client.0.smithi049.stdout:3/368: dwrite d3/d23/d2f/d6a/d6b/d26/f48 [0,4194304] 0 2024-04-26T10:44:30.021 INFO:tasks.workunit.client.0.smithi049.stdout:6/440: dread da/dd/de/d26/d22/d4c/f53 [0,4194304] 0 2024-04-26T10:44:30.021 INFO:tasks.workunit.client.0.smithi049.stdout:8/453: mkdir d2/d16/d91 0 2024-04-26T10:44:30.021 INFO:tasks.workunit.client.0.smithi049.stdout:9/503: dwrite d2/d1a/d1b/d1f/d64/fa2 [0,4194304] 0 2024-04-26T10:44:30.021 INFO:tasks.workunit.client.0.smithi049.stdout:4/488: creat de/d1b/f92 x:0 0 0 2024-04-26T10:44:30.021 INFO:tasks.workunit.client.0.smithi049.stdout:7/432: dwrite d2/dd/d48/d5c/f7a [0,4194304] 0 2024-04-26T10:44:30.021 INFO:tasks.workunit.client.0.smithi049.stdout:9/504: readlink d2/d1a/l73 0 2024-04-26T10:44:30.021 INFO:tasks.workunit.client.0.smithi049.stdout:3/369: mkdir d3/d23/d2f/d6a/d6b/d26/d65/d70/d84 0 2024-04-26T10:44:30.021 INFO:tasks.workunit.client.0.smithi049.stdout:8/454: symlink d2/l92 0 2024-04-26T10:44:30.021 INFO:tasks.workunit.client.0.smithi049.stdout:7/433: stat d2/d3/l7b 0 2024-04-26T10:44:30.021 INFO:tasks.workunit.client.0.smithi049.stdout:6/441: rename da/dd/de/d26/d22/d4c/f53 to da/dd/de/f95 0 2024-04-26T10:44:30.022 INFO:tasks.workunit.client.0.smithi049.stdout:8/455: fdatasync d2/d89/d2a/f2b 0 2024-04-26T10:44:30.022 INFO:tasks.workunit.client.0.smithi049.stdout:4/489: mknod de/d1b/d5e/d72/d73/d84/d24/d5c/c93 0 2024-04-26T10:44:30.022 INFO:tasks.workunit.client.0.smithi049.stdout:6/442: rmdir da/dd/d47/d7b/d84 39 2024-04-26T10:44:30.022 INFO:tasks.workunit.client.0.smithi049.stdout:3/370: symlink d3/d23/d2f/d6a/d6b/d26/l85 0 2024-04-26T10:44:30.022 INFO:tasks.workunit.client.0.smithi049.stdout:7/434: mknod d2/dd/d48/d5c/c8d 0 2024-04-26T10:44:30.022 INFO:tasks.workunit.client.0.smithi049.stdout:0/427: dwrite d8/d1e/f67 [0,4194304] 0 2024-04-26T10:44:30.022 INFO:tasks.workunit.client.0.smithi049.stdout:1/390: dwrite d1e/d20/d67/f6c [0,4194304] 0 2024-04-26T10:44:30.022 INFO:tasks.workunit.client.0.smithi049.stdout:4/490: unlink de/d1b/d5e/d72/d73/d84/d24/l41 0 2024-04-26T10:44:30.022 INFO:tasks.workunit.client.0.smithi049.stdout:4/491: dread - de/d3f/d52/f75 zero size 2024-04-26T10:44:30.022 INFO:tasks.workunit.client.0.smithi049.stdout:9/505: truncate d2/d1a/d1b/d7a/f80 2285025 0 2024-04-26T10:44:30.022 INFO:tasks.workunit.client.0.smithi049.stdout:8/456: truncate d2/d89/d2a/f54 2330573 0 2024-04-26T10:44:30.022 INFO:tasks.workunit.client.0.smithi049.stdout:7/435: link d2/d3/f56 d2/f8e 0 2024-04-26T10:44:30.022 INFO:tasks.workunit.client.0.smithi049.stdout:4/492: chown de/l10 0 1 2024-04-26T10:44:30.023 INFO:tasks.workunit.client.0.smithi049.stdout:1/391: mknod d1e/d20/d26/d3c/d54/d59/d68/c78 0 2024-04-26T10:44:30.023 INFO:tasks.workunit.client.0.smithi049.stdout:9/506: rename d2/d25/f3e to d2/d25/fa3 0 2024-04-26T10:44:30.023 INFO:tasks.workunit.client.0.smithi049.stdout:2/428: dread d6/f64 [0,4194304] 0 2024-04-26T10:44:30.023 INFO:tasks.workunit.client.0.smithi049.stdout:4/493: stat de/d1b/d5e/d72/d73/d84/d4b/l4f 0 2024-04-26T10:44:30.023 INFO:tasks.workunit.client.0.smithi049.stdout:2/429: rmdir d6/d30 39 2024-04-26T10:44:30.023 INFO:tasks.workunit.client.0.smithi049.stdout:8/457: link d2/df/d10/c51 d2/df/d10/d23/d6c/d5e/c93 0 2024-04-26T10:44:30.023 INFO:tasks.workunit.client.0.smithi049.stdout:4/494: unlink de/d1b/d5e/d72/f7f 0 2024-04-26T10:44:30.023 INFO:tasks.workunit.client.0.smithi049.stdout:9/507: rmdir d2/d1a 39 2024-04-26T10:44:30.023 INFO:tasks.workunit.client.0.smithi049.stdout:3/371: truncate d3/d23/d2f/d6a/d6b/d8/d55/d2e/f4c 3571889 0 2024-04-26T10:44:30.023 INFO:tasks.workunit.client.0.smithi049.stdout:4/495: rmdir de/d1d 39 2024-04-26T10:44:30.023 INFO:tasks.workunit.client.0.smithi049.stdout:3/372: chown d3/c33 22815735 1 2024-04-26T10:44:30.023 INFO:tasks.workunit.client.0.smithi049.stdout:8/458: mknod d2/df/d10/d23/d6c/d5e/c94 0 2024-04-26T10:44:30.023 INFO:tasks.workunit.client.0.smithi049.stdout:9/508: write d2/d25/d74/f71 [402813,117793] 0 2024-04-26T10:44:30.023 INFO:tasks.workunit.client.0.smithi049.stdout:8/459: truncate d2/d16/f2e 1698032 0 2024-04-26T10:44:30.024 INFO:tasks.workunit.client.0.smithi049.stdout:8/460: read d2/d17/d34/f5b [2000023,116542] 0 2024-04-26T10:44:30.024 INFO:tasks.workunit.client.0.smithi049.stdout:9/509: mkdir d2/d25/d60/da4 0 2024-04-26T10:44:30.024 INFO:tasks.workunit.client.0.smithi049.stdout:1/392: dwrite d1e/d20/d26/d3c/f3f [0,4194304] 0 2024-04-26T10:44:30.024 INFO:tasks.workunit.client.0.smithi049.stdout:8/461: dread - d2/d17/d34/d40/f71 zero size 2024-04-26T10:44:30.024 INFO:tasks.workunit.client.0.smithi049.stdout:9/510: symlink d2/d1a/d1b/la5 0 2024-04-26T10:44:30.024 INFO:tasks.workunit.client.0.smithi049.stdout:1/393: symlink d1e/d20/d4d/l79 0 2024-04-26T10:44:30.024 INFO:tasks.workunit.client.0.smithi049.stdout:7/436: dread d2/d3/f3c [0,4194304] 0 2024-04-26T10:44:30.024 INFO:tasks.workunit.client.0.smithi049.stdout:4/496: dwrite f7 [0,4194304] 0 2024-04-26T10:44:30.024 INFO:tasks.workunit.client.0.smithi049.stdout:7/437: fdatasync d2/f4f 0 2024-04-26T10:44:30.024 INFO:tasks.workunit.client.0.smithi049.stdout:8/462: chown d2/d16/d19/f4d 5369 1 2024-04-26T10:44:30.024 INFO:tasks.workunit.client.0.smithi049.stdout:8/463: unlink d2/c73 0 2024-04-26T10:44:30.024 INFO:tasks.workunit.client.0.smithi049.stdout:9/511: rename d2/d1a/df/c69 to d2/d25/d60/da4/ca6 0 2024-04-26T10:44:30.024 INFO:tasks.workunit.client.0.smithi049.stdout:1/394: mknod d1e/d20/d26/d3c/d54/d59/d68/c7a 0 2024-04-26T10:44:30.025 INFO:tasks.workunit.client.0.smithi049.stdout:3/373: dwrite d3/d23/d2f/d6a/d6b/d8/d34/f51 [0,4194304] 0 2024-04-26T10:44:30.025 INFO:tasks.workunit.client.0.smithi049.stdout:4/497: getdents de/d1b/d5e/d72/d73/d88 0 2024-04-26T10:44:30.025 INFO:tasks.workunit.client.0.smithi049.stdout:3/374: write d3/d23/d2f/d6a/d6b/d26/f6d [1477746,90840] 0 2024-04-26T10:44:30.025 INFO:tasks.workunit.client.0.smithi049.stdout:5/434: dread d7/f64 [0,4194304] 0 2024-04-26T10:44:30.025 INFO:tasks.workunit.client.0.smithi049.stdout:4/498: unlink de/d1b/d5e/d72/d73/d84/d4b/c6a 0 2024-04-26T10:44:30.025 INFO:tasks.workunit.client.0.smithi049.stdout:7/438: truncate d2/dd/d38/f40 279493 0 2024-04-26T10:44:30.025 INFO:tasks.workunit.client.0.smithi049.stdout:7/439: chown d2/f74 6 1 2024-04-26T10:44:30.025 INFO:tasks.workunit.client.0.smithi049.stdout:4/499: stat de/d1b/d5e/d72/d73/d84/d38/f3b 0 2024-04-26T10:44:30.025 INFO:tasks.workunit.client.0.smithi049.stdout:5/435: rename d7/d14/d18/d48/ca3 to d7/d53/cb4 0 2024-04-26T10:44:30.025 INFO:tasks.workunit.client.0.smithi049.stdout:9/512: dwrite d2/d25/d74/f63 [0,4194304] 0 2024-04-26T10:44:30.025 INFO:tasks.workunit.client.0.smithi049.stdout:7/440: write d2/dd/d38/f44 [4076819,127501] 0 2024-04-26T10:44:30.026 INFO:tasks.workunit.client.0.smithi049.stdout:4/500: creat de/d1b/d5e/d72/d73/d88/f94 x:0 0 0 2024-04-26T10:44:30.026 INFO:tasks.workunit.client.0.smithi049.stdout:3/375: creat d3/d23/d2f/d6a/d6b/d26/f86 x:0 0 0 2024-04-26T10:44:30.026 INFO:tasks.workunit.client.0.smithi049.stdout:9/513: creat d2/d1a/d9c/fa7 x:0 0 0 2024-04-26T10:44:30.026 INFO:tasks.workunit.client.0.smithi049.stdout:5/436: mkdir d7/d1d/d1f/d4e/d65/d6f/d91/d3e/db5 0 2024-04-26T10:44:30.026 INFO:tasks.workunit.client.0.smithi049.stdout:5/437: sync 2024-04-26T10:44:30.026 INFO:tasks.workunit.client.0.smithi049.stdout:3/376: write d3/d23/d2f/d6a/d6b/d26/d29/f72 [990116,97786] 0 2024-04-26T10:44:30.026 INFO:tasks.workunit.client.0.smithi049.stdout:9/514: readlink d2/d1a/d1b/d1f/l8c 0 2024-04-26T10:44:30.027 INFO:tasks.workunit.client.0.smithi049.stdout:5/438: read - d7/d1d/d1f/d4e/f98 zero size 2024-04-26T10:44:30.027 INFO:tasks.workunit.client.0.smithi049.stdout:4/501: rename de/d1b/d5e/d72/d73/d84/c77 to de/d1b/d5e/d72/d73/d84/d24/d50/c95 0 2024-04-26T10:44:30.027 INFO:tasks.workunit.client.0.smithi049.stdout:4/502: dread - de/d3f/d52/f75 zero size 2024-04-26T10:44:30.027 INFO:tasks.workunit.client.0.smithi049.stdout:5/439: link d7/d1d/d1f/d4e/c5b d7/d1d/d1f/d95/cb6 0 2024-04-26T10:44:30.027 INFO:tasks.workunit.client.0.smithi049.stdout:4/503: creat de/d1b/f96 x:0 0 0 2024-04-26T10:44:30.027 INFO:tasks.workunit.client.0.smithi049.stdout:5/440: fdatasync d7/d1d/d1f/d4e/d77/f93 0 2024-04-26T10:44:30.027 INFO:tasks.workunit.client.0.smithi049.stdout:4/504: write de/d1b/d5e/d72/d73/d88/f89 [4091240,74183] 0 2024-04-26T10:44:30.027 INFO:tasks.workunit.client.0.smithi049.stdout:9/515: dwrite d2/d1a/df/f26 [0,4194304] 0 2024-04-26T10:44:30.027 INFO:tasks.workunit.client.0.smithi049.stdout:3/377: truncate d3/d23/d2f/d6a/d6b/d26/f6d 1488365 0 2024-04-26T10:44:30.027 INFO:tasks.workunit.client.0.smithi049.stdout:9/516: creat d2/d40/fa8 x:0 0 0 2024-04-26T10:44:30.027 INFO:tasks.workunit.client.0.smithi049.stdout:5/441: dread d7/d1d/f30 [0,4194304] 0 2024-04-26T10:44:30.027 INFO:tasks.workunit.client.0.smithi049.stdout:4/505: getdents de/d1b/d5e/d72/d73/d84/d24/d50 0 2024-04-26T10:44:30.027 INFO:tasks.workunit.client.0.smithi049.stdout:3/378: mkdir d3/d23/d2f/d6a/d6b/d8/d87 0 2024-04-26T10:44:30.028 INFO:tasks.workunit.client.0.smithi049.stdout:5/442: dread - d7/fab zero size 2024-04-26T10:44:30.028 INFO:tasks.workunit.client.0.smithi049.stdout:9/517: unlink d2/d1a/df/f30 0 2024-04-26T10:44:30.028 INFO:tasks.workunit.client.0.smithi049.stdout:4/506: chown de/d1b/d5e/d72/d73/d84/f60 3454254 1 2024-04-26T10:44:30.028 INFO:tasks.workunit.client.0.smithi049.stdout:3/379: dread - d3/d23/d2f/d6a/d6b/d26/f5a zero size 2024-04-26T10:44:30.028 INFO:tasks.workunit.client.0.smithi049.stdout:5/443: rename d7/d53/f7e to d7/d1d/d1f/d4e/dad/fb7 0 2024-04-26T10:44:30.028 INFO:tasks.workunit.client.0.smithi049.stdout:3/380: read d3/d23/d2f/d6a/d6b/d26/f48 [3705861,102512] 0 2024-04-26T10:44:30.028 INFO:tasks.workunit.client.0.smithi049.stdout:9/518: write d2/d40/d53/f86 [408121,4379] 0 2024-04-26T10:44:30.028 INFO:tasks.workunit.client.0.smithi049.stdout:4/507: rename de/d1b/d5e/d72/d73/d84/d38/f45 to de/d1b/d5e/d72/d73/d84/d4b/d76/f97 0 2024-04-26T10:44:30.028 INFO:tasks.workunit.client.0.smithi049.stdout:9/519: symlink d2/d1a/d1b/d1f/d34/la9 0 2024-04-26T10:44:30.028 INFO:tasks.workunit.client.0.smithi049.stdout:1/395: dread d1e/d20/d26/d3c/d54/f5a [0,4194304] 0 2024-04-26T10:44:30.028 INFO:tasks.workunit.client.0.smithi049.stdout:5/444: dread d7/d1d/d20/f24 [0,4194304] 0 2024-04-26T10:44:30.028 INFO:tasks.workunit.client.0.smithi049.stdout:5/445: chown d7/d66 31 1 2024-04-26T10:44:30.029 INFO:tasks.workunit.client.0.smithi049.stdout:4/508: rename de/d1d/l4d to de/d1b/d5e/d72/d73/d84/d4b/d76/l98 0 2024-04-26T10:44:30.029 INFO:tasks.workunit.client.0.smithi049.stdout:1/396: creat d1e/d20/d26/d3c/f7b x:0 0 0 2024-04-26T10:44:30.029 INFO:tasks.workunit.client.0.smithi049.stdout:4/509: mkdir de/d1b/d5e/d99 0 2024-04-26T10:44:30.029 INFO:tasks.workunit.client.0.smithi049.stdout:1/397: stat d1e/d20/d26/d3c/l64 0 2024-04-26T10:44:30.029 INFO:tasks.workunit.client.0.smithi049.stdout:7/441: dread d2/dd/d38/f40 [0,4194304] 0 2024-04-26T10:44:30.029 INFO:tasks.workunit.client.0.smithi049.stdout:3/381: dwrite d3/d23/d2f/d6a/d6b/d8/d55/d46/f4a [0,4194304] 0 2024-04-26T10:44:30.029 INFO:tasks.workunit.client.0.smithi049.stdout:7/442: chown d2/dd/c84 969401416 1 2024-04-26T10:44:30.029 INFO:tasks.workunit.client.0.smithi049.stdout:3/382: creat d3/d23/d2f/d6a/d6b/d8/f88 x:0 0 0 2024-04-26T10:44:30.029 INFO:tasks.workunit.client.0.smithi049.stdout:7/443: chown d2/dd/c15 3770 1 2024-04-26T10:44:30.029 INFO:tasks.workunit.client.0.smithi049.stdout:9/520: dwrite d2/f8 [0,4194304] 0 2024-04-26T10:44:30.029 INFO:tasks.workunit.client.0.smithi049.stdout:4/510: getdents de/d1b/d5e/d72 0 2024-04-26T10:44:30.029 INFO:tasks.workunit.client.0.smithi049.stdout:7/444: fdatasync d2/dd/f12 0 2024-04-26T10:44:30.029 INFO:tasks.workunit.client.0.smithi049.stdout:9/521: read d2/f8 [930840,79186] 0 2024-04-26T10:44:30.030 INFO:tasks.workunit.client.0.smithi049.stdout:7/445: fsync d2/dd/d48/f59 0 2024-04-26T10:44:30.030 INFO:tasks.workunit.client.0.smithi049.stdout:3/383: mknod d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/c89 0 2024-04-26T10:44:30.030 INFO:tasks.workunit.client.0.smithi049.stdout:3/384: sync 2024-04-26T10:44:30.030 INFO:tasks.workunit.client.0.smithi049.stdout:3/385: sync 2024-04-26T10:44:30.030 INFO:tasks.workunit.client.0.smithi049.stdout:4/511: readlink de/d1b/d5e/d72/d73/d84/d4b/l5f 0 2024-04-26T10:44:30.030 INFO:tasks.workunit.client.0.smithi049.stdout:5/446: dwrite d7/d1d/d1f/d4e/d65/d6f/d91/d3e/f40 [0,4194304] 0 2024-04-26T10:44:30.030 INFO:tasks.workunit.client.0.smithi049.stdout:1/398: dwrite d1e/d20/f38 [0,4194304] 0 2024-04-26T10:44:30.030 INFO:tasks.workunit.client.0.smithi049.stdout:9/522: dread d2/d1a/d1b/f52 [0,4194304] 0 2024-04-26T10:44:30.030 INFO:tasks.workunit.client.0.smithi049.stdout:6/443: dread da/dd/de/d26/f6f [0,4194304] 0 2024-04-26T10:44:30.030 INFO:tasks.workunit.client.0.smithi049.stdout:3/386: read - d3/d23/d2f/d6a/d6b/d8/d34/f83 zero size 2024-04-26T10:44:30.030 INFO:tasks.workunit.client.0.smithi049.stdout:1/399: creat d1e/d20/d67/f7c x:0 0 0 2024-04-26T10:44:30.030 INFO:tasks.workunit.client.0.smithi049.stdout:5/447: write d7/d1d/d20/f24 [4354000,5703] 0 2024-04-26T10:44:30.031 INFO:tasks.workunit.client.0.smithi049.stdout:6/444: dread - da/dd/f8a zero size 2024-04-26T10:44:30.031 INFO:tasks.workunit.client.0.smithi049.stdout:9/523: readlink d2/d1a/d8a/l8d 0 2024-04-26T10:44:30.031 INFO:tasks.workunit.client.0.smithi049.stdout:6/445: sync 2024-04-26T10:44:30.031 INFO:tasks.workunit.client.0.smithi049.stdout:1/400: rmdir d1e/d20/d26/d3c/d54/d59/d68 39 2024-04-26T10:44:30.031 INFO:tasks.workunit.client.0.smithi049.stdout:5/448: write d7/d53/f9d [932223,38880] 0 2024-04-26T10:44:30.031 INFO:tasks.workunit.client.0.smithi049.stdout:3/387: symlink d3/d23/d2f/d6a/d6b/d8/d87/l8a 0 2024-04-26T10:44:30.031 INFO:tasks.workunit.client.0.smithi049.stdout:9/524: write d2/d25/fa3 [245251,93046] 0 2024-04-26T10:44:30.031 INFO:tasks.workunit.client.0.smithi049.stdout:1/401: rmdir d1e/d20/d26 39 2024-04-26T10:44:30.031 INFO:tasks.workunit.client.0.smithi049.stdout:5/449: readlink d7/d14/d18/l5a 0 2024-04-26T10:44:30.031 INFO:tasks.workunit.client.0.smithi049.stdout:9/525: dread - d2/d1a/f2c zero size 2024-04-26T10:44:30.031 INFO:tasks.workunit.client.0.smithi049.stdout:6/446: rename da/dd/de/d26/d22/f25 to da/dd/de/f96 0 2024-04-26T10:44:30.031 INFO:tasks.workunit.client.0.smithi049.stdout:7/446: dwrite d2/dd/d25/f81 [0,4194304] 0 2024-04-26T10:44:30.031 INFO:tasks.workunit.client.0.smithi049.stdout:7/447: creat d2/dd/d48/f8f x:0 0 0 2024-04-26T10:44:30.032 INFO:tasks.workunit.client.0.smithi049.stdout:5/450: link d7/d1d/d1f/d95/cb6 d7/d1d/d1f/d4e/cb8 0 2024-04-26T10:44:30.032 INFO:tasks.workunit.client.0.smithi049.stdout:9/526: getdents d2/d1a/d1b/d1f/d64 0 2024-04-26T10:44:30.032 INFO:tasks.workunit.client.0.smithi049.stdout:7/448: chown d2/dd/d48/l86 44772 1 2024-04-26T10:44:30.032 INFO:tasks.workunit.client.0.smithi049.stdout:5/451: mkdir d7/d1d/d34/db9 0 2024-04-26T10:44:30.032 INFO:tasks.workunit.client.0.smithi049.stdout:9/527: unlink d2/d1a/d1b/f4c 0 2024-04-26T10:44:30.032 INFO:tasks.workunit.client.0.smithi049.stdout:7/449: dread - d2/dd/d45/d82/f83 zero size 2024-04-26T10:44:30.032 INFO:tasks.workunit.client.0.smithi049.stdout:9/528: chown d2/d40/d53/f86 27148469 1 2024-04-26T10:44:30.032 INFO:tasks.workunit.client.0.smithi049.stdout:3/388: dwrite d3/d23/d2f/d6a/d6b/d26/d58/f7b [0,4194304] 0 2024-04-26T10:44:30.032 INFO:tasks.workunit.client.0.smithi049.stdout:9/529: chown d2/d1a/l15 100 1 2024-04-26T10:44:30.032 INFO:tasks.workunit.client.0.smithi049.stdout:5/452: truncate d7/d1d/d1f/d4e/d65/d6f/d91/d3e/f40 4360657 0 2024-04-26T10:44:30.032 INFO:tasks.workunit.client.0.smithi049.stdout:4/512: dread de/d1b/d5e/d72/d73/d84/f22 [0,4194304] 0 2024-04-26T10:44:30.032 INFO:tasks.workunit.client.0.smithi049.stdout:7/450: creat d2/d3/de/d1c/f90 x:0 0 0 2024-04-26T10:44:30.032 INFO:tasks.workunit.client.0.smithi049.stdout:4/513: stat de/d1b/d5e/d72/d73/f7c 0 2024-04-26T10:44:30.033 INFO:tasks.workunit.client.0.smithi049.stdout:5/453: chown d7/d1d/d20/l28 76830482 1 2024-04-26T10:44:30.033 INFO:tasks.workunit.client.0.smithi049.stdout:9/530: creat d2/faa x:0 0 0 2024-04-26T10:44:30.033 INFO:tasks.workunit.client.0.smithi049.stdout:3/389: getdents d3/d23/d2f/d6a/d6b/d26/d65 0 2024-04-26T10:44:30.039 INFO:tasks.workunit.client.0.smithi049.stdout:5/454: stat d7/d1d/f30 0 2024-04-26T10:44:30.039 INFO:tasks.workunit.client.0.smithi049.stdout:4/514: symlink de/d3f/d48/d62/l9a 0 2024-04-26T10:44:30.039 INFO:tasks.workunit.client.0.smithi049.stdout:9/531: chown d2/d1a/d42/f61 21757698 1 2024-04-26T10:44:30.040 INFO:tasks.workunit.client.0.smithi049.stdout:2/430: dread d6/f2f [0,4194304] 0 2024-04-26T10:44:30.040 INFO:tasks.workunit.client.0.smithi049.stdout:5/455: stat d7/d1d/d1f/d95 0 2024-04-26T10:44:30.040 INFO:tasks.workunit.client.0.smithi049.stdout:7/451: truncate d2/dd/f3f 459607 0 2024-04-26T10:44:30.040 INFO:tasks.workunit.client.0.smithi049.stdout:9/532: symlink d2/d1a/d9c/lab 0 2024-04-26T10:44:30.040 INFO:tasks.workunit.client.0.smithi049.stdout:7/452: write d2/f2c [3068226,30461] 0 2024-04-26T10:44:30.040 INFO:tasks.workunit.client.0.smithi049.stdout:9/533: sync 2024-04-26T10:44:30.040 INFO:tasks.workunit.client.0.smithi049.stdout:4/515: getdents de/d3f/d52 0 2024-04-26T10:44:30.040 INFO:tasks.workunit.client.0.smithi049.stdout:2/431: link d6/d30/l3d d6/d9/db/d34/l7c 0 2024-04-26T10:44:30.040 INFO:tasks.workunit.client.0.smithi049.stdout:7/453: creat d2/d3/f91 x:0 0 0 2024-04-26T10:44:30.040 INFO:tasks.workunit.client.0.smithi049.stdout:5/456: getdents d7/d1d/d1f/d4e/d77 0 2024-04-26T10:44:30.040 INFO:tasks.workunit.client.0.smithi049.stdout:9/534: write d2/d1a/d1b/d1f/f3f [693745,39230] 0 2024-04-26T10:44:30.040 INFO:tasks.workunit.client.0.smithi049.stdout:4/516: write de/d1b/f1c [4749171,42173] 0 2024-04-26T10:44:30.041 INFO:tasks.workunit.client.0.smithi049.stdout:5/457: fdatasync d7/d1d/d1f/f29 0 2024-04-26T10:44:30.041 INFO:tasks.workunit.client.0.smithi049.stdout:9/535: fsync d2/d1a/d1b/d1f/d49/f94 0 2024-04-26T10:44:30.041 INFO:tasks.workunit.client.0.smithi049.stdout:4/517: rmdir de/d1b/d5e/d72/d73/d84/d24 39 2024-04-26T10:44:30.041 INFO:tasks.workunit.client.0.smithi049.stdout:7/454: getdents d2/dd/d38 0 2024-04-26T10:44:30.041 INFO:tasks.workunit.client.0.smithi049.stdout:9/536: readlink d2/d1a/d1b/d1f/d49/l75 0 2024-04-26T10:44:30.041 INFO:tasks.workunit.client.0.smithi049.stdout:3/390: truncate d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/f28 5921033 0 2024-04-26T10:44:30.041 INFO:tasks.workunit.client.0.smithi049.stdout:7/455: dread - d2/dd/d48/f59 zero size 2024-04-26T10:44:30.041 INFO:tasks.workunit.client.0.smithi049.stdout:0/428: dread f2 [4194304,4194304] 0 2024-04-26T10:44:30.041 INFO:tasks.workunit.client.0.smithi049.stdout:9/537: write d2/d1a/d42/f92 [449850,12469] 0 2024-04-26T10:44:30.041 INFO:tasks.workunit.client.0.smithi049.stdout:0/429: mknod d8/d66/c94 0 2024-04-26T10:44:30.041 INFO:tasks.workunit.client.0.smithi049.stdout:1/402: fsync d1e/d20/f38 0 2024-04-26T10:44:30.041 INFO:tasks.workunit.client.0.smithi049.stdout:4/518: read de/d1b/d5e/d72/d73/d84/f8c [836889,947] 0 2024-04-26T10:44:30.041 INFO:tasks.workunit.client.0.smithi049.stdout:2/432: dwrite d6/d9/d5f/f67 [0,4194304] 0 2024-04-26T10:44:30.041 INFO:tasks.workunit.client.0.smithi049.stdout:3/391: creat d3/d23/d2f/d6a/d6b/d8/d82/f8b x:0 0 0 2024-04-26T10:44:30.041 INFO:tasks.workunit.client.0.smithi049.stdout:6/447: dread da/dd/de/d26/d22/f54 [0,4194304] 0 2024-04-26T10:44:30.042 INFO:tasks.workunit.client.0.smithi049.stdout:0/430: fdatasync d8/db/d11/d1c/f5b 0 2024-04-26T10:44:30.042 INFO:tasks.workunit.client.0.smithi049.stdout:9/538: rename d2/d1a/d1b/d1f/f8f to d2/d1a/fac 0 2024-04-26T10:44:30.042 INFO:tasks.workunit.client.0.smithi049.stdout:5/458: dwrite d7/d1d/d34/f8e [0,4194304] 0 2024-04-26T10:44:30.042 INFO:tasks.workunit.client.0.smithi049.stdout:8/464: dread d2/d16/d19/f25 [0,4194304] 0 2024-04-26T10:44:30.042 INFO:tasks.workunit.client.0.smithi049.stdout:0/431: readlink d8/d1e/l7a 0 2024-04-26T10:44:30.042 INFO:tasks.workunit.client.0.smithi049.stdout:9/539: dread - d2/d1a/d1b/d1f/d64/f7b zero size 2024-04-26T10:44:30.042 INFO:tasks.workunit.client.0.smithi049.stdout:7/456: dwrite d2/f74 [0,4194304] 0 2024-04-26T10:44:30.042 INFO:tasks.workunit.client.0.smithi049.stdout:9/540: truncate d2/d25/fa3 1531501 0 2024-04-26T10:44:30.042 INFO:tasks.workunit.client.0.smithi049.stdout:6/448: symlink da/dd/de/d26/d29/l97 0 2024-04-26T10:44:30.042 INFO:tasks.workunit.client.0.smithi049.stdout:4/519: rename de/d3f/d48/d62 to de/d3f/d52/d9b 0 2024-04-26T10:44:30.042 INFO:tasks.workunit.client.0.smithi049.stdout:3/392: mkdir d3/d23/d2f/d6a/d6b/d8c 0 2024-04-26T10:44:30.042 INFO:tasks.workunit.client.0.smithi049.stdout:0/432: mknod d8/db/d26/d39/c95 0 2024-04-26T10:44:30.042 INFO:tasks.workunit.client.0.smithi049.stdout:5/459: chown d7/d1d/d1f/d4e/d65/d6f/c76 221 1 2024-04-26T10:44:30.042 INFO:tasks.workunit.client.0.smithi049.stdout:1/403: symlink d1e/d20/d26/d37/d69/d75/l7d 0 2024-04-26T10:44:30.043 INFO:tasks.workunit.client.0.smithi049.stdout:9/541: unlink d2/d1a/d1b/d1f/d64/f9f 0 2024-04-26T10:44:30.043 INFO:tasks.workunit.client.0.smithi049.stdout:7/457: creat d2/f92 x:0 0 0 2024-04-26T10:44:30.043 INFO:tasks.workunit.client.0.smithi049.stdout:6/449: fdatasync da/dd/de/d11/f7e 0 2024-04-26T10:44:30.043 INFO:tasks.workunit.client.0.smithi049.stdout:0/433: mkdir d8/db/d93/d96 0 2024-04-26T10:44:30.043 INFO:tasks.workunit.client.0.smithi049.stdout:4/520: creat de/d1b/d5e/d72/d73/d84/d24/d50/f9c x:0 0 0 2024-04-26T10:44:30.043 INFO:tasks.workunit.client.0.smithi049.stdout:5/460: link d7/d1d/d1f/d4e/d65/d6f/d91/c3d d7/d14/cba 0 2024-04-26T10:44:30.043 INFO:tasks.workunit.client.0.smithi049.stdout:0/434: unlink d8/f52 0 2024-04-26T10:44:30.043 INFO:tasks.workunit.client.0.smithi049.stdout:4/521: fsync de/d1b/f34 0 2024-04-26T10:44:30.043 INFO:tasks.workunit.client.0.smithi049.stdout:6/450: symlink da/dd/de/d42/d5a/l98 0 2024-04-26T10:44:30.043 INFO:tasks.workunit.client.0.smithi049.stdout:7/458: symlink d2/d3/de/l93 0 2024-04-26T10:44:30.043 INFO:tasks.workunit.client.0.smithi049.stdout:8/465: write d2/f6 [1440754,129279] 0 2024-04-26T10:44:30.043 INFO:tasks.workunit.client.0.smithi049.stdout:4/522: readlink lb 0 2024-04-26T10:44:30.043 INFO:tasks.workunit.client.0.smithi049.stdout:5/461: creat d7/d66/fbb x:0 0 0 2024-04-26T10:44:30.043 INFO:tasks.workunit.client.0.smithi049.stdout:1/404: rename d1e/d20/d67/f7c to d1e/d20/d26/d3c/d54/d59/d73/f7e 0 2024-04-26T10:44:30.043 INFO:tasks.workunit.client.0.smithi049.stdout:3/393: dwrite d3/d23/d2f/d6a/d6b/d8/d55/f2d [0,4194304] 0 2024-04-26T10:44:30.044 INFO:tasks.workunit.client.0.smithi049.stdout:0/435: creat d8/db/d26/f97 x:0 0 0 2024-04-26T10:44:30.044 INFO:tasks.workunit.client.0.smithi049.stdout:8/466: write d2/d16/f2e [377566,96981] 0 2024-04-26T10:44:30.045 INFO:tasks.workunit.client.0.smithi049.stdout:5/462: creat d7/d1d/fbc x:0 0 0 2024-04-26T10:44:30.045 INFO:tasks.workunit.client.0.smithi049.stdout:0/436: mkdir d8/d1e/d98 0 2024-04-26T10:44:30.045 INFO:tasks.workunit.client.0.smithi049.stdout:4/523: symlink de/d1b/d5e/d72/d73/d84/d38/l9d 0 2024-04-26T10:44:30.045 INFO:tasks.workunit.client.0.smithi049.stdout:7/459: creat d2/d3/de/d1c/f94 x:0 0 0 2024-04-26T10:44:30.045 INFO:tasks.workunit.client.0.smithi049.stdout:8/467: write d2/d89/d2a/f48 [657823,2167] 0 2024-04-26T10:44:30.045 INFO:tasks.workunit.client.0.smithi049.stdout:9/542: dwrite d2/d40/d53/f86 [0,4194304] 0 2024-04-26T10:44:30.045 INFO:tasks.workunit.client.0.smithi049.stdout:7/460: stat d2/f4f 0 2024-04-26T10:44:30.045 INFO:tasks.workunit.client.0.smithi049.stdout:8/468: write d2/d89/d2a/f84 [567759,117367] 0 2024-04-26T10:44:30.047 INFO:tasks.workunit.client.0.smithi049.stdout:0/437: unlink d8/db/d26/d39/f82 0 2024-04-26T10:44:30.047 INFO:tasks.workunit.client.0.smithi049.stdout:4/524: mkdir de/d3f/d52/d9b/d9e 0 2024-04-26T10:44:30.047 INFO:tasks.workunit.client.0.smithi049.stdout:6/451: dwrite da/dd/de/d42/f5f [0,4194304] 0 2024-04-26T10:44:30.047 INFO:tasks.workunit.client.0.smithi049.stdout:7/461: creat d2/d3/de/d1c/d4d/f95 x:0 0 0 2024-04-26T10:44:30.047 INFO:tasks.workunit.client.0.smithi049.stdout:3/394: rename d3/d23/d2f/c7e to d3/d23/d2f/d6a/d6b/c8d 0 2024-04-26T10:44:30.047 INFO:tasks.workunit.client.0.smithi049.stdout:8/469: fsync d2/df/f5a 0 2024-04-26T10:44:30.047 INFO:tasks.workunit.client.0.smithi049.stdout:1/405: dread d1e/d20/d26/f4b [0,4194304] 0 2024-04-26T10:44:30.047 INFO:tasks.workunit.client.0.smithi049.stdout:6/452: read - da/dd/d62/f6d zero size 2024-04-26T10:44:30.048 INFO:tasks.workunit.client.0.smithi049.stdout:5/463: rename d7/d53/l6c to d7/d1d/d34/lbd 0 2024-04-26T10:44:30.050 INFO:tasks.workunit.client.0.smithi049.stdout:0/438: creat d8/db/d26/d39/f99 x:0 0 0 2024-04-26T10:44:30.050 INFO:tasks.workunit.client.0.smithi049.stdout:1/406: write fa [3900339,120339] 0 2024-04-26T10:44:30.051 INFO:tasks.workunit.client.0.smithi049.stdout:0/439: stat d8/db/d26/d39 0 2024-04-26T10:44:30.053 INFO:tasks.workunit.client.0.smithi049.stdout:9/543: dwrite d2/d25/d74/f63 [0,4194304] 0 2024-04-26T10:44:30.054 INFO:tasks.workunit.client.0.smithi049.stdout:7/462: dwrite d2/f49 [0,4194304] 0 2024-04-26T10:44:30.054 INFO:tasks.workunit.client.0.smithi049.stdout:8/470: creat d2/df/f95 x:0 0 0 2024-04-26T10:44:30.055 INFO:tasks.workunit.client.0.smithi049.stdout:5/464: rmdir d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d9f 0 2024-04-26T10:44:30.055 INFO:tasks.workunit.client.0.smithi049.stdout:4/525: getdents de/d1b/d5e/d72/d73/d84/d38 0 2024-04-26T10:44:30.055 INFO:tasks.workunit.client.0.smithi049.stdout:0/440: chown d8/db/l3e 227553540 1 2024-04-26T10:44:30.055 INFO:tasks.workunit.client.0.smithi049.stdout:6/453: getdents da/dd/d47/d7b/d84/d92 0 2024-04-26T10:44:30.056 INFO:tasks.workunit.client.0.smithi049.stdout:9/544: fsync d2/f3c 0 2024-04-26T10:44:30.057 INFO:tasks.workunit.client.0.smithi049.stdout:7/463: write d2/dd/d48/f69 [434025,58084] 0 2024-04-26T10:44:30.059 INFO:tasks.workunit.client.0.smithi049.stdout:8/471: creat d2/d16/d19/d42/f96 x:0 0 0 2024-04-26T10:44:30.059 INFO:tasks.workunit.client.0.smithi049.stdout:0/441: unlink d8/d1e/f2a 0 2024-04-26T10:44:30.059 INFO:tasks.workunit.client.0.smithi049.stdout:5/465: rmdir d7/d1d/d34 39 2024-04-26T10:44:30.059 INFO:tasks.workunit.client.0.smithi049.stdout:6/454: mknod da/dd/de/d26/d22/d4c/c99 0 2024-04-26T10:44:30.060 INFO:tasks.workunit.client.0.smithi049.stdout:9/545: symlink d2/d1a/d1b/d1f/d49/lad 0 2024-04-26T10:44:30.061 INFO:tasks.workunit.client.0.smithi049.stdout:3/395: dwrite d3/d23/d2f/d6a/d6b/d26/f6d [0,4194304] 0 2024-04-26T10:44:30.061 INFO:tasks.workunit.client.0.smithi049.stdout:1/407: getdents d1e/d20/d26/d3c/d54/d59 0 2024-04-26T10:44:30.061 INFO:tasks.workunit.client.0.smithi049.stdout:8/472: chown d2/d89/f74 15 1 2024-04-26T10:44:30.062 INFO:tasks.workunit.client.0.smithi049.stdout:9/546: symlink d2/d1a/d9c/lae 0 2024-04-26T10:44:30.063 INFO:tasks.workunit.client.0.smithi049.stdout:8/473: write d2/fc [8965385,75120] 0 2024-04-26T10:44:30.064 INFO:tasks.workunit.client.0.smithi049.stdout:4/526: dwrite de/d3f/d52/d9b/f91 [12582912,4194304] 0 2024-04-26T10:44:30.064 INFO:tasks.workunit.client.0.smithi049.stdout:0/442: getdents d8/d66/d84 0 2024-04-26T10:44:30.065 INFO:tasks.workunit.client.0.smithi049.stdout:3/396: rename d3/f76 to d3/d23/d2f/d6a/d6b/d8c/f8e 0 2024-04-26T10:44:30.065 INFO:tasks.workunit.client.0.smithi049.stdout:9/547: symlink d2/d1a/d1b/d1f/d34/laf 0 2024-04-26T10:44:30.066 INFO:tasks.workunit.client.0.smithi049.stdout:8/474: chown d2/d17/l5d 641948 1 2024-04-26T10:44:30.067 INFO:tasks.workunit.client.0.smithi049.stdout:5/466: write d7/d1d/d1f/f8f [884547,94862] 0 2024-04-26T10:44:30.067 INFO:tasks.workunit.client.0.smithi049.stdout:7/464: dread d2/f74 [0,4194304] 0 2024-04-26T10:44:30.067 INFO:tasks.workunit.client.0.smithi049.stdout:0/443: unlink d8/la 0 2024-04-26T10:44:30.069 INFO:tasks.workunit.client.0.smithi049.stdout:0/444: readlink d8/ld 0 2024-04-26T10:44:30.069 INFO:tasks.workunit.client.0.smithi049.stdout:8/475: creat d2/d17/f97 x:0 0 0 2024-04-26T10:44:30.069 INFO:tasks.workunit.client.0.smithi049.stdout:4/527: symlink de/d1b/d5e/d72/d73/d84/l9f 0 2024-04-26T10:44:30.069 INFO:tasks.workunit.client.0.smithi049.stdout:9/548: write d2/d1a/f2a [1623856,122242] 0 2024-04-26T10:44:30.070 INFO:tasks.workunit.client.0.smithi049.stdout:7/465: chown d2/d3/de/l93 747 1 2024-04-26T10:44:30.070 INFO:tasks.workunit.client.0.smithi049.stdout:2/433: dread d6/d9/db/d34/f5a [0,4194304] 0 2024-04-26T10:44:30.070 INFO:tasks.workunit.client.0.smithi049.stdout:8/476: read d2/d16/d19/f25 [2011536,2937] 0 2024-04-26T10:44:30.071 INFO:tasks.workunit.client.0.smithi049.stdout:3/397: chown d3/d23/d2f/d6a/d6b/d26/d58/f7b 373 1 2024-04-26T10:44:30.071 INFO:tasks.workunit.client.0.smithi049.stdout:6/455: dwrite da/dd/f1e [0,4194304] 0 2024-04-26T10:44:30.071 INFO:tasks.workunit.client.0.smithi049.stdout:7/466: chown d2/dd/d48/f69 1843 1 2024-04-26T10:44:30.072 INFO:tasks.workunit.client.0.smithi049.stdout:4/528: creat de/fa0 x:0 0 0 2024-04-26T10:44:30.073 INFO:tasks.workunit.client.0.smithi049.stdout:6/456: fsync da/ff 0 2024-04-26T10:44:30.073 INFO:tasks.workunit.client.0.smithi049.stdout:2/434: dread - d6/d9/f6b zero size 2024-04-26T10:44:30.073 INFO:tasks.workunit.client.0.smithi049.stdout:5/467: rename d7/d1d/d1f/l5e to d7/d1d/lbe 0 2024-04-26T10:44:30.075 INFO:tasks.workunit.client.0.smithi049.stdout:1/408: dwrite f11 [0,4194304] 0 2024-04-26T10:44:30.075 INFO:tasks.workunit.client.0.smithi049.stdout:9/549: rename d2/d1a/l7c to d2/d1a/d9c/lb0 0 2024-04-26T10:44:30.076 INFO:tasks.workunit.client.0.smithi049.stdout:3/398: mknod d3/d23/d2f/d6a/d6b/d8/d34/c8f 0 2024-04-26T10:44:30.076 INFO:tasks.workunit.client.0.smithi049.stdout:7/467: getdents d2/dd/d38 0 2024-04-26T10:44:30.076 INFO:tasks.workunit.client.0.smithi049.stdout:2/435: creat d6/f7d x:0 0 0 2024-04-26T10:44:30.077 INFO:tasks.workunit.client.0.smithi049.stdout:4/529: symlink de/d1b/d5e/d72/d73/d84/d24/la1 0 2024-04-26T10:44:30.078 INFO:tasks.workunit.client.0.smithi049.stdout:9/550: mknod d2/d1a/d1b/d1f/d49/cb1 0 2024-04-26T10:44:30.078 INFO:tasks.workunit.client.0.smithi049.stdout:3/399: chown d3/d23/d2f/d6a/d6b/c8d 121 1 2024-04-26T10:44:30.078 INFO:tasks.workunit.client.0.smithi049.stdout:2/436: read d6/f2f [4183578,58159] 0 2024-04-26T10:44:30.078 INFO:tasks.workunit.client.0.smithi049.stdout:5/468: rename d7/d53/f78 to d7/d14/d18/d48/fbf 0 2024-04-26T10:44:30.079 INFO:tasks.workunit.client.0.smithi049.stdout:4/530: chown de/d3f/d48/d8b 151680 1 2024-04-26T10:44:30.079 INFO:tasks.workunit.client.0.smithi049.stdout:9/551: mkdir d2/d40/db2 0 2024-04-26T10:44:30.080 INFO:tasks.workunit.client.0.smithi049.stdout:0/445: dwrite d8/db/d11/f32 [0,4194304] 0 2024-04-26T10:44:30.082 INFO:tasks.workunit.client.0.smithi049.stdout:8/477: dwrite d2/d17/f3d [0,4194304] 0 2024-04-26T10:44:30.083 INFO:tasks.workunit.client.0.smithi049.stdout:5/469: mknod d7/d66/d84/cc0 0 2024-04-26T10:44:30.083 INFO:tasks.workunit.client.0.smithi049.stdout:7/468: rename d2/d3/de/d1c/d4d to d2/d3/d96 0 2024-04-26T10:44:30.083 INFO:tasks.workunit.client.0.smithi049.stdout:6/457: dread da/dd/d47/f61 [0,4194304] 0 2024-04-26T10:44:30.084 INFO:tasks.workunit.client.0.smithi049.stdout:3/400: mkdir d3/d23/d2f/d6a/d6b/d26/d58/d90 0 2024-04-26T10:44:30.084 INFO:tasks.workunit.client.0.smithi049.stdout:0/446: symlink d8/d66/l9a 0 2024-04-26T10:44:30.084 INFO:tasks.workunit.client.0.smithi049.stdout:2/437: creat d6/d9/db/d34/d7b/f7e x:0 0 0 2024-04-26T10:44:30.085 INFO:tasks.workunit.client.0.smithi049.stdout:8/478: symlink d2/d89/l98 0 2024-04-26T10:44:30.085 INFO:tasks.workunit.client.0.smithi049.stdout:1/409: dwrite d1e/d20/f6b [0,4194304] 0 2024-04-26T10:44:30.086 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:30.083+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:30.087 INFO:tasks.workunit.client.0.smithi049.stdout:9/552: getdents d2/d1a/d8a 0 2024-04-26T10:44:30.088 INFO:tasks.workunit.client.0.smithi049.stdout:2/438: mkdir d6/d32/d7f 0 2024-04-26T10:44:30.091 INFO:tasks.workunit.client.0.smithi049.stdout:1/410: write d1e/f31 [2327661,126270] 0 2024-04-26T10:44:30.091 INFO:tasks.workunit.client.0.smithi049.stdout:4/531: write f1 [23989,55880] 0 2024-04-26T10:44:30.091 INFO:tasks.workunit.client.0.smithi049.stdout:0/447: mkdir d8/db/d93/d96/d9b 0 2024-04-26T10:44:30.095 INFO:tasks.workunit.client.0.smithi049.stdout:9/553: creat d2/d1a/d1b/d1f/d64/fb3 x:0 0 0 2024-04-26T10:44:30.095 INFO:tasks.workunit.client.0.smithi049.stdout:2/439: rmdir d6/d9/db 39 2024-04-26T10:44:30.095 INFO:tasks.workunit.client.0.smithi049.stdout:4/532: write de/d1b/f1c [4177015,9082] 0 2024-04-26T10:44:30.095 INFO:tasks.workunit.client.0.smithi049.stdout:1/411: truncate d1e/f72 1424629 0 2024-04-26T10:44:30.098 INFO:tasks.workunit.client.0.smithi049.stdout:7/469: dwrite d2/f33 [0,4194304] 0 2024-04-26T10:44:30.099 INFO:tasks.workunit.client.0.smithi049.stdout:0/448: rename d8/d1e/f4c to d8/db/d26/d6f/f9c 0 2024-04-26T10:44:30.099 INFO:tasks.workunit.client.0.smithi049.stdout:6/458: dwrite da/dd/d62/f6d [0,4194304] 0 2024-04-26T10:44:30.100 INFO:tasks.workunit.client.0.smithi049.stdout:2/440: creat d6/d9/d5f/f80 x:0 0 0 2024-04-26T10:44:30.101 INFO:tasks.workunit.client.0.smithi049.stdout:4/533: readlink de/d1b/d5e/d72/d73/d84/d24/l2a 0 2024-04-26T10:44:30.101 INFO:tasks.workunit.client.0.smithi049.stdout:3/401: dwrite d3/d23/d2f/d6a/d6b/d8/f9 [8388608,4194304] 0 2024-04-26T10:44:30.103 INFO:tasks.workunit.client.0.smithi049.stdout:5/470: dwrite d7/d1d/d34/f8e [0,4194304] 0 2024-04-26T10:44:30.103 INFO:tasks.workunit.client.0.smithi049.stdout:0/449: mknod d8/d66/d84/c9d 0 2024-04-26T10:44:30.103 INFO:tasks.workunit.client.0.smithi049.stdout:6/459: fdatasync da/dd/d47/f66 0 2024-04-26T10:44:30.103 INFO:tasks.workunit.client.0.smithi049.stdout:7/470: creat d2/dd/d45/f97 x:0 0 0 2024-04-26T10:44:30.104 INFO:tasks.workunit.client.0.smithi049.stdout:8/479: dwrite d2/d16/d19/f25 [0,4194304] 0 2024-04-26T10:44:30.104 INFO:tasks.workunit.client.0.smithi049.stdout:0/450: creat d8/d1e/d6a/f9e x:0 0 0 2024-04-26T10:44:30.105 INFO:tasks.workunit.client.0.smithi049.stdout:4/534: chown de/d1b/d5e/d72/d73/d84/d4b/d76 0 1 2024-04-26T10:44:30.105 INFO:tasks.workunit.client.0.smithi049.stdout:2/441: rename d6/d32/d4a/f4e to d6/d9/db/d1e/f81 0 2024-04-26T10:44:30.106 INFO:tasks.workunit.client.0.smithi049.stdout:5/471: write d7/d1d/fa2 [1034795,76191] 0 2024-04-26T10:44:30.106 INFO:tasks.workunit.client.0.smithi049.stdout:8/480: chown d2/d17/c6d 2121012653 1 2024-04-26T10:44:30.107 INFO:tasks.workunit.client.0.smithi049.stdout:6/460: mknod da/dd/d62/c9a 0 2024-04-26T10:44:30.107 INFO:tasks.workunit.client.0.smithi049.stdout:9/554: truncate d2/d40/f78 980470 0 2024-04-26T10:44:30.109 INFO:tasks.workunit.client.0.smithi049.stdout:0/451: write d8/d42/f6c [669108,108130] 0 2024-04-26T10:44:30.110 INFO:tasks.workunit.client.0.smithi049.stdout:5/472: symlink d7/d1d/d1f/d4e/d80/lc1 0 2024-04-26T10:44:30.110 INFO:tasks.workunit.client.0.smithi049.stdout:1/412: dwrite d1e/d20/d26/f33 [0,4194304] 0 2024-04-26T10:44:30.110 INFO:tasks.workunit.client.0.smithi049.stdout:2/442: rename d6/d32/d7f to d6/d9/db/d34/d38/d73/d82 0 2024-04-26T10:44:30.111 INFO:tasks.workunit.client.0.smithi049.stdout:6/461: symlink da/dd/de/d42/d5a/l9b 0 2024-04-26T10:44:30.111 INFO:tasks.workunit.client.0.smithi049.stdout:9/555: unlink d2/d1a/d1b/d1f/d49/c4e 0 2024-04-26T10:44:30.113 INFO:tasks.workunit.client.0.smithi049.stdout:2/443: stat d6/d9/db/df/l1b 0 2024-04-26T10:44:30.113 INFO:tasks.workunit.client.0.smithi049.stdout:8/481: link d2/d89/d30/f63 d2/df/d10/d47/f99 0 2024-04-26T10:44:30.113 INFO:tasks.workunit.client.0.smithi049.stdout:1/413: chown d1e/d20/d26/d57/l66 367057399 1 2024-04-26T10:44:30.114 INFO:tasks.workunit.client.0.smithi049.stdout:9/556: write d2/d1a/d42/f61 [314407,27023] 0 2024-04-26T10:44:30.114 INFO:tasks.workunit.client.0.smithi049.stdout:6/462: mknod da/dd/de/d26/d22/d4c/c9c 0 2024-04-26T10:44:30.114 INFO:tasks.workunit.client.0.smithi049.stdout:1/414: chown f12 0 1 2024-04-26T10:44:30.115 INFO:tasks.workunit.client.0.smithi049.stdout:5/473: getdents d7/d14/d18 0 2024-04-26T10:44:30.115 INFO:tasks.workunit.client.0.smithi049.stdout:8/482: mkdir d2/df/d10/d23/d9a 0 2024-04-26T10:44:30.115 INFO:tasks.workunit.client.0.smithi049.stdout:9/557: rmdir d2 39 2024-04-26T10:44:30.116 INFO:tasks.workunit.client.0.smithi049.stdout:6/463: stat da/dd/de/d42/d5a/l98 0 2024-04-26T10:44:30.116 INFO:tasks.workunit.client.0.smithi049.stdout:3/402: dwrite d3/d23/d2f/d6a/d6b/d26/d58/f81 [0,4194304] 0 2024-04-26T10:44:30.116 INFO:tasks.workunit.client.0.smithi049.stdout:4/535: truncate de/d1b/d5e/d72/d73/d84/d38/f3b 36406 0 2024-04-26T10:44:30.116 INFO:tasks.workunit.client.0.smithi049.stdout:0/452: truncate d8/d1e/f72 1540409 0 2024-04-26T10:44:30.116 INFO:tasks.workunit.client.0.smithi049.stdout:6/464: write f1 [1606593,28179] 0 2024-04-26T10:44:30.117 INFO:tasks.workunit.client.0.smithi049.stdout:1/415: mknod d1e/d20/d4d/d70/c7f 0 2024-04-26T10:44:30.117 INFO:tasks.workunit.client.0.smithi049.stdout:5/474: mknod d7/d1d/d1f/d4e/d65/d6f/cc2 0 2024-04-26T10:44:30.118 INFO:tasks.workunit.client.0.smithi049.stdout:8/483: getdents d2/d17/d34 0 2024-04-26T10:44:30.119 INFO:tasks.workunit.client.0.smithi049.stdout:4/536: write de/d1b/d5e/d72/d73/d84/f25 [445793,5480] 0 2024-04-26T10:44:30.119 INFO:tasks.workunit.client.0.smithi049.stdout:6/465: readlink da/dd/de/d42/d5a/l9b 0 2024-04-26T10:44:30.119 INFO:tasks.workunit.client.0.smithi049.stdout:1/416: rename d1e/d20/d26/c2f to d1e/d20/d4d/c80 0 2024-04-26T10:44:30.120 INFO:tasks.workunit.client.0.smithi049.stdout:8/484: write d2/d89/d30/f8f [57736,48783] 0 2024-04-26T10:44:30.121 INFO:tasks.workunit.client.0.smithi049.stdout:6/466: mkdir da/dd/d62/d9d 0 2024-04-26T10:44:30.122 INFO:tasks.workunit.client.0.smithi049.stdout:4/537: write de/d1b/d5e/d72/d73/d84/d24/d50/f9c [368024,77872] 0 2024-04-26T10:44:30.122 INFO:tasks.workunit.client.0.smithi049.stdout:6/467: rmdir da/dd/de/d26 39 2024-04-26T10:44:30.123 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:30.124 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:30.124 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.124 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12590 4.20 4:07d4a554:::1000000324b.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:30.124 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.110954+0000", 2024-04-26T10:44:30.124 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.010979671, 2024-04-26T10:44:30.124 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.011005119000000001, 2024-04-26T10:44:30.124 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.124 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:30.124 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:30.125 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:30.125 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:30.125 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12590 2024-04-26T10:44:30.125 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.125 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.125 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.125 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.125 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.110954+0000", 2024-04-26T10:44:30.126 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.126 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.126 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.126 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.126 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.110954+0000", 2024-04-26T10:44:30.126 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.126 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.126 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.127 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.127 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.110953+0000", 2024-04-26T10:44:30.127 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:30.127 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.127 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.127 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.127 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.119099+0000", 2024-04-26T10:44:30.127 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0081459449999999999 2024-04-26T10:44:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.119111+0000", 2024-04-26T10:44:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2081e-05 2024-04-26T10:44:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.119116+0000", 2024-04-26T10:44:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.4870000000000002e-06 2024-04-26T10:44:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.119155+0000", 2024-04-26T10:44:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9187999999999998e-05 2024-04-26T10:44:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.129 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.130 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.119215+0000", 2024-04-26T10:44:30.130 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.923e-05 2024-04-26T10:44:30.130 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.130 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.130 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.130 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.130 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12599 4.18 4:1945f42e:::10000003508.00000000:head [write 57736~48783 in=48783b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.120951+0000", 2024-04-26T10:44:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.0009820269999999999, 2024-04-26T10:44:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001074258, 2024-04-26T10:44:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:30.131 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12599 2024-04-26T10:44:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.120951+0000", 2024-04-26T10:44:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.132 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.133 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.120951+0000", 2024-04-26T10:44:30.133 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.133 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.133 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.120950+0000", 2024-04-26T10:44:30.133 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:30.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.121016+0000", 2024-04-26T10:44:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5885999999999999e-05 2024-04-26T10:44:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.121025+0000", 2024-04-26T10:44:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4809999999999995e-06 2024-04-26T10:44:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.134 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.121032+0000", 2024-04-26T10:44:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8210000000000004e-06 2024-04-26T10:44:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.121069+0000", 2024-04-26T10:44:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6788000000000001e-05 2024-04-26T10:44:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.135 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.136 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.136 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.121200+0000", 2024-04-26T10:44:30.136 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013155299999999999 2024-04-26T10:44:30.136 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.136 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.136 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.136 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.136 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(client.4532.0:12586 4.4 e57/37 4:233f6309:::10000003211.00000000:head v 57'176, mlcod=57'174)", 2024-04-26T10:44:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.116082+0000", 2024-04-26T10:44:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.0058508830000000003, 2024-04-26T10:44:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059975089999999998, 2024-04-26T10:44:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.137 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.116082+0000", 2024-04-26T10:44:30.138 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.138 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.138 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.138 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.138 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.116082+0000", 2024-04-26T10:44:30.138 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.138 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.138 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.138 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.116082+0000", 2024-04-26T10:44:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.121030+0000", 2024-04-26T10:44:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0049477660000000001 2024-04-26T10:44:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.139 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.140 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.121039+0000", 2024-04-26T10:44:30.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7879999999999995e-06 2024-04-26T10:44:30.140 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.140 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.140 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.121043+0000", 2024-04-26T10:44:30.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6380000000000003e-06 2024-04-26T10:44:30.140 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.121074+0000", 2024-04-26T10:44:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0312e-05 2024-04-26T10:44:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.121090+0000", 2024-04-26T10:44:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6653000000000001e-05 2024-04-26T10:44:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.141 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(client.4532.0:12594 4.1e e57/37 4:78e5e06c:::100000030c5.00000000:head v 57'191, mlcod=57'189)", 2024-04-26T10:44:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.121274+0000", 2024-04-26T10:44:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.000659284, 2024-04-26T10:44:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00083595100000000003, 2024-04-26T10:44:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.121274+0000", 2024-04-26T10:44:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.142 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.121274+0000", 2024-04-26T10:44:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.121274+0000", 2024-04-26T10:44:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.121333+0000", 2024-04-26T10:44:30.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8984999999999999e-05 2024-04-26T10:44:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.121338+0000", 2024-04-26T10:44:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.1780000000000002e-06 2024-04-26T10:44:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.121341+0000", 2024-04-26T10:44:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.976e-06 2024-04-26T10:44:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.144 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.121375+0000", 2024-04-26T10:44:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3936999999999997e-05 2024-04-26T10:44:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.121392+0000", 2024-04-26T10:44:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.7173e-05 2024-04-26T10:44:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: ], 2024-04-26T10:44:30.145 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 4 2024-04-26T10:44:30.145 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:30.149 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:30.150 INFO:tasks.workunit.client.0.smithi049.stdout:8/485: rename d2/d89/d2a/f84 to d2/d16/f9b 0 2024-04-26T10:44:30.150 INFO:tasks.workunit.client.0.smithi049.stdout:1/417: getdents d1e/d20/d26/d37/d69/d75 0 2024-04-26T10:44:30.150 INFO:tasks.workunit.client.0.smithi049.stdout:5/475: dread d7/d1d/d20/f24 [0,4194304] 0 2024-04-26T10:44:30.150 INFO:tasks.workunit.client.0.smithi049.stdout:3/403: dwrite d3/d23/d2f/d6a/d6b/d8/d82/f8b [0,4194304] 0 2024-04-26T10:44:30.150 INFO:tasks.workunit.client.0.smithi049.stdout:9/558: dread d2/d1a/d1b/d1f/f39 [0,4194304] 0 2024-04-26T10:44:30.150 INFO:tasks.workunit.client.0.smithi049.stdout:8/486: fsync d2/d1a/f1e 0 2024-04-26T10:44:30.150 INFO:tasks.workunit.client.0.smithi049.stdout:8/487: chown d2/d17/d34/d40/f57 27 1 2024-04-26T10:44:30.150 INFO:tasks.workunit.client.0.smithi049.stdout:1/418: dread f11 [0,4194304] 0 2024-04-26T10:44:30.150 INFO:tasks.workunit.client.0.smithi049.stdout:6/468: dwrite da/f91 [0,4194304] 0 2024-04-26T10:44:30.150 INFO:tasks.workunit.client.0.smithi049.stdout:3/404: write d3/d23/d2f/d6a/d6b/d26/d29/f7d [937124,80589] 0 2024-04-26T10:44:30.151 INFO:tasks.workunit.client.0.smithi049.stdout:7/471: dread d2/dd/d38/f3d [0,4194304] 0 2024-04-26T10:44:30.151 INFO:tasks.workunit.client.0.smithi049.stdout:0/453: dwrite d8/d1e/f2b [0,4194304] 0 2024-04-26T10:44:30.151 INFO:tasks.workunit.client.0.smithi049.stdout:8/488: rmdir d2/d17/d34/d40 39 2024-04-26T10:44:30.151 INFO:tasks.workunit.client.0.smithi049.stdout:1/419: unlink d1e/d20/d26/f33 0 2024-04-26T10:44:30.151 INFO:tasks.workunit.client.0.smithi049.stdout:4/538: dwrite de/f15 [0,4194304] 0 2024-04-26T10:44:30.151 INFO:tasks.workunit.client.0.smithi049.stdout:7/472: creat d2/dd/d48/d5c/f98 x:0 0 0 2024-04-26T10:44:30.151 INFO:tasks.workunit.client.0.smithi049.stdout:0/454: chown d8/d1e/f67 475 1 2024-04-26T10:44:30.151 INFO:tasks.workunit.client.0.smithi049.stdout:3/405: truncate d3/d6/f10 3464260 0 2024-04-26T10:44:30.151 INFO:tasks.workunit.client.0.smithi049.stdout:1/420: stat d1e/d20/f6b 0 2024-04-26T10:44:30.151 INFO:tasks.workunit.client.0.smithi049.stdout:8/489: mkdir d2/d1a/d9c 0 2024-04-26T10:44:30.151 INFO:tasks.workunit.client.0.smithi049.stdout:9/559: dwrite d2/d1a/fd [0,4194304] 0 2024-04-26T10:44:30.151 INFO:tasks.workunit.client.0.smithi049.stdout:4/539: mkdir de/d1b/d5e/da2 0 2024-04-26T10:44:30.151 INFO:tasks.workunit.client.0.smithi049.stdout:8/490: creat d2/df/d10/f9d x:0 0 0 2024-04-26T10:44:30.151 INFO:tasks.workunit.client.0.smithi049.stdout:2/444: dread d6/d9/f52 [0,4194304] 0 2024-04-26T10:44:30.151 INFO:tasks.workunit.client.0.smithi049.stdout:7/473: mknod d2/dd/d7f/c99 0 2024-04-26T10:44:30.152 INFO:tasks.workunit.client.0.smithi049.stdout:9/560: chown d2/d40/c6a 17 1 2024-04-26T10:44:30.152 INFO:tasks.workunit.client.0.smithi049.stdout:0/455: write d8/db/d11/f65 [1359559,14067] 0 2024-04-26T10:44:30.152 INFO:tasks.workunit.client.0.smithi049.stdout:0/456: chown d8/d42/f6c 28639 1 2024-04-26T10:44:30.152 INFO:tasks.workunit.client.0.smithi049.stdout:4/540: link de/d1b/f92 de/d1b/d5e/d72/d73/d84/d4b/fa3 0 2024-04-26T10:44:30.152 INFO:tasks.workunit.client.0.smithi049.stdout:3/406: dread d3/d23/d2f/d6a/d6b/d8/d55/d46/f4a [0,4194304] 0 2024-04-26T10:44:30.152 INFO:tasks.workunit.client.0.smithi049.stdout:4/541: chown de/d1b/d5e/d72/d73/d84/d38/f3b 2 1 2024-04-26T10:44:30.152 INFO:tasks.workunit.client.0.smithi049.stdout:8/491: dwrite d2/df/d10/d23/f31 [0,4194304] 0 2024-04-26T10:44:30.152 INFO:tasks.workunit.client.0.smithi049.stdout:9/561: dwrite d2/d25/fa1 [0,4194304] 0 2024-04-26T10:44:30.152 INFO:tasks.workunit.client.0.smithi049.stdout:3/407: rename d3/d23/d2f to d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/d91 22 2024-04-26T10:44:30.152 INFO:tasks.workunit.client.0.smithi049.stdout:4/542: mkdir de/d1b/d5e/d72/d73/d84/d4b/da4 0 2024-04-26T10:44:30.153 INFO:tasks.workunit.client.0.smithi049.stdout:8/492: mknod d2/d17/d34/d40/d7f/c9e 0 2024-04-26T10:44:30.155 INFO:tasks.workunit.client.0.smithi049.stdout:9/562: dread d2/d25/fa1 [0,4194304] 0 2024-04-26T10:44:30.157 INFO:tasks.workunit.client.0.smithi049.stdout:8/493: write d2/df/d10/f13 [1558611,83987] 0 2024-04-26T10:44:30.158 INFO:tasks.workunit.client.0.smithi049.stdout:3/408: dwrite d3/d23/d2f/d6a/d6b/d26/d58/f7b [0,4194304] 0 2024-04-26T10:44:30.159 INFO:tasks.workunit.client.0.smithi049.stdout:8/494: readlink d2/d1a/l53 0 2024-04-26T10:44:30.159 INFO:tasks.workunit.client.0.smithi049.stdout:5/476: dread d7/fc [0,4194304] 0 2024-04-26T10:44:30.160 INFO:tasks.workunit.client.0.smithi049.stdout:4/543: dwrite de/d1b/d5e/d72/d73/d84/d4b/d76/f97 [0,4194304] 0 2024-04-26T10:44:30.160 INFO:tasks.workunit.client.0.smithi049.stdout:5/477: fsync d7/d14/f38 0 2024-04-26T10:44:30.160 INFO:tasks.workunit.client.0.smithi049.stdout:8/495: dread - d2/d17/d34/d40/f71 zero size 2024-04-26T10:44:30.161 INFO:tasks.workunit.client.0.smithi049.stdout:3/409: chown d3/d23/d2f/d6a/d6b/d8/d55/l2c 14206 1 2024-04-26T10:44:30.161 INFO:tasks.workunit.client.0.smithi049.stdout:5/478: fsync d7/d1d/d1f/d4e/d65/fa1 0 2024-04-26T10:44:30.161 INFO:tasks.workunit.client.0.smithi049.stdout:8/496: mkdir d2/d89/d2a/d9f 0 2024-04-26T10:44:30.162 INFO:tasks.workunit.client.0.smithi049.stdout:3/410: dread - d3/d23/d2f/d6a/d6b/d26/f86 zero size 2024-04-26T10:44:30.162 INFO:tasks.workunit.client.0.smithi049.stdout:4/544: rename de/d1b/d5e/d72/d73/d84/d4b/d76 to de/d3f/d52/d9b/da5 0 2024-04-26T10:44:30.163 INFO:tasks.workunit.client.0.smithi049.stdout:5/479: fsync d7/d1d/d1f/d4e/d77/f93 0 2024-04-26T10:44:30.163 INFO:tasks.workunit.client.0.smithi049.stdout:7/474: sync 2024-04-26T10:44:30.163 INFO:tasks.workunit.client.0.smithi049.stdout:2/445: sync 2024-04-26T10:44:30.163 INFO:tasks.workunit.client.0.smithi049.stdout:1/421: sync 2024-04-26T10:44:30.164 INFO:tasks.workunit.client.0.smithi049.stdout:5/480: creat d7/d1d/d1f/d4e/fc3 x:0 0 0 2024-04-26T10:44:30.164 INFO:tasks.workunit.client.0.smithi049.stdout:4/545: mkdir de/d3f/d52/da6 0 2024-04-26T10:44:30.164 INFO:tasks.workunit.client.0.smithi049.stdout:1/422: rmdir d1e/d20/d26/d37/d69/d75 39 2024-04-26T10:44:30.165 INFO:tasks.workunit.client.0.smithi049.stdout:7/475: unlink d2/dd/d25/d27/l60 0 2024-04-26T10:44:30.165 INFO:tasks.workunit.client.0.smithi049.stdout:5/481: creat d7/d53/fc4 x:0 0 0 2024-04-26T10:44:30.166 INFO:tasks.workunit.client.0.smithi049.stdout:7/476: stat d2/dd/d25/l2e 0 2024-04-26T10:44:30.167 INFO:tasks.workunit.client.0.smithi049.stdout:3/411: rename d3/d23/d2f/d6a/d6b/d26/d29/l77 to d3/d23/d2f/d6a/d6b/d26/d65/d70/d84/l92 0 2024-04-26T10:44:30.169 INFO:tasks.workunit.client.0.smithi049.stdout:4/546: getdents de/d1b/d5e/d90 0 2024-04-26T10:44:30.169 INFO:tasks.workunit.client.0.smithi049.stdout:9/563: dread d2/d25/fa3 [0,4194304] 0 2024-04-26T10:44:30.169 INFO:tasks.workunit.client.0.smithi049.stdout:6/469: dread da/dd/f5c [0,4194304] 0 2024-04-26T10:44:30.169 INFO:tasks.workunit.client.0.smithi049.stdout:7/477: mknod d2/d3/de/c9a 0 2024-04-26T10:44:30.171 INFO:tasks.workunit.client.0.smithi049.stdout:8/497: dwrite d2/df/d10/f66 [0,4194304] 0 2024-04-26T10:44:30.173 INFO:tasks.workunit.client.0.smithi049.stdout:4/547: rmdir de/d3f/d52/d9b/da5 39 2024-04-26T10:44:30.174 INFO:tasks.workunit.client.0.smithi049.stdout:7/478: creat d2/d3/de/d1c/f9b x:0 0 0 2024-04-26T10:44:30.174 INFO:tasks.workunit.client.0.smithi049.stdout:1/423: dwrite d1e/d20/d4d/f60 [0,4194304] 0 2024-04-26T10:44:30.175 INFO:tasks.workunit.client.0.smithi049.stdout:0/457: dread d8/db/d11/d1c/f47 [0,4194304] 0 2024-04-26T10:44:30.175 INFO:tasks.workunit.client.0.smithi049.stdout:8/498: mknod d2/d16/d19/d42/d7c/ca0 0 2024-04-26T10:44:30.176 INFO:tasks.workunit.client.0.smithi049.stdout:5/482: dwrite d7/d1d/d1f/f9a [0,4194304] 0 2024-04-26T10:44:30.176 INFO:tasks.workunit.client.0.smithi049.stdout:7/479: symlink d2/dd/d7f/l9c 0 2024-04-26T10:44:30.177 INFO:tasks.workunit.client.0.smithi049.stdout:1/424: mknod d1e/c81 0 2024-04-26T10:44:30.177 INFO:tasks.workunit.client.0.smithi049.stdout:0/458: read d8/d1e/f2b [2912925,114821] 0 2024-04-26T10:44:30.177 INFO:tasks.workunit.client.0.smithi049.stdout:4/548: write de/d1b/d5e/d72/d73/d84/f8c [462891,49541] 0 2024-04-26T10:44:30.179 INFO:tasks.workunit.client.0.smithi049.stdout:1/425: mkdir d1e/d82 0 2024-04-26T10:44:30.179 INFO:tasks.workunit.client.0.smithi049.stdout:8/499: rename d2/df/d10/d23/f6e to d2/df/fa1 0 2024-04-26T10:44:30.179 INFO:tasks.workunit.client.0.smithi049.stdout:7/480: creat d2/dd/d48/d5c/f9d x:0 0 0 2024-04-26T10:44:30.179 INFO:tasks.workunit.client.0.smithi049.stdout:0/459: readlink d8/db/d26/d39/l4f 0 2024-04-26T10:44:30.179 INFO:tasks.workunit.client.0.smithi049.stdout:5/483: creat d7/d1d/d1f/d4e/dad/db3/fc5 x:0 0 0 2024-04-26T10:44:30.180 INFO:tasks.workunit.client.0.smithi049.stdout:6/470: dwrite da/dd/de/d11/f3e [4194304,4194304] 0 2024-04-26T10:44:30.181 INFO:tasks.workunit.client.0.smithi049.stdout:8/500: write d2/f2f [1952262,44567] 0 2024-04-26T10:44:30.181 INFO:tasks.workunit.client.0.smithi049.stdout:5/484: mkdir d7/dc6 0 2024-04-26T10:44:30.181 INFO:tasks.workunit.client.0.smithi049.stdout:7/481: creat d2/dd/d45/f9e x:0 0 0 2024-04-26T10:44:30.182 INFO:tasks.workunit.client.0.smithi049.stdout:0/460: symlink d8/d1e/d98/l9f 0 2024-04-26T10:44:30.182 INFO:tasks.workunit.client.0.smithi049.stdout:5/485: symlink d7/d1d/d20/lc7 0 2024-04-26T10:44:30.182 INFO:tasks.workunit.client.0.smithi049.stdout:8/501: write d2/fe [586111,12110] 0 2024-04-26T10:44:30.182 INFO:tasks.workunit.client.0.smithi049.stdout:7/482: readlink d2/dd/d25/l28 0 2024-04-26T10:44:30.183 INFO:tasks.workunit.client.0.smithi049.stdout:6/471: write da/f32 [2747845,104273] 0 2024-04-26T10:44:30.183 INFO:tasks.workunit.client.0.smithi049.stdout:4/549: rename de/d1b/d5e/d72/d73/d84/f25 to de/d3f/d52/d9b/fa7 0 2024-04-26T10:44:30.183 INFO:tasks.workunit.client.0.smithi049.stdout:8/502: chown d2/d17/d34 2 1 2024-04-26T10:44:30.184 INFO:tasks.workunit.client.0.smithi049.stdout:7/483: read d2/dd/f26 [1148419,71436] 0 2024-04-26T10:44:30.184 INFO:tasks.workunit.client.0.smithi049.stdout:8/503: stat d2/d16/l82 0 2024-04-26T10:44:30.185 INFO:tasks.workunit.client.0.smithi049.stdout:7/484: chown d2/dd/d25/f81 197694 1 2024-04-26T10:44:30.185 INFO:tasks.workunit.client.0.smithi049.stdout:8/504: write d2/d16/f8e [523116,123732] 0 2024-04-26T10:44:30.186 INFO:tasks.workunit.client.0.smithi049.stdout:0/461: getdents d8/db/d11/d1b/d4d 0 2024-04-26T10:44:30.187 INFO:tasks.workunit.client.0.smithi049.stdout:7/485: symlink d2/dd/d48/d5c/l9f 0 2024-04-26T10:44:30.187 INFO:tasks.workunit.client.0.smithi049.stdout:0/462: chown f2 21049598 1 2024-04-26T10:44:30.187 INFO:tasks.workunit.client.0.smithi049.stdout:0/463: readlink d8/db/l3e 0 2024-04-26T10:44:30.188 INFO:tasks.workunit.client.0.smithi049.stdout:2/446: dwrite f4 [0,4194304] 0 2024-04-26T10:44:30.188 INFO:tasks.workunit.client.0.smithi049.stdout:8/505: link d2/d17/c43 d2/df/d10/d47/ca2 0 2024-04-26T10:44:30.188 INFO:tasks.workunit.client.0.smithi049.stdout:0/464: chown d8/d1e/f72 12304874 1 2024-04-26T10:44:30.189 INFO:tasks.workunit.client.0.smithi049.stdout:2/447: mknod d6/d32/d69/c83 0 2024-04-26T10:44:30.190 INFO:tasks.workunit.client.0.smithi049.stdout:8/506: mknod d2/d17/ca3 0 2024-04-26T10:44:30.190 INFO:tasks.workunit.client.0.smithi049.stdout:5/486: write f3 [582733,72132] 0 2024-04-26T10:44:30.190 INFO:tasks.workunit.client.0.smithi049.stdout:7/486: dread d2/dd/d38/f3d [0,4194304] 0 2024-04-26T10:44:30.190 INFO:tasks.workunit.client.0.smithi049.stdout:0/465: truncate d8/db/d26/f97 202985 0 2024-04-26T10:44:30.191 INFO:tasks.workunit.client.0.smithi049.stdout:2/448: write d6/d9/db/df/f12 [1675839,98007] 0 2024-04-26T10:44:30.191 INFO:tasks.workunit.client.0.smithi049.stdout:5/487: symlink d7/d1d/d1f/d4e/d80/lc8 0 2024-04-26T10:44:30.192 INFO:tasks.workunit.client.0.smithi049.stdout:2/449: fsync d6/d9/db/f24 0 2024-04-26T10:44:30.192 INFO:tasks.workunit.client.0.smithi049.stdout:8/507: rename d2/d89/d2a/f48 to d2/df/d10/d23/d6c/d5e/fa4 0 2024-04-26T10:44:30.192 INFO:tasks.workunit.client.0.smithi049.stdout:0/466: getdents d8/db/d93 0 2024-04-26T10:44:30.192 INFO:tasks.workunit.client.0.smithi049.stdout:5/488: write d7/d1d/d20/fa8 [14819,103532] 0 2024-04-26T10:44:30.192 INFO:tasks.workunit.client.0.smithi049.stdout:2/450: creat d6/f84 x:0 0 0 2024-04-26T10:44:30.193 INFO:tasks.workunit.client.0.smithi049.stdout:8/508: creat d2/d1a/fa5 x:0 0 0 2024-04-26T10:44:30.194 INFO:tasks.workunit.client.0.smithi049.stdout:8/509: fsync f1 0 2024-04-26T10:44:30.194 INFO:tasks.workunit.client.0.smithi049.stdout:0/467: getdents d8/db/d11/d1b/d4d 0 2024-04-26T10:44:30.194 INFO:tasks.workunit.client.0.smithi049.stdout:4/550: truncate de/d3f/d52/d9b/da5/f97 3492562 0 2024-04-26T10:44:30.195 INFO:tasks.workunit.client.0.smithi049.stdout:4/551: readlink de/d1b/l3e 0 2024-04-26T10:44:30.195 INFO:tasks.workunit.client.0.smithi049.stdout:0/468: creat d8/db/fa0 x:0 0 0 2024-04-26T10:44:30.195 INFO:tasks.workunit.client.0.smithi049.stdout:8/510: link d2/d16/f2e d2/d17/d34/d40/d7f/fa6 0 2024-04-26T10:44:30.196 INFO:tasks.workunit.client.0.smithi049.stdout:0/469: rename d8/db/d11/d1b/f4a to d8/db/d93/d96/fa1 0 2024-04-26T10:44:30.196 INFO:tasks.workunit.client.0.smithi049.stdout:8/511: getdents d2/d89 0 2024-04-26T10:44:30.196 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:30.195+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:30.198 INFO:tasks.workunit.client.0.smithi049.stdout:0/470: link d8/db/d11/c7c d8/d41/ca2 0 2024-04-26T10:44:30.199 INFO:tasks.workunit.client.0.smithi049.stdout:0/471: write d8/db/d11/d1b/d4d/f64 [1502654,121163] 0 2024-04-26T10:44:30.200 INFO:tasks.workunit.client.0.smithi049.stdout:4/552: dwrite de/d1b/d5e/d72/d73/d84/d38/f46 [0,4194304] 0 2024-04-26T10:44:30.200 INFO:tasks.workunit.client.0.smithi049.stdout:0/472: dread - d8/db/d26/d39/f99 zero size 2024-04-26T10:44:30.202 INFO:tasks.workunit.client.0.smithi049.stdout:0/473: mknod d8/db/d11/d1b/ca3 0 2024-04-26T10:44:30.202 INFO:tasks.workunit.client.0.smithi049.stdout:4/553: write de/d1b/d5e/d72/d73/d84/d24/f61 [2026428,5646] 0 2024-04-26T10:44:30.202 INFO:tasks.workunit.client.0.smithi049.stdout:4/554: sync 2024-04-26T10:44:30.202 INFO:tasks.workunit.client.0.smithi049.stdout:0/474: rmdir d8/db/d26/d39 39 2024-04-26T10:44:30.203 INFO:tasks.workunit.client.0.smithi049.stdout:7/487: rmdir d2/dd/d48 39 2024-04-26T10:44:30.205 INFO:tasks.workunit.client.0.smithi049.stdout:2/451: truncate d6/d9/f52 2421255 0 2024-04-26T10:44:30.205 INFO:tasks.workunit.client.0.smithi049.stdout:5/489: truncate d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d60/f7a 2206844 0 2024-04-26T10:44:30.205 INFO:tasks.workunit.client.0.smithi049.stdout:0/475: rename d8/f9 to d8/db/d26/d39/fa4 0 2024-04-26T10:44:30.206 INFO:tasks.workunit.client.0.smithi049.stdout:4/555: getdents de/d1b/d5e/d72/d73/d84/d4b/da4 0 2024-04-26T10:44:30.207 INFO:tasks.workunit.client.0.smithi049.stdout:7/488: creat d2/fa0 x:0 0 0 2024-04-26T10:44:30.207 INFO:tasks.workunit.client.0.smithi049.stdout:2/452: symlink d6/d9/l85 0 2024-04-26T10:44:30.207 INFO:tasks.workunit.client.0.smithi049.stdout:5/490: symlink d7/d1d/lc9 0 2024-04-26T10:44:30.207 INFO:tasks.workunit.client.0.smithi049.stdout:4/556: unlink de/c21 0 2024-04-26T10:44:30.207 INFO:tasks.workunit.client.0.smithi049.stdout:7/489: creat d2/dd/d38/fa1 x:0 0 0 2024-04-26T10:44:30.208 INFO:tasks.workunit.client.0.smithi049.stdout:5/491: rename d7/d66/l9c to d7/d1d/d1f/d4e/da0/lca 0 2024-04-26T10:44:30.209 INFO:tasks.workunit.client.0.smithi049.stdout:7/490: fdatasync d2/d3/f56 0 2024-04-26T10:44:30.209 INFO:tasks.workunit.client.0.smithi049.stdout:2/453: dread f5 [0,4194304] 0 2024-04-26T10:44:30.209 INFO:tasks.workunit.client.0.smithi049.stdout:7/491: symlink d2/dd/d38/la2 0 2024-04-26T10:44:30.210 INFO:tasks.workunit.client.0.smithi049.stdout:5/492: symlink d7/d1d/d1f/d22/lcb 0 2024-04-26T10:44:30.211 INFO:tasks.workunit.client.0.smithi049.stdout:7/492: mkdir d2/dd/d48/da3 0 2024-04-26T10:44:30.212 INFO:tasks.workunit.client.0.smithi049.stdout:2/454: rmdir d6/d9/db/d34/d38/d73/d82 0 2024-04-26T10:44:30.212 INFO:tasks.workunit.client.0.smithi049.stdout:0/476: dwrite d8/db/d26/d39/f58 [0,4194304] 0 2024-04-26T10:44:30.213 INFO:tasks.workunit.client.0.smithi049.stdout:7/493: write d2/fc [355306,37659] 0 2024-04-26T10:44:30.214 INFO:tasks.workunit.client.0.smithi049.stdout:0/477: chown d8/db/l3e 1040313234 1 2024-04-26T10:44:30.215 INFO:tasks.workunit.client.0.smithi049.stdout:7/494: write d2/f53 [3082701,39635] 0 2024-04-26T10:44:30.215 INFO:tasks.workunit.client.0.smithi049.stdout:0/478: mkdir d8/da5 0 2024-04-26T10:44:30.215 INFO:tasks.workunit.client.0.smithi049.stdout:7/495: dread - d2/f8c zero size 2024-04-26T10:44:30.216 INFO:tasks.workunit.client.0.smithi049.stdout:2/455: rename d6/d9/db/d34/f50 to d6/d9/db/d34/d38/d3f/d60/f86 0 2024-04-26T10:44:30.217 INFO:tasks.workunit.client.0.smithi049.stdout:0/479: creat d8/db/d11/fa6 x:0 0 0 2024-04-26T10:44:30.217 INFO:tasks.workunit.client.0.smithi049.stdout:7/496: write d2/dd/f12 [732189,87937] 0 2024-04-26T10:44:30.219 INFO:tasks.workunit.client.0.smithi049.stdout:0/480: fdatasync d8/db/d11/d1c/f5b 0 2024-04-26T10:44:30.219 INFO:tasks.workunit.client.0.smithi049.stdout:5/493: dwrite d7/d1d/f30 [0,4194304] 0 2024-04-26T10:44:30.219 INFO:tasks.workunit.client.0.smithi049.stdout:7/497: fsync d2/d3/f3c 0 2024-04-26T10:44:30.219 INFO:tasks.workunit.client.0.smithi049.stdout:0/481: chown d8/f3d 7259624 1 2024-04-26T10:44:30.220 INFO:tasks.workunit.client.0.smithi049.stdout:7/498: chown d2/dd/f26 0 1 2024-04-26T10:44:30.221 INFO:tasks.workunit.client.0.smithi049.stdout:5/494: write d7/d1d/d1f/d4e/d65/d6f/d91/fae [303058,102283] 0 2024-04-26T10:44:30.221 INFO:tasks.workunit.client.0.smithi049.stdout:7/499: creat d2/dd/d25/fa4 x:0 0 0 2024-04-26T10:44:30.223 INFO:tasks.workunit.client.0.smithi049.stdout:7/500: mkdir d2/dd/d45/da5 0 2024-04-26T10:44:30.223 INFO:tasks.workunit.client.0.smithi049.stdout:5/495: rename d7/d1d/d1f/d4e/d65/d6f/d91/d3e/db5 to d7/d1d/d1f/d4e/dad/db3/dcc 0 2024-04-26T10:44:30.223 INFO:tasks.workunit.client.0.smithi049.stdout:7/501: creat d2/dd/d25/d27/fa6 x:0 0 0 2024-04-26T10:44:30.224 INFO:tasks.workunit.client.0.smithi049.stdout:4/557: dread de/d1b/f34 [4194304,4194304] 0 2024-04-26T10:44:30.225 INFO:tasks.workunit.client.0.smithi049.stdout:5/496: dread d7/d1d/d1f/f29 [0,4194304] 0 2024-04-26T10:44:30.225 INFO:tasks.workunit.client.0.smithi049.stdout:7/502: unlink d2/dd/d48/d5c/f98 0 2024-04-26T10:44:30.226 INFO:tasks.workunit.client.0.smithi049.stdout:4/558: mknod de/d3f/d52/da6/ca8 0 2024-04-26T10:44:30.226 INFO:tasks.workunit.client.0.smithi049.stdout:0/482: dwrite d8/db/d11/d1c/f47 [0,4194304] 0 2024-04-26T10:44:30.226 INFO:tasks.workunit.client.0.smithi049.stdout:3/412: dread d3/d23/d2f/d6a/d6b/d8/f32 [0,4194304] 0 2024-04-26T10:44:30.226 INFO:tasks.workunit.client.0.smithi049.stdout:7/503: readlink d2/dd/d48/d5c/l76 0 2024-04-26T10:44:30.227 INFO:tasks.workunit.client.0.smithi049.stdout:0/483: chown d8/db/d11/d1c 0 1 2024-04-26T10:44:30.228 INFO:tasks.workunit.client.0.smithi049.stdout:8/512: dread d2/df/d10/d23/d6c/d5e/fa4 [0,4194304] 0 2024-04-26T10:44:30.228 INFO:tasks.workunit.client.0.smithi049.stdout:7/504: dread - d2/d3/de/d1c/f90 zero size 2024-04-26T10:44:30.229 INFO:tasks.workunit.client.0.smithi049.stdout:1/426: dread fe [0,4194304] 0 2024-04-26T10:44:30.230 INFO:tasks.workunit.client.0.smithi049.stdout:0/484: mknod d8/d1e/d98/ca7 0 2024-04-26T10:44:30.230 INFO:tasks.workunit.client.0.smithi049.stdout:1/427: chown d1e/f72 237272 1 2024-04-26T10:44:30.231 INFO:tasks.workunit.client.0.smithi049.stdout:4/559: creat de/d1b/d5e/da2/fa9 x:0 0 0 2024-04-26T10:44:30.231 INFO:tasks.workunit.client.0.smithi049.stdout:7/505: symlink d2/dd/d45/la7 0 2024-04-26T10:44:30.231 INFO:tasks.workunit.client.0.smithi049.stdout:4/560: fdatasync de/f8d 0 2024-04-26T10:44:30.231 INFO:tasks.workunit.client.0.smithi049.stdout:0/485: read - d8/db/d11/d1c/f48 zero size 2024-04-26T10:44:30.232 INFO:tasks.workunit.client.0.smithi049.stdout:1/428: stat d1e/d20/d4d/d70/c7f 0 2024-04-26T10:44:30.234 INFO:tasks.workunit.client.0.smithi049.stdout:4/561: unlink de/d1d/l8f 0 2024-04-26T10:44:30.238 INFO:tasks.workunit.client.0.smithi049.stdout:5/497: dwrite d7/d66/f73 [0,4194304] 0 2024-04-26T10:44:30.238 INFO:tasks.workunit.client.0.smithi049.stdout:9/564: dread d2/d1a/d1b/d1f/d64/fa2 [0,4194304] 0 2024-04-26T10:44:30.238 INFO:tasks.workunit.client.0.smithi049.stdout:0/486: creat d8/db/d11/d1b/fa8 x:0 0 0 2024-04-26T10:44:30.238 INFO:tasks.workunit.client.0.smithi049.stdout:3/413: dwrite d3/f56 [0,4194304] 0 2024-04-26T10:44:30.238 INFO:tasks.workunit.client.0.smithi049.stdout:6/472: dread f9 [0,4194304] 0 2024-04-26T10:44:30.239 INFO:tasks.workunit.client.0.smithi049.stdout:1/429: symlink d1e/d20/d26/d3c/d54/d59/l83 0 2024-04-26T10:44:30.239 INFO:tasks.workunit.client.0.smithi049.stdout:4/562: creat de/d1b/d5e/da2/faa x:0 0 0 2024-04-26T10:44:30.239 INFO:tasks.workunit.client.0.smithi049.stdout:5/498: symlink d7/d53/lcd 0 2024-04-26T10:44:30.239 INFO:tasks.workunit.client.0.smithi049.stdout:3/414: symlink d3/l93 0 2024-04-26T10:44:30.239 INFO:tasks.workunit.client.0.smithi049.stdout:9/565: truncate d2/d1a/d1b/d1f/f3d 2425786 0 2024-04-26T10:44:30.241 INFO:tasks.workunit.client.0.smithi049.stdout:0/487: link d8/l14 d8/d66/d84/la9 0 2024-04-26T10:44:30.241 INFO:tasks.workunit.client.0.smithi049.stdout:5/499: write d7/d1d/d20/fa4 [3400382,82861] 0 2024-04-26T10:44:30.241 INFO:tasks.workunit.client.0.smithi049.stdout:9/566: stat d2/d1a/df/c17 0 2024-04-26T10:44:30.241 INFO:tasks.workunit.client.0.smithi049.stdout:3/415: creat d3/d23/d2f/d6a/d6b/d8/d55/d46/f94 x:0 0 0 2024-04-26T10:44:30.241 INFO:tasks.workunit.client.0.smithi049.stdout:6/473: mkdir da/dd/d62/d9d/d9e 0 2024-04-26T10:44:30.241 INFO:tasks.workunit.client.0.smithi049.stdout:8/513: dwrite d2/df/d10/d47/f99 [0,4194304] 0 2024-04-26T10:44:30.241 INFO:tasks.workunit.client.0.smithi049.stdout:4/563: chown de/d1b/d5e/d72/d73/d84/d4b/l74 11 1 2024-04-26T10:44:30.243 INFO:tasks.workunit.client.0.smithi049.stdout:6/474: unlink f1 0 2024-04-26T10:44:30.244 INFO:tasks.workunit.client.0.smithi049.stdout:0/488: mknod d8/db/d93/caa 0 2024-04-26T10:44:30.244 INFO:tasks.workunit.client.0.smithi049.stdout:8/514: creat d2/d89/d2a/d9f/fa7 x:0 0 0 2024-04-26T10:44:30.244 INFO:tasks.workunit.client.0.smithi049.stdout:6/475: creat da/dd/f9f x:0 0 0 2024-04-26T10:44:30.245 INFO:tasks.workunit.client.0.smithi049.stdout:8/515: creat d2/d17/fa8 x:0 0 0 2024-04-26T10:44:30.245 INFO:tasks.workunit.client.0.smithi049.stdout:4/564: truncate de/d1b/d5e/d72/d73/d84/f60 1005240 0 2024-04-26T10:44:30.247 INFO:tasks.workunit.client.0.smithi049.stdout:0/489: link d8/db/d93/caa d8/db/d93/d96/cab 0 2024-04-26T10:44:30.247 INFO:tasks.workunit.client.0.smithi049.stdout:1/430: dwrite d1e/d20/f41 [0,4194304] 0 2024-04-26T10:44:30.247 INFO:tasks.workunit.client.0.smithi049.stdout:3/416: link d3/d23/d2f/d6a/d6b/d26/d29/c66 d3/d23/d2f/d6a/d6b/d8/d87/c95 0 2024-04-26T10:44:30.248 INFO:tasks.workunit.client.0.smithi049.stdout:9/567: dread d2/d1a/d1b/d1f/d64/fa2 [0,4194304] 0 2024-04-26T10:44:30.249 INFO:tasks.workunit.client.0.smithi049.stdout:8/516: truncate d2/df/d10/d23/f5f 151209 0 2024-04-26T10:44:30.250 INFO:tasks.workunit.client.0.smithi049.stdout:3/417: stat d3/d23/d2f/d6a/d6b/d26/c59 0 2024-04-26T10:44:30.251 INFO:tasks.workunit.client.0.smithi049.stdout:8/517: rename d2/f6 to d2/d89/fa9 0 2024-04-26T10:44:30.251 INFO:tasks.workunit.client.0.smithi049.stdout:9/568: symlink d2/d1a/d1b/d7a/lb4 0 2024-04-26T10:44:30.254 INFO:tasks.workunit.client.0.smithi049.stdout:8/518: truncate d2/d16/f8e 1473539 0 2024-04-26T10:44:30.254 INFO:tasks.workunit.client.0.smithi049.stdout:5/500: truncate d7/d1d/d1f/d4e/dad/fb7 476900 0 2024-04-26T10:44:30.254 INFO:tasks.workunit.client.0.smithi049.stdout:4/565: dwrite de/d1d/f78 [0,4194304] 0 2024-04-26T10:44:30.255 INFO:tasks.workunit.client.0.smithi049.stdout:1/431: truncate fd 3334505 0 2024-04-26T10:44:30.255 INFO:tasks.workunit.client.0.smithi049.stdout:8/519: fdatasync d2/df/f5a 0 2024-04-26T10:44:30.256 INFO:tasks.workunit.client.0.smithi049.stdout:0/490: dwrite d8/db/d11/f83 [4194304,4194304] 0 2024-04-26T10:44:30.258 INFO:tasks.workunit.client.0.smithi049.stdout:8/520: fdatasync d2/d17/f97 0 2024-04-26T10:44:30.258 INFO:tasks.workunit.client.0.smithi049.stdout:1/432: mknod d1e/d20/d26/d37/c84 0 2024-04-26T10:44:30.258 INFO:tasks.workunit.client.0.smithi049.stdout:5/501: mknod d7/d1d/d1f/d4e/d65/d6f/d91/cce 0 2024-04-26T10:44:30.258 INFO:tasks.workunit.client.0.smithi049.stdout:0/491: fsync d8/db/d26/f7b 0 2024-04-26T10:44:30.261 INFO:tasks.workunit.client.0.smithi049.stdout:1/433: dread - d1e/d20/d26/d3c/f7b zero size 2024-04-26T10:44:30.261 INFO:tasks.workunit.client.0.smithi049.stdout:8/521: fdatasync d2/d17/d34/d40/f71 0 2024-04-26T10:44:30.261 INFO:tasks.workunit.client.0.smithi049.stdout:1/434: sync 2024-04-26T10:44:30.262 INFO:tasks.workunit.client.0.smithi049.stdout:9/569: dwrite d2/d1a/fac [0,4194304] 0 2024-04-26T10:44:30.262 INFO:tasks.workunit.client.0.smithi049.stdout:3/418: dwrite d3/d23/d2f/d6a/d6b/d8/d55/f2d [0,4194304] 0 2024-04-26T10:44:30.262 INFO:tasks.workunit.client.0.smithi049.stdout:6/476: dwrite da/d4a/f37 [0,4194304] 0 2024-04-26T10:44:30.262 INFO:tasks.workunit.client.0.smithi049.stdout:5/502: stat d7/d1d/d1f/d4e/d65/d6f/d91/c3d 0 2024-04-26T10:44:30.263 INFO:tasks.workunit.client.0.smithi049.stdout:7/506: dread d2/dd/d25/d27/f57 [0,4194304] 0 2024-04-26T10:44:30.264 INFO:tasks.workunit.client.0.smithi049.stdout:8/522: creat d2/df/d10/d47/faa x:0 0 0 2024-04-26T10:44:30.265 INFO:tasks.workunit.client.0.smithi049.stdout:3/419: mkdir d3/d23/d2f/d6a/d6b/d26/d65/d70/d96 0 2024-04-26T10:44:30.268 INFO:tasks.workunit.client.0.smithi049.stdout:4/566: read de/d1b/f40 [909449,78063] 0 2024-04-26T10:44:30.268 INFO:tasks.workunit.client.0.smithi049.stdout:7/507: symlink d2/dd/d7f/la8 0 2024-04-26T10:44:30.268 INFO:tasks.workunit.client.0.smithi049.stdout:9/570: truncate d2/d40/f78 952353 0 2024-04-26T10:44:30.269 INFO:tasks.workunit.client.0.smithi049.stdout:8/523: mkdir d2/df/dab 0 2024-04-26T10:44:30.269 INFO:tasks.workunit.client.0.smithi049.stdout:7/508: stat d2/dd/d48/l86 0 2024-04-26T10:44:30.271 INFO:tasks.workunit.client.0.smithi049.stdout:4/567: mkdir de/d1b/d5e/d72/d73/dab 0 2024-04-26T10:44:30.271 INFO:tasks.workunit.client.0.smithi049.stdout:6/477: creat da/dd/de/fa0 x:0 0 0 2024-04-26T10:44:30.271 INFO:tasks.workunit.client.0.smithi049.stdout:5/503: link d7/d14/d18/d2b/c4c d7/d1d/d34/ccf 0 2024-04-26T10:44:30.271 INFO:tasks.workunit.client.0.smithi049.stdout:2/456: dread d6/f64 [0,4194304] 0 2024-04-26T10:44:30.271 INFO:tasks.workunit.client.0.smithi049.stdout:9/571: write d2/d1a/d1b/d1f/f3d [1819819,92862] 0 2024-04-26T10:44:30.271 INFO:tasks.workunit.client.0.smithi049.stdout:7/509: chown d2/dd/c84 605250 1 2024-04-26T10:44:30.271 INFO:tasks.workunit.client.0.smithi049.stdout:0/492: dwrite d8/db/d26/d39/f99 [0,4194304] 0 2024-04-26T10:44:30.272 INFO:tasks.workunit.client.0.smithi049.stdout:8/524: symlink d2/d16/d19/lac 0 2024-04-26T10:44:30.272 INFO:tasks.workunit.client.0.smithi049.stdout:2/457: write d6/d9/db/f24 [3874685,28762] 0 2024-04-26T10:44:30.273 INFO:tasks.workunit.client.0.smithi049.stdout:2/458: chown d6/d9 15217055 1 2024-04-26T10:44:30.273 INFO:tasks.workunit.client.0.smithi049.stdout:9/572: creat d2/d1a/d1b/d7a/fb5 x:0 0 0 2024-04-26T10:44:30.273 INFO:tasks.workunit.client.0.smithi049.stdout:5/504: chown d7/d1d/d1f/d4e/d65/d6f/d91/f4a 393962 1 2024-04-26T10:44:30.274 INFO:tasks.workunit.client.0.smithi049.stdout:0/493: stat d8/db/d93/d96/fa1 0 2024-04-26T10:44:30.274 INFO:tasks.workunit.client.0.smithi049.stdout:6/478: mkdir da/dd/de/d26/da1 0 2024-04-26T10:44:30.274 INFO:tasks.workunit.client.0.smithi049.stdout:7/510: creat d2/d3/de/d1c/fa9 x:0 0 0 2024-04-26T10:44:30.274 INFO:tasks.workunit.client.0.smithi049.stdout:9/573: readlink d2/l46 0 2024-04-26T10:44:30.274 INFO:tasks.workunit.client.0.smithi049.stdout:8/525: write d2/d17/d34/f68 [78532,126347] 0 2024-04-26T10:44:30.275 INFO:tasks.workunit.client.0.smithi049.stdout:7/511: dread - d2/dd/d48/f59 zero size 2024-04-26T10:44:30.275 INFO:tasks.workunit.client.0.smithi049.stdout:3/420: dread d3/d23/d2f/d6a/d6b/d26/d58/f81 [0,4194304] 0 2024-04-26T10:44:30.275 INFO:tasks.workunit.client.0.smithi049.stdout:2/459: creat d6/d32/f87 x:0 0 0 2024-04-26T10:44:30.275 INFO:tasks.workunit.client.0.smithi049.stdout:0/494: rename d8/db/l3e to d8/d66/lac 0 2024-04-26T10:44:30.276 INFO:tasks.workunit.client.0.smithi049.stdout:7/512: dread - d2/fa0 zero size 2024-04-26T10:44:30.276 INFO:tasks.workunit.client.0.smithi049.stdout:9/574: rename d2/d25/l55 to d2/d1a/d1b/d7a/lb6 0 2024-04-26T10:44:30.277 INFO:tasks.workunit.client.0.smithi049.stdout:0/495: write d8/db/d11/f32 [3965622,102152] 0 2024-04-26T10:44:30.277 INFO:tasks.workunit.client.0.smithi049.stdout:8/526: getdents d2/df/d10/d23/d9a 0 2024-04-26T10:44:30.278 INFO:tasks.workunit.client.0.smithi049.stdout:2/460: getdents d6/d9/db/d34/d7b 0 2024-04-26T10:44:30.278 INFO:tasks.workunit.client.0.smithi049.stdout:8/527: chown d2/df/c4a 44354 1 2024-04-26T10:44:30.279 INFO:tasks.workunit.client.0.smithi049.stdout:9/575: creat d2/d1a/d1b/d1f/d49/fb7 x:0 0 0 2024-04-26T10:44:30.279 INFO:tasks.workunit.client.0.smithi049.stdout:2/461: chown d6/d9/db/d34/d7b/f7e 7819 1 2024-04-26T10:44:30.280 INFO:tasks.workunit.client.0.smithi049.stdout:4/568: dwrite de/d1b/d5e/d72/d73/d84/f8c [0,4194304] 0 2024-04-26T10:44:30.280 INFO:tasks.workunit.client.0.smithi049.stdout:1/435: dread d1e/d20/d26/d3c/d54/f5a [0,4194304] 0 2024-04-26T10:44:30.280 INFO:tasks.workunit.client.0.smithi049.stdout:7/513: dread d2/dd/d38/f40 [0,4194304] 0 2024-04-26T10:44:30.281 INFO:tasks.workunit.client.0.smithi049.stdout:1/436: fdatasync f16 0 2024-04-26T10:44:30.281 INFO:tasks.workunit.client.0.smithi049.stdout:2/462: read - d6/d9/db/d34/f6c zero size 2024-04-26T10:44:30.282 INFO:tasks.workunit.client.0.smithi049.stdout:8/528: fsync d2/d89/d2a/f35 0 2024-04-26T10:44:30.283 INFO:tasks.workunit.client.0.smithi049.stdout:1/437: chown d1e/f6f 2 1 2024-04-26T10:44:30.283 INFO:tasks.workunit.client.0.smithi049.stdout:4/569: creat de/d1b/d5e/fac x:0 0 0 2024-04-26T10:44:30.283 INFO:tasks.workunit.client.0.smithi049.stdout:4/570: sync 2024-04-26T10:44:30.284 INFO:tasks.workunit.client.0.smithi049.stdout:1/438: fdatasync d1e/f72 0 2024-04-26T10:44:30.284 INFO:tasks.workunit.client.0.smithi049.stdout:2/463: mknod d6/d9/c88 0 2024-04-26T10:44:30.284 INFO:tasks.workunit.client.0.smithi049.stdout:8/529: symlink d2/df/d10/d47/lad 0 2024-04-26T10:44:30.285 INFO:tasks.workunit.client.0.smithi049.stdout:0/496: dwrite d8/db/d26/d39/fa4 [0,4194304] 0 2024-04-26T10:44:30.285 INFO:tasks.workunit.client.0.smithi049.stdout:2/464: mknod d6/d9/db/d35/c89 0 2024-04-26T10:44:30.286 INFO:tasks.workunit.client.0.smithi049.stdout:1/439: creat d1e/d20/d26/d37/d69/d75/f85 x:0 0 0 2024-04-26T10:44:30.287 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:30.285+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:30.287 INFO:tasks.workunit.client.0.smithi049.stdout:4/571: link de/d1b/d5e/d72/d73/d84/f8c de/d3f/fad 0 2024-04-26T10:44:30.287 INFO:tasks.workunit.client.0.smithi049.stdout:9/576: truncate d2/d25/d60/f76 826172 0 2024-04-26T10:44:30.288 INFO:tasks.workunit.client.0.smithi049.stdout:4/572: fdatasync de/d1b/d5e/d72/d73/d84/d4b/f7d 0 2024-04-26T10:44:30.290 INFO:tasks.workunit.client.0.smithi049.stdout:6/479: dwrite da/dd/de/d26/f64 [0,4194304] 0 2024-04-26T10:44:30.290 INFO:tasks.workunit.client.0.smithi049.stdout:7/514: truncate d2/dd/d25/f81 1160279 0 2024-04-26T10:44:30.291 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:30.291 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:30.292 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:30.292 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:30.292 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:30.293 INFO:tasks.workunit.client.0.smithi049.stdout:1/440: rename d1e/d20/c40 to d1e/c86 0 2024-04-26T10:44:30.293 INFO:tasks.workunit.client.0.smithi049.stdout:3/421: dwrite d3/d6/f10 [0,4194304] 0 2024-04-26T10:44:30.293 INFO:tasks.workunit.client.0.smithi049.stdout:2/465: chown d6/d9/db/d34/l7c 177 1 2024-04-26T10:44:30.293 INFO:tasks.workunit.client.0.smithi049.stdout:9/577: symlink d2/d40/lb8 0 2024-04-26T10:44:30.293 INFO:tasks.workunit.client.0.smithi049.stdout:7/515: fsync d2/d3/de/d1c/f61 0 2024-04-26T10:44:30.293 INFO:tasks.workunit.client.0.smithi049.stdout:6/480: symlink da/dd/de/d11/la2 0 2024-04-26T10:44:30.293 INFO:tasks.workunit.client.0.smithi049.stdout:2/466: stat d6/d9/f76 0 2024-04-26T10:44:30.293 INFO:tasks.workunit.client.0.smithi049.stdout:0/497: rename d8/db/d11/d1c/c23 to d8/d1e/d98/cad 0 2024-04-26T10:44:30.294 INFO:tasks.workunit.client.0.smithi049.stdout:9/578: mkdir d2/db9 0 2024-04-26T10:44:30.295 INFO:tasks.workunit.client.0.smithi049.stdout:9/579: readlink d2/d40/l81 0 2024-04-26T10:44:30.295 INFO:tasks.workunit.client.0.smithi049.stdout:2/467: mknod d6/d9/db/d11/d6a/c8a 0 2024-04-26T10:44:30.296 INFO:tasks.workunit.client.0.smithi049.stdout:0/498: mkdir d8/db/d11/d1b/d4d/dae 0 2024-04-26T10:44:30.296 INFO:tasks.workunit.client.0.smithi049.stdout:2/468: chown f3 303911 1 2024-04-26T10:44:30.296 INFO:tasks.workunit.client.0.smithi049.stdout:9/580: getdents d2/db9 0 2024-04-26T10:44:30.296 INFO:tasks.workunit.client.0.smithi049.stdout:2/469: fsync d6/f8 0 2024-04-26T10:44:30.296 INFO:tasks.workunit.client.0.smithi049.stdout:0/499: fsync d8/db/d11/d1c/f48 0 2024-04-26T10:44:30.296 INFO:tasks.workunit.client.0.smithi049.stdout:9/581: chown d2/d1a/d9c/lb0 826208233 1 2024-04-26T10:44:30.298 INFO:tasks.workunit.client.0.smithi049.stdout:0/500: fdatasync d8/db/d26/d39/f99 0 2024-04-26T10:44:30.298 INFO:tasks.workunit.client.0.smithi049.stdout:2/470: creat d6/d9/db/d34/d38/d3f/f8b x:0 0 0 2024-04-26T10:44:30.300 INFO:tasks.workunit.client.0.smithi049.stdout:6/481: dwrite f8 [0,4194304] 0 2024-04-26T10:44:30.300 INFO:tasks.workunit.client.0.smithi049.stdout:5/505: dread d7/d1d/d1f/d4e/dad/fb7 [0,4194304] 0 2024-04-26T10:44:30.300 INFO:tasks.workunit.client.0.smithi049.stdout:9/582: link d2/d1a/d1b/d1f/d49/f93 d2/d1a/d1b/fba 0 2024-04-26T10:44:30.301 INFO:tasks.workunit.client.0.smithi049.stdout:0/501: truncate d8/db/d26/f7b 65924 0 2024-04-26T10:44:30.302 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:30.303 INFO:tasks.workunit.client.0.smithi049.stdout:9/583: creat d2/d25/d74/fbb x:0 0 0 2024-04-26T10:44:30.303 INFO:tasks.workunit.client.0.smithi049.stdout:9/584: symlink d2/d1a/d1b/lbc 0 2024-04-26T10:44:30.304 INFO:tasks.workunit.client.0.smithi049.stdout:3/422: dwrite d3/f40 [0,4194304] 0 2024-04-26T10:44:30.304 INFO:tasks.workunit.client.0.smithi049.stdout:9/585: stat d2/d1a/fd 0 2024-04-26T10:44:30.305 INFO:tasks.workunit.client.0.smithi049.stdout:3/423: fdatasync d3/d23/d2f/d6a/d6b/d26/d29/f72 0 2024-04-26T10:44:30.307 INFO:tasks.workunit.client.0.smithi049.stdout:9/586: rename d2/d1a/d1b/d1f/f3f to d2/db9/fbd 0 2024-04-26T10:44:30.307 INFO:tasks.workunit.client.0.smithi049.stdout:3/424: rmdir d3/d23/d2f/d6a/d6b/d8/d55/d46 39 2024-04-26T10:44:30.308 INFO:tasks.workunit.client.0.smithi049.stdout:9/587: rename d2/d1a/f79 to d2/d1a/d1b/d1f/d34/fbe 0 2024-04-26T10:44:30.309 INFO:tasks.workunit.client.0.smithi049.stdout:9/588: sync 2024-04-26T10:44:30.309 INFO:tasks.workunit.client.0.smithi049.stdout:9/589: chown d2/c2b 28024726 1 2024-04-26T10:44:30.312 INFO:tasks.workunit.client.0.smithi049.stdout:3/425: dwrite d3/d23/d2f/d6a/d6b/d26/f5a [0,4194304] 0 2024-04-26T10:44:30.317 INFO:tasks.workunit.client.0.smithi049.stdout:9/590: dwrite d2/d25/d74/f59 [0,4194304] 0 2024-04-26T10:44:30.318 INFO:tasks.workunit.client.0.smithi049.stdout:8/530: dread f1 [0,4194304] 0 2024-04-26T10:44:30.319 INFO:tasks.workunit.client.0.smithi049.stdout:6/482: dwrite da/dd/de/d26/f72 [0,4194304] 0 2024-04-26T10:44:30.321 INFO:tasks.workunit.client.0.smithi049.stdout:7/516: dread d2/dd/d25/f75 [0,4194304] 0 2024-04-26T10:44:30.322 INFO:tasks.workunit.client.0.smithi049.stdout:7/517: rmdir d2/d3/de/d1c 39 2024-04-26T10:44:30.322 INFO:tasks.workunit.client.0.smithi049.stdout:7/518: fdatasync d2/f64 0 2024-04-26T10:44:30.324 INFO:tasks.workunit.client.0.smithi049.stdout:7/519: creat d2/dd/d48/d5c/faa x:0 0 0 2024-04-26T10:44:30.324 INFO:tasks.workunit.client.0.smithi049.stdout:7/520: dread - d2/f8c zero size 2024-04-26T10:44:30.324 INFO:tasks.workunit.client.0.smithi049.stdout:3/426: read d3/d23/d2f/d6a/d6b/d8/f9 [11961256,69323] 0 2024-04-26T10:44:30.325 INFO:tasks.workunit.client.0.smithi049.stdout:7/521: mkdir d2/dab 0 2024-04-26T10:44:30.325 INFO:tasks.workunit.client.0.smithi049.stdout:4/573: dread de/d1b/f40 [0,4194304] 0 2024-04-26T10:44:30.325 INFO:tasks.workunit.client.0.smithi049.stdout:7/522: fsync d2/f8e 0 2024-04-26T10:44:30.327 INFO:tasks.workunit.client.0.smithi049.stdout:4/574: symlink de/d1b/d5e/d72/d73/dab/lae 0 2024-04-26T10:44:30.327 INFO:tasks.workunit.client.0.smithi049.stdout:3/427: fsync d3/d23/d2f/d6a/d6b/d8/dd/f18 0 2024-04-26T10:44:30.327 INFO:tasks.workunit.client.0.smithi049.stdout:7/523: mkdir d2/d3/de/d1c/dac 0 2024-04-26T10:44:30.328 INFO:tasks.workunit.client.0.smithi049.stdout:7/524: chown d2/fc 223 1 2024-04-26T10:44:30.328 INFO:tasks.workunit.client.0.smithi049.stdout:3/428: chown d3/d23/d2f/d6a/d6b/d8/d55/l67 65108376 1 2024-04-26T10:44:30.329 INFO:tasks.workunit.client.0.smithi049.stdout:3/429: fsync d3/d23/f75 0 2024-04-26T10:44:30.329 INFO:tasks.workunit.client.0.smithi049.stdout:4/575: rename de/d1b/d5e/d72/d73/dab/lae to de/d1b/d5e/d72/d73/d88/laf 0 2024-04-26T10:44:30.330 INFO:tasks.workunit.client.0.smithi049.stdout:4/576: fsync de/d1d/f78 0 2024-04-26T10:44:30.330 INFO:tasks.workunit.client.0.smithi049.stdout:6/483: dread da/dd/de/d26/d22/f54 [0,4194304] 0 2024-04-26T10:44:30.330 INFO:tasks.workunit.client.0.smithi049.stdout:7/525: rename d2/d3/l9 to d2/dd/d45/d82/lad 0 2024-04-26T10:44:30.330 INFO:tasks.workunit.client.0.smithi049.stdout:0/502: dread d8/f18 [0,4194304] 0 2024-04-26T10:44:30.331 INFO:tasks.workunit.client.0.smithi049.stdout:6/484: chown da/dd/de/d26/l59 3742699 1 2024-04-26T10:44:30.331 INFO:tasks.workunit.client.0.smithi049.stdout:4/577: write de/d3f/d52/d9b/f91 [15231818,127429] 0 2024-04-26T10:44:30.333 INFO:tasks.workunit.client.0.smithi049.stdout:6/485: truncate da/d4a/f6e 427651 0 2024-04-26T10:44:30.333 INFO:tasks.workunit.client.0.smithi049.stdout:7/526: creat d2/d3/de/d1c/fae x:0 0 0 2024-04-26T10:44:30.333 INFO:tasks.workunit.client.0.smithi049.stdout:0/503: mkdir d8/db/d26/daf 0 2024-04-26T10:44:30.334 INFO:tasks.workunit.client.0.smithi049.stdout:6/486: dread - da/f35 zero size 2024-04-26T10:44:30.334 INFO:tasks.workunit.client.0.smithi049.stdout:4/578: symlink de/d1b/d5e/d72/d73/d84/d38/lb0 0 2024-04-26T10:44:30.334 INFO:tasks.workunit.client.0.smithi049.stdout:0/504: chown d8/db 4 1 2024-04-26T10:44:30.334 INFO:tasks.workunit.client.0.smithi049.stdout:5/506: dread d7/d1d/d1f/d4e/d65/d6f/d91/f4f [0,4194304] 0 2024-04-26T10:44:30.335 INFO:tasks.workunit.client.0.smithi049.stdout:0/505: dread - d8/d66/f91 zero size 2024-04-26T10:44:30.336 INFO:tasks.workunit.client.0.smithi049.stdout:0/506: fsync d8/d66/f91 0 2024-04-26T10:44:30.337 INFO:tasks.workunit.client.0.smithi049.stdout:4/579: rmdir de/d3f/d52/d9b/da5 39 2024-04-26T10:44:30.338 INFO:tasks.workunit.client.0.smithi049.stdout:3/430: dwrite d3/d23/d2f/d6a/d6b/d8/f88 [0,4194304] 0 2024-04-26T10:44:30.338 INFO:tasks.workunit.client.0.smithi049.stdout:1/441: dread d1e/f3b [0,4194304] 0 2024-04-26T10:44:30.339 INFO:tasks.workunit.client.0.smithi049.stdout:9/591: dread d2/d25/d74/f6c [0,4194304] 0 2024-04-26T10:44:30.340 INFO:tasks.workunit.client.0.smithi049.stdout:6/487: write da/dd/de/d42/d5a/f74 [723241,52669] 0 2024-04-26T10:44:30.340 INFO:tasks.workunit.client.0.smithi049.stdout:5/507: getdents d7/d1d/d1f/d4e/d65/d6f/d91/d3e 0 2024-04-26T10:44:30.340 INFO:tasks.workunit.client.0.smithi049.stdout:2/471: dread d6/d9/db/df/d31/f5c [0,4194304] 0 2024-04-26T10:44:30.341 INFO:tasks.workunit.client.0.smithi049.stdout:0/507: write d8/db/d11/d1b/fa8 [1044453,47527] 0 2024-04-26T10:44:30.341 INFO:tasks.workunit.client.0.smithi049.stdout:2/472: fsync f3 0 2024-04-26T10:44:30.341 INFO:tasks.workunit.client.0.smithi049.stdout:9/592: chown d2/d1a/f2a 185 1 2024-04-26T10:44:30.343 INFO:tasks.workunit.client.0.smithi049.stdout:7/527: dwrite d2/f4f [0,4194304] 0 2024-04-26T10:44:30.343 INFO:tasks.workunit.client.0.smithi049.stdout:1/442: write d1e/d20/d26/d37/f4e [295768,11821] 0 2024-04-26T10:44:30.343 INFO:tasks.workunit.client.0.smithi049.stdout:5/508: mknod d7/d1d/d1f/d4e/d77/cd0 0 2024-04-26T10:44:30.344 INFO:tasks.workunit.client.0.smithi049.stdout:9/593: read - d2/d1a/d1b/d1f/d34/d6d/f8e zero size 2024-04-26T10:44:30.345 INFO:tasks.workunit.client.0.smithi049.stdout:1/443: readlink d1e/d20/d26/l2b 0 2024-04-26T10:44:30.345 INFO:tasks.workunit.client.0.smithi049.stdout:5/509: readlink d7/d1d/d1f/d4e/d65/l6b 0 2024-04-26T10:44:30.346 INFO:tasks.workunit.client.0.smithi049.stdout:0/508: mkdir d8/d1e/d6a/db0 0 2024-04-26T10:44:30.347 INFO:tasks.workunit.client.0.smithi049.stdout:6/488: rename da/dd/d47/d7b/d84/d92 to da/dd/d47/da3 0 2024-04-26T10:44:30.348 INFO:tasks.workunit.client.0.smithi049.stdout:4/580: dwrite de/d3f/d52/d9b/f6b [4194304,4194304] 0 2024-04-26T10:44:30.348 INFO:tasks.workunit.client.0.smithi049.stdout:1/444: write d1e/d20/d4d/f53 [966273,38009] 0 2024-04-26T10:44:30.348 INFO:tasks.workunit.client.0.smithi049.stdout:5/510: read - d7/d1d/fbc zero size 2024-04-26T10:44:30.348 INFO:tasks.workunit.client.0.smithi049.stdout:2/473: creat d6/d9/f8c x:0 0 0 2024-04-26T10:44:30.349 INFO:tasks.workunit.client.0.smithi049.stdout:7/528: creat d2/dd/d25/faf x:0 0 0 2024-04-26T10:44:30.349 INFO:tasks.workunit.client.0.smithi049.stdout:9/594: write d2/d1a/d1b/d1f/d64/fa2 [2020463,130385] 0 2024-04-26T10:44:30.349 INFO:tasks.workunit.client.0.smithi049.stdout:8/531: dread d2/d17/d34/f5b [0,4194304] 0 2024-04-26T10:44:30.349 INFO:tasks.workunit.client.0.smithi049.stdout:0/509: rename d8/db/d26/f7b to d8/d66/fb1 0 2024-04-26T10:44:30.350 INFO:tasks.workunit.client.0.smithi049.stdout:5/511: chown d7/d1d/d1f/d4e/dad/db3 83 1 2024-04-26T10:44:30.350 INFO:tasks.workunit.client.0.smithi049.stdout:6/489: creat da/dd/d47/d7b/fa4 x:0 0 0 2024-04-26T10:44:30.351 INFO:tasks.workunit.client.0.smithi049.stdout:4/581: read - de/d1b/d5e/d72/d73/d88/f94 zero size 2024-04-26T10:44:30.351 INFO:tasks.workunit.client.0.smithi049.stdout:1/445: creat d1e/d20/d26/d3c/f87 x:0 0 0 2024-04-26T10:44:30.351 INFO:tasks.workunit.client.0.smithi049.stdout:0/510: symlink d8/da5/lb2 0 2024-04-26T10:44:30.352 INFO:tasks.workunit.client.0.smithi049.stdout:2/474: creat d6/d9/db/d34/d38/d73/f8d x:0 0 0 2024-04-26T10:44:30.352 INFO:tasks.workunit.client.0.smithi049.stdout:9/595: symlink d2/d1a/d1b/d7a/lbf 0 2024-04-26T10:44:30.352 INFO:tasks.workunit.client.0.smithi049.stdout:8/532: mknod d2/d16/d19/d42/d7c/cae 0 2024-04-26T10:44:30.353 INFO:tasks.workunit.client.0.smithi049.stdout:2/475: write f4 [5011699,89410] 0 2024-04-26T10:44:30.353 INFO:tasks.workunit.client.0.smithi049.stdout:4/582: mkdir de/d1b/d5e/d90/db1 0 2024-04-26T10:44:30.354 INFO:tasks.workunit.client.0.smithi049.stdout:3/431: dwrite d3/d23/d2f/d6a/d6b/d8/f88 [0,4194304] 0 2024-04-26T10:44:30.354 INFO:tasks.workunit.client.0.smithi049.stdout:6/490: read da/dd/d47/f48 [191068,38986] 0 2024-04-26T10:44:30.354 INFO:tasks.workunit.client.0.smithi049.stdout:9/596: symlink d2/d1a/lc0 0 2024-04-26T10:44:30.356 INFO:tasks.workunit.client.0.smithi049.stdout:0/511: dread d8/db/d26/f97 [0,4194304] 0 2024-04-26T10:44:30.356 INFO:tasks.workunit.client.0.smithi049.stdout:6/491: rmdir da/dd/de/d11 39 2024-04-26T10:44:30.357 INFO:tasks.workunit.client.0.smithi049.stdout:3/432: unlink d3/d6/f42 0 2024-04-26T10:44:30.357 INFO:tasks.workunit.client.0.smithi049.stdout:8/533: fsync d2/d17/f69 0 2024-04-26T10:44:30.357 INFO:tasks.workunit.client.0.smithi049.stdout:2/476: creat d6/d32/d69/f8e x:0 0 0 2024-04-26T10:44:30.358 INFO:tasks.workunit.client.0.smithi049.stdout:4/583: unlink de/d3f/d52/d9b/f91 0 2024-04-26T10:44:30.358 INFO:tasks.workunit.client.0.smithi049.stdout:1/446: creat d1e/d20/d26/d3c/d54/d59/f88 x:0 0 0 2024-04-26T10:44:30.358 INFO:tasks.workunit.client.0.smithi049.stdout:6/492: chown da/dd/d47/f80 0 1 2024-04-26T10:44:30.358 INFO:tasks.workunit.client.0.smithi049.stdout:7/529: dwrite d2/fc [0,4194304] 0 2024-04-26T10:44:30.358 INFO:tasks.workunit.client.0.smithi049.stdout:9/597: truncate d2/d40/f78 731950 0 2024-04-26T10:44:30.359 INFO:tasks.workunit.client.0.smithi049.stdout:2/477: readlink d6/d9/db/d1e/l39 0 2024-04-26T10:44:30.359 INFO:tasks.workunit.client.0.smithi049.stdout:8/534: mkdir d2/d16/d19/d42/daf 0 2024-04-26T10:44:30.360 INFO:tasks.workunit.client.0.smithi049.stdout:9/598: write d2/faa [909341,96955] 0 2024-04-26T10:44:30.360 INFO:tasks.workunit.client.0.smithi049.stdout:1/447: symlink d1e/d20/d26/d3c/d54/l89 0 2024-04-26T10:44:30.361 INFO:tasks.workunit.client.0.smithi049.stdout:7/530: chown d2/dd/d25/fa4 66278346 1 2024-04-26T10:44:30.361 INFO:tasks.workunit.client.0.smithi049.stdout:2/478: symlink d6/d9/db/d34/d38/d73/l8f 0 2024-04-26T10:44:30.361 INFO:tasks.workunit.client.0.smithi049.stdout:5/512: write d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d60/f7a [1403913,73342] 0 2024-04-26T10:44:30.362 INFO:tasks.workunit.client.0.smithi049.stdout:3/433: rename d3/d23/d2f/d6a/d6b/d8/d55/l67 to d3/d23/d2f/d6a/d6b/d26/d58/l97 0 2024-04-26T10:44:30.362 INFO:tasks.workunit.client.0.smithi049.stdout:4/584: mkdir de/d3f/d52/d9b/d9e/db2 0 2024-04-26T10:44:30.362 INFO:tasks.workunit.client.0.smithi049.stdout:8/535: write d2/d89/d2a/f2b [3065663,105933] 0 2024-04-26T10:44:30.363 INFO:tasks.workunit.client.0.smithi049.stdout:7/531: chown d2/f6 466 1 2024-04-26T10:44:30.364 INFO:tasks.workunit.client.0.smithi049.stdout:9/599: read d2/d1a/f5e [59765,81929] 0 2024-04-26T10:44:30.365 INFO:tasks.workunit.client.0.smithi049.stdout:1/448: write d1e/d20/d26/d37/f5d [2945826,34198] 0 2024-04-26T10:44:30.366 INFO:tasks.workunit.client.0.smithi049.stdout:8/536: rmdir d2/d16/d91 0 2024-04-26T10:44:30.366 INFO:tasks.workunit.client.0.smithi049.stdout:3/434: write d3/d23/d2f/d6a/d6b/d8/f9 [1353274,80022] 0 2024-04-26T10:44:30.367 INFO:tasks.workunit.client.0.smithi049.stdout:6/493: dwrite da/dd/d47/f49 [0,4194304] 0 2024-04-26T10:44:30.368 INFO:tasks.workunit.client.0.smithi049.stdout:4/585: rmdir de 39 2024-04-26T10:44:30.370 INFO:tasks.workunit.client.0.smithi049.stdout:9/600: write d2/d25/fa3 [2089177,112768] 0 2024-04-26T10:44:30.370 INFO:tasks.workunit.client.0.smithi049.stdout:1/449: fsync d1e/d20/d26/f51 0 2024-04-26T10:44:30.370 INFO:tasks.workunit.client.0.smithi049.stdout:0/512: dwrite d8/db/d26/d39/f6e [0,4194304] 0 2024-04-26T10:44:30.371 INFO:tasks.workunit.client.0.smithi049.stdout:9/601: fdatasync d2/d1a/d42/f67 0 2024-04-26T10:44:30.371 INFO:tasks.workunit.client.0.smithi049.stdout:5/513: truncate d7/d1d/d1f/d4e/d65/f75 3175035 0 2024-04-26T10:44:30.373 INFO:tasks.workunit.client.0.smithi049.stdout:1/450: fsync d1e/d20/d26/d37/f5d 0 2024-04-26T10:44:30.373 INFO:tasks.workunit.client.0.smithi049.stdout:7/532: getdents d2/d3/de/d1c 0 2024-04-26T10:44:30.373 INFO:tasks.workunit.client.0.smithi049.stdout:4/586: mknod de/d1b/d5e/d72/d73/d88/cb3 0 2024-04-26T10:44:30.373 INFO:tasks.workunit.client.0.smithi049.stdout:6/494: getdents da/dd 0 2024-04-26T10:44:30.373 INFO:tasks.workunit.client.0.smithi049.stdout:9/602: read - d2/d1a/d1b/d1f/d49/f94 zero size 2024-04-26T10:44:30.375 INFO:tasks.workunit.client.0.smithi049.stdout:7/533: dread - d2/dd/d48/f88 zero size 2024-04-26T10:44:30.376 INFO:tasks.workunit.client.0.smithi049.stdout:6/495: read da/dd/de/d26/d22/f54 [12096,9743] 0 2024-04-26T10:44:30.376 INFO:tasks.workunit.client.0.smithi049.stdout:1/451: mknod d1e/d20/d26/d3c/d54/d59/d73/c8a 0 2024-04-26T10:44:30.376 INFO:tasks.workunit.client.0.smithi049.stdout:8/537: dwrite d2/d17/d34/d40/f71 [0,4194304] 0 2024-04-26T10:44:30.376 INFO:tasks.workunit.client.0.smithi049.stdout:7/534: mknod d2/dd/cb0 0 2024-04-26T10:44:30.378 INFO:tasks.workunit.client.0.smithi049.stdout:9/603: truncate d2/d1a/d42/f67 2877682 0 2024-04-26T10:44:30.379 INFO:tasks.workunit.client.0.smithi049.stdout:0/513: dwrite d8/d42/f62 [0,4194304] 0 2024-04-26T10:44:30.379 INFO:tasks.workunit.client.0.smithi049.stdout:6/496: chown da/dd/de/d42/d5a/f65 2 1 2024-04-26T10:44:30.379 INFO:tasks.workunit.client.0.smithi049.stdout:8/538: unlink d2/df/d10/d23/d6c/d5e/l60 0 2024-04-26T10:44:30.380 INFO:tasks.workunit.client.0.smithi049.stdout:9/604: dread - d2/d1a/d9c/fa7 zero size 2024-04-26T10:44:30.383 INFO:tasks.workunit.client.0.smithi049.stdout:8/539: write d2/f2f [2542214,86282] 0 2024-04-26T10:44:30.383 INFO:tasks.workunit.client.0.smithi049.stdout:2/479: truncate d6/d9/db/d34/d38/d3f/f42 2402766 0 2024-04-26T10:44:30.383 INFO:tasks.workunit.client.0.smithi049.stdout:4/587: dwrite de/d1b/d5e/d72/d73/d84/d4b/f7d [0,4194304] 0 2024-04-26T10:44:30.385 INFO:tasks.workunit.client.0.smithi049.stdout:9/605: creat d2/d1a/fc1 x:0 0 0 2024-04-26T10:44:30.386 INFO:tasks.workunit.client.0.smithi049.stdout:1/452: dread d1e/f3b [0,4194304] 0 2024-04-26T10:44:30.386 INFO:tasks.workunit.client.0.smithi049.stdout:5/514: link d7/d1d/d1f/d4e/d65/fa1 d7/d1d/d1f/d4e/d65/d6f/fd1 0 2024-04-26T10:44:30.386 INFO:tasks.workunit.client.0.smithi049.stdout:4/588: write de/d1d/f78 [3468814,97150] 0 2024-04-26T10:44:30.387 INFO:tasks.workunit.client.0.smithi049.stdout:2/480: creat d6/d9/db/d35/f90 x:0 0 0 2024-04-26T10:44:30.387 INFO:tasks.workunit.client.0.smithi049.stdout:0/514: dread d8/d66/fb1 [0,4194304] 0 2024-04-26T10:44:30.387 INFO:tasks.workunit.client.0.smithi049.stdout:5/515: stat d7/d14/l90 0 2024-04-26T10:44:30.388 INFO:tasks.workunit.client.0.smithi049.stdout:7/535: dwrite d2/d3/de/d1c/f90 [0,4194304] 0 2024-04-26T10:44:30.388 INFO:tasks.workunit.client.0.smithi049.stdout:6/497: dwrite da/dd/f1e [4194304,4194304] 0 2024-04-26T10:44:30.388 INFO:tasks.workunit.client.0.smithi049.stdout:1/453: creat d1e/d62/f8b x:0 0 0 2024-04-26T10:44:30.388 INFO:tasks.workunit.client.0.smithi049.stdout:0/515: chown d8/d66/f69 15201004 1 2024-04-26T10:44:30.389 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:30.387+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:30.390 INFO:tasks.workunit.client.0.smithi049.stdout:2/481: truncate d6/d9/f6b 539246 0 2024-04-26T10:44:30.391 INFO:tasks.workunit.client.0.smithi049.stdout:8/540: getdents d2/df/d10 0 2024-04-26T10:44:30.391 INFO:tasks.workunit.client.0.smithi049.stdout:1/454: write d1e/d20/d26/d3c/f3f [4201150,83865] 0 2024-04-26T10:44:30.392 INFO:tasks.workunit.client.0.smithi049.stdout:2/482: chown d6/d9/db/d1e/f81 27284 1 2024-04-26T10:44:30.392 INFO:tasks.workunit.client.0.smithi049.stdout:7/536: mkdir d2/dd/d7f/db1 0 2024-04-26T10:44:30.392 INFO:tasks.workunit.client.0.smithi049.stdout:6/498: mknod da/dd/d62/ca5 0 2024-04-26T10:44:30.392 INFO:tasks.workunit.client.0.smithi049.stdout:8/541: unlink d2/d89/d2a/d9f/fa7 0 2024-04-26T10:44:30.392 INFO:tasks.workunit.client.0.smithi049.stdout:0/516: mknod d8/db/d11/d1b/d4d/dae/cb3 0 2024-04-26T10:44:30.393 INFO:tasks.workunit.client.0.smithi049.stdout:5/516: rename d7/d53/cb4 to d7/d1d/d1f/d22/cd2 0 2024-04-26T10:44:30.393 INFO:tasks.workunit.client.0.smithi049.stdout:2/483: write d6/d9/db/f24 [5333015,29843] 0 2024-04-26T10:44:30.395 INFO:tasks.workunit.client.0.smithi049.stdout:9/606: write d2/d1a/d42/f67 [3758648,85455] 0 2024-04-26T10:44:30.395 INFO:tasks.workunit.client.0.smithi049.stdout:6/499: creat da/dd/d62/d9d/d9e/fa6 x:0 0 0 2024-04-26T10:44:30.396 INFO:tasks.workunit.client.0.smithi049.stdout:0/517: write d8/db/d11/d1c/f48 [216359,36903] 0 2024-04-26T10:44:30.396 INFO:tasks.workunit.client.0.smithi049.stdout:2/484: stat d6/d9/db/f1c 0 2024-04-26T10:44:30.397 INFO:tasks.workunit.client.0.smithi049.stdout:9/607: mkdir d2/d25/d74/dc2 0 2024-04-26T10:44:30.398 INFO:tasks.workunit.client.0.smithi049.stdout:4/589: dwrite de/d1b/d5e/d72/d73/d84/f8c [0,4194304] 0 2024-04-26T10:44:30.398 INFO:tasks.workunit.client.0.smithi049.stdout:2/485: mkdir d6/d9/db/d35/d91 0 2024-04-26T10:44:30.399 INFO:tasks.workunit.client.0.smithi049.stdout:0/518: read d8/d42/f6c [2615019,71060] 0 2024-04-26T10:44:30.399 INFO:tasks.workunit.client.0.smithi049.stdout:5/517: rename d7/d1d/d1f/d4e/d65/d6f/d91/d3e/l55 to d7/d66/d84/ld3 0 2024-04-26T10:44:30.399 INFO:tasks.workunit.client.0.smithi049.stdout:9/608: creat d2/d1a/d1b/d1f/fc3 x:0 0 0 2024-04-26T10:44:30.400 INFO:tasks.workunit.client.0.smithi049.stdout:8/542: truncate d2/fe 3319107 0 2024-04-26T10:44:30.400 INFO:tasks.workunit.client.0.smithi049.stdout:4/590: readlink de/d1b/d5e/d72/d73/d84/l3a 0 2024-04-26T10:44:30.400 INFO:tasks.workunit.client.0.smithi049.stdout:2/486: dread - d6/d9/db/d34/d7b/f7e zero size 2024-04-26T10:44:30.400 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:44:30.401 INFO:tasks.workunit.client.0.smithi049.stdout:9/609: creat d2/d1a/d42/fc4 x:0 0 0 2024-04-26T10:44:30.401 INFO:tasks.workunit.client.0.smithi049.stdout:0/519: creat d8/d66/fb4 x:0 0 0 2024-04-26T10:44:30.401 INFO:tasks.workunit.client.0.smithi049.stdout:2/487: fsync d6/d32/d4a/f51 0 2024-04-26T10:44:30.404 INFO:tasks.workunit.client.0.smithi049.stdout:1/455: dwrite d1e/f45 [4194304,4194304] 0 2024-04-26T10:44:30.404 INFO:tasks.workunit.client.0.smithi049.stdout:0/520: readlink d8/db/d26/d39/l4f 0 2024-04-26T10:44:30.404 INFO:tasks.workunit.client.0.smithi049.stdout:0/521: chown d8/d42 217017 1 2024-04-26T10:44:30.404 INFO:tasks.workunit.client.0.smithi049.stdout:6/500: read da/dd/de/d42/d5a/f8e [12395,21295] 0 2024-04-26T10:44:30.404 INFO:tasks.workunit.client.0.smithi049.stdout:8/543: rename d2/d16/d19/f85 to d2/d16/d19/fb0 0 2024-04-26T10:44:30.404 INFO:tasks.workunit.client.0.smithi049.stdout:9/610: unlink d2/d1a/d1b/d1f/c50 0 2024-04-26T10:44:30.406 INFO:tasks.workunit.client.0.smithi049.stdout:0/522: symlink d8/db/d11/lb5 0 2024-04-26T10:44:30.406 INFO:tasks.workunit.client.0.smithi049.stdout:8/544: rmdir d2/d1a 39 2024-04-26T10:44:30.407 INFO:tasks.workunit.client.0.smithi049.stdout:9/611: mkdir d2/d25/dc5 0 2024-04-26T10:44:30.408 INFO:tasks.workunit.client.0.smithi049.stdout:9/612: unlink d2/d1a/f45 0 2024-04-26T10:44:30.408 INFO:tasks.workunit.client.0.smithi049.stdout:1/456: getdents d1e/d20/d26/d37 0 2024-04-26T10:44:30.409 INFO:tasks.workunit.client.0.smithi049.stdout:6/501: rename da/dd/de/d26 to da/dd/de/d26/d22/da7 22 2024-04-26T10:44:30.409 INFO:tasks.workunit.client.0.smithi049.stdout:0/523: chown d8/db/d11/d1c/l7d 2491 1 2024-04-26T10:44:30.409 INFO:tasks.workunit.client.0.smithi049.stdout:8/545: chown d2/df/d10/f9d 3960762 1 2024-04-26T10:44:30.410 INFO:tasks.workunit.client.0.smithi049.stdout:4/591: dwrite de/f8d [0,4194304] 0 2024-04-26T10:44:30.411 INFO:tasks.workunit.client.0.smithi049.stdout:2/488: write d6/d9/f52 [1057928,104495] 0 2024-04-26T10:44:30.411 INFO:tasks.workunit.client.0.smithi049.stdout:5/518: dwrite d7/d1d/d1f/d4e/d65/d6f/f5c [0,4194304] 0 2024-04-26T10:44:30.411 INFO:tasks.workunit.client.0.smithi049.stdout:9/613: chown d2/d40/d53/l5a 22 1 2024-04-26T10:44:30.411 INFO:tasks.workunit.client.0.smithi049.stdout:1/457: dread - d1e/d62/f8b zero size 2024-04-26T10:44:30.412 INFO:tasks.workunit.client.0.smithi049.stdout:6/502: creat da/dd/d47/fa8 x:0 0 0 2024-04-26T10:44:30.412 INFO:tasks.workunit.client.0.smithi049.stdout:3/435: dread d3/d23/d2f/d6a/d6b/d8/d34/f51 [0,4194304] 0 2024-04-26T10:44:30.412 INFO:tasks.workunit.client.0.smithi049.stdout:8/546: write d2/df/d10/f9d [864498,109079] 0 2024-04-26T10:44:30.412 INFO:tasks.workunit.client.0.smithi049.stdout:0/524: creat d8/db/fb6 x:0 0 0 2024-04-26T10:44:30.413 INFO:tasks.workunit.client.0.smithi049.stdout:4/592: dread - de/d1b/d5e/da2/fa9 zero size 2024-04-26T10:44:30.413 INFO:tasks.workunit.client.0.smithi049.stdout:9/614: chown d2/d1a/f5e 10046 1 2024-04-26T10:44:30.413 INFO:tasks.workunit.client.0.smithi049.stdout:1/458: stat d1e/d20/d26/d37 0 2024-04-26T10:44:30.413 INFO:tasks.workunit.client.0.smithi049.stdout:5/519: fsync d7/d1d/d1f/d22/f35 0 2024-04-26T10:44:30.413 INFO:tasks.workunit.client.0.smithi049.stdout:6/503: symlink da/dd/d62/d9d/d9e/la9 0 2024-04-26T10:44:30.414 INFO:tasks.workunit.client.0.smithi049.stdout:9/615: fsync d2/d1a/f2a 0 2024-04-26T10:44:30.414 INFO:tasks.workunit.client.0.smithi049.stdout:2/489: getdents d6/d32/d4a 0 2024-04-26T10:44:30.416 INFO:tasks.workunit.client.0.smithi049.stdout:0/525: rename l6 to d8/db/d26/lb7 0 2024-04-26T10:44:30.416 INFO:tasks.workunit.client.0.smithi049.stdout:9/616: write d2/d1a/f2c [229053,13000] 0 2024-04-26T10:44:30.419 INFO:tasks.workunit.client.0.smithi049.stdout:9/617: chown d2/d40/db2 286891 1 2024-04-26T10:44:30.419 INFO:tasks.workunit.client.0.smithi049.stdout:5/520: rename d7/d14/d18/f46 to d7/d1d/d1f/d4e/d77/fd4 0 2024-04-26T10:44:30.419 INFO:tasks.workunit.client.0.smithi049.stdout:2/490: creat d6/d9/db/d35/d91/f92 x:0 0 0 2024-04-26T10:44:30.419 INFO:tasks.workunit.client.0.smithi049.stdout:8/547: dread d2/d89/f41 [0,4194304] 0 2024-04-26T10:44:30.419 INFO:tasks.workunit.client.0.smithi049.stdout:5/521: chown d7/d1d/l6a 97539936 1 2024-04-26T10:44:30.420 INFO:tasks.workunit.client.0.smithi049.stdout:3/436: rename d3/d23/d2f/d6a/d6b/d26/d58/f81 to d3/d23/d2f/d6a/d6b/d8/d55/f98 0 2024-04-26T10:44:30.421 INFO:tasks.workunit.client.0.smithi049.stdout:9/618: fdatasync d2/d1a/d1b/d1f/d64/f6e 0 2024-04-26T10:44:30.421 INFO:tasks.workunit.client.0.smithi049.stdout:5/522: stat d7/d66/d84/ld3 0 2024-04-26T10:44:30.421 INFO:tasks.workunit.client.0.smithi049.stdout:8/548: rename d2/df/d10/f13 to d2/df/d10/d23/d6c/d5e/fb1 0 2024-04-26T10:44:30.423 INFO:tasks.workunit.client.0.smithi049.stdout:6/504: dwrite da/dd/de/d26/f6f [0,4194304] 0 2024-04-26T10:44:30.423 INFO:tasks.workunit.client.0.smithi049.stdout:8/549: write d2/df/d10/d23/f31 [8860859,69043] 0 2024-04-26T10:44:30.424 INFO:tasks.workunit.client.0.smithi049.stdout:5/523: symlink d7/d1d/d1f/d4e/dad/db3/ld5 0 2024-04-26T10:44:30.424 INFO:tasks.workunit.client.0.smithi049.stdout:3/437: truncate d3/d23/d2f/d6a/d6b/d26/f86 953519 0 2024-04-26T10:44:30.424 INFO:tasks.workunit.client.0.smithi049.stdout:5/524: fdatasync d7/d14/f1a 0 2024-04-26T10:44:30.424 INFO:tasks.workunit.client.0.smithi049.stdout:6/505: mkdir da/dd/d47/d7b/d84/daa 0 2024-04-26T10:44:30.425 INFO:tasks.workunit.client.0.smithi049.stdout:8/550: creat d2/df/d10/d47/fb2 x:0 0 0 2024-04-26T10:44:30.425 INFO:tasks.workunit.client.0.smithi049.stdout:3/438: stat d3/d23/d2f/d6a/d6b/d8/d55/d2e/l3d 0 2024-04-26T10:44:30.426 INFO:tasks.workunit.client.0.smithi049.stdout:6/506: stat da/dd/de/d26/d22/f77 0 2024-04-26T10:44:30.426 INFO:tasks.workunit.client.0.smithi049.stdout:9/619: read d2/f8 [3714769,87483] 0 2024-04-26T10:44:30.426 INFO:tasks.workunit.client.0.smithi049.stdout:1/459: truncate d1e/d20/d26/d37/f4e 75154 0 2024-04-26T10:44:30.428 INFO:tasks.workunit.client.0.smithi049.stdout:1/460: chown d1e/d20/d26/d37/f5b 36331935 1 2024-04-26T10:44:30.428 INFO:tasks.workunit.client.0.smithi049.stdout:8/551: write d2/d89/d30/f63 [2920348,44594] 0 2024-04-26T10:44:30.429 INFO:tasks.workunit.client.0.smithi049.stdout:9/620: link d2/d1a/d1b/f52 d2/d1a/d1b/d1f/d49/fc6 0 2024-04-26T10:44:30.431 INFO:tasks.workunit.client.0.smithi049.stdout:5/525: dwrite d7/f74 [0,4194304] 0 2024-04-26T10:44:30.431 INFO:tasks.workunit.client.0.smithi049.stdout:8/552: creat d2/df/d10/d47/d75/fb3 x:0 0 0 2024-04-26T10:44:30.431 INFO:tasks.workunit.client.0.smithi049.stdout:1/461: creat d1e/d20/d26/d37/d6e/f8c x:0 0 0 2024-04-26T10:44:30.432 INFO:tasks.workunit.client.0.smithi049.stdout:6/507: truncate da/dd/de/d42/f5f 1642888 0 2024-04-26T10:44:30.433 INFO:tasks.workunit.client.0.smithi049.stdout:8/553: chown d2/d17/fa8 174033 1 2024-04-26T10:44:30.434 INFO:tasks.workunit.client.0.smithi049.stdout:8/554: stat d2/df/d10/d47/f99 0 2024-04-26T10:44:30.436 INFO:tasks.workunit.client.0.smithi049.stdout:1/462: mknod d1e/d20/d26/d3c/d54/d59/d68/c8d 0 2024-04-26T10:44:30.437 INFO:tasks.workunit.client.0.smithi049.stdout:8/555: mknod d2/d89/d2a/d9f/cb4 0 2024-04-26T10:44:30.437 INFO:tasks.workunit.client.0.smithi049.stdout:2/491: dread d6/d9/f52 [0,4194304] 0 2024-04-26T10:44:30.437 INFO:tasks.workunit.client.0.smithi049.stdout:6/508: getdents da/dd/d62/d9d 0 2024-04-26T10:44:30.437 INFO:tasks.workunit.client.0.smithi049.stdout:9/621: dwrite d2/d1a/f38 [0,4194304] 0 2024-04-26T10:44:30.438 INFO:tasks.workunit.client.0.smithi049.stdout:1/463: chown d1e/d20/f28 1303257278 1 2024-04-26T10:44:30.441 INFO:tasks.workunit.client.0.smithi049.stdout:2/492: write d6/d32/f87 [138991,117076] 0 2024-04-26T10:44:30.442 INFO:tasks.workunit.client.0.smithi049.stdout:8/556: write d2/df/d10/d47/faa [59436,11050] 0 2024-04-26T10:44:30.442 INFO:tasks.workunit.client.0.smithi049.stdout:7/537: sync 2024-04-26T10:44:30.442 INFO:tasks.workunit.client.0.smithi049.stdout:9/622: creat d2/d1a/d9c/fc7 x:0 0 0 2024-04-26T10:44:30.442 INFO:tasks.workunit.client.0.smithi049.stdout:6/509: rename da/dd/de/d26/l40 to da/dd/d47/lab 0 2024-04-26T10:44:30.442 INFO:tasks.workunit.client.0.smithi049.stdout:7/538: write d2/f8c [527189,69877] 0 2024-04-26T10:44:30.442 INFO:tasks.workunit.client.0.smithi049.stdout:1/464: mkdir d1e/d20/d26/d37/d8e 0 2024-04-26T10:44:30.443 INFO:tasks.workunit.client.0.smithi049.stdout:2/493: write d6/d9/f6b [1319864,47024] 0 2024-04-26T10:44:30.443 INFO:tasks.workunit.client.0.smithi049.stdout:7/539: stat d2/dd/d25 0 2024-04-26T10:44:30.443 INFO:tasks.workunit.client.0.smithi049.stdout:5/526: dwrite d7/d14/d18/d48/fbf [0,4194304] 0 2024-04-26T10:44:30.444 INFO:tasks.workunit.client.0.smithi049.stdout:8/557: creat d2/d16/d19/d42/daf/fb5 x:0 0 0 2024-04-26T10:44:30.444 INFO:tasks.workunit.client.0.smithi049.stdout:9/623: symlink d2/d40/db2/lc8 0 2024-04-26T10:44:30.444 INFO:tasks.workunit.client.0.smithi049.stdout:8/558: chown d2/f14 465634965 1 2024-04-26T10:44:30.445 INFO:tasks.workunit.client.0.smithi049.stdout:7/540: chown d2/d3/de/d1c/c6d 5144913 1 2024-04-26T10:44:30.445 INFO:tasks.workunit.client.0.smithi049.stdout:3/439: dread d3/d23/d2f/d6a/d6b/d8/d55/d46/f4a [0,4194304] 0 2024-04-26T10:44:30.445 INFO:tasks.workunit.client.0.smithi049.stdout:0/526: dread d8/d66/f69 [0,4194304] 0 2024-04-26T10:44:30.445 INFO:tasks.workunit.client.0.smithi049.stdout:9/624: unlink d2/d1a/d42/f61 0 2024-04-26T10:44:30.445 INFO:tasks.workunit.client.0.smithi049.stdout:5/527: mkdir d7/d1d/d34/db9/dd6 0 2024-04-26T10:44:30.446 INFO:tasks.workunit.client.0.smithi049.stdout:1/465: mknod d1e/d20/d26/d37/d8e/c8f 0 2024-04-26T10:44:30.446 INFO:tasks.workunit.client.0.smithi049.stdout:7/541: fdatasync d2/dd/d45/f97 0 2024-04-26T10:44:30.447 INFO:tasks.workunit.client.0.smithi049.stdout:3/440: fsync d3/d23/d2f/d6a/d6b/d26/f6d 0 2024-04-26T10:44:30.447 INFO:tasks.workunit.client.0.smithi049.stdout:1/466: mknod d1e/d62/c90 0 2024-04-26T10:44:30.447 INFO:tasks.workunit.client.0.smithi049.stdout:0/527: mkdir d8/db/d11/d1c/db8 0 2024-04-26T10:44:30.447 INFO:tasks.workunit.client.0.smithi049.stdout:7/542: read - d2/dd/d45/f9e zero size 2024-04-26T10:44:30.448 INFO:tasks.workunit.client.0.smithi049.stdout:5/528: rename d7/d1d/f30 to d7/d1d/d1f/d4e/d65/d6f/d91/fd7 0 2024-04-26T10:44:30.448 INFO:tasks.workunit.client.0.smithi049.stdout:1/467: stat d1e/d20/d26/d3c/d54/d59/d68/c78 0 2024-04-26T10:44:30.448 INFO:tasks.workunit.client.0.smithi049.stdout:7/543: dread - d2/d3/de/d1c/fa9 zero size 2024-04-26T10:44:30.448 INFO:tasks.workunit.client.0.smithi049.stdout:0/528: readlink d8/db/d11/lb5 0 2024-04-26T10:44:30.448 INFO:tasks.workunit.client.0.smithi049.stdout:9/625: rename d2/d1a/d1b/d1f/d64/fa2 to d2/d1a/d1b/d1f/d34/fc9 0 2024-04-26T10:44:30.449 INFO:tasks.workunit.client.0.smithi049.stdout:7/544: fdatasync d2/f74 0 2024-04-26T10:44:30.449 INFO:tasks.workunit.client.0.smithi049.stdout:1/468: write d1e/f45 [893997,97230] 0 2024-04-26T10:44:30.449 INFO:tasks.workunit.client.0.smithi049.stdout:0/529: mkdir d8/db/d26/db9 0 2024-04-26T10:44:30.449 INFO:tasks.workunit.client.0.smithi049.stdout:5/529: creat d7/dc6/fd8 x:0 0 0 2024-04-26T10:44:30.450 INFO:tasks.workunit.client.0.smithi049.stdout:1/469: stat d1e/d62/f8b 0 2024-04-26T10:44:30.450 INFO:tasks.workunit.client.0.smithi049.stdout:9/626: mknod d2/d25/dc5/cca 0 2024-04-26T10:44:30.450 INFO:tasks.workunit.client.0.smithi049.stdout:7/545: creat d2/dd/d48/da3/fb2 x:0 0 0 2024-04-26T10:44:30.451 INFO:tasks.workunit.client.0.smithi049.stdout:0/530: creat d8/db/d26/d6f/fba x:0 0 0 2024-04-26T10:44:30.451 INFO:tasks.workunit.client.0.smithi049.stdout:5/530: creat d7/d14/d18/d2b/fd9 x:0 0 0 2024-04-26T10:44:30.451 INFO:tasks.workunit.client.0.smithi049.stdout:9/627: mknod d2/d1a/d1b/d1f/ccb 0 2024-04-26T10:44:30.451 INFO:tasks.workunit.client.0.smithi049.stdout:7/546: mkdir d2/d3/d96/db3 0 2024-04-26T10:44:30.452 INFO:tasks.workunit.client.0.smithi049.stdout:5/531: creat d7/dc6/fda x:0 0 0 2024-04-26T10:44:30.452 INFO:tasks.workunit.client.0.smithi049.stdout:0/531: write d8/db/d11/d1b/f8b [33747,55348] 0 2024-04-26T10:44:30.453 INFO:tasks.workunit.client.0.smithi049.stdout:9/628: mknod d2/d25/d74/ccc 0 2024-04-26T10:44:30.453 INFO:tasks.workunit.client.0.smithi049.stdout:1/470: link d1e/d20/d26/f51 d1e/d20/d26/d3c/d54/d59/d73/f91 0 2024-04-26T10:44:30.453 INFO:tasks.workunit.client.0.smithi049.stdout:2/494: truncate d6/d9/db/d34/f5a 2337152 0 2024-04-26T10:44:30.454 INFO:tasks.workunit.client.0.smithi049.stdout:5/532: creat d7/d1d/d1f/d4e/d65/d6f/d91/fdb x:0 0 0 2024-04-26T10:44:30.456 INFO:tasks.workunit.client.0.smithi049.stdout:9/629: creat d2/fcd x:0 0 0 2024-04-26T10:44:30.456 INFO:tasks.workunit.client.0.smithi049.stdout:3/441: write d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/f28 [4727102,101810] 0 2024-04-26T10:44:30.457 INFO:tasks.workunit.client.0.smithi049.stdout:5/533: symlink d7/d14/d18/d48/ldc 0 2024-04-26T10:44:30.458 INFO:tasks.workunit.client.0.smithi049.stdout:1/471: link d1e/l21 d1e/d20/d26/d37/d8e/l92 0 2024-04-26T10:44:30.458 INFO:tasks.workunit.client.0.smithi049.stdout:2/495: getdents d6 0 2024-04-26T10:44:30.459 INFO:tasks.workunit.client.0.smithi049.stdout:5/534: mknod d7/d1d/d20/cdd 0 2024-04-26T10:44:30.462 INFO:tasks.workunit.client.0.smithi049.stdout:1/472: symlink d1e/d20/d26/d37/l93 0 2024-04-26T10:44:30.463 INFO:tasks.workunit.client.0.smithi049.stdout:0/532: dwrite d8/db/d11/d1c/f47 [0,4194304] 0 2024-04-26T10:44:30.464 INFO:tasks.workunit.client.0.smithi049.stdout:0/533: readlink d8/d42/l85 0 2024-04-26T10:44:30.466 INFO:tasks.workunit.client.0.smithi049.stdout:9/630: dwrite d2/d25/fa1 [4194304,4194304] 0 2024-04-26T10:44:30.467 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:30.467 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:30.467 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:30.467 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:30.467 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.467 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:329 3.13 3:ceffbd45:::200.0000000a:head [write 1314738~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:30.467 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513103+0000", 2024-04-26T10:44:30.468 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 3.9514131479999999, 2024-04-26T10:44:30.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022212274000000001, 2024-04-26T10:44:30.468 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.468 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:30.468 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.468 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.468 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.468 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513103+0000", 2024-04-26T10:44:30.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.468 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.468 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.468 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.468 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513103+0000", 2024-04-26T10:44:30.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.469 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.469 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513102+0000", 2024-04-26T10:44:30.469 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:30.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.469 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.469 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513106+0000", 2024-04-26T10:44:30.469 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1889999999999999e-06 2024-04-26T10:44:30.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.469 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.469 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513113+0000", 2024-04-26T10:44:30.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.328e-06 2024-04-26T10:44:30.470 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.470 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.470 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.470 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513118+0000", 2024-04-26T10:44:30.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6149999999999999e-06 2024-04-26T10:44:30.470 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.470 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.470 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.470 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533387+0000", 2024-04-26T10:44:30.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020269862 2024-04-26T10:44:30.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533445+0000", 2024-04-26T10:44:30.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7568999999999997e-05 2024-04-26T10:44:30.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:30.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535257+0000", 2024-04-26T10:44:30.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00181237 2024-04-26T10:44:30.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.472 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:30.472 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535280+0000", 2024-04-26T10:44:30.472 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.2578999999999998e-05 2024-04-26T10:44:30.472 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.472 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.472 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:30.472 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535315+0000", 2024-04-26T10:44:30.472 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5132000000000002e-05 2024-04-26T10:44:30.472 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.472 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.472 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.472 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.472 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.473 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:330 3.13 3:ceffbd45:::200.0000000a:head [write 1316140~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:30.473 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:30.473 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 3.9513762699999999, 2024-04-26T10:44:30.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022245654, 2024-04-26T10:44:30.473 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.473 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:30.473 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.473 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.473 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.473 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:30.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.473 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.473 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.473 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:30.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513139+0000", 2024-04-26T10:44:30.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:30.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513149+0000", 2024-04-26T10:44:30.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7550000000000006e-06 2024-04-26T10:44:30.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.475 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.475 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513157+0000", 2024-04-26T10:44:30.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1089999999999998e-06 2024-04-26T10:44:30.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.476 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.476 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513167+0000", 2024-04-26T10:44:30.476 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0539e-05 2024-04-26T10:44:30.476 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.476 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.476 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.476 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533830+0000", 2024-04-26T10:44:30.476 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020662852999999998 2024-04-26T10:44:30.476 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.477 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.477 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.477 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533875+0000", 2024-04-26T10:44:30.477 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.5071999999999998e-05 2024-04-26T10:44:30.477 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.477 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.477 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:30.477 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535319+0000", 2024-04-26T10:44:30.477 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001443578 2024-04-26T10:44:30.477 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.477 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.477 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:30.477 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535346+0000", 2024-04-26T10:44:30.478 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7415000000000001e-05 2024-04-26T10:44:30.478 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.478 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.478 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:30.478 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535385+0000", 2024-04-26T10:44:30.478 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8912999999999998e-05 2024-04-26T10:44:30.478 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.478 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.478 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.478 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.478 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.478 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:331 3.13 3:ceffbd45:::200.0000000a:head [write 1318049~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:30.479 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:30.479 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 3.9513369420000002, 2024-04-26T10:44:30.479 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023524521, 2024-04-26T10:44:30.479 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.479 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:30.479 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.479 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.479 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.479 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:30.479 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.479 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.479 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.479 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.479 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:30.480 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.480 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.480 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.480 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.480 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513178+0000", 2024-04-26T10:44:30.480 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:30.480 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.480 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.480 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.480 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513183+0000", 2024-04-26T10:44:30.480 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2549999999999999e-06 2024-04-26T10:44:30.480 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.480 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.481 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.481 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513190+0000", 2024-04-26T10:44:30.481 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8460000000000002e-06 2024-04-26T10:44:30.481 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.481 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.481 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.481 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513195+0000", 2024-04-26T10:44:30.481 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3630000000000002e-06 2024-04-26T10:44:30.481 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.481 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.481 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.481 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534463+0000", 2024-04-26T10:44:30.481 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021267823000000002 2024-04-26T10:44:30.481 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.482 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.482 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.482 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534520+0000", 2024-04-26T10:44:30.482 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7510000000000003e-05 2024-04-26T10:44:30.482 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.482 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.482 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:30.482 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536634+0000", 2024-04-26T10:44:30.482 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0021138900000000002 2024-04-26T10:44:30.482 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.482 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.482 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:30.482 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536663+0000", 2024-04-26T10:44:30.483 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8884e-05 2024-04-26T10:44:30.483 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.483 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.483 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:30.483 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536703+0000", 2024-04-26T10:44:30.483 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0479000000000003e-05 2024-04-26T10:44:30.483 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.483 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.483 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.483 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.483 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.483 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:332 3.13 3:ceffbd45:::200.0000000a:head [write 1319462~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:30.484 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:30.484 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 3.9513021090000002, 2024-04-26T10:44:30.484 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024543230999999999, 2024-04-26T10:44:30.484 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.484 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:30.484 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.484 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.484 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.484 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:30.484 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.484 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.484 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.484 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.484 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:30.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.485 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.485 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.485 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513213+0000", 2024-04-26T10:44:30.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:30.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.485 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.485 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.485 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513217+0000", 2024-04-26T10:44:30.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:44:30.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.485 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.485 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.486 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513229+0000", 2024-04-26T10:44:30.486 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2051e-05 2024-04-26T10:44:30.486 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.486 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.486 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.486 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513236+0000", 2024-04-26T10:44:30.486 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4470000000000003e-06 2024-04-26T10:44:30.486 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.486 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.486 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.486 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534891+0000", 2024-04-26T10:44:30.486 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021655863000000001 2024-04-26T10:44:30.486 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.487 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.487 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.487 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534933+0000", 2024-04-26T10:44:30.487 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1596e-05 2024-04-26T10:44:30.487 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.487 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.487 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:30.487 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537677+0000", 2024-04-26T10:44:30.487 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027440989999999998 2024-04-26T10:44:30.487 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.487 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.487 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:30.487 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537721+0000", 2024-04-26T10:44:30.487 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3813999999999998e-05 2024-04-26T10:44:30.487 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.488 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.488 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:30.488 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537757+0000", 2024-04-26T10:44:30.488 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6022999999999997e-05 2024-04-26T10:44:30.488 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.488 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.488 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.488 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.488 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.488 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:333 3.13 3:ceffbd45:::200.0000000a:head [write 1320870~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:30.488 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:30.488 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 3.95125919, 2024-04-26T10:44:30.488 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024557151999999999, 2024-04-26T10:44:30.488 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.489 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:30.489 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.489 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.489 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.489 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:30.489 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.489 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.489 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.489 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.489 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:30.489 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.489 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.489 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.490 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.490 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513256+0000", 2024-04-26T10:44:30.490 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:30.490 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.490 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.490 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.490 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513260+0000", 2024-04-26T10:44:30.490 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6550000000000002e-06 2024-04-26T10:44:30.490 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.490 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.490 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.490 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513273+0000", 2024-04-26T10:44:30.491 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2965e-05 2024-04-26T10:44:30.491 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.491 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.491 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.491 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513279+0000", 2024-04-26T10:44:30.491 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:44:30.491 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.491 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.491 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.491 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535411+0000", 2024-04-26T10:44:30.491 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022132233000000001 2024-04-26T10:44:30.491 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.491 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.491 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.492 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535479+0000", 2024-04-26T10:44:30.492 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7554999999999999e-05 2024-04-26T10:44:30.492 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.492 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.492 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:30.492 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537762+0000", 2024-04-26T10:44:30.492 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022836499999999999 2024-04-26T10:44:30.492 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.492 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.492 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:30.492 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537783+0000", 2024-04-26T10:44:30.492 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0364e-05 2024-04-26T10:44:30.492 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.492 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.492 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:30.493 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537814+0000", 2024-04-26T10:44:30.493 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1170000000000001e-05 2024-04-26T10:44:30.493 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.493 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.493 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.493 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.493 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.493 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:334 3.13 3:ceffbd45:::200.0000000a:head [write 1322273~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:30.493 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:30.493 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 3.9494224309999999, 2024-04-26T10:44:30.493 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022778731999999999, 2024-04-26T10:44:30.493 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.493 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:30.493 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.494 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.494 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.494 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:30.494 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.494 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.494 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.494 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.494 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:30.494 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.494 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.494 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.494 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.494 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:30.494 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:30.495 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.495 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.495 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.495 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515099+0000", 2024-04-26T10:44:30.495 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6599999999999998e-06 2024-04-26T10:44:30.495 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.495 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.495 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.495 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515112+0000", 2024-04-26T10:44:30.495 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2707e-05 2024-04-26T10:44:30.495 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.495 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.495 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.495 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515120+0000", 2024-04-26T10:44:30.496 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8509999999999999e-06 2024-04-26T10:44:30.496 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.496 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.496 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.496 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535792+0000", 2024-04-26T10:44:30.496 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020672209 2024-04-26T10:44:30.496 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.496 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.496 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.496 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535833+0000", 2024-04-26T10:44:30.496 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1415000000000002e-05 2024-04-26T10:44:30.496 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.496 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.497 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:30.497 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537818+0000", 2024-04-26T10:44:30.497 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0019850900000000001 2024-04-26T10:44:30.497 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.497 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.497 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:30.497 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537839+0000", 2024-04-26T10:44:30.498 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0068000000000002e-05 2024-04-26T10:44:30.498 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.498 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.498 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:30.498 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537872+0000", 2024-04-26T10:44:30.498 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3680999999999998e-05 2024-04-26T10:44:30.498 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.498 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.498 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.498 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.498 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.498 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:335 3.13 3:ceffbd45:::200.0000000a:head [write 1325230~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:30.498 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:30.499 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 3.949383332, 2024-04-26T10:44:30.499 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023487081, 2024-04-26T10:44:30.499 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.499 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:30.499 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.499 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.499 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.499 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:30.499 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.499 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.499 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.499 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.499 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:30.500 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.500 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.500 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.500 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.500 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515132+0000", 2024-04-26T10:44:30.500 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:30.500 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.500 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.500 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.500 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515136+0000", 2024-04-26T10:44:30.500 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0860000000000004e-06 2024-04-26T10:44:30.500 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.501 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.501 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.501 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515143+0000", 2024-04-26T10:44:30.501 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.0400000000000004e-06 2024-04-26T10:44:30.501 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.501 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.501 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.501 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515149+0000", 2024-04-26T10:44:30.501 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0789999999999997e-06 2024-04-26T10:44:30.501 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.501 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.501 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.501 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536200+0000", 2024-04-26T10:44:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021050993 2024-04-26T10:44:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536253+0000", 2024-04-26T10:44:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.2643999999999999e-05 2024-04-26T10:44:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538560+0000", 2024-04-26T10:44:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0023073389999999998 2024-04-26T10:44:30.502 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538584+0000", 2024-04-26T10:44:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3893999999999999e-05 2024-04-26T10:44:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538620+0000", 2024-04-26T10:44:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5611000000000002e-05 2024-04-26T10:44:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.503 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:336 3.13 3:ceffbd45:::200.0000000a:head [write 1327147~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:30.504 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:30.504 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 3.948050877, 2024-04-26T10:44:30.504 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027687066, 2024-04-26T10:44:30.504 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.504 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:30.504 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.504 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.504 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.504 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:30.504 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.504 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.505 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.505 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.505 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:30.505 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.505 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.505 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.505 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.505 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516464+0000", 2024-04-26T10:44:30.505 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:30.505 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.505 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.505 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.505 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516491+0000", 2024-04-26T10:44:30.505 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6539000000000001e-05 2024-04-26T10:44:30.506 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.506 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.506 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.506 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516500+0000", 2024-04-26T10:44:30.506 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5480000000000007e-06 2024-04-26T10:44:30.506 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.506 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.506 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.506 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516511+0000", 2024-04-26T10:44:30.506 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0719e-05 2024-04-26T10:44:30.506 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.506 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.506 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.506 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536737+0000", 2024-04-26T10:44:30.507 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020225770000000001 2024-04-26T10:44:30.507 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.507 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.507 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.507 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536783+0000", 2024-04-26T10:44:30.507 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6168999999999998e-05 2024-04-26T10:44:30.507 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.507 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.507 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:30.507 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544080+0000", 2024-04-26T10:44:30.507 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0072966799999999998 2024-04-26T10:44:30.507 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.507 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.508 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:30.508 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544111+0000", 2024-04-26T10:44:30.508 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1056999999999998e-05 2024-04-26T10:44:30.508 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.508 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.508 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:30.508 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544152+0000", 2024-04-26T10:44:30.508 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1452000000000002e-05 2024-04-26T10:44:30.508 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.508 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.508 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.508 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.508 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.508 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:337 3.13 3:ceffbd45:::200.0000000a:head [write 1342136~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:30.509 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:30.509 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 3.947997939, 2024-04-26T10:44:30.509 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027711237, 2024-04-26T10:44:30.509 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.509 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:30.509 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.509 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.509 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.509 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:30.509 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.509 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.509 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.510 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.510 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:30.510 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.510 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.510 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.510 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.510 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516517+0000", 2024-04-26T10:44:30.510 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:30.510 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.510 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.510 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.510 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516521+0000", 2024-04-26T10:44:30.510 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6200000000000001e-06 2024-04-26T10:44:30.511 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.511 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.511 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.511 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516528+0000", 2024-04-26T10:44:30.511 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8639999999999998e-06 2024-04-26T10:44:30.511 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.511 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.511 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.511 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516533+0000", 2024-04-26T10:44:30.511 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6310000000000002e-06 2024-04-26T10:44:30.511 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.511 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.511 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.511 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537231+0000", 2024-04-26T10:44:30.512 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020698613000000001 2024-04-26T10:44:30.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.512 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.512 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.512 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537273+0000", 2024-04-26T10:44:30.512 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1529000000000002e-05 2024-04-26T10:44:30.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.512 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.512 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:30.512 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544157+0000", 2024-04-26T10:44:30.512 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068847090000000001 2024-04-26T10:44:30.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.512 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.513 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:30.513 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544180+0000", 2024-04-26T10:44:30.513 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.2532e-05 2024-04-26T10:44:30.513 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.513 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.513 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:30.513 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544229+0000", 2024-04-26T10:44:30.513 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9190000000000002e-05 2024-04-26T10:44:30.513 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.513 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.513 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.513 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.513 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.513 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:338 3.13 3:ceffbd45:::200.0000000a:head [write 1344569~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:30.514 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:30.514 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 3.9473316860000001, 2024-04-26T10:44:30.514 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027105598000000002, 2024-04-26T10:44:30.514 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.514 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:30.514 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.514 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.514 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.514 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:30.514 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.514 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.514 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.514 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.514 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:30.515 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.515 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.515 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.515 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.515 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517183+0000", 2024-04-26T10:44:30.515 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:30.515 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.515 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.515 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.515 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517188+0000", 2024-04-26T10:44:30.515 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7389999999999999e-06 2024-04-26T10:44:30.515 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.515 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.515 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.516 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517199+0000", 2024-04-26T10:44:30.516 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0652000000000001e-05 2024-04-26T10:44:30.516 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.516 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.516 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.516 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517206+0000", 2024-04-26T10:44:30.516 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6610000000000003e-06 2024-04-26T10:44:30.516 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.516 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.516 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.516 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537905+0000", 2024-04-26T10:44:30.516 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020699662000000001 2024-04-26T10:44:30.516 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.517 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.517 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.517 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537956+0000", 2024-04-26T10:44:30.517 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0954e-05 2024-04-26T10:44:30.517 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.517 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.517 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:30.517 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544233+0000", 2024-04-26T10:44:30.517 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062773009999999999 2024-04-26T10:44:30.517 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.517 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.517 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:30.517 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544258+0000", 2024-04-26T10:44:30.518 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4434999999999999e-05 2024-04-26T10:44:30.518 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.518 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.518 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:30.518 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544290+0000", 2024-04-26T10:44:30.518 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1918000000000002e-05 2024-04-26T10:44:30.518 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.518 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.518 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.518 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.518 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.518 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:339 3.13 3:ceffbd45:::200.0000000a:head [write 1346485~4322 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:30.518 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:30.518 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 3.946393193, 2024-04-26T10:44:30.518 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026221617999999999, 2024-04-26T10:44:30.519 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.519 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:30.519 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.519 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.519 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.519 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:30.519 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.519 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.519 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.519 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.519 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:30.519 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.519 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.519 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.520 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.520 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518122+0000", 2024-04-26T10:44:30.520 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:30.520 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.520 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.520 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.520 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518129+0000", 2024-04-26T10:44:30.520 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.43e-06 2024-04-26T10:44:30.520 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.520 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.520 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.520 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518138+0000", 2024-04-26T10:44:30.520 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9129999999999992e-06 2024-04-26T10:44:30.520 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.521 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.521 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.521 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518144+0000", 2024-04-26T10:44:30.521 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.1419999999999998e-06 2024-04-26T10:44:30.521 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.521 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.521 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.521 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538232+0000", 2024-04-26T10:44:30.521 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020087383 2024-04-26T10:44:30.521 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.521 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.521 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.521 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538274+0000", 2024-04-26T10:44:30.521 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2602999999999999e-05 2024-04-26T10:44:30.522 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.522 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.522 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:30.522 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544294+0000", 2024-04-26T10:44:30.522 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060194059999999997 2024-04-26T10:44:30.522 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.522 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.522 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:30.522 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544314+0000", 2024-04-26T10:44:30.522 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0091000000000001e-05 2024-04-26T10:44:30.522 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.522 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.522 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:30.522 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544344+0000", 2024-04-26T10:44:30.523 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0446e-05 2024-04-26T10:44:30.523 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.523 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.523 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.523 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.523 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.523 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:340 3.13 3:ceffbd45:::200.0000000a:head [write 1350807~2768 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:30.523 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:30.523 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 3.9439089570000001, 2024-04-26T10:44:30.523 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023795594, 2024-04-26T10:44:30.523 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.523 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:30.523 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.523 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.523 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.524 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:30.524 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.524 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.524 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.524 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.524 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:30.524 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.524 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.524 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.524 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.524 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520606+0000", 2024-04-26T10:44:30.524 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:30.524 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.524 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.525 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.525 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520612+0000", 2024-04-26T10:44:30.525 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.835e-06 2024-04-26T10:44:30.525 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.525 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.525 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.525 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520622+0000", 2024-04-26T10:44:30.525 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0173999999999999e-05 2024-04-26T10:44:30.525 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.525 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.525 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.525 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520629+0000", 2024-04-26T10:44:30.525 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7460000000000003e-06 2024-04-26T10:44:30.525 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.526 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.526 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.526 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538651+0000", 2024-04-26T10:44:30.526 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018022474 2024-04-26T10:44:30.526 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.526 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.526 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.526 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538697+0000", 2024-04-26T10:44:30.526 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6183999999999997e-05 2024-04-26T10:44:30.526 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.526 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.526 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:30.526 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544348+0000", 2024-04-26T10:44:30.526 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0056503509999999996 2024-04-26T10:44:30.527 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.527 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.527 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:30.527 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544369+0000", 2024-04-26T10:44:30.527 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1064999999999999e-05 2024-04-26T10:44:30.527 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.527 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.527 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:30.527 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544403+0000", 2024-04-26T10:44:30.527 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3695000000000002e-05 2024-04-26T10:44:30.527 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.527 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.527 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.527 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.528 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.528 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:341 3.13 3:ceffbd45:::200.0000000a:head [write 1353575~3816 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:30.528 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:30.528 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 3.9431737020000002, 2024-04-26T10:44:30.528 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023114967, 2024-04-26T10:44:30.528 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.528 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:30.528 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.528 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.528 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.528 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:30.528 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.528 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.528 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.528 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.529 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:30.529 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.529 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.529 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.529 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.529 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521341+0000", 2024-04-26T10:44:30.529 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:30.529 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.529 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.529 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.529 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521349+0000", 2024-04-26T10:44:30.529 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1550000000000001e-06 2024-04-26T10:44:30.530 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.530 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.530 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.530 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521358+0000", 2024-04-26T10:44:30.530 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.1500000000000005e-06 2024-04-26T10:44:30.530 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.530 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.530 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.530 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521364+0000", 2024-04-26T10:44:30.530 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3289999999999999e-06 2024-04-26T10:44:30.530 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.530 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.530 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.530 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539010+0000", 2024-04-26T10:44:30.531 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.017645965999999999 2024-04-26T10:44:30.531 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.531 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.531 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.531 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539051+0000", 2024-04-26T10:44:30.531 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.053e-05 2024-04-26T10:44:30.531 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.531 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.531 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:30.531 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544407+0000", 2024-04-26T10:44:30.531 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053560209999999999 2024-04-26T10:44:30.531 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.532 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.532 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:30.532 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544427+0000", 2024-04-26T10:44:30.532 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0228e-05 2024-04-26T10:44:30.532 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.532 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.532 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:30.532 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544457+0000", 2024-04-26T10:44:30.532 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0375e-05 2024-04-26T10:44:30.532 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.532 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.532 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.532 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.533 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.533 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11582 4.2f 4:f76ba295:::10000003252.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:30.533 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:30.533 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 1.469558157, 2024-04-26T10:44:30.533 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024553994999999999, 2024-04-26T10:44:30.533 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.533 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:30.533 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:30.533 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:30.533 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:30.533 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11582 2024-04-26T10:44:30.533 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.533 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.533 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.534 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.534 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:30.534 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.534 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.534 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.534 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:30.534 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.534 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.534 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.534 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994957+0000", 2024-04-26T10:44:30.534 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:30.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.535 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.535 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.535 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002755+0000", 2024-04-26T10:44:30.535 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0077984719999999999 2024-04-26T10:44:30.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.535 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.535 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.535 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002770+0000", 2024-04-26T10:44:30.535 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4956e-05 2024-04-26T10:44:30.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.535 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.535 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.536 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002777+0000", 2024-04-26T10:44:30.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1899999999999998e-06 2024-04-26T10:44:30.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.536 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.536 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.536 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002833+0000", 2024-04-26T10:44:30.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5189999999999998e-05 2024-04-26T10:44:30.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.536 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.536 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.536 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002977+0000", 2024-04-26T10:44:30.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014444100000000001 2024-04-26T10:44:30.537 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.537 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.537 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:30.537 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.003108+0000", 2024-04-26T10:44:30.537 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000131068 2024-04-26T10:44:30.537 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.537 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.537 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:30.537 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.009040+0000", 2024-04-26T10:44:30.537 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059314149999999998 2024-04-26T10:44:30.537 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.537 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.537 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:30.538 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019462+0000", 2024-04-26T10:44:30.538 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010422803 2024-04-26T10:44:30.538 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.538 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.538 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:30.538 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019490+0000", 2024-04-26T10:44:30.538 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7773999999999999e-05 2024-04-26T10:44:30.538 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.538 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.538 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:30.538 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019512+0000", 2024-04-26T10:44:30.538 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1611999999999999e-05 2024-04-26T10:44:30.539 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.539 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.539 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.539 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.539 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.539 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11911 4.37 4:ec04ab04:::100000031ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:30.539 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:30.539 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 1.12783795, 2024-04-26T10:44:30.539 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026810273999999999, 2024-04-26T10:44:30.539 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.539 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:30.540 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:30.540 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:30.540 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:30.540 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11911 2024-04-26T10:44:30.540 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.540 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.540 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.540 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.540 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:30.540 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.540 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.540 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.541 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.541 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:30.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.541 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.541 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336676+0000", 2024-04-26T10:44:30.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:30.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.541 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.541 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343119+0000", 2024-04-26T10:44:30.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0064424850000000004 2024-04-26T10:44:30.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.542 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.542 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343131+0000", 2024-04-26T10:44:30.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1708e-05 2024-04-26T10:44:30.542 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.542 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.542 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343137+0000", 2024-04-26T10:44:30.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9880000000000001e-06 2024-04-26T10:44:30.542 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.542 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.542 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343175+0000", 2024-04-26T10:44:30.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7913000000000001e-05 2024-04-26T10:44:30.543 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.543 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.543 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.543 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343269+0000", 2024-04-26T10:44:30.543 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4931000000000003e-05 2024-04-26T10:44:30.543 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.543 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.543 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:30.543 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343392+0000", 2024-04-26T10:44:30.543 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000122435 2024-04-26T10:44:30.543 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.543 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.543 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:30.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.347520+0000", 2024-04-26T10:44:30.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004128418 2024-04-26T10:44:30.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:30.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363410+0000", 2024-04-26T10:44:30.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.015889309000000001 2024-04-26T10:44:30.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:30.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363453+0000", 2024-04-26T10:44:30.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3244000000000001e-05 2024-04-26T10:44:30.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.545 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:30.545 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363488+0000", 2024-04-26T10:44:30.545 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5318000000000003e-05 2024-04-26T10:44:30.545 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.545 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.545 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.545 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.545 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12000 4.3c 4:3c2be35d:::100000030f7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:30.545 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:30.545 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 1.045216438, 2024-04-26T10:44:30.545 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022808264000000002, 2024-04-26T10:44:30.546 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.546 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:30.546 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:30.546 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:30.546 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:30.546 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12000 2024-04-26T10:44:30.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.546 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.546 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.546 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:30.546 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:30.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.547 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:30.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:30.547 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430937+0000", 2024-04-26T10:44:30.548 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.011638097 2024-04-26T10:44:30.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.548 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.548 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.548 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430948+0000", 2024-04-26T10:44:30.548 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0824e-05 2024-04-26T10:44:30.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.548 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.548 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.548 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430953+0000", 2024-04-26T10:44:30.548 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5219999999999998e-06 2024-04-26T10:44:30.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.548 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.549 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.549 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430990+0000", 2024-04-26T10:44:30.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6458999999999998e-05 2024-04-26T10:44:30.549 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.549 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.549 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.431052+0000", 2024-04-26T10:44:30.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2687000000000005e-05 2024-04-26T10:44:30.549 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.549 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:30.549 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442027+0000", 2024-04-26T10:44:30.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010974513 2024-04-26T10:44:30.549 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:30.550 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442060+0000", 2024-04-26T10:44:30.550 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2849999999999999e-05 2024-04-26T10:44:30.550 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:30.550 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442108+0000", 2024-04-26T10:44:30.550 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8031999999999997e-05 2024-04-26T10:44:30.550 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.550 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.550 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.550 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.551 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.551 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12042 4.2f 4:f741970f:::10000003414.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:30.551 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:30.551 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 1.005962961, 2024-04-26T10:44:30.551 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.029390757, 2024-04-26T10:44:30.551 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.551 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:30.551 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:30.551 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:30.551 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:30.551 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12042 2024-04-26T10:44:30.551 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.551 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.551 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.552 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.552 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:30.552 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.552 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.552 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.552 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.552 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:30.552 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.552 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.552 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.552 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.552 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458552+0000", 2024-04-26T10:44:30.552 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:30.552 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.553 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.553 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.553 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464335+0000", 2024-04-26T10:44:30.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.005783168 2024-04-26T10:44:30.553 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.553 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.553 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.553 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464347+0000", 2024-04-26T10:44:30.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1578e-05 2024-04-26T10:44:30.553 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.553 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.553 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.554 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464353+0000", 2024-04-26T10:44:30.554 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3709999999999996e-06 2024-04-26T10:44:30.554 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.554 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.554 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.554 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464407+0000", 2024-04-26T10:44:30.554 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3717000000000001e-05 2024-04-26T10:44:30.554 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.554 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.554 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.554 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464556+0000", 2024-04-26T10:44:30.554 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014899100000000001 2024-04-26T10:44:30.554 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.555 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:30.555 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464688+0000", 2024-04-26T10:44:30.555 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013238599999999999 2024-04-26T10:44:30.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.555 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:30.555 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.469725+0000", 2024-04-26T10:44:30.555 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0050369229999999996 2024-04-26T10:44:30.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.555 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:30.555 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487892+0000", 2024-04-26T10:44:30.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018167184999999999 2024-04-26T10:44:30.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.556 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:30.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487922+0000", 2024-04-26T10:44:30.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.9495000000000001e-05 2024-04-26T10:44:30.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.556 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:30.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487944+0000", 2024-04-26T10:44:30.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1823000000000001e-05 2024-04-26T10:44:30.556 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.556 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.556 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.557 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.557 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.557 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12050 4.2c 4:36b72e58:::100000031ba.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:30.557 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:30.557 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.99742235199999996, 2024-04-26T10:44:30.557 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022722497000000001, 2024-04-26T10:44:30.557 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.557 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:30.557 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:30.557 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:30.557 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:30.557 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12050 2024-04-26T10:44:30.557 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.557 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.558 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.558 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:30.558 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.558 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.558 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.558 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:30.558 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.558 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.558 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.558 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467093+0000", 2024-04-26T10:44:30.558 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:30.559 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.559 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.559 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.559 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476305+0000", 2024-04-26T10:44:30.559 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092125850000000006 2024-04-26T10:44:30.559 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.559 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.559 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.559 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476322+0000", 2024-04-26T10:44:30.559 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6860000000000001e-05 2024-04-26T10:44:30.559 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.559 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.559 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.559 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476328+0000", 2024-04-26T10:44:30.560 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.587e-06 2024-04-26T10:44:30.560 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.560 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.560 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.560 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476378+0000", 2024-04-26T10:44:30.560 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0519999999999997e-05 2024-04-26T10:44:30.560 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.560 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.560 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.560 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476474+0000", 2024-04-26T10:44:30.560 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5556000000000005e-05 2024-04-26T10:44:30.560 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.560 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.561 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:30.561 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489677+0000", 2024-04-26T10:44:30.561 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013203048 2024-04-26T10:44:30.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.561 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.561 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:30.561 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489722+0000", 2024-04-26T10:44:30.561 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4650000000000001e-05 2024-04-26T10:44:30.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.561 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.561 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:30.561 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489816+0000", 2024-04-26T10:44:30.561 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4402999999999997e-05 2024-04-26T10:44:30.561 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.561 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.562 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.562 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.562 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.562 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12516 4.37 4:ed0cb515:::10000003324.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:30.562 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:30.562 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.47734078699999999, 2024-04-26T10:44:30.562 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.030139677, 2024-04-26T10:44:30.562 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.562 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:30.562 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:30.562 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:30.562 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:30.562 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12516 2024-04-26T10:44:30.562 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.563 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.563 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.563 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.563 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:30.563 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.563 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.563 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.563 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.563 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:30.563 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.563 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.563 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.563 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.563 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987173+0000", 2024-04-26T10:44:30.564 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:30.564 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.564 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.564 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991339+0000", 2024-04-26T10:44:30.564 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0041663760000000003 2024-04-26T10:44:30.564 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.564 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.564 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991351+0000", 2024-04-26T10:44:30.564 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1333e-05 2024-04-26T10:44:30.564 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.564 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.565 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991357+0000", 2024-04-26T10:44:30.565 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3350000000000003e-06 2024-04-26T10:44:30.565 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.565 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.565 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.565 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991394+0000", 2024-04-26T10:44:30.565 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7054000000000001e-05 2024-04-26T10:44:30.565 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.565 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.565 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.565 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991495+0000", 2024-04-26T10:44:30.565 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000100386 2024-04-26T10:44:30.565 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.565 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.566 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:30.566 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991579+0000", 2024-04-26T10:44:30.566 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4295000000000005e-05 2024-04-26T10:44:30.566 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.566 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.566 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:30.566 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.996238+0000", 2024-04-26T10:44:30.566 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0046589309999999998 2024-04-26T10:44:30.566 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.566 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.566 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:30.566 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017237+0000", 2024-04-26T10:44:30.567 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020998993000000001 2024-04-26T10:44:30.567 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.567 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.567 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:30.567 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017280+0000", 2024-04-26T10:44:30.567 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3600000000000003e-05 2024-04-26T10:44:30.567 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.567 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.567 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:30.567 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017315+0000", 2024-04-26T10:44:30.567 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4381999999999997e-05 2024-04-26T10:44:30.567 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.567 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.567 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.567 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.568 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.568 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12644 4.37 4:ec5044d7:::100000032d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:30.568 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:30.568 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.30366795899999999, 2024-04-26T10:44:30.568 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.037018677, 2024-04-26T10:44:30.568 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:30.568 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:30.568 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:30.568 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:30.568 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:30.568 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12644 2024-04-26T10:44:30.568 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.568 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:30.568 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.569 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:30.569 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:30.569 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.569 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.569 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.569 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:30.569 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:30.569 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:30.569 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.569 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.569 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:30.569 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160847+0000", 2024-04-26T10:44:30.569 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:30.569 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.570 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.570 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:30.570 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170089+0000", 2024-04-26T10:44:30.570 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092424289999999999 2024-04-26T10:44:30.570 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.570 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.570 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:30.570 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170111+0000", 2024-04-26T10:44:30.570 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1733e-05 2024-04-26T10:44:30.570 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.570 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.570 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.570 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170124+0000", 2024-04-26T10:44:30.570 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.272e-05 2024-04-26T10:44:30.571 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.571 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.571 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:30.571 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170177+0000", 2024-04-26T10:44:30.571 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3745000000000001e-05 2024-04-26T10:44:30.571 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.571 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.571 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:30.571 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170350+0000", 2024-04-26T10:44:30.571 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017297699999999999 2024-04-26T10:44:30.571 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.571 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.571 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:30.571 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170458+0000", 2024-04-26T10:44:30.572 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000107583 2024-04-26T10:44:30.572 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.572 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.572 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:30.572 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.176693+0000", 2024-04-26T10:44:30.572 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062351799999999999 2024-04-26T10:44:30.572 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.572 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.572 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:30.572 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197774+0000", 2024-04-26T10:44:30.572 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021080471999999999 2024-04-26T10:44:30.572 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.572 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.572 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:30.572 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197824+0000", 2024-04-26T10:44:30.573 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0096000000000003e-05 2024-04-26T10:44:30.573 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:30.573 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:30.573 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:30.573 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197867+0000", 2024-04-26T10:44:30.573 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2882e-05 2024-04-26T10:44:30.573 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.573 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.573 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.573 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:30.573 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:30.573 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:30.576 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:30.574+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:30.576 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:30.597 INFO:tasks.workunit.client.0.smithi049.stdout:1/473: link l1c d1e/d20/d26/d37/d69/d75/l94 0 2024-04-26T10:44:30.597 INFO:tasks.workunit.client.0.smithi049.stdout:8/559: dread d2/df/d10/d23/d6c/f2c [0,4194304] 0 2024-04-26T10:44:30.597 INFO:tasks.workunit.client.0.smithi049.stdout:2/496: dwrite d6/f84 [0,4194304] 0 2024-04-26T10:44:30.597 INFO:tasks.workunit.client.0.smithi049.stdout:6/510: dread da/dd/f13 [0,4194304] 0 2024-04-26T10:44:30.597 INFO:tasks.workunit.client.0.smithi049.stdout:2/497: stat d6/l36 0 2024-04-26T10:44:30.597 INFO:tasks.workunit.client.0.smithi049.stdout:4/593: sync 2024-04-26T10:44:30.597 INFO:tasks.workunit.client.0.smithi049.stdout:9/631: mknod d2/d1a/d1b/d1f/d64/cce 0 2024-04-26T10:44:30.598 INFO:tasks.workunit.client.0.smithi049.stdout:3/442: dread d3/d23/d2f/d6a/d6b/d26/f2b [0,4194304] 0 2024-04-26T10:44:30.598 INFO:tasks.workunit.client.0.smithi049.stdout:0/534: rename d8/d1e/d6a to d8/db/d11/d1c/dbb 0 2024-04-26T10:44:30.598 INFO:tasks.workunit.client.0.smithi049.stdout:6/511: chown l3 458 1 2024-04-26T10:44:30.598 INFO:tasks.workunit.client.0.smithi049.stdout:0/535: chown d8/db/d11 121363407 1 2024-04-26T10:44:30.598 INFO:tasks.workunit.client.0.smithi049.stdout:8/560: getdents d2/d16/d19/d42/daf 0 2024-04-26T10:44:30.598 INFO:tasks.workunit.client.0.smithi049.stdout:2/498: link d6/d9/db/d34/d38/d3f/f45 d6/d9/db/d34/d38/d3f/d60/f93 0 2024-04-26T10:44:30.598 INFO:tasks.workunit.client.0.smithi049.stdout:9/632: mknod d2/d1a/d1b/d1f/d64/ccf 0 2024-04-26T10:44:30.598 INFO:tasks.workunit.client.0.smithi049.stdout:0/536: write d8/db/d11/d1c/dbb/f9e [694038,123192] 0 2024-04-26T10:44:30.598 INFO:tasks.workunit.client.0.smithi049.stdout:6/512: unlink da/dd/d47/f49 0 2024-04-26T10:44:30.598 INFO:tasks.workunit.client.0.smithi049.stdout:8/561: unlink d2/df/d10/l3c 0 2024-04-26T10:44:30.598 INFO:tasks.workunit.client.0.smithi049.stdout:2/499: fdatasync d6/d9/db/d35/f90 0 2024-04-26T10:44:30.598 INFO:tasks.workunit.client.0.smithi049.stdout:9/633: creat d2/d1a/d1b/d1f/fd0 x:0 0 0 2024-04-26T10:44:30.598 INFO:tasks.workunit.client.0.smithi049.stdout:3/443: creat d3/d23/d2f/d6a/d6b/d8/d55/f99 x:0 0 0 2024-04-26T10:44:30.599 INFO:tasks.workunit.client.0.smithi049.stdout:8/562: truncate d2/d16/d19/d42/f4e 5237110 0 2024-04-26T10:44:30.599 INFO:tasks.workunit.client.0.smithi049.stdout:7/547: dread d2/dd/d38/f4c [0,4194304] 0 2024-04-26T10:44:30.599 INFO:tasks.workunit.client.0.smithi049.stdout:2/500: truncate d6/d9/db/d34/d38/d3f/f8b 428358 0 2024-04-26T10:44:30.599 INFO:tasks.workunit.client.0.smithi049.stdout:7/548: write d2/d3/f77 [4651595,124079] 0 2024-04-26T10:44:30.599 INFO:tasks.workunit.client.0.smithi049.stdout:8/563: truncate d2/d17/d34/d40/f71 4451895 0 2024-04-26T10:44:30.599 INFO:tasks.workunit.client.0.smithi049.stdout:2/501: truncate d6/f3b 1022159 0 2024-04-26T10:44:30.599 INFO:tasks.workunit.client.0.smithi049.stdout:8/564: mknod d2/df/dab/cb6 0 2024-04-26T10:44:30.599 INFO:tasks.workunit.client.0.smithi049.stdout:7/549: write d2/d3/f20 [1492372,74983] 0 2024-04-26T10:44:30.599 INFO:tasks.workunit.client.0.smithi049.stdout:2/502: write d6/d9/db/d35/d91/f92 [791155,95954] 0 2024-04-26T10:44:30.599 INFO:tasks.workunit.client.0.smithi049.stdout:8/565: mknod d2/df/d10/d23/cb7 0 2024-04-26T10:44:30.599 INFO:tasks.workunit.client.0.smithi049.stdout:7/550: creat d2/d3/d96/fb4 x:0 0 0 2024-04-26T10:44:30.599 INFO:tasks.workunit.client.0.smithi049.stdout:3/444: dwrite d3/d23/d2f/d6a/d6b/d8/d34/f51 [0,4194304] 0 2024-04-26T10:44:30.599 INFO:tasks.workunit.client.0.smithi049.stdout:8/566: fsync d2/df/f5a 0 2024-04-26T10:44:30.600 INFO:tasks.workunit.client.0.smithi049.stdout:2/503: creat d6/d9/f94 x:0 0 0 2024-04-26T10:44:30.600 INFO:tasks.workunit.client.0.smithi049.stdout:3/445: dread - d3/d23/d2f/d6a/d6b/d8/d34/f83 zero size 2024-04-26T10:44:30.600 INFO:tasks.workunit.client.0.smithi049.stdout:2/504: symlink d6/d9/d5f/l95 0 2024-04-26T10:44:30.600 INFO:tasks.workunit.client.0.smithi049.stdout:7/551: creat d2/dd/d7f/db1/fb5 x:0 0 0 2024-04-26T10:44:30.600 INFO:tasks.workunit.client.0.smithi049.stdout:7/552: dread - d2/fa0 zero size 2024-04-26T10:44:30.600 INFO:tasks.workunit.client.0.smithi049.stdout:2/505: creat d6/d9/d5f/f96 x:0 0 0 2024-04-26T10:44:30.600 INFO:tasks.workunit.client.0.smithi049.stdout:8/567: write d2/d16/d19/fb0 [480731,85037] 0 2024-04-26T10:44:30.600 INFO:tasks.workunit.client.0.smithi049.stdout:9/634: sync 2024-04-26T10:44:30.600 INFO:tasks.workunit.client.0.smithi049.stdout:3/446: rename d3/d23/d2f/d6a/d6b/d8/c60 to d3/d23/d2f/d6a/d6b/d26/d29/c9a 0 2024-04-26T10:44:30.600 INFO:tasks.workunit.client.0.smithi049.stdout:9/635: mkdir d2/d1a/d42/dd1 0 2024-04-26T10:44:30.600 INFO:tasks.workunit.client.0.smithi049.stdout:0/537: dwrite d8/db/d26/f97 [0,4194304] 0 2024-04-26T10:44:30.600 INFO:tasks.workunit.client.0.smithi049.stdout:4/594: dread de/d1b/f1c [0,4194304] 0 2024-04-26T10:44:30.600 INFO:tasks.workunit.client.0.smithi049.stdout:9/636: read - d2/d1a/d1b/f7f zero size 2024-04-26T10:44:30.600 INFO:tasks.workunit.client.0.smithi049.stdout:8/568: link d2/df/f83 d2/d1a/d9c/fb8 0 2024-04-26T10:44:30.601 INFO:tasks.workunit.client.0.smithi049.stdout:4/595: chown de/d1b/d5e/da2/fa9 1394 1 2024-04-26T10:44:30.601 INFO:tasks.workunit.client.0.smithi049.stdout:3/447: creat d3/d23/d2f/d6a/d6b/d26/d65/f9b x:0 0 0 2024-04-26T10:44:30.601 INFO:tasks.workunit.client.0.smithi049.stdout:7/553: dwrite d2/dd/d48/d5c/f9d [0,4194304] 0 2024-04-26T10:44:30.601 INFO:tasks.workunit.client.0.smithi049.stdout:0/538: mknod d8/d42/cbc 0 2024-04-26T10:44:30.601 INFO:tasks.workunit.client.0.smithi049.stdout:2/506: write d6/d9/db/d34/f5a [740872,67464] 0 2024-04-26T10:44:30.601 INFO:tasks.workunit.client.0.smithi049.stdout:0/539: chown d8/d42 116553938 1 2024-04-26T10:44:30.601 INFO:tasks.workunit.client.0.smithi049.stdout:9/637: symlink d2/d25/dc5/ld2 0 2024-04-26T10:44:30.601 INFO:tasks.workunit.client.0.smithi049.stdout:7/554: write d2/f53 [2529150,60102] 0 2024-04-26T10:44:30.601 INFO:tasks.workunit.client.0.smithi049.stdout:9/638: creat d2/d1a/d1b/fd3 x:0 0 0 2024-04-26T10:44:30.601 INFO:tasks.workunit.client.0.smithi049.stdout:7/555: creat d2/dd/d45/d82/fb6 x:0 0 0 2024-04-26T10:44:30.601 INFO:tasks.workunit.client.0.smithi049.stdout:2/507: unlink d6/d9/db/d34/d38/d73/f8d 0 2024-04-26T10:44:30.601 INFO:tasks.workunit.client.0.smithi049.stdout:3/448: rmdir d3/d23/d2f/d6a/d6b/d26/d5f 39 2024-04-26T10:44:30.601 INFO:tasks.workunit.client.0.smithi049.stdout:9/639: write d2/d1a/df/f56 [2268860,86431] 0 2024-04-26T10:44:30.601 INFO:tasks.workunit.client.0.smithi049.stdout:2/508: rmdir d6/d9/db/d1e 39 2024-04-26T10:44:30.601 INFO:tasks.workunit.client.0.smithi049.stdout:8/569: dwrite d2/d16/d19/f55 [0,4194304] 0 2024-04-26T10:44:30.602 INFO:tasks.workunit.client.0.smithi049.stdout:2/509: mkdir d6/d30/d97 0 2024-04-26T10:44:30.602 INFO:tasks.workunit.client.0.smithi049.stdout:5/535: dread d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d60/f72 [0,4194304] 0 2024-04-26T10:44:30.602 INFO:tasks.workunit.client.0.smithi049.stdout:9/640: write d2/d25/d74/fbb [330135,35050] 0 2024-04-26T10:44:30.602 INFO:tasks.workunit.client.0.smithi049.stdout:0/540: dwrite d8/d66/d84/f8c [0,4194304] 0 2024-04-26T10:44:30.602 INFO:tasks.workunit.client.0.smithi049.stdout:3/449: truncate d3/d23/d2f/d6a/d6b/d8/d55/d46/f94 87893 0 2024-04-26T10:44:30.602 INFO:tasks.workunit.client.0.smithi049.stdout:2/510: mknod d6/d9/db/d11/d6a/c98 0 2024-04-26T10:44:30.602 INFO:tasks.workunit.client.0.smithi049.stdout:0/541: read d8/d66/f69 [2831687,80100] 0 2024-04-26T10:44:30.602 INFO:tasks.workunit.client.0.smithi049.stdout:8/570: rename d2/df/d10/f66 to d2/df/d10/d47/d75/fb9 0 2024-04-26T10:44:30.602 INFO:tasks.workunit.client.0.smithi049.stdout:0/542: fsync d8/db/d11/f65 0 2024-04-26T10:44:30.602 INFO:tasks.workunit.client.0.smithi049.stdout:9/641: getdents d2/d25 0 2024-04-26T10:44:30.602 INFO:tasks.workunit.client.0.smithi049.stdout:3/450: mknod d3/d23/d2f/d6a/d6b/d26/d65/d70/c9c 0 2024-04-26T10:44:30.602 INFO:tasks.workunit.client.0.smithi049.stdout:8/571: chown d2/df/d10/c7b 1 1 2024-04-26T10:44:30.603 INFO:tasks.workunit.client.0.smithi049.stdout:9/642: unlink d2/d1a/d42/f92 0 2024-04-26T10:44:30.603 INFO:tasks.workunit.client.0.smithi049.stdout:0/543: chown d8/d41/ca2 11 1 2024-04-26T10:44:30.603 INFO:tasks.workunit.client.0.smithi049.stdout:8/572: fdatasync d2/d16/d19/d42/f96 0 2024-04-26T10:44:30.603 INFO:tasks.workunit.client.0.smithi049.stdout:1/474: dread fd [0,4194304] 0 2024-04-26T10:44:30.603 INFO:tasks.workunit.client.0.smithi049.stdout:3/451: write d3/d23/d2f/d6a/d6b/d8/d34/f64 [10830,70046] 0 2024-04-26T10:44:30.603 INFO:tasks.workunit.client.0.smithi049.stdout:9/643: mknod d2/d40/d53/cd4 0 2024-04-26T10:44:30.603 INFO:tasks.workunit.client.0.smithi049.stdout:9/644: sync 2024-04-26T10:44:30.603 INFO:tasks.workunit.client.0.smithi049.stdout:8/573: rmdir d2/df/d10/d23 39 2024-04-26T10:44:30.603 INFO:tasks.workunit.client.0.smithi049.stdout:0/544: mknod d8/db/d11/d1c/db8/cbd 0 2024-04-26T10:44:30.603 INFO:tasks.workunit.client.0.smithi049.stdout:0/545: creat d8/da5/fbe x:0 0 0 2024-04-26T10:44:30.603 INFO:tasks.workunit.client.0.smithi049.stdout:7/556: dread d2/dd/d45/d82/f8a [0,4194304] 0 2024-04-26T10:44:30.603 INFO:tasks.workunit.client.0.smithi049.stdout:1/475: symlink d1e/d20/d26/d3c/d54/d59/d68/l95 0 2024-04-26T10:44:30.603 INFO:tasks.workunit.client.0.smithi049.stdout:6/513: dread da/dd/de/d11/f5d [0,4194304] 0 2024-04-26T10:44:30.603 INFO:tasks.workunit.client.0.smithi049.stdout:5/536: dread d7/d1d/d1f/f51 [0,4194304] 0 2024-04-26T10:44:30.604 INFO:tasks.workunit.client.0.smithi049.stdout:3/452: link d3/d23/d2f/d6a/d6b/d8/d55/f98 d3/d23/d2f/d6a/d6b/d8/dd/f9d 0 2024-04-26T10:44:30.604 INFO:tasks.workunit.client.0.smithi049.stdout:1/476: chown d1e/f6f 590 1 2024-04-26T10:44:30.604 INFO:tasks.workunit.client.0.smithi049.stdout:0/546: rename d8/d66/lac to d8/d1e/d98/lbf 0 2024-04-26T10:44:30.604 INFO:tasks.workunit.client.0.smithi049.stdout:1/477: read d1e/f44 [636594,14134] 0 2024-04-26T10:44:30.604 INFO:tasks.workunit.client.0.smithi049.stdout:5/537: dread - d7/d1d/d1f/d4e/d65/f92 zero size 2024-04-26T10:44:30.604 INFO:tasks.workunit.client.0.smithi049.stdout:6/514: mknod da/dd/de/d42/d5a/cac 0 2024-04-26T10:44:30.604 INFO:tasks.workunit.client.0.smithi049.stdout:0/547: creat d8/db/d93/fc0 x:0 0 0 2024-04-26T10:44:30.604 INFO:tasks.workunit.client.0.smithi049.stdout:8/574: dread d2/d1a/f1e [0,4194304] 0 2024-04-26T10:44:30.604 INFO:tasks.workunit.client.0.smithi049.stdout:5/538: write d7/dc6/fd8 [541028,71302] 0 2024-04-26T10:44:30.604 INFO:tasks.workunit.client.0.smithi049.stdout:9/645: dwrite d2/d1a/d9c/fa7 [0,4194304] 0 2024-04-26T10:44:30.604 INFO:tasks.workunit.client.0.smithi049.stdout:7/557: dwrite d2/f4f [0,4194304] 0 2024-04-26T10:44:30.604 INFO:tasks.workunit.client.0.smithi049.stdout:0/548: write d8/db/d26/d6f/f9c [3076082,81574] 0 2024-04-26T10:44:30.604 INFO:tasks.workunit.client.0.smithi049.stdout:8/575: creat d2/d89/d30/fba x:0 0 0 2024-04-26T10:44:30.605 INFO:tasks.workunit.client.0.smithi049.stdout:7/558: chown d2/d3/d96/fb4 1713345 1 2024-04-26T10:44:30.605 INFO:tasks.workunit.client.0.smithi049.stdout:1/478: write d1e/d20/d26/d3c/d54/d59/d73/f7e [594503,17626] 0 2024-04-26T10:44:30.605 INFO:tasks.workunit.client.0.smithi049.stdout:5/539: rename d7/d1d/d1f/d4e/d65/d6f/d91/l50 to d7/d66/lde 0 2024-04-26T10:44:30.605 INFO:tasks.workunit.client.0.smithi049.stdout:0/549: mkdir d8/db/d11/d1c/dbb/dc1 0 2024-04-26T10:44:30.605 INFO:tasks.workunit.client.0.smithi049.stdout:8/576: unlink d2/d16/d19/d42/d7c/ca0 0 2024-04-26T10:44:30.605 INFO:tasks.workunit.client.0.smithi049.stdout:1/479: mkdir d1e/d20/d26/d3c/d96 0 2024-04-26T10:44:30.605 INFO:tasks.workunit.client.0.smithi049.stdout:0/550: dread - d8/d66/fb4 zero size 2024-04-26T10:44:30.605 INFO:tasks.workunit.client.0.smithi049.stdout:5/540: symlink d7/d14/d18/d2b/ldf 0 2024-04-26T10:44:30.605 INFO:tasks.workunit.client.0.smithi049.stdout:1/480: chown l13 32384146 1 2024-04-26T10:44:30.605 INFO:tasks.workunit.client.0.smithi049.stdout:6/515: dwrite da/dd/de/d11/f5d [0,4194304] 0 2024-04-26T10:44:30.605 INFO:tasks.workunit.client.0.smithi049.stdout:9/646: link d2/d1a/d1b/d1f/d64/f85 d2/d1a/d1b/d1f/d34/fd5 0 2024-04-26T10:44:30.605 INFO:tasks.workunit.client.0.smithi049.stdout:4/596: dread de/f15 [0,4194304] 0 2024-04-26T10:44:30.605 INFO:tasks.workunit.client.0.smithi049.stdout:2/511: dread d6/d9/db/d1e/f81 [0,4194304] 0 2024-04-26T10:44:30.606 INFO:tasks.workunit.client.0.smithi049.stdout:5/541: readlink d7/d14/d18/l45 0 2024-04-26T10:44:30.606 INFO:tasks.workunit.client.0.smithi049.stdout:9/647: dread - d2/d1a/d1b/d1f/fd0 zero size 2024-04-26T10:44:30.606 INFO:tasks.workunit.client.0.smithi049.stdout:8/577: creat d2/df/d10/d23/d6c/fbb x:0 0 0 2024-04-26T10:44:30.606 INFO:tasks.workunit.client.0.smithi049.stdout:2/512: fsync d6/d9/f94 0 2024-04-26T10:44:30.606 INFO:tasks.workunit.client.0.smithi049.stdout:1/481: getdents d1e/d20 0 2024-04-26T10:44:30.606 INFO:tasks.workunit.client.0.smithi049.stdout:9/648: stat d2/d1a/df/f56 0 2024-04-26T10:44:30.606 INFO:tasks.workunit.client.0.smithi049.stdout:8/578: truncate d2/d89/d30/fba 218166 0 2024-04-26T10:44:30.606 INFO:tasks.workunit.client.0.smithi049.stdout:7/559: dwrite d2/f8c [0,4194304] 0 2024-04-26T10:44:30.606 INFO:tasks.workunit.client.0.smithi049.stdout:9/649: read - d2/d1a/d1b/fba zero size 2024-04-26T10:44:30.606 INFO:tasks.workunit.client.0.smithi049.stdout:2/513: mknod d6/d9/db/d11/d6a/c99 0 2024-04-26T10:44:30.606 INFO:tasks.workunit.client.0.smithi049.stdout:4/597: mkdir de/d1b/d5e/d72/d73/d84/d24/db4 0 2024-04-26T10:44:30.606 INFO:tasks.workunit.client.0.smithi049.stdout:7/560: rmdir d2/dd/d48/da3 39 2024-04-26T10:44:30.606 INFO:tasks.workunit.client.0.smithi049.stdout:8/579: rmdir d2/df/d10/d47 39 2024-04-26T10:44:30.606 INFO:tasks.workunit.client.0.smithi049.stdout:9/650: rmdir d2/d1a/d1b/d1f/d34/d6d 39 2024-04-26T10:44:30.607 INFO:tasks.workunit.client.0.smithi049.stdout:2/514: readlink d6/d30/l49 0 2024-04-26T10:44:30.607 INFO:tasks.workunit.client.0.smithi049.stdout:5/542: creat d7/d1d/d1f/d4e/d65/d6f/fe0 x:0 0 0 2024-04-26T10:44:30.607 INFO:tasks.workunit.client.0.smithi049.stdout:7/561: read - d2/d3/f56 zero size 2024-04-26T10:44:30.607 INFO:tasks.workunit.client.0.smithi049.stdout:4/598: mkdir de/d1b/d5e/d72/d73/d84/d4b/db5 0 2024-04-26T10:44:30.607 INFO:tasks.workunit.client.0.smithi049.stdout:7/562: write d2/dd/d38/f3d [1537653,56288] 0 2024-04-26T10:44:30.607 INFO:tasks.workunit.client.0.smithi049.stdout:9/651: write d2/d25/f6b [1196403,2647] 0 2024-04-26T10:44:30.607 INFO:tasks.workunit.client.0.smithi049.stdout:4/599: fdatasync de/d1b/f7a 0 2024-04-26T10:44:30.607 INFO:tasks.workunit.client.0.smithi049.stdout:8/580: link d2/d16/d19/f55 d2/d89/d2a/d9f/fbc 0 2024-04-26T10:44:30.607 INFO:tasks.workunit.client.0.smithi049.stdout:7/563: creat d2/fb7 x:0 0 0 2024-04-26T10:44:30.607 INFO:tasks.workunit.client.0.smithi049.stdout:4/600: dread - de/d1b/d5e/d72/d73/d84/f7e zero size 2024-04-26T10:44:30.607 INFO:tasks.workunit.client.0.smithi049.stdout:8/581: truncate d2/d1a/d9c/fb8 1491132 0 2024-04-26T10:44:30.607 INFO:tasks.workunit.client.0.smithi049.stdout:6/516: dread da/dd/de/d11/f43 [0,4194304] 0 2024-04-26T10:44:30.607 INFO:tasks.workunit.client.0.smithi049.stdout:7/564: getdents d2/d3 0 2024-04-26T10:44:30.607 INFO:tasks.workunit.client.0.smithi049.stdout:7/565: mkdir d2/d3/d96/db3/db8 0 2024-04-26T10:44:30.608 INFO:tasks.workunit.client.0.smithi049.stdout:6/517: symlink da/dd/d47/d7b/d84/daa/lad 0 2024-04-26T10:44:30.608 INFO:tasks.workunit.client.0.smithi049.stdout:9/652: read d2/d25/f6b [580781,54954] 0 2024-04-26T10:44:30.608 INFO:tasks.workunit.client.0.smithi049.stdout:8/582: write d2/df/f83 [866046,105156] 0 2024-04-26T10:44:30.608 INFO:tasks.workunit.client.0.smithi049.stdout:6/518: symlink da/dd/d47/d7b/d84/daa/lae 0 2024-04-26T10:44:30.608 INFO:tasks.workunit.client.0.smithi049.stdout:9/653: getdents d2/db9 0 2024-04-26T10:44:30.608 INFO:tasks.workunit.client.0.smithi049.stdout:9/654: readlink d2/d40/lb8 0 2024-04-26T10:44:30.608 INFO:tasks.workunit.client.0.smithi049.stdout:4/601: dwrite de/d1b/f40 [0,4194304] 0 2024-04-26T10:44:30.608 INFO:tasks.workunit.client.0.smithi049.stdout:8/583: getdents d2/d89/d2a 0 2024-04-26T10:44:30.608 INFO:tasks.workunit.client.0.smithi049.stdout:9/655: symlink d2/d25/d60/ld6 0 2024-04-26T10:44:30.608 INFO:tasks.workunit.client.0.smithi049.stdout:4/602: stat de/d1b/d5e/d72/d73/d84 0 2024-04-26T10:44:30.608 INFO:tasks.workunit.client.0.smithi049.stdout:9/656: dread - d2/d1a/d1b/d1f/fd0 zero size 2024-04-26T10:44:30.608 INFO:tasks.workunit.client.0.smithi049.stdout:3/453: dread d3/d23/f75 [0,4194304] 0 2024-04-26T10:44:30.608 INFO:tasks.workunit.client.0.smithi049.stdout:0/551: sync 2024-04-26T10:44:30.608 INFO:tasks.workunit.client.0.smithi049.stdout:5/543: sync 2024-04-26T10:44:30.609 INFO:tasks.workunit.client.0.smithi049.stdout:9/657: symlink d2/d25/d74/dc2/ld7 0 2024-04-26T10:44:30.609 INFO:tasks.workunit.client.0.smithi049.stdout:0/552: rmdir d8/db/d11/d1b 39 2024-04-26T10:44:30.609 INFO:tasks.workunit.client.0.smithi049.stdout:6/519: dwrite da/dd/de/fa0 [0,4194304] 0 2024-04-26T10:44:30.609 INFO:tasks.workunit.client.0.smithi049.stdout:0/553: mknod d8/d66/d84/cc2 0 2024-04-26T10:44:30.609 INFO:tasks.workunit.client.0.smithi049.stdout:5/544: rename d7/d1d/d1f/d4e/fc3 to d7/d1d/d1f/d4e/d77/fe1 0 2024-04-26T10:44:30.609 INFO:tasks.workunit.client.0.smithi049.stdout:8/584: dwrite d2/f2f [0,4194304] 0 2024-04-26T10:44:30.609 INFO:tasks.workunit.client.0.smithi049.stdout:4/603: dread de/d1b/f40 [0,4194304] 0 2024-04-26T10:44:30.609 INFO:tasks.workunit.client.0.smithi049.stdout:8/585: chown d2/f1b 0 1 2024-04-26T10:44:30.609 INFO:tasks.workunit.client.0.smithi049.stdout:0/554: mknod d8/d66/cc3 0 2024-04-26T10:44:30.609 INFO:tasks.workunit.client.0.smithi049.stdout:5/545: chown d7/d1d/l71 1485 1 2024-04-26T10:44:30.609 INFO:tasks.workunit.client.0.smithi049.stdout:8/586: write d2/d16/d19/f4d [575949,36712] 0 2024-04-26T10:44:30.609 INFO:tasks.workunit.client.0.smithi049.stdout:0/555: fsync d8/db/d93/d96/fa1 0 2024-04-26T10:44:30.609 INFO:tasks.workunit.client.0.smithi049.stdout:9/658: dwrite d2/d1a/d1b/d1f/f39 [0,4194304] 0 2024-04-26T10:44:30.610 INFO:tasks.workunit.client.0.smithi049.stdout:9/659: mknod d2/d25/cd8 0 2024-04-26T10:44:30.610 INFO:tasks.workunit.client.0.smithi049.stdout:4/604: write f7 [8863433,106170] 0 2024-04-26T10:44:30.610 INFO:tasks.workunit.client.0.smithi049.stdout:2/515: dread f4 [0,4194304] 0 2024-04-26T10:44:30.610 INFO:tasks.workunit.client.0.smithi049.stdout:8/587: dwrite d2/d16/f8e [0,4194304] 0 2024-04-26T10:44:30.610 INFO:tasks.workunit.client.0.smithi049.stdout:4/605: rename f7 to de/d1b/d5e/d72/fb6 0 2024-04-26T10:44:30.610 INFO:tasks.workunit.client.0.smithi049.stdout:2/516: rmdir d6/d9/db/d35/d91 39 2024-04-26T10:44:30.610 INFO:tasks.workunit.client.0.smithi049.stdout:8/588: stat d2/d17/d34/d40/f57 0 2024-04-26T10:44:30.610 INFO:tasks.workunit.client.0.smithi049.stdout:3/454: read d3/d23/d2f/d6a/d6b/d26/f6d [4189505,95373] 0 2024-04-26T10:44:30.610 INFO:tasks.workunit.client.0.smithi049.stdout:0/556: dwrite d8/d1e/f2b [0,4194304] 0 2024-04-26T10:44:30.610 INFO:tasks.workunit.client.0.smithi049.stdout:0/557: chown d8/db/c1f 182 1 2024-04-26T10:44:30.610 INFO:tasks.workunit.client.0.smithi049.stdout:4/606: creat de/d1b/d5e/d72/d73/d88/fb7 x:0 0 0 2024-04-26T10:44:30.610 INFO:tasks.workunit.client.0.smithi049.stdout:1/482: dread d1e/d20/d26/f63 [0,4194304] 0 2024-04-26T10:44:30.610 INFO:tasks.workunit.client.0.smithi049.stdout:9/660: dwrite d2/d25/d74/f63 [0,4194304] 0 2024-04-26T10:44:30.610 INFO:tasks.workunit.client.0.smithi049.stdout:3/455: write d3/d23/d2f/d6a/d6b/d26/d29/f7d [2316195,129786] 0 2024-04-26T10:44:30.611 INFO:tasks.workunit.client.0.smithi049.stdout:0/558: dread - d8/db/d26/d6f/fba zero size 2024-04-26T10:44:30.611 INFO:tasks.workunit.client.0.smithi049.stdout:4/607: creat de/d1b/d5e/d72/d73/d88/fb8 x:0 0 0 2024-04-26T10:44:30.611 INFO:tasks.workunit.client.0.smithi049.stdout:1/483: mkdir d1e/d20/d26/d37/d8e/d97 0 2024-04-26T10:44:30.611 INFO:tasks.workunit.client.0.smithi049.stdout:0/559: unlink d8/c79 0 2024-04-26T10:44:30.611 INFO:tasks.workunit.client.0.smithi049.stdout:1/484: symlink d1e/d20/l98 0 2024-04-26T10:44:30.611 INFO:tasks.workunit.client.0.smithi049.stdout:3/456: stat d3/d23/d2f/d6a/d6b/d8/d87/c95 0 2024-04-26T10:44:30.611 INFO:tasks.workunit.client.0.smithi049.stdout:0/560: write d8/db/f33 [2519648,66691] 0 2024-04-26T10:44:30.611 INFO:tasks.workunit.client.0.smithi049.stdout:9/661: rename d2/d1a/d1b/d1f/fc3 to d2/d1a/d1b/d1f/d34/d6d/fd9 0 2024-04-26T10:44:30.611 INFO:tasks.workunit.client.0.smithi049.stdout:3/457: dread - d3/d23/d2f/d6a/d6b/d8/dd/f7c zero size 2024-04-26T10:44:30.611 INFO:tasks.workunit.client.0.smithi049.stdout:0/561: readlink d8/db/d26/l2e 0 2024-04-26T10:44:30.611 INFO:tasks.workunit.client.0.smithi049.stdout:9/662: write d2/d25/d74/f98 [122410,15135] 0 2024-04-26T10:44:30.611 INFO:tasks.workunit.client.0.smithi049.stdout:5/546: dread d7/d14/d18/f89 [0,4194304] 0 2024-04-26T10:44:30.611 INFO:tasks.workunit.client.0.smithi049.stdout:3/458: write d3/d23/d2f/d6a/d6b/d8/d34/f44 [375263,38878] 0 2024-04-26T10:44:30.612 INFO:tasks.workunit.client.0.smithi049.stdout:9/663: creat d2/d1a/d1b/d1f/fda x:0 0 0 2024-04-26T10:44:30.612 INFO:tasks.workunit.client.0.smithi049.stdout:0/562: creat d8/db/d11/d1b/fc4 x:0 0 0 2024-04-26T10:44:30.612 INFO:tasks.workunit.client.0.smithi049.stdout:5/547: mkdir d7/d1d/d1f/d4e/da0/de2 0 2024-04-26T10:44:30.612 INFO:tasks.workunit.client.0.smithi049.stdout:9/664: write d2/d1a/d1b/d1f/f43 [532615,115463] 0 2024-04-26T10:44:30.612 INFO:tasks.workunit.client.0.smithi049.stdout:3/459: link d3/l30 d3/d23/d2f/d6a/d6b/l9e 0 2024-04-26T10:44:30.612 INFO:tasks.workunit.client.0.smithi049.stdout:0/563: mkdir d8/db/d11/d1b/d4d/dae/dc5 0 2024-04-26T10:44:30.612 INFO:tasks.workunit.client.0.smithi049.stdout:9/665: write d2/d40/fa8 [71048,92236] 0 2024-04-26T10:44:30.612 INFO:tasks.workunit.client.0.smithi049.stdout:5/548: unlink d7/d1d/d1f/d4e/d77/fe1 0 2024-04-26T10:44:30.612 INFO:tasks.workunit.client.0.smithi049.stdout:5/549: chown d7/dc6/fda 202118566 1 2024-04-26T10:44:30.612 INFO:tasks.workunit.client.0.smithi049.stdout:9/666: chown d2/d25/fa3 47712455 1 2024-04-26T10:44:30.612 INFO:tasks.workunit.client.0.smithi049.stdout:4/608: dwrite de/d1b/d5e/d72/d73/d88/f94 [0,4194304] 0 2024-04-26T10:44:30.612 INFO:tasks.workunit.client.0.smithi049.stdout:4/609: mkdir de/d3f/d48/d8b/db9 0 2024-04-26T10:44:30.612 INFO:tasks.workunit.client.0.smithi049.stdout:3/460: read d3/d23/d2f/d6a/d6b/d8/f32 [2922217,17950] 0 2024-04-26T10:44:30.612 INFO:tasks.workunit.client.0.smithi049.stdout:5/550: rename d7/d14/d18/d2b/f4b to d7/d1d/d1f/d4e/d65/d6f/d91/d3e/fe3 0 2024-04-26T10:44:30.613 INFO:tasks.workunit.client.0.smithi049.stdout:4/610: write de/d1b/d5e/d72/d73/d84/d38/f46 [538454,42223] 0 2024-04-26T10:44:30.613 INFO:tasks.workunit.client.0.smithi049.stdout:3/461: chown d3/d23/d2f/d6a/d6b/d8/d34/f83 8 1 2024-04-26T10:44:30.613 INFO:tasks.workunit.client.0.smithi049.stdout:4/611: creat de/d1b/fba x:0 0 0 2024-04-26T10:44:30.613 INFO:tasks.workunit.client.0.smithi049.stdout:5/551: mknod d7/d1d/d1f/d95/ce4 0 2024-04-26T10:44:30.613 INFO:tasks.workunit.client.0.smithi049.stdout:4/612: dread - de/d1b/d5e/d72/d73/d84/f7e zero size 2024-04-26T10:44:30.613 INFO:tasks.workunit.client.0.smithi049.stdout:9/667: getdents d2/d1a/d1b/d1f 0 2024-04-26T10:44:30.613 INFO:tasks.workunit.client.0.smithi049.stdout:0/564: truncate d8/db/d11/d1c/f47 3670942 0 2024-04-26T10:44:30.613 INFO:tasks.workunit.client.0.smithi049.stdout:0/565: chown d8/db/d11/d1b/l7e 98506061 1 2024-04-26T10:44:30.613 INFO:tasks.workunit.client.0.smithi049.stdout:1/485: creat d1e/d20/d26/d3c/f99 x:0 0 0 2024-04-26T10:44:30.613 INFO:tasks.workunit.client.0.smithi049.stdout:9/668: rename d2/db9 to d2/d1a/df/ddb 0 2024-04-26T10:44:30.613 INFO:tasks.workunit.client.0.smithi049.stdout:5/552: mkdir d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d60/de5 0 2024-04-26T10:44:30.613 INFO:tasks.workunit.client.0.smithi049.stdout:0/566: symlink d8/d42/lc6 0 2024-04-26T10:44:30.613 INFO:tasks.workunit.client.0.smithi049.stdout:1/486: symlink d1e/d20/d26/d3c/d54/d59/d73/l9a 0 2024-04-26T10:44:30.613 INFO:tasks.workunit.client.0.smithi049.stdout:4/613: dwrite de/d3f/d52/d9b/f6b [0,4194304] 0 2024-04-26T10:44:30.616 INFO:tasks.workunit.client.0.smithi049.stdout:5/553: read d7/d1d/f27 [2228282,11181] 0 2024-04-26T10:44:30.616 INFO:tasks.workunit.client.0.smithi049.stdout:7/566: dread d2/dd/d25/d27/f57 [0,4194304] 0 2024-04-26T10:44:30.616 INFO:tasks.workunit.client.0.smithi049.stdout:7/567: write d2/dd/d45/f9e [847714,86889] 0 2024-04-26T10:44:30.616 INFO:tasks.workunit.client.0.smithi049.stdout:7/568: rmdir d2/d3/de 39 2024-04-26T10:44:30.616 INFO:tasks.workunit.client.0.smithi049.stdout:3/462: dwrite d3/d23/d2f/d6a/d6b/d26/d29/f3e [0,4194304] 0 2024-04-26T10:44:30.616 INFO:tasks.workunit.client.0.smithi049.stdout:1/487: dwrite d1e/d20/f6b [4194304,4194304] 0 2024-04-26T10:44:30.616 INFO:tasks.workunit.client.0.smithi049.stdout:8/589: dread d2/d89/d2a/f54 [0,4194304] 0 2024-04-26T10:44:30.616 INFO:tasks.workunit.client.0.smithi049.stdout:5/554: chown d7/d1d/d1f/d4e/d65/d6f/d91/d3e/fa7 2 1 2024-04-26T10:44:30.616 INFO:tasks.workunit.client.0.smithi049.stdout:6/520: dread da/dd/de/d26/f64 [0,4194304] 0 2024-04-26T10:44:30.616 INFO:tasks.workunit.client.0.smithi049.stdout:0/567: dwrite d8/db/d11/d1b/d4d/f80 [0,4194304] 0 2024-04-26T10:44:30.616 INFO:tasks.workunit.client.0.smithi049.stdout:8/590: write d2/f2f [3773719,53908] 0 2024-04-26T10:44:30.616 INFO:tasks.workunit.client.0.smithi049.stdout:5/555: dread - d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d60/faf zero size 2024-04-26T10:44:30.617 INFO:tasks.workunit.client.0.smithi049.stdout:2/517: dread d6/d9/db/d11/f5d [0,4194304] 0 2024-04-26T10:44:30.617 INFO:tasks.workunit.client.0.smithi049.stdout:6/521: mkdir da/dd/d62/daf 0 2024-04-26T10:44:30.617 INFO:tasks.workunit.client.0.smithi049.stdout:3/463: unlink d3/d23/d2f/d6a/d6b/d8/c74 0 2024-04-26T10:44:30.617 INFO:tasks.workunit.client.0.smithi049.stdout:0/568: mknod d8/db/cc7 0 2024-04-26T10:44:30.617 INFO:tasks.workunit.client.0.smithi049.stdout:6/522: chown da/dd/f5c 3390016 1 2024-04-26T10:44:30.617 INFO:tasks.workunit.client.0.smithi049.stdout:8/591: mknod d2/d16/d19/d42/d7c/cbd 0 2024-04-26T10:44:30.617 INFO:tasks.workunit.client.0.smithi049.stdout:5/556: unlink d7/d1d/d1f/d4e/d65/d6f/d91/cce 0 2024-04-26T10:44:30.618 INFO:tasks.workunit.client.0.smithi049.stdout:6/523: mknod da/d4a/cb0 0 2024-04-26T10:44:30.618 INFO:tasks.workunit.client.0.smithi049.stdout:0/569: mknod d8/db/d26/daf/cc8 0 2024-04-26T10:44:30.621 INFO:tasks.workunit.client.0.smithi049.stdout:8/592: mknod d2/d16/d19/d42/daf/cbe 0 2024-04-26T10:44:30.621 INFO:tasks.workunit.client.0.smithi049.stdout:5/557: symlink d7/d1d/le6 0 2024-04-26T10:44:30.621 INFO:tasks.workunit.client.0.smithi049.stdout:3/464: rmdir d3/d23/d2f/d6a/d6b/d8/d55 39 2024-04-26T10:44:30.621 INFO:tasks.workunit.client.0.smithi049.stdout:8/593: mkdir d2/d17/d34/dbf 0 2024-04-26T10:44:30.621 INFO:tasks.workunit.client.0.smithi049.stdout:3/465: rmdir d3/d23/d2f/d6a/d6b/d8c 39 2024-04-26T10:44:30.621 INFO:tasks.workunit.client.0.smithi049.stdout:5/558: chown d7/d1d/d1f/d4e/d77/f93 1693 1 2024-04-26T10:44:30.621 INFO:tasks.workunit.client.0.smithi049.stdout:0/570: getdents d8/d1e 0 2024-04-26T10:44:30.622 INFO:tasks.workunit.client.0.smithi049.stdout:5/559: readlink d7/d1d/d20/lc7 0 2024-04-26T10:44:30.622 INFO:tasks.workunit.client.0.smithi049.stdout:8/594: write d2/d1a/f3e [1988323,97349] 0 2024-04-26T10:44:30.622 INFO:tasks.workunit.client.0.smithi049.stdout:7/569: dwrite d2/d3/f56 [0,4194304] 0 2024-04-26T10:44:30.623 INFO:tasks.workunit.client.0.smithi049.stdout:3/466: write d3/d23/d2f/d6a/d6b/d26/f5a [480706,11932] 0 2024-04-26T10:44:30.623 INFO:tasks.workunit.client.0.smithi049.stdout:5/560: readlink d7/d1d/d1f/l52 0 2024-04-26T10:44:30.625 INFO:tasks.workunit.client.0.smithi049.stdout:2/518: dwrite d6/d9/fc [0,4194304] 0 2024-04-26T10:44:30.625 INFO:tasks.workunit.client.0.smithi049.stdout:5/561: fsync d7/d66/f73 0 2024-04-26T10:44:30.628 INFO:tasks.workunit.client.0.smithi049.stdout:8/595: mknod d2/d1a/cc0 0 2024-04-26T10:44:30.629 INFO:tasks.workunit.client.0.smithi049.stdout:6/524: truncate f8 1583241 0 2024-04-26T10:44:30.632 INFO:tasks.workunit.client.0.smithi049.stdout:0/571: dwrite d8/db/d11/fa6 [0,4194304] 0 2024-04-26T10:44:30.633 INFO:tasks.workunit.client.0.smithi049.stdout:5/562: dread d7/d1d/d20/fa8 [0,4194304] 0 2024-04-26T10:44:30.635 INFO:tasks.workunit.client.0.smithi049.stdout:9/669: dread d2/d1a/d1b/d7a/f80 [0,4194304] 0 2024-04-26T10:44:30.636 INFO:tasks.workunit.client.0.smithi049.stdout:6/525: rename da/dd/de/d26/d29/l3f to da/dd/de/d11/lb1 0 2024-04-26T10:44:30.636 INFO:tasks.workunit.client.0.smithi049.stdout:3/467: dwrite d3/d23/d2f/d6a/d6b/d8/f49 [0,4194304] 0 2024-04-26T10:44:30.637 INFO:tasks.workunit.client.0.smithi049.stdout:4/614: dread de/d1b/d5e/d72/d73/d84/f22 [0,4194304] 0 2024-04-26T10:44:30.639 INFO:tasks.workunit.client.0.smithi049.stdout:0/572: rename d8/db/d11/d1c/f5b to d8/db/d11/d1b/d4d/dae/fc9 0 2024-04-26T10:44:30.640 INFO:tasks.workunit.client.0.smithi049.stdout:2/519: dwrite d6/d9/d5f/f80 [0,4194304] 0 2024-04-26T10:44:30.641 INFO:tasks.workunit.client.0.smithi049.stdout:5/563: truncate d7/d1d/d1f/d4e/d80/fb1 841546 0 2024-04-26T10:44:30.641 INFO:tasks.workunit.client.0.smithi049.stdout:9/670: symlink d2/d25/dc5/ldc 0 2024-04-26T10:44:30.641 INFO:tasks.workunit.client.0.smithi049.stdout:7/570: dwrite d2/d3/de/d1c/fa9 [0,4194304] 0 2024-04-26T10:44:30.645 INFO:tasks.workunit.client.0.smithi049.stdout:4/615: mkdir de/d1b/d5e/d99/dbb 0 2024-04-26T10:44:30.645 INFO:tasks.workunit.client.0.smithi049.stdout:8/596: dwrite d2/df/d10/d47/fb2 [0,4194304] 0 2024-04-26T10:44:30.645 INFO:tasks.workunit.client.0.smithi049.stdout:6/526: creat da/dd/de/d26/d22/d4c/fb2 x:0 0 0 2024-04-26T10:44:30.645 INFO:tasks.workunit.client.0.smithi049.stdout:5/564: dread d7/d1d/d1f/f51 [0,4194304] 0 2024-04-26T10:44:30.646 INFO:tasks.workunit.client.0.smithi049.stdout:2/520: read - d6/d9/db/d11/f43 zero size 2024-04-26T10:44:30.646 INFO:tasks.workunit.client.0.smithi049.stdout:7/571: creat d2/dd/d7f/db1/fb9 x:0 0 0 2024-04-26T10:44:30.646 INFO:tasks.workunit.client.0.smithi049.stdout:9/671: truncate d2/d1a/d1b/d1f/d49/fb7 952778 0 2024-04-26T10:44:30.649 INFO:tasks.workunit.client.0.smithi049.stdout:8/597: creat d2/d1a/fc1 x:0 0 0 2024-04-26T10:44:30.650 INFO:tasks.workunit.client.0.smithi049.stdout:7/572: symlink d2/lba 0 2024-04-26T10:44:30.654 INFO:tasks.workunit.client.0.smithi049.stdout:9/672: creat d2/d1a/d8a/fdd x:0 0 0 2024-04-26T10:44:30.654 INFO:tasks.workunit.client.0.smithi049.stdout:2/521: creat d6/d9/f9a x:0 0 0 2024-04-26T10:44:30.655 INFO:tasks.workunit.client.0.smithi049.stdout:7/573: dread - d2/f92 zero size 2024-04-26T10:44:30.657 INFO:tasks.workunit.client.0.smithi049.stdout:8/598: chown d2/d1a/d9c/fb8 0 1 2024-04-26T10:44:30.658 INFO:tasks.workunit.client.0.smithi049.stdout:3/468: dwrite d3/d23/d2f/d6a/d6b/d8/d55/d46/f94 [0,4194304] 0 2024-04-26T10:44:30.659 INFO:tasks.workunit.client.0.smithi049.stdout:4/616: dwrite de/d1b/d5e/d72/d73/d84/d4b/f7d [0,4194304] 0 2024-04-26T10:44:30.659 INFO:tasks.workunit.client.0.smithi049.stdout:6/527: dread da/dd/de/d26/d22/f56 [0,4194304] 0 2024-04-26T10:44:30.661 INFO:tasks.workunit.client.0.smithi049.stdout:8/599: chown d2/df/d10/d47/f99 12 1 2024-04-26T10:44:30.663 INFO:tasks.workunit.client.0.smithi049.stdout:8/600: fdatasync d2/df/d10/d23/f5f 0 2024-04-26T10:44:30.666 INFO:tasks.workunit.client.0.smithi049.stdout:1/488: dread d1e/d20/f41 [0,4194304] 0 2024-04-26T10:44:30.667 INFO:tasks.workunit.client.0.smithi049.stdout:9/673: dwrite d2/d25/d74/f63 [4194304,4194304] 0 2024-04-26T10:44:30.667 INFO:tasks.workunit.client.0.smithi049.stdout:1/489: stat fa 0 2024-04-26T10:44:30.669 INFO:tasks.workunit.client.0.smithi049.stdout:9/674: fsync d2/d1a/d1b/f24 0 2024-04-26T10:44:30.671 INFO:tasks.workunit.client.0.smithi049.stdout:5/565: dwrite d7/d1d/d1f/d4e/d65/d6f/fd1 [0,4194304] 0 2024-04-26T10:44:30.673 INFO:tasks.workunit.client.0.smithi049.stdout:4/617: dwrite de/d1b/d5e/d72/d73/d88/fb8 [0,4194304] 0 2024-04-26T10:44:30.674 INFO:tasks.workunit.client.0.smithi049.stdout:7/574: fsync d2/dd/d45/d82/f8a 0 2024-04-26T10:44:30.674 INFO:tasks.workunit.client.0.smithi049.stdout:1/490: write d1e/f6f [757774,52441] 0 2024-04-26T10:44:30.674 INFO:tasks.workunit.client.0.smithi049.stdout:8/601: fdatasync d2/d17/f69 0 2024-04-26T10:44:30.674 INFO:tasks.workunit.client.0.smithi049.stdout:7/575: read d2/dd/d25/d27/f57 [1101048,52295] 0 2024-04-26T10:44:30.675 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:30.674+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:30.676 INFO:tasks.workunit.client.0.smithi049.stdout:9/675: mkdir d2/d25/d60/da4/dde 0 2024-04-26T10:44:30.676 INFO:tasks.workunit.client.0.smithi049.stdout:3/469: mknod d3/d23/d2f/d6a/d6b/d26/d65/d70/d96/c9f 0 2024-04-26T10:44:30.677 INFO:tasks.workunit.client.0.smithi049.stdout:2/522: rename d6/d9/db/d11/f54 to d6/d32/d69/f9b 0 2024-04-26T10:44:30.677 INFO:tasks.workunit.client.0.smithi049.stdout:0/573: dread d8/db/d11/f83 [4194304,4194304] 0 2024-04-26T10:44:30.677 INFO:tasks.workunit.client.0.smithi049.stdout:8/602: mknod d2/df/d10/d47/cc2 0 2024-04-26T10:44:30.680 INFO:tasks.workunit.client.0.smithi049.stdout:1/491: write d1e/d20/d4d/f53 [454841,69823] 0 2024-04-26T10:44:30.680 INFO:tasks.workunit.client.0.smithi049.stdout:6/528: getdents da/dd/d62 0 2024-04-26T10:44:30.681 INFO:tasks.workunit.client.0.smithi049.stdout:9/676: link d2/d40/d53/cd4 d2/d25/cdf 0 2024-04-26T10:44:30.681 INFO:tasks.workunit.client.0.smithi049.stdout:5/566: dwrite d7/d1d/d1f/d4e/d65/d6f/d91/d3e/f42 [4194304,4194304] 0 2024-04-26T10:44:30.682 INFO:tasks.workunit.client.0.smithi049.stdout:2/523: write d6/d9/f52 [162109,126570] 0 2024-04-26T10:44:30.682 INFO:tasks.workunit.client.0.smithi049.stdout:0/574: chown d8/d66/d84/cc2 0 1 2024-04-26T10:44:30.683 INFO:tasks.workunit.client.0.smithi049.stdout:9/677: readlink d2/d25/d74/dc2/ld7 0 2024-04-26T10:44:30.683 INFO:tasks.workunit.client.0.smithi049.stdout:1/492: write d1e/d20/d26/d3c/f87 [144250,40037] 0 2024-04-26T10:44:30.683 INFO:tasks.workunit.client.0.smithi049.stdout:8/603: mkdir d2/df/d10/d47/d75/dc3 0 2024-04-26T10:44:30.683 INFO:tasks.workunit.client.0.smithi049.stdout:6/529: write da/dd/f1e [3201897,85073] 0 2024-04-26T10:44:30.683 INFO:tasks.workunit.client.0.smithi049.stdout:7/576: dwrite d2/f8e [0,4194304] 0 2024-04-26T10:44:30.685 INFO:tasks.workunit.client.0.smithi049.stdout:2/524: rmdir d6/d9/db/d34 39 2024-04-26T10:44:30.685 INFO:tasks.workunit.client.0.smithi049.stdout:8/604: write d2/d89/d2a/f2b [113340,99422] 0 2024-04-26T10:44:30.686 INFO:tasks.workunit.client.0.smithi049.stdout:9/678: creat d2/d1a/df/fe0 x:0 0 0 2024-04-26T10:44:30.686 INFO:tasks.workunit.client.0.smithi049.stdout:0/575: rename d8/d1e/d98/l9f to d8/d42/lca 0 2024-04-26T10:44:30.686 INFO:tasks.workunit.client.0.smithi049.stdout:8/605: dread - d2/df/f95 zero size 2024-04-26T10:44:30.687 INFO:tasks.workunit.client.0.smithi049.stdout:4/618: read de/d1b/d5e/d72/d73/d84/d38/f58 [2127412,13088] 0 2024-04-26T10:44:30.688 INFO:tasks.workunit.client.0.smithi049.stdout:0/576: write d8/d42/f43 [1765905,21848] 0 2024-04-26T10:44:30.688 INFO:tasks.workunit.client.0.smithi049.stdout:6/530: write da/dd/de/f96 [3746385,39697] 0 2024-04-26T10:44:30.688 INFO:tasks.workunit.client.0.smithi049.stdout:2/525: write d6/d9/db/d34/d7b/f7e [167107,19666] 0 2024-04-26T10:44:30.689 INFO:tasks.workunit.client.0.smithi049.stdout:9/679: unlink d2/d1a/d1b/d1f/d49/f94 0 2024-04-26T10:44:30.689 INFO:tasks.workunit.client.0.smithi049.stdout:3/470: getdents d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e 0 2024-04-26T10:44:30.690 INFO:tasks.workunit.client.0.smithi049.stdout:4/619: rename de/d1d/c30 to de/d1b/d5e/d72/d73/cbc 0 2024-04-26T10:44:30.692 INFO:tasks.workunit.client.0.smithi049.stdout:2/526: creat d6/d9/db/d11/f9c x:0 0 0 2024-04-26T10:44:30.693 INFO:tasks.workunit.client.0.smithi049.stdout:6/531: mknod da/dd/de/cb3 0 2024-04-26T10:44:30.693 INFO:tasks.workunit.client.0.smithi049.stdout:9/680: getdents d2/d1a/d1b/d7a 0 2024-04-26T10:44:30.693 INFO:tasks.workunit.client.0.smithi049.stdout:7/577: read d2/dd/d25/f75 [2601727,67758] 0 2024-04-26T10:44:30.693 INFO:tasks.workunit.client.0.smithi049.stdout:4/620: write f1 [2160691,120254] 0 2024-04-26T10:44:30.694 INFO:tasks.workunit.client.0.smithi049.stdout:3/471: getdents d3/d23/d2f/d6a/d6b/d26/d58 0 2024-04-26T10:44:30.694 INFO:tasks.workunit.client.0.smithi049.stdout:5/567: dwrite d7/d1d/d1f/d4e/d65/d6f/d91/fd7 [4194304,4194304] 0 2024-04-26T10:44:30.696 INFO:tasks.workunit.client.0.smithi049.stdout:2/527: fdatasync d6/d9/db/df/f4c 0 2024-04-26T10:44:30.696 INFO:tasks.workunit.client.0.smithi049.stdout:7/578: creat d2/dd/d7f/fbb x:0 0 0 2024-04-26T10:44:30.696 INFO:tasks.workunit.client.0.smithi049.stdout:8/606: dwrite d2/d1a/f22 [0,4194304] 0 2024-04-26T10:44:30.696 INFO:tasks.workunit.client.0.smithi049.stdout:9/681: write d2/d25/fa1 [4373350,78138] 0 2024-04-26T10:44:30.698 INFO:tasks.workunit.client.0.smithi049.stdout:8/607: chown d2/d16/f9b 3505128 1 2024-04-26T10:44:30.699 INFO:tasks.workunit.client.0.smithi049.stdout:6/532: rename da/dd/de/d42/d5a/f8e to da/dd/d62/fb4 0 2024-04-26T10:44:30.699 INFO:tasks.workunit.client.0.smithi049.stdout:5/568: dread - d7/d1d/d1f/d4e/d65/fb0 zero size 2024-04-26T10:44:30.700 INFO:tasks.workunit.client.0.smithi049.stdout:2/528: readlink d6/d9/db/d1e/l48 0 2024-04-26T10:44:30.701 INFO:tasks.workunit.client.0.smithi049.stdout:7/579: dread - d2/d3/d96/fb4 zero size 2024-04-26T10:44:30.702 INFO:tasks.workunit.client.0.smithi049.stdout:9/682: symlink d2/d1a/d1b/d1f/d34/le1 0 2024-04-26T10:44:30.705 INFO:tasks.workunit.client.0.smithi049.stdout:9/683: chown d2/d1a/d1b/d1f/d49/l75 22784 1 2024-04-26T10:44:30.705 INFO:tasks.workunit.client.0.smithi049.stdout:4/621: dwrite de/d1b/f40 [4194304,4194304] 0 2024-04-26T10:44:30.708 INFO:tasks.workunit.client.0.smithi049.stdout:4/622: fsync de/d3f/f5d 0 2024-04-26T10:44:30.710 INFO:tasks.workunit.client.0.smithi049.stdout:4/623: truncate de/d3f/f5d 183341 0 2024-04-26T10:44:30.710 INFO:tasks.workunit.client.0.smithi049.stdout:2/529: truncate f5 109072 0 2024-04-26T10:44:30.711 INFO:tasks.workunit.client.0.smithi049.stdout:7/580: fdatasync d2/dd/d38/f40 0 2024-04-26T10:44:30.711 INFO:tasks.workunit.client.0.smithi049.stdout:2/530: write d6/d9/db/d11/f1d [1669374,79519] 0 2024-04-26T10:44:30.713 INFO:tasks.workunit.client.0.smithi049.stdout:4/624: dread de/d1b/d5e/d72/d73/d84/f60 [0,4194304] 0 2024-04-26T10:44:30.716 INFO:tasks.workunit.client.0.smithi049.stdout:3/472: link d3/d23/d2f/d6a/d6b/d26/d65/d70/d96/c9f d3/d23/ca0 0 2024-04-26T10:44:30.716 INFO:tasks.workunit.client.0.smithi049.stdout:6/533: mkdir da/dd/de/db5 0 2024-04-26T10:44:30.717 INFO:tasks.workunit.client.0.smithi049.stdout:1/493: dread d1e/d20/d26/f4b [0,4194304] 0 2024-04-26T10:44:30.721 INFO:tasks.workunit.client.0.smithi049.stdout:4/625: mknod de/d3f/d48/cbd 0 2024-04-26T10:44:30.721 INFO:tasks.workunit.client.0.smithi049.stdout:8/608: link d2/df/f36 d2/df/d10/fc4 0 2024-04-26T10:44:30.721 INFO:tasks.workunit.client.0.smithi049.stdout:6/534: creat da/dd/d47/fb6 x:0 0 0 2024-04-26T10:44:30.721 INFO:tasks.workunit.client.0.smithi049.stdout:3/473: creat d3/d23/d2f/d6a/d6b/d26/d65/d70/fa1 x:0 0 0 2024-04-26T10:44:30.721 INFO:tasks.workunit.client.0.smithi049.stdout:1/494: creat d1e/d20/d26/d3c/d54/f9b x:0 0 0 2024-04-26T10:44:30.721 INFO:tasks.workunit.client.0.smithi049.stdout:7/581: mknod d2/d3/d96/db3/db8/cbc 0 2024-04-26T10:44:30.721 INFO:tasks.workunit.client.0.smithi049.stdout:9/684: rename d2/d1a/d1b/d1f/d34/d6d to d2/d1a/de2 0 2024-04-26T10:44:30.721 INFO:tasks.workunit.client.0.smithi049.stdout:4/626: unlink de/d3f/fad 0 2024-04-26T10:44:30.722 INFO:tasks.workunit.client.0.smithi049.stdout:8/609: mkdir d2/df/dc5 0 2024-04-26T10:44:30.722 INFO:tasks.workunit.client.0.smithi049.stdout:7/582: symlink d2/lbd 0 2024-04-26T10:44:30.722 INFO:tasks.workunit.client.0.smithi049.stdout:9/685: chown d2/d1a/d1b/d1f/l8c 120 1 2024-04-26T10:44:30.723 INFO:tasks.workunit.client.0.smithi049.stdout:8/610: write d2/d16/d19/d42/f65 [965866,4194] 0 2024-04-26T10:44:30.724 INFO:tasks.workunit.client.0.smithi049.stdout:4/627: rename de/d1b/d5e/d90/c79 to de/d1d/cbe 0 2024-04-26T10:44:30.725 INFO:tasks.workunit.client.0.smithi049.stdout:8/611: fdatasync d2/d17/f97 0 2024-04-26T10:44:30.725 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:30.725 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:30.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:30.725 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4532.0:13152 4.3 4:c2e29ab4:::1000000343b.00000000:head [write 965866~4194 in=4194b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:30.725 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:30.723997+0000", 2024-04-26T10:44:30.725 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.00073040099999999999, 2024-04-26T10:44:30.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00075099400000000005, 2024-04-26T10:44:30.726 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:30.726 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-04-26T10:44:30.726 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-04-26T10:44:30.726 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4532", 2024-04-26T10:44:30.726 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:30.726 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 13152 2024-04-26T10:44:30.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:30.726 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:30.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:30.726 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:30.726 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:30.723997+0000", 2024-04-26T10:44:30.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:30.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:30.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:30.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:30.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:30.723997+0000", 2024-04-26T10:44:30.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:30.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:30.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:30.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:30.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:30.723996+0000", 2024-04-26T10:44:30.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:30.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:30.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:30.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:30.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:30.724003+0000", 2024-04-26T10:44:30.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1099999999999997e-06 2024-04-26T10:44:30.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:30.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:30.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:30.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:30.724014+0000", 2024-04-26T10:44:30.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0344e-05 2024-04-26T10:44:30.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:30.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:30.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:30.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:30.724019+0000", 2024-04-26T10:44:30.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5489999999999997e-06 2024-04-26T10:44:30.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:30.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:30.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:30.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:30.724054+0000", 2024-04-26T10:44:30.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4841000000000001e-05 2024-04-26T10:44:30.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:30.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:30.729 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:30.729 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:30.724144+0000", 2024-04-26T10:44:30.729 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0414999999999994e-05 2024-04-26T10:44:30.729 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:30.729 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:30.729 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:30.729 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:30.729 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-04-26T10:44:30.729 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 1 2024-04-26T10:44:30.729 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:30.730 INFO:tasks.workunit.client.0.smithi049.stdout:7/583: write d2/d3/de/d1c/fa9 [1642618,124001] 0 2024-04-26T10:44:30.730 INFO:tasks.workunit.client.0.smithi049.stdout:1/495: rmdir d1e/d20/d26/d3c/d54 39 2024-04-26T10:44:30.730 INFO:tasks.workunit.client.0.smithi049.stdout:8/612: chown d2/df/dab/cb6 12816 1 2024-04-26T10:44:30.730 INFO:tasks.workunit.client.0.smithi049.stdout:6/535: dwrite da/dd/d47/fb6 [0,4194304] 0 2024-04-26T10:44:30.730 INFO:tasks.workunit.client.0.smithi049.stdout:4/628: chown de/c17 3005426 1 2024-04-26T10:44:30.731 INFO:tasks.workunit.client.0.smithi049.stdout:7/584: creat d2/dd/d38/fbe x:0 0 0 2024-04-26T10:44:30.731 INFO:tasks.workunit.client.0.smithi049.stdout:0/577: sync 2024-04-26T10:44:30.731 INFO:tasks.workunit.client.0.smithi049.stdout:2/531: sync 2024-04-26T10:44:30.731 INFO:tasks.workunit.client.0.smithi049.stdout:3/474: dwrite d3/d23/d2f/d6a/d6b/d8/d82/f8b [0,4194304] 0 2024-04-26T10:44:30.732 INFO:tasks.workunit.client.0.smithi049.stdout:0/578: fdatasync d8/db/d11/d1b/d4d/f87 0 2024-04-26T10:44:30.732 INFO:tasks.workunit.client.0.smithi049.stdout:9/686: dwrite d2/d1a/d1b/d1f/fd0 [0,4194304] 0 2024-04-26T10:44:30.734 INFO:tasks.workunit.client.0.smithi049.stdout:2/532: mknod d6/d9/db/df/c9d 0 2024-04-26T10:44:30.734 INFO:tasks.workunit.client.0.smithi049.stdout:6/536: rename da/dd/de/d26/d22/d4c/c9c to da/dd/cb7 0 2024-04-26T10:44:30.735 INFO:tasks.workunit.client.0.smithi049.stdout:7/585: fdatasync d2/d3/de/f1e 0 2024-04-26T10:44:30.736 INFO:tasks.workunit.client.0.smithi049.stdout:0/579: creat d8/db/d26/daf/fcb x:0 0 0 2024-04-26T10:44:30.737 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:30.738 INFO:tasks.workunit.client.0.smithi049.stdout:3/475: unlink d3/d23/d2f/d6a/d6b/d8/c52 0 2024-04-26T10:44:30.739 INFO:tasks.workunit.client.0.smithi049.stdout:9/687: truncate d2/d1a/d9c/fa7 4519449 0 2024-04-26T10:44:30.739 INFO:tasks.workunit.client.0.smithi049.stdout:1/496: dwrite d1e/d20/d26/d37/f58 [0,4194304] 0 2024-04-26T10:44:30.743 INFO:tasks.workunit.client.0.smithi049.stdout:8/613: dwrite d2/f14 [0,4194304] 0 2024-04-26T10:44:30.743 INFO:tasks.workunit.client.0.smithi049.stdout:7/586: write d2/d3/de/d1c/f94 [850386,22096] 0 2024-04-26T10:44:30.744 INFO:tasks.workunit.client.0.smithi049.stdout:4/629: dwrite de/d1b/d5e/d72/d73/d84/f60 [0,4194304] 0 2024-04-26T10:44:30.744 INFO:tasks.workunit.client.0.smithi049.stdout:9/688: rmdir d2/d1a/d42/dd1 0 2024-04-26T10:44:30.745 INFO:tasks.workunit.client.0.smithi049.stdout:8/614: write d2/d16/d19/f4d [1396969,23788] 0 2024-04-26T10:44:30.745 INFO:tasks.workunit.client.0.smithi049.stdout:1/497: rename d1e/l46 to d1e/d20/d26/d37/d8e/l9c 0 2024-04-26T10:44:30.746 INFO:tasks.workunit.client.0.smithi049.stdout:7/587: stat d2/dd/d25/d27/fa6 0 2024-04-26T10:44:30.747 INFO:tasks.workunit.client.0.smithi049.stdout:3/476: getdents d3/d23/d2f/d6a/d6b/d8/d87 0 2024-04-26T10:44:30.747 INFO:tasks.workunit.client.0.smithi049.stdout:0/580: dread d8/f3d [0,4194304] 0 2024-04-26T10:44:30.747 INFO:tasks.workunit.client.0.smithi049.stdout:9/689: truncate d2/d1a/df/f87 896086 0 2024-04-26T10:44:30.748 INFO:tasks.workunit.client.0.smithi049.stdout:2/533: dwrite d6/d9/db/d35/f90 [0,4194304] 0 2024-04-26T10:44:30.749 INFO:tasks.workunit.client.0.smithi049.stdout:1/498: symlink d1e/d20/d4d/l9d 0 2024-04-26T10:44:30.749 INFO:tasks.workunit.client.0.smithi049.stdout:9/690: stat d2/d1a/d1b/f7f 0 2024-04-26T10:44:30.749 INFO:tasks.workunit.client.0.smithi049.stdout:7/588: creat d2/dd/d48/da3/fbf x:0 0 0 2024-04-26T10:44:30.750 INFO:tasks.workunit.client.0.smithi049.stdout:0/581: rmdir d8/db/d11/d1c/db8 39 2024-04-26T10:44:30.750 INFO:tasks.workunit.client.0.smithi049.stdout:8/615: read d2/d16/d19/f55 [352754,566] 0 2024-04-26T10:44:30.750 INFO:tasks.workunit.client.0.smithi049.stdout:7/589: symlink d2/lc0 0 2024-04-26T10:44:30.750 INFO:tasks.workunit.client.0.smithi049.stdout:8/616: write d2/df/d10/d47/faa [245140,25812] 0 2024-04-26T10:44:30.751 INFO:tasks.workunit.client.0.smithi049.stdout:0/582: getdents d8/db/d11/d1b/d4d/dae 0 2024-04-26T10:44:30.751 INFO:tasks.workunit.client.0.smithi049.stdout:7/590: unlink d2/d3/de/d1c/fa9 0 2024-04-26T10:44:30.753 INFO:tasks.workunit.client.0.smithi049.stdout:0/583: creat d8/db/d11/d1b/d4d/fcc x:0 0 0 2024-04-26T10:44:30.753 INFO:tasks.workunit.client.0.smithi049.stdout:2/534: dread d6/d9/db/d1e/f81 [0,4194304] 0 2024-04-26T10:44:30.754 INFO:tasks.workunit.client.0.smithi049.stdout:2/535: creat d6/f9e x:0 0 0 2024-04-26T10:44:30.754 INFO:tasks.workunit.client.0.smithi049.stdout:0/584: getdents d8/d1e 0 2024-04-26T10:44:30.755 INFO:tasks.workunit.client.0.smithi049.stdout:0/585: fsync d8/f18 0 2024-04-26T10:44:30.755 INFO:tasks.workunit.client.0.smithi049.stdout:4/630: read f8 [1737958,104904] 0 2024-04-26T10:44:30.756 INFO:tasks.workunit.client.0.smithi049.stdout:0/586: mkdir d8/db/d26/db9/dcd 0 2024-04-26T10:44:30.760 INFO:tasks.workunit.client.0.smithi049.stdout:0/587: dwrite d8/f74 [0,4194304] 0 2024-04-26T10:44:30.761 INFO:tasks.workunit.client.0.smithi049.stdout:2/536: fsync d6/d9/db/d35/d91/f92 0 2024-04-26T10:44:30.762 INFO:tasks.workunit.client.0.smithi049.stdout:0/588: link d8/db/d26/c75 d8/da5/cce 0 2024-04-26T10:44:30.763 INFO:tasks.workunit.client.0.smithi049.stdout:2/537: mkdir d6/d9/db/d11/d6a/d9f 0 2024-04-26T10:44:30.763 INFO:tasks.workunit.client.0.smithi049.stdout:5/569: sync 2024-04-26T10:44:30.764 INFO:tasks.workunit.client.0.smithi049.stdout:3/477: sync 2024-04-26T10:44:30.764 INFO:tasks.workunit.client.0.smithi049.stdout:1/499: sync 2024-04-26T10:44:30.764 INFO:tasks.workunit.client.0.smithi049.stdout:7/591: sync 2024-04-26T10:44:30.764 INFO:tasks.workunit.client.0.smithi049.stdout:4/631: sync 2024-04-26T10:44:30.765 INFO:tasks.workunit.client.0.smithi049.stdout:2/538: chown d6/d9/db/d34/d38/d3f/f42 875747 1 2024-04-26T10:44:30.765 INFO:tasks.workunit.client.0.smithi049.stdout:3/478: write d3/d23/d2f/d6a/d6b/d8/f57 [1979951,109349] 0 2024-04-26T10:44:30.765 INFO:tasks.workunit.client.0.smithi049.stdout:1/500: creat d1e/d20/d26/d37/d69/d75/f9e x:0 0 0 2024-04-26T10:44:30.766 INFO:tasks.workunit.client.0.smithi049.stdout:2/539: dread - d6/d9/db/f70 zero size 2024-04-26T10:44:30.766 INFO:tasks.workunit.client.0.smithi049.stdout:5/570: rename d7/d1d/c8d to d7/d1d/d1f/d4e/d65/d6f/d91/d3e/ce7 0 2024-04-26T10:44:30.767 INFO:tasks.workunit.client.0.smithi049.stdout:4/632: getdents de/d1b/d5e/da2 0 2024-04-26T10:44:30.769 INFO:tasks.workunit.client.0.smithi049.stdout:8/617: dread d2/d17/d34/d40/d7f/fa6 [0,4194304] 0 2024-04-26T10:44:30.769 INFO:tasks.workunit.client.0.smithi049.stdout:5/571: dread - d7/d14/d18/f6e zero size 2024-04-26T10:44:30.773 INFO:tasks.workunit.client.0.smithi049.stdout:7/592: dwrite d2/fa0 [0,4194304] 0 2024-04-26T10:44:30.776 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:30.775+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:30.777 INFO:tasks.workunit.client.0.smithi049.stdout:6/537: dread da/dd/de/f18 [0,4194304] 0 2024-04-26T10:44:30.777 INFO:tasks.workunit.client.0.smithi049.stdout:3/479: getdents d3/d23/d2f/d6a/d6b/d26/d65 0 2024-04-26T10:44:30.777 INFO:tasks.workunit.client.0.smithi049.stdout:5/572: symlink d7/d1d/d1f/d4e/d65/le8 0 2024-04-26T10:44:30.778 INFO:tasks.workunit.client.0.smithi049.stdout:1/501: dwrite d1e/d20/d26/d3c/d54/d59/f88 [0,4194304] 0 2024-04-26T10:44:30.779 INFO:tasks.workunit.client.0.smithi049.stdout:7/593: fdatasync d2/d3/f77 0 2024-04-26T10:44:30.779 INFO:tasks.workunit.client.0.smithi049.stdout:2/540: dwrite d6/d9/d5f/f80 [0,4194304] 0 2024-04-26T10:44:30.779 INFO:tasks.workunit.client.0.smithi049.stdout:9/691: dread d2/f8 [0,4194304] 0 2024-04-26T10:44:30.779 INFO:tasks.workunit.client.0.smithi049.stdout:9/692: stat d2/d40/db2 0 2024-04-26T10:44:30.780 INFO:tasks.workunit.client.0.smithi049.stdout:3/480: rename d3 to d3/d23/d2f/d6a/d6b/d8/d34/da2 22 2024-04-26T10:44:30.781 INFO:tasks.workunit.client.0.smithi049.stdout:9/693: write d2/d25/d74/f98 [666579,48289] 0 2024-04-26T10:44:30.782 INFO:tasks.workunit.client.0.smithi049.stdout:5/573: symlink d7/d53/le9 0 2024-04-26T10:44:30.783 INFO:tasks.workunit.client.0.smithi049.stdout:9/694: write d2/f3c [3939346,126606] 0 2024-04-26T10:44:30.786 INFO:tasks.workunit.client.0.smithi049.stdout:3/481: write d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/f3f [2653746,22771] 0 2024-04-26T10:44:30.786 INFO:tasks.workunit.client.0.smithi049.stdout:9/695: unlink d2/d25/d74/f6c 0 2024-04-26T10:44:30.788 INFO:tasks.workunit.client.0.smithi049.stdout:9/696: dread - d2/d1a/df/fe0 zero size 2024-04-26T10:44:30.788 INFO:tasks.workunit.client.0.smithi049.stdout:0/589: dread f2 [0,4194304] 0 2024-04-26T10:44:30.789 INFO:tasks.workunit.client.0.smithi049.stdout:7/594: dwrite d2/dd/d45/d82/f8a [0,4194304] 0 2024-04-26T10:44:30.791 INFO:tasks.workunit.client.0.smithi049.stdout:6/538: dwrite da/dd/de/d26/f45 [0,4194304] 0 2024-04-26T10:44:30.792 INFO:tasks.workunit.client.0.smithi049.stdout:5/574: dread d7/f9 [4194304,4194304] 0 2024-04-26T10:44:30.793 INFO:tasks.workunit.client.0.smithi049.stdout:2/541: dwrite d6/d32/d4a/f51 [0,4194304] 0 2024-04-26T10:44:30.793 INFO:tasks.workunit.client.0.smithi049.stdout:9/697: mkdir d2/d1a/d42/de3 0 2024-04-26T10:44:30.794 INFO:tasks.workunit.client.0.smithi049.stdout:0/590: mkdir d8/db/d11/d1c/dbb/dcf 0 2024-04-26T10:44:30.794 INFO:tasks.workunit.client.0.smithi049.stdout:5/575: write d7/d14/d18/d48/f49 [1593528,4973] 0 2024-04-26T10:44:30.796 INFO:tasks.workunit.client.0.smithi049.stdout:7/595: rename d2/dd/d7f/c99 to d2/d3/d96/cc1 0 2024-04-26T10:44:30.797 INFO:tasks.workunit.client.0.smithi049.stdout:4/633: dread de/d1b/f34 [0,4194304] 0 2024-04-26T10:44:30.798 INFO:tasks.workunit.client.0.smithi049.stdout:3/482: dwrite d3/d23/d2f/d6a/d6b/d26/f48 [4194304,4194304] 0 2024-04-26T10:44:30.799 INFO:tasks.workunit.client.0.smithi049.stdout:0/591: unlink d8/db/d26/d39/l53 0 2024-04-26T10:44:30.799 INFO:tasks.workunit.client.0.smithi049.stdout:9/698: rename d2/d1a/d1b/d1f/d64/c9a to d2/d25/d60/da4/ce4 0 2024-04-26T10:44:30.799 INFO:tasks.workunit.client.0.smithi049.stdout:7/596: mknod d2/dd/d48/da3/cc2 0 2024-04-26T10:44:30.799 INFO:tasks.workunit.client.0.smithi049.stdout:6/539: link da/f19 da/fb8 0 2024-04-26T10:44:30.800 INFO:tasks.workunit.client.0.smithi049.stdout:5/576: unlink d7/d14/d18/d2b/c4c 0 2024-04-26T10:44:30.800 INFO:tasks.workunit.client.0.smithi049.stdout:4/634: write de/d1b/f96 [480618,65995] 0 2024-04-26T10:44:30.800 INFO:tasks.workunit.client.0.smithi049.stdout:2/542: symlink d6/d32/la0 0 2024-04-26T10:44:30.800 INFO:tasks.workunit.client.0.smithi049.stdout:0/592: creat d8/db/d26/d6f/fd0 x:0 0 0 2024-04-26T10:44:30.801 INFO:tasks.workunit.client.0.smithi049.stdout:6/540: chown da/f91 9968009 1 2024-04-26T10:44:30.802 INFO:tasks.workunit.client.0.smithi049.stdout:9/699: chown d2/d25/dc5/ld2 1011061 1 2024-04-26T10:44:30.803 INFO:tasks.workunit.client.0.smithi049.stdout:4/635: chown de/d3f/d52/d9b/da5/l98 238187212 1 2024-04-26T10:44:30.805 INFO:tasks.workunit.client.0.smithi049.stdout:9/700: creat d2/d40/db2/fe5 x:0 0 0 2024-04-26T10:44:30.805 INFO:tasks.workunit.client.0.smithi049.stdout:5/577: mknod d7/d1d/d1f/d4e/dad/cea 0 2024-04-26T10:44:30.805 INFO:tasks.workunit.client.0.smithi049.stdout:1/502: dread d1e/d20/d4d/f53 [0,4194304] 0 2024-04-26T10:44:30.806 INFO:tasks.workunit.client.0.smithi049.stdout:3/483: truncate d3/d23/d2f/d6a/d6b/d8/dd/f18 6722522 0 2024-04-26T10:44:30.806 INFO:tasks.workunit.client.0.smithi049.stdout:9/701: fdatasync d2/d1a/df/f56 0 2024-04-26T10:44:30.807 INFO:tasks.workunit.client.0.smithi049.stdout:2/543: link f4 d6/d9/db/d34/d38/d3f/fa1 0 2024-04-26T10:44:30.807 INFO:tasks.workunit.client.0.smithi049.stdout:7/597: dread d2/d3/f56 [0,4194304] 0 2024-04-26T10:44:30.808 INFO:tasks.workunit.client.0.smithi049.stdout:4/636: dread - de/d1b/d5e/d72/d73/d88/fb7 zero size 2024-04-26T10:44:30.808 INFO:tasks.workunit.client.0.smithi049.stdout:1/503: creat d1e/d20/d26/d3c/d54/f9f x:0 0 0 2024-04-26T10:44:30.809 INFO:tasks.workunit.client.0.smithi049.stdout:8/618: dread d2/d89/d30/f63 [0,4194304] 0 2024-04-26T10:44:30.810 INFO:tasks.workunit.client.0.smithi049.stdout:3/484: stat d3/d23/d2f/d6a/d6b/d26/f7a 0 2024-04-26T10:44:30.811 INFO:tasks.workunit.client.0.smithi049.stdout:9/702: fsync d2/d1a/d1b/fba 0 2024-04-26T10:44:30.811 INFO:tasks.workunit.client.0.smithi049.stdout:6/541: dwrite da/dd/de/d26/f45 [0,4194304] 0 2024-04-26T10:44:30.812 INFO:tasks.workunit.client.0.smithi049.stdout:2/544: creat d6/d9/db/d34/d38/d3f/d60/fa2 x:0 0 0 2024-04-26T10:44:30.812 INFO:tasks.workunit.client.0.smithi049.stdout:1/504: creat d1e/d20/d26/d37/fa0 x:0 0 0 2024-04-26T10:44:30.813 INFO:tasks.workunit.client.0.smithi049.stdout:3/485: mknod d3/d23/ca3 0 2024-04-26T10:44:30.813 INFO:tasks.workunit.client.0.smithi049.stdout:0/593: dread d8/f74 [4194304,4194304] 0 2024-04-26T10:44:30.814 INFO:tasks.workunit.client.0.smithi049.stdout:1/505: chown d1e/f6f 1 1 2024-04-26T10:44:30.814 INFO:tasks.workunit.client.0.smithi049.stdout:8/619: mknod d2/d16/d19/d42/cc6 0 2024-04-26T10:44:30.815 INFO:tasks.workunit.client.0.smithi049.stdout:6/542: chown da/dd/d47/d7b/fa4 10 1 2024-04-26T10:44:30.817 INFO:tasks.workunit.client.0.smithi049.stdout:9/703: mknod d2/d1a/d8a/ce6 0 2024-04-26T10:44:30.817 INFO:tasks.workunit.client.0.smithi049.stdout:0/594: fdatasync d8/db/d26/daf/fcb 0 2024-04-26T10:44:30.817 INFO:tasks.workunit.client.0.smithi049.stdout:2/545: creat d6/d9/db/d34/d38/d3f/d60/fa3 x:0 0 0 2024-04-26T10:44:30.817 INFO:tasks.workunit.client.0.smithi049.stdout:8/620: unlink d2/d1a/f22 0 2024-04-26T10:44:30.818 INFO:tasks.workunit.client.0.smithi049.stdout:5/578: dwrite d7/d1d/d1f/d4e/d65/d6f/d91/d3e/f42 [0,4194304] 0 2024-04-26T10:44:30.820 INFO:tasks.workunit.client.0.smithi049.stdout:3/486: rename d3/d23/d2f/d6a/d6b/d8/d34/f83 to d3/d23/d2f/d6a/d6b/d26/d58/fa4 0 2024-04-26T10:44:30.820 INFO:tasks.workunit.client.0.smithi049.stdout:7/598: dwrite d2/dd/d48/f69 [4194304,4194304] 0 2024-04-26T10:44:30.821 INFO:tasks.workunit.client.0.smithi049.stdout:4/637: truncate de/d1b/d5e/d72/d73/f7c 2273258 0 2024-04-26T10:44:30.821 INFO:tasks.workunit.client.0.smithi049.stdout:9/704: truncate d2/d1a/d1b/d7a/fb5 824569 0 2024-04-26T10:44:30.823 INFO:tasks.workunit.client.0.smithi049.stdout:5/579: symlink d7/d14/d18/d2b/leb 0 2024-04-26T10:44:30.823 INFO:tasks.workunit.client.0.smithi049.stdout:0/595: write d8/db/d11/f83 [1451445,18775] 0 2024-04-26T10:44:30.824 INFO:tasks.workunit.client.0.smithi049.stdout:7/599: write d2/dd/d7f/db1/fb9 [700911,37235] 0 2024-04-26T10:44:30.825 INFO:tasks.workunit.client.0.smithi049.stdout:2/546: write d6/d9/db/df/d31/f5c [1260960,36297] 0 2024-04-26T10:44:30.825 INFO:tasks.workunit.client.0.smithi049.stdout:3/487: mknod d3/d23/d2f/d6a/d6b/d8/d55/d46/ca5 0 2024-04-26T10:44:30.826 INFO:tasks.workunit.client.0.smithi049.stdout:4/638: chown de/d1b/d5e/d72/d73/d84/f2e 0 1 2024-04-26T10:44:30.829 INFO:tasks.workunit.client.0.smithi049.stdout:0/596: read - d8/db/fb6 zero size 2024-04-26T10:44:30.829 INFO:tasks.workunit.client.0.smithi049.stdout:1/506: dwrite d1e/d20/d4d/f60 [4194304,4194304] 0 2024-04-26T10:44:30.829 INFO:tasks.workunit.client.0.smithi049.stdout:3/488: write d3/d6/f10 [483233,65059] 0 2024-04-26T10:44:30.829 INFO:tasks.workunit.client.0.smithi049.stdout:5/580: mknod d7/d1d/d1f/d4e/dad/cec 0 2024-04-26T10:44:30.829 INFO:tasks.workunit.client.0.smithi049.stdout:4/639: mkdir de/d3f/dbf 0 2024-04-26T10:44:30.829 INFO:tasks.workunit.client.0.smithi049.stdout:2/547: creat d6/d9/db/d34/d38/d73/fa4 x:0 0 0 2024-04-26T10:44:30.830 INFO:tasks.workunit.client.0.smithi049.stdout:7/600: creat d2/d3/de/fc3 x:0 0 0 2024-04-26T10:44:30.830 INFO:tasks.workunit.client.0.smithi049.stdout:0/597: dread - d8/db/d26/d6f/fba zero size 2024-04-26T10:44:30.830 INFO:tasks.workunit.client.0.smithi049.stdout:6/543: dwrite f8 [0,4194304] 0 2024-04-26T10:44:30.830 INFO:tasks.workunit.client.0.smithi049.stdout:1/507: chown d1e/d20/f32 801115 1 2024-04-26T10:44:30.830 INFO:tasks.workunit.client.0.smithi049.stdout:3/489: symlink d3/d23/d2f/d6a/d6b/la6 0 2024-04-26T10:44:30.831 INFO:tasks.workunit.client.0.smithi049.stdout:7/601: write d2/d3/de/fc3 [763561,125526] 0 2024-04-26T10:44:30.831 INFO:tasks.workunit.client.0.smithi049.stdout:2/548: creat d6/fa5 x:0 0 0 2024-04-26T10:44:30.833 INFO:tasks.workunit.client.0.smithi049.stdout:1/508: dread - d1e/d20/d26/d3c/f99 zero size 2024-04-26T10:44:30.834 INFO:tasks.workunit.client.0.smithi049.stdout:9/705: truncate d2/d1a/fd 3200901 0 2024-04-26T10:44:30.834 INFO:tasks.workunit.client.0.smithi049.stdout:6/544: creat da/dd/d62/d9d/fb9 x:0 0 0 2024-04-26T10:44:30.834 INFO:tasks.workunit.client.0.smithi049.stdout:0/598: symlink d8/db/d26/d39/ld1 0 2024-04-26T10:44:30.835 INFO:tasks.workunit.client.0.smithi049.stdout:2/549: creat d6/d9/db/df/d31/fa6 x:0 0 0 2024-04-26T10:44:30.837 INFO:tasks.workunit.client.0.smithi049.stdout:3/490: fdatasync d3/d6/f10 0 2024-04-26T10:44:30.837 INFO:tasks.workunit.client.0.smithi049.stdout:6/545: symlink da/dd/d47/d7b/d84/daa/lba 0 2024-04-26T10:44:30.838 INFO:tasks.workunit.client.0.smithi049.stdout:5/581: dwrite d7/d14/d18/f89 [0,4194304] 0 2024-04-26T10:44:30.840 INFO:tasks.workunit.client.0.smithi049.stdout:2/550: unlink d6/d9/db/d11/l2c 0 2024-04-26T10:44:30.840 INFO:tasks.workunit.client.0.smithi049.stdout:9/706: dread d2/d1a/d1b/d7a/f80 [0,4194304] 0 2024-04-26T10:44:30.840 INFO:tasks.workunit.client.0.smithi049.stdout:6/546: chown da/dd/de/d26/d22/f56 58601677 1 2024-04-26T10:44:30.840 INFO:tasks.workunit.client.0.smithi049.stdout:3/491: write d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/f28 [3550086,88410] 0 2024-04-26T10:44:30.841 INFO:tasks.workunit.client.0.smithi049.stdout:5/582: write d7/fab [583047,69201] 0 2024-04-26T10:44:30.842 INFO:tasks.workunit.client.0.smithi049.stdout:7/602: dwrite d2/dd/d48/d5c/f5f [0,4194304] 0 2024-04-26T10:44:30.842 INFO:tasks.workunit.client.0.smithi049.stdout:2/551: fsync d6/d9/db/d11/f1d 0 2024-04-26T10:44:30.843 INFO:tasks.workunit.client.0.smithi049.stdout:9/707: mkdir d2/d40/d53/de7 0 2024-04-26T10:44:30.843 INFO:tasks.workunit.client.0.smithi049.stdout:3/492: dread - d3/d23/d2f/d6a/d6b/d26/f7a zero size 2024-04-26T10:44:30.844 INFO:tasks.workunit.client.0.smithi049.stdout:8/621: dread d2/df/d10/d23/d6c/f2c [8388608,4194304] 0 2024-04-26T10:44:30.844 INFO:tasks.workunit.client.0.smithi049.stdout:9/708: truncate d2/f3c 4978008 0 2024-04-26T10:44:30.846 INFO:tasks.workunit.client.0.smithi049.stdout:8/622: write d2/df/d10/d47/d75/fb3 [311288,52378] 0 2024-04-26T10:44:30.846 INFO:tasks.workunit.client.0.smithi049.stdout:9/709: unlink d2/d1a/d1b/d1f/d49/fc6 0 2024-04-26T10:44:30.846 INFO:tasks.workunit.client.0.smithi049.stdout:3/493: creat d3/d23/d2f/d6a/d6b/d26/fa7 x:0 0 0 2024-04-26T10:44:30.846 INFO:tasks.workunit.client.0.smithi049.stdout:8/623: getdents d2/df/dc5 0 2024-04-26T10:44:30.847 INFO:tasks.workunit.client.0.smithi049.stdout:8/624: write d2/d16/f9b [1270143,121861] 0 2024-04-26T10:44:30.849 INFO:tasks.workunit.client.0.smithi049.stdout:1/509: write d1e/d20/d26/d37/f4e [82707,63150] 0 2024-04-26T10:44:30.849 INFO:tasks.workunit.client.0.smithi049.stdout:5/583: write d7/d1d/d1f/d4e/dad/fb7 [384801,113071] 0 2024-04-26T10:44:30.851 INFO:tasks.workunit.client.0.smithi049.stdout:7/603: truncate d2/d3/f56 190010 0 2024-04-26T10:44:30.851 INFO:tasks.workunit.client.0.smithi049.stdout:1/510: fsync d1e/d20/d26/f4b 0 2024-04-26T10:44:30.852 INFO:tasks.workunit.client.0.smithi049.stdout:5/584: symlink d7/d14/d18/d2b/led 0 2024-04-26T10:44:30.852 INFO:tasks.workunit.client.0.smithi049.stdout:1/511: chown d1e/d20/d26/d3c/d54 31 1 2024-04-26T10:44:30.853 INFO:tasks.workunit.client.0.smithi049.stdout:8/625: dwrite d2/d16/f8e [0,4194304] 0 2024-04-26T10:44:30.854 INFO:tasks.workunit.client.0.smithi049.stdout:8/626: mkdir d2/d16/d19/dc7 0 2024-04-26T10:44:30.854 INFO:tasks.workunit.client.0.smithi049.stdout:1/512: creat d1e/d20/d26/d3c/d96/fa1 x:0 0 0 2024-04-26T10:44:30.855 INFO:tasks.workunit.client.0.smithi049.stdout:5/585: getdents d7/dc6 0 2024-04-26T10:44:30.856 INFO:tasks.workunit.client.0.smithi049.stdout:8/627: creat d2/d1a/d9c/fc8 x:0 0 0 2024-04-26T10:44:30.857 INFO:tasks.workunit.client.0.smithi049.stdout:1/513: write d1e/d20/d26/d3c/d54/f9b [589873,124266] 0 2024-04-26T10:44:30.858 INFO:tasks.workunit.client.0.smithi049.stdout:5/586: fdatasync d7/d1d/d1f/d4e/d65/d6f/d91/fae 0 2024-04-26T10:44:30.858 INFO:tasks.workunit.client.0.smithi049.stdout:8/628: mkdir d2/d1a/d9c/dc9 0 2024-04-26T10:44:30.859 INFO:tasks.workunit.client.0.smithi049.stdout:5/587: read - d7/d1d/d1f/d4e/d65/f92 zero size 2024-04-26T10:44:30.859 INFO:tasks.workunit.client.0.smithi049.stdout:8/629: mkdir d2/df/d10/d47/dca 0 2024-04-26T10:44:30.860 INFO:tasks.workunit.client.0.smithi049.stdout:8/630: creat d2/d89/d30/fcb x:0 0 0 2024-04-26T10:44:30.862 INFO:tasks.workunit.client.0.smithi049.stdout:8/631: creat d2/d89/d2a/fcc x:0 0 0 2024-04-26T10:44:30.862 INFO:tasks.workunit.client.0.smithi049.stdout:4/640: sync 2024-04-26T10:44:30.862 INFO:tasks.workunit.client.0.smithi049.stdout:7/604: sync 2024-04-26T10:44:30.862 INFO:tasks.workunit.client.0.smithi049.stdout:4/641: readlink de/d1b/l3e 0 2024-04-26T10:44:30.863 INFO:tasks.workunit.client.0.smithi049.stdout:7/605: rmdir d2/dd/d45 39 2024-04-26T10:44:30.863 INFO:tasks.workunit.client.0.smithi049.stdout:8/632: mkdir d2/d17/d34/d40/d64/dcd 0 2024-04-26T10:44:30.864 INFO:tasks.workunit.client.0.smithi049.stdout:1/514: dwrite d1e/d20/d26/d37/d69/d75/f85 [0,4194304] 0 2024-04-26T10:44:30.865 INFO:tasks.workunit.client.0.smithi049.stdout:4/642: stat de/d3f/d48/l65 0 2024-04-26T10:44:30.865 INFO:tasks.workunit.client.0.smithi049.stdout:0/599: dread d8/db/d26/d6f/f9c [0,4194304] 0 2024-04-26T10:44:30.865 INFO:tasks.workunit.client.0.smithi049.stdout:7/606: mknod d2/dd/cc4 0 2024-04-26T10:44:30.866 INFO:tasks.workunit.client.0.smithi049.stdout:1/515: creat d1e/d20/d26/d57/fa2 x:0 0 0 2024-04-26T10:44:30.867 INFO:tasks.workunit.client.0.smithi049.stdout:5/588: read d7/d1d/d1f/d4e/d65/d6f/d91/fae [28637,73928] 0 2024-04-26T10:44:30.867 INFO:tasks.workunit.client.0.smithi049.stdout:1/516: chown fa 99865578 1 2024-04-26T10:44:30.867 INFO:tasks.workunit.client.0.smithi049.stdout:2/552: dread d6/d9/db/d34/d38/d3f/f42 [0,4194304] 0 2024-04-26T10:44:30.868 INFO:tasks.workunit.client.0.smithi049.stdout:2/553: chown d6/f9e 593 1 2024-04-26T10:44:30.869 INFO:tasks.workunit.client.0.smithi049.stdout:8/633: link d2/d16/f2e d2/d1a/fce 0 2024-04-26T10:44:30.870 INFO:tasks.workunit.client.0.smithi049.stdout:1/517: mkdir d1e/d20/d26/d3c/d96/da3 0 2024-04-26T10:44:30.870 INFO:tasks.workunit.client.0.smithi049.stdout:2/554: creat d6/d9/db/d35/d91/fa7 x:0 0 0 2024-04-26T10:44:30.872 INFO:tasks.workunit.client.0.smithi049.stdout:2/555: chown d6/d32/la0 15566690 1 2024-04-26T10:44:30.873 INFO:tasks.workunit.client.0.smithi049.stdout:7/607: truncate d2/d3/de/d1c/f36 2478257 0 2024-04-26T10:44:30.873 INFO:tasks.workunit.client.0.smithi049.stdout:3/494: dread d3/f40 [0,4194304] 0 2024-04-26T10:44:30.874 INFO:tasks.workunit.client.0.smithi049.stdout:0/600: dwrite d8/db/d26/d6f/f9c [0,4194304] 0 2024-04-26T10:44:30.875 INFO:tasks.workunit.client.0.smithi049.stdout:5/589: dwrite d7/dc6/fda [0,4194304] 0 2024-04-26T10:44:30.876 INFO:tasks.workunit.client.0.smithi049.stdout:2/556: write d6/d32/f87 [1304255,1950] 0 2024-04-26T10:44:30.877 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:30.876+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:30.878 INFO:tasks.workunit.client.0.smithi049.stdout:3/495: mknod d3/d6/ca8 0 2024-04-26T10:44:30.881 INFO:tasks.workunit.client.0.smithi049.stdout:7/608: link d2/dd/d25/d27/f57 d2/d3/de/d1c/fc5 0 2024-04-26T10:44:30.881 INFO:tasks.workunit.client.0.smithi049.stdout:8/634: dread d2/f14 [0,4194304] 0 2024-04-26T10:44:30.881 INFO:tasks.workunit.client.0.smithi049.stdout:2/557: symlink d6/d9/db/d34/d7b/la8 0 2024-04-26T10:44:30.881 INFO:tasks.workunit.client.0.smithi049.stdout:6/547: dread da/dd/de/d26/d29/f31 [4194304,4194304] 0 2024-04-26T10:44:30.883 INFO:tasks.workunit.client.0.smithi049.stdout:1/518: dwrite d1e/d20/f32 [0,4194304] 0 2024-04-26T10:44:30.883 INFO:tasks.workunit.client.0.smithi049.stdout:3/496: creat d3/d23/d2f/d6a/d6b/d8/dd/fa9 x:0 0 0 2024-04-26T10:44:30.883 INFO:tasks.workunit.client.0.smithi049.stdout:5/590: creat d7/d1d/d1f/d4e/d65/d6f/d91/fee x:0 0 0 2024-04-26T10:44:30.884 INFO:tasks.workunit.client.0.smithi049.stdout:2/558: mknod d6/d32/d4a/ca9 0 2024-04-26T10:44:30.885 INFO:tasks.workunit.client.0.smithi049.stdout:8/635: creat d2/d16/d19/d42/d7c/fcf x:0 0 0 2024-04-26T10:44:30.886 INFO:tasks.workunit.client.0.smithi049.stdout:1/519: creat d1e/d20/d26/d37/d8e/fa4 x:0 0 0 2024-04-26T10:44:30.886 INFO:tasks.workunit.client.0.smithi049.stdout:4/643: dwrite de/d1b/d5e/d72/d73/d84/d4b/fa3 [0,4194304] 0 2024-04-26T10:44:30.887 INFO:tasks.workunit.client.0.smithi049.stdout:2/559: fsync d6/d9/f6b 0 2024-04-26T10:44:30.887 INFO:tasks.workunit.client.0.smithi049.stdout:2/560: sync 2024-04-26T10:44:30.887 INFO:tasks.workunit.client.0.smithi049.stdout:0/601: dwrite d8/db/d26/f40 [0,4194304] 0 2024-04-26T10:44:30.888 INFO:tasks.workunit.client.0.smithi049.stdout:0/602: sync 2024-04-26T10:44:30.888 INFO:tasks.workunit.client.0.smithi049.stdout:8/636: write d2/d16/d19/f25 [935087,72498] 0 2024-04-26T10:44:30.889 INFO:tasks.workunit.client.0.smithi049.stdout:6/548: creat da/dd/de/d26/fbb x:0 0 0 2024-04-26T10:44:30.889 INFO:tasks.workunit.client.0.smithi049.stdout:9/710: dread d2/d1a/f2a [0,4194304] 0 2024-04-26T10:44:30.890 INFO:tasks.workunit.client.0.smithi049.stdout:2/561: dread - d6/d30/f65 zero size 2024-04-26T10:44:30.891 INFO:tasks.workunit.client.0.smithi049.stdout:1/520: mknod d1e/d20/d26/d37/d69/ca5 0 2024-04-26T10:44:30.892 INFO:tasks.workunit.client.0.smithi049.stdout:5/591: dread d7/d1d/d1f/d4e/d65/f75 [0,4194304] 0 2024-04-26T10:44:30.892 INFO:tasks.workunit.client.0.smithi049.stdout:9/711: readlink d2/d25/dc5/ldc 0 2024-04-26T10:44:30.892 INFO:tasks.workunit.client.0.smithi049.stdout:6/549: write da/dd/d47/f79 [1811029,69997] 0 2024-04-26T10:44:30.892 INFO:tasks.workunit.client.0.smithi049.stdout:2/562: symlink d6/d9/d5f/laa 0 2024-04-26T10:44:30.894 INFO:tasks.workunit.client.0.smithi049.stdout:8/637: rename d2/df/dc5 to d2/d17/d34/dd0 0 2024-04-26T10:44:30.895 INFO:tasks.workunit.client.0.smithi049.stdout:1/521: chown d1e/d20/d26/d3c/d54/d59/f5e 2911 1 2024-04-26T10:44:30.896 INFO:tasks.workunit.client.0.smithi049.stdout:2/563: write d6/d9/db/d34/d7b/f7e [560149,55304] 0 2024-04-26T10:44:30.898 INFO:tasks.workunit.client.0.smithi049.stdout:0/603: dwrite d8/db/d11/f65 [0,4194304] 0 2024-04-26T10:44:30.901 INFO:tasks.workunit.client.0.smithi049.stdout:4/644: truncate de/d1b/d5e/d72/d73/f7c 1257110 0 2024-04-26T10:44:30.902 INFO:tasks.workunit.client.0.smithi049.stdout:1/522: unlink d1e/d20/d26/l48 0 2024-04-26T10:44:30.903 INFO:tasks.workunit.client.0.smithi049.stdout:4/645: dread - de/fa0 zero size 2024-04-26T10:44:30.903 INFO:tasks.workunit.client.0.smithi049.stdout:9/712: dwrite d2/d25/d74/f71 [0,4194304] 0 2024-04-26T10:44:30.903 INFO:tasks.workunit.client.0.smithi049.stdout:0/604: dread - d8/db/d11/d1b/fc4 zero size 2024-04-26T10:44:30.905 INFO:tasks.workunit.client.0.smithi049.stdout:8/638: write d2/df/d10/d47/d75/fb9 [4378912,104045] 0 2024-04-26T10:44:30.905 INFO:tasks.workunit.client.0.smithi049.stdout:0/605: rmdir d8/d1e 39 2024-04-26T10:44:30.908 INFO:tasks.workunit.client.0.smithi049.stdout:5/592: dwrite d7/d53/fc4 [0,4194304] 0 2024-04-26T10:44:30.911 INFO:tasks.workunit.client.0.smithi049.stdout:1/523: stat d1e/d20/d26/d3c/d54/d59/d73/c8a 0 2024-04-26T10:44:30.911 INFO:tasks.workunit.client.0.smithi049.stdout:7/609: dwrite d2/dd/d25/f75 [0,4194304] 0 2024-04-26T10:44:30.911 INFO:tasks.workunit.client.0.smithi049.stdout:6/550: dwrite da/dd/f5c [0,4194304] 0 2024-04-26T10:44:30.911 INFO:tasks.workunit.client.0.smithi049.stdout:4/646: creat de/d1b/d5e/d99/fc0 x:0 0 0 2024-04-26T10:44:30.911 INFO:tasks.workunit.client.0.smithi049.stdout:8/639: write d2/d1a/d9c/fc8 [623604,29406] 0 2024-04-26T10:44:30.912 INFO:tasks.workunit.client.0.smithi049.stdout:0/606: creat d8/d1e/fd2 x:0 0 0 2024-04-26T10:44:30.912 INFO:tasks.workunit.client.0.smithi049.stdout:1/524: readlink d1e/d20/d4d/l6d 0 2024-04-26T10:44:30.912 INFO:tasks.workunit.client.0.smithi049.stdout:2/564: dwrite d6/d9/db/f1c [8388608,4194304] 0 2024-04-26T10:44:30.912 INFO:tasks.workunit.client.0.smithi049.stdout:9/713: write d2/d1a/d1b/fba [376778,92937] 0 2024-04-26T10:44:30.913 INFO:tasks.workunit.client.0.smithi049.stdout:7/610: mkdir d2/dd/d7f/db1/dc6 0 2024-04-26T10:44:30.913 INFO:tasks.workunit.client.0.smithi049.stdout:0/607: read d8/f74 [2125278,20396] 0 2024-04-26T10:44:30.913 INFO:tasks.workunit.client.0.smithi049.stdout:8/640: symlink d2/ld1 0 2024-04-26T10:44:30.913 INFO:tasks.workunit.client.0.smithi049.stdout:4/647: write de/d1b/d5e/d72/d73/f85 [849309,67568] 0 2024-04-26T10:44:30.915 INFO:tasks.workunit.client.0.smithi049.stdout:3/497: dread d3/d23/d2f/d6a/d6b/d26/f5a [0,4194304] 0 2024-04-26T10:44:30.915 INFO:tasks.workunit.client.0.smithi049.stdout:6/551: chown da/dd/d47/d7b/fa4 1264987 1 2024-04-26T10:44:30.915 INFO:tasks.workunit.client.0.smithi049.stdout:5/593: symlink d7/d1d/d1f/d4e/d65/d6f/d91/d3e/lef 0 2024-04-26T10:44:30.915 INFO:tasks.workunit.client.0.smithi049.stdout:8/641: write d2/df/f95 [610764,38736] 0 2024-04-26T10:44:30.915 INFO:tasks.workunit.client.0.smithi049.stdout:6/552: fsync da/d4a/f37 0 2024-04-26T10:44:30.915 INFO:tasks.workunit.client.0.smithi049.stdout:9/714: truncate d2/d1a/d1b/d7a/fb5 934011 0 2024-04-26T10:44:30.915 INFO:tasks.workunit.client.0.smithi049.stdout:2/565: truncate d6/d9/f9a 391808 0 2024-04-26T10:44:30.916 INFO:tasks.workunit.client.0.smithi049.stdout:7/611: truncate d2/d3/d96/f95 869007 0 2024-04-26T10:44:30.917 INFO:tasks.workunit.client.0.smithi049.stdout:4/648: creat de/d3f/d52/fc1 x:0 0 0 2024-04-26T10:44:30.917 INFO:tasks.workunit.client.0.smithi049.stdout:5/594: write d7/d14/d18/f6e [650173,72107] 0 2024-04-26T10:44:30.917 INFO:tasks.workunit.client.0.smithi049.stdout:0/608: creat d8/d66/d84/fd3 x:0 0 0 2024-04-26T10:44:30.917 INFO:tasks.workunit.client.0.smithi049.stdout:2/566: creat d6/d30/d97/fab x:0 0 0 2024-04-26T10:44:30.918 INFO:tasks.workunit.client.0.smithi049.stdout:9/715: creat d2/d25/d60/da4/fe8 x:0 0 0 2024-04-26T10:44:30.918 INFO:tasks.workunit.client.0.smithi049.stdout:3/498: symlink d3/d23/d2f/d6a/d6b/d8c/laa 0 2024-04-26T10:44:30.919 INFO:tasks.workunit.client.0.smithi049.stdout:9/716: read - d2/d25/d60/da4/fe8 zero size 2024-04-26T10:44:30.920 INFO:tasks.workunit.client.0.smithi049.stdout:2/567: chown d6/d32/d69/f8e 1856 1 2024-04-26T10:44:30.921 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:30.921 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:30.921 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:30.921 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:30.921 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:30.923 INFO:tasks.workunit.client.0.smithi049.stdout:8/642: dwrite d2/df/f5a [0,4194304] 0 2024-04-26T10:44:30.923 INFO:tasks.workunit.client.0.smithi049.stdout:2/568: creat d6/d9/db/fac x:0 0 0 2024-04-26T10:44:30.924 INFO:tasks.workunit.client.0.smithi049.stdout:8/643: mknod d2/d16/cd2 0 2024-04-26T10:44:30.924 INFO:tasks.workunit.client.0.smithi049.stdout:8/644: read - d2/df/fa1 zero size 2024-04-26T10:44:30.926 INFO:tasks.workunit.client.0.smithi049.stdout:2/569: symlink d6/d9/db/d34/d38/d73/lad 0 2024-04-26T10:44:30.926 INFO:tasks.workunit.client.0.smithi049.stdout:8/645: fdatasync d2/d89/d2a/d9f/fbc 0 2024-04-26T10:44:30.928 INFO:tasks.workunit.client.0.smithi049.stdout:2/570: chown d6/d9/d5f/l95 13 1 2024-04-26T10:44:30.928 INFO:tasks.workunit.client.0.smithi049.stdout:9/717: dwrite d2/d1a/d1b/d1f/d34/fbe [0,4194304] 0 2024-04-26T10:44:30.928 INFO:tasks.workunit.client.0.smithi049.stdout:1/525: truncate d1e/d20/d26/d3c/f3f 653299 0 2024-04-26T10:44:30.929 INFO:tasks.workunit.client.0.smithi049.stdout:2/571: creat d6/d30/d97/fae x:0 0 0 2024-04-26T10:44:30.929 INFO:tasks.workunit.client.0.smithi049.stdout:8/646: write d2/d16/d19/f25 [1442242,94650] 0 2024-04-26T10:44:30.929 INFO:tasks.workunit.client.0.smithi049.stdout:1/526: stat d1e/d20/d26/d3c/d54/d59/c61 0 2024-04-26T10:44:30.930 INFO:tasks.workunit.client.0.smithi049.stdout:8/647: unlink d2/d89/d30/fba 0 2024-04-26T10:44:30.931 INFO:tasks.workunit.client.0.smithi049.stdout:8/648: chown d2/d89/d2a/d9f/cb4 323011 1 2024-04-26T10:44:30.931 INFO:tasks.workunit.client.0.smithi049.stdout:8/649: sync 2024-04-26T10:44:30.932 INFO:tasks.workunit.client.0.smithi049.stdout:1/527: mknod d1e/d20/d67/ca6 0 2024-04-26T10:44:30.932 INFO:tasks.workunit.client.0.smithi049.stdout:2/572: link d6/f29 d6/d9/db/d35/faf 0 2024-04-26T10:44:30.932 INFO:tasks.workunit.client.0.smithi049.stdout:8/650: mknod d2/d89/d2a/cd3 0 2024-04-26T10:44:30.933 INFO:tasks.workunit.client.0.smithi049.stdout:1/528: symlink d1e/d20/la7 0 2024-04-26T10:44:30.934 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:30.934 INFO:tasks.workunit.client.0.smithi049.stdout:2/573: creat d6/d9/db/d11/fb0 x:0 0 0 2024-04-26T10:44:30.935 INFO:tasks.workunit.client.0.smithi049.stdout:8/651: link d2/df/d10/d47/d75/f7d d2/df/d10/d23/d6c/d5e/fd4 0 2024-04-26T10:44:30.935 INFO:tasks.workunit.client.0.smithi049.stdout:1/529: chown d1e/d20/d26/d3c/d54/d59/f65 45321 1 2024-04-26T10:44:30.935 INFO:tasks.workunit.client.0.smithi049.stdout:6/553: truncate da/dd/de/d42/d5a/f74 528851 0 2024-04-26T10:44:30.937 INFO:tasks.workunit.client.0.smithi049.stdout:6/554: dread - da/dd/de/d26/fbb zero size 2024-04-26T10:44:30.941 INFO:tasks.workunit.client.0.smithi049.stdout:2/574: rmdir d6/d9/db 39 2024-04-26T10:44:30.942 INFO:tasks.workunit.client.0.smithi049.stdout:8/652: dwrite d2/d17/fa8 [0,4194304] 0 2024-04-26T10:44:30.942 INFO:tasks.workunit.client.0.smithi049.stdout:4/649: dread de/d1b/f1c [0,4194304] 0 2024-04-26T10:44:30.946 INFO:tasks.workunit.client.0.smithi049.stdout:2/575: readlink d6/d9/db/d34/d7b/la8 0 2024-04-26T10:44:30.946 INFO:tasks.workunit.client.0.smithi049.stdout:8/653: mkdir d2/df/d10/d47/d75/dd5 0 2024-04-26T10:44:30.946 INFO:tasks.workunit.client.0.smithi049.stdout:6/555: dwrite da/dd/de/d42/d5a/f4b [0,4194304] 0 2024-04-26T10:44:30.946 INFO:tasks.workunit.client.0.smithi049.stdout:4/650: mknod de/d1b/d5e/d72/d73/d84/cc2 0 2024-04-26T10:44:30.946 INFO:tasks.workunit.client.0.smithi049.stdout:8/654: chown d2/df/f36 9124 1 2024-04-26T10:44:30.946 INFO:tasks.workunit.client.0.smithi049.stdout:2/576: creat d6/d9/db/fb1 x:0 0 0 2024-04-26T10:44:30.947 INFO:tasks.workunit.client.0.smithi049.stdout:4/651: mknod de/d3f/d52/d9b/d9e/cc3 0 2024-04-26T10:44:30.947 INFO:tasks.workunit.client.0.smithi049.stdout:6/556: write da/dd/de/d26/d22/d4c/f8b [621296,72452] 0 2024-04-26T10:44:30.948 INFO:tasks.workunit.client.0.smithi049.stdout:4/652: fsync de/d1b/d5e/d72/fb6 0 2024-04-26T10:44:30.949 INFO:tasks.workunit.client.0.smithi049.stdout:8/655: creat d2/d17/d34/fd6 x:0 0 0 2024-04-26T10:44:30.949 INFO:tasks.workunit.client.0.smithi049.stdout:4/653: mknod de/d1d/cc4 0 2024-04-26T10:44:30.949 INFO:tasks.workunit.client.0.smithi049.stdout:2/577: truncate d6/d9/db/d34/d38/d3f/d60/f93 10506 0 2024-04-26T10:44:30.950 INFO:tasks.workunit.client.0.smithi049.stdout:2/578: creat d6/d9/db/d1e/fb2 x:0 0 0 2024-04-26T10:44:30.950 INFO:tasks.workunit.client.0.smithi049.stdout:8/656: link d2/df/d10/c7b d2/d89/cd7 0 2024-04-26T10:44:30.951 INFO:tasks.workunit.client.0.smithi049.stdout:4/654: fdatasync de/d1b/d5e/d72/d73/d84/d24/f61 0 2024-04-26T10:44:30.951 INFO:tasks.workunit.client.0.smithi049.stdout:8/657: truncate d2/df/f36 827219 0 2024-04-26T10:44:30.952 INFO:tasks.workunit.client.0.smithi049.stdout:4/655: readlink de/d1b/d5e/d72/d73/d84/d4b/l5f 0 2024-04-26T10:44:30.952 INFO:tasks.workunit.client.0.smithi049.stdout:8/658: write d2/d16/d19/d42/f4e [2373340,12113] 0 2024-04-26T10:44:30.953 INFO:tasks.workunit.client.0.smithi049.stdout:4/656: mkdir de/d1b/d5e/d72/d73/d84/d24/d50/dc5 0 2024-04-26T10:44:30.955 INFO:tasks.workunit.client.0.smithi049.stdout:7/612: dread d2/f2c [0,4194304] 0 2024-04-26T10:44:30.956 INFO:tasks.workunit.client.0.smithi049.stdout:7/613: chown d2/f4f 2363320 1 2024-04-26T10:44:30.957 INFO:tasks.workunit.client.0.smithi049.stdout:7/614: stat d2/d3/d96/fb4 0 2024-04-26T10:44:30.957 INFO:tasks.workunit.client.0.smithi049.stdout:4/657: dread de/d1b/f1c [0,4194304] 0 2024-04-26T10:44:30.958 INFO:tasks.workunit.client.0.smithi049.stdout:8/659: dwrite d2/d89/f74 [0,4194304] 0 2024-04-26T10:44:30.958 INFO:tasks.workunit.client.0.smithi049.stdout:7/615: unlink d2/dd/d48/l86 0 2024-04-26T10:44:30.958 INFO:tasks.workunit.client.0.smithi049.stdout:4/658: write de/f15 [4577988,39784] 0 2024-04-26T10:44:30.960 INFO:tasks.workunit.client.0.smithi049.stdout:8/660: stat d2/d16/d19/d42/d7c/l80 0 2024-04-26T10:44:30.960 INFO:tasks.workunit.client.0.smithi049.stdout:5/595: dread d7/d1d/d20/fa4 [0,4194304] 0 2024-04-26T10:44:30.961 INFO:tasks.workunit.client.0.smithi049.stdout:8/661: unlink d2/d89/f41 0 2024-04-26T10:44:30.962 INFO:tasks.workunit.client.0.smithi049.stdout:9/718: dread d2/d25/d74/f98 [0,4194304] 0 2024-04-26T10:44:30.962 INFO:tasks.workunit.client.0.smithi049.stdout:9/719: sync 2024-04-26T10:44:30.963 INFO:tasks.workunit.client.0.smithi049.stdout:9/720: sync 2024-04-26T10:44:30.963 INFO:tasks.workunit.client.0.smithi049.stdout:4/659: rename de/d1b/d5e/da2/fa9 to de/d1b/d5e/d72/d73/d84/fc6 0 2024-04-26T10:44:30.964 INFO:tasks.workunit.client.0.smithi049.stdout:5/596: symlink d7/d1d/d1f/d4e/d65/d6f/lf0 0 2024-04-26T10:44:30.964 INFO:tasks.workunit.client.0.smithi049.stdout:0/609: dread d8/db/d26/d39/f58 [0,4194304] 0 2024-04-26T10:44:30.965 INFO:tasks.workunit.client.0.smithi049.stdout:8/662: symlink d2/df/ld8 0 2024-04-26T10:44:30.965 INFO:tasks.workunit.client.0.smithi049.stdout:8/663: sync 2024-04-26T10:44:30.966 INFO:tasks.workunit.client.0.smithi049.stdout:9/721: mkdir d2/d1a/df/ddb/de9 0 2024-04-26T10:44:30.966 INFO:tasks.workunit.client.0.smithi049.stdout:1/530: dread d1e/f44 [0,4194304] 0 2024-04-26T10:44:30.966 INFO:tasks.workunit.client.0.smithi049.stdout:9/722: stat d2/d1a 0 2024-04-26T10:44:30.967 INFO:tasks.workunit.client.0.smithi049.stdout:2/579: dwrite d6/d9/db/d1e/f21 [0,4194304] 0 2024-04-26T10:44:30.968 INFO:tasks.workunit.client.0.smithi049.stdout:1/531: fdatasync d1e/d20/d26/f63 0 2024-04-26T10:44:30.969 INFO:tasks.workunit.client.0.smithi049.stdout:3/499: dread d3/d23/d2f/d6a/d6b/d8/f49 [0,4194304] 0 2024-04-26T10:44:30.969 INFO:tasks.workunit.client.0.smithi049.stdout:7/616: dread d2/dd/d7f/db1/fb9 [0,4194304] 0 2024-04-26T10:44:30.969 INFO:tasks.workunit.client.0.smithi049.stdout:9/723: dread - d2/d1a/d1b/d1f/d64/f85 zero size 2024-04-26T10:44:30.969 INFO:tasks.workunit.client.0.smithi049.stdout:8/664: mkdir d2/d16/d19/dd9 0 2024-04-26T10:44:30.970 INFO:tasks.workunit.client.0.smithi049.stdout:2/580: fdatasync d6/f2f 0 2024-04-26T10:44:30.972 INFO:tasks.workunit.client.0.smithi049.stdout:8/665: readlink d2/df/d10/l2d 0 2024-04-26T10:44:30.972 INFO:tasks.workunit.client.0.smithi049.stdout:0/610: truncate f3 1193963 0 2024-04-26T10:44:30.973 INFO:tasks.workunit.client.0.smithi049.stdout:5/597: dwrite d7/d1d/fbc [0,4194304] 0 2024-04-26T10:44:30.974 INFO:tasks.workunit.client.0.smithi049.stdout:2/581: creat d6/d32/d69/fb3 x:0 0 0 2024-04-26T10:44:30.976 INFO:tasks.workunit.client.0.smithi049.stdout:5/598: mknod d7/d14/cf1 0 2024-04-26T10:44:30.976 INFO:tasks.workunit.client.0.smithi049.stdout:0/611: write d8/db/d11/d1b/d4d/f80 [3473671,1140] 0 2024-04-26T10:44:30.977 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:30.976+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:30.978 INFO:tasks.workunit.client.0.smithi049.stdout:2/582: rename d6/d30/f6e to d6/d32/d69/fb4 0 2024-04-26T10:44:30.981 INFO:tasks.workunit.client.0.smithi049.stdout:3/500: dwrite d3/d23/d2f/d6a/d6b/d26/d29/f72 [0,4194304] 0 2024-04-26T10:44:30.981 INFO:tasks.workunit.client.0.smithi049.stdout:7/617: dwrite d2/f6 [8388608,4194304] 0 2024-04-26T10:44:30.981 INFO:tasks.workunit.client.0.smithi049.stdout:5/599: write d7/d1d/d20/f36 [547421,42481] 0 2024-04-26T10:44:30.982 INFO:tasks.workunit.client.0.smithi049.stdout:1/532: dwrite d1e/d20/f41 [4194304,4194304] 0 2024-04-26T10:44:30.983 INFO:tasks.workunit.client.0.smithi049.stdout:8/666: dwrite d2/d1a/d9c/fb8 [0,4194304] 0 2024-04-26T10:44:30.983 INFO:tasks.workunit.client.0.smithi049.stdout:0/612: creat d8/db/d11/d1c/dbb/fd4 x:0 0 0 2024-04-26T10:44:30.983 INFO:tasks.workunit.client.0.smithi049.stdout:5/600: fdatasync d7/d1d/d1f/f8f 0 2024-04-26T10:44:30.983 INFO:tasks.workunit.client.0.smithi049.stdout:6/557: dread da/fc [0,4194304] 0 2024-04-26T10:44:30.984 INFO:tasks.workunit.client.0.smithi049.stdout:2/583: truncate d6/d9/db/d34/d38/d73/fa4 12862 0 2024-04-26T10:44:30.986 INFO:tasks.workunit.client.0.smithi049.stdout:0/613: creat d8/db/d11/d1c/dbb/dc1/fd5 x:0 0 0 2024-04-26T10:44:30.987 INFO:tasks.workunit.client.0.smithi049.stdout:3/501: symlink d3/d23/d2f/d6a/d6b/d8/d55/lab 0 2024-04-26T10:44:30.987 INFO:tasks.workunit.client.0.smithi049.stdout:7/618: truncate d2/d3/de/d1c/f3e 4423946 0 2024-04-26T10:44:30.987 INFO:tasks.workunit.client.0.smithi049.stdout:6/558: write da/dd/de/d26/d29/f8f [523403,126364] 0 2024-04-26T10:44:30.988 INFO:tasks.workunit.client.0.smithi049.stdout:2/584: mkdir d6/d9/db/d34/d38/db5 0 2024-04-26T10:44:30.989 INFO:tasks.workunit.client.0.smithi049.stdout:0/614: creat d8/db/d26/db9/fd6 x:0 0 0 2024-04-26T10:44:30.990 INFO:tasks.workunit.client.0.smithi049.stdout:6/559: write da/dd/de/d26/d29/f31 [221190,69336] 0 2024-04-26T10:44:30.991 INFO:tasks.workunit.client.0.smithi049.stdout:5/601: dwrite d7/d1d/d1f/f8f [4194304,4194304] 0 2024-04-26T10:44:30.991 INFO:tasks.workunit.client.0.smithi049.stdout:0/615: readlink d8/ld 0 2024-04-26T10:44:30.991 INFO:tasks.workunit.client.0.smithi049.stdout:2/585: fdatasync d6/d9/db/d34/d38/d3f/d60/f86 0 2024-04-26T10:44:30.992 INFO:tasks.workunit.client.0.smithi049.stdout:7/619: getdents d2/dd/d7f 0 2024-04-26T10:44:30.992 INFO:tasks.workunit.client.0.smithi049.stdout:1/533: dwrite d1e/d20/d26/d3c/d54/d59/f65 [4194304,4194304] 0 2024-04-26T10:44:30.993 INFO:tasks.workunit.client.0.smithi049.stdout:0/616: unlink d8/db/d11/l16 0 2024-04-26T10:44:30.993 INFO:tasks.workunit.client.0.smithi049.stdout:7/620: write f0 [37335,82827] 0 2024-04-26T10:44:30.994 INFO:tasks.workunit.client.0.smithi049.stdout:5/602: rename l6 to d7/d1d/d34/db9/lf2 0 2024-04-26T10:44:30.995 INFO:tasks.workunit.client.0.smithi049.stdout:7/621: symlink d2/dd/d7f/lc7 0 2024-04-26T10:44:30.995 INFO:tasks.workunit.client.0.smithi049.stdout:9/724: sync 2024-04-26T10:44:30.995 INFO:tasks.workunit.client.0.smithi049.stdout:0/617: sync 2024-04-26T10:44:30.997 INFO:tasks.workunit.client.0.smithi049.stdout:5/603: write d7/d1d/fbc [148220,85644] 0 2024-04-26T10:44:30.997 INFO:tasks.workunit.client.0.smithi049.stdout:1/534: mknod d1e/d20/d26/d37/d69/ca8 0 2024-04-26T10:44:30.997 INFO:tasks.workunit.client.0.smithi049.stdout:7/622: symlink d2/dd/d7f/db1/lc8 0 2024-04-26T10:44:30.997 INFO:tasks.workunit.client.0.smithi049.stdout:9/725: mknod d2/d40/cea 0 2024-04-26T10:44:30.998 INFO:tasks.workunit.client.0.smithi049.stdout:1/535: stat f16 0 2024-04-26T10:44:30.998 INFO:tasks.workunit.client.0.smithi049.stdout:0/618: mkdir d8/db/d11/d1c/dbb/dc1/dd7 0 2024-04-26T10:44:30.999 INFO:tasks.workunit.client.0.smithi049.stdout:5/604: mkdir d7/d14/d18/df3 0 2024-04-26T10:44:30.999 INFO:tasks.workunit.client.0.smithi049.stdout:6/560: dwrite da/dd/de/d11/f3e [4194304,4194304] 0 2024-04-26T10:44:30.999 INFO:tasks.workunit.client.0.smithi049.stdout:7/623: dread - d2/dd/d25/fa4 zero size 2024-04-26T10:44:30.999 INFO:tasks.workunit.client.0.smithi049.stdout:8/667: dread d2/d1a/d9c/fc8 [0,4194304] 0 2024-04-26T10:44:31.000 INFO:tasks.workunit.client.0.smithi049.stdout:0/619: dread - d8/db/d11/d1b/fc4 zero size 2024-04-26T10:44:31.000 INFO:tasks.workunit.client.0.smithi049.stdout:5/605: mknod d7/d1d/d1f/cf4 0 2024-04-26T10:44:31.001 INFO:tasks.workunit.client.0.smithi049.stdout:5/606: write d7/d1d/d1f/d4e/d65/d6f/fe0 [995588,121913] 0 2024-04-26T10:44:31.001 INFO:tasks.workunit.client.0.smithi049.stdout:7/624: stat d2/d3/de/c6c 0 2024-04-26T10:44:31.002 INFO:tasks.workunit.client.0.smithi049.stdout:1/536: creat d1e/d20/d26/d37/d8e/d97/fa9 x:0 0 0 2024-04-26T10:44:31.002 INFO:tasks.workunit.client.0.smithi049.stdout:9/726: getdents d2/d25/d60/da4 0 2024-04-26T10:44:31.002 INFO:tasks.workunit.client.0.smithi049.stdout:7/625: fdatasync d2/dd/d48/d5c/f9d 0 2024-04-26T10:44:31.002 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:44:31.004 INFO:tasks.workunit.client.0.smithi049.stdout:0/620: creat d8/db/fd8 x:0 0 0 2024-04-26T10:44:31.004 INFO:tasks.workunit.client.0.smithi049.stdout:9/727: mkdir d2/d1a/d42/de3/deb 0 2024-04-26T10:44:31.004 INFO:tasks.workunit.client.0.smithi049.stdout:0/621: symlink d8/d66/ld9 0 2024-04-26T10:44:31.004 INFO:tasks.workunit.client.0.smithi049.stdout:7/626: creat d2/d3/de/fc9 x:0 0 0 2024-04-26T10:44:31.006 INFO:tasks.workunit.client.0.smithi049.stdout:0/622: symlink d8/db/d26/d39/lda 0 2024-04-26T10:44:31.006 INFO:tasks.workunit.client.0.smithi049.stdout:0/623: chown d8/db/d93/d96/d9b 223 1 2024-04-26T10:44:31.007 INFO:tasks.workunit.client.0.smithi049.stdout:5/607: dwrite d7/f88 [0,4194304] 0 2024-04-26T10:44:31.007 INFO:tasks.workunit.client.0.smithi049.stdout:0/624: truncate d8/d66/fb4 372728 0 2024-04-26T10:44:31.009 INFO:tasks.workunit.client.0.smithi049.stdout:5/608: rename d7/d14/d18/f89 to d7/d1d/d34/db9/ff5 0 2024-04-26T10:44:31.010 INFO:tasks.workunit.client.0.smithi049.stdout:7/627: dread d2/d3/de/fc3 [0,4194304] 0 2024-04-26T10:44:31.010 INFO:tasks.workunit.client.0.smithi049.stdout:4/660: dread de/d1b/f2c [0,4194304] 0 2024-04-26T10:44:31.010 INFO:tasks.workunit.client.0.smithi049.stdout:6/561: dread da/d4a/f63 [0,4194304] 0 2024-04-26T10:44:31.011 INFO:tasks.workunit.client.0.smithi049.stdout:5/609: write d7/d14/f1b [8693940,1521] 0 2024-04-26T10:44:31.011 INFO:tasks.workunit.client.0.smithi049.stdout:4/661: chown de/d1b/d5e/d90/l82 7781965 1 2024-04-26T10:44:31.012 INFO:tasks.workunit.client.0.smithi049.stdout:1/537: rmdir d1e/d20/d26/d37 39 2024-04-26T10:44:31.012 INFO:tasks.workunit.client.0.smithi049.stdout:8/668: truncate d2/d17/d34/d40/f71 4019914 0 2024-04-26T10:44:31.012 INFO:tasks.workunit.client.0.smithi049.stdout:3/502: sync 2024-04-26T10:44:31.012 INFO:tasks.workunit.client.0.smithi049.stdout:2/586: sync 2024-04-26T10:44:31.014 INFO:tasks.workunit.client.0.smithi049.stdout:6/562: chown da/dd/de/d26/c7c 293940 1 2024-04-26T10:44:31.014 INFO:tasks.workunit.client.0.smithi049.stdout:5/610: getdents d7/d1d/d1f/d4e/da0 0 2024-04-26T10:44:31.017 INFO:tasks.workunit.client.0.smithi049.stdout:2/587: write d6/d9/db/d34/d38/d3f/d60/f86 [166143,43583] 0 2024-04-26T10:44:31.018 INFO:tasks.workunit.client.0.smithi049.stdout:8/669: creat d2/df/d10/d47/d75/dc3/fda x:0 0 0 2024-04-26T10:44:31.018 INFO:tasks.workunit.client.0.smithi049.stdout:6/563: mkdir da/dd/de/d11/dbc 0 2024-04-26T10:44:31.021 INFO:tasks.workunit.client.0.smithi049.stdout:0/625: dwrite d8/d66/fb1 [0,4194304] 0 2024-04-26T10:44:31.021 INFO:tasks.workunit.client.0.smithi049.stdout:9/728: dwrite d2/d1a/f5e [0,4194304] 0 2024-04-26T10:44:31.022 INFO:tasks.workunit.client.0.smithi049.stdout:1/538: dwrite fa [4194304,4194304] 0 2024-04-26T10:44:31.022 INFO:tasks.workunit.client.0.smithi049.stdout:4/662: dread de/d1b/d5e/d72/d73/d84/d4b/fa3 [0,4194304] 0 2024-04-26T10:44:31.022 INFO:tasks.workunit.client.0.smithi049.stdout:3/503: creat d3/d23/d2f/d6a/d6b/d8/dd/fac x:0 0 0 2024-04-26T10:44:31.022 INFO:tasks.workunit.client.0.smithi049.stdout:0/626: dread - d8/d66/f91 zero size 2024-04-26T10:44:31.023 INFO:tasks.workunit.client.0.smithi049.stdout:8/670: rmdir d2/d16 39 2024-04-26T10:44:31.023 INFO:tasks.workunit.client.0.smithi049.stdout:5/611: chown d7/d1d/d1f/d4e/d65/d6f/f5c 23 1 2024-04-26T10:44:31.023 INFO:tasks.workunit.client.0.smithi049.stdout:0/627: stat d8/d66/fb4 0 2024-04-26T10:44:31.024 INFO:tasks.workunit.client.0.smithi049.stdout:2/588: chown d6/d9/db/d34/d38/l77 73579 1 2024-04-26T10:44:31.024 INFO:tasks.workunit.client.0.smithi049.stdout:5/612: readlink d7/d14/d18/d2b/ldf 0 2024-04-26T10:44:31.025 INFO:tasks.workunit.client.0.smithi049.stdout:1/539: truncate d1e/d20/d26/d3c/f3d 4894308 0 2024-04-26T10:44:31.025 INFO:tasks.workunit.client.0.smithi049.stdout:3/504: chown d3/d23/d2f/d6a/d6b/d8/d34/f51 224 1 2024-04-26T10:44:31.025 INFO:tasks.workunit.client.0.smithi049.stdout:9/729: chown d2/d1a/d9c/lae 3 1 2024-04-26T10:44:31.025 INFO:tasks.workunit.client.0.smithi049.stdout:5/613: chown d7/d1d/d20/cdd 149227 1 2024-04-26T10:44:31.025 INFO:tasks.workunit.client.0.smithi049.stdout:8/671: chown d2/d17/d34/d40/d64/c8b 139291022 1 2024-04-26T10:44:31.026 INFO:tasks.workunit.client.0.smithi049.stdout:0/628: unlink d8/d41/c92 0 2024-04-26T10:44:31.026 INFO:tasks.workunit.client.0.smithi049.stdout:3/505: dread - d3/d23/d2f/d6a/d6b/d8/d55/f99 zero size 2024-04-26T10:44:31.027 INFO:tasks.workunit.client.0.smithi049.stdout:2/589: mknod d6/d32/cb6 0 2024-04-26T10:44:31.027 INFO:tasks.workunit.client.0.smithi049.stdout:0/629: chown d8/db/d11/d1b/d4d/f87 205004124 1 2024-04-26T10:44:31.028 INFO:tasks.workunit.client.0.smithi049.stdout:2/590: read - d6/d9/f94 zero size 2024-04-26T10:44:31.029 INFO:tasks.workunit.client.0.smithi049.stdout:5/614: symlink d7/d14/d18/d48/lf6 0 2024-04-26T10:44:31.029 INFO:tasks.workunit.client.0.smithi049.stdout:4/663: getdents de/d1b/d5e/d72/d73/d84/d24/db4 0 2024-04-26T10:44:31.029 INFO:tasks.workunit.client.0.smithi049.stdout:7/628: dread d2/d3/de/d1c/f61 [0,4194304] 0 2024-04-26T10:44:31.029 INFO:tasks.workunit.client.0.smithi049.stdout:9/730: creat d2/d40/fec x:0 0 0 2024-04-26T10:44:31.030 INFO:tasks.workunit.client.0.smithi049.stdout:8/672: symlink d2/d17/d34/d40/d64/dcd/ldb 0 2024-04-26T10:44:31.030 INFO:tasks.workunit.client.0.smithi049.stdout:0/630: chown d8/db/d11/d1c/dbb/dc1 2412 1 2024-04-26T10:44:31.031 INFO:tasks.workunit.client.0.smithi049.stdout:9/731: write d2/d1a/f95 [1324213,25450] 0 2024-04-26T10:44:31.031 INFO:tasks.workunit.client.0.smithi049.stdout:5/615: mkdir d7/dc6/df7 0 2024-04-26T10:44:31.032 INFO:tasks.workunit.client.0.smithi049.stdout:7/629: mknod d2/d3/d96/db3/db8/cca 0 2024-04-26T10:44:31.033 INFO:tasks.workunit.client.0.smithi049.stdout:3/506: getdents d3/d23/d2f/d6a/d6b/d8/d55/d2e 0 2024-04-26T10:44:31.034 INFO:tasks.workunit.client.0.smithi049.stdout:8/673: mknod d2/d16/d19/d42/cdc 0 2024-04-26T10:44:31.035 INFO:tasks.workunit.client.0.smithi049.stdout:9/732: symlink d2/d1a/d1b/d1f/d64/led 0 2024-04-26T10:44:31.036 INFO:tasks.workunit.client.0.smithi049.stdout:1/540: dwrite d1e/f6f [0,4194304] 0 2024-04-26T10:44:31.036 INFO:tasks.workunit.client.0.smithi049.stdout:5/616: write d7/d1d/d1f/d4e/d65/d6f/d91/fd7 [4022814,40141] 0 2024-04-26T10:44:31.038 INFO:tasks.workunit.client.0.smithi049.stdout:6/564: dread da/dd/d47/f66 [0,4194304] 0 2024-04-26T10:44:31.038 INFO:tasks.workunit.client.0.smithi049.stdout:9/733: mkdir d2/d25/dee 0 2024-04-26T10:44:31.039 INFO:tasks.workunit.client.0.smithi049.stdout:1/541: write f11 [329685,1732] 0 2024-04-26T10:44:31.041 INFO:tasks.workunit.client.0.smithi049.stdout:2/591: dwrite d6/d9/db/fb1 [0,4194304] 0 2024-04-26T10:44:31.041 INFO:tasks.workunit.client.0.smithi049.stdout:0/631: dwrite d8/f76 [0,4194304] 0 2024-04-26T10:44:31.043 INFO:tasks.workunit.client.0.smithi049.stdout:6/565: fdatasync da/dd/de/f96 0 2024-04-26T10:44:31.043 INFO:tasks.workunit.client.0.smithi049.stdout:1/542: chown d1e/c81 39 1 2024-04-26T10:44:31.043 INFO:tasks.workunit.client.0.smithi049.stdout:9/734: mknod d2/d25/d74/dc2/cef 0 2024-04-26T10:44:31.043 INFO:tasks.workunit.client.0.smithi049.stdout:3/507: creat d3/d23/d2f/d6a/d6b/d8/fad x:0 0 0 2024-04-26T10:44:31.043 INFO:tasks.workunit.client.0.smithi049.stdout:0/632: readlink d8/db/d11/l30 0 2024-04-26T10:44:31.044 INFO:tasks.workunit.client.0.smithi049.stdout:4/664: link de/d1b/d5e/d72/d73/d84/l4e de/d3f/lc7 0 2024-04-26T10:44:31.044 INFO:tasks.workunit.client.0.smithi049.stdout:7/630: dwrite d2/dd/d45/d82/fb6 [0,4194304] 0 2024-04-26T10:44:31.045 INFO:tasks.workunit.client.0.smithi049.stdout:6/566: read - da/dd/d47/f80 zero size 2024-04-26T10:44:31.048 INFO:tasks.workunit.client.0.smithi049.stdout:3/508: write d3/d23/d2f/d6a/d6b/d8/f49 [2593656,111800] 0 2024-04-26T10:44:31.048 INFO:tasks.workunit.client.0.smithi049.stdout:2/592: write d6/d9/db/d34/d38/d3f/d60/f86 [624507,55053] 0 2024-04-26T10:44:31.048 INFO:tasks.workunit.client.0.smithi049.stdout:4/665: creat de/d3f/d52/d9b/d9e/db2/fc8 x:0 0 0 2024-04-26T10:44:31.049 INFO:tasks.workunit.client.0.smithi049.stdout:6/567: write da/f38 [1084760,112257] 0 2024-04-26T10:44:31.049 INFO:tasks.workunit.client.0.smithi049.stdout:7/631: creat d2/dab/fcb x:0 0 0 2024-04-26T10:44:31.054 INFO:tasks.workunit.client.0.smithi049.stdout:2/593: stat d6/d32/d69/fb4 0 2024-04-26T10:44:31.054 INFO:tasks.workunit.client.0.smithi049.stdout:4/666: chown de/d1b/d5e/d72/d73/d88/fb8 8991670 1 2024-04-26T10:44:31.055 INFO:tasks.workunit.client.0.smithi049.stdout:2/594: dread - d6/d30/d97/fae zero size 2024-04-26T10:44:31.055 INFO:tasks.workunit.client.0.smithi049.stdout:7/632: chown d2/d3/de/c24 2 1 2024-04-26T10:44:31.055 INFO:tasks.workunit.client.0.smithi049.stdout:6/568: chown da/dd/d62/ca5 0 1 2024-04-26T10:44:31.055 INFO:tasks.workunit.client.0.smithi049.stdout:3/509: mkdir d3/d23/d2f/d6a/d6b/d26/d65/dae 0 2024-04-26T10:44:31.055 INFO:tasks.workunit.client.0.smithi049.stdout:2/595: fdatasync d6/d9/f9a 0 2024-04-26T10:44:31.055 INFO:tasks.workunit.client.0.smithi049.stdout:7/633: symlink d2/dd/d38/lcc 0 2024-04-26T10:44:31.055 INFO:tasks.workunit.client.0.smithi049.stdout:9/735: dread d2/d1a/d1b/d1f/d34/fbe [0,4194304] 0 2024-04-26T10:44:31.056 INFO:tasks.workunit.client.0.smithi049.stdout:0/633: dwrite d8/db/fb6 [0,4194304] 0 2024-04-26T10:44:31.056 INFO:tasks.workunit.client.0.smithi049.stdout:1/543: truncate d1e/d20/d26/d3c/f3d 4749230 0 2024-04-26T10:44:31.058 INFO:tasks.workunit.client.0.smithi049.stdout:8/674: dwrite d2/df/d10/d23/d6c/d5e/fd4 [0,4194304] 0 2024-04-26T10:44:31.059 INFO:tasks.workunit.client.0.smithi049.stdout:1/544: rmdir d1e/d20/d4d/d70 39 2024-04-26T10:44:31.059 INFO:tasks.workunit.client.0.smithi049.stdout:3/510: creat d3/d23/d2f/d6a/d6b/d8/faf x:0 0 0 2024-04-26T10:44:31.060 INFO:tasks.workunit.client.0.smithi049.stdout:4/667: dwrite f1 [0,4194304] 0 2024-04-26T10:44:31.062 INFO:tasks.workunit.client.0.smithi049.stdout:7/634: creat d2/d3/de/d1c/dac/fcd x:0 0 0 2024-04-26T10:44:31.062 INFO:tasks.workunit.client.0.smithi049.stdout:2/596: getdents d6/d32 0 2024-04-26T10:44:31.062 INFO:tasks.workunit.client.0.smithi049.stdout:3/511: stat d3/d23/d2f/d6a/d6b/d8c/f8e 0 2024-04-26T10:44:31.063 INFO:tasks.workunit.client.0.smithi049.stdout:8/675: rename d2/df/d10/d23/d6c/l81 to d2/d17/d34/d40/ldd 0 2024-04-26T10:44:31.063 INFO:tasks.workunit.client.0.smithi049.stdout:3/512: chown d3/d23/d2f/d6a/d6b/d26/d29/f7d 698316067 1 2024-04-26T10:44:31.064 INFO:tasks.workunit.client.0.smithi049.stdout:4/668: mknod de/d1b/d5e/da2/cc9 0 2024-04-26T10:44:31.064 INFO:tasks.workunit.client.0.smithi049.stdout:2/597: creat d6/d9/db/d11/d6a/d9f/fb7 x:0 0 0 2024-04-26T10:44:31.066 INFO:tasks.workunit.client.0.smithi049.stdout:4/669: fdatasync de/d1b/d5e/d72/d73/d84/f8c 0 2024-04-26T10:44:31.068 INFO:tasks.workunit.client.0.smithi049.stdout:4/670: rename de/d3f/d48/c6f to de/d3f/d48/cca 0 2024-04-26T10:44:31.070 INFO:tasks.workunit.client.0.smithi049.stdout:4/671: symlink de/d1b/d5e/d99/lcb 0 2024-04-26T10:44:31.070 INFO:tasks.workunit.client.0.smithi049.stdout:2/598: dwrite d6/d9/db/df/d31/fa6 [0,4194304] 0 2024-04-26T10:44:31.070 INFO:tasks.workunit.client.0.smithi049.stdout:8/676: dwrite d2/d16/d19/fb0 [0,4194304] 0 2024-04-26T10:44:31.071 INFO:tasks.workunit.client.0.smithi049.stdout:4/672: write de/d1b/d5e/fac [888002,5934] 0 2024-04-26T10:44:31.072 INFO:tasks.workunit.client.0.smithi049.stdout:4/673: read f1 [801595,88814] 0 2024-04-26T10:44:31.073 INFO:tasks.workunit.client.0.smithi049.stdout:5/617: sync 2024-04-26T10:44:31.073 INFO:tasks.workunit.client.0.smithi049.stdout:4/674: stat de/d1b/d5e/d72/d73/d84/f7e 0 2024-04-26T10:44:31.074 INFO:tasks.workunit.client.0.smithi049.stdout:4/675: dread - de/fa0 zero size 2024-04-26T10:44:31.075 INFO:tasks.workunit.client.0.smithi049.stdout:5/618: truncate d7/d66/d84/f9b 358673 0 2024-04-26T10:44:31.078 INFO:tasks.workunit.client.0.smithi049.stdout:2/599: dwrite d6/d9/d5f/f80 [0,4194304] 0 2024-04-26T10:44:31.078 INFO:tasks.workunit.client.0.smithi049.stdout:4/676: creat de/d3f/d48/d8b/fcc x:0 0 0 2024-04-26T10:44:31.078 INFO:tasks.workunit.client.0.smithi049.stdout:4/677: truncate f1 5194883 0 2024-04-26T10:44:31.078 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:31.077+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:31.079 INFO:tasks.workunit.client.0.smithi049.stdout:4/678: write de/d3f/d52/fc1 [170725,111855] 0 2024-04-26T10:44:31.079 INFO:tasks.workunit.client.0.smithi049.stdout:2/600: mknod d6/cb8 0 2024-04-26T10:44:31.080 INFO:tasks.workunit.client.0.smithi049.stdout:4/679: getdents de/d1b/d5e/d72 0 2024-04-26T10:44:31.083 INFO:tasks.workunit.client.0.smithi049.stdout:9/736: dread d2/d1a/f95 [0,4194304] 0 2024-04-26T10:44:31.087 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:31.087 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:31.087 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:31.087 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:31.087 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.087 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:80 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:31.087 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:31.087 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.5617316270000003, 2024-04-26T10:44:31.087 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029259192, 2024-04-26T10:44:31.088 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:31.088 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:31.088 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:31.088 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.088 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:31.088 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:31.088 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.088 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.088 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.088 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:31.088 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:31.088 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.088 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.088 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.088 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:31.089 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522252+0000", 2024-04-26T10:44:31.089 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:31.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.089 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.089 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:31.089 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523121+0000", 2024-04-26T10:44:31.089 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00086885100000000002 2024-04-26T10:44:31.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.089 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.089 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:31.089 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523133+0000", 2024-04-26T10:44:31.089 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2109999999999999e-05 2024-04-26T10:44:31.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.090 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:31.090 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523139+0000", 2024-04-26T10:44:31.090 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.541e-06 2024-04-26T10:44:31.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.090 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:31.090 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523176+0000", 2024-04-26T10:44:31.090 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6847999999999997e-05 2024-04-26T10:44:31.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.090 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:31.090 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523240+0000", 2024-04-26T10:44:31.091 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3941000000000003e-05 2024-04-26T10:44:31.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.091 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:31.091 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.536390+0000", 2024-04-26T10:44:31.091 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013150811 2024-04-26T10:44:31.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.091 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:31.091 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551071+0000", 2024-04-26T10:44:31.091 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014680021 2024-04-26T10:44:31.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.091 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:31.092 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551428+0000", 2024-04-26T10:44:31.092 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00035703900000000002 2024-04-26T10:44:31.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.092 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:31.092 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551462+0000", 2024-04-26T10:44:31.092 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4337e-05 2024-04-26T10:44:31.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.092 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:31.092 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551513+0000", 2024-04-26T10:44:31.092 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0875000000000003e-05 2024-04-26T10:44:31.092 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.092 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:31.093 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.093 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:129 3.1a 3:5e41ab69:::200.00000005:head [write 3557843~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:31.093 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:31.093 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.5576735569999993, 2024-04-26T10:44:31.093 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029108253000000001, 2024-04-26T10:44:31.093 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:31.093 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:31.093 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:31.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.093 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:31.093 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:31.093 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.094 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:31.094 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:31.094 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.094 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:31.094 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526311+0000", 2024-04-26T10:44:31.094 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:31.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.094 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:31.094 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526315+0000", 2024-04-26T10:44:31.095 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4809999999999998e-06 2024-04-26T10:44:31.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.095 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:31.095 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526319+0000", 2024-04-26T10:44:31.095 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0690000000000003e-06 2024-04-26T10:44:31.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.095 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:31.095 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526321+0000", 2024-04-26T10:44:31.095 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4880000000000001e-06 2024-04-26T10:44:31.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.095 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:31.096 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553856+0000", 2024-04-26T10:44:31.096 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027534916 2024-04-26T10:44:31.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.096 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:31.096 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553900+0000", 2024-04-26T10:44:31.096 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3954e-05 2024-04-26T10:44:31.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.096 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:31.096 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553962+0000", 2024-04-26T10:44:31.096 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1519000000000005e-05 2024-04-26T10:44:31.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.096 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:31.097 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555348+0000", 2024-04-26T10:44:31.097 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013864579999999999 2024-04-26T10:44:31.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.097 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:31.097 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555378+0000", 2024-04-26T10:44:31.097 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9441000000000002e-05 2024-04-26T10:44:31.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.097 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:31.097 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555401+0000", 2024-04-26T10:44:31.097 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2815000000000001e-05 2024-04-26T10:44:31.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.097 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555420+0000", 2024-04-26T10:44:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9341e-05 2024-04-26T10:44:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:130 3.1a 3:5e41ab69:::200.00000005:head [write 3559243~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.5576617220000006, 2024-04-26T10:44:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029188316999999998, 2024-04-26T10:44:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:31.098 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:31.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526325+0000", 2024-04-26T10:44:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4899999999999999e-06 2024-04-26T10:44:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526327+0000", 2024-04-26T10:44:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.745e-06 2024-04-26T10:44:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526330+0000", 2024-04-26T10:44:31.100 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5620000000000002e-06 2024-04-26T10:44:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554200+0000", 2024-04-26T10:44:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027869541000000001 2024-04-26T10:44:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554244+0000", 2024-04-26T10:44:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4464e-05 2024-04-26T10:44:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554304+0000", 2024-04-26T10:44:31.101 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9457999999999999e-05 2024-04-26T10:44:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555453+0000", 2024-04-26T10:44:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011494000000000001 2024-04-26T10:44:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555457+0000", 2024-04-26T10:44:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1779999999999996e-06 2024-04-26T10:44:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:31.102 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555480+0000", 2024-04-26T10:44:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2802e-05 2024-04-26T10:44:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555512+0000", 2024-04-26T10:44:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1885999999999999e-05 2024-04-26T10:44:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:131 3.1a 3:5e41ab69:::200.00000005:head [write 3560642~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:31.103 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.5576531419999995, 2024-04-26T10:44:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029683102999999999, 2024-04-26T10:44:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.104 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526336+0000", 2024-04-26T10:44:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.681e-06 2024-04-26T10:44:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526338+0000", 2024-04-26T10:44:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8430000000000001e-06 2024-04-26T10:44:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526341+0000", 2024-04-26T10:44:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6180000000000002e-06 2024-04-26T10:44:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554745+0000", 2024-04-26T10:44:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028404088000000001 2024-04-26T10:44:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554788+0000", 2024-04-26T10:44:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2738999999999999e-05 2024-04-26T10:44:31.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554849+0000", 2024-04-26T10:44:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1362e-05 2024-04-26T10:44:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555963+0000", 2024-04-26T10:44:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001113597 2024-04-26T10:44:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555969+0000", 2024-04-26T10:44:31.107 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6900000000000003e-06 2024-04-26T10:44:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555995+0000", 2024-04-26T10:44:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5165999999999999e-05 2024-04-26T10:44:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556015+0000", 2024-04-26T10:44:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0522000000000001e-05 2024-04-26T10:44:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:132 3.1a 3:5e41ab69:::200.00000005:head [write 3562043~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.5576328769999996, 2024-04-26T10:44:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030129895, 2024-04-26T10:44:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.109 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526354+0000", 2024-04-26T10:44:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8560000000000001e-06 2024-04-26T10:44:31.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526359+0000", 2024-04-26T10:44:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4700000000000001e-06 2024-04-26T10:44:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526365+0000", 2024-04-26T10:44:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2120000000000002e-06 2024-04-26T10:44:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555050+0000", 2024-04-26T10:44:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028685458 2024-04-26T10:44:31.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.112 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:31.112 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555093+0000", 2024-04-26T10:44:31.112 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3307999999999999e-05 2024-04-26T10:44:31.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.112 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:31.112 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555156+0000", 2024-04-26T10:44:31.112 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2396000000000004e-05 2024-04-26T10:44:31.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.112 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:31.112 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556052+0000", 2024-04-26T10:44:31.112 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00089650299999999999 2024-04-26T10:44:31.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.113 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:31.113 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556439+0000", 2024-04-26T10:44:31.113 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038647900000000001 2024-04-26T10:44:31.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.113 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:31.113 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556463+0000", 2024-04-26T10:44:31.113 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4071e-05 2024-04-26T10:44:31.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.113 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:31.113 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556482+0000", 2024-04-26T10:44:31.113 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9378999999999999e-05 2024-04-26T10:44:31.113 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.114 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:31.114 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.114 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 3563440~3660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:31.114 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:31.114 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.5576164830000003, 2024-04-26T10:44:31.114 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030550738000000001, 2024-04-26T10:44:31.114 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:31.114 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:31.114 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:31.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.114 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:31.115 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:31.115 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.115 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:31.115 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:31.115 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.115 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:31.115 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526368+0000", 2024-04-26T10:44:31.115 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:31.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.116 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:31.116 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526375+0000", 2024-04-26T10:44:31.116 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7510000000000002e-06 2024-04-26T10:44:31.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.116 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:31.116 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526381+0000", 2024-04-26T10:44:31.116 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3929999999999996e-06 2024-04-26T10:44:31.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.116 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:31.116 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526387+0000", 2024-04-26T10:44:31.116 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.215e-06 2024-04-26T10:44:31.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.117 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:31.117 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555542+0000", 2024-04-26T10:44:31.117 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029154992000000001 2024-04-26T10:44:31.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.117 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:31.117 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555610+0000", 2024-04-26T10:44:31.117 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8610999999999998e-05 2024-04-26T10:44:31.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.117 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:31.117 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555681+0000", 2024-04-26T10:44:31.117 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1072e-05 2024-04-26T10:44:31.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.118 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:31.118 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556866+0000", 2024-04-26T10:44:31.118 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001184598 2024-04-26T10:44:31.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.118 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:31.118 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556872+0000", 2024-04-26T10:44:31.118 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.55e-06 2024-04-26T10:44:31.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.118 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:31.118 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556897+0000", 2024-04-26T10:44:31.118 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.516e-05 2024-04-26T10:44:31.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.119 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:31.119 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556919+0000", 2024-04-26T10:44:31.119 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1951e-05 2024-04-26T10:44:31.119 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.119 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:31.119 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.119 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:134 3.1a 3:5e41ab69:::200.00000005:head [write 3567100~2427 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:31.119 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:31.119 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.5575834180000001, 2024-04-26T10:44:31.119 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031267445999999997, 2024-04-26T10:44:31.119 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:31.120 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:31.120 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:31.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.120 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:31.120 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:31.120 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.120 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:31.120 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:31.120 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.120 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:31.120 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526401+0000", 2024-04-26T10:44:31.121 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:31.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.121 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:31.121 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526408+0000", 2024-04-26T10:44:31.121 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7769999999999997e-06 2024-04-26T10:44:31.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.121 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:31.121 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526415+0000", 2024-04-26T10:44:31.121 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0720000000000002e-06 2024-04-26T10:44:31.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.121 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:31.121 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526421+0000", 2024-04-26T10:44:31.122 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9699999999999996e-06 2024-04-26T10:44:31.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.122 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:31.122 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556084+0000", 2024-04-26T10:44:31.122 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029662351999999999 2024-04-26T10:44:31.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.122 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:31.122 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556126+0000", 2024-04-26T10:44:31.122 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2385000000000002e-05 2024-04-26T10:44:31.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.122 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:31.123 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556186+0000", 2024-04-26T10:44:31.123 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9945999999999998e-05 2024-04-26T10:44:31.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.123 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.123 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:31.123 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557598+0000", 2024-04-26T10:44:31.123 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0014121559999999999 2024-04-26T10:44:31.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.123 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.123 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:31.123 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557626+0000", 2024-04-26T10:44:31.123 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7960999999999999e-05 2024-04-26T10:44:31.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.123 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.123 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:31.124 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557650+0000", 2024-04-26T10:44:31.124 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3969999999999999e-05 2024-04-26T10:44:31.124 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.124 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:31.124 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557669+0000", 2024-04-26T10:44:31.124 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9262e-05 2024-04-26T10:44:31.124 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.124 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:31.124 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.124 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.124 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:135 3.1a 3:5e41ab69:::200.00000005:head [write 3569527~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:31.124 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:31.125 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.5575591519999996, 2024-04-26T10:44:31.125 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031322516000000002, 2024-04-26T10:44:31.125 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:31.125 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:31.125 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:31.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.125 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:31.125 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:31.125 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.125 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:31.125 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:31.125 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526429+0000", 2024-04-26T10:44:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0750000000000002e-06 2024-04-26T10:44:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526435+0000", 2024-04-26T10:44:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.263e-06 2024-04-26T10:44:31.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526442+0000", 2024-04-26T10:44:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1219999999999997e-06 2024-04-26T10:44:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556515+0000", 2024-04-26T10:44:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030073132999999998 2024-04-26T10:44:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:31.127 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556564+0000", 2024-04-26T10:44:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8871e-05 2024-04-26T10:44:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556625+0000", 2024-04-26T10:44:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1307000000000001e-05 2024-04-26T10:44:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557678+0000", 2024-04-26T10:44:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010523100000000001 2024-04-26T10:44:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.128 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557709+0000", 2024-04-26T10:44:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1748000000000002e-05 2024-04-26T10:44:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557732+0000", 2024-04-26T10:44:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2415000000000001e-05 2024-04-26T10:44:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557749+0000", 2024-04-26T10:44:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6736999999999999e-05 2024-04-26T10:44:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.129 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:136 3.1a 3:5e41ab69:::200.00000005:head [write 3571449~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.5575379619999996, 2024-04-26T10:44:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032180937, 2024-04-26T10:44:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:31.130 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526455+0000", 2024-04-26T10:44:31.131 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6429999999999995e-06 2024-04-26T10:44:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526461+0000", 2024-04-26T10:44:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526467+0000", 2024-04-26T10:44:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4389999999999999e-06 2024-04-26T10:44:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:31.132 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556950+0000", 2024-04-26T10:44:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030483854000000001 2024-04-26T10:44:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556989+0000", 2024-04-26T10:44:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8415999999999999e-05 2024-04-26T10:44:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557051+0000", 2024-04-26T10:44:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2088999999999995e-05 2024-04-26T10:44:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:31.133 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558166+0000", 2024-04-26T10:44:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001114622 2024-04-26T10:44:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558584+0000", 2024-04-26T10:44:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000418033 2024-04-26T10:44:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558609+0000", 2024-04-26T10:44:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5344999999999999e-05 2024-04-26T10:44:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.134 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558628+0000", 2024-04-26T10:44:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9273999999999999e-05 2024-04-26T10:44:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:137 3.1a 3:5e41ab69:::200.00000005:head [write 3573699~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.5575143130000004, 2024-04-26T10:44:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032241530999999997, 2024-04-26T10:44:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:31.135 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526470+0000", 2024-04-26T10:44:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:31.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526473+0000", 2024-04-26T10:44:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.818e-06 2024-04-26T10:44:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526480+0000", 2024-04-26T10:44:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4119999999999998e-06 2024-04-26T10:44:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526484+0000", 2024-04-26T10:44:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6840000000000004e-06 2024-04-26T10:44:31.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557323+0000", 2024-04-26T10:44:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030838956000000001 2024-04-26T10:44:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557362+0000", 2024-04-26T10:44:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8343999999999997e-05 2024-04-26T10:44:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557421+0000", 2024-04-26T10:44:31.138 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9176999999999999e-05 2024-04-26T10:44:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558636+0000", 2024-04-26T10:44:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012153789999999999 2024-04-26T10:44:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558668+0000", 2024-04-26T10:44:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1452999999999999e-05 2024-04-26T10:44:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558694+0000", 2024-04-26T10:44:31.139 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6288999999999999e-05 2024-04-26T10:44:31.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.140 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.140 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:31.140 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558712+0000", 2024-04-26T10:44:31.140 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8459000000000001e-05 2024-04-26T10:44:31.140 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.140 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:31.140 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.140 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.140 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:138 3.1a 3:5e41ab69:::200.00000005:head [write 3575103~4205 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:31.140 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:31.140 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.5574969939999992, 2024-04-26T10:44:31.140 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032665567999999999, 2024-04-26T10:44:31.141 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:31.141 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:31.141 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:31.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.141 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:31.141 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:31.141 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.141 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:31.141 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:31.141 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.141 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:31.142 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:31.142 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:31.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.142 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:31.142 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526495+0000", 2024-04-26T10:44:31.142 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7580000000000003e-06 2024-04-26T10:44:31.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.142 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:31.142 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526501+0000", 2024-04-26T10:44:31.142 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1680000000000001e-06 2024-04-26T10:44:31.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.143 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:31.143 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526505+0000", 2024-04-26T10:44:31.143 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.673e-06 2024-04-26T10:44:31.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.143 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.143 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:31.143 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557781+0000", 2024-04-26T10:44:31.143 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031275718000000001 2024-04-26T10:44:31.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.143 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.143 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:31.143 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557825+0000", 2024-04-26T10:44:31.143 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4048000000000002e-05 2024-04-26T10:44:31.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.143 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.144 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:31.144 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557888+0000", 2024-04-26T10:44:31.144 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2562000000000002e-05 2024-04-26T10:44:31.144 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.144 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.144 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:31.144 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559073+0000", 2024-04-26T10:44:31.144 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011852239999999999 2024-04-26T10:44:31.144 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.144 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.144 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:31.144 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559112+0000", 2024-04-26T10:44:31.144 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9226e-05 2024-04-26T10:44:31.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.145 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.145 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:31.145 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559136+0000", 2024-04-26T10:44:31.145 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3966000000000001e-05 2024-04-26T10:44:31.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.145 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.145 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:31.145 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559154+0000", 2024-04-26T10:44:31.145 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7575e-05 2024-04-26T10:44:31.145 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.145 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:31.145 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.145 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.146 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:139 3.1a 3:5e41ab69:::200.00000005:head [write 3579308~2255 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:31.146 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:31.146 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.5574753759999993, 2024-04-26T10:44:31.146 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033424720999999998, 2024-04-26T10:44:31.146 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:31.146 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:31.146 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:31.146 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.146 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:31.146 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:31.146 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.147 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:31.147 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:31.147 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.148 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:31.148 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526509+0000", 2024-04-26T10:44:31.148 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:31.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.148 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:31.148 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526516+0000", 2024-04-26T10:44:31.148 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5209999999999999e-06 2024-04-26T10:44:31.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.148 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:31.148 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526522+0000", 2024-04-26T10:44:31.148 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1229999999999997e-06 2024-04-26T10:44:31.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.149 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:31.149 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526527+0000", 2024-04-26T10:44:31.149 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7849999999999999e-06 2024-04-26T10:44:31.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.149 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:31.149 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558194+0000", 2024-04-26T10:44:31.149 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031667419000000002 2024-04-26T10:44:31.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.149 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:31.149 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558234+0000", 2024-04-26T10:44:31.149 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9774999999999998e-05 2024-04-26T10:44:31.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.150 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.150 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:31.150 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558294+0000", 2024-04-26T10:44:31.150 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0242999999999999e-05 2024-04-26T10:44:31.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.150 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.150 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:31.150 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559106+0000", 2024-04-26T10:44:31.150 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00081148099999999996 2024-04-26T10:44:31.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.150 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.150 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:31.150 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559890+0000", 2024-04-26T10:44:31.150 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00078439999999999998 2024-04-26T10:44:31.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.151 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:31.151 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559917+0000", 2024-04-26T10:44:31.151 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7044000000000001e-05 2024-04-26T10:44:31.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.151 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:31.151 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559935+0000", 2024-04-26T10:44:31.151 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7448e-05 2024-04-26T10:44:31.151 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.151 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:31.151 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.152 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:140 3.1a 3:5e41ab69:::200.00000005:head [write 3581563~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:31.152 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:31.152 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.5574539549999997, 2024-04-26T10:44:31.152 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033867728, 2024-04-26T10:44:31.152 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:31.152 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:31.152 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:31.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.152 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:31.152 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:31.152 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.153 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:31.153 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:31.153 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.153 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:31.153 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:31.153 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:31.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.153 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:31.153 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526538+0000", 2024-04-26T10:44:31.153 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.905e-06 2024-04-26T10:44:31.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.155 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:31.155 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526542+0000", 2024-04-26T10:44:31.155 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9550000000000002e-06 2024-04-26T10:44:31.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.155 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:31.155 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526545+0000", 2024-04-26T10:44:31.155 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8499999999999998e-06 2024-04-26T10:44:31.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.155 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:31.155 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558744+0000", 2024-04-26T10:44:31.156 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032198986999999998 2024-04-26T10:44:31.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.156 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.156 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:31.156 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558788+0000", 2024-04-26T10:44:31.156 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4365e-05 2024-04-26T10:44:31.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.156 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.156 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:31.156 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558854+0000", 2024-04-26T10:44:31.156 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5952999999999997e-05 2024-04-26T10:44:31.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.156 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.156 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:31.157 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559971+0000", 2024-04-26T10:44:31.157 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011172770000000001 2024-04-26T10:44:31.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.157 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:31.157 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560354+0000", 2024-04-26T10:44:31.157 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038267599999999998 2024-04-26T10:44:31.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.157 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:31.157 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560380+0000", 2024-04-26T10:44:31.157 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6140999999999999e-05 2024-04-26T10:44:31.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.157 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:31.158 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560399+0000", 2024-04-26T10:44:31.158 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9032999999999999e-05 2024-04-26T10:44:31.158 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.158 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:31.158 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.158 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:141 3.1a 3:5e41ab69:::200.00000005:head [write 3583482~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:31.158 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:31.158 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.5574382960000008, 2024-04-26T10:44:31.158 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034316301, 2024-04-26T10:44:31.158 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:31.158 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:31.158 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:31.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.159 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:31.159 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:31.159 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.159 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:31.159 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:31.159 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.159 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:31.160 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:31.160 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:31.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.160 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:31.160 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526548+0000", 2024-04-26T10:44:31.160 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.739e-06 2024-04-26T10:44:31.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.160 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:31.160 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526551+0000", 2024-04-26T10:44:31.160 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.044e-06 2024-04-26T10:44:31.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.161 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:31.161 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526562+0000", 2024-04-26T10:44:31.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0370000000000001e-05 2024-04-26T10:44:31.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.161 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:31.161 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559179+0000", 2024-04-26T10:44:31.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032617444000000002 2024-04-26T10:44:31.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.161 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:31.161 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559220+0000", 2024-04-26T10:44:31.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0364999999999997e-05 2024-04-26T10:44:31.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.162 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:31.162 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559280+0000", 2024-04-26T10:44:31.162 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0569000000000002e-05 2024-04-26T10:44:31.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.162 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:31.162 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560814+0000", 2024-04-26T10:44:31.162 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015337580000000001 2024-04-26T10:44:31.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.162 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:31.162 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560820+0000", 2024-04-26T10:44:31.162 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.455e-06 2024-04-26T10:44:31.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.163 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:31.163 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560846+0000", 2024-04-26T10:44:31.163 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5228999999999998e-05 2024-04-26T10:44:31.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.163 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:31.163 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560863+0000", 2024-04-26T10:44:31.163 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7555e-05 2024-04-26T10:44:31.163 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.163 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:31.163 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.163 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:142 3.1a 3:5e41ab69:::200.00000005:head [write 3585931~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:31.164 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:31.164 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.5574178990000007, 2024-04-26T10:44:31.164 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034372373999999997, 2024-04-26T10:44:31.164 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:31.164 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:31.164 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:31.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.164 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:31.164 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:31.164 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.164 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:31.164 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:31.165 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.165 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:31.165 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:31.165 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:31.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.165 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:31.165 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526573+0000", 2024-04-26T10:44:31.165 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0800000000000002e-06 2024-04-26T10:44:31.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.165 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:31.165 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526580+0000", 2024-04-26T10:44:31.166 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5799999999999997e-06 2024-04-26T10:44:31.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.166 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:31.166 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526585+0000", 2024-04-26T10:44:31.166 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2270000000000001e-06 2024-04-26T10:44:31.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.166 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:31.166 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559601+0000", 2024-04-26T10:44:31.166 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033016684999999997 2024-04-26T10:44:31.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.166 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:31.166 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559642+0000", 2024-04-26T10:44:31.167 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0321000000000002e-05 2024-04-26T10:44:31.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.167 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:31.167 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559706+0000", 2024-04-26T10:44:31.167 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4228999999999998e-05 2024-04-26T10:44:31.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.167 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:31.167 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560871+0000", 2024-04-26T10:44:31.167 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001164893 2024-04-26T10:44:31.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.167 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:31.168 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560899+0000", 2024-04-26T10:44:31.168 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:31.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.168 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:31.168 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560922+0000", 2024-04-26T10:44:31.168 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3337999999999999e-05 2024-04-26T10:44:31.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.168 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:31.168 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560940+0000", 2024-04-26T10:44:31.168 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7289999999999999e-05 2024-04-26T10:44:31.168 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.168 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:31.168 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.169 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.169 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:143 3.1a 3:5e41ab69:::200.00000005:head [write 3587331~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:31.169 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:31.169 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.5573960010000008, 2024-04-26T10:44:31.169 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035256000000000003, 2024-04-26T10:44:31.169 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:31.169 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:31.169 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:31.169 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.169 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:31.169 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:31.169 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.170 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.170 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:31.170 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:31.170 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.170 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.170 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:31.170 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:31.170 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:31.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.170 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.170 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:31.170 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526592+0000", 2024-04-26T10:44:31.170 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2449999999999998e-06 2024-04-26T10:44:31.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.171 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:31.171 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526596+0000", 2024-04-26T10:44:31.171 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7000000000000002e-06 2024-04-26T10:44:31.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.171 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:31.171 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526599+0000", 2024-04-26T10:44:31.171 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6160000000000002e-06 2024-04-26T10:44:31.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.171 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:31.171 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559997+0000", 2024-04-26T10:44:31.171 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033397835000000001 2024-04-26T10:44:31.172 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.172 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.172 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:31.172 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560051+0000", 2024-04-26T10:44:31.172 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3742000000000001e-05 2024-04-26T10:44:31.172 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.172 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.172 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:31.172 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560112+0000", 2024-04-26T10:44:31.172 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0851999999999999e-05 2024-04-26T10:44:31.172 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.172 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.172 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:31.172 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561404+0000", 2024-04-26T10:44:31.173 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001291869 2024-04-26T10:44:31.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.173 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:31.173 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561797+0000", 2024-04-26T10:44:31.173 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039383000000000002 2024-04-26T10:44:31.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.173 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:31.173 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561827+0000", 2024-04-26T10:44:31.173 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9247e-05 2024-04-26T10:44:31.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.173 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:31.173 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561845+0000", 2024-04-26T10:44:31.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8462999999999999e-05 2024-04-26T10:44:31.174 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.174 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:31.174 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.174 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:144 3.1a 3:5e41ab69:::200.00000005:head [write 3588736~4987 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:31.174 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:31.174 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.5572737090000004, 2024-04-26T10:44:31.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035224283000000002, 2024-04-26T10:44:31.174 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:31.174 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:31.174 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:31.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.175 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:31.175 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:31.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.175 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:31.175 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:31.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.175 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:31.175 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:31.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:31.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.176 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:31.176 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526718+0000", 2024-04-26T10:44:31.176 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.43e-06 2024-04-26T10:44:31.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.176 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:31.176 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526726+0000", 2024-04-26T10:44:31.176 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:44:31.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.176 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:31.176 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526729+0000", 2024-04-26T10:44:31.176 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6480000000000001e-06 2024-04-26T10:44:31.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.177 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:31.177 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560427+0000", 2024-04-26T10:44:31.177 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033697280000000003 2024-04-26T10:44:31.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.177 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:31.177 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560466+0000", 2024-04-26T10:44:31.177 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9606e-05 2024-04-26T10:44:31.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.177 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:31.177 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560525+0000", 2024-04-26T10:44:31.177 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9218000000000001e-05 2024-04-26T10:44:31.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.178 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:31.178 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561854+0000", 2024-04-26T10:44:31.178 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001328421 2024-04-26T10:44:31.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.178 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:31.178 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561887+0000", 2024-04-26T10:44:31.178 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2746000000000001e-05 2024-04-26T10:44:31.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.178 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:31.178 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561912+0000", 2024-04-26T10:44:31.178 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5126999999999998e-05 2024-04-26T10:44:31.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.179 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:31.179 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561936+0000", 2024-04-26T10:44:31.179 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4032999999999998e-05 2024-04-26T10:44:31.179 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.179 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:31.179 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.179 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:145 3.1a 3:5e41ab69:::200.00000005:head [write 3593723~2939 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:31.179 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:31.179 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.5543546639999999, 2024-04-26T10:44:31.179 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033294394999999997, 2024-04-26T10:44:31.179 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:31.179 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:31.180 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:31.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.180 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:31.180 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:31.180 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.180 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:31.180 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:31.180 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.180 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:31.180 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529630+0000", 2024-04-26T10:44:31.180 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:31.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.181 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:31.181 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529635+0000", 2024-04-26T10:44:31.181 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7960000000000003e-06 2024-04-26T10:44:31.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.181 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:31.181 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529643+0000", 2024-04-26T10:44:31.181 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0390000000000005e-06 2024-04-26T10:44:31.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.181 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:31.181 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529648+0000", 2024-04-26T10:44:31.181 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9599999999999999e-06 2024-04-26T10:44:31.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.182 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:31.182 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560969+0000", 2024-04-26T10:44:31.182 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031321767 2024-04-26T10:44:31.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.182 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:31.182 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561009+0000", 2024-04-26T10:44:31.182 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9904999999999998e-05 2024-04-26T10:44:31.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.182 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:31.182 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561070+0000", 2024-04-26T10:44:31.182 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0708999999999998e-05 2024-04-26T10:44:31.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.183 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:31.183 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562352+0000", 2024-04-26T10:44:31.183 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012818440000000001 2024-04-26T10:44:31.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.183 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:31.183 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562867+0000", 2024-04-26T10:44:31.183 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000515665 2024-04-26T10:44:31.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.183 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:31.183 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562893+0000", 2024-04-26T10:44:31.184 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5469999999999998e-05 2024-04-26T10:44:31.184 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.184 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:31.184 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562925+0000", 2024-04-26T10:44:31.184 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1974999999999998e-05 2024-04-26T10:44:31.184 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.184 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:31.184 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.184 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.184 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:146 3.1a 3:5e41ab69:::200.00000005:head [write 3596662~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:31.184 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:31.184 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.55412645, 2024-04-26T10:44:31.184 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033178429000000002, 2024-04-26T10:44:31.185 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:31.185 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:31.185 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:31.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.185 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:31.185 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:31.185 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.185 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:31.185 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:31.185 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:31.186 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529858+0000", 2024-04-26T10:44:31.186 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:31.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:31.186 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529863+0000", 2024-04-26T10:44:31.186 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4500000000000003e-06 2024-04-26T10:44:31.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:31.186 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529874+0000", 2024-04-26T10:44:31.186 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0552e-05 2024-04-26T10:44:31.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.187 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:31.187 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529882+0000", 2024-04-26T10:44:31.187 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4449999999999996e-06 2024-04-26T10:44:31.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.187 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:31.187 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561452+0000", 2024-04-26T10:44:31.187 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031569680000000003 2024-04-26T10:44:31.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.187 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:31.187 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561511+0000", 2024-04-26T10:44:31.187 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9332e-05 2024-04-26T10:44:31.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.188 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:31.188 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561583+0000", 2024-04-26T10:44:31.188 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1730000000000006e-05 2024-04-26T10:44:31.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.188 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:31.188 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562933+0000", 2024-04-26T10:44:31.188 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013500059999999999 2024-04-26T10:44:31.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.188 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:31.188 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562976+0000", 2024-04-26T10:44:31.188 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2987e-05 2024-04-26T10:44:31.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.189 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.189 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:31.189 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563015+0000", 2024-04-26T10:44:31.189 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9453999999999999e-05 2024-04-26T10:44:31.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.189 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.189 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:31.189 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563037+0000", 2024-04-26T10:44:31.189 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1679e-05 2024-04-26T10:44:31.189 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.189 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:31.189 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.189 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.189 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:277 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:31.190 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:31.190 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.5691157469999997, 2024-04-26T10:44:31.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030430563000000001, 2024-04-26T10:44:31.190 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:31.190 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:31.190 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:31.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.190 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:31.190 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:31.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.190 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.190 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:31.190 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:31.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:31.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:31.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514867+0000", 2024-04-26T10:44:31.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:31.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:31.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515460+0000", 2024-04-26T10:44:31.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00059285800000000004 2024-04-26T10:44:31.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:31.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515474+0000", 2024-04-26T10:44:31.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3933e-05 2024-04-26T10:44:31.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.192 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:31.192 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515481+0000", 2024-04-26T10:44:31.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:31.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.192 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:31.192 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515522+0000", 2024-04-26T10:44:31.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1369000000000003e-05 2024-04-26T10:44:31.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.192 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:31.192 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515591+0000", 2024-04-26T10:44:31.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9377999999999999e-05 2024-04-26T10:44:31.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.193 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:31.193 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.526440+0000", 2024-04-26T10:44:31.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010848837 2024-04-26T10:44:31.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.193 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:31.193 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.543866+0000", 2024-04-26T10:44:31.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017426288000000002 2024-04-26T10:44:31.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.193 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:31.193 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545193+0000", 2024-04-26T10:44:31.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001326111 2024-04-26T10:44:31.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.194 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:31.194 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545229+0000", 2024-04-26T10:44:31.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6390999999999998e-05 2024-04-26T10:44:31.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:31.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:31.194 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:31.194 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545300+0000", 2024-04-26T10:44:31.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1073000000000002e-05 2024-04-26T10:44:31.194 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.194 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:31.194 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.195 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:31.195 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:31.195 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:31.197 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:31.197 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:31.194+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:31.212 INFO:tasks.workunit.client.0.smithi049.stdout:5/619: dread d7/d1d/d1f/d4e/d77/f93 [0,4194304] 0 2024-04-26T10:44:31.212 INFO:tasks.workunit.client.0.smithi049.stdout:5/620: mknod d7/d1d/d34/cf8 0 2024-04-26T10:44:31.212 INFO:tasks.workunit.client.0.smithi049.stdout:9/737: dread d2/d1a/d1b/fba [0,4194304] 0 2024-04-26T10:44:31.212 INFO:tasks.workunit.client.0.smithi049.stdout:9/738: fdatasync d2/d1a/d9c/fc7 0 2024-04-26T10:44:31.213 INFO:tasks.workunit.client.0.smithi049.stdout:5/621: rmdir d7/d1d/d1f/d4e/d77 39 2024-04-26T10:44:31.213 INFO:tasks.workunit.client.0.smithi049.stdout:9/739: dread - d2/d1a/d1b/d1f/fda zero size 2024-04-26T10:44:31.213 INFO:tasks.workunit.client.0.smithi049.stdout:5/622: fdatasync d7/d1d/d1f/f3b 0 2024-04-26T10:44:31.213 INFO:tasks.workunit.client.0.smithi049.stdout:0/634: dread d8/db/d11/d1b/d4d/f5e [0,4194304] 0 2024-04-26T10:44:31.213 INFO:tasks.workunit.client.0.smithi049.stdout:0/635: chown d8/db/d11/f65 1716 1 2024-04-26T10:44:31.213 INFO:tasks.workunit.client.0.smithi049.stdout:3/513: dread d3/d23/d2f/d6a/d6b/d8/d55/f98 [0,4194304] 0 2024-04-26T10:44:31.213 INFO:tasks.workunit.client.0.smithi049.stdout:4/680: truncate de/d1b/d5e/d72/d73/d84/d38/f58 1767299 0 2024-04-26T10:44:31.213 INFO:tasks.workunit.client.0.smithi049.stdout:3/514: creat d3/d23/d2f/d6a/d6b/d26/d58/fb0 x:0 0 0 2024-04-26T10:44:31.213 INFO:tasks.workunit.client.0.smithi049.stdout:4/681: creat de/d3f/d52/d9b/da5/fcd x:0 0 0 2024-04-26T10:44:31.213 INFO:tasks.workunit.client.0.smithi049.stdout:3/515: mkdir d3/d23/d2f/d6a/d6b/d8/d87/db1 0 2024-04-26T10:44:31.213 INFO:tasks.workunit.client.0.smithi049.stdout:0/636: dwrite d8/d66/f69 [0,4194304] 0 2024-04-26T10:44:31.213 INFO:tasks.workunit.client.0.smithi049.stdout:7/635: dread d2/dd/d48/d5c/f5f [0,4194304] 0 2024-04-26T10:44:31.213 INFO:tasks.workunit.client.0.smithi049.stdout:4/682: read de/d3f/d52/d9b/da5/f97 [45137,87257] 0 2024-04-26T10:44:31.213 INFO:tasks.workunit.client.0.smithi049.stdout:8/677: dread d2/df/d10/d47/f99 [0,4194304] 0 2024-04-26T10:44:31.214 INFO:tasks.workunit.client.0.smithi049.stdout:3/516: readlink d3/d23/d2f/d6a/d6b/d8/d55/l2c 0 2024-04-26T10:44:31.214 INFO:tasks.workunit.client.0.smithi049.stdout:1/545: dread d1e/d20/d67/f6c [0,4194304] 0 2024-04-26T10:44:31.214 INFO:tasks.workunit.client.0.smithi049.stdout:0/637: symlink d8/db/d11/d1c/db8/ldb 0 2024-04-26T10:44:31.214 INFO:tasks.workunit.client.0.smithi049.stdout:6/569: sync 2024-04-26T10:44:31.214 INFO:tasks.workunit.client.0.smithi049.stdout:1/546: sync 2024-04-26T10:44:31.214 INFO:tasks.workunit.client.0.smithi049.stdout:6/570: creat da/dd/de/d26/da1/fbd x:0 0 0 2024-04-26T10:44:31.214 INFO:tasks.workunit.client.0.smithi049.stdout:0/638: rename d8/db/d11/d1b/d4d/l61 to d8/db/d93/d96/ldc 0 2024-04-26T10:44:31.214 INFO:tasks.workunit.client.0.smithi049.stdout:6/571: symlink da/dd/de/d11/dbc/lbe 0 2024-04-26T10:44:31.214 INFO:tasks.workunit.client.0.smithi049.stdout:6/572: mknod da/dd/de/d26/da1/cbf 0 2024-04-26T10:44:31.214 INFO:tasks.workunit.client.0.smithi049.stdout:4/683: truncate de/d1b/d5e/d72/d73/d88/f94 885006 0 2024-04-26T10:44:31.214 INFO:tasks.workunit.client.0.smithi049.stdout:5/623: sync 2024-04-26T10:44:31.214 INFO:tasks.workunit.client.0.smithi049.stdout:2/601: sync 2024-04-26T10:44:31.214 INFO:tasks.workunit.client.0.smithi049.stdout:9/740: sync 2024-04-26T10:44:31.214 INFO:tasks.workunit.client.0.smithi049.stdout:7/636: sync 2024-04-26T10:44:31.214 INFO:tasks.workunit.client.0.smithi049.stdout:6/573: symlink da/dd/d47/d7b/d84/daa/lc0 0 2024-04-26T10:44:31.215 INFO:tasks.workunit.client.0.smithi049.stdout:4/684: chown de/d1b/d5e/d72/d73/d88/cb3 23 1 2024-04-26T10:44:31.215 INFO:tasks.workunit.client.0.smithi049.stdout:5/624: write d7/d1d/d1f/d4e/d80/fb1 [229305,125505] 0 2024-04-26T10:44:31.215 INFO:tasks.workunit.client.0.smithi049.stdout:3/517: dwrite d3/d23/d2f/d6a/d6b/d8/d55/f99 [0,4194304] 0 2024-04-26T10:44:31.215 INFO:tasks.workunit.client.0.smithi049.stdout:7/637: rename d2/d3/l8 to d2/dd/d45/da5/lce 0 2024-04-26T10:44:31.215 INFO:tasks.workunit.client.0.smithi049.stdout:6/574: write da/dd/d47/f66 [1047809,8535] 0 2024-04-26T10:44:31.215 INFO:tasks.workunit.client.0.smithi049.stdout:6/575: sync 2024-04-26T10:44:31.215 INFO:tasks.workunit.client.0.smithi049.stdout:9/741: link d2/d1a/d1b/d1f/c9d d2/d40/cf0 0 2024-04-26T10:44:31.215 INFO:tasks.workunit.client.0.smithi049.stdout:0/639: dwrite d8/d42/f62 [0,4194304] 0 2024-04-26T10:44:31.215 INFO:tasks.workunit.client.0.smithi049.stdout:5/625: creat d7/d66/ff9 x:0 0 0 2024-04-26T10:44:31.215 INFO:tasks.workunit.client.0.smithi049.stdout:7/638: mkdir d2/d3/dcf 0 2024-04-26T10:44:31.215 INFO:tasks.workunit.client.0.smithi049.stdout:0/640: mkdir d8/db/d11/d1b/d4d/dae/dc5/ddd 0 2024-04-26T10:44:31.215 INFO:tasks.workunit.client.0.smithi049.stdout:4/685: link de/l1a de/d1b/d5e/d72/d73/lce 0 2024-04-26T10:44:31.215 INFO:tasks.workunit.client.0.smithi049.stdout:0/641: mknod d8/d66/cde 0 2024-04-26T10:44:31.215 INFO:tasks.workunit.client.0.smithi049.stdout:4/686: readlink de/d1b/d5e/d72/d73/d84/l9f 0 2024-04-26T10:44:31.215 INFO:tasks.workunit.client.0.smithi049.stdout:7/639: chown d2/dd/d48/da3/fb2 417824 1 2024-04-26T10:44:31.216 INFO:tasks.workunit.client.0.smithi049.stdout:7/640: write d2/fa0 [3673821,52548] 0 2024-04-26T10:44:31.216 INFO:tasks.workunit.client.0.smithi049.stdout:4/687: write de/d1b/f2c [4112078,77937] 0 2024-04-26T10:44:31.216 INFO:tasks.workunit.client.0.smithi049.stdout:7/641: dread - d2/f64 zero size 2024-04-26T10:44:31.216 INFO:tasks.workunit.client.0.smithi049.stdout:4/688: symlink de/lcf 0 2024-04-26T10:44:31.216 INFO:tasks.workunit.client.0.smithi049.stdout:7/642: creat d2/dab/fd0 x:0 0 0 2024-04-26T10:44:31.216 INFO:tasks.workunit.client.0.smithi049.stdout:4/689: write de/d3f/d52/d9b/da5/f97 [2286511,24691] 0 2024-04-26T10:44:31.216 INFO:tasks.workunit.client.0.smithi049.stdout:0/642: write d8/f3d [485171,130616] 0 2024-04-26T10:44:31.216 INFO:tasks.workunit.client.0.smithi049.stdout:8/678: dread d2/d16/f4b [0,4194304] 0 2024-04-26T10:44:31.216 INFO:tasks.workunit.client.0.smithi049.stdout:7/643: write d2/d3/de/d1c/f90 [2189558,107475] 0 2024-04-26T10:44:31.216 INFO:tasks.workunit.client.0.smithi049.stdout:0/643: readlink d8/db/d11/d1c/l8d 0 2024-04-26T10:44:31.216 INFO:tasks.workunit.client.0.smithi049.stdout:8/679: fsync d2/d1a/f3e 0 2024-04-26T10:44:31.216 INFO:tasks.workunit.client.0.smithi049.stdout:7/644: readlink d2/dd/d48/d5c/l79 0 2024-04-26T10:44:31.216 INFO:tasks.workunit.client.0.smithi049.stdout:4/690: creat de/d3f/d52/d9b/fd0 x:0 0 0 2024-04-26T10:44:31.216 INFO:tasks.workunit.client.0.smithi049.stdout:8/680: write d2/df/d10/d23/f31 [3459192,27225] 0 2024-04-26T10:44:31.216 INFO:tasks.workunit.client.0.smithi049.stdout:4/691: link de/d1b/f40 de/d1b/d5e/d72/d73/fd1 0 2024-04-26T10:44:31.217 INFO:tasks.workunit.client.0.smithi049.stdout:8/681: write d2/f14 [2698981,93041] 0 2024-04-26T10:44:31.217 INFO:tasks.workunit.client.0.smithi049.stdout:4/692: chown de/d1b/d5e/d72/d73/d84/d24/f31 73947 1 2024-04-26T10:44:31.217 INFO:tasks.workunit.client.0.smithi049.stdout:8/682: rmdir d2/d17/d34/dd0 0 2024-04-26T10:44:31.217 INFO:tasks.workunit.client.0.smithi049.stdout:5/626: dread d7/d1d/d1f/d4e/d77/fd4 [0,4194304] 0 2024-04-26T10:44:31.217 INFO:tasks.workunit.client.0.smithi049.stdout:0/644: dwrite d8/f76 [0,4194304] 0 2024-04-26T10:44:31.217 INFO:tasks.workunit.client.0.smithi049.stdout:7/645: write d2/d3/f56 [992657,105260] 0 2024-04-26T10:44:31.217 INFO:tasks.workunit.client.0.smithi049.stdout:4/693: write de/d1b/fba [248733,52647] 0 2024-04-26T10:44:31.217 INFO:tasks.workunit.client.0.smithi049.stdout:0/645: fdatasync d8/db/d11/d1b/d4d/f5e 0 2024-04-26T10:44:31.217 INFO:tasks.workunit.client.0.smithi049.stdout:5/627: creat d7/d14/d18/ffa x:0 0 0 2024-04-26T10:44:31.217 INFO:tasks.workunit.client.0.smithi049.stdout:5/628: chown d7/c70 33879788 1 2024-04-26T10:44:31.217 INFO:tasks.workunit.client.0.smithi049.stdout:4/694: mknod de/d1b/d5e/d72/d73/d84/cd2 0 2024-04-26T10:44:31.217 INFO:tasks.workunit.client.0.smithi049.stdout:0/646: write d8/d66/d84/f8c [2792364,121514] 0 2024-04-26T10:44:31.217 INFO:tasks.workunit.client.0.smithi049.stdout:0/647: rmdir d8/db/d11/d1b/d4d 39 2024-04-26T10:44:31.217 INFO:tasks.workunit.client.0.smithi049.stdout:5/629: getdents d7/d1d/d1f/d4e/d65/d6f 0 2024-04-26T10:44:31.217 INFO:tasks.workunit.client.0.smithi049.stdout:7/646: write d2/d3/de/f1e [464954,45249] 0 2024-04-26T10:44:31.218 INFO:tasks.workunit.client.0.smithi049.stdout:7/647: read - d2/f92 zero size 2024-04-26T10:44:31.218 INFO:tasks.workunit.client.0.smithi049.stdout:0/648: symlink d8/db/d11/d1b/ldf 0 2024-04-26T10:44:31.218 INFO:tasks.workunit.client.0.smithi049.stdout:0/649: link d8/d41/c6d d8/db/d11/d1c/db8/ce0 0 2024-04-26T10:44:31.218 INFO:tasks.workunit.client.0.smithi049.stdout:4/695: dwrite de/d1b/d5e/d72/d73/d88/f94 [0,4194304] 0 2024-04-26T10:44:31.218 INFO:tasks.workunit.client.0.smithi049.stdout:0/650: rmdir d8/db/d11/d1b/d4d/dae/dc5 39 2024-04-26T10:44:31.218 INFO:tasks.workunit.client.0.smithi049.stdout:4/696: symlink de/d3f/d48/ld3 0 2024-04-26T10:44:31.218 INFO:tasks.workunit.client.0.smithi049.stdout:0/651: fsync d8/db/d26/f97 0 2024-04-26T10:44:31.218 INFO:tasks.workunit.client.0.smithi049.stdout:3/518: dread d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/f3f [0,4194304] 0 2024-04-26T10:44:31.218 INFO:tasks.workunit.client.0.smithi049.stdout:7/648: write d2/d3/de/d1c/fc5 [2649980,32327] 0 2024-04-26T10:44:31.218 INFO:tasks.workunit.client.0.smithi049.stdout:0/652: readlink d8/db/d11/d1b/l31 0 2024-04-26T10:44:31.218 INFO:tasks.workunit.client.0.smithi049.stdout:7/649: mkdir d2/dd/d7f/dd1 0 2024-04-26T10:44:31.218 INFO:tasks.workunit.client.0.smithi049.stdout:0/653: creat d8/d1e/d98/fe1 x:0 0 0 2024-04-26T10:44:31.218 INFO:tasks.workunit.client.0.smithi049.stdout:3/519: chown d3/d23/d2f/d6a/d6b 202369569 1 2024-04-26T10:44:31.218 INFO:tasks.workunit.client.0.smithi049.stdout:0/654: getdents d8/db 0 2024-04-26T10:44:31.219 INFO:tasks.workunit.client.0.smithi049.stdout:7/650: rename d2/d3/f52 to d2/dd/d48/da3/fd2 0 2024-04-26T10:44:31.219 INFO:tasks.workunit.client.0.smithi049.stdout:0/655: mknod d8/d66/ce2 0 2024-04-26T10:44:31.219 INFO:tasks.workunit.client.0.smithi049.stdout:7/651: mkdir d2/dd/dd3 0 2024-04-26T10:44:31.219 INFO:tasks.workunit.client.0.smithi049.stdout:3/520: creat d3/d23/d2f/d6a/d6b/d8/fb2 x:0 0 0 2024-04-26T10:44:31.219 INFO:tasks.workunit.client.0.smithi049.stdout:0/656: mkdir d8/db/d11/d1c/dbb/dc1/dd7/de3 0 2024-04-26T10:44:31.219 INFO:tasks.workunit.client.0.smithi049.stdout:4/697: dwrite de/d1b/d5e/d72/d73/f7c [0,4194304] 0 2024-04-26T10:44:31.219 INFO:tasks.workunit.client.0.smithi049.stdout:1/547: dread d1e/d20/d4d/f5f [0,4194304] 0 2024-04-26T10:44:31.219 INFO:tasks.workunit.client.0.smithi049.stdout:3/521: dread - d3/d23/d2f/d6a/d6b/d8/fb2 zero size 2024-04-26T10:44:31.219 INFO:tasks.workunit.client.0.smithi049.stdout:7/652: rename d2/d3/de/fc9 to d2/dd/d48/d5c/fd4 0 2024-04-26T10:44:31.219 INFO:tasks.workunit.client.0.smithi049.stdout:1/548: write f12 [3743353,16793] 0 2024-04-26T10:44:31.219 INFO:tasks.workunit.client.0.smithi049.stdout:4/698: chown de/d1d/cbe 1510547 1 2024-04-26T10:44:31.219 INFO:tasks.workunit.client.0.smithi049.stdout:7/653: write d2/dd/d45/f97 [695328,75296] 0 2024-04-26T10:44:31.219 INFO:tasks.workunit.client.0.smithi049.stdout:3/522: getdents d3/d23/d2f/d6a/d6b/d8/d87 0 2024-04-26T10:44:31.219 INFO:tasks.workunit.client.0.smithi049.stdout:4/699: chown de/d1b/d5e/d72/d73/d84/l33 5300652 1 2024-04-26T10:44:31.219 INFO:tasks.workunit.client.0.smithi049.stdout:7/654: creat d2/d3/de/d1c/dac/fd5 x:0 0 0 2024-04-26T10:44:31.220 INFO:tasks.workunit.client.0.smithi049.stdout:5/630: sync 2024-04-26T10:44:31.220 INFO:tasks.workunit.client.0.smithi049.stdout:7/655: creat d2/dab/fd6 x:0 0 0 2024-04-26T10:44:31.220 INFO:tasks.workunit.client.0.smithi049.stdout:6/576: dread da/dd/f13 [0,4194304] 0 2024-04-26T10:44:31.220 INFO:tasks.workunit.client.0.smithi049.stdout:0/657: dwrite d8/db/fa0 [0,4194304] 0 2024-04-26T10:44:31.220 INFO:tasks.workunit.client.0.smithi049.stdout:4/700: rmdir de/d3f/d52/d9b/d9e 39 2024-04-26T10:44:31.220 INFO:tasks.workunit.client.0.smithi049.stdout:6/577: chown da/f1b 13056 1 2024-04-26T10:44:31.220 INFO:tasks.workunit.client.0.smithi049.stdout:5/631: creat d7/d1d/d1f/ffb x:0 0 0 2024-04-26T10:44:31.220 INFO:tasks.workunit.client.0.smithi049.stdout:3/523: truncate d3/d23/d2f/d6a/d6b/d8/d34/f44 1373159 0 2024-04-26T10:44:31.220 INFO:tasks.workunit.client.0.smithi049.stdout:7/656: rename d2/f74 to d2/dd/dd3/fd7 0 2024-04-26T10:44:31.220 INFO:tasks.workunit.client.0.smithi049.stdout:5/632: readlink d7/d14/d18/d2b/l58 0 2024-04-26T10:44:31.220 INFO:tasks.workunit.client.0.smithi049.stdout:4/701: symlink de/d1b/d5e/ld4 0 2024-04-26T10:44:31.220 INFO:tasks.workunit.client.0.smithi049.stdout:2/602: dread d6/d9/f27 [0,4194304] 0 2024-04-26T10:44:31.220 INFO:tasks.workunit.client.0.smithi049.stdout:6/578: mkdir da/dd/d62/dc1 0 2024-04-26T10:44:31.220 INFO:tasks.workunit.client.0.smithi049.stdout:1/549: truncate d1e/f6f 3164807 0 2024-04-26T10:44:31.220 INFO:tasks.workunit.client.0.smithi049.stdout:7/657: rmdir d2/d3 39 2024-04-26T10:44:31.220 INFO:tasks.workunit.client.0.smithi049.stdout:6/579: read da/fc [3933773,102209] 0 2024-04-26T10:44:31.221 INFO:tasks.workunit.client.0.smithi049.stdout:3/524: truncate d3/d23/d2f/d6a/d6b/d26/f7a 130413 0 2024-04-26T10:44:31.221 INFO:tasks.workunit.client.0.smithi049.stdout:5/633: truncate d7/d1d/d1f/d4e/d80/fb1 1449838 0 2024-04-26T10:44:31.221 INFO:tasks.workunit.client.0.smithi049.stdout:1/550: dread d1e/d20/d26/d37/f77 [0,4194304] 0 2024-04-26T10:44:31.221 INFO:tasks.workunit.client.0.smithi049.stdout:5/634: write d7/d14/d18/f6e [1596962,75115] 0 2024-04-26T10:44:31.221 INFO:tasks.workunit.client.0.smithi049.stdout:3/525: stat d3/d23/d2f/d6a/d6b/d26/d5f/f69 0 2024-04-26T10:44:31.221 INFO:tasks.workunit.client.0.smithi049.stdout:5/635: mkdir d7/d66/d84/dfc 0 2024-04-26T10:44:31.221 INFO:tasks.workunit.client.0.smithi049.stdout:3/526: write d3/d6/f10 [3941772,91134] 0 2024-04-26T10:44:31.221 INFO:tasks.workunit.client.0.smithi049.stdout:5/636: creat d7/d1d/d1f/d4e/ffd x:0 0 0 2024-04-26T10:44:31.221 INFO:tasks.workunit.client.0.smithi049.stdout:1/551: read d1e/d20/d26/d3c/f4f [585550,51679] 0 2024-04-26T10:44:31.221 INFO:tasks.workunit.client.0.smithi049.stdout:6/580: dwrite da/f91 [4194304,4194304] 0 2024-04-26T10:44:31.221 INFO:tasks.workunit.client.0.smithi049.stdout:1/552: creat d1e/d20/d26/d37/d8e/faa x:0 0 0 2024-04-26T10:44:31.221 INFO:tasks.workunit.client.0.smithi049.stdout:1/553: mkdir d1e/d20/d26/d3c/d54/d59/d73/dab 0 2024-04-26T10:44:31.221 INFO:tasks.workunit.client.0.smithi049.stdout:9/742: dread d2/d25/d74/f59 [0,4194304] 0 2024-04-26T10:44:31.221 INFO:tasks.workunit.client.0.smithi049.stdout:1/554: dwrite d1e/d20/d26/d37/f4e [0,4194304] 0 2024-04-26T10:44:31.221 INFO:tasks.workunit.client.0.smithi049.stdout:9/743: truncate d2/d1a/f2a 9336649 0 2024-04-26T10:44:31.222 INFO:tasks.workunit.client.0.smithi049.stdout:8/683: dread d2/df/d10/d47/d75/fb9 [0,4194304] 0 2024-04-26T10:44:31.222 INFO:tasks.workunit.client.0.smithi049.stdout:9/744: mknod d2/d1a/df/cf1 0 2024-04-26T10:44:31.222 INFO:tasks.workunit.client.0.smithi049.stdout:8/684: unlink d2/d16/d19/d42/d7c/cae 0 2024-04-26T10:44:31.222 INFO:tasks.workunit.client.0.smithi049.stdout:1/555: dwrite d1e/d20/f6b [0,4194304] 0 2024-04-26T10:44:31.222 INFO:tasks.workunit.client.0.smithi049.stdout:4/702: dread f8 [0,4194304] 0 2024-04-26T10:44:31.222 INFO:tasks.workunit.client.0.smithi049.stdout:1/556: dwrite d1e/d20/d26/d3c/d54/f9b [0,4194304] 0 2024-04-26T10:44:31.222 INFO:tasks.workunit.client.0.smithi049.stdout:1/557: fsync d1e/d20/f41 0 2024-04-26T10:44:31.222 INFO:tasks.workunit.client.0.smithi049.stdout:4/703: write de/d1b/d5e/da2/faa [58504,110599] 0 2024-04-26T10:44:31.222 INFO:tasks.workunit.client.0.smithi049.stdout:8/685: truncate d2/df/d10/d23/d6c/f2c 8205582 0 2024-04-26T10:44:31.222 INFO:tasks.workunit.client.0.smithi049.stdout:1/558: unlink d1e/d20/d26/d3c/d54/d59/d68/l95 0 2024-04-26T10:44:31.222 INFO:tasks.workunit.client.0.smithi049.stdout:0/658: dread d8/db/d11/f32 [0,4194304] 0 2024-04-26T10:44:31.222 INFO:tasks.workunit.client.0.smithi049.stdout:8/686: creat d2/d89/d2a/d9f/fde x:0 0 0 2024-04-26T10:44:31.222 INFO:tasks.workunit.client.0.smithi049.stdout:1/559: chown d1e/d20/d26/d37/c84 1638397 1 2024-04-26T10:44:31.222 INFO:tasks.workunit.client.0.smithi049.stdout:0/659: mknod d8/d42/ce4 0 2024-04-26T10:44:31.222 INFO:tasks.workunit.client.0.smithi049.stdout:8/687: creat d2/df/d10/d23/d6c/d5e/fdf x:0 0 0 2024-04-26T10:44:31.223 INFO:tasks.workunit.client.0.smithi049.stdout:0/660: symlink d8/db/le5 0 2024-04-26T10:44:31.223 INFO:tasks.workunit.client.0.smithi049.stdout:8/688: creat d2/df/d10/d47/d75/dc3/fe0 x:0 0 0 2024-04-26T10:44:31.223 INFO:tasks.workunit.client.0.smithi049.stdout:8/689: fsync d2/d1a/fc1 0 2024-04-26T10:44:31.223 INFO:tasks.workunit.client.0.smithi049.stdout:2/603: sync 2024-04-26T10:44:31.223 INFO:tasks.workunit.client.0.smithi049.stdout:3/527: sync 2024-04-26T10:44:31.223 INFO:tasks.workunit.client.0.smithi049.stdout:8/690: readlink d2/d89/l4c 0 2024-04-26T10:44:31.223 INFO:tasks.workunit.client.0.smithi049.stdout:2/604: fsync d6/d9/db/fac 0 2024-04-26T10:44:31.223 INFO:tasks.workunit.client.0.smithi049.stdout:8/691: mkdir d2/d17/de1 0 2024-04-26T10:44:31.223 INFO:tasks.workunit.client.0.smithi049.stdout:2/605: symlink d6/d9/db/d11/d6a/lb9 0 2024-04-26T10:44:31.223 INFO:tasks.workunit.client.0.smithi049.stdout:8/692: symlink d2/d89/d30/le2 0 2024-04-26T10:44:31.223 INFO:tasks.workunit.client.0.smithi049.stdout:7/658: dread d2/f4f [0,4194304] 0 2024-04-26T10:44:31.223 INFO:tasks.workunit.client.0.smithi049.stdout:3/528: truncate d3/d23/d2f/d6a/d6b/d26/d29/f3e 5214814 0 2024-04-26T10:44:31.223 INFO:tasks.workunit.client.0.smithi049.stdout:9/745: dread d2/d1a/df/ddb/fbd [0,4194304] 0 2024-04-26T10:44:31.223 INFO:tasks.workunit.client.0.smithi049.stdout:8/693: write d2/df/f95 [410829,48946] 0 2024-04-26T10:44:31.223 INFO:tasks.workunit.client.0.smithi049.stdout:7/659: write d2/f2c [185808,41485] 0 2024-04-26T10:44:31.224 INFO:tasks.workunit.client.0.smithi049.stdout:6/581: dread da/ff [0,4194304] 0 2024-04-26T10:44:31.224 INFO:tasks.workunit.client.0.smithi049.stdout:3/529: truncate d3/d23/f75 3081407 0 2024-04-26T10:44:31.224 INFO:tasks.workunit.client.0.smithi049.stdout:0/661: link d8/db/d26/d39/lda d8/d1e/d98/le6 0 2024-04-26T10:44:31.224 INFO:tasks.workunit.client.0.smithi049.stdout:5/637: dread d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d60/f72 [0,4194304] 0 2024-04-26T10:44:31.224 INFO:tasks.workunit.client.0.smithi049.stdout:3/530: rmdir d3/d23/d2f/d6a/d6b/d8/dd 39 2024-04-26T10:44:31.224 INFO:tasks.workunit.client.0.smithi049.stdout:2/606: rename d6/d9/db to d6/d9/d5f/dba 0 2024-04-26T10:44:31.224 INFO:tasks.workunit.client.0.smithi049.stdout:5/638: unlink d7/d53/le9 0 2024-04-26T10:44:31.224 INFO:tasks.workunit.client.0.smithi049.stdout:0/662: unlink d8/db/d11/d1b/f8b 0 2024-04-26T10:44:31.224 INFO:tasks.workunit.client.0.smithi049.stdout:9/746: dwrite d2/d1a/d1b/d1f/d64/fb3 [0,4194304] 0 2024-04-26T10:44:31.224 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:31.225 INFO:tasks.workunit.client.0.smithi049.stdout:4/704: dread de/d1b/d5e/d72/d73/d84/d38/f58 [0,4194304] 0 2024-04-26T10:44:31.225 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:31.228 INFO:tasks.workunit.client.0.smithi049.stdout:2/607: symlink d6/d9/d5f/dba/d35/lbb 0 2024-04-26T10:44:31.228 INFO:tasks.workunit.client.0.smithi049.stdout:5/639: symlink d7/d1d/d1f/d4e/dad/lfe 0 2024-04-26T10:44:31.228 INFO:tasks.workunit.client.0.smithi049.stdout:7/660: rename d2/l37 to d2/dd/d25/ld8 0 2024-04-26T10:44:31.228 INFO:tasks.workunit.client.0.smithi049.stdout:0/663: read d8/db/fa0 [3383357,98594] 0 2024-04-26T10:44:31.228 INFO:tasks.workunit.client.0.smithi049.stdout:4/705: stat de/d1b/f34 0 2024-04-26T10:44:31.228 INFO:tasks.workunit.client.0.smithi049.stdout:6/582: rename da/dd/de/d26/d22/f7d to da/dd/d47/d7b/d84/fc2 0 2024-04-26T10:44:31.229 INFO:tasks.workunit.client.0.smithi049.stdout:7/661: symlink d2/dd/d38/ld9 0 2024-04-26T10:44:31.229 INFO:tasks.workunit.client.0.smithi049.stdout:2/608: creat d6/d9/d5f/dba/d34/d38/d3f/d60/fbc x:0 0 0 2024-04-26T10:44:31.229 INFO:tasks.workunit.client.0.smithi049.stdout:4/706: truncate de/d3f/d52/fc1 829047 0 2024-04-26T10:44:31.229 INFO:tasks.workunit.client.0.smithi049.stdout:7/662: mkdir d2/dd/d48/da3/dda 0 2024-04-26T10:44:31.229 INFO:tasks.workunit.client.0.smithi049.stdout:4/707: fdatasync de/f54 0 2024-04-26T10:44:31.229 INFO:tasks.workunit.client.0.smithi049.stdout:7/663: readlink d2/dd/d38/la2 0 2024-04-26T10:44:31.229 INFO:tasks.workunit.client.0.smithi049.stdout:5/640: write d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d60/f72 [784382,73386] 0 2024-04-26T10:44:31.229 INFO:tasks.workunit.client.0.smithi049.stdout:9/747: dwrite d2/d1a/d1b/d1f/f3d [0,4194304] 0 2024-04-26T10:44:31.229 INFO:tasks.workunit.client.0.smithi049.stdout:5/641: stat d7/c70 0 2024-04-26T10:44:31.229 INFO:tasks.workunit.client.0.smithi049.stdout:2/609: dread - d6/d9/d5f/dba/d34/d38/d3f/d60/fa2 zero size 2024-04-26T10:44:31.229 INFO:tasks.workunit.client.0.smithi049.stdout:6/583: link da/dd/d62/c9a da/dd/de/d26/d22/cc3 0 2024-04-26T10:44:31.229 INFO:tasks.workunit.client.0.smithi049.stdout:0/664: dwrite d8/d42/f43 [0,4194304] 0 2024-04-26T10:44:31.229 INFO:tasks.workunit.client.0.smithi049.stdout:9/748: mkdir d2/d40/d53/de7/df2 0 2024-04-26T10:44:31.229 INFO:tasks.workunit.client.0.smithi049.stdout:5/642: dread - d7/d1d/d1f/d4e/d65/d6f/d91/fdb zero size 2024-04-26T10:44:31.229 INFO:tasks.workunit.client.0.smithi049.stdout:4/708: symlink de/d1b/d5e/d72/d73/d84/d4b/db5/ld5 0 2024-04-26T10:44:31.230 INFO:tasks.workunit.client.0.smithi049.stdout:7/664: creat d2/d3/fdb x:0 0 0 2024-04-26T10:44:31.230 INFO:tasks.workunit.client.0.smithi049.stdout:2/610: fdatasync d6/d9/d5f/dba/d1e/fb2 0 2024-04-26T10:44:31.230 INFO:tasks.workunit.client.0.smithi049.stdout:8/694: dread d2/f2f [0,4194304] 0 2024-04-26T10:44:31.230 INFO:tasks.workunit.client.0.smithi049.stdout:2/611: stat d6/d30/c55 0 2024-04-26T10:44:31.230 INFO:tasks.workunit.client.0.smithi049.stdout:9/749: unlink d2/d25/d74/f98 0 2024-04-26T10:44:31.230 INFO:tasks.workunit.client.0.smithi049.stdout:3/531: dread d3/d23/d2f/d6a/d6b/d26/f5a [0,4194304] 0 2024-04-26T10:44:31.230 INFO:tasks.workunit.client.0.smithi049.stdout:8/695: write d2/df/f62 [1641644,73344] 0 2024-04-26T10:44:31.230 INFO:tasks.workunit.client.0.smithi049.stdout:1/560: dread d1e/d20/d4d/f60 [4194304,4194304] 0 2024-04-26T10:44:31.230 INFO:tasks.workunit.client.0.smithi049.stdout:7/665: rmdir d2/d3/d96/db3/db8 39 2024-04-26T10:44:31.230 INFO:tasks.workunit.client.0.smithi049.stdout:3/532: stat d3/d23/d2f/d6a 0 2024-04-26T10:44:31.230 INFO:tasks.workunit.client.0.smithi049.stdout:4/709: creat de/d1b/d5e/d72/d73/fd6 x:0 0 0 2024-04-26T10:44:31.230 INFO:tasks.workunit.client.0.smithi049.stdout:7/666: dread - d2/dab/fcb zero size 2024-04-26T10:44:31.231 INFO:tasks.workunit.client.0.smithi049.stdout:9/750: creat d2/ff3 x:0 0 0 2024-04-26T10:44:31.231 INFO:tasks.workunit.client.0.smithi049.stdout:6/584: read da/dd/de/fa0 [21485,9157] 0 2024-04-26T10:44:31.231 INFO:tasks.workunit.client.0.smithi049.stdout:4/710: mknod de/d1b/d5e/d90/cd7 0 2024-04-26T10:44:31.231 INFO:tasks.workunit.client.0.smithi049.stdout:1/561: creat d1e/d20/d4d/fac x:0 0 0 2024-04-26T10:44:31.231 INFO:tasks.workunit.client.0.smithi049.stdout:7/667: mkdir d2/d3/d96/ddc 0 2024-04-26T10:44:31.232 INFO:tasks.workunit.client.0.smithi049.stdout:3/533: creat d3/d23/d2f/d6a/d6b/d26/d65/d70/d96/fb3 x:0 0 0 2024-04-26T10:44:31.232 INFO:tasks.workunit.client.0.smithi049.stdout:9/751: creat d2/d1a/d42/ff4 x:0 0 0 2024-04-26T10:44:31.232 INFO:tasks.workunit.client.0.smithi049.stdout:0/665: dwrite d8/db/d11/d1b/fc4 [0,4194304] 0 2024-04-26T10:44:31.234 INFO:tasks.workunit.client.0.smithi049.stdout:5/643: truncate d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d60/faf 122997 0 2024-04-26T10:44:31.234 INFO:tasks.workunit.client.0.smithi049.stdout:4/711: rename de/d1b/f1c to de/d3f/d48/fd8 0 2024-04-26T10:44:31.235 INFO:tasks.workunit.client.0.smithi049.stdout:3/534: unlink d3/d23/d2f/d6a/d6b/d8/d34/c8f 0 2024-04-26T10:44:31.235 INFO:tasks.workunit.client.0.smithi049.stdout:7/668: mknod d2/dd/d7f/db1/dc6/cdd 0 2024-04-26T10:44:31.235 INFO:tasks.workunit.client.0.smithi049.stdout:6/585: link da/dd/de/cb3 da/dd/d47/da3/cc4 0 2024-04-26T10:44:31.235 INFO:tasks.workunit.client.0.smithi049.stdout:8/696: dread d2/df/d10/d47/f99 [0,4194304] 0 2024-04-26T10:44:31.237 INFO:tasks.workunit.client.0.smithi049.stdout:7/669: chown d2/d3/c43 45553656 1 2024-04-26T10:44:31.238 INFO:tasks.workunit.client.0.smithi049.stdout:8/697: symlink d2/df/d10/le3 0 2024-04-26T10:44:31.238 INFO:tasks.workunit.client.0.smithi049.stdout:3/535: rmdir d3/d23/d2f/d6a/d6b/d26/d65/d70/d84 39 2024-04-26T10:44:31.239 INFO:tasks.workunit.client.0.smithi049.stdout:6/586: rename da/d4a/l36 to da/lc5 0 2024-04-26T10:44:31.241 INFO:tasks.workunit.client.0.smithi049.stdout:2/612: truncate d6/d32/d4a/f51 3317787 0 2024-04-26T10:44:31.241 INFO:tasks.workunit.client.0.smithi049.stdout:4/712: dread de/d3f/d52/fc1 [0,4194304] 0 2024-04-26T10:44:31.241 INFO:tasks.workunit.client.0.smithi049.stdout:9/752: dwrite d2/d1a/d1b/d1f/d49/fb7 [0,4194304] 0 2024-04-26T10:44:31.242 INFO:tasks.workunit.client.0.smithi049.stdout:7/670: write d2/f4f [504265,83736] 0 2024-04-26T10:44:31.243 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:31.243 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:31.243 INFO:tasks.workunit.client.0.smithi049.stdout:9/753: chown d2/d1a/de2/f8e 237057750 1 2024-04-26T10:44:31.244 INFO:tasks.workunit.client.0.smithi049.stdout:8/698: mkdir d2/d17/de1/de4 0 2024-04-26T10:44:31.245 INFO:tasks.workunit.client.0.smithi049.stdout:5/644: dwrite f3 [0,4194304] 0 2024-04-26T10:44:31.246 INFO:tasks.workunit.client.0.smithi049.stdout:7/671: read - d2/dd/d25/d27/fa6 zero size 2024-04-26T10:44:31.247 INFO:tasks.workunit.client.0.smithi049.stdout:3/536: read d3/d23/d2f/d6a/d6b/d8/d55/f2d [2962106,77771] 0 2024-04-26T10:44:31.248 INFO:tasks.workunit.client.0.smithi049.stdout:9/754: write d2/d1a/d1b/d7a/fb5 [817098,99314] 0 2024-04-26T10:44:31.248 INFO:tasks.workunit.client.0.smithi049.stdout:6/587: rename da/lc5 to da/lc6 0 2024-04-26T10:44:31.249 INFO:tasks.workunit.client.0.smithi049.stdout:4/713: write de/d1b/d5e/d72/d73/d84/d4b/fa3 [5204001,16975] 0 2024-04-26T10:44:31.249 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:31.250 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:31.250 INFO:tasks.workunit.client.0.smithi049.stdout:1/562: dwrite fd [0,4194304] 0 2024-04-26T10:44:31.251 INFO:tasks.workunit.client.0.smithi049.stdout:7/672: write d2/dd/d25/d27/f57 [684695,5667] 0 2024-04-26T10:44:31.251 INFO:tasks.workunit.client.0.smithi049.stdout:6/588: readlink da/dd/de/d11/la2 0 2024-04-26T10:44:31.251 INFO:tasks.workunit.client.0.smithi049.stdout:8/699: fdatasync d2/d89/d2a/d9f/fbc 0 2024-04-26T10:44:31.252 INFO:tasks.workunit.client.0.smithi049.stdout:7/673: dread - d2/dd/d48/da3/fd2 zero size 2024-04-26T10:44:31.252 INFO:tasks.workunit.client.0.smithi049.stdout:9/755: creat d2/d1a/df/ff5 x:0 0 0 2024-04-26T10:44:31.252 INFO:tasks.workunit.client.0.smithi049.stdout:4/714: stat de/d3f/d52/d9b/d9e/cc3 0 2024-04-26T10:44:31.252 INFO:tasks.workunit.client.0.smithi049.stdout:3/537: mkdir d3/d23/d2f/d6a/d6b/d8/d55/db4 0 2024-04-26T10:44:31.253 INFO:tasks.workunit.client.0.smithi049.stdout:5/645: write d7/d1d/d1f/f51 [84326,60502] 0 2024-04-26T10:44:31.253 INFO:tasks.workunit.client.0.smithi049.stdout:4/715: fdatasync de/d1b/f40 0 2024-04-26T10:44:31.254 INFO:tasks.workunit.client.0.smithi049.stdout:2/613: truncate d6/d32/d69/fb4 650541 0 2024-04-26T10:44:31.254 INFO:tasks.workunit.client.0.smithi049.stdout:7/674: symlink d2/dd/d48/da3/lde 0 2024-04-26T10:44:31.254 INFO:tasks.workunit.client.0.smithi049.stdout:1/563: getdents d1e/d20/d26/d3c/d54/d59/d73 0 2024-04-26T10:44:31.254 INFO:tasks.workunit.client.0.smithi049.stdout:8/700: rename d2/d89/d30/f8f to d2/d16/fe5 0 2024-04-26T10:44:31.255 INFO:tasks.workunit.client.0.smithi049.stdout:9/756: mkdir d2/d1a/d1b/d1f/d64/df6 0 2024-04-26T10:44:31.255 INFO:tasks.workunit.client.0.smithi049.stdout:5/646: mknod d7/d1d/d1f/d4e/dad/cff 0 2024-04-26T10:44:31.256 INFO:tasks.workunit.client.0.smithi049.stdout:3/538: symlink d3/d23/d2f/d6a/d6b/d8/d55/lb5 0 2024-04-26T10:44:31.257 INFO:tasks.workunit.client.0.smithi049.stdout:4/716: creat de/d1b/d5e/d99/dbb/fd9 x:0 0 0 2024-04-26T10:44:31.257 INFO:tasks.workunit.client.0.smithi049.stdout:5/647: creat d7/f100 x:0 0 0 2024-04-26T10:44:31.257 INFO:tasks.workunit.client.0.smithi049.stdout:9/757: mknod d2/d25/dee/cf7 0 2024-04-26T10:44:31.257 INFO:tasks.workunit.client.0.smithi049.stdout:2/614: rename d6/d9/d5f/dba/d34/d38/d3f/d60/fbc to d6/d9/d5f/dba/d35/d91/fbd 0 2024-04-26T10:44:31.263 INFO:tasks.workunit.client.0.smithi049.stdout:7/675: read d2/dd/d7f/db1/fb9 [563523,48832] 0 2024-04-26T10:44:31.263 INFO:tasks.workunit.client.0.smithi049.stdout:9/758: rename d2/d1a/d42/ff4 to d2/d25/d74/ff8 0 2024-04-26T10:44:31.263 INFO:tasks.workunit.client.0.smithi049.stdout:8/701: link d2/d16/d19/d42/d7c/l80 d2/d17/d34/d40/d64/le6 0 2024-04-26T10:44:31.263 INFO:tasks.workunit.client.0.smithi049.stdout:2/615: dread - d6/d9/d5f/f96 zero size 2024-04-26T10:44:31.263 INFO:tasks.workunit.client.0.smithi049.stdout:5/648: rename d7/d53/lcd to d7/d1d/d1f/d4e/dad/l101 0 2024-04-26T10:44:31.263 INFO:tasks.workunit.client.0.smithi049.stdout:1/564: read f11 [265899,124390] 0 2024-04-26T10:44:31.263 INFO:tasks.workunit.client.0.smithi049.stdout:0/666: dread d8/db/d26/d39/fa4 [0,4194304] 0 2024-04-26T10:44:31.263 INFO:tasks.workunit.client.0.smithi049.stdout:9/759: unlink d2/d1a/df/f13 0 2024-04-26T10:44:31.264 INFO:tasks.workunit.client.0.smithi049.stdout:8/702: mkdir d2/d16/d19/de7 0 2024-04-26T10:44:31.264 INFO:tasks.workunit.client.0.smithi049.stdout:4/717: rename de/d1b/d5e/da2/faa to de/d1b/d5e/d72/d73/d84/d4b/fda 0 2024-04-26T10:44:31.264 INFO:tasks.workunit.client.0.smithi049.stdout:9/760: dread - d2/d40/db2/fe5 zero size 2024-04-26T10:44:31.264 INFO:tasks.workunit.client.0.smithi049.stdout:1/565: mknod d1e/d20/d26/d37/d69/cad 0 2024-04-26T10:44:31.264 INFO:tasks.workunit.client.0.smithi049.stdout:5/649: symlink d7/d14/d18/l102 0 2024-04-26T10:44:31.264 INFO:tasks.workunit.client.0.smithi049.stdout:0/667: creat d8/db/d11/fe7 x:0 0 0 2024-04-26T10:44:31.264 INFO:tasks.workunit.client.0.smithi049.stdout:2/616: getdents d6/d9/d5f/dba/d34/d38/d73 0 2024-04-26T10:44:31.264 INFO:tasks.workunit.client.0.smithi049.stdout:1/566: stat d1e/d20/d26/d37/d8e/faa 0 2024-04-26T10:44:31.264 INFO:tasks.workunit.client.0.smithi049.stdout:9/761: chown d2/d1a/d1b/d1f/d34/fbe 623425 1 2024-04-26T10:44:31.264 INFO:tasks.workunit.client.0.smithi049.stdout:4/718: symlink de/d1b/d5e/d72/d73/d84/d24/db4/ldb 0 2024-04-26T10:44:31.265 INFO:tasks.workunit.client.0.smithi049.stdout:8/703: creat d2/d17/de1/de4/fe8 x:0 0 0 2024-04-26T10:44:31.266 INFO:tasks.workunit.client.0.smithi049.stdout:3/539: truncate d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/f3f 285619 0 2024-04-26T10:44:31.266 INFO:tasks.workunit.client.0.smithi049.stdout:5/650: rename d7/d1d/d1f/d22 to d7/d66/d84/d103 0 2024-04-26T10:44:31.266 INFO:tasks.workunit.client.0.smithi049.stdout:0/668: mknod d8/db/d11/d1c/dbb/db0/ce8 0 2024-04-26T10:44:31.266 INFO:tasks.workunit.client.0.smithi049.stdout:1/567: rename d1e/d20/d26/d57 to d1e/d20/d26/d57/dae 22 2024-04-26T10:44:31.267 INFO:tasks.workunit.client.0.smithi049.stdout:5/651: fdatasync d7/fc 0 2024-04-26T10:44:31.267 INFO:tasks.workunit.client.0.smithi049.stdout:8/704: mkdir d2/d89/d2a/d9f/de9 0 2024-04-26T10:44:31.267 INFO:tasks.workunit.client.0.smithi049.stdout:2/617: getdents d6/d9/d5f/dba/d34/d38 0 2024-04-26T10:44:31.268 INFO:tasks.workunit.client.0.smithi049.stdout:4/719: rename de/d3f/d52/d9b/d9e/db2/fc8 to de/d1b/d5e/d72/d73/d84/d24/fdc 0 2024-04-26T10:44:31.268 INFO:tasks.workunit.client.0.smithi049.stdout:8/705: truncate d2/d1a/f3e 1332659 0 2024-04-26T10:44:31.269 INFO:tasks.workunit.client.0.smithi049.stdout:4/720: fsync de/d3f/d48/d8b/fcc 0 2024-04-26T10:44:31.273 INFO:tasks.workunit.client.0.smithi049.stdout:9/762: dwrite d2/d1a/f2a [0,4194304] 0 2024-04-26T10:44:31.276 INFO:tasks.workunit.client.0.smithi049.stdout:0/669: dwrite d8/db/d26/f40 [0,4194304] 0 2024-04-26T10:44:31.276 INFO:tasks.workunit.client.0.smithi049.stdout:1/568: dwrite d1e/d20/d26/f4b [0,4194304] 0 2024-04-26T10:44:31.276 INFO:tasks.workunit.client.0.smithi049.stdout:6/589: dread da/dd/d47/fb6 [0,4194304] 0 2024-04-26T10:44:31.277 INFO:tasks.workunit.client.0.smithi049.stdout:4/721: fsync de/d1b/d5e/d72/d73/d84/d24/d50/f9c 0 2024-04-26T10:44:31.277 INFO:tasks.workunit.client.0.smithi049.stdout:3/540: dwrite d3/d23/d2f/d6a/d6b/d26/d29/f3e [0,4194304] 0 2024-04-26T10:44:31.277 INFO:tasks.workunit.client.0.smithi049.stdout:9/763: truncate d2/d1a/fc1 908526 0 2024-04-26T10:44:31.279 INFO:tasks.workunit.client.0.smithi049.stdout:1/569: chown d1e/d20/d26/d37/fa0 342 1 2024-04-26T10:44:31.279 INFO:tasks.workunit.client.0.smithi049.stdout:2/618: dwrite d6/d9/d5f/dba/d34/d38/d3f/f8b [0,4194304] 0 2024-04-26T10:44:31.279 INFO:tasks.workunit.client.0.smithi049.stdout:9/764: chown d2/d1a/d1b/d1f/d64 555777044 1 2024-04-26T10:44:31.279 INFO:tasks.workunit.client.0.smithi049.stdout:1/570: mkdir d1e/d20/daf 0 2024-04-26T10:44:31.279 INFO:tasks.workunit.client.0.smithi049.stdout:0/670: rename d8/d41/ca2 to d8/db/ce9 0 2024-04-26T10:44:31.281 INFO:tasks.workunit.client.0.smithi049.stdout:6/590: rename da/lc6 to da/dd/d62/dc1/lc7 0 2024-04-26T10:44:31.281 INFO:tasks.workunit.client.0.smithi049.stdout:9/765: link d2/d1a/d1b/fba d2/d1a/d1b/d1f/d34/ff9 0 2024-04-26T10:44:31.281 INFO:tasks.workunit.client.0.smithi049.stdout:0/671: truncate d8/da5/fbe 454522 0 2024-04-26T10:44:31.281 INFO:tasks.workunit.client.0.smithi049.stdout:1/571: chown d1e/d20/d26/d3c/d54/d59/l83 3267 1 2024-04-26T10:44:31.282 INFO:tasks.workunit.client.0.smithi049.stdout:3/541: rename d3/d23/d2f/d6a/d6b/d8/d55/l2c to d3/d23/d2f/d6a/d6b/d8/d34/lb6 0 2024-04-26T10:44:31.282 INFO:tasks.workunit.client.0.smithi049.stdout:0/672: fdatasync d8/f18 0 2024-04-26T10:44:31.282 INFO:tasks.workunit.client.0.smithi049.stdout:9/766: write d2/d1a/f2c [348908,96088] 0 2024-04-26T10:44:31.283 INFO:tasks.workunit.client.0.smithi049.stdout:9/767: stat d2/d1a/d1b/d7a/f80 0 2024-04-26T10:44:31.283 INFO:tasks.workunit.client.0.smithi049.stdout:6/591: symlink da/dd/lc8 0 2024-04-26T10:44:31.284 INFO:tasks.workunit.client.0.smithi049.stdout:3/542: mknod d3/d23/d2f/d6a/d6b/d8/d55/d46/cb7 0 2024-04-26T10:44:31.284 INFO:tasks.workunit.client.0.smithi049.stdout:9/768: fsync d2/d1a/d1b/d1f/d34/fbe 0 2024-04-26T10:44:31.285 INFO:tasks.workunit.client.0.smithi049.stdout:0/673: mknod d8/db/d11/d1b/d4d/dae/cea 0 2024-04-26T10:44:31.286 INFO:tasks.workunit.client.0.smithi049.stdout:3/543: mkdir d3/d23/d2f/db8 0 2024-04-26T10:44:31.286 INFO:tasks.workunit.client.0.smithi049.stdout:9/769: write d2/d1a/d1b/d1f/fd0 [5084836,101627] 0 2024-04-26T10:44:31.287 INFO:tasks.workunit.client.0.smithi049.stdout:5/652: truncate d7/d1d/d1f/d4e/d65/d6f/d91/f4f 3881572 0 2024-04-26T10:44:31.287 INFO:tasks.workunit.client.0.smithi049.stdout:0/674: creat d8/d1e/feb x:0 0 0 2024-04-26T10:44:31.287 INFO:tasks.workunit.client.0.smithi049.stdout:3/544: getdents d3/d23/d2f/d6a/d6b/d8/d87/db1 0 2024-04-26T10:44:31.288 INFO:tasks.workunit.client.0.smithi049.stdout:1/572: dwrite d1e/d20/d26/f63 [0,4194304] 0 2024-04-26T10:44:31.288 INFO:tasks.workunit.client.0.smithi049.stdout:9/770: mknod d2/d1a/d1b/d1f/d64/df6/cfa 0 2024-04-26T10:44:31.289 INFO:tasks.workunit.client.0.smithi049.stdout:1/573: mknod d1e/d20/d26/d37/cb0 0 2024-04-26T10:44:31.289 INFO:tasks.workunit.client.0.smithi049.stdout:1/574: readlink d1e/d20/d4d/l79 0 2024-04-26T10:44:31.293 INFO:tasks.workunit.client.0.smithi049.stdout:6/592: truncate da/dd/f1e 1737188 0 2024-04-26T10:44:31.294 INFO:tasks.workunit.client.0.smithi049.stdout:0/675: dread d8/f18 [0,4194304] 0 2024-04-26T10:44:31.295 INFO:tasks.workunit.client.0.smithi049.stdout:6/593: mkdir da/dd/d62/d9d/d9e/dc9 0 2024-04-26T10:44:31.295 INFO:tasks.workunit.client.0.smithi049.stdout:6/594: readlink da/d4a/l88 0 2024-04-26T10:44:31.295 INFO:tasks.workunit.client.0.smithi049.stdout:0/676: mkdir d8/db/d11/d1c/db8/dec 0 2024-04-26T10:44:31.295 INFO:tasks.workunit.client.0.smithi049.stdout:6/595: readlink da/dd/de/d11/l23 0 2024-04-26T10:44:31.296 INFO:tasks.workunit.client.0.smithi049.stdout:6/596: chown da/dd/de/d26/d22/d4c/f5b 47 1 2024-04-26T10:44:31.296 INFO:tasks.workunit.client.0.smithi049.stdout:7/676: sync 2024-04-26T10:44:31.296 INFO:tasks.workunit.client.0.smithi049.stdout:3/545: sync 2024-04-26T10:44:31.296 INFO:tasks.workunit.client.0.smithi049.stdout:0/677: mknod d8/db/d11/d1b/d4d/dae/dc5/ced 0 2024-04-26T10:44:31.297 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:31.295+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:31.298 INFO:tasks.workunit.client.0.smithi049.stdout:0/678: stat d8/db/d11/d1b/d4d/l63 0 2024-04-26T10:44:31.298 INFO:tasks.workunit.client.0.smithi049.stdout:3/546: stat d3/d23/d2f/d6a/d6b/d26/d65 0 2024-04-26T10:44:31.298 INFO:tasks.workunit.client.0.smithi049.stdout:7/677: creat d2/dd/d38/fdf x:0 0 0 2024-04-26T10:44:31.298 INFO:tasks.workunit.client.0.smithi049.stdout:9/771: truncate d2/d1a/d1b/d1f/f39 3695433 0 2024-04-26T10:44:31.300 INFO:tasks.workunit.client.0.smithi049.stdout:0/679: getdents d8/da5 0 2024-04-26T10:44:31.300 INFO:tasks.workunit.client.0.smithi049.stdout:3/547: creat d3/d23/d2f/d6a/d6b/d26/d65/dae/fb9 x:0 0 0 2024-04-26T10:44:31.300 INFO:tasks.workunit.client.0.smithi049.stdout:7/678: rename d2/d3/f16 to d2/dd/d48/da3/fe0 0 2024-04-26T10:44:31.301 INFO:tasks.workunit.client.0.smithi049.stdout:0/680: write d8/d41/f8a [564442,47811] 0 2024-04-26T10:44:31.302 INFO:tasks.workunit.client.0.smithi049.stdout:6/597: dwrite da/f91 [4194304,4194304] 0 2024-04-26T10:44:31.302 INFO:tasks.workunit.client.0.smithi049.stdout:3/548: rmdir d3/d23/d2f/d6a/d6b/d26/d65 39 2024-04-26T10:44:31.302 INFO:tasks.workunit.client.0.smithi049.stdout:7/679: creat d2/dd/d48/fe1 x:0 0 0 2024-04-26T10:44:31.303 INFO:tasks.workunit.client.0.smithi049.stdout:6/598: mknod da/dd/d62/dc1/cca 0 2024-04-26T10:44:31.303 INFO:tasks.workunit.client.0.smithi049.stdout:0/681: getdents d8/d1e 0 2024-04-26T10:44:31.304 INFO:tasks.workunit.client.0.smithi049.stdout:3/549: read d3/d23/d2f/d6a/d6b/d26/d29/f3e [3283572,8864] 0 2024-04-26T10:44:31.305 INFO:tasks.workunit.client.0.smithi049.stdout:7/680: getdents d2/dd/d48/d5c 0 2024-04-26T10:44:31.305 INFO:tasks.workunit.client.0.smithi049.stdout:6/599: rmdir da/dd/d62/d9d/d9e/dc9 0 2024-04-26T10:44:31.306 INFO:tasks.workunit.client.0.smithi049.stdout:7/681: mknod d2/d3/d96/ddc/ce2 0 2024-04-26T10:44:31.306 INFO:tasks.workunit.client.0.smithi049.stdout:6/600: mkdir da/dd/d47/da3/dcb 0 2024-04-26T10:44:31.307 INFO:tasks.workunit.client.0.smithi049.stdout:7/682: dread - d2/dab/fd0 zero size 2024-04-26T10:44:31.307 INFO:tasks.workunit.client.0.smithi049.stdout:3/550: rename d3/l38 to d3/d23/d2f/d6a/d6b/d8/d55/d46/lba 0 2024-04-26T10:44:31.307 INFO:tasks.workunit.client.0.smithi049.stdout:9/772: write d2/d1a/d1b/d1f/d64/f6e [505035,122460] 0 2024-04-26T10:44:31.308 INFO:tasks.workunit.client.0.smithi049.stdout:8/706: dread d2/d89/d2a/f54 [0,4194304] 0 2024-04-26T10:44:31.308 INFO:tasks.workunit.client.0.smithi049.stdout:7/683: mknod d2/dd/dd3/ce3 0 2024-04-26T10:44:31.309 INFO:tasks.workunit.client.0.smithi049.stdout:8/707: chown d2/fe 126461 1 2024-04-26T10:44:31.309 INFO:tasks.workunit.client.0.smithi049.stdout:9/773: chown d2/d1a/d1b/d7a/lb4 506 1 2024-04-26T10:44:31.310 INFO:tasks.workunit.client.0.smithi049.stdout:7/684: creat d2/d3/fe4 x:0 0 0 2024-04-26T10:44:31.310 INFO:tasks.workunit.client.0.smithi049.stdout:8/708: fdatasync d2/fc 0 2024-04-26T10:44:31.311 INFO:tasks.workunit.client.0.smithi049.stdout:9/774: creat d2/d1a/ffb x:0 0 0 2024-04-26T10:44:31.313 INFO:tasks.workunit.client.0.smithi049.stdout:0/682: dwrite d8/db/d11/d1c/f47 [0,4194304] 0 2024-04-26T10:44:31.314 INFO:tasks.workunit.client.0.smithi049.stdout:3/551: dwrite d3/f40 [0,4194304] 0 2024-04-26T10:44:31.315 INFO:tasks.workunit.client.0.smithi049.stdout:0/683: chown d8/db/d11/d1b/d4d/l63 930580275 1 2024-04-26T10:44:31.315 INFO:tasks.workunit.client.0.smithi049.stdout:8/709: symlink d2/d17/d34/dbf/lea 0 2024-04-26T10:44:31.317 INFO:tasks.workunit.client.0.smithi049.stdout:2/619: dread d6/d9/d5f/dba/d34/d38/d3f/f42 [0,4194304] 0 2024-04-26T10:44:31.317 INFO:tasks.workunit.client.0.smithi049.stdout:5/653: dread d7/d14/f17 [0,4194304] 0 2024-04-26T10:44:31.317 INFO:tasks.workunit.client.0.smithi049.stdout:0/684: stat d8/db/c1f 0 2024-04-26T10:44:31.318 INFO:tasks.workunit.client.0.smithi049.stdout:8/710: mkdir d2/d16/d19/d42/deb 0 2024-04-26T10:44:31.318 INFO:tasks.workunit.client.0.smithi049.stdout:3/552: fsync d3/d23/d2f/d6a/d6b/d8/dd/f9d 0 2024-04-26T10:44:31.319 INFO:tasks.workunit.client.0.smithi049.stdout:4/722: dread de/d1b/d5e/d72/d73/d84/f2e [0,4194304] 0 2024-04-26T10:44:31.319 INFO:tasks.workunit.client.0.smithi049.stdout:7/685: dwrite d2/dd/d25/f75 [0,4194304] 0 2024-04-26T10:44:31.319 INFO:tasks.workunit.client.0.smithi049.stdout:9/775: dread d2/d1a/d1b/d1f/d49/fb7 [0,4194304] 0 2024-04-26T10:44:31.320 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:31.320 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:31.320 INFO:tasks.workunit.client.0.smithi049.stdout:0/685: creat d8/db/d11/d1c/db8/fee x:0 0 0 2024-04-26T10:44:31.321 INFO:tasks.workunit.client.0.smithi049.stdout:9/776: stat d2/l18 0 2024-04-26T10:44:31.321 INFO:tasks.workunit.client.0.smithi049.stdout:8/711: chown d2/d89/c70 15592569 1 2024-04-26T10:44:31.321 INFO:tasks.workunit.client.0.smithi049.stdout:7/686: chown d2/dd/d25/f75 408 1 2024-04-26T10:44:31.321 INFO:tasks.workunit.client.0.smithi049.stdout:1/575: dread d1e/d20/d26/d37/f58 [0,4194304] 0 2024-04-26T10:44:31.322 INFO:tasks.workunit.client.0.smithi049.stdout:9/777: write d2/f3c [877883,113564] 0 2024-04-26T10:44:31.322 INFO:tasks.workunit.client.0.smithi049.stdout:0/686: write d8/db/fd8 [528907,113108] 0 2024-04-26T10:44:31.323 INFO:tasks.workunit.client.0.smithi049.stdout:4/723: rename de/d3f/lc7 to de/d1b/d5e/d72/ldd 0 2024-04-26T10:44:31.323 INFO:tasks.workunit.client.0.smithi049.stdout:8/712: symlink d2/d17/d34/d40/d7f/lec 0 2024-04-26T10:44:31.323 INFO:tasks.workunit.client.0.smithi049.stdout:7/687: creat d2/d3/d96/fe5 x:0 0 0 2024-04-26T10:44:31.323 INFO:tasks.workunit.client.0.smithi049.stdout:9/778: chown d2/d25/d60/da4/fe8 0 1 2024-04-26T10:44:31.323 INFO:tasks.workunit.client.0.smithi049.stdout:1/576: write d1e/d20/d26/d37/f5b [1001705,47784] 0 2024-04-26T10:44:31.325 INFO:tasks.workunit.client.0.smithi049.stdout:8/713: read d2/df/f3f [1051812,84918] 0 2024-04-26T10:44:31.325 INFO:tasks.workunit.client.0.smithi049.stdout:4/724: write de/d3f/d52/d9b/f6b [3368849,73158] 0 2024-04-26T10:44:31.325 INFO:tasks.workunit.client.0.smithi049.stdout:7/688: chown d2/d3/de/d1c/l21 111707 1 2024-04-26T10:44:31.325 INFO:tasks.workunit.client.0.smithi049.stdout:9/779: creat d2/d1a/d1b/d1f/ffc x:0 0 0 2024-04-26T10:44:31.325 INFO:tasks.workunit.client.0.smithi049.stdout:0/687: rename d8/db/d26/db9/fd6 to d8/db/d11/d1c/dbb/db0/fef 0 2024-04-26T10:44:31.326 INFO:tasks.workunit.client.0.smithi049.stdout:1/577: rename d1e/d20/d26/d37/d69/d75/l7d to d1e/d20/d26/d3c/lb1 0 2024-04-26T10:44:31.326 INFO:tasks.workunit.client.0.smithi049.stdout:2/620: truncate d6/d9/d5f/dba/d35/f90 3296927 0 2024-04-26T10:44:31.326 INFO:tasks.workunit.client.0.smithi049.stdout:5/654: truncate d7/d1d/d1f/d4e/d65/d6f/fe0 249475 0 2024-04-26T10:44:31.327 INFO:tasks.workunit.client.0.smithi049.stdout:7/689: rename d2/d3/de/fc3 to d2/d3/dcf/fe6 0 2024-04-26T10:44:31.327 INFO:tasks.workunit.client.0.smithi049.stdout:5/655: fsync d7/d14/d18/ffa 0 2024-04-26T10:44:31.327 INFO:tasks.workunit.client.0.smithi049.stdout:8/714: rename d2/d1a/d9c/dc9 to d2/d16/d19/dd9/ded 0 2024-04-26T10:44:31.328 INFO:tasks.workunit.client.0.smithi049.stdout:7/690: dread - d2/dd/d7f/db1/fb5 zero size 2024-04-26T10:44:31.328 INFO:tasks.workunit.client.0.smithi049.stdout:0/688: dread d8/f3d [0,4194304] 0 2024-04-26T10:44:31.328 INFO:tasks.workunit.client.0.smithi049.stdout:1/578: rename d1e/f6f to d1e/d20/d26/d37/d6e/fb2 0 2024-04-26T10:44:31.329 INFO:tasks.workunit.client.0.smithi049.stdout:7/691: mkdir d2/dab/de7 0 2024-04-26T10:44:31.329 INFO:tasks.workunit.client.0.smithi049.stdout:8/715: mknod d2/d16/d19/d42/d7c/cee 0 2024-04-26T10:44:31.329 INFO:tasks.workunit.client.0.smithi049.stdout:3/553: truncate d3/d23/d2f/d6a/d6b/d8/f49 1401803 0 2024-04-26T10:44:31.330 INFO:tasks.workunit.client.0.smithi049.stdout:6/601: sync 2024-04-26T10:44:31.330 INFO:tasks.workunit.client.0.smithi049.stdout:4/725: sync 2024-04-26T10:44:31.330 INFO:tasks.workunit.client.0.smithi049.stdout:2/621: truncate d6/d9/d5f/dba/d34/d38/d3f/d60/fa3 327464 0 2024-04-26T10:44:31.331 INFO:tasks.workunit.client.0.smithi049.stdout:7/692: dread - d2/dd/d48/f8f zero size 2024-04-26T10:44:31.331 INFO:tasks.workunit.client.0.smithi049.stdout:0/689: rename d8/db/d26/d39/f58 to d8/db/ff0 0 2024-04-26T10:44:31.332 INFO:tasks.workunit.client.0.smithi049.stdout:8/716: creat d2/df/d10/d47/dca/fef x:0 0 0 2024-04-26T10:44:31.332 INFO:tasks.workunit.client.0.smithi049.stdout:6/602: creat da/dd/de/d11/dbc/fcc x:0 0 0 2024-04-26T10:44:31.332 INFO:tasks.workunit.client.0.smithi049.stdout:3/554: creat d3/d23/d2f/d6a/d6b/d8/d34/fbb x:0 0 0 2024-04-26T10:44:31.332 INFO:tasks.workunit.client.0.smithi049.stdout:2/622: mkdir d6/d30/d97/dbe 0 2024-04-26T10:44:31.333 INFO:tasks.workunit.client.0.smithi049.stdout:6/603: readlink l3 0 2024-04-26T10:44:31.334 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:31.337 INFO:tasks.workunit.client.0.smithi049.stdout:8/717: unlink d2/d89/d2a/d9f/cb4 0 2024-04-26T10:44:31.337 INFO:tasks.workunit.client.0.smithi049.stdout:7/693: mknod d2/d3/de/d1c/ce8 0 2024-04-26T10:44:31.337 INFO:tasks.workunit.client.0.smithi049.stdout:4/726: link de/d3f/d48/c87 de/d1b/d5e/d72/d73/cde 0 2024-04-26T10:44:31.337 INFO:tasks.workunit.client.0.smithi049.stdout:0/690: creat d8/db/d11/d1c/dbb/dc1/dd7/de3/ff1 x:0 0 0 2024-04-26T10:44:31.337 INFO:tasks.workunit.client.0.smithi049.stdout:2/623: write d6/d9/d5f/dba/f13 [3893784,3510] 0 2024-04-26T10:44:31.337 INFO:tasks.workunit.client.0.smithi049.stdout:3/555: creat d3/d23/d2f/d6a/d6b/d26/d5f/fbc x:0 0 0 2024-04-26T10:44:31.337 INFO:tasks.workunit.client.0.smithi049.stdout:1/579: dread d1e/d20/d26/d3c/d54/d59/d73/f7e [0,4194304] 0 2024-04-26T10:44:31.337 INFO:tasks.workunit.client.0.smithi049.stdout:9/780: dwrite d2/d1a/d1b/f52 [0,4194304] 0 2024-04-26T10:44:31.337 INFO:tasks.workunit.client.0.smithi049.stdout:7/694: write d2/d3/d96/fb4 [941411,98793] 0 2024-04-26T10:44:31.337 INFO:tasks.workunit.client.0.smithi049.stdout:4/727: unlink de/d3f/d52/d9b/fd0 0 2024-04-26T10:44:31.338 INFO:tasks.workunit.client.0.smithi049.stdout:1/580: rmdir d1e/d20/d4d 39 2024-04-26T10:44:31.338 INFO:tasks.workunit.client.0.smithi049.stdout:9/781: dread - d2/d1a/d42/fc4 zero size 2024-04-26T10:44:31.338 INFO:tasks.workunit.client.0.smithi049.stdout:3/556: read d3/d23/d2f/d6a/d6b/d26/f5a [801037,126186] 0 2024-04-26T10:44:31.339 INFO:tasks.workunit.client.0.smithi049.stdout:3/557: sync 2024-04-26T10:44:31.339 INFO:tasks.workunit.client.0.smithi049.stdout:9/782: read - d2/d1a/d1b/fd3 zero size 2024-04-26T10:44:31.339 INFO:tasks.workunit.client.0.smithi049.stdout:7/695: mkdir d2/dd/d7f/db1/dc6/de9 0 2024-04-26T10:44:31.340 INFO:tasks.workunit.client.0.smithi049.stdout:0/691: rename d8/db/d11/d1b/d4d/f5e to d8/db/d11/d1c/dbb/dc1/ff2 0 2024-04-26T10:44:31.344 INFO:tasks.workunit.client.0.smithi049.stdout:7/696: dread - d2/dd/d38/fa1 zero size 2024-04-26T10:44:31.344 INFO:tasks.workunit.client.0.smithi049.stdout:2/624: getdents d6/d9/d5f/dba/d11/d6a 0 2024-04-26T10:44:31.344 INFO:tasks.workunit.client.0.smithi049.stdout:6/604: truncate da/dd/d47/f79 1496958 0 2024-04-26T10:44:31.344 INFO:tasks.workunit.client.0.smithi049.stdout:9/783: mknod d2/d1a/d8a/cfd 0 2024-04-26T10:44:31.344 INFO:tasks.workunit.client.0.smithi049.stdout:1/581: creat d1e/d20/d26/d3c/fb3 x:0 0 0 2024-04-26T10:44:31.344 INFO:tasks.workunit.client.0.smithi049.stdout:4/728: link de/d3f/d52/fc1 de/d3f/dbf/fdf 0 2024-04-26T10:44:31.344 INFO:tasks.workunit.client.0.smithi049.stdout:3/558: write d3/d23/d2f/d6a/d6b/d26/fa7 [731050,5837] 0 2024-04-26T10:44:31.345 INFO:tasks.workunit.client.0.smithi049.stdout:7/697: mknod d2/dd/cea 0 2024-04-26T10:44:31.345 INFO:tasks.workunit.client.0.smithi049.stdout:6/605: symlink da/dd/de/d42/d5a/lcd 0 2024-04-26T10:44:31.346 INFO:tasks.workunit.client.0.smithi049.stdout:9/784: write d2/d25/d60/fa0 [1063893,95608] 0 2024-04-26T10:44:31.346 INFO:tasks.workunit.client.0.smithi049.stdout:1/582: creat d1e/d20/d26/d3c/d54/d59/d73/dab/fb4 x:0 0 0 2024-04-26T10:44:31.346 INFO:tasks.workunit.client.0.smithi049.stdout:2/625: rename d6/d30/l37 to d6/d9/d5f/dba/d34/d38/db5/lbf 0 2024-04-26T10:44:31.346 INFO:tasks.workunit.client.0.smithi049.stdout:5/656: dread d7/ff [0,4194304] 0 2024-04-26T10:44:31.346 INFO:tasks.workunit.client.0.smithi049.stdout:7/698: symlink d2/dd/d45/leb 0 2024-04-26T10:44:31.346 INFO:tasks.workunit.client.0.smithi049.stdout:1/583: stat d1e/c81 0 2024-04-26T10:44:31.346 INFO:tasks.workunit.client.0.smithi049.stdout:8/718: dwrite d2/d17/d34/f5b [0,4194304] 0 2024-04-26T10:44:31.346 INFO:tasks.workunit.client.0.smithi049.stdout:9/785: dread - d2/d1a/d42/fc4 zero size 2024-04-26T10:44:31.347 INFO:tasks.workunit.client.0.smithi049.stdout:6/606: write da/dd/de/d26/d22/f8d [520912,30570] 0 2024-04-26T10:44:31.347 INFO:tasks.workunit.client.0.smithi049.stdout:7/699: mknod d2/d3/d96/ddc/cec 0 2024-04-26T10:44:31.347 INFO:tasks.workunit.client.0.smithi049.stdout:2/626: chown d6/d9/d5f/dba/c6d 2008925 1 2024-04-26T10:44:31.347 INFO:tasks.workunit.client.0.smithi049.stdout:8/719: dread - d2/d17/de1/de4/fe8 zero size 2024-04-26T10:44:31.348 INFO:tasks.workunit.client.0.smithi049.stdout:7/700: write d2/dab/fd0 [658256,114054] 0 2024-04-26T10:44:31.349 INFO:tasks.workunit.client.0.smithi049.stdout:9/786: mknod d2/d40/d53/de7/cfe 0 2024-04-26T10:44:31.349 INFO:tasks.workunit.client.0.smithi049.stdout:0/692: truncate d8/f76 2640301 0 2024-04-26T10:44:31.349 INFO:tasks.workunit.client.0.smithi049.stdout:2/627: chown d6/d9/d5f/dba/df/c9d 771745 1 2024-04-26T10:44:31.350 INFO:tasks.workunit.client.0.smithi049.stdout:7/701: symlink d2/d3/d96/led 0 2024-04-26T10:44:31.350 INFO:tasks.workunit.client.0.smithi049.stdout:5/657: creat d7/d1d/d1f/d4e/f104 x:0 0 0 2024-04-26T10:44:31.351 INFO:tasks.workunit.client.0.smithi049.stdout:1/584: getdents d1e/d20/d26/d3c 0 2024-04-26T10:44:31.352 INFO:tasks.workunit.client.0.smithi049.stdout:9/787: dread - d2/d25/d60/da4/fe8 zero size 2024-04-26T10:44:31.352 INFO:tasks.workunit.client.0.smithi049.stdout:8/720: chown d2/d16/d19/lac 6763 1 2024-04-26T10:44:31.352 INFO:tasks.workunit.client.0.smithi049.stdout:3/559: dwrite d3/d23/d2f/d6a/d6b/d26/d5f/fbc [0,4194304] 0 2024-04-26T10:44:31.352 INFO:tasks.workunit.client.0.smithi049.stdout:9/788: sync 2024-04-26T10:44:31.352 INFO:tasks.workunit.client.0.smithi049.stdout:7/702: mknod d2/dd/d25/cee 0 2024-04-26T10:44:31.353 INFO:tasks.workunit.client.0.smithi049.stdout:5/658: mknod d7/d1d/d20/c105 0 2024-04-26T10:44:31.353 INFO:tasks.workunit.client.0.smithi049.stdout:1/585: write d1e/d20/d4d/fac [755221,98360] 0 2024-04-26T10:44:31.354 INFO:tasks.workunit.client.0.smithi049.stdout:4/729: truncate de/d1b/d5e/d72/d73/d84/d4b/f7d 1590874 0 2024-04-26T10:44:31.354 INFO:tasks.workunit.client.0.smithi049.stdout:0/693: rename d8/db/d11/d1c/dbb/dc1/ff2 to d8/db/d26/d39/ff3 0 2024-04-26T10:44:31.355 INFO:tasks.workunit.client.0.smithi049.stdout:8/721: mkdir d2/d17/d34/d40/d64/dcd/df0 0 2024-04-26T10:44:31.355 INFO:tasks.workunit.client.0.smithi049.stdout:3/560: mknod d3/d23/d2f/d6a/d6b/d26/d58/cbd 0 2024-04-26T10:44:31.356 INFO:tasks.workunit.client.0.smithi049.stdout:9/789: mknod d2/d1a/d42/de3/cff 0 2024-04-26T10:44:31.357 INFO:tasks.workunit.client.0.smithi049.stdout:4/730: dread - de/d1b/d5e/d72/d73/d84/f7e zero size 2024-04-26T10:44:31.357 INFO:tasks.workunit.client.0.smithi049.stdout:2/628: link d6/d32/d4a/c56 d6/d9/d5f/dba/d35/d91/cc0 0 2024-04-26T10:44:31.358 INFO:tasks.workunit.client.0.smithi049.stdout:7/703: getdents d2/dab 0 2024-04-26T10:44:31.358 INFO:tasks.workunit.client.0.smithi049.stdout:6/607: dwrite da/dd/d62/d9d/fb9 [0,4194304] 0 2024-04-26T10:44:31.359 INFO:tasks.workunit.client.0.smithi049.stdout:9/790: symlink d2/d1a/l100 0 2024-04-26T10:44:31.360 INFO:tasks.workunit.client.0.smithi049.stdout:3/561: creat d3/d23/d2f/d6a/d6b/d26/d65/dae/fbe x:0 0 0 2024-04-26T10:44:31.361 INFO:tasks.workunit.client.0.smithi049.stdout:4/731: mknod de/d3f/d52/d9b/d9e/ce0 0 2024-04-26T10:44:31.361 INFO:tasks.workunit.client.0.smithi049.stdout:7/704: rmdir d2/dd/d7f/db1 39 2024-04-26T10:44:31.362 INFO:tasks.workunit.client.0.smithi049.stdout:9/791: unlink d2/d1a/df/l3b 0 2024-04-26T10:44:31.362 INFO:tasks.workunit.client.0.smithi049.stdout:1/586: getdents d1e/d20/d4d 0 2024-04-26T10:44:31.362 INFO:tasks.workunit.client.0.smithi049.stdout:7/705: stat d2/f92 0 2024-04-26T10:44:31.366 INFO:tasks.workunit.client.0.smithi049.stdout:1/587: write d1e/d62/f8b [47434,122383] 0 2024-04-26T10:44:31.366 INFO:tasks.workunit.client.0.smithi049.stdout:0/694: dwrite d8/db/fd8 [0,4194304] 0 2024-04-26T10:44:31.368 INFO:tasks.workunit.client.0.smithi049.stdout:4/732: symlink de/d3f/d52/d9b/d9e/db2/le1 0 2024-04-26T10:44:31.369 INFO:tasks.workunit.client.0.smithi049.stdout:8/722: dwrite d2/df/d10/f9d [0,4194304] 0 2024-04-26T10:44:31.369 INFO:tasks.workunit.client.0.smithi049.stdout:7/706: creat d2/fef x:0 0 0 2024-04-26T10:44:31.369 INFO:teuthology.orchestra.run.smithi049.stderr:nodeep-scrub is unset 2024-04-26T10:44:31.370 INFO:tasks.workunit.client.0.smithi049.stdout:0/695: mknod d8/db/d11/d1b/d4d/cf4 0 2024-04-26T10:44:31.371 INFO:tasks.workunit.client.0.smithi049.stdout:4/733: chown de/d1b/d5e/ld4 748312 1 2024-04-26T10:44:31.374 INFO:tasks.workunit.client.0.smithi049.stdout:2/629: dwrite d6/d9/d5f/dba/d1e/f21 [0,4194304] 0 2024-04-26T10:44:31.374 INFO:tasks.workunit.client.0.smithi049.stdout:1/588: creat d1e/d62/fb5 x:0 0 0 2024-04-26T10:44:31.375 INFO:tasks.workunit.client.0.smithi049.stdout:8/723: mknod d2/d17/cf1 0 2024-04-26T10:44:31.375 INFO:tasks.workunit.client.0.smithi049.stdout:5/659: dread d7/d1d/d1f/d4e/d80/fb1 [0,4194304] 0 2024-04-26T10:44:31.375 INFO:tasks.workunit.client.0.smithi049.stdout:6/608: dwrite da/dd/de/d26/fbb [0,4194304] 0 2024-04-26T10:44:31.377 INFO:tasks.workunit.client.0.smithi049.stdout:9/792: rename d2/d1a/d1b/d1f/d64/fb3 to d2/d25/d60/da4/dde/f101 0 2024-04-26T10:44:31.378 INFO:tasks.workunit.client.0.smithi049.stdout:4/734: mknod de/d1b/d5e/d72/d73/d84/d24/d50/ce2 0 2024-04-26T10:44:31.379 INFO:tasks.workunit.client.0.smithi049.stdout:2/630: symlink d6/d9/d5f/dba/d35/d91/lc1 0 2024-04-26T10:44:31.379 INFO:tasks.workunit.client.0.smithi049.stdout:8/724: symlink d2/d16/d19/de7/lf2 0 2024-04-26T10:44:31.380 INFO:tasks.workunit.client.0.smithi049.stdout:9/793: creat d2/d1a/d42/de3/f102 x:0 0 0 2024-04-26T10:44:31.381 INFO:tasks.workunit.client.0.smithi049.stdout:2/631: dread - d6/d9/d5f/dba/f70 zero size 2024-04-26T10:44:31.381 INFO:tasks.workunit.client.0.smithi049.stdout:1/589: rename d1e/d20/l3e to d1e/d20/d26/d3c/d54/d59/d68/lb6 0 2024-04-26T10:44:31.383 INFO:tasks.workunit.client.0.smithi049.stdout:0/696: dwrite d8/db/fd8 [4194304,4194304] 0 2024-04-26T10:44:31.384 INFO:tasks.workunit.client.0.smithi049.stdout:4/735: truncate de/d1b/d5e/d72/d73/d88/f89 4646180 0 2024-04-26T10:44:31.384 INFO:tasks.workunit.client.0.smithi049.stdout:5/660: dwrite d7/d66/fbb [0,4194304] 0 2024-04-26T10:44:31.385 INFO:tasks.workunit.client.0.smithi049.stdout:2/632: write d6/d9/f6b [246007,26729] 0 2024-04-26T10:44:31.385 INFO:tasks.workunit.client.0.smithi049.stdout:1/590: truncate d1e/d62/f8b 445280 0 2024-04-26T10:44:31.386 INFO:tasks.workunit.client.0.smithi049.stdout:5/661: chown d7/d1d 34 1 2024-04-26T10:44:31.386 INFO:tasks.workunit.client.0.smithi049.stdout:7/707: truncate d2/dd/d25/d27/f57 419691 0 2024-04-26T10:44:31.387 INFO:tasks.workunit.client.0.smithi049.stdout:5/662: readlink d7/d53/l67 0 2024-04-26T10:44:31.388 INFO:tasks.workunit.client.0.smithi049.stdout:0/697: truncate d8/db/d26/f97 1294469 0 2024-04-26T10:44:31.389 INFO:tasks.workunit.client.0.smithi049.stdout:7/708: creat d2/dd/d25/ff0 x:0 0 0 2024-04-26T10:44:31.390 INFO:tasks.workunit.client.0.smithi049.stdout:5/663: mkdir d7/d1d/d1f/d4e/d65/d6f/d91/d106 0 2024-04-26T10:44:31.390 INFO:tasks.workunit.client.0.smithi049.stdout:7/709: mkdir d2/dd/d25/d27/df1 0 2024-04-26T10:44:31.390 INFO:tasks.workunit.client.0.smithi049.stdout:9/794: dwrite d2/d1a/d1b/d1f/fda [0,4194304] 0 2024-04-26T10:44:31.392 INFO:tasks.workunit.client.0.smithi049.stdout:7/710: creat d2/d3/dcf/ff2 x:0 0 0 2024-04-26T10:44:31.392 INFO:tasks.workunit.client.0.smithi049.stdout:5/664: getdents d7/dc6/df7 0 2024-04-26T10:44:31.392 INFO:tasks.workunit.client.0.smithi049.stdout:9/795: mkdir d2/d25/d60/da4/d103 0 2024-04-26T10:44:31.393 INFO:tasks.workunit.client.0.smithi049.stdout:8/725: dread d2/df/d10/d47/faa [0,4194304] 0 2024-04-26T10:44:31.394 INFO:tasks.workunit.client.0.smithi049.stdout:5/665: symlink d7/d1d/d1f/d95/l107 0 2024-04-26T10:44:31.394 INFO:tasks.workunit.client.0.smithi049.stdout:0/698: read d8/d1e/f2b [3021869,40018] 0 2024-04-26T10:44:31.394 INFO:tasks.workunit.client.0.smithi049.stdout:4/736: dwrite de/d1b/f34 [4194304,4194304] 0 2024-04-26T10:44:31.395 INFO:tasks.workunit.client.0.smithi049.stdout:0/699: write d8/d66/fb4 [915703,98567] 0 2024-04-26T10:44:31.397 INFO:tasks.workunit.client.0.smithi049.stdout:4/737: write de/d1b/d5e/d72/d73/d84/f35 [15364498,57911] 0 2024-04-26T10:44:31.397 INFO:tasks.workunit.client.0.smithi049.stdout:9/796: rename d2/d1a/df/f87 to d2/d1a/df/ddb/f104 0 2024-04-26T10:44:31.397 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:31.395+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:31.398 INFO:tasks.workunit.client.0.smithi049.stdout:9/797: symlink d2/d40/db2/l105 0 2024-04-26T10:44:31.399 INFO:tasks.workunit.client.0.smithi049.stdout:7/711: dwrite d2/dd/d48/f8f [0,4194304] 0 2024-04-26T10:44:31.399 INFO:tasks.workunit.client.0.smithi049.stdout:2/633: read d6/d9/d5f/dba/d1e/f81 [2848525,44427] 0 2024-04-26T10:44:31.399 INFO:tasks.workunit.client.0.smithi049.stdout:0/700: creat d8/db/d11/d1b/d4d/dae/ff5 x:0 0 0 2024-04-26T10:44:31.399 INFO:tasks.workunit.client.0.smithi049.stdout:5/666: getdents d7/d1d/d1f/d4e/dad/db3 0 2024-04-26T10:44:31.402 INFO:tasks.workunit.client.0.smithi049.stdout:5/667: symlink d7/d66/l108 0 2024-04-26T10:44:31.402 INFO:tasks.workunit.client.0.smithi049.stdout:2/634: dread - d6/d9/d5f/f96 zero size 2024-04-26T10:44:31.405 INFO:tasks.workunit.client.0.smithi049.stdout:7/712: mkdir d2/dd/d48/df3 0 2024-04-26T10:44:31.405 INFO:tasks.workunit.client.0.smithi049.stdout:8/726: dwrite d2/d89/d2a/f2b [0,4194304] 0 2024-04-26T10:44:31.405 INFO:tasks.workunit.client.0.smithi049.stdout:7/713: dread - d2/dd/d7f/db1/fb5 zero size 2024-04-26T10:44:31.405 INFO:tasks.workunit.client.0.smithi049.stdout:0/701: truncate d8/db/d11/d1c/dbb/dc1/dd7/de3/ff1 678524 0 2024-04-26T10:44:31.405 INFO:tasks.workunit.client.0.smithi049.stdout:5/668: getdents d7/d1d/d1f/d4e/d65 0 2024-04-26T10:44:31.405 INFO:tasks.workunit.client.0.smithi049.stdout:8/727: getdents d2/d17/de1 0 2024-04-26T10:44:31.405 INFO:tasks.workunit.client.0.smithi049.stdout:7/714: creat d2/dd/d38/ff4 x:0 0 0 2024-04-26T10:44:31.406 INFO:tasks.workunit.client.0.smithi049.stdout:8/728: symlink d2/d16/d19/d42/daf/lf3 0 2024-04-26T10:44:31.406 INFO:tasks.workunit.client.0.smithi049.stdout:7/715: mkdir d2/dd/dd3/df5 0 2024-04-26T10:44:31.406 INFO:tasks.workunit.client.0.smithi049.stdout:0/702: creat d8/db/d11/d1b/d4d/dae/ff6 x:0 0 0 2024-04-26T10:44:31.406 INFO:tasks.workunit.client.0.smithi049.stdout:0/703: dread - d8/d1e/fd2 zero size 2024-04-26T10:44:31.407 INFO:tasks.workunit.client.0.smithi049.stdout:7/716: fdatasync d2/dd/d48/d5c/faa 0 2024-04-26T10:44:31.407 INFO:tasks.workunit.client.0.smithi049.stdout:8/729: symlink d2/d17/lf4 0 2024-04-26T10:44:31.407 INFO:tasks.workunit.client.0.smithi049.stdout:5/669: rename d7/d1d/d1f/d4e/d65/d6f/lf0 to d7/d1d/d1f/d4e/dad/db3/l109 0 2024-04-26T10:44:31.408 INFO:tasks.workunit.client.0.smithi049.stdout:0/704: write d8/db/d11/f83 [1824441,44454] 0 2024-04-26T10:44:31.408 INFO:tasks.workunit.client.0.smithi049.stdout:9/798: dwrite d2/d1a/df/ddb/fbd [0,4194304] 0 2024-04-26T10:44:31.409 INFO:tasks.workunit.client.0.smithi049.stdout:5/670: unlink d7/d14/cba 0 2024-04-26T10:44:31.409 INFO:tasks.workunit.client.0.smithi049.stdout:7/717: creat d2/dd/d48/da3/ff6 x:0 0 0 2024-04-26T10:44:31.409 INFO:tasks.workunit.client.0.smithi049.stdout:9/799: fsync d2/d1a/ffb 0 2024-04-26T10:44:31.411 INFO:tasks.workunit.client.0.smithi049.stdout:5/671: unlink d7/f74 0 2024-04-26T10:44:31.411 INFO:tasks.workunit.client.0.smithi049.stdout:4/738: write de/d1b/f40 [3907610,31510] 0 2024-04-26T10:44:31.411 INFO:tasks.workunit.client.0.smithi049.stdout:0/705: creat d8/db/d11/d1c/dbb/db0/ff7 x:0 0 0 2024-04-26T10:44:31.411 INFO:tasks.workunit.client.0.smithi049.stdout:7/718: link d2/dd/f3f d2/dab/de7/ff7 0 2024-04-26T10:44:31.411 INFO:tasks.workunit.client.0.smithi049.stdout:3/562: dread d3/d23/d2f/d6a/d6b/d8/f57 [0,4194304] 0 2024-04-26T10:44:31.412 INFO:tasks.workunit.client.0.smithi049.stdout:5/672: mknod d7/d1d/d1f/d4e/da0/c10a 0 2024-04-26T10:44:31.412 INFO:tasks.workunit.client.0.smithi049.stdout:0/706: unlink d8/db/d11/d1b/d4d/f87 0 2024-04-26T10:44:31.413 INFO:tasks.workunit.client.0.smithi049.stdout:5/673: unlink d7/d1d/d34/cf8 0 2024-04-26T10:44:31.415 INFO:tasks.workunit.client.0.smithi049.stdout:5/674: fdatasync d7/d1d/d34/f8e 0 2024-04-26T10:44:31.415 INFO:tasks.workunit.client.0.smithi049.stdout:0/707: rename d8/db/d11/d1c/dbb/db0/ce8 to d8/d1e/d98/cf8 0 2024-04-26T10:44:31.415 INFO:tasks.workunit.client.0.smithi049.stdout:5/675: mknod d7/d14/d18/d48/c10b 0 2024-04-26T10:44:31.416 INFO:tasks.workunit.client.0.smithi049.stdout:0/708: unlink d8/db/d11/d1c/f47 0 2024-04-26T10:44:31.416 INFO:tasks.workunit.client.0.smithi049.stdout:7/719: dwrite d2/dd/f14 [0,4194304] 0 2024-04-26T10:44:31.417 INFO:tasks.workunit.client.0.smithi049.stdout:0/709: truncate d8/d66/d84/fd3 84502 0 2024-04-26T10:44:31.418 INFO:tasks.workunit.client.0.smithi049.stdout:7/720: write d2/dd/d48/d5c/fd4 [821741,72586] 0 2024-04-26T10:44:31.418 INFO:tasks.workunit.client.0.smithi049.stdout:3/563: read d3/d23/d2f/d6a/d6b/d8/f88 [3336758,48193] 0 2024-04-26T10:44:31.419 INFO:tasks.workunit.client.0.smithi049.stdout:7/721: getdents d2/dd/d48/da3/dda 0 2024-04-26T10:44:31.419 INFO:tasks.workunit.client.0.smithi049.stdout:3/564: dread - d3/d23/d2f/d6a/d6b/d8/faf zero size 2024-04-26T10:44:31.421 INFO:tasks.workunit.client.0.smithi049.stdout:3/565: stat d3/d23/d2f/d6a/d6b/d8/d55/d46/f94 0 2024-04-26T10:44:31.421 INFO:tasks.workunit.client.0.smithi049.stdout:0/710: dread d8/db/fa0 [0,4194304] 0 2024-04-26T10:44:31.422 INFO:tasks.workunit.client.0.smithi049.stdout:0/711: mkdir d8/db/d11/d1c/dbb/db0/df9 0 2024-04-26T10:44:31.423 INFO:tasks.workunit.client.0.smithi049.stdout:3/566: getdents d3/d23/d2f/d6a/d6b 0 2024-04-26T10:44:31.424 INFO:tasks.workunit.client.0.smithi049.stdout:4/739: truncate de/d1b/d5e/d72/d73/d88/f89 4286535 0 2024-04-26T10:44:31.426 INFO:tasks.workunit.client.0.smithi049.stdout:7/722: dwrite d2/dd/d7f/db1/fb9 [0,4194304] 0 2024-04-26T10:44:31.426 INFO:tasks.workunit.client.0.smithi049.stdout:6/609: dread da/dd/de/d42/d5a/f65 [0,4194304] 0 2024-04-26T10:44:31.426 INFO:tasks.workunit.client.0.smithi049.stdout:0/712: getdents d8/db/d93/d96 0 2024-04-26T10:44:31.426 INFO:tasks.workunit.client.0.smithi049.stdout:3/567: chown d3/d23/d2f/d6a/d6b/d8/d55/d46/lba 8 1 2024-04-26T10:44:31.427 INFO:tasks.workunit.client.0.smithi049.stdout:4/740: getdents de/d1b/d5e/da2 0 2024-04-26T10:44:31.427 INFO:tasks.workunit.client.0.smithi049.stdout:7/723: creat d2/dd/d45/ff8 x:0 0 0 2024-04-26T10:44:31.427 INFO:tasks.workunit.client.0.smithi049.stdout:6/610: creat da/dd/d62/fce x:0 0 0 2024-04-26T10:44:31.428 INFO:tasks.workunit.client.0.smithi049.stdout:3/568: symlink d3/d23/d2f/d6a/d6b/d8/d87/lbf 0 2024-04-26T10:44:31.430 INFO:tasks.workunit.client.0.smithi049.stdout:3/569: dread - d3/d23/d2f/d6a/d6b/d8/d34/fbb zero size 2024-04-26T10:44:31.431 INFO:tasks.workunit.client.0.smithi049.stdout:5/676: truncate d7/d14/d18/f6e 200551 0 2024-04-26T10:44:31.432 INFO:tasks.workunit.client.0.smithi049.stdout:1/591: dread d1e/f31 [0,4194304] 0 2024-04-26T10:44:31.432 INFO:tasks.workunit.client.0.smithi049.stdout:0/713: dwrite d8/db/d93/fc0 [0,4194304] 0 2024-04-26T10:44:31.433 INFO:tasks.workunit.client.0.smithi049.stdout:8/730: dread d2/df/f36 [0,4194304] 0 2024-04-26T10:44:31.433 INFO:tasks.workunit.client.0.smithi049.stdout:6/611: write da/dd/d47/f79 [1167703,64854] 0 2024-04-26T10:44:31.434 INFO:tasks.workunit.client.0.smithi049.stdout:1/592: unlink d1e/d20/d26/d3c/d96/fa1 0 2024-04-26T10:44:31.435 INFO:tasks.workunit.client.0.smithi049.stdout:0/714: creat d8/db/d26/daf/ffa x:0 0 0 2024-04-26T10:44:31.436 INFO:tasks.workunit.client.0.smithi049.stdout:5/677: write d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d60/f7a [2356335,4513] 0 2024-04-26T10:44:31.436 INFO:tasks.workunit.client.0.smithi049.stdout:1/593: chown l13 13 1 2024-04-26T10:44:31.438 INFO:tasks.workunit.client.0.smithi049.stdout:8/731: getdents d2/d16/d19/dd9 0 2024-04-26T10:44:31.438 INFO:tasks.workunit.client.0.smithi049.stdout:4/741: dwrite de/d1b/d5e/d99/fc0 [0,4194304] 0 2024-04-26T10:44:31.438 INFO:tasks.workunit.client.0.smithi049.stdout:6/612: mkdir da/dd/d47/da3/dcb/dcf 0 2024-04-26T10:44:31.438 INFO:tasks.workunit.client.0.smithi049.stdout:5/678: chown d7/fab 97350 1 2024-04-26T10:44:31.438 INFO:tasks.workunit.client.0.smithi049.stdout:7/724: dwrite d2/d3/de/d1c/f94 [0,4194304] 0 2024-04-26T10:44:31.438 INFO:tasks.workunit.client.0.smithi049.stdout:0/715: symlink d8/lfb 0 2024-04-26T10:44:31.438 INFO:tasks.workunit.client.0.smithi049.stdout:8/732: mknod d2/d89/cf5 0 2024-04-26T10:44:31.439 INFO:tasks.workunit.client.0.smithi049.stdout:4/742: fsync de/d1b/d5e/d72/d73/d84/d38/f46 0 2024-04-26T10:44:31.440 INFO:tasks.workunit.client.0.smithi049.stdout:1/594: creat d1e/d20/d26/d3c/d54/d59/d73/dab/fb7 x:0 0 0 2024-04-26T10:44:31.440 INFO:tasks.workunit.client.0.smithi049.stdout:0/716: creat d8/db/d11/d1c/ffc x:0 0 0 2024-04-26T10:44:31.441 INFO:tasks.workunit.client.0.smithi049.stdout:8/733: chown d2/f12 11977 1 2024-04-26T10:44:31.441 INFO:tasks.workunit.client.0.smithi049.stdout:5/679: readlink d7/d1d/d1f/d4e/d65/d6f/l9e 0 2024-04-26T10:44:31.441 INFO:tasks.workunit.client.0.smithi049.stdout:7/725: write d2/dd/d38/fa1 [73380,9285] 0 2024-04-26T10:44:31.441 INFO:tasks.workunit.client.0.smithi049.stdout:0/717: write d8/db/d11/d1c/f48 [787989,67137] 0 2024-04-26T10:44:31.443 INFO:tasks.workunit.client.0.smithi049.stdout:3/570: write d3/d23/d2f/d6a/d6b/d8/d55/d2e/f4c [3086687,57050] 0 2024-04-26T10:44:31.443 INFO:tasks.workunit.client.0.smithi049.stdout:4/743: fsync de/d1b/d5e/d72/d73/d84/d38/f58 0 2024-04-26T10:44:31.443 INFO:tasks.workunit.client.0.smithi049.stdout:7/726: getdents d2/dd/dd3/df5 0 2024-04-26T10:44:31.443 INFO:tasks.workunit.client.0.smithi049.stdout:0/718: write d8/db/fb6 [1502977,28078] 0 2024-04-26T10:44:31.444 INFO:tasks.workunit.client.0.smithi049.stdout:4/744: chown de/d1b/d5e/d72/d73/d84/d4b 1 1 2024-04-26T10:44:31.445 INFO:tasks.workunit.client.0.smithi049.stdout:3/571: creat d3/d23/d2f/d6a/d6b/d8c/fc0 x:0 0 0 2024-04-26T10:44:31.445 INFO:tasks.workunit.client.0.smithi049.stdout:7/727: truncate d2/dd/dd3/fd7 4545492 0 2024-04-26T10:44:31.446 INFO:tasks.workunit.client.0.smithi049.stdout:0/719: creat d8/db/d11/d1b/d4d/dae/dc5/ffd x:0 0 0 2024-04-26T10:44:31.446 INFO:tasks.workunit.client.0.smithi049.stdout:4/745: mkdir de/d3f/d48/de3 0 2024-04-26T10:44:31.447 INFO:tasks.workunit.client.0.smithi049.stdout:9/800: dread d2/d1a/d42/f67 [0,4194304] 0 2024-04-26T10:44:31.448 INFO:tasks.workunit.client.0.smithi049.stdout:6/613: dread da/dd/de/f75 [0,4194304] 0 2024-04-26T10:44:31.450 INFO:tasks.workunit.client.0.smithi049.stdout:7/728: write d2/f92 [720520,66006] 0 2024-04-26T10:44:31.450 INFO:tasks.workunit.client.0.smithi049.stdout:0/720: creat d8/db/d93/d96/ffe x:0 0 0 2024-04-26T10:44:31.451 INFO:tasks.workunit.client.0.smithi049.stdout:1/595: dwrite d1e/d20/d26/d3c/f4f [0,4194304] 0 2024-04-26T10:44:31.451 INFO:tasks.workunit.client.0.smithi049.stdout:8/734: dwrite d2/d1a/fc1 [0,4194304] 0 2024-04-26T10:44:31.451 INFO:tasks.workunit.client.0.smithi049.stdout:9/801: chown d2/d1a/df/c48 74288 1 2024-04-26T10:44:31.451 INFO:tasks.workunit.client.0.smithi049.stdout:5/680: write d7/f64 [1343726,124693] 0 2024-04-26T10:44:31.451 INFO:tasks.workunit.client.0.smithi049.stdout:4/746: write de/d3f/d52/d9b/f6b [3535453,86874] 0 2024-04-26T10:44:31.452 INFO:tasks.workunit.client.0.smithi049.stdout:8/735: creat d2/d16/d19/de7/ff6 x:0 0 0 2024-04-26T10:44:31.452 INFO:tasks.workunit.client.0.smithi049.stdout:9/802: chown d2/d1a/df/c48 27 1 2024-04-26T10:44:31.452 INFO:tasks.workunit.client.0.smithi049.stdout:1/596: mknod d1e/d20/d26/d37/d8e/d97/cb8 0 2024-04-26T10:44:31.453 INFO:tasks.workunit.client.0.smithi049.stdout:3/572: dread d3/f40 [0,4194304] 0 2024-04-26T10:44:31.453 INFO:tasks.workunit.client.0.smithi049.stdout:4/747: chown de/d1b/d5e/d72/d73/d84/d4b/l5f 63582120 1 2024-04-26T10:44:31.453 INFO:tasks.workunit.client.0.smithi049.stdout:7/729: getdents d2/dd/d45/da5 0 2024-04-26T10:44:31.454 INFO:tasks.workunit.client.0.smithi049.stdout:5/681: mknod d7/d1d/d1f/d4e/dad/db3/c10c 0 2024-04-26T10:44:31.454 INFO:tasks.workunit.client.0.smithi049.stdout:6/614: getdents da/dd/d47/d7b/d84/daa 0 2024-04-26T10:44:31.454 INFO:tasks.workunit.client.0.smithi049.stdout:8/736: fdatasync d2/d1a/f3e 0 2024-04-26T10:44:31.455 INFO:tasks.workunit.client.0.smithi049.stdout:1/597: write d1e/d20/d26/d3c/d54/d59/f5e [563722,41917] 0 2024-04-26T10:44:31.456 INFO:tasks.workunit.client.0.smithi049.stdout:4/748: getdents de/d1b/d5e/d90 0 2024-04-26T10:44:31.457 INFO:tasks.workunit.client.0.smithi049.stdout:7/730: getdents d2/d3/dcf 0 2024-04-26T10:44:31.458 INFO:tasks.workunit.client.0.smithi049.stdout:0/721: dread d8/db/d26/d39/fa4 [0,4194304] 0 2024-04-26T10:44:31.458 INFO:tasks.workunit.client.0.smithi049.stdout:8/737: fdatasync d2/d89/d2a/d9f/fbc 0 2024-04-26T10:44:31.458 INFO:tasks.workunit.client.0.smithi049.stdout:5/682: mkdir d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d60/d10d 0 2024-04-26T10:44:31.459 INFO:tasks.workunit.client.0.smithi049.stdout:9/803: dwrite d2/d25/f6b [0,4194304] 0 2024-04-26T10:44:31.459 INFO:tasks.workunit.client.0.smithi049.stdout:3/573: rename d3/d23/d2f/d6a/d6b/d8/d55/d46/ca5 to d3/d23/d2f/d6a/d6b/d8/cc1 0 2024-04-26T10:44:31.459 INFO:tasks.workunit.client.0.smithi049.stdout:4/749: symlink de/d3f/d48/de3/le4 0 2024-04-26T10:44:31.460 INFO:tasks.workunit.client.0.smithi049.stdout:3/574: fdatasync d3/d23/d2f/d6a/d6b/d8/d55/d2e/f31 0 2024-04-26T10:44:31.460 INFO:tasks.workunit.client.0.smithi049.stdout:1/598: symlink d1e/d20/d26/d3c/d96/da3/lb9 0 2024-04-26T10:44:31.461 INFO:tasks.workunit.client.0.smithi049.stdout:0/722: mkdir d8/db/d93/d96/d9b/dff 0 2024-04-26T10:44:31.461 INFO:tasks.workunit.client.0.smithi049.stdout:8/738: write d2/df/d10/d23/d6c/d5e/fa4 [146056,85868] 0 2024-04-26T10:44:31.461 INFO:tasks.workunit.client.0.smithi049.stdout:7/731: creat d2/d3/d96/db3/ff9 x:0 0 0 2024-04-26T10:44:31.461 INFO:tasks.workunit.client.0.smithi049.stdout:5/683: mkdir d7/d1d/d1f/d4e/d65/d6f/d91/d106/d10e 0 2024-04-26T10:44:31.461 INFO:tasks.workunit.client.0.smithi049.stdout:9/804: unlink d2/d1a/df/l5c 0 2024-04-26T10:44:31.462 INFO:tasks.workunit.client.0.smithi049.stdout:7/732: fsync d2/d3/d96/fb4 0 2024-04-26T10:44:31.463 INFO:tasks.workunit.client.0.smithi049.stdout:2/635: sync 2024-04-26T10:44:31.463 INFO:tasks.workunit.client.0.smithi049.stdout:5/684: chown d7/d1d/d1f/d4e/d65/d6f/d91/fee 72476 1 2024-04-26T10:44:31.463 INFO:tasks.workunit.client.0.smithi049.stdout:0/723: creat d8/db/f100 x:0 0 0 2024-04-26T10:44:31.464 INFO:tasks.workunit.client.0.smithi049.stdout:5/685: write d7/f81 [2825273,36072] 0 2024-04-26T10:44:31.464 INFO:tasks.workunit.client.0.smithi049.stdout:9/805: truncate d2/d1a/df/f56 368465 0 2024-04-26T10:44:31.466 INFO:tasks.workunit.client.0.smithi049.stdout:7/733: getdents d2/d3/de 0 2024-04-26T10:44:31.466 INFO:tasks.workunit.client.0.smithi049.stdout:2/636: getdents d6/d9/d5f 0 2024-04-26T10:44:31.469 INFO:tasks.workunit.client.0.smithi049.stdout:0/724: creat d8/db/d11/d1c/dbb/dc1/dd7/de3/f101 x:0 0 0 2024-04-26T10:44:31.470 INFO:tasks.workunit.client.0.smithi049.stdout:7/734: mkdir d2/dd/d7f/dd1/dfa 0 2024-04-26T10:44:31.470 INFO:tasks.workunit.client.0.smithi049.stdout:9/806: rename d2/d1a/d1b/d1f/f39 to d2/d40/f106 0 2024-04-26T10:44:31.470 INFO:tasks.workunit.client.0.smithi049.stdout:3/575: dwrite d3/d23/d2f/d6a/d6b/d26/f5a [0,4194304] 0 2024-04-26T10:44:31.470 INFO:tasks.workunit.client.0.smithi049.stdout:7/735: chown d2/dd/d45/d82 3 1 2024-04-26T10:44:31.470 INFO:tasks.workunit.client.0.smithi049.stdout:6/615: write da/dd/d62/fb4 [103265,59850] 0 2024-04-26T10:44:31.471 INFO:tasks.workunit.client.0.smithi049.stdout:9/807: fsync d2/d1a/df/fe0 0 2024-04-26T10:44:31.471 INFO:tasks.workunit.client.0.smithi049.stdout:6/616: readlink da/d4a/l88 0 2024-04-26T10:44:31.471 INFO:tasks.workunit.client.0.smithi049.stdout:8/739: dwrite d2/d89/d30/f63 [0,4194304] 0 2024-04-26T10:44:31.472 INFO:tasks.workunit.client.0.smithi049.stdout:0/725: mkdir d8/db/d11/d1c/dbb/db0/d102 0 2024-04-26T10:44:31.472 INFO:tasks.workunit.client.0.smithi049.stdout:5/686: rename d7/d1d/d1f/d4e/dad/db3/ld5 to d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d60/d10d/l10f 0 2024-04-26T10:44:31.472 INFO:tasks.workunit.client.0.smithi049.stdout:9/808: chown d2/d25/d60/fa0 2 1 2024-04-26T10:44:31.473 INFO:tasks.workunit.client.0.smithi049.stdout:8/740: dread - d2/d16/d19/de7/ff6 zero size 2024-04-26T10:44:31.474 INFO:tasks.workunit.client.0.smithi049.stdout:1/599: write d1e/d20/d26/d3c/f3f [375275,115347] 0 2024-04-26T10:44:31.474 INFO:tasks.workunit.client.0.smithi049.stdout:0/726: chown d8/d66/cc3 88271689 1 2024-04-26T10:44:31.475 INFO:tasks.workunit.client.0.smithi049.stdout:8/741: chown d2/d16/d19/d42/d7c 59 1 2024-04-26T10:44:31.475 INFO:tasks.workunit.client.0.smithi049.stdout:4/750: dread de/d1b/f34 [0,4194304] 0 2024-04-26T10:44:31.476 INFO:tasks.workunit.client.0.smithi049.stdout:3/576: creat d3/d23/d2f/d6a/d6b/d26/d65/d70/d84/fc2 x:0 0 0 2024-04-26T10:44:31.476 INFO:tasks.workunit.client.0.smithi049.stdout:5/687: creat d7/d1d/d1f/d4e/d65/d6f/d91/d3e/f110 x:0 0 0 2024-04-26T10:44:31.476 INFO:tasks.workunit.client.0.smithi049.stdout:1/600: chown d1e/d20/c2c 14 1 2024-04-26T10:44:31.476 INFO:tasks.workunit.client.0.smithi049.stdout:0/727: dread - d8/db/d11/d1c/dbb/db0/fef zero size 2024-04-26T10:44:31.478 INFO:tasks.workunit.client.0.smithi049.stdout:5/688: chown d7/d66/fbb 553820 1 2024-04-26T10:44:31.479 INFO:tasks.workunit.client.0.smithi049.stdout:1/601: creat d1e/d20/d26/d3c/d54/d59/d73/fba x:0 0 0 2024-04-26T10:44:31.480 INFO:tasks.workunit.client.0.smithi049.stdout:0/728: write d8/db/d11/d1c/db8/fee [932655,38803] 0 2024-04-26T10:44:31.480 INFO:tasks.workunit.client.0.smithi049.stdout:5/689: chown d7/d1d/d1f/d4e/d65 81653446 1 2024-04-26T10:44:31.480 INFO:tasks.workunit.client.0.smithi049.stdout:7/736: dwrite d2/d3/fdb [0,4194304] 0 2024-04-26T10:44:31.480 INFO:tasks.workunit.client.0.smithi049.stdout:8/742: dread d2/d89/d2a/f54 [0,4194304] 0 2024-04-26T10:44:31.481 INFO:tasks.workunit.client.0.smithi049.stdout:1/602: write d1e/f50 [226104,76622] 0 2024-04-26T10:44:31.481 INFO:tasks.workunit.client.0.smithi049.stdout:7/737: readlink d2/dd/d25/l2e 0 2024-04-26T10:44:31.484 INFO:tasks.workunit.client.0.smithi049.stdout:5/690: unlink d7/d1d/d1f/d4e/d65/d6f/d91/c3d 0 2024-04-26T10:44:31.484 INFO:tasks.workunit.client.0.smithi049.stdout:4/751: dread de/d1b/d5e/d72/d73/f85 [0,4194304] 0 2024-04-26T10:44:31.484 INFO:tasks.workunit.client.0.smithi049.stdout:8/743: rename d2/d17/f3d to d2/d17/d34/d40/d64/ff7 0 2024-04-26T10:44:31.485 INFO:tasks.workunit.client.0.smithi049.stdout:7/738: link d2/dd/f14 d2/dd/d25/d27/ffb 0 2024-04-26T10:44:31.485 INFO:tasks.workunit.client.0.smithi049.stdout:1/603: creat d1e/d20/d26/d3c/d54/d59/fbb x:0 0 0 2024-04-26T10:44:31.486 INFO:tasks.workunit.client.0.smithi049.stdout:3/577: dwrite d3/d23/d2f/d6a/d6b/d8/d34/f44 [0,4194304] 0 2024-04-26T10:44:31.487 INFO:tasks.workunit.client.0.smithi049.stdout:8/744: symlink d2/d89/d2a/d9f/de9/lf8 0 2024-04-26T10:44:31.487 INFO:tasks.workunit.client.0.smithi049.stdout:7/739: creat d2/d3/d96/ffc x:0 0 0 2024-04-26T10:44:31.488 INFO:tasks.workunit.client.0.smithi049.stdout:1/604: creat d1e/d20/d26/d37/d6e/fbc x:0 0 0 2024-04-26T10:44:31.489 INFO:tasks.workunit.client.0.smithi049.stdout:8/745: creat d2/d17/d34/d40/d64/dcd/ff9 x:0 0 0 2024-04-26T10:44:31.489 INFO:tasks.workunit.client.0.smithi049.stdout:3/578: dread - d3/d23/d2f/d6a/d6b/d8/fad zero size 2024-04-26T10:44:31.490 INFO:tasks.workunit.client.0.smithi049.stdout:7/740: creat d2/dd/d7f/dd1/ffd x:0 0 0 2024-04-26T10:44:31.491 INFO:tasks.workunit.client.0.smithi049.stdout:1/605: mknod d1e/d20/d26/d3c/cbd 0 2024-04-26T10:44:31.491 INFO:tasks.workunit.client.0.smithi049.stdout:3/579: dread - d3/d23/d2f/d6a/f7f zero size 2024-04-26T10:44:31.492 INFO:tasks.workunit.client.0.smithi049.stdout:0/729: dwrite d8/d1e/f72 [0,4194304] 0 2024-04-26T10:44:31.493 INFO:tasks.workunit.client.0.smithi049.stdout:2/637: dread d6/d9/d5f/dba/d11/f1d [4194304,4194304] 0 2024-04-26T10:44:31.494 INFO:tasks.workunit.client.0.smithi049.stdout:5/691: dwrite d7/d1d/d1f/d4e/d77/fd4 [0,4194304] 0 2024-04-26T10:44:31.495 INFO:tasks.workunit.client.0.smithi049.stdout:0/730: creat d8/db/d26/d6f/f103 x:0 0 0 2024-04-26T10:44:31.495 INFO:tasks.workunit.client.0.smithi049.stdout:3/580: mknod d3/d23/d2f/d6a/d6b/d8/cc3 0 2024-04-26T10:44:31.495 INFO:tasks.workunit.client.0.smithi049.stdout:5/692: write d7/d14/f1b [2760996,2770] 0 2024-04-26T10:44:31.495 INFO:tasks.workunit.client.0.smithi049.stdout:0/731: write d8/d1e/d98/fe1 [199256,124319] 0 2024-04-26T10:44:31.497 INFO:tasks.workunit.client.0.smithi049.stdout:5/693: creat d7/d66/d84/f111 x:0 0 0 2024-04-26T10:44:31.497 INFO:tasks.workunit.client.0.smithi049.stdout:6/617: dread da/d4a/f37 [0,4194304] 0 2024-04-26T10:44:31.497 INFO:tasks.workunit.client.0.smithi049.stdout:4/752: truncate de/f15 3730906 0 2024-04-26T10:44:31.498 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:31.495+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:31.498 INFO:tasks.workunit.client.0.smithi049.stdout:5/694: fdatasync d7/d1d/d1f/d4e/ffd 0 2024-04-26T10:44:31.499 INFO:tasks.workunit.client.0.smithi049.stdout:6/618: creat da/d4a/fd0 x:0 0 0 2024-04-26T10:44:31.499 INFO:tasks.workunit.client.0.smithi049.stdout:0/732: link d8/db/d11/d1c/dbb/c77 d8/d42/c104 0 2024-04-26T10:44:31.499 INFO:tasks.workunit.client.0.smithi049.stdout:1/606: stat d1e/d20/d26/d3c 0 2024-04-26T10:44:31.500 INFO:tasks.workunit.client.0.smithi049.stdout:5/695: symlink d7/d1d/d1f/d4e/d65/d6f/l112 0 2024-04-26T10:44:31.503 INFO:tasks.workunit.client.0.smithi049.stdout:5/696: dwrite d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d60/faa [0,4194304] 0 2024-04-26T10:44:31.504 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:31.504 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:31.508 INFO:tasks.workunit.client.0.smithi049.stdout:1/607: symlink d1e/d20/d26/d57/lbe 0 2024-04-26T10:44:31.508 INFO:tasks.workunit.client.0.smithi049.stdout:5/697: mknod d7/d1d/d1f/d4e/d65/d6f/d91/d106/d10e/c113 0 2024-04-26T10:44:31.508 INFO:tasks.workunit.client.0.smithi049.stdout:3/581: truncate d3/d6/f10 2844758 0 2024-04-26T10:44:31.508 INFO:tasks.workunit.client.0.smithi049.stdout:6/619: rmdir da/d4a 39 2024-04-26T10:44:31.508 INFO:tasks.workunit.client.0.smithi049.stdout:4/753: write de/d1b/d5e/d72/d73/d84/d38/f58 [365021,91035] 0 2024-04-26T10:44:31.509 INFO:tasks.workunit.client.0.smithi049.stdout:6/620: chown da/dd/d47/d7b/fa4 71733 1 2024-04-26T10:44:31.509 INFO:tasks.workunit.client.0.smithi049.stdout:4/754: chown de/d3f/d48/ld3 39499507 1 2024-04-26T10:44:31.510 INFO:tasks.workunit.client.0.smithi049.stdout:1/608: truncate d1e/d20/d26/d57/fa2 783852 0 2024-04-26T10:44:31.510 INFO:tasks.workunit.client.0.smithi049.stdout:1/609: fdatasync f16 0 2024-04-26T10:44:31.511 INFO:tasks.workunit.client.0.smithi049.stdout:5/698: dread d7/d1d/d1f/f29 [0,4194304] 0 2024-04-26T10:44:31.511 INFO:tasks.workunit.client.0.smithi049.stdout:7/741: dread d2/dd/d25/d27/f57 [0,4194304] 0 2024-04-26T10:44:31.511 INFO:tasks.workunit.client.0.smithi049.stdout:4/755: mkdir de/d1b/d5e/d90/db1/de5 0 2024-04-26T10:44:31.512 INFO:tasks.workunit.client.0.smithi049.stdout:2/638: dwrite d6/d9/d5f/dba/d34/d38/d3f/d60/f93 [0,4194304] 0 2024-04-26T10:44:31.513 INFO:tasks.workunit.client.0.smithi049.stdout:9/809: sync 2024-04-26T10:44:31.513 INFO:tasks.workunit.client.0.smithi049.stdout:0/733: sync 2024-04-26T10:44:31.513 INFO:tasks.workunit.client.0.smithi049.stdout:5/699: dread - d7/d1d/d1f/d4e/d65/f92 zero size 2024-04-26T10:44:31.514 INFO:tasks.workunit.client.0.smithi049.stdout:6/621: rename da/dd/d47/d7b/d84/daa/lae to da/dd/de/d26/d29/ld1 0 2024-04-26T10:44:31.514 INFO:tasks.workunit.client.0.smithi049.stdout:1/610: link d1e/d20/d26/d57/lbe d1e/d20/d4d/lbf 0 2024-04-26T10:44:31.514 INFO:tasks.workunit.client.0.smithi049.stdout:2/639: dread - d6/d32/d69/f9b zero size 2024-04-26T10:44:31.515 INFO:tasks.workunit.client.0.smithi049.stdout:0/734: dread - d8/db/d11/d1b/d4d/dae/ff6 zero size 2024-04-26T10:44:31.516 INFO:tasks.workunit.client.0.smithi049.stdout:3/582: dwrite d3/d23/d2f/d6a/d6b/d26/d29/f3e [0,4194304] 0 2024-04-26T10:44:31.517 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:31.519 INFO:tasks.workunit.client.0.smithi049.stdout:8/746: sync 2024-04-26T10:44:31.519 INFO:tasks.workunit.client.0.smithi049.stdout:7/742: rename d2/dd/d25/faf to d2/d3/d96/ddc/ffe 0 2024-04-26T10:44:31.519 INFO:tasks.workunit.client.0.smithi049.stdout:5/700: getdents d7/d66 0 2024-04-26T10:44:31.519 INFO:tasks.workunit.client.0.smithi049.stdout:6/622: fsync da/dd/de/d26/f6f 0 2024-04-26T10:44:31.519 INFO:tasks.workunit.client.0.smithi049.stdout:2/640: symlink d6/d9/lc2 0 2024-04-26T10:44:31.519 INFO:tasks.workunit.client.0.smithi049.stdout:3/583: readlink d3/d23/d2f/d6a/d6b/d8/d55/l62 0 2024-04-26T10:44:31.519 INFO:tasks.workunit.client.0.smithi049.stdout:8/747: chown d2/d17/d34/d40/d7f/lec 2 1 2024-04-26T10:44:31.519 INFO:tasks.workunit.client.0.smithi049.stdout:7/743: unlink d2/dd/d45/d82/fb6 0 2024-04-26T10:44:31.520 INFO:tasks.workunit.client.0.smithi049.stdout:9/810: rename d2/d40/d53/de7/cfe to d2/d1a/d1b/d1f/d34/c107 0 2024-04-26T10:44:31.520 INFO:tasks.workunit.client.0.smithi049.stdout:6/623: fdatasync da/dd/d62/fce 0 2024-04-26T10:44:31.521 INFO:tasks.workunit.client.0.smithi049.stdout:2/641: fsync d6/d9/d5f/dba/d34/d7b/f7e 0 2024-04-26T10:44:31.521 INFO:tasks.workunit.client.0.smithi049.stdout:0/735: rename d8/db/d11/d1c/l8d to d8/db/d11/d1b/l105 0 2024-04-26T10:44:31.522 INFO:tasks.workunit.client.0.smithi049.stdout:9/811: write d2/d1a/d1b/d7a/f9b [1828330,61076] 0 2024-04-26T10:44:31.522 INFO:tasks.workunit.client.0.smithi049.stdout:6/624: write da/dd/d47/f61 [1234429,43514] 0 2024-04-26T10:44:31.523 INFO:tasks.workunit.client.0.smithi049.stdout:1/611: link d1e/d20/d26/d3c/f87 d1e/d20/d26/d3c/d54/d59/d68/fc0 0 2024-04-26T10:44:31.523 INFO:tasks.workunit.client.0.smithi049.stdout:2/642: mkdir d6/d9/d5f/dba/d11/d6a/dc3 0 2024-04-26T10:44:31.524 INFO:tasks.workunit.client.0.smithi049.stdout:9/812: mkdir d2/d1a/d1b/d1f/d108 0 2024-04-26T10:44:31.525 INFO:tasks.workunit.client.0.smithi049.stdout:7/744: link d2/d3/de/l18 d2/dd/d48/da3/dda/lff 0 2024-04-26T10:44:31.525 INFO:tasks.workunit.client.0.smithi049.stdout:0/736: creat d8/db/d93/d96/d9b/f106 x:0 0 0 2024-04-26T10:44:31.526 INFO:tasks.workunit.client.0.smithi049.stdout:9/813: readlink d2/d1a/l73 0 2024-04-26T10:44:31.526 INFO:tasks.workunit.client.0.smithi049.stdout:6/625: creat da/dd/d47/d7b/d84/fd2 x:0 0 0 2024-04-26T10:44:31.526 INFO:tasks.workunit.client.0.smithi049.stdout:2/643: mknod d6/d9/d5f/dba/d1e/cc4 0 2024-04-26T10:44:31.527 INFO:tasks.workunit.client.0.smithi049.stdout:3/584: dread d3/d23/d2f/d6a/d6b/d26/f5a [0,4194304] 0 2024-04-26T10:44:31.528 INFO:tasks.workunit.client.0.smithi049.stdout:7/745: mkdir d2/d3/de/d1c/d100 0 2024-04-26T10:44:31.528 INFO:tasks.workunit.client.0.smithi049.stdout:5/701: dwrite d7/d66/f73 [0,4194304] 0 2024-04-26T10:44:31.529 INFO:tasks.workunit.client.0.smithi049.stdout:8/748: dwrite d2/df/d10/d47/dca/fef [0,4194304] 0 2024-04-26T10:44:31.532 INFO:tasks.workunit.client.0.smithi049.stdout:3/585: mkdir d3/d6/dc4 0 2024-04-26T10:44:31.532 INFO:tasks.workunit.client.0.smithi049.stdout:2/644: rmdir d6/d9/d5f/dba/d11/d6a 39 2024-04-26T10:44:31.533 INFO:tasks.workunit.client.0.smithi049.stdout:8/749: creat d2/d16/d19/d42/deb/ffa x:0 0 0 2024-04-26T10:44:31.533 INFO:tasks.workunit.client.0.smithi049.stdout:5/702: write d7/d1d/d1f/d4e/d65/d6f/d91/d3e/f42 [7761824,59686] 0 2024-04-26T10:44:31.534 INFO:tasks.workunit.client.0.smithi049.stdout:2/645: chown d6/d9/d5f/dba/d35/faf 4667 1 2024-04-26T10:44:31.534 INFO:tasks.workunit.client.0.smithi049.stdout:9/814: dwrite d2/d1a/f38 [0,4194304] 0 2024-04-26T10:44:31.536 INFO:tasks.workunit.client.0.smithi049.stdout:9/815: fsync d2/d25/f6b 0 2024-04-26T10:44:31.536 INFO:tasks.workunit.client.0.smithi049.stdout:2/646: rename d6/d9/d5f/dba/fac to d6/d9/d5f/dba/d34/fc5 0 2024-04-26T10:44:31.538 INFO:tasks.workunit.client.0.smithi049.stdout:9/816: truncate d2/d1a/d42/f67 4718916 0 2024-04-26T10:44:31.540 INFO:tasks.workunit.client.0.smithi049.stdout:4/756: dread de/d1b/d5e/d72/d73/d88/f94 [0,4194304] 0 2024-04-26T10:44:31.540 INFO:tasks.workunit.client.0.smithi049.stdout:8/750: dwrite d2/d89/d2a/fcc [0,4194304] 0 2024-04-26T10:44:31.541 INFO:tasks.workunit.client.0.smithi049.stdout:8/751: chown d2/d16/d19/de7 4 1 2024-04-26T10:44:31.542 INFO:tasks.workunit.client.0.smithi049.stdout:5/703: dwrite d7/d1d/d1f/d4e/d65/d6f/d91/d3e/fa7 [0,4194304] 0 2024-04-26T10:44:31.542 INFO:tasks.workunit.client.0.smithi049.stdout:8/752: mkdir d2/d16/d88/dfb 0 2024-04-26T10:44:31.543 INFO:tasks.workunit.client.0.smithi049.stdout:5/704: dread - d7/d1d/d1f/d4e/f104 zero size 2024-04-26T10:44:31.543 INFO:tasks.workunit.client.0.smithi049.stdout:8/753: getdents d2/df/dab 0 2024-04-26T10:44:31.544 INFO:tasks.workunit.client.0.smithi049.stdout:8/754: chown d2/d89 503 1 2024-04-26T10:44:31.545 INFO:tasks.workunit.client.0.smithi049.stdout:8/755: read - d2/d16/d19/d42/deb/ffa zero size 2024-04-26T10:44:31.546 INFO:tasks.workunit.client.0.smithi049.stdout:8/756: rename d2/d17/d34 to d2/d17/d34/d40/d64/dcd/dfc 22 2024-04-26T10:44:31.547 INFO:tasks.workunit.client.0.smithi049.stdout:4/757: dwrite de/d1b/f40 [4194304,4194304] 0 2024-04-26T10:44:31.550 INFO:tasks.workunit.client.0.smithi049.stdout:4/758: unlink de/d1b/d5e/d72/d73/d84/l3a 0 2024-04-26T10:44:31.551 INFO:tasks.workunit.client.0.smithi049.stdout:4/759: symlink de/d1b/d5e/d72/d73/d84/d4b/da4/le6 0 2024-04-26T10:44:31.552 INFO:tasks.workunit.client.0.smithi049.stdout:4/760: chown de/d3f/d52/d9b/d9e/cc3 414 1 2024-04-26T10:44:31.552 INFO:tasks.workunit.client.0.smithi049.stdout:8/757: dwrite d2/df/d10/d47/d75/f7d [0,4194304] 0 2024-04-26T10:44:31.557 INFO:tasks.workunit.client.0.smithi049.stdout:0/737: dread d8/db/f25 [0,4194304] 0 2024-04-26T10:44:31.558 INFO:tasks.workunit.client.0.smithi049.stdout:0/738: write d8/d1e/d98/fe1 [265149,10085] 0 2024-04-26T10:44:31.559 INFO:tasks.workunit.client.0.smithi049.stdout:2/647: dread d6/d9/f19 [0,4194304] 0 2024-04-26T10:44:31.559 INFO:tasks.workunit.client.0.smithi049.stdout:8/758: dwrite d2/df/d10/d47/d75/fb3 [0,4194304] 0 2024-04-26T10:44:31.559 INFO:tasks.workunit.client.0.smithi049.stdout:0/739: symlink d8/db/d26/daf/l107 0 2024-04-26T10:44:31.559 INFO:tasks.workunit.client.0.smithi049.stdout:6/626: dread da/fb8 [4194304,4194304] 0 2024-04-26T10:44:31.560 INFO:tasks.workunit.client.0.smithi049.stdout:8/759: stat d2/d17/d34/dbf 0 2024-04-26T10:44:31.560 INFO:tasks.workunit.client.0.smithi049.stdout:2/648: write d6/f7d [371744,98397] 0 2024-04-26T10:44:31.560 INFO:tasks.workunit.client.0.smithi049.stdout:6/627: write da/dd/d62/f6d [1187730,115464] 0 2024-04-26T10:44:31.561 INFO:tasks.workunit.client.0.smithi049.stdout:8/760: write d2/f2f [4381790,65014] 0 2024-04-26T10:44:31.562 INFO:tasks.workunit.client.0.smithi049.stdout:6/628: mknod da/dd/cd3 0 2024-04-26T10:44:31.562 INFO:tasks.workunit.client.0.smithi049.stdout:2/649: mknod d6/d30/d97/dbe/cc6 0 2024-04-26T10:44:31.562 INFO:tasks.workunit.client.0.smithi049.stdout:8/761: truncate f1 5068210 0 2024-04-26T10:44:31.563 INFO:tasks.workunit.client.0.smithi049.stdout:2/650: readlink d6/d9/d5f/dba/d35/lbb 0 2024-04-26T10:44:31.564 INFO:tasks.workunit.client.0.smithi049.stdout:8/762: creat d2/df/d10/d23/d9a/ffd x:0 0 0 2024-04-26T10:44:31.564 INFO:tasks.workunit.client.0.smithi049.stdout:6/629: link da/d4a/fd0 da/dd/de/d26/fd4 0 2024-04-26T10:44:31.565 INFO:tasks.workunit.client.0.smithi049.stdout:2/651: symlink d6/d30/d97/dbe/lc7 0 2024-04-26T10:44:31.565 INFO:tasks.workunit.client.0.smithi049.stdout:0/740: dwrite d8/d66/f86 [0,4194304] 0 2024-04-26T10:44:31.566 INFO:tasks.workunit.client.0.smithi049.stdout:6/630: chown da/dd/d47/d7b/d84/daa/lad 862 1 2024-04-26T10:44:31.566 INFO:tasks.workunit.client.0.smithi049.stdout:2/652: mkdir d6/d30/dc8 0 2024-04-26T10:44:31.566 INFO:tasks.workunit.client.0.smithi049.stdout:0/741: creat d8/db/d11/d1c/db8/f108 x:0 0 0 2024-04-26T10:44:31.566 INFO:tasks.workunit.client.0.smithi049.stdout:8/763: write d2/d1a/d9c/fc8 [262354,47792] 0 2024-04-26T10:44:31.568 INFO:tasks.workunit.client.0.smithi049.stdout:8/764: write d2/d16/f4b [814609,105379] 0 2024-04-26T10:44:31.568 INFO:tasks.workunit.client.0.smithi049.stdout:2/653: creat d6/d9/d5f/dba/d34/d38/d3f/d60/fc9 x:0 0 0 2024-04-26T10:44:31.569 INFO:tasks.workunit.client.0.smithi049.stdout:8/765: chown d2/d89/cd7 188224 1 2024-04-26T10:44:31.570 INFO:tasks.workunit.client.0.smithi049.stdout:2/654: rename d6/d9/d5f/dba/d34/d38/c74 to d6/d32/d69/cca 0 2024-04-26T10:44:31.571 INFO:tasks.workunit.client.0.smithi049.stdout:7/746: dread d2/d3/de/d1c/f36 [0,4194304] 0 2024-04-26T10:44:31.572 INFO:tasks.workunit.client.0.smithi049.stdout:0/742: dwrite d8/d1e/f2b [0,4194304] 0 2024-04-26T10:44:31.572 INFO:tasks.workunit.client.0.smithi049.stdout:2/655: rename d6/f7d to d6/d9/d5f/dba/df/fcb 0 2024-04-26T10:44:31.573 INFO:tasks.workunit.client.0.smithi049.stdout:0/743: chown d8/db/c1f 4489 1 2024-04-26T10:44:31.573 INFO:tasks.workunit.client.0.smithi049.stdout:7/747: creat d2/dab/de7/f101 x:0 0 0 2024-04-26T10:44:31.573 INFO:tasks.workunit.client.0.smithi049.stdout:2/656: creat d6/d30/d97/fcc x:0 0 0 2024-04-26T10:44:31.574 INFO:tasks.workunit.client.0.smithi049.stdout:0/744: mkdir d8/d109 0 2024-04-26T10:44:31.575 INFO:tasks.workunit.client.0.smithi049.stdout:9/817: dread d2/d1a/f5e [0,4194304] 0 2024-04-26T10:44:31.576 INFO:tasks.workunit.client.0.smithi049.stdout:8/766: dwrite d2/d16/d19/d42/f4e [4194304,4194304] 0 2024-04-26T10:44:31.577 INFO:tasks.workunit.client.0.smithi049.stdout:9/818: read d2/d1a/d1b/d1f/d34/ff9 [391941,70699] 0 2024-04-26T10:44:31.579 INFO:tasks.workunit.client.0.smithi049.stdout:4/761: sync 2024-04-26T10:44:31.579 INFO:tasks.workunit.client.0.smithi049.stdout:6/631: sync 2024-04-26T10:44:31.580 INFO:tasks.workunit.client.0.smithi049.stdout:2/657: dwrite d6/f84 [0,4194304] 0 2024-04-26T10:44:31.581 INFO:tasks.workunit.client.0.smithi049.stdout:6/632: fsync da/dd/d47/f66 0 2024-04-26T10:44:31.581 INFO:tasks.workunit.client.0.smithi049.stdout:9/819: getdents d2/d25/d74 0 2024-04-26T10:44:31.581 INFO:tasks.workunit.client.0.smithi049.stdout:0/745: dwrite d8/db/fb6 [0,4194304] 0 2024-04-26T10:44:31.582 INFO:tasks.workunit.client.0.smithi049.stdout:9/820: write d2/d1a/fc1 [1658658,103445] 0 2024-04-26T10:44:31.582 INFO:tasks.workunit.client.0.smithi049.stdout:0/746: chown d8/db/d11/d1b/ldf 0 1 2024-04-26T10:44:31.583 INFO:tasks.workunit.client.0.smithi049.stdout:0/747: creat d8/d66/f10a x:0 0 0 2024-04-26T10:44:31.584 INFO:tasks.workunit.client.0.smithi049.stdout:0/748: readlink d8/d42/l5c 0 2024-04-26T10:44:31.584 INFO:tasks.workunit.client.0.smithi049.stdout:0/749: rmdir d8/da5 39 2024-04-26T10:44:31.589 INFO:tasks.workunit.client.0.smithi049.stdout:7/748: sync 2024-04-26T10:44:31.589 INFO:tasks.workunit.client.0.smithi049.stdout:4/762: sync 2024-04-26T10:44:31.590 INFO:tasks.workunit.client.0.smithi049.stdout:4/763: unlink de/d1b/d5e/d72/d73/fd6 0 2024-04-26T10:44:31.591 INFO:tasks.workunit.client.0.smithi049.stdout:4/764: read - de/fa0 zero size 2024-04-26T10:44:31.592 INFO:tasks.workunit.client.0.smithi049.stdout:4/765: mkdir de/d3f/d52/d9b/d9e/de7 0 2024-04-26T10:44:31.593 INFO:tasks.workunit.client.0.smithi049.stdout:7/749: dwrite d2/fc [0,4194304] 0 2024-04-26T10:44:31.595 INFO:tasks.workunit.client.0.smithi049.stdout:4/766: chown de/d1b/d5e/d72/d73/d84/d24/d5c/c93 486446382 1 2024-04-26T10:44:31.595 INFO:tasks.workunit.client.0.smithi049.stdout:8/767: dread d2/d89/d2a/d9f/fbc [0,4194304] 0 2024-04-26T10:44:31.595 INFO:tasks.workunit.client.0.smithi049.stdout:7/750: mkdir d2/dd/d38/d102 0 2024-04-26T10:44:31.595 INFO:tasks.workunit.client.0.smithi049.stdout:7/751: read - d2/fef zero size 2024-04-26T10:44:31.595 INFO:tasks.workunit.client.0.smithi049.stdout:8/768: fsync d2/d17/d34/fd6 0 2024-04-26T10:44:31.595 INFO:tasks.workunit.client.0.smithi049.stdout:4/767: fsync de/d1b/d5e/d72/d73/d88/fb7 0 2024-04-26T10:44:31.595 INFO:tasks.workunit.client.0.smithi049.stdout:7/752: fdatasync d2/dd/d7f/fbb 0 2024-04-26T10:44:31.595 INFO:tasks.workunit.client.0.smithi049.stdout:8/769: chown d2/df/d10/d23/d6c/d5e/fd4 24533081 1 2024-04-26T10:44:31.596 INFO:tasks.workunit.client.0.smithi049.stdout:4/768: rename de/d3f/l70 to de/d3f/d48/de3/le8 0 2024-04-26T10:44:31.596 INFO:tasks.workunit.client.0.smithi049.stdout:8/770: chown d2/d17/d34/d40/d64/dcd 938300 1 2024-04-26T10:44:31.597 INFO:tasks.workunit.client.0.smithi049.stdout:8/771: write d2/d89/d2a/f35 [628992,59778] 0 2024-04-26T10:44:31.597 INFO:tasks.workunit.client.0.smithi049.stdout:4/769: write de/d1b/d5e/d72/d73/d84/f7e [434815,81747] 0 2024-04-26T10:44:31.597 INFO:tasks.workunit.client.0.smithi049.stdout:8/772: fdatasync d2/d16/f9b 0 2024-04-26T10:44:31.597 INFO:tasks.workunit.client.0.smithi049.stdout:4/770: fsync de/d1b/d5e/d72/d73/f7c 0 2024-04-26T10:44:31.598 INFO:tasks.workunit.client.0.smithi049.stdout:8/773: creat d2/d17/de1/de4/ffe x:0 0 0 2024-04-26T10:44:31.598 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:31.596+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:31.608 INFO:tasks.workunit.client.0.smithi049.stdout:4/771: dread de/d1b/d5e/d72/d73/d84/d38/f58 [0,4194304] 0 2024-04-26T10:44:31.608 INFO:tasks.workunit.client.0.smithi049.stdout:9/821: dread d2/d1a/d1b/d1f/f32 [0,4194304] 0 2024-04-26T10:44:31.609 INFO:tasks.workunit.client.0.smithi049.stdout:9/822: write d2/d1a/d1b/f24 [1144311,21786] 0 2024-04-26T10:44:31.609 INFO:tasks.workunit.client.0.smithi049.stdout:4/772: getdents de/d1b/d5e/d72/d73/d84/d24/d50 0 2024-04-26T10:44:31.610 INFO:tasks.workunit.client.0.smithi049.stdout:9/823: link d2/d25/d60/da4/ca6 d2/d25/d74/c109 0 2024-04-26T10:44:31.611 INFO:tasks.workunit.client.0.smithi049.stdout:9/824: unlink d2/d1a/d1b/d1f/fda 0 2024-04-26T10:44:31.613 INFO:tasks.workunit.client.0.smithi049.stdout:4/773: dread de/d3f/dbf/fdf [0,4194304] 0 2024-04-26T10:44:31.613 INFO:tasks.workunit.client.0.smithi049.stdout:0/750: chown d8/db/d11/d1b/l105 2002801 1 2024-04-26T10:44:31.614 INFO:tasks.workunit.client.0.smithi049.stdout:4/774: write de/d1b/f7a [893142,123146] 0 2024-04-26T10:44:31.615 INFO:tasks.workunit.client.0.smithi049.stdout:0/751: write d8/db/d11/f32 [166401,105525] 0 2024-04-26T10:44:31.616 INFO:tasks.workunit.client.0.smithi049.stdout:0/752: fsync d8/f18 0 2024-04-26T10:44:31.617 INFO:tasks.workunit.client.0.smithi049.stdout:1/612: dwrite d1e/d20/d26/d37/f77 [0,4194304] 0 2024-04-26T10:44:31.617 INFO:tasks.workunit.client.0.smithi049.stdout:0/753: stat d8/db/d11/d1c/c81 0 2024-04-26T10:44:31.620 INFO:tasks.workunit.client.0.smithi049.stdout:0/754: mknod d8/db/d11/d1b/c10b 0 2024-04-26T10:44:31.620 INFO:tasks.workunit.client.0.smithi049.stdout:4/775: dwrite f1 [4194304,4194304] 0 2024-04-26T10:44:31.621 INFO:tasks.workunit.client.0.smithi049.stdout:0/755: dread - d8/db/d11/d1c/dbb/fd4 zero size 2024-04-26T10:44:31.622 INFO:tasks.workunit.client.0.smithi049.stdout:0/756: unlink d8/db/d11/d1c/dbb/db0/fef 0 2024-04-26T10:44:31.623 INFO:tasks.workunit.client.0.smithi049.stdout:4/776: creat de/d1b/d5e/d72/d73/d84/d24/fe9 x:0 0 0 2024-04-26T10:44:31.624 INFO:tasks.workunit.client.0.smithi049.stdout:4/777: write de/d1b/d5e/d72/d73/d84/d24/d50/f9c [692851,65165] 0 2024-04-26T10:44:31.625 INFO:tasks.workunit.client.0.smithi049.stdout:4/778: mkdir de/dea 0 2024-04-26T10:44:31.625 INFO:tasks.workunit.client.0.smithi049.stdout:1/613: dwrite d1e/f44 [0,4194304] 0 2024-04-26T10:44:31.627 INFO:tasks.workunit.client.0.smithi049.stdout:1/614: rename d1e/d20/d26/d37/f77 to d1e/d20/d26/d3c/d54/d59/d73/dab/fc1 0 2024-04-26T10:44:31.630 INFO:tasks.workunit.client.0.smithi049.stdout:9/825: dread d2/d1a/d1b/d1f/f3d [0,4194304] 0 2024-04-26T10:44:31.630 INFO:tasks.workunit.client.0.smithi049.stdout:5/705: truncate d7/d1d/d1f/d4e/d65/d6f/d91/d3e/f40 3214339 0 2024-04-26T10:44:31.630 INFO:tasks.workunit.client.0.smithi049.stdout:4/779: dwrite de/d1b/d5e/d72/d73/d84/d24/d50/f9c [0,4194304] 0 2024-04-26T10:44:31.631 INFO:tasks.workunit.client.0.smithi049.stdout:9/826: write d2/d1a/d42/f72 [8358165,38091] 0 2024-04-26T10:44:31.631 INFO:tasks.workunit.client.0.smithi049.stdout:4/780: chown de/d1b/d5e/d90/l82 1556221 1 2024-04-26T10:44:31.633 INFO:tasks.workunit.client.0.smithi049.stdout:5/706: link d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d60/f7a d7/d1d/d1f/d4e/d65/d6f/f114 0 2024-04-26T10:44:31.633 INFO:tasks.workunit.client.0.smithi049.stdout:4/781: link de/d1d/f78 de/d1b/d5e/d90/feb 0 2024-04-26T10:44:31.633 INFO:tasks.workunit.client.0.smithi049.stdout:5/707: symlink d7/d1d/d1f/d4e/dad/db3/dcc/l115 0 2024-04-26T10:44:31.634 INFO:tasks.workunit.client.0.smithi049.stdout:5/708: write d7/d1d/d1f/f3b [2330636,35422] 0 2024-04-26T10:44:31.634 INFO:tasks.workunit.client.0.smithi049.stdout:4/782: creat de/d1b/d5e/d72/d73/d84/d4b/db5/fec x:0 0 0 2024-04-26T10:44:31.635 INFO:tasks.workunit.client.0.smithi049.stdout:4/783: write de/f63 [468524,75142] 0 2024-04-26T10:44:31.635 INFO:tasks.workunit.client.0.smithi049.stdout:5/709: write d7/d1d/d20/f24 [2641398,128004] 0 2024-04-26T10:44:31.636 INFO:tasks.workunit.client.0.smithi049.stdout:5/710: getdents d7/d1d/d1f/d4e/d80 0 2024-04-26T10:44:31.639 INFO:tasks.workunit.client.0.smithi049.stdout:9/827: dread d2/d1a/d1b/d1f/d34/ff9 [0,4194304] 0 2024-04-26T10:44:31.640 INFO:tasks.workunit.client.0.smithi049.stdout:9/828: truncate d2/d1a/f95 1455766 0 2024-04-26T10:44:31.645 INFO:tasks.workunit.client.0.smithi049.stdout:5/711: dread d7/d1d/d1f/f51 [0,4194304] 0 2024-04-26T10:44:31.646 INFO:tasks.workunit.client.0.smithi049.stdout:5/712: write d7/d66/fbb [378363,124181] 0 2024-04-26T10:44:31.646 INFO:tasks.workunit.client.0.smithi049.stdout:2/658: dwrite f4 [0,4194304] 0 2024-04-26T10:44:31.647 INFO:tasks.workunit.client.0.smithi049.stdout:6/633: truncate da/dd/f13 1888454 0 2024-04-26T10:44:31.648 INFO:tasks.workunit.client.0.smithi049.stdout:2/659: truncate d6/f29 1354046 0 2024-04-26T10:44:31.648 INFO:tasks.workunit.client.0.smithi049.stdout:6/634: creat da/dd/de/d42/d5a/fd5 x:0 0 0 2024-04-26T10:44:31.649 INFO:tasks.workunit.client.0.smithi049.stdout:6/635: write da/d4a/f2f [3430299,107926] 0 2024-04-26T10:44:31.649 INFO:tasks.workunit.client.0.smithi049.stdout:0/757: dread d8/d42/f54 [0,4194304] 0 2024-04-26T10:44:31.650 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:31.650 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:31.650 INFO:tasks.workunit.client.0.smithi049.stdout:0/758: readlink d8/d66/l9a 0 2024-04-26T10:44:31.651 INFO:tasks.workunit.client.0.smithi049.stdout:6/636: creat da/dd/d47/d7b/fd6 x:0 0 0 2024-04-26T10:44:31.651 INFO:tasks.workunit.client.0.smithi049.stdout:0/759: mknod d8/db/d11/d1b/c10c 0 2024-04-26T10:44:31.651 INFO:tasks.workunit.client.0.smithi049.stdout:6/637: dread - da/dd/de/d26/d22/d4c/f5b zero size 2024-04-26T10:44:31.652 INFO:tasks.workunit.client.0.smithi049.stdout:6/638: write da/dd/de/d26/d22/f8d [1398062,115742] 0 2024-04-26T10:44:31.653 INFO:tasks.workunit.client.0.smithi049.stdout:2/660: dwrite d6/d9/d5f/dba/d34/d7b/f7e [0,4194304] 0 2024-04-26T10:44:31.655 INFO:tasks.workunit.client.0.smithi049.stdout:6/639: dread - da/dd/d47/d7b/f81 zero size 2024-04-26T10:44:31.656 INFO:tasks.workunit.client.0.smithi049.stdout:2/661: mkdir d6/d9/d5f/dba/d34/d38/d73/dcd 0 2024-04-26T10:44:31.656 INFO:tasks.workunit.client.0.smithi049.stdout:6/640: rmdir da/dd/d47/da3/dcb 39 2024-04-26T10:44:31.656 INFO:tasks.workunit.client.0.smithi049.stdout:2/662: fsync d6/d9/f19 0 2024-04-26T10:44:31.657 INFO:tasks.workunit.client.0.smithi049.stdout:6/641: creat da/dd/de/d26/d29/fd7 x:0 0 0 2024-04-26T10:44:31.657 INFO:tasks.workunit.client.0.smithi049.stdout:0/760: dwrite d8/d66/f10a [0,4194304] 0 2024-04-26T10:44:31.658 INFO:tasks.workunit.client.0.smithi049.stdout:6/642: readlink da/dd/de/d42/d5a/lcd 0 2024-04-26T10:44:31.658 INFO:tasks.workunit.client.0.smithi049.stdout:2/663: truncate d6/f79 320166 0 2024-04-26T10:44:31.660 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:31.661 INFO:tasks.workunit.client.0.smithi049.stdout:6/643: link da/dd/de/d26/d22/f55 da/dd/de/d26/d29/fd8 0 2024-04-26T10:44:31.662 INFO:tasks.workunit.client.0.smithi049.stdout:4/784: dread de/f8d [0,4194304] 0 2024-04-26T10:44:31.665 INFO:tasks.workunit.client.0.smithi049.stdout:7/753: mknod d2/c103 0 2024-04-26T10:44:31.665 INFO:tasks.workunit.client.0.smithi049.stdout:9/829: rename d2/l46 to d2/d1a/de2/l10a 0 2024-04-26T10:44:31.666 INFO:tasks.workunit.client.0.smithi049.stdout:0/761: dwrite d8/da5/fbe [0,4194304] 0 2024-04-26T10:44:31.666 INFO:tasks.workunit.client.0.smithi049.stdout:2/664: dwrite d6/d9/d5f/dba/df/d31/f5c [0,4194304] 0 2024-04-26T10:44:31.667 INFO:tasks.workunit.client.0.smithi049.stdout:3/586: write d3/d6/f10 [1402157,32151] 0 2024-04-26T10:44:31.671 INFO:tasks.workunit.client.0.smithi049.stdout:7/754: symlink d2/d3/d96/ddc/l104 0 2024-04-26T10:44:31.671 INFO:tasks.workunit.client.0.smithi049.stdout:3/587: rmdir d3/d23/d2f/d6a 39 2024-04-26T10:44:31.671 INFO:tasks.workunit.client.0.smithi049.stdout:2/665: rmdir d6/d9/d5f/dba/df/d31 39 2024-04-26T10:44:31.671 INFO:tasks.workunit.client.0.smithi049.stdout:8/774: dwrite d2/df/f36 [0,4194304] 0 2024-04-26T10:44:31.671 INFO:tasks.workunit.client.0.smithi049.stdout:9/830: write d2/d25/d74/ff8 [930693,44274] 0 2024-04-26T10:44:31.673 INFO:tasks.workunit.client.0.smithi049.stdout:5/713: read d7/d53/fc4 [2685952,15451] 0 2024-04-26T10:44:31.673 INFO:tasks.workunit.client.0.smithi049.stdout:0/762: truncate d8/db/d26/f97 1941091 0 2024-04-26T10:44:31.674 INFO:tasks.workunit.client.0.smithi049.stdout:6/644: dwrite da/dd/de/d26/d22/f8d [0,4194304] 0 2024-04-26T10:44:31.674 INFO:tasks.workunit.client.0.smithi049.stdout:2/666: dread - d6/d30/d97/fae zero size 2024-04-26T10:44:31.674 INFO:tasks.workunit.client.0.smithi049.stdout:9/831: chown d2/d25/d60/da4/dde/f101 0 1 2024-04-26T10:44:31.674 INFO:tasks.workunit.client.0.smithi049.stdout:6/645: chown da/dd/de/f96 966 1 2024-04-26T10:44:31.674 INFO:tasks.workunit.client.0.smithi049.stdout:7/755: rename d2/d3/d96/led to d2/dd/d7f/dd1/l105 0 2024-04-26T10:44:31.675 INFO:tasks.workunit.client.0.smithi049.stdout:1/615: write d1e/f1f [1375441,94626] 0 2024-04-26T10:44:31.676 INFO:tasks.workunit.client.0.smithi049.stdout:9/832: mkdir d2/d25/dee/d10b 0 2024-04-26T10:44:31.676 INFO:tasks.workunit.client.0.smithi049.stdout:7/756: stat d2/dd/d25/l5e 0 2024-04-26T10:44:31.678 INFO:tasks.workunit.client.0.smithi049.stdout:9/833: rmdir d2/d1a/d42 39 2024-04-26T10:44:31.678 INFO:tasks.workunit.client.0.smithi049.stdout:1/616: creat d1e/d20/d26/d37/d6e/fc2 x:0 0 0 2024-04-26T10:44:31.679 INFO:tasks.workunit.client.0.smithi049.stdout:6/646: getdents da/dd/de/d11/dbc 0 2024-04-26T10:44:31.679 INFO:tasks.workunit.client.0.smithi049.stdout:7/757: write d2/dd/d38/ff4 [227970,34620] 0 2024-04-26T10:44:31.680 INFO:tasks.workunit.client.0.smithi049.stdout:9/834: mknod d2/d25/c10c 0 2024-04-26T10:44:31.680 INFO:tasks.workunit.client.0.smithi049.stdout:6/647: chown l3 3 1 2024-04-26T10:44:31.681 INFO:tasks.workunit.client.0.smithi049.stdout:8/775: dwrite d2/d16/d19/f4d [0,4194304] 0 2024-04-26T10:44:31.681 INFO:tasks.workunit.client.0.smithi049.stdout:0/763: dwrite d8/d1e/feb [0,4194304] 0 2024-04-26T10:44:31.681 INFO:tasks.workunit.client.0.smithi049.stdout:4/785: dread de/d1b/d5e/d72/d73/d84/d4b/fda [0,4194304] 0 2024-04-26T10:44:31.681 INFO:tasks.workunit.client.0.smithi049.stdout:1/617: write d1e/d20/f38 [1081970,90047] 0 2024-04-26T10:44:31.682 INFO:tasks.workunit.client.0.smithi049.stdout:9/835: readlink d2/d40/db2/l105 0 2024-04-26T10:44:31.682 INFO:tasks.workunit.client.0.smithi049.stdout:3/588: dwrite d3/d23/d2f/d6a/d6b/d26/d65/dae/fbe [0,4194304] 0 2024-04-26T10:44:31.683 INFO:tasks.workunit.client.0.smithi049.stdout:6/648: creat da/dd/fd9 x:0 0 0 2024-04-26T10:44:31.683 INFO:tasks.workunit.client.0.smithi049.stdout:8/776: fsync d2/d16/f2e 0 2024-04-26T10:44:31.683 INFO:tasks.workunit.client.0.smithi049.stdout:1/618: chown d1e/d20/d26/d37/d8e/d97 0 1 2024-04-26T10:44:31.683 INFO:tasks.workunit.client.0.smithi049.stdout:4/786: creat de/d1b/d5e/d72/d73/d88/fed x:0 0 0 2024-04-26T10:44:31.684 INFO:tasks.workunit.client.0.smithi049.stdout:3/589: fsync d3/d23/d2f/d6a/d6b/d8/d55/d46/f94 0 2024-04-26T10:44:31.684 INFO:tasks.workunit.client.0.smithi049.stdout:1/619: creat d1e/d20/d26/d3c/d54/fc3 x:0 0 0 2024-04-26T10:44:31.685 INFO:tasks.workunit.client.0.smithi049.stdout:8/777: rmdir d2/d16/d19/dd9 39 2024-04-26T10:44:31.686 INFO:tasks.workunit.client.0.smithi049.stdout:8/778: fdatasync d2/d17/f97 0 2024-04-26T10:44:31.686 INFO:tasks.workunit.client.0.smithi049.stdout:3/590: chown d3/d23/d2f/d6a/d6b/d26/f5a 193 1 2024-04-26T10:44:31.687 INFO:tasks.workunit.client.0.smithi049.stdout:1/620: unlink d1e/d20/d26/d37/l93 0 2024-04-26T10:44:31.688 INFO:tasks.workunit.client.0.smithi049.stdout:2/667: write d6/d32/d69/fb4 [659159,3705] 0 2024-04-26T10:44:31.688 INFO:tasks.workunit.client.0.smithi049.stdout:4/787: mknod de/d1b/d5e/d72/d73/d84/d24/d50/dc5/cee 0 2024-04-26T10:44:31.688 INFO:tasks.workunit.client.0.smithi049.stdout:2/668: fsync d6/fa5 0 2024-04-26T10:44:31.689 INFO:tasks.workunit.client.0.smithi049.stdout:3/591: getdents d3 0 2024-04-26T10:44:31.689 INFO:tasks.workunit.client.0.smithi049.stdout:1/621: stat d1e/d20/d26/d37/d69/d75 0 2024-04-26T10:44:31.689 INFO:tasks.workunit.client.0.smithi049.stdout:6/649: dwrite da/dd/de/d26/f45 [0,4194304] 0 2024-04-26T10:44:31.690 INFO:tasks.workunit.client.0.smithi049.stdout:6/650: rmdir da/d4a 39 2024-04-26T10:44:31.691 INFO:tasks.workunit.client.0.smithi049.stdout:4/788: getdents de/d1b/d5e/d72/d73/d84/d4b 0 2024-04-26T10:44:31.692 INFO:tasks.workunit.client.0.smithi049.stdout:8/779: dwrite d2/df/f3f [0,4194304] 0 2024-04-26T10:44:31.692 INFO:tasks.workunit.client.0.smithi049.stdout:3/592: readlink d3/d23/d2f/d6a/d6b/d8/d34/lb6 0 2024-04-26T10:44:31.692 INFO:tasks.workunit.client.0.smithi049.stdout:8/780: readlink d2/d16/l90 0 2024-04-26T10:44:31.693 INFO:tasks.workunit.client.0.smithi049.stdout:8/781: creat d2/d1a/fff x:0 0 0 2024-04-26T10:44:31.693 INFO:tasks.workunit.client.0.smithi049.stdout:4/789: link de/d1b/d5e/d90/l82 de/d1b/d5e/d72/d73/d84/d4b/lef 0 2024-04-26T10:44:31.695 INFO:tasks.workunit.client.0.smithi049.stdout:3/593: link d3/d23/d2f/d6a/d6b/d8/d55/d46/f4a d3/d23/d2f/d6a/d6b/d26/d65/fc5 0 2024-04-26T10:44:31.698 INFO:tasks.workunit.client.0.smithi049.stdout:4/790: dwrite de/d1b/d5e/d72/d73/d84/f60 [0,4194304] 0 2024-04-26T10:44:31.698 INFO:tasks.workunit.client.0.smithi049.stdout:6/651: dread da/dd/de/f75 [0,4194304] 0 2024-04-26T10:44:31.700 INFO:tasks.workunit.client.0.smithi049.stdout:4/791: truncate de/f15 2276919 0 2024-04-26T10:44:31.700 INFO:tasks.workunit.client.0.smithi049.stdout:4/792: symlink de/d3f/d48/de3/lf0 0 2024-04-26T10:44:31.702 INFO:tasks.workunit.client.0.smithi049.stdout:4/793: rmdir de/d1b/d5e/d72/d73/d84/d24/db4 39 2024-04-26T10:44:31.704 INFO:tasks.workunit.client.0.smithi049.stdout:3/594: dread d3/d23/d2f/d6a/d6b/d26/f7a [0,4194304] 0 2024-04-26T10:44:31.704 INFO:tasks.workunit.client.0.smithi049.stdout:9/836: truncate d2/d25/fa3 1773240 0 2024-04-26T10:44:31.705 INFO:tasks.workunit.client.0.smithi049.stdout:7/758: truncate d2/d3/de/d1c/f94 3087481 0 2024-04-26T10:44:31.705 INFO:tasks.workunit.client.0.smithi049.stdout:1/622: getdents d1e/d20/d26/d3c/d54 0 2024-04-26T10:44:31.705 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:31.703+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:31.705 INFO:tasks.workunit.client.0.smithi049.stdout:6/652: write da/dd/de/d26/d22/f55 [4494496,33958] 0 2024-04-26T10:44:31.706 INFO:tasks.workunit.client.0.smithi049.stdout:1/623: creat d1e/d20/d26/d3c/d54/fc4 x:0 0 0 2024-04-26T10:44:31.706 INFO:tasks.workunit.client.0.smithi049.stdout:3/595: chown d3/d23/d2f/d6a/d6b/d8/dd/f9d 0 1 2024-04-26T10:44:31.707 INFO:tasks.workunit.client.0.smithi049.stdout:7/759: symlink d2/dd/d7f/db1/dc6/de9/l106 0 2024-04-26T10:44:31.707 INFO:tasks.workunit.client.0.smithi049.stdout:1/624: dread - d1e/d62/f71 zero size 2024-04-26T10:44:31.707 INFO:tasks.workunit.client.0.smithi049.stdout:9/837: link d2/d1a/d1b/c90 d2/d1a/d42/c10d 0 2024-04-26T10:44:31.708 INFO:tasks.workunit.client.0.smithi049.stdout:3/596: creat d3/d23/d2f/d6a/d6b/d8/d87/db1/fc6 x:0 0 0 2024-04-26T10:44:31.708 INFO:tasks.workunit.client.0.smithi049.stdout:9/838: chown d2/d1a/d1b/d1f/d34/c107 111 1 2024-04-26T10:44:31.708 INFO:tasks.workunit.client.0.smithi049.stdout:1/625: rename d1e/d20/d26/l2b to d1e/d20/d26/d37/d69/d75/lc5 0 2024-04-26T10:44:31.710 INFO:tasks.workunit.client.0.smithi049.stdout:3/597: creat d3/d23/d2f/fc7 x:0 0 0 2024-04-26T10:44:31.710 INFO:tasks.workunit.client.0.smithi049.stdout:4/794: dread de/d1b/d5e/d72/d73/d84/d4b/f7d [0,4194304] 0 2024-04-26T10:44:31.710 INFO:tasks.workunit.client.0.smithi049.stdout:9/839: symlink d2/d1a/d1b/d1f/d34/l10e 0 2024-04-26T10:44:31.711 INFO:tasks.workunit.client.0.smithi049.stdout:3/598: creat d3/fc8 x:0 0 0 2024-04-26T10:44:31.711 INFO:tasks.workunit.client.0.smithi049.stdout:6/653: dwrite da/dd/d62/f6d [0,4194304] 0 2024-04-26T10:44:31.711 INFO:tasks.workunit.client.0.smithi049.stdout:9/840: fsync d2/d1a/fd 0 2024-04-26T10:44:31.712 INFO:tasks.workunit.client.0.smithi049.stdout:1/626: rename d1e/d20/l23 to d1e/d20/d26/d3c/d54/d59/lc6 0 2024-04-26T10:44:31.712 INFO:tasks.workunit.client.0.smithi049.stdout:9/841: mkdir d2/d40/d5d/d10f 0 2024-04-26T10:44:31.712 INFO:tasks.workunit.client.0.smithi049.stdout:4/795: creat de/d1b/d5e/d72/d73/d84/d24/ff1 x:0 0 0 2024-04-26T10:44:31.713 INFO:tasks.workunit.client.0.smithi049.stdout:3/599: write d3/d23/d2f/d6a/d6b/d8/d55/d2e/f4c [4058376,107967] 0 2024-04-26T10:44:31.713 INFO:tasks.workunit.client.0.smithi049.stdout:4/796: chown de/l6e 7 1 2024-04-26T10:44:31.714 INFO:tasks.workunit.client.0.smithi049.stdout:1/627: creat d1e/d20/d26/d3c/d54/d59/d68/fc7 x:0 0 0 2024-04-26T10:44:31.715 INFO:tasks.workunit.client.0.smithi049.stdout:1/628: creat d1e/d20/d26/d37/d69/d75/fc8 x:0 0 0 2024-04-26T10:44:31.716 INFO:tasks.workunit.client.0.smithi049.stdout:7/760: truncate d2/f33 643077 0 2024-04-26T10:44:31.716 INFO:tasks.workunit.client.0.smithi049.stdout:3/600: dread - d3/d23/d2f/d6a/d6b/d8/dd/fac zero size 2024-04-26T10:44:31.717 INFO:tasks.workunit.client.0.smithi049.stdout:1/629: fdatasync d1e/d20/f32 0 2024-04-26T10:44:31.718 INFO:tasks.workunit.client.0.smithi049.stdout:4/797: dread de/f8d [0,4194304] 0 2024-04-26T10:44:31.718 INFO:tasks.workunit.client.0.smithi049.stdout:9/842: dwrite d2/d1a/d1b/d1f/ffc [0,4194304] 0 2024-04-26T10:44:31.718 INFO:tasks.workunit.client.0.smithi049.stdout:4/798: chown de/d3f/dbf 7238130 1 2024-04-26T10:44:31.719 INFO:tasks.workunit.client.0.smithi049.stdout:7/761: link d2/d3/d96/ddc/l104 d2/dd/d7f/dd1/dfa/l107 0 2024-04-26T10:44:31.719 INFO:tasks.workunit.client.0.smithi049.stdout:1/630: symlink d1e/d20/d26/d3c/d96/lc9 0 2024-04-26T10:44:31.720 INFO:tasks.workunit.client.0.smithi049.stdout:7/762: unlink d2/d3/de/f51 0 2024-04-26T10:44:31.720 INFO:tasks.workunit.client.0.smithi049.stdout:9/843: truncate d2/d1a/d1b/d1f/d34/fd5 167221 0 2024-04-26T10:44:31.721 INFO:tasks.workunit.client.0.smithi049.stdout:9/844: stat d2/d1a/d1b/d1f/l8c 0 2024-04-26T10:44:31.721 INFO:tasks.workunit.client.0.smithi049.stdout:5/714: sync 2024-04-26T10:44:31.722 INFO:tasks.workunit.client.0.smithi049.stdout:5/715: mknod d7/d53/c116 0 2024-04-26T10:44:31.722 INFO:tasks.workunit.client.0.smithi049.stdout:5/716: mkdir d7/d14/d18/d2b/d117 0 2024-04-26T10:44:31.724 INFO:tasks.workunit.client.0.smithi049.stdout:5/717: chown d7/d14/d18/d2b/fd9 53306264 1 2024-04-26T10:44:31.724 INFO:tasks.workunit.client.0.smithi049.stdout:4/799: dwrite de/d1b/f92 [4194304,4194304] 0 2024-04-26T10:44:31.724 INFO:tasks.workunit.client.0.smithi049.stdout:2/669: dread d6/d9/d5f/dba/d11/f5d [0,4194304] 0 2024-04-26T10:44:31.725 INFO:tasks.workunit.client.0.smithi049.stdout:5/718: fdatasync d7/d1d/d1f/ffb 0 2024-04-26T10:44:31.725 INFO:tasks.workunit.client.0.smithi049.stdout:3/601: write d3/d23/d2f/d6a/d6b/d8/f32 [322187,91454] 0 2024-04-26T10:44:31.725 INFO:tasks.workunit.client.0.smithi049.stdout:4/800: rename de to de/d1b/d5e/d72/d73/dab/df2 22 2024-04-26T10:44:31.726 INFO:tasks.workunit.client.0.smithi049.stdout:3/602: mknod d3/d23/d2f/d6a/d6b/d26/d65/dae/cc9 0 2024-04-26T10:44:31.728 INFO:tasks.workunit.client.0.smithi049.stdout:3/603: write d3/d23/d2f/d6a/d6b/d8/d55/f98 [2337986,64286] 0 2024-04-26T10:44:31.729 INFO:tasks.workunit.client.0.smithi049.stdout:2/670: dread d6/f84 [0,4194304] 0 2024-04-26T10:44:31.729 INFO:tasks.workunit.client.0.smithi049.stdout:3/604: rename d3/d6 to d3/d23/d2f/d6a/d6b/d8/d55/db4/dca 0 2024-04-26T10:44:31.730 INFO:tasks.workunit.client.0.smithi049.stdout:2/671: dread - d6/d9/d5f/dba/d11/f43 zero size 2024-04-26T10:44:31.731 INFO:tasks.workunit.client.0.smithi049.stdout:5/719: dwrite d7/d1d/d1f/d4e/d65/d6f/d91/fae [0,4194304] 0 2024-04-26T10:44:31.731 INFO:tasks.workunit.client.0.smithi049.stdout:2/672: chown d6/d9/f19 3055 1 2024-04-26T10:44:31.732 INFO:tasks.workunit.client.0.smithi049.stdout:5/720: creat d7/dc6/df7/f118 x:0 0 0 2024-04-26T10:44:31.732 INFO:tasks.workunit.client.0.smithi049.stdout:2/673: mknod d6/d9/d5f/dba/d34/d38/cce 0 2024-04-26T10:44:31.734 INFO:tasks.workunit.client.0.smithi049.stdout:2/674: rename d6/d9/d5f/dba/d1e/l48 to d6/d32/lcf 0 2024-04-26T10:44:31.734 INFO:tasks.workunit.client.0.smithi049.stdout:5/721: link d7/d1d/d20/l28 d7/d1d/l119 0 2024-04-26T10:44:31.736 INFO:tasks.workunit.client.0.smithi049.stdout:2/675: write d6/d9/d5f/dba/d11/f5d [2197266,110389] 0 2024-04-26T10:44:31.736 INFO:tasks.workunit.client.0.smithi049.stdout:5/722: getdents d7/d66/d84/dfc 0 2024-04-26T10:44:31.739 INFO:tasks.workunit.client.0.smithi049.stdout:5/723: write d7/d14/f38 [503148,24876] 0 2024-04-26T10:44:31.741 INFO:tasks.workunit.client.0.smithi049.stdout:3/605: dwrite d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/f28 [4194304,4194304] 0 2024-04-26T10:44:31.741 INFO:tasks.workunit.client.0.smithi049.stdout:5/724: stat d7/d1d/d1f/d4e/d65/l6b 0 2024-04-26T10:44:31.742 INFO:tasks.workunit.client.0.smithi049.stdout:4/801: dwrite de/d3f/d52/fc1 [0,4194304] 0 2024-04-26T10:44:31.744 INFO:tasks.workunit.client.0.smithi049.stdout:7/763: dwrite d2/d3/de/d1c/f36 [0,4194304] 0 2024-04-26T10:44:31.745 INFO:tasks.workunit.client.0.smithi049.stdout:3/606: creat d3/d23/d2f/d6a/d6b/d8/d55/d2e/fcb x:0 0 0 2024-04-26T10:44:31.745 INFO:tasks.workunit.client.0.smithi049.stdout:5/725: creat d7/d14/d18/f11a x:0 0 0 2024-04-26T10:44:31.745 INFO:tasks.workunit.client.0.smithi049.stdout:4/802: write de/d1b/d5e/d72/d73/f85 [832860,52128] 0 2024-04-26T10:44:31.745 INFO:tasks.workunit.client.0.smithi049.stdout:7/764: mkdir d2/dab/de7/d108 0 2024-04-26T10:44:31.747 INFO:tasks.workunit.client.0.smithi049.stdout:4/803: stat de/d1d/cbe 0 2024-04-26T10:44:31.747 INFO:tasks.workunit.client.0.smithi049.stdout:2/676: rename d6/d9/d5f/dba/f1c to d6/d32/d4a/fd0 0 2024-04-26T10:44:31.750 INFO:tasks.workunit.client.0.smithi049.stdout:1/631: sync 2024-04-26T10:44:31.750 INFO:tasks.workunit.client.0.smithi049.stdout:0/764: sync 2024-04-26T10:44:31.750 INFO:tasks.workunit.client.0.smithi049.stdout:8/782: sync 2024-04-26T10:44:31.750 INFO:tasks.workunit.client.0.smithi049.stdout:7/765: creat d2/dd/d48/d5c/f109 x:0 0 0 2024-04-26T10:44:31.750 INFO:tasks.workunit.client.0.smithi049.stdout:8/783: write d2/d1a/d9c/fc8 [1208862,81254] 0 2024-04-26T10:44:31.750 INFO:tasks.workunit.client.0.smithi049.stdout:4/804: mknod de/d1b/d5e/d90/db1/cf3 0 2024-04-26T10:44:31.750 INFO:tasks.workunit.client.0.smithi049.stdout:3/607: unlink d3/d23/d2f/d6a/d6b/d8/d55/lb5 0 2024-04-26T10:44:31.751 INFO:tasks.workunit.client.0.smithi049.stdout:1/632: readlink d1e/d20/d26/d3c/d54/d59/d73/l9a 0 2024-04-26T10:44:31.751 INFO:tasks.workunit.client.0.smithi049.stdout:0/765: mknod d8/d66/d84/c10d 0 2024-04-26T10:44:31.751 INFO:tasks.workunit.client.0.smithi049.stdout:7/766: mknod d2/d3/d96/ddc/c10a 0 2024-04-26T10:44:31.751 INFO:tasks.workunit.client.0.smithi049.stdout:6/654: dread da/dd/de/d26/fbb [0,4194304] 0 2024-04-26T10:44:31.751 INFO:tasks.workunit.client.0.smithi049.stdout:1/633: chown d1e/d20/d26/d37/d8e/d97/cb8 530901 1 2024-04-26T10:44:31.752 INFO:tasks.workunit.client.0.smithi049.stdout:8/784: symlink d2/df/d10/d23/l100 0 2024-04-26T10:44:31.752 INFO:tasks.workunit.client.0.smithi049.stdout:3/608: mknod d3/d23/d2f/d6a/d6b/d26/d29/ccc 0 2024-04-26T10:44:31.752 INFO:tasks.workunit.client.0.smithi049.stdout:4/805: write de/d1b/d5e/d72/d73/d84/f7e [973970,4771] 0 2024-04-26T10:44:31.752 INFO:tasks.workunit.client.0.smithi049.stdout:7/767: creat d2/d3/de/d1c/dac/f10b x:0 0 0 2024-04-26T10:44:31.752 INFO:tasks.workunit.client.0.smithi049.stdout:1/634: symlink d1e/d20/d67/lca 0 2024-04-26T10:44:31.752 INFO:tasks.workunit.client.0.smithi049.stdout:3/609: chown d3/l1a 15 1 2024-04-26T10:44:31.753 INFO:tasks.workunit.client.0.smithi049.stdout:8/785: dread - d2/d17/de1/de4/ffe zero size 2024-04-26T10:44:31.754 INFO:tasks.workunit.client.0.smithi049.stdout:2/677: truncate d6/d9/d5f/dba/f13 4599449 0 2024-04-26T10:44:31.755 INFO:tasks.workunit.client.0.smithi049.stdout:9/845: dread d2/d1a/d42/f67 [0,4194304] 0 2024-04-26T10:44:31.755 INFO:tasks.workunit.client.0.smithi049.stdout:4/806: mknod de/d3f/d48/de3/cf4 0 2024-04-26T10:44:31.756 INFO:tasks.workunit.client.0.smithi049.stdout:1/635: mknod d1e/d20/d4d/ccb 0 2024-04-26T10:44:31.756 INFO:tasks.workunit.client.0.smithi049.stdout:8/786: creat d2/d16/f101 x:0 0 0 2024-04-26T10:44:31.756 INFO:tasks.workunit.client.0.smithi049.stdout:7/768: symlink d2/d3/de/d1c/l10c 0 2024-04-26T10:44:31.756 INFO:tasks.workunit.client.0.smithi049.stdout:3/610: chown d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e 262967407 1 2024-04-26T10:44:31.756 INFO:tasks.workunit.client.0.smithi049.stdout:6/655: dread da/dd/de/d26/f45 [0,4194304] 0 2024-04-26T10:44:31.756 INFO:tasks.workunit.client.0.smithi049.stdout:0/766: dwrite d8/d66/f69 [0,4194304] 0 2024-04-26T10:44:31.757 INFO:tasks.workunit.client.0.smithi049.stdout:6/656: sync 2024-04-26T10:44:31.757 INFO:tasks.workunit.client.0.smithi049.stdout:4/807: dread - de/d3f/d48/d8b/fcc zero size 2024-04-26T10:44:31.758 INFO:tasks.workunit.client.0.smithi049.stdout:8/787: write d2/df/d10/d23/f5f [648594,59070] 0 2024-04-26T10:44:31.758 INFO:tasks.workunit.client.0.smithi049.stdout:1/636: write d1e/d20/d26/d37/d8e/fa4 [321065,45313] 0 2024-04-26T10:44:31.758 INFO:tasks.workunit.client.0.smithi049.stdout:6/657: symlink da/dd/d47/lda 0 2024-04-26T10:44:31.759 INFO:tasks.workunit.client.0.smithi049.stdout:9/846: mknod d2/d1a/d1b/d1f/d108/c110 0 2024-04-26T10:44:31.759 INFO:tasks.workunit.client.0.smithi049.stdout:0/767: chown d8/d42/f6c 330 1 2024-04-26T10:44:31.760 INFO:tasks.workunit.client.0.smithi049.stdout:3/611: truncate d3/d23/d2f/d6a/d6b/d8/f57 4856924 0 2024-04-26T10:44:31.760 INFO:tasks.workunit.client.0.smithi049.stdout:0/768: fsync d8/db/ff0 0 2024-04-26T10:44:31.760 INFO:tasks.workunit.client.0.smithi049.stdout:8/788: symlink d2/d17/d34/l102 0 2024-04-26T10:44:31.760 INFO:tasks.workunit.client.0.smithi049.stdout:6/658: chown da/dd/d47/fb6 4067 1 2024-04-26T10:44:31.761 INFO:tasks.workunit.client.0.smithi049.stdout:4/808: chown de/d1b/d5e/d72/d73/d84/d4b/l4f 956428 1 2024-04-26T10:44:31.761 INFO:tasks.workunit.client.0.smithi049.stdout:1/637: write d1e/d20/d26/d37/d69/d75/f85 [1323607,125740] 0 2024-04-26T10:44:31.762 INFO:tasks.workunit.client.0.smithi049.stdout:0/769: mkdir d8/d109/d10e 0 2024-04-26T10:44:31.762 INFO:tasks.workunit.client.0.smithi049.stdout:9/847: rename d2/d1a/d1b/d1f/d34/ff9 to d2/d25/dee/d10b/f111 0 2024-04-26T10:44:31.763 INFO:tasks.workunit.client.0.smithi049.stdout:6/659: write da/dd/fd9 [545006,120624] 0 2024-04-26T10:44:31.763 INFO:tasks.workunit.client.0.smithi049.stdout:4/809: dread - de/d1b/d5e/d72/d73/d84/d24/fdc zero size 2024-04-26T10:44:31.763 INFO:tasks.workunit.client.0.smithi049.stdout:2/678: dwrite d6/d9/f6b [0,4194304] 0 2024-04-26T10:44:31.764 INFO:tasks.workunit.client.0.smithi049.stdout:0/770: chown d8/db/d26/d39/c55 63891 1 2024-04-26T10:44:31.764 INFO:tasks.workunit.client.0.smithi049.stdout:3/612: truncate d3/d23/d2f/d6a/d6b/d26/d65/f9b 603312 0 2024-04-26T10:44:31.765 INFO:tasks.workunit.client.0.smithi049.stdout:9/848: symlink d2/d25/dc5/l112 0 2024-04-26T10:44:31.765 INFO:tasks.workunit.client.0.smithi049.stdout:2/679: mkdir d6/d30/d97/dbe/dd1 0 2024-04-26T10:44:31.766 INFO:tasks.workunit.client.0.smithi049.stdout:4/810: readlink de/d1b/d5e/d72/d73/d84/l39 0 2024-04-26T10:44:31.767 INFO:tasks.workunit.client.0.smithi049.stdout:7/769: truncate d2/dd/d48/f69 7655516 0 2024-04-26T10:44:31.767 INFO:tasks.workunit.client.0.smithi049.stdout:0/771: link d8/db/d11/d1b/d4d/dae/fc9 d8/d66/f10f 0 2024-04-26T10:44:31.768 INFO:tasks.workunit.client.0.smithi049.stdout:9/849: mkdir d2/d1a/d1b/d1f/d49/d113 0 2024-04-26T10:44:31.768 INFO:tasks.workunit.client.0.smithi049.stdout:6/660: link da/dd/d47/da3/cc4 da/dd/d62/d9d/cdb 0 2024-04-26T10:44:31.769 INFO:tasks.workunit.client.0.smithi049.stdout:2/680: mkdir d6/d9/d5f/dba/d34/d38/d3f/dd2 0 2024-04-26T10:44:31.769 INFO:tasks.workunit.client.0.smithi049.stdout:4/811: fdatasync de/d1b/d5e/d72/d73/d84/d4b/db5/fec 0 2024-04-26T10:44:31.771 INFO:tasks.workunit.client.0.smithi049.stdout:9/850: rename d2/d1a/df/f56 to d2/d40/d53/f114 0 2024-04-26T10:44:31.771 INFO:tasks.workunit.client.0.smithi049.stdout:2/681: rmdir d6/d9/d5f/dba 39 2024-04-26T10:44:31.771 INFO:tasks.workunit.client.0.smithi049.stdout:6/661: mknod da/dd/de/db5/cdc 0 2024-04-26T10:44:31.772 INFO:tasks.workunit.client.0.smithi049.stdout:3/613: dread d3/d23/d2f/d6a/d6b/d26/f86 [0,4194304] 0 2024-04-26T10:44:31.772 INFO:tasks.workunit.client.0.smithi049.stdout:3/614: stat d3 0 2024-04-26T10:44:31.772 INFO:tasks.workunit.client.0.smithi049.stdout:3/615: sync 2024-04-26T10:44:31.772 INFO:tasks.workunit.client.0.smithi049.stdout:6/662: dread - da/dd/d47/d7b/fd6 zero size 2024-04-26T10:44:31.772 INFO:tasks.workunit.client.0.smithi049.stdout:5/726: dread d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d60/f72 [0,4194304] 0 2024-04-26T10:44:31.772 INFO:tasks.workunit.client.0.smithi049.stdout:0/772: read d8/db/fd8 [8080882,8930] 0 2024-04-26T10:44:31.773 INFO:tasks.workunit.client.0.smithi049.stdout:1/638: dread d1e/d20/d4d/fac [0,4194304] 0 2024-04-26T10:44:31.773 INFO:tasks.workunit.client.0.smithi049.stdout:4/812: mknod de/d1b/d5e/d72/d73/d84/d38/cf5 0 2024-04-26T10:44:31.773 INFO:tasks.workunit.client.0.smithi049.stdout:6/663: fsync da/dd/f10 0 2024-04-26T10:44:31.773 INFO:tasks.workunit.client.0.smithi049.stdout:5/727: symlink d7/d1d/d1f/d4e/da0/l11b 0 2024-04-26T10:44:31.773 INFO:tasks.workunit.client.0.smithi049.stdout:0/773: creat d8/db/d26/db9/f110 x:0 0 0 2024-04-26T10:44:31.775 INFO:tasks.workunit.client.0.smithi049.stdout:3/616: truncate d3/d23/d2f/d6a/d6b/d8/fad 52530 0 2024-04-26T10:44:31.775 INFO:tasks.workunit.client.0.smithi049.stdout:6/664: creat da/dd/d47/d7b/d84/fdd x:0 0 0 2024-04-26T10:44:31.775 INFO:tasks.workunit.client.0.smithi049.stdout:8/789: truncate d2/df/d10/f9d 3037161 0 2024-04-26T10:44:31.776 INFO:tasks.workunit.client.0.smithi049.stdout:1/639: getdents d1e/d20/d26/d37/d8e 0 2024-04-26T10:44:31.776 INFO:tasks.workunit.client.0.smithi049.stdout:8/790: stat d2/df/f36 0 2024-04-26T10:44:31.777 INFO:tasks.workunit.client.0.smithi049.stdout:5/728: creat d7/d1d/d1f/d4e/da0/de2/f11c x:0 0 0 2024-04-26T10:44:31.777 INFO:tasks.workunit.client.0.smithi049.stdout:8/791: sync 2024-04-26T10:44:31.777 INFO:tasks.workunit.client.0.smithi049.stdout:6/665: stat da/dd/cd3 0 2024-04-26T10:44:31.777 INFO:tasks.workunit.client.0.smithi049.stdout:7/770: dread d2/d3/d96/fb4 [0,4194304] 0 2024-04-26T10:44:31.777 INFO:tasks.workunit.client.0.smithi049.stdout:1/640: rmdir d1e/d20/d26/d3c 39 2024-04-26T10:44:31.778 INFO:tasks.workunit.client.0.smithi049.stdout:2/682: dwrite d6/d9/d5f/dba/d11/f43 [0,4194304] 0 2024-04-26T10:44:31.779 INFO:tasks.workunit.client.0.smithi049.stdout:5/729: chown d7/d1d/d1f/d4e/d65/d6f/d91/d3e/f110 2 1 2024-04-26T10:44:31.779 INFO:tasks.workunit.client.0.smithi049.stdout:7/771: creat d2/dd/d38/f10d x:0 0 0 2024-04-26T10:44:31.780 INFO:tasks.workunit.client.0.smithi049.stdout:6/666: mknod da/dd/de/cde 0 2024-04-26T10:44:31.781 INFO:tasks.workunit.client.0.smithi049.stdout:1/641: read f11 [3386656,130008] 0 2024-04-26T10:44:31.781 INFO:tasks.workunit.client.0.smithi049.stdout:0/774: dread d8/d66/f69 [0,4194304] 0 2024-04-26T10:44:31.781 INFO:tasks.workunit.client.0.smithi049.stdout:2/683: write d6/d9/d5f/dba/fb1 [2548692,41967] 0 2024-04-26T10:44:31.781 INFO:tasks.workunit.client.0.smithi049.stdout:8/792: creat d2/d17/d34/d40/d64/dcd/f103 x:0 0 0 2024-04-26T10:44:31.782 INFO:tasks.workunit.client.0.smithi049.stdout:3/617: rename d3/d23/d2f/d6a/d6b/d8/d55/d2e/l3d to d3/d23/d2f/d6a/d6b/d8/d34/lcd 0 2024-04-26T10:44:31.782 INFO:tasks.workunit.client.0.smithi049.stdout:7/772: read - d2/d3/de/d1c/f9b zero size 2024-04-26T10:44:31.782 INFO:tasks.workunit.client.0.smithi049.stdout:5/730: unlink d7/d14/d18/d2b/l58 0 2024-04-26T10:44:31.782 INFO:tasks.workunit.client.0.smithi049.stdout:6/667: dread - da/dd/de/d26/d22/d4c/fb2 zero size 2024-04-26T10:44:31.782 INFO:tasks.workunit.client.0.smithi049.stdout:2/684: stat d6/c68 0 2024-04-26T10:44:31.783 INFO:tasks.workunit.client.0.smithi049.stdout:7/773: readlink d2/dd/d25/d27/l5a 0 2024-04-26T10:44:31.784 INFO:tasks.workunit.client.0.smithi049.stdout:8/793: creat d2/d89/d2a/d9f/de9/f104 x:0 0 0 2024-04-26T10:44:31.784 INFO:tasks.workunit.client.0.smithi049.stdout:1/642: read fa [6358522,95999] 0 2024-04-26T10:44:31.785 INFO:tasks.workunit.client.0.smithi049.stdout:7/774: chown d2/d3/d96/db3/db8 715 1 2024-04-26T10:44:31.785 INFO:tasks.workunit.client.0.smithi049.stdout:9/851: dread d2/d40/f106 [0,4194304] 0 2024-04-26T10:44:31.786 INFO:tasks.workunit.client.0.smithi049.stdout:6/668: mknod da/dd/de/d26/cdf 0 2024-04-26T10:44:31.786 INFO:tasks.workunit.client.0.smithi049.stdout:5/731: creat d7/d1d/d1f/d4e/f11d x:0 0 0 2024-04-26T10:44:31.786 INFO:tasks.workunit.client.0.smithi049.stdout:0/775: dread d8/d1e/d98/fe1 [0,4194304] 0 2024-04-26T10:44:31.787 INFO:tasks.workunit.client.0.smithi049.stdout:8/794: write d2/d16/d19/d42/deb/ffa [200588,83821] 0 2024-04-26T10:44:31.788 INFO:tasks.workunit.client.0.smithi049.stdout:4/813: truncate de/d1b/d5e/d72/d73/d84/d24/d50/f9c 2544679 0 2024-04-26T10:44:31.789 INFO:tasks.workunit.client.0.smithi049.stdout:7/775: chown d2/d3/d96/db3/ff9 5862 1 2024-04-26T10:44:31.789 INFO:tasks.workunit.client.0.smithi049.stdout:1/643: truncate d1e/d20/d26/d3c/d54/fc4 460860 0 2024-04-26T10:44:31.790 INFO:tasks.workunit.client.0.smithi049.stdout:7/776: fsync d2/dd/d38/fa1 0 2024-04-26T10:44:31.792 INFO:tasks.workunit.client.0.smithi049.stdout:3/618: dwrite d3/d23/d2f/d6a/d6b/d26/d65/dae/fbe [0,4194304] 0 2024-04-26T10:44:31.792 INFO:tasks.workunit.client.0.smithi049.stdout:6/669: truncate da/dd/f1e 1375844 0 2024-04-26T10:44:31.792 INFO:tasks.workunit.client.0.smithi049.stdout:2/685: dwrite d6/d32/f87 [0,4194304] 0 2024-04-26T10:44:31.792 INFO:tasks.workunit.client.0.smithi049.stdout:9/852: link d2/d1a/d9c/lae d2/d1a/d1b/d1f/d34/l115 0 2024-04-26T10:44:31.793 INFO:tasks.workunit.client.0.smithi049.stdout:8/795: link d2/d16/d19/f25 d2/df/d10/d47/d75/f105 0 2024-04-26T10:44:31.793 INFO:tasks.workunit.client.0.smithi049.stdout:1/644: fsync d1e/d20/d26/d3c/d54/d59/d73/fba 0 2024-04-26T10:44:31.793 INFO:tasks.workunit.client.0.smithi049.stdout:6/670: dread - da/dd/de/d26/d29/fd7 zero size 2024-04-26T10:44:31.794 INFO:tasks.workunit.client.0.smithi049.stdout:7/777: rmdir d2/dab/de7/d108 0 2024-04-26T10:44:31.794 INFO:tasks.workunit.client.0.smithi049.stdout:9/853: read d2/f3c [2381394,56626] 0 2024-04-26T10:44:31.795 INFO:tasks.workunit.client.0.smithi049.stdout:6/671: mkdir da/d4a/de0 0 2024-04-26T10:44:31.797 INFO:tasks.workunit.client.0.smithi049.stdout:9/854: dread - d2/d1a/de2/f8e zero size 2024-04-26T10:44:31.798 INFO:tasks.workunit.client.0.smithi049.stdout:7/778: write d2/dd/d48/d5c/f7a [1921171,69601] 0 2024-04-26T10:44:31.798 INFO:tasks.workunit.client.0.smithi049.stdout:2/686: link d6/d9/d5f/dba/d34/d38/d3f/d60/f93 d6/d9/d5f/dba/d1e/fd3 0 2024-04-26T10:44:31.799 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:31.797+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:31.800 INFO:tasks.workunit.client.0.smithi049.stdout:3/619: truncate d3/d23/d2f/d6a/d6b/d8/dd/fac 850805 0 2024-04-26T10:44:31.801 INFO:tasks.workunit.client.0.smithi049.stdout:7/779: mknod d2/dd/d48/da3/dda/c10e 0 2024-04-26T10:44:31.801 INFO:tasks.workunit.client.0.smithi049.stdout:3/620: chown d3/d23/d2f/d6a/d6b/d8c/f8e 867 1 2024-04-26T10:44:31.802 INFO:tasks.workunit.client.0.smithi049.stdout:8/796: dread d2/df/d10/d47/d75/fb3 [0,4194304] 0 2024-04-26T10:44:31.803 INFO:tasks.workunit.client.0.smithi049.stdout:1/645: dwrite d1e/d20/f41 [4194304,4194304] 0 2024-04-26T10:44:31.803 INFO:tasks.workunit.client.0.smithi049.stdout:8/797: chown d2/df/d10/d47/dca 187 1 2024-04-26T10:44:31.805 INFO:tasks.workunit.client.0.smithi049.stdout:2/687: truncate d6/d9/d5f/dba/d34/d38/d3f/f42 1573882 0 2024-04-26T10:44:31.806 INFO:tasks.workunit.client.0.smithi049.stdout:6/672: write da/dd/de/d42/f5f [2113416,37277] 0 2024-04-26T10:44:31.807 INFO:tasks.workunit.client.0.smithi049.stdout:0/776: dread d8/d42/f6c [0,4194304] 0 2024-04-26T10:44:31.808 INFO:tasks.workunit.client.0.smithi049.stdout:6/673: dread - da/dd/d47/f80 zero size 2024-04-26T10:44:31.809 INFO:tasks.workunit.client.0.smithi049.stdout:2/688: creat d6/d9/d5f/dba/d34/d7b/fd4 x:0 0 0 2024-04-26T10:44:31.809 INFO:tasks.workunit.client.0.smithi049.stdout:9/855: dwrite d2/d1a/d1b/d1f/d49/fb7 [0,4194304] 0 2024-04-26T10:44:31.810 INFO:tasks.workunit.client.0.smithi049.stdout:4/814: dread de/d1b/f7a [0,4194304] 0 2024-04-26T10:44:31.810 INFO:tasks.workunit.client.0.smithi049.stdout:9/856: stat d2/c4d 0 2024-04-26T10:44:31.812 INFO:tasks.workunit.client.0.smithi049.stdout:7/780: dwrite d2/dd/d48/da3/fb2 [0,4194304] 0 2024-04-26T10:44:31.812 INFO:tasks.workunit.client.0.smithi049.stdout:0/777: symlink d8/db/d11/d1c/dbb/dc1/dd7/de3/l111 0 2024-04-26T10:44:31.812 INFO:tasks.workunit.client.0.smithi049.stdout:6/674: stat da/dd/d47/da3/dcb 0 2024-04-26T10:44:31.812 INFO:tasks.workunit.client.0.smithi049.stdout:3/621: link d3/d23/d2f/d6a/d6b/l9e d3/d23/d2f/d6a/d6b/d8/d55/db4/dca/dc4/lce 0 2024-04-26T10:44:31.812 INFO:tasks.workunit.client.0.smithi049.stdout:6/675: sync 2024-04-26T10:44:31.813 INFO:tasks.workunit.client.0.smithi049.stdout:4/815: rmdir de/d3f/d52/d9b/d9e/db2 39 2024-04-26T10:44:31.814 INFO:tasks.workunit.client.0.smithi049.stdout:8/798: dwrite d2/df/f83 [0,4194304] 0 2024-04-26T10:44:31.815 INFO:tasks.workunit.client.0.smithi049.stdout:9/857: write d2/d1a/df/ddb/f104 [1585585,57260] 0 2024-04-26T10:44:31.815 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:31.816 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:31.816 INFO:tasks.workunit.client.0.smithi049.stdout:0/778: write d8/db/d26/daf/ffa [764962,77034] 0 2024-04-26T10:44:31.817 INFO:tasks.workunit.client.0.smithi049.stdout:2/689: creat d6/d9/d5f/dba/d11/d6a/dc3/fd5 x:0 0 0 2024-04-26T10:44:31.818 INFO:tasks.workunit.client.0.smithi049.stdout:3/622: write d3/d23/d2f/d6a/d6b/d8/d55/f98 [3967592,41570] 0 2024-04-26T10:44:31.819 INFO:tasks.workunit.client.0.smithi049.stdout:9/858: write d2/d25/d74/fbb [103687,9449] 0 2024-04-26T10:44:31.819 INFO:tasks.workunit.client.0.smithi049.stdout:2/690: stat d6/d9/f9a 0 2024-04-26T10:44:31.819 INFO:tasks.workunit.client.0.smithi049.stdout:9/859: sync 2024-04-26T10:44:31.819 INFO:tasks.workunit.client.0.smithi049.stdout:8/799: mknod d2/d16/d19/dd9/ded/c106 0 2024-04-26T10:44:31.819 INFO:tasks.workunit.client.0.smithi049.stdout:7/781: link d2/d3/l7b d2/d3/d96/db3/l10f 0 2024-04-26T10:44:31.820 INFO:tasks.workunit.client.0.smithi049.stdout:2/691: write d6/d9/d5f/f67 [2411771,13110] 0 2024-04-26T10:44:31.820 INFO:tasks.workunit.client.0.smithi049.stdout:6/676: dwrite da/dd/fd9 [0,4194304] 0 2024-04-26T10:44:31.820 INFO:tasks.workunit.client.0.smithi049.stdout:4/816: link de/c71 de/d3f/d52/d9b/d9e/db2/cf6 0 2024-04-26T10:44:31.821 INFO:tasks.workunit.client.0.smithi049.stdout:7/782: symlink d2/d3/l110 0 2024-04-26T10:44:31.821 INFO:tasks.workunit.client.0.smithi049.stdout:9/860: creat d2/d1a/d1b/d1f/d49/f116 x:0 0 0 2024-04-26T10:44:31.822 INFO:tasks.workunit.client.0.smithi049.stdout:2/692: creat d6/d30/fd6 x:0 0 0 2024-04-26T10:44:31.823 INFO:tasks.workunit.client.0.smithi049.stdout:3/623: symlink d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/lcf 0 2024-04-26T10:44:31.823 INFO:tasks.workunit.client.0.smithi049.stdout:8/800: rename d2/df/d10/d23/d6c/d5e/c94 to d2/d17/de1/c107 0 2024-04-26T10:44:31.823 INFO:tasks.workunit.client.0.smithi049.stdout:8/801: sync 2024-04-26T10:44:31.823 INFO:tasks.workunit.client.0.smithi049.stdout:4/817: mknod de/d1b/d5e/d72/cf7 0 2024-04-26T10:44:31.825 INFO:tasks.workunit.client.0.smithi049.stdout:7/783: rmdir d2/dd/d7f/dd1/dfa 39 2024-04-26T10:44:31.825 INFO:tasks.workunit.client.0.smithi049.stdout:0/779: dwrite d8/d66/d84/f8c [0,4194304] 0 2024-04-26T10:44:31.825 INFO:tasks.workunit.client.0.smithi049.stdout:9/861: chown d2/d1a/f38 2 1 2024-04-26T10:44:31.825 INFO:tasks.workunit.client.0.smithi049.stdout:6/677: mknod da/dd/de/d26/ce1 0 2024-04-26T10:44:31.825 INFO:tasks.workunit.client.0.smithi049.stdout:9/862: dread - d2/d1a/df/fe0 zero size 2024-04-26T10:44:31.825 INFO:tasks.workunit.client.0.smithi049.stdout:3/624: readlink d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/l1d 0 2024-04-26T10:44:31.826 INFO:tasks.workunit.client.0.smithi049.stdout:7/784: mkdir d2/dd/d7f/d111 0 2024-04-26T10:44:31.826 INFO:tasks.workunit.client.0.smithi049.stdout:0/780: creat d8/db/f112 x:0 0 0 2024-04-26T10:44:31.826 INFO:tasks.workunit.client.0.smithi049.stdout:8/802: truncate d2/df/d10/d23/d6c/f2c 6659090 0 2024-04-26T10:44:31.826 INFO:tasks.workunit.client.0.smithi049.stdout:9/863: fdatasync d2/d25/d74/f59 0 2024-04-26T10:44:31.827 INFO:tasks.workunit.client.0.smithi049.stdout:7/785: read - d2/dd/d25/fa4 zero size 2024-04-26T10:44:31.827 INFO:tasks.workunit.client.0.smithi049.stdout:6/678: truncate da/dd/de/d26/d22/f77 900256 0 2024-04-26T10:44:31.828 INFO:tasks.workunit.client.0.smithi049.stdout:0/781: mkdir d8/db/d11/d1c/dbb/dc1/dd7/d113 0 2024-04-26T10:44:31.828 INFO:tasks.workunit.client.0.smithi049.stdout:7/786: write d2/dd/d45/f9e [24284,26595] 0 2024-04-26T10:44:31.829 INFO:tasks.workunit.client.0.smithi049.stdout:8/803: creat d2/d17/d34/d40/d7f/f108 x:0 0 0 2024-04-26T10:44:31.829 INFO:tasks.workunit.client.0.smithi049.stdout:0/782: chown d8/d66/d84/fd3 257423543 1 2024-04-26T10:44:31.829 INFO:tasks.workunit.client.0.smithi049.stdout:6/679: write da/dd/d47/f80 [681455,21910] 0 2024-04-26T10:44:31.830 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:31.831 INFO:tasks.workunit.client.0.smithi049.stdout:5/732: dread d7/f88 [0,4194304] 0 2024-04-26T10:44:31.831 INFO:tasks.workunit.client.0.smithi049.stdout:7/787: truncate d2/d3/de/f1e 644204 0 2024-04-26T10:44:31.831 INFO:tasks.workunit.client.0.smithi049.stdout:6/680: mknod da/dd/de/d26/d22/ce2 0 2024-04-26T10:44:31.831 INFO:tasks.workunit.client.0.smithi049.stdout:8/804: rename d2/d89 to d2/d17/d34/d40/d64/dcd/df0/d109 0 2024-04-26T10:44:31.833 INFO:tasks.workunit.client.0.smithi049.stdout:6/681: creat da/dd/fe3 x:0 0 0 2024-04-26T10:44:31.834 INFO:tasks.workunit.client.0.smithi049.stdout:5/733: link d7/d1d/d20/fa8 d7/d1d/d1f/d4e/dad/db3/f11e 0 2024-04-26T10:44:31.834 INFO:tasks.workunit.client.0.smithi049.stdout:5/734: sync 2024-04-26T10:44:31.834 INFO:tasks.workunit.client.0.smithi049.stdout:7/788: chown d2/dd/d7f/dd1/dfa/l107 26948 1 2024-04-26T10:44:31.834 INFO:tasks.workunit.client.0.smithi049.stdout:9/864: dwrite d2/d1a/d1b/f16 [8388608,4194304] 0 2024-04-26T10:44:31.835 INFO:tasks.workunit.client.0.smithi049.stdout:6/682: write da/d4a/f2f [5013437,55224] 0 2024-04-26T10:44:31.836 INFO:tasks.workunit.client.0.smithi049.stdout:9/865: write d2/d25/fa1 [7491241,72047] 0 2024-04-26T10:44:31.837 INFO:tasks.workunit.client.0.smithi049.stdout:5/735: fdatasync d7/d1d/d34/db9/ff5 0 2024-04-26T10:44:31.837 INFO:tasks.workunit.client.0.smithi049.stdout:9/866: fsync d2/d40/d53/f114 0 2024-04-26T10:44:31.838 INFO:tasks.workunit.client.0.smithi049.stdout:6/683: mkdir da/dd/d47/d7b/d84/daa/de4 0 2024-04-26T10:44:31.838 INFO:tasks.workunit.client.0.smithi049.stdout:0/783: dwrite d8/db/d26/d39/fa4 [0,4194304] 0 2024-04-26T10:44:31.839 INFO:tasks.workunit.client.0.smithi049.stdout:1/646: dread d1e/d20/d26/d3c/f4f [0,4194304] 0 2024-04-26T10:44:31.839 INFO:tasks.workunit.client.0.smithi049.stdout:5/736: chown d7/d14/d18/l85 21280018 1 2024-04-26T10:44:31.839 INFO:tasks.workunit.client.0.smithi049.stdout:9/867: chown d2/d1a/d9c/lae 404 1 2024-04-26T10:44:31.840 INFO:tasks.workunit.client.0.smithi049.stdout:6/684: chown da/dd/d47/l93 1259 1 2024-04-26T10:44:31.840 INFO:tasks.workunit.client.0.smithi049.stdout:2/693: truncate d6/d9/d5f/dba/d34/d7b/f7e 1050749 0 2024-04-26T10:44:31.840 INFO:tasks.workunit.client.0.smithi049.stdout:7/789: dread d2/dd/dd3/fd7 [4194304,4194304] 0 2024-04-26T10:44:31.841 INFO:tasks.workunit.client.0.smithi049.stdout:0/784: rename d8/d1e/l7a to d8/db/d11/d1c/dbb/db0/l114 0 2024-04-26T10:44:31.842 INFO:tasks.workunit.client.0.smithi049.stdout:7/790: rmdir d2/dd/d45 39 2024-04-26T10:44:31.842 INFO:tasks.workunit.client.0.smithi049.stdout:6/685: chown da/dd/de/d11/l7f 15 1 2024-04-26T10:44:31.843 INFO:tasks.workunit.client.0.smithi049.stdout:5/737: rename d7/d1d/d34/db9/ff5 to d7/d53/f11f 0 2024-04-26T10:44:31.844 INFO:tasks.workunit.client.0.smithi049.stdout:0/785: write d8/db/d11/d1b/d4d/f64 [307488,118615] 0 2024-04-26T10:44:31.844 INFO:tasks.workunit.client.0.smithi049.stdout:6/686: mknod da/dd/de/d26/da1/ce5 0 2024-04-26T10:44:31.844 INFO:tasks.workunit.client.0.smithi049.stdout:2/694: symlink d6/d9/d5f/dba/d34/d7b/ld7 0 2024-04-26T10:44:31.844 INFO:tasks.workunit.client.0.smithi049.stdout:7/791: dread - d2/dd/d25/ff0 zero size 2024-04-26T10:44:31.844 INFO:tasks.workunit.client.0.smithi049.stdout:5/738: readlink d7/d14/d18/d2b/led 0 2024-04-26T10:44:31.845 INFO:tasks.workunit.client.0.smithi049.stdout:3/625: dwrite d3/d23/d2f/d6a/d6b/d26/f2b [0,4194304] 0 2024-04-26T10:44:31.846 INFO:tasks.workunit.client.0.smithi049.stdout:6/687: chown da/dd/de/d11/l82 14541925 1 2024-04-26T10:44:31.846 INFO:tasks.workunit.client.0.smithi049.stdout:7/792: rmdir d2/dd/d45 39 2024-04-26T10:44:31.846 INFO:tasks.workunit.client.0.smithi049.stdout:0/786: rmdir d8/db/d11/d1c/dbb/dc1 39 2024-04-26T10:44:31.846 INFO:tasks.workunit.client.0.smithi049.stdout:7/793: sync 2024-04-26T10:44:31.847 INFO:tasks.workunit.client.0.smithi049.stdout:5/739: creat d7/d1d/d1f/d4e/d65/d6f/d91/d3e/d60/f120 x:0 0 0 2024-04-26T10:44:31.848 INFO:tasks.workunit.client.0.smithi049.stdout:7/794: truncate d2/dab/fcb 799217 0 2024-04-26T10:44:31.848 INFO:tasks.workunit.client.0.smithi049.stdout:2/695: truncate d6/d9/d5f/dba/d35/f90 3985204 0 2024-04-26T10:44:31.849 INFO:tasks.workunit.client.0.smithi049.stdout:1/647: dwrite d1e/d20/d26/d3c/d54/fc3 [0,4194304] 0 2024-04-26T10:44:31.849 INFO:tasks.workunit.client.0.smithi049.stdout:0/787: truncate d8/db/d26/d6f/f103 672649 0 2024-04-26T10:44:31.850 INFO:tasks.workunit.client.0.smithi049.stdout:7/795: dread - d2/dd/d45/d82/f83 zero size 2024-04-26T10:44:31.850 INFO:tasks.workunit.client.0.smithi049.stdout:5/740: creat d7/d1d/d1f/f121 x:0 0 0 2024-04-26T10:44:31.850 INFO:tasks.workunit.client.0.smithi049.stdout:0/788: chown d8/d66/f86 2260687 1 2024-04-26T10:44:31.850 INFO:tasks.workunit.client.0.smithi049.stdout:2/696: rmdir d6/d30/d97/dbe 39 2024-04-26T10:44:31.850 INFO:tasks.workunit.client.0.smithi049.stdout:1/648: rmdir d1e/d20/d26/d3c/d54/d59 39 2024-04-26T10:44:31.851 INFO:tasks.workunit.client.0.smithi049.stdout:3/626: creat d3/d23/d2f/d6a/d6b/d8/fd0 x:0 0 0 2024-04-26T10:44:31.851 INFO:tasks.workunit.client.0.smithi049.stdout:2/697: chown d6/d9/d5f/dba/df/d31 1795093 1 2024-04-26T10:44:31.852 INFO:tasks.workunit.client.0.smithi049.stdout:5/741: symlink d7/d14/d18/d2b/d117/l122 0 2024-04-26T10:44:31.852 INFO:tasks.workunit.client.0.smithi049.stdout:1/649: stat d1e/d20/d26/d3c/d54 0 2024-04-26T10:44:31.852 INFO:tasks.workunit.client.0.smithi049.stdout:3/627: symlink d3/d23/d2f/d6a/ld1 0 2024-04-26T10:44:31.853 INFO:tasks.workunit.client.0.smithi049.stdout:2/698: rmdir d6/d30/d97 39 2024-04-26T10:44:31.854 INFO:tasks.workunit.client.0.smithi049.stdout:5/742: chown d7/d1d/d1f/d4e/d65/d6f/d91/d3e/lef 3187310 1 2024-04-26T10:44:31.854 INFO:tasks.workunit.client.0.smithi049.stdout:5/743: sync 2024-04-26T10:44:31.855 INFO:tasks.workunit.client.0.smithi049.stdout:2/699: symlink d6/d9/d5f/dba/d11/ld8 0 2024-04-26T10:44:31.858 INFO:tasks.workunit.client.0.smithi049.stdout:4/818: dread de/d1b/d5e/d72/d73/d84/d24/f61 [4194304,4194304] 0 2024-04-26T10:44:31.859 INFO:tasks.workunit.client.0.smithi049.stdout:0/789: dwrite d8/db/d26/d6f/fba [0,4194304] 0 2024-04-26T10:44:31.861 INFO:tasks.workunit.client.0.smithi049.stdout:3/628: dwrite d3/fc8 [0,4194304] 0 2024-04-26T10:44:31.861 INFO:tasks.workunit.client.0.smithi049.stdout:5/744: rename d7/d1d/d1f/d4e/d65/d6f to d7/d1d/d34/d123 0 2024-04-26T10:44:31.862 INFO:tasks.workunit.client.0.smithi049.stdout:0/790: mkdir d8/db/d11/d115 0 2024-04-26T10:44:31.862 INFO:tasks.workunit.client.0.smithi049.stdout:5/745: rmdir d7/d1d/d1f/d4e/d65 39 2024-04-26T10:44:31.862 INFO:tasks.workunit.client.0.smithi049.stdout:4/819: link de/d3f/d52/d9b/d9e/cc3 de/cf8 0 2024-04-26T10:44:31.862 INFO:tasks.workunit.client.0.smithi049.stdout:0/791: stat d8/db/d11/d1c/ffc 0 2024-04-26T10:44:31.862 INFO:tasks.workunit.client.0.smithi049.stdout:4/820: sync 2024-04-26T10:44:31.863 INFO:tasks.workunit.client.0.smithi049.stdout:4/821: symlink de/d1b/d5e/d90/db1/lf9 0 2024-04-26T10:44:31.864 INFO:tasks.workunit.client.0.smithi049.stdout:5/746: chown d7/d1d/d1f/d4e/d65/le8 9113 1 2024-04-26T10:44:31.864 INFO:tasks.workunit.client.0.smithi049.stdout:3/629: getdents d3/d23/d2f/d6a/d6b/d8/d55/db4 0 2024-04-26T10:44:31.864 INFO:tasks.workunit.client.0.smithi049.stdout:4/822: chown de/d1d 247 1 2024-04-26T10:44:31.865 INFO:tasks.workunit.client.0.smithi049.stdout:4/823: creat de/d3f/d48/ffa x:0 0 0 2024-04-26T10:44:31.865 INFO:tasks.workunit.client.0.smithi049.stdout:5/747: mkdir d7/d1d/d1f/d4e/d65/d124 0 2024-04-26T10:44:31.867 INFO:tasks.workunit.client.0.smithi049.stdout:5/748: truncate d7/d1d/d1f/d4e/d65/f92 939549 0 2024-04-26T10:44:31.867 INFO:tasks.workunit.client.0.smithi049.stdout:3/630: mknod d3/d23/d2f/d6a/d6b/d26/d65/d70/cd2 0 2024-04-26T10:44:31.868 INFO:tasks.workunit.client.0.smithi049.stdout:6/688: dread da/dd/d47/fb6 [0,4194304] 0 2024-04-26T10:44:31.868 INFO:tasks.workunit.client.0.smithi049.stdout:4/824: link de/d1d/cc4 de/d1b/d5e/d72/cfb 0 2024-04-26T10:44:31.868 INFO:tasks.workunit.client.0.smithi049.stdout:5/749: symlink d7/d1d/d1f/d4e/dad/db3/dcc/l125 0 2024-04-26T10:44:31.869 INFO:tasks.workunit.client.0.smithi049.stdout:6/689: chown da/dd/de/d42/d5a/f4b 7 1 2024-04-26T10:44:31.869 INFO:tasks.workunit.client.0.smithi049.stdout:4/825: creat de/d1b/d5e/d72/d73/dab/ffc x:0 0 0 2024-04-26T10:44:31.870 INFO:tasks.workunit.client.0.smithi049.stdout:5/750: read d7/d66/f73 [3703693,108025] 0 2024-04-26T10:44:31.870 INFO:tasks.workunit.client.0.smithi049.stdout:1/650: dread d1e/f1f [0,4194304] 0 2024-04-26T10:44:31.871 INFO:tasks.workunit.client.0.smithi049.stdout:5/751: write d7/fc [3145303,70206] 0 2024-04-26T10:44:31.871 INFO:tasks.workunit.client.0.smithi049.stdout:4/826: symlink de/d1b/d5e/d90/db1/de5/lfd 0 2024-04-26T10:44:31.872 INFO:tasks.workunit.client.0.smithi049.stdout:3/631: link d3/d23/d2f/d6a/d6b/d8/d55/db4/dca/c3b d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/cd3 0 2024-04-26T10:44:31.872 INFO:tasks.workunit.client.0.smithi049.stdout:1/651: creat d1e/d20/d26/d3c/d96/da3/fcc x:0 0 0 2024-04-26T10:44:31.873 INFO:tasks.workunit.client.0.smithi049.stdout:9/868: dread d2/d1a/df/ddb/fbd [0,4194304] 0 2024-04-26T10:44:31.873 INFO:tasks.workunit.client.0.smithi049.stdout:4/827: chown de/d3f/d48/l65 3 1 2024-04-26T10:44:31.874 INFO:tasks.workunit.client.0.smithi049.stdout:5/752: creat d7/d1d/d34/d123/db2/f126 x:0 0 0 2024-04-26T10:44:31.876 INFO:tasks.workunit.client.0.smithi049.stdout:9/869: symlink d2/d25/dee/d10b/l117 0 2024-04-26T10:44:31.876 INFO:tasks.workunit.client.0.smithi049.stdout:1/652: creat d1e/d20/d26/d3c/d54/d59/d68/fcd x:0 0 0 2024-04-26T10:44:31.876 INFO:tasks.workunit.client.0.smithi049.stdout:8/805: dread d2/df/d10/d23/d6c/f2c [4194304,4194304] 0 2024-04-26T10:44:31.876 INFO:tasks.workunit.client.0.smithi049.stdout:4/828: dread - de/d1b/d5e/d72/d73/d84/f8a zero size 2024-04-26T10:44:31.877 INFO:tasks.workunit.client.0.smithi049.stdout:5/753: read d7/dc6/fda [3959459,21653] 0 2024-04-26T10:44:31.877 INFO:tasks.workunit.client.0.smithi049.stdout:1/653: getdents d1e/d20/d26/d3c/d96 0 2024-04-26T10:44:31.878 INFO:tasks.workunit.client.0.smithi049.stdout:5/754: chown d7/d66/d84/ld3 404858 1 2024-04-26T10:44:31.879 INFO:tasks.workunit.client.0.smithi049.stdout:1/654: mkdir d1e/d20/d4d/d70/dce 0 2024-04-26T10:44:31.880 INFO:tasks.workunit.client.0.smithi049.stdout:5/755: mkdir d7/d1d/d1f/d4e/da0/de2/d127 0 2024-04-26T10:44:31.880 INFO:tasks.workunit.client.0.smithi049.stdout:1/655: chown d1e/d20/l98 1418588309 1 2024-04-26T10:44:31.880 INFO:tasks.workunit.client.0.smithi049.stdout:0/792: write d8/d66/f10f [1570835,70870] 0 2024-04-26T10:44:31.881 INFO:tasks.workunit.client.0.smithi049.stdout:9/870: dwrite d2/d25/f2e [0,4194304] 0 2024-04-26T10:44:31.882 INFO:tasks.workunit.client.0.smithi049.stdout:1/656: write fb [575955,77063] 0 2024-04-26T10:44:31.882 INFO:tasks.workunit.client.0.smithi049.stdout:5/756: dread - d7/d1d/d34/d123/db2/f126 zero size 2024-04-26T10:44:31.883 INFO:tasks.workunit.client.0.smithi049.stdout:3/632: truncate d3/d23/d2f/d6a/d6b/d8/d34/f51 1637231 0 2024-04-26T10:44:31.883 INFO:tasks.workunit.client.0.smithi049.stdout:7/796: dread d2/dd/f66 [0,4194304] 0 2024-04-26T10:44:31.884 INFO:tasks.workunit.client.0.smithi049.stdout:4/829: dwrite de/d1b/f40 [4194304,4194304] 0 2024-04-26T10:44:31.884 INFO:tasks.workunit.client.0.smithi049.stdout:9/871: mkdir d2/d1a/d1b/d1f/d64/df6/d118 0 2024-04-26T10:44:31.884 INFO:tasks.workunit.client.0.smithi049.stdout:0/793: write d8/db/fa0 [4560622,123931] 0 2024-04-26T10:44:31.884 INFO:tasks.workunit.client.0.smithi049.stdout:1/657: mknod d1e/d20/d26/d37/ccf 0 2024-04-26T10:44:31.884 INFO:tasks.workunit.client.0.smithi049.stdout:5/757: fdatasync d7/d14/d18/d48/f5f 0 2024-04-26T10:44:31.885 INFO:tasks.workunit.client.0.smithi049.stdout:0/794: fdatasync d8/d1e/f2b 0 2024-04-26T10:44:31.885 INFO:tasks.workunit.client.0.smithi049.stdout:7/797: mkdir d2/dd/d45/d112 0 2024-04-26T10:44:31.886 INFO:tasks.workunit.client.0.smithi049.stdout:9/872: write d2/d1a/d8a/fdd [244938,126152] 0 2024-04-26T10:44:31.886 INFO:tasks.workunit.client.0.smithi049.stdout:4/830: fdatasync de/d1b/d5e/d72/d73/d84/f7e 0 2024-04-26T10:44:31.886 INFO:tasks.workunit.client.0.smithi049.stdout:5/758: chown d7/d1d/d1f/d4e/d77/f93 4 1 2024-04-26T10:44:31.887 INFO:tasks.workunit.client.0.smithi049.stdout:6/690: dread da/dd/de/d26/f72 [0,4194304] 0 2024-04-26T10:44:31.887 INFO:tasks.workunit.client.0.smithi049.stdout:1/658: write d1e/d20/d26/d3c/fb3 [217079,55082] 0 2024-04-26T10:44:31.888 INFO:tasks.workunit.client.0.smithi049.stdout:7/798: write d2/d3/de/d1c/f36 [4007561,5939] 0 2024-04-26T10:44:31.888 INFO:tasks.workunit.client.0.smithi049.stdout:9/873: creat d2/d25/f119 x:0 0 0 2024-04-26T10:44:31.889 INFO:tasks.workunit.client.0.smithi049.stdout:7/799: chown d2/d3/de 15718 1 2024-04-26T10:44:31.889 INFO:tasks.workunit.client.0.smithi049.stdout:9/874: write d2/d25/d60/fa0 [1522139,27123] 0 2024-04-26T10:44:31.890 INFO:tasks.workunit.client.0.smithi049.stdout:1/659: creat d1e/d20/d26/d37/d8e/d97/fd0 x:0 0 0 2024-04-26T10:44:31.891 INFO:tasks.workunit.client.0.smithi049.stdout:5/759: getdents d7/d1d/d34/d123/d91 0 2024-04-26T10:44:31.891 INFO:tasks.workunit.client.0.smithi049.stdout:9/875: write d2/d1a/f38 [8519,2239] 0 2024-04-26T10:44:31.891 INFO:tasks.workunit.client.0.smithi049.stdout:6/691: dread da/dd/de/d11/f43 [0,4194304] 0 2024-04-26T10:44:31.892 INFO:tasks.workunit.client.0.smithi049.stdout:3/633: dwrite d3/d23/d2f/d6a/d6b/d26/d29/f7d [4194304,4194304] 0 2024-04-26T10:44:31.896 INFO:tasks.workunit.client.0.smithi049.stdout:5/760: dread d7/d1d/d1f/d4e/d65/f92 [0,4194304] 0 2024-04-26T10:44:31.896 INFO:tasks.workunit.client.0.smithi049.stdout:3/634: mknod d3/d23/d2f/d6a/d6b/cd4 0 2024-04-26T10:44:31.897 INFO:tasks.workunit.client.0.smithi049.stdout:2/700: dread d6/f8 [4194304,4194304] 0 2024-04-26T10:44:31.897 INFO:tasks.workunit.client.0.smithi049.stdout:7/800: dwrite d2/dd/d48/fe1 [0,4194304] 0 2024-04-26T10:44:31.898 INFO:tasks.workunit.client.0.smithi049.stdout:6/692: dread da/dd/de/d26/d29/f3d [0,4194304] 0 2024-04-26T10:44:31.899 INFO:tasks.workunit.client.0.smithi049.stdout:0/795: write f3 [240437,71407] 0 2024-04-26T10:44:31.899 INFO:tasks.workunit.client.0.smithi049.stdout:1/660: dwrite d1e/d20/d4d/f5f [0,4194304] 0 2024-04-26T10:44:31.900 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:31.898+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:31.903 INFO:tasks.workunit.client.0.smithi049.stdout:3/635: read - d3/d23/d2f/d6a/d6b/d8/d55/d2e/fcb zero size 2024-04-26T10:44:31.903 INFO:tasks.workunit.client.0.smithi049.stdout:7/801: mkdir d2/dd/d7f/dd1/dfa/d113 0 2024-04-26T10:44:31.903 INFO:tasks.workunit.client.0.smithi049.stdout:5/761: rename d7/d1d/d34/d123/d91/d3e/fe3 to d7/dc6/df7/f128 0 2024-04-26T10:44:31.903 INFO:tasks.workunit.client.0.smithi049.stdout:5/762: sync 2024-04-26T10:44:31.903 INFO:tasks.workunit.client.0.smithi049.stdout:0/796: write d8/db/d11/f83 [4769138,44666] 0 2024-04-26T10:44:31.903 INFO:tasks.workunit.client.0.smithi049.stdout:1/661: stat d1e/d20/d26/d37/d69/d75/lc5 0 2024-04-26T10:44:31.903 INFO:tasks.workunit.client.0.smithi049.stdout:6/693: truncate da/d4a/f6e 892974 0 2024-04-26T10:44:31.903 INFO:tasks.workunit.client.0.smithi049.stdout:1/662: mknod d1e/d20/d26/d57/cd1 0 2024-04-26T10:44:31.903 INFO:tasks.workunit.client.0.smithi049.stdout:0/797: dread - d8/db/d93/d96/d9b/f106 zero size 2024-04-26T10:44:31.904 INFO:tasks.workunit.client.0.smithi049.stdout:3/636: read - d3/d23/d2f/d6a/d6b/d8/d55/d2e/fcb zero size 2024-04-26T10:44:31.904 INFO:tasks.workunit.client.0.smithi049.stdout:7/802: rename d2/dd/d25/d27/df1 to d2/dd/d48/da3/d114 0 2024-04-26T10:44:31.904 INFO:tasks.workunit.client.0.smithi049.stdout:6/694: symlink da/dd/de/d26/d22/d4c/le6 0 2024-04-26T10:44:31.904 INFO:tasks.workunit.client.0.smithi049.stdout:0/798: mknod d8/db/d93/c116 0 2024-04-26T10:44:31.904 INFO:tasks.workunit.client.0.smithi049.stdout:1/663: symlink d1e/d20/daf/ld2 0 2024-04-26T10:44:31.905 INFO:tasks.workunit.client.0.smithi049.stdout:7/803: fdatasync d2/d3/f3c 0 2024-04-26T10:44:31.906 INFO:tasks.workunit.client.0.smithi049.stdout:0/799: truncate d8/f18 1653488 0 2024-04-26T10:44:31.906 INFO:tasks.workunit.client.0.smithi049.stdout:6/695: write da/dd/de/d42/d5a/f4b [2895491,112315] 0 2024-04-26T10:44:31.906 INFO:tasks.workunit.client.0.smithi049.stdout:1/664: dread - d1e/d20/d26/d3c/d54/d59/fbb zero size 2024-04-26T10:44:31.906 INFO:tasks.workunit.client.0.smithi049.stdout:7/804: getdents d2/d3/de/d1c/d100 0 2024-04-26T10:44:31.906 INFO:tasks.workunit.client.0.smithi049.stdout:0/800: readlink d8/d42/lc6 0 2024-04-26T10:44:31.906 INFO:tasks.workunit.client.0.smithi049.stdout:1/665: chown d1e/d20/d26/d37/cb0 11621570 1 2024-04-26T10:44:31.908 INFO:tasks.workunit.client.0.smithi049.stdout:1/666: symlink d1e/d20/d26/d37/d8e/ld3 0 2024-04-26T10:44:31.908 INFO:tasks.workunit.client.0.smithi049.stdout:6/696: dread da/dd/d47/d7b/d84/fc2 [0,4194304] 0 2024-04-26T10:44:31.909 INFO:tasks.workunit.client.0.smithi049.stdout:1/667: chown f16 2274530 1 2024-04-26T10:44:31.910 INFO:tasks.workunit.client.0.smithi049.stdout:6/697: truncate da/dd/f9f 917173 0 2024-04-26T10:44:31.911 INFO:tasks.workunit.client.0.smithi049.stdout:3/637: read d3/d23/d2f/d6a/d6b/d8/d55/f98 [3821839,57938] 0 2024-04-26T10:44:31.911 INFO:tasks.workunit.client.0.smithi049.stdout:0/801: dread d8/d42/f6c [0,4194304] 0 2024-04-26T10:44:31.912 INFO:tasks.workunit.client.0.smithi049.stdout:6/698: creat da/dd/de/d26/d22/fe7 x:0 0 0 2024-04-26T10:44:31.913 INFO:tasks.workunit.client.0.smithi049.stdout:9/876: dread d2/d25/d60/fa0 [0,4194304] 0 2024-04-26T10:44:31.913 INFO:tasks.workunit.client.0.smithi049.stdout:4/831: dwrite de/d1b/d5e/d72/d73/d84/d24/d50/f9c [0,4194304] 0 2024-04-26T10:44:31.913 INFO:tasks.workunit.client.0.smithi049.stdout:0/802: readlink d8/d42/l5c 0 2024-04-26T10:44:31.915 INFO:tasks.workunit.client.0.smithi049.stdout:4/832: mkdir de/dfe 0 2024-04-26T10:44:31.915 INFO:tasks.workunit.client.0.smithi049.stdout:3/638: creat d3/d23/d2f/d6a/d6b/d26/d65/dae/fd5 x:0 0 0 2024-04-26T10:44:31.915 INFO:tasks.workunit.client.0.smithi049.stdout:1/668: link d1e/d20/d26/d3c/d54/d59/d68/fc0 d1e/d20/d26/d37/d8e/d97/fd4 0 2024-04-26T10:44:31.915 INFO:tasks.workunit.client.0.smithi049.stdout:0/803: dread - d8/db/d11/fe7 zero size 2024-04-26T10:44:31.916 INFO:tasks.workunit.client.0.smithi049.stdout:5/763: dread d7/d14/d18/f6e [0,4194304] 0 2024-04-26T10:44:31.916 INFO:tasks.workunit.client.0.smithi049.stdout:6/699: getdents da/dd 0 2024-04-26T10:44:31.917 INFO:tasks.workunit.client.0.smithi049.stdout:1/669: mkdir d1e/dd5 0 2024-04-26T10:44:31.917 INFO:tasks.workunit.client.0.smithi049.stdout:3/639: creat d3/d23/d2f/d6a/d6b/d26/d5f/fd6 x:0 0 0 2024-04-26T10:44:31.918 INFO:tasks.workunit.client.0.smithi049.stdout:5/764: symlink d7/d14/d18/d2b/d117/l129 0 2024-04-26T10:44:31.919 INFO:tasks.workunit.client.0.smithi049.stdout:0/804: getdents d8/d1e 0 2024-04-26T10:44:31.919 INFO:tasks.workunit.client.0.smithi049.stdout:3/640: stat d3/d23/d2f/d6a/d6b/d8/d55/f99 0 2024-04-26T10:44:31.919 INFO:tasks.workunit.client.0.smithi049.stdout:6/700: rmdir da/dd/d47/da3/dcb/dcf 0 2024-04-26T10:44:31.920 INFO:tasks.workunit.client.0.smithi049.stdout:5/765: link d7/d1d/d1f/d4e/d80/lc1 d7/d14/d18/d48/l12a 0 2024-04-26T10:44:31.920 INFO:tasks.workunit.client.0.smithi049.stdout:2/701: dread d6/d9/d5f/f80 [0,4194304] 0 2024-04-26T10:44:31.920 INFO:tasks.workunit.client.0.smithi049.stdout:0/805: mkdir d8/db/d93/d96/d9b/d117 0 2024-04-26T10:44:31.921 INFO:tasks.workunit.client.0.smithi049.stdout:2/702: chown d6/d32/d4a/c75 2328083 1 2024-04-26T10:44:31.921 INFO:tasks.workunit.client.0.smithi049.stdout:6/701: link da/f32 da/dd/d47/d7b/d84/fe8 0 2024-04-26T10:44:31.923 INFO:tasks.workunit.client.0.smithi049.stdout:2/703: write d6/d32/d4a/fd0 [3403413,20004] 0 2024-04-26T10:44:31.924 INFO:tasks.workunit.client.0.smithi049.stdout:5/766: getdents d7/d1d/d1f/d4e/da0/de2 0 2024-04-26T10:44:31.924 INFO:tasks.workunit.client.0.smithi049.stdout:0/806: write d8/db/d11/d1c/dbb/dc1/dd7/de3/ff1 [1645451,7959] 0 2024-04-26T10:44:31.924 INFO:tasks.workunit.client.0.smithi049.stdout:8/806: dread d2/df/f5a [0,4194304] 0 2024-04-26T10:44:31.924 INFO:tasks.workunit.client.0.smithi049.stdout:6/702: mknod da/dd/d47/da3/ce9 0 2024-04-26T10:44:31.926 INFO:tasks.workunit.client.0.smithi049.stdout:6/703: fsync da/dd/de/d42/d5a/fd5 0 2024-04-26T10:44:31.926 INFO:tasks.workunit.client.0.smithi049.stdout:2/704: mknod d6/d9/d5f/dba/d34/cd9 0 2024-04-26T10:44:31.926 INFO:tasks.workunit.client.0.smithi049.stdout:8/807: symlink d2/d16/d19/d42/l10a 0 2024-04-26T10:44:31.926 INFO:tasks.workunit.client.0.smithi049.stdout:5/767: rmdir d7/d1d/d1f/d4e/d77 39 2024-04-26T10:44:31.926 INFO:tasks.workunit.client.0.smithi049.stdout:5/768: sync 2024-04-26T10:44:31.926 INFO:tasks.workunit.client.0.smithi049.stdout:0/807: mkdir d8/d109/d10e/d118 0 2024-04-26T10:44:31.927 INFO:tasks.workunit.client.0.smithi049.stdout:3/641: truncate d3/d23/d2f/d6a/d6b/d8/d55/f2d 7793815 0 2024-04-26T10:44:31.927 INFO:tasks.workunit.client.0.smithi049.stdout:7/805: dread d2/dd/d38/f4c [0,4194304] 0 2024-04-26T10:44:31.929 INFO:tasks.workunit.client.0.smithi049.stdout:5/769: stat d7/d1d/d34/d123/d91/d3e/d60/faa 0 2024-04-26T10:44:31.929 INFO:tasks.workunit.client.0.smithi049.stdout:7/806: stat d2/d3/d96/ddc/ce2 0 2024-04-26T10:44:31.929 INFO:tasks.workunit.client.0.smithi049.stdout:3/642: read d3/d23/d2f/d6a/d6b/d26/d65/dae/fbe [2744270,107429] 0 2024-04-26T10:44:31.930 INFO:tasks.workunit.client.0.smithi049.stdout:0/808: truncate d8/db/d26/d6f/fd0 570291 0 2024-04-26T10:44:31.932 INFO:tasks.workunit.client.0.smithi049.stdout:7/807: mkdir d2/dd/dd3/df5/d115 0 2024-04-26T10:44:31.933 INFO:tasks.workunit.client.0.smithi049.stdout:5/770: chown d7/d1d/d34/d123/d91/d3e/d60/d10d/l10f 14309 1 2024-04-26T10:44:31.933 INFO:tasks.workunit.client.0.smithi049.stdout:3/643: symlink d3/d23/d2f/d6a/d6b/d8/ld7 0 2024-04-26T10:44:31.933 INFO:tasks.workunit.client.0.smithi049.stdout:0/809: write d8/d66/f10a [1464310,34968] 0 2024-04-26T10:44:31.933 INFO:tasks.workunit.client.0.smithi049.stdout:2/705: dread d6/d9/d5f/dba/d11/f43 [0,4194304] 0 2024-04-26T10:44:31.934 INFO:tasks.workunit.client.0.smithi049.stdout:5/771: mkdir d7/d53/d12b 0 2024-04-26T10:44:31.934 INFO:tasks.workunit.client.0.smithi049.stdout:7/808: read - d2/dd/d48/da3/fd2 zero size 2024-04-26T10:44:31.934 INFO:tasks.workunit.client.0.smithi049.stdout:7/809: sync 2024-04-26T10:44:31.935 INFO:tasks.workunit.client.0.smithi049.stdout:0/810: mknod d8/db/d26/daf/c119 0 2024-04-26T10:44:31.935 INFO:tasks.workunit.client.0.smithi049.stdout:3/644: dread - d3/d23/d2f/d6a/f7f zero size 2024-04-26T10:44:31.935 INFO:tasks.workunit.client.0.smithi049.stdout:6/704: dwrite da/dd/de/d26/f6f [4194304,4194304] 0 2024-04-26T10:44:31.937 INFO:tasks.workunit.client.0.smithi049.stdout:5/772: chown d7/d1d/d1f/d4e/dad/cec 21449133 1 2024-04-26T10:44:31.937 INFO:tasks.workunit.client.0.smithi049.stdout:9/877: dread d2/d1a/d1b/f16 [0,4194304] 0 2024-04-26T10:44:31.937 INFO:tasks.workunit.client.0.smithi049.stdout:6/705: truncate da/f38 1651449 0 2024-04-26T10:44:31.938 INFO:tasks.workunit.client.0.smithi049.stdout:1/670: dread fa [0,4194304] 0 2024-04-26T10:44:31.938 INFO:tasks.workunit.client.0.smithi049.stdout:0/811: truncate d8/db/d26/d6f/fd0 925886 0 2024-04-26T10:44:31.939 INFO:tasks.workunit.client.0.smithi049.stdout:5/773: stat d7/d14/d18/d48/lf6 0 2024-04-26T10:44:31.939 INFO:tasks.workunit.client.0.smithi049.stdout:9/878: chown d2/d1a/df/c17 25 1 2024-04-26T10:44:31.939 INFO:tasks.workunit.client.0.smithi049.stdout:0/812: write f3 [53600,66822] 0 2024-04-26T10:44:31.940 INFO:tasks.workunit.client.0.smithi049.stdout:8/808: dread d2/d16/f9b [0,4194304] 0 2024-04-26T10:44:31.940 INFO:tasks.workunit.client.0.smithi049.stdout:3/645: unlink d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/l1d 0 2024-04-26T10:44:31.940 INFO:tasks.workunit.client.0.smithi049.stdout:6/706: creat da/dd/d62/daf/fea x:0 0 0 2024-04-26T10:44:31.940 INFO:tasks.workunit.client.0.smithi049.stdout:1/671: getdents d1e/dd5 0 2024-04-26T10:44:31.942 INFO:tasks.workunit.client.0.smithi049.stdout:4/833: dread f1 [4194304,4194304] 0 2024-04-26T10:44:31.943 INFO:tasks.workunit.client.0.smithi049.stdout:0/813: mknod d8/db/d93/d96/d9b/dff/c11a 0 2024-04-26T10:44:31.944 INFO:tasks.workunit.client.0.smithi049.stdout:1/672: creat d1e/d20/fd6 x:0 0 0 2024-04-26T10:44:31.944 INFO:tasks.workunit.client.0.smithi049.stdout:5/774: truncate d7/d1d/d1f/d4e/d65/f92 513245 0 2024-04-26T10:44:31.945 INFO:tasks.workunit.client.0.smithi049.stdout:4/834: write de/d1b/d5e/fac [239019,20166] 0 2024-04-26T10:44:31.945 INFO:tasks.workunit.client.0.smithi049.stdout:2/706: dwrite d6/f29 [0,4194304] 0 2024-04-26T10:44:31.945 INFO:tasks.workunit.client.0.smithi049.stdout:8/809: getdents d2/d16/d88 0 2024-04-26T10:44:31.946 INFO:tasks.workunit.client.0.smithi049.stdout:7/810: dwrite d2/dd/f3f [0,4194304] 0 2024-04-26T10:44:31.947 INFO:tasks.workunit.client.0.smithi049.stdout:7/811: read - d2/d3/d96/ffc zero size 2024-04-26T10:44:31.949 INFO:tasks.workunit.client.0.smithi049.stdout:5/775: chown d7/d66/d84/d103/cd2 12908762 1 2024-04-26T10:44:31.949 INFO:tasks.workunit.client.0.smithi049.stdout:8/810: readlink d2/d17/d34/d40/d64/le6 0 2024-04-26T10:44:31.949 INFO:tasks.workunit.client.0.smithi049.stdout:1/673: creat d1e/d20/d26/d3c/d54/d59/d73/dab/fd7 x:0 0 0 2024-04-26T10:44:31.949 INFO:tasks.workunit.client.0.smithi049.stdout:9/879: dread d2/d1a/d1b/d1f/d34/fd5 [0,4194304] 0 2024-04-26T10:44:31.949 INFO:tasks.workunit.client.0.smithi049.stdout:4/835: getdents de/d1b/d5e/d72/d73/d84 0 2024-04-26T10:44:31.950 INFO:tasks.workunit.client.0.smithi049.stdout:1/674: dread - d1e/d20/d26/d3c/d54/d59/fbb zero size 2024-04-26T10:44:31.950 INFO:tasks.workunit.client.0.smithi049.stdout:7/812: write d2/dd/d48/da3/fd2 [375861,44987] 0 2024-04-26T10:44:31.950 INFO:tasks.workunit.client.0.smithi049.stdout:2/707: truncate d6/d9/d5f/dba/d1e/fb2 811940 0 2024-04-26T10:44:31.952 INFO:tasks.workunit.client.0.smithi049.stdout:5/776: creat d7/d1d/d1f/d4e/dad/f12c x:0 0 0 2024-04-26T10:44:31.952 INFO:tasks.workunit.client.0.smithi049.stdout:8/811: creat d2/d17/d34/d40/f10b x:0 0 0 2024-04-26T10:44:31.952 INFO:tasks.workunit.client.0.smithi049.stdout:5/777: chown d7/d14/f38 44177 1 2024-04-26T10:44:31.952 INFO:tasks.workunit.client.0.smithi049.stdout:1/675: truncate d1e/d20/f32 1000412 0 2024-04-26T10:44:31.953 INFO:tasks.workunit.client.0.smithi049.stdout:0/814: truncate d8/db/d26/d6f/f9c 3317291 0 2024-04-26T10:44:31.953 INFO:tasks.workunit.client.0.smithi049.stdout:9/880: creat d2/d40/d53/de7/df2/f11a x:0 0 0 2024-04-26T10:44:31.953 INFO:tasks.workunit.client.0.smithi049.stdout:4/836: link de/cf8 de/cff 0 2024-04-26T10:44:31.954 INFO:tasks.workunit.client.0.smithi049.stdout:8/812: getdents d2/df/d10/d47 0 2024-04-26T10:44:31.954 INFO:tasks.workunit.client.0.smithi049.stdout:0/815: rmdir d8/db/d11 39 2024-04-26T10:44:31.954 INFO:tasks.workunit.client.0.smithi049.stdout:7/813: link d2/d3/f91 d2/dd/d45/d82/f116 0 2024-04-26T10:44:31.954 INFO:tasks.workunit.client.0.smithi049.stdout:2/708: truncate d6/d32/d69/f8e 245470 0 2024-04-26T10:44:31.954 INFO:tasks.workunit.client.0.smithi049.stdout:0/816: chown d8/d66/d84 6990 1 2024-04-26T10:44:31.955 INFO:tasks.workunit.client.0.smithi049.stdout:9/881: rename d2/d25/d74/dc2 to d2/d1a/d42/de3/d11b 0 2024-04-26T10:44:31.958 INFO:tasks.workunit.client.0.smithi049.stdout:4/837: getdents de/d1b/d5e/d72/d73 0 2024-04-26T10:44:31.958 INFO:tasks.workunit.client.0.smithi049.stdout:2/709: creat d6/d9/d5f/dba/d35/fda x:0 0 0 2024-04-26T10:44:31.958 INFO:tasks.workunit.client.0.smithi049.stdout:8/813: write d2/d17/d34/d40/d64/dcd/df0/d109/fa9 [3327944,47651] 0 2024-04-26T10:44:31.958 INFO:tasks.workunit.client.0.smithi049.stdout:5/778: dwrite d7/d1d/d34/d123/d91/d3e/f42 [4194304,4194304] 0 2024-04-26T10:44:31.958 INFO:tasks.workunit.client.0.smithi049.stdout:9/882: getdents d2/d1a/d42/de3/deb 0 2024-04-26T10:44:31.959 INFO:tasks.workunit.client.0.smithi049.stdout:5/779: chown d7/d1d/d34/d123/d91/f4a 10239 1 2024-04-26T10:44:31.960 INFO:tasks.workunit.client.0.smithi049.stdout:4/838: creat de/d1b/d5e/d90/db1/f100 x:0 0 0 2024-04-26T10:44:31.960 INFO:tasks.workunit.client.0.smithi049.stdout:0/817: read d8/d1e/f67 [895946,23152] 0 2024-04-26T10:44:31.961 INFO:tasks.workunit.client.0.smithi049.stdout:8/814: getdents d2/d17/d34 0 2024-04-26T10:44:31.962 INFO:tasks.workunit.client.0.smithi049.stdout:5/780: rename d7/d1d/d1f/d4e/d77/f93 to d7/d1d/d1f/f12d 0 2024-04-26T10:44:31.962 INFO:tasks.workunit.client.0.smithi049.stdout:4/839: write de/d1b/d5e/d99/fc0 [1635575,16440] 0 2024-04-26T10:44:31.964 INFO:tasks.workunit.client.0.smithi049.stdout:3/646: dread d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/f3f [0,4194304] 0 2024-04-26T10:44:31.965 INFO:tasks.workunit.client.0.smithi049.stdout:2/710: truncate d6/f29 2982921 0 2024-04-26T10:44:31.965 INFO:tasks.workunit.client.0.smithi049.stdout:7/814: dwrite d2/d3/de/d1c/f94 [0,4194304] 0 2024-04-26T10:44:31.967 INFO:tasks.workunit.client.0.smithi049.stdout:4/840: unlink de/d1b/d5e/d72/d73/d84/d24/d50/c8e 0 2024-04-26T10:44:31.967 INFO:tasks.workunit.client.0.smithi049.stdout:7/815: fsync d2/dd/d38/f44 0 2024-04-26T10:44:31.967 INFO:tasks.workunit.client.0.smithi049.stdout:9/883: dwrite d2/d25/d74/ff8 [0,4194304] 0 2024-04-26T10:44:31.969 INFO:tasks.workunit.client.0.smithi049.stdout:5/781: read d7/d1d/d34/d123/d91/f4f [1367891,3932] 0 2024-04-26T10:44:31.970 INFO:tasks.workunit.client.0.smithi049.stdout:9/884: read - d2/ff3 zero size 2024-04-26T10:44:31.971 INFO:tasks.workunit.client.0.smithi049.stdout:8/815: link d2/d1a/fff d2/d17/d34/d40/d64/dcd/df0/d109/d2a/f10c 0 2024-04-26T10:44:31.971 INFO:tasks.workunit.client.0.smithi049.stdout:2/711: truncate d6/f64 4037914 0 2024-04-26T10:44:31.971 INFO:tasks.workunit.client.0.smithi049.stdout:0/818: dread d8/f3d [0,4194304] 0 2024-04-26T10:44:31.972 INFO:tasks.workunit.client.0.smithi049.stdout:0/819: sync 2024-04-26T10:44:31.973 INFO:tasks.workunit.client.0.smithi049.stdout:7/816: creat d2/dd/d25/f117 x:0 0 0 2024-04-26T10:44:31.973 INFO:tasks.workunit.client.0.smithi049.stdout:9/885: read d2/d1a/d1b/d1f/d34/fc9 [395235,86563] 0 2024-04-26T10:44:31.973 INFO:tasks.workunit.client.0.smithi049.stdout:0/820: chown d8/d66/d84/c9d 86 1 2024-04-26T10:44:31.974 INFO:tasks.workunit.client.0.smithi049.stdout:2/712: creat d6/d9/d5f/dba/d11/fdb x:0 0 0 2024-04-26T10:44:31.975 INFO:tasks.workunit.client.0.smithi049.stdout:8/816: rmdir d2 39 2024-04-26T10:44:31.975 INFO:tasks.workunit.client.0.smithi049.stdout:3/647: dwrite d3/d23/d2f/d6a/d6b/d8/dd/fac [0,4194304] 0 2024-04-26T10:44:31.979 INFO:tasks.workunit.client.0.smithi049.stdout:0/821: dread - d8/db/d11/d1c/ffc zero size 2024-04-26T10:44:31.979 INFO:tasks.workunit.client.0.smithi049.stdout:2/713: creat d6/d9/d5f/dba/d11/d6a/d9f/fdc x:0 0 0 2024-04-26T10:44:31.979 INFO:tasks.workunit.client.0.smithi049.stdout:6/707: dread f9 [0,4194304] 0 2024-04-26T10:44:31.979 INFO:tasks.workunit.client.0.smithi049.stdout:7/817: chown d2/d3/de/l18 3 1 2024-04-26T10:44:31.979 INFO:tasks.workunit.client.0.smithi049.stdout:5/782: dwrite d7/d14/f1a [0,4194304] 0 2024-04-26T10:44:31.979 INFO:tasks.workunit.client.0.smithi049.stdout:9/886: link d2/d1a/df/c48 d2/d1a/d8a/c11c 0 2024-04-26T10:44:31.979 INFO:tasks.workunit.client.0.smithi049.stdout:4/841: dwrite de/d1b/d5e/d72/d73/fd1 [4194304,4194304] 0 2024-04-26T10:44:31.980 INFO:tasks.workunit.client.0.smithi049.stdout:8/817: mkdir d2/d16/d19/d42/d7c/d10d 0 2024-04-26T10:44:31.981 INFO:tasks.workunit.client.0.smithi049.stdout:5/783: readlink d7/d1d/d1f/d4e/d80/lc8 0 2024-04-26T10:44:31.981 INFO:tasks.workunit.client.0.smithi049.stdout:0/822: fdatasync d8/d42/f6c 0 2024-04-26T10:44:31.981 INFO:tasks.workunit.client.0.smithi049.stdout:3/648: write d3/d23/d2f/d6a/d6b/d26/d65/d70/d96/fb3 [87177,90446] 0 2024-04-26T10:44:31.981 INFO:tasks.workunit.client.0.smithi049.stdout:2/714: dread - d6/d30/d97/fab zero size 2024-04-26T10:44:31.981 INFO:tasks.workunit.client.0.smithi049.stdout:4/842: mkdir de/dea/d101 0 2024-04-26T10:44:31.982 INFO:tasks.workunit.client.0.smithi049.stdout:7/818: truncate d2/dd/d38/f40 1005817 0 2024-04-26T10:44:31.984 INFO:tasks.workunit.client.0.smithi049.stdout:0/823: mknod d8/db/d11/d1b/d4d/c11b 0 2024-04-26T10:44:31.984 INFO:tasks.workunit.client.0.smithi049.stdout:3/649: fsync d3/d23/d2f/d6a/d6b/d8/d55/d2e/f4c 0 2024-04-26T10:44:31.984 INFO:tasks.workunit.client.0.smithi049.stdout:8/818: write d2/df/d10/d23/d6c/d5e/fd4 [4597450,1499] 0 2024-04-26T10:44:31.984 INFO:tasks.workunit.client.0.smithi049.stdout:4/843: creat de/d1b/d5e/d90/db1/f102 x:0 0 0 2024-04-26T10:44:31.984 INFO:tasks.workunit.client.0.smithi049.stdout:5/784: mkdir d7/d1d/d34/d123/d91/d3e/d60/d10d/d12e 0 2024-04-26T10:44:31.984 INFO:tasks.workunit.client.0.smithi049.stdout:0/824: readlink d8/db/d11/d1b/ldf 0 2024-04-26T10:44:31.985 INFO:tasks.workunit.client.0.smithi049.stdout:4/844: stat de/d1b/d5e/d90 0 2024-04-26T10:44:31.987 INFO:tasks.workunit.client.0.smithi049.stdout:6/708: dwrite da/dd/fe3 [0,4194304] 0 2024-04-26T10:44:31.988 INFO:tasks.workunit.client.0.smithi049.stdout:1/676: dread d1e/d20/f6b [0,4194304] 0 2024-04-26T10:44:31.989 INFO:tasks.workunit.client.0.smithi049.stdout:5/785: creat d7/d1d/d34/d123/d91/d3e/d7b/f12f x:0 0 0 2024-04-26T10:44:31.989 INFO:tasks.workunit.client.0.smithi049.stdout:2/715: dread d6/d32/f87 [0,4194304] 0 2024-04-26T10:44:31.989 INFO:tasks.workunit.client.0.smithi049.stdout:0/825: mknod d8/db/d93/d96/d9b/d117/c11c 0 2024-04-26T10:44:31.990 INFO:tasks.workunit.client.0.smithi049.stdout:6/709: creat da/d4a/feb x:0 0 0 2024-04-26T10:44:31.990 INFO:tasks.workunit.client.0.smithi049.stdout:1/677: mknod d1e/d20/d4d/d70/cd8 0 2024-04-26T10:44:31.992 INFO:tasks.workunit.client.0.smithi049.stdout:8/819: read d2/f14 [1677565,49802] 0 2024-04-26T10:44:31.992 INFO:tasks.workunit.client.0.smithi049.stdout:1/678: mkdir d1e/d20/d67/dd9 0 2024-04-26T10:44:31.993 INFO:tasks.workunit.client.0.smithi049.stdout:7/819: dwrite d2/dd/d25/fa4 [0,4194304] 0 2024-04-26T10:44:31.994 INFO:tasks.workunit.client.0.smithi049.stdout:4/845: dread de/d1b/d5e/d72/d73/d84/d38/f3b [0,4194304] 0 2024-04-26T10:44:31.994 INFO:tasks.workunit.client.0.smithi049.stdout:1/679: mkdir d1e/d62/dda 0 2024-04-26T10:44:31.994 INFO:tasks.workunit.client.0.smithi049.stdout:6/710: chown da/dd/de/d26/fbb 43544 1 2024-04-26T10:44:31.995 INFO:tasks.workunit.client.0.smithi049.stdout:5/786: rename d7/d1d/d34/d123/d91/d106/d10e to d7/d53/d130 0 2024-04-26T10:44:31.995 INFO:tasks.workunit.client.0.smithi049.stdout:3/650: dwrite d3/d23/d2f/d6a/d6b/d8/dd/f7c [0,4194304] 0 2024-04-26T10:44:31.995 INFO:tasks.workunit.client.0.smithi049.stdout:0/826: rmdir d8/db/d93/d96 39 2024-04-26T10:44:31.995 INFO:tasks.workunit.client.0.smithi049.stdout:8/820: symlink d2/d17/d34/d40/d64/dcd/df0/d109/d30/l10e 0 2024-04-26T10:44:31.996 INFO:tasks.workunit.client.0.smithi049.stdout:6/711: mknod da/dd/de/cec 0 2024-04-26T10:44:31.997 INFO:tasks.workunit.client.0.smithi049.stdout:5/787: rmdir d7/d53/d12b 0 2024-04-26T10:44:31.998 INFO:tasks.workunit.client.0.smithi049.stdout:7/820: link d2/dd/d48/d5c/f9d d2/dd/f118 0 2024-04-26T10:44:31.998 INFO:tasks.workunit.client.0.smithi049.stdout:8/821: unlink d2/d16/d88/l61 0 2024-04-26T10:44:31.999 INFO:tasks.workunit.client.0.smithi049.stdout:6/712: readlink da/dd/de/d26/d22/d4c/l90 0 2024-04-26T10:44:32.000 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:31.998+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:32.001 INFO:tasks.workunit.client.0.smithi049.stdout:7/821: chown d2/f8e 830 1 2024-04-26T10:44:32.001 INFO:tasks.workunit.client.0.smithi049.stdout:5/788: write d7/d1d/d1f/d4e/d65/fb0 [874884,100322] 0 2024-04-26T10:44:32.001 INFO:tasks.workunit.client.0.smithi049.stdout:8/822: rmdir d2/d16/d19 39 2024-04-26T10:44:32.004 INFO:tasks.workunit.client.0.smithi049.stdout:7/822: mkdir d2/dd/d25/d27/d119 0 2024-04-26T10:44:32.004 INFO:tasks.workunit.client.0.smithi049.stdout:5/789: write d7/d14/d18/ffa [936701,121048] 0 2024-04-26T10:44:32.004 INFO:tasks.workunit.client.0.smithi049.stdout:8/823: read - d2/d17/d34/d40/f10b zero size 2024-04-26T10:44:32.004 INFO:tasks.workunit.client.0.smithi049.stdout:1/680: dwrite fa [4194304,4194304] 0 2024-04-26T10:44:32.005 INFO:tasks.workunit.client.0.smithi049.stdout:6/713: truncate da/dd/de/d11/f5d 4277839 0 2024-04-26T10:44:32.006 INFO:tasks.workunit.client.0.smithi049.stdout:3/651: dwrite d3/d23/d2f/d6a/d6b/d8/d82/f8b [4194304,4194304] 0 2024-04-26T10:44:32.006 INFO:tasks.workunit.client.0.smithi049.stdout:7/823: mkdir d2/dd/d48/da3/d11a 0 2024-04-26T10:44:32.007 INFO:tasks.workunit.client.0.smithi049.stdout:7/824: sync 2024-04-26T10:44:32.007 INFO:tasks.workunit.client.0.smithi049.stdout:1/681: stat d1e/d20/d4d/d70/cd8 0 2024-04-26T10:44:32.007 INFO:tasks.workunit.client.0.smithi049.stdout:4/846: dwrite de/d3f/d52/d9b/da5/fcd [0,4194304] 0 2024-04-26T10:44:32.007 INFO:tasks.workunit.client.0.smithi049.stdout:8/824: unlink d2/d16/d19/lac 0 2024-04-26T10:44:32.008 INFO:tasks.workunit.client.0.smithi049.stdout:6/714: chown da/dd/de/d42/d5a/fd5 51678010 1 2024-04-26T10:44:32.008 INFO:tasks.workunit.client.0.smithi049.stdout:7/825: symlink d2/dd/d7f/db1/l11b 0 2024-04-26T10:44:32.008 INFO:tasks.workunit.client.0.smithi049.stdout:1/682: symlink d1e/d20/d26/d37/d69/d75/ldb 0 2024-04-26T10:44:32.008 INFO:tasks.workunit.client.0.smithi049.stdout:4/847: creat de/d1b/d5e/d90/db1/f103 x:0 0 0 2024-04-26T10:44:32.009 INFO:tasks.workunit.client.0.smithi049.stdout:8/825: creat d2/d16/d19/d42/d7c/f10f x:0 0 0 2024-04-26T10:44:32.010 INFO:tasks.workunit.client.0.smithi049.stdout:7/826: truncate d2/dd/d48/f59 1037375 0 2024-04-26T10:44:32.010 INFO:tasks.workunit.client.0.smithi049.stdout:1/683: unlink d1e/d20/d26/d37/d69/d75/l94 0 2024-04-26T10:44:32.011 INFO:tasks.workunit.client.0.smithi049.stdout:6/715: truncate da/dd/d47/d7b/fd6 933553 0 2024-04-26T10:44:32.011 INFO:tasks.workunit.client.0.smithi049.stdout:4/848: write de/d1b/d5e/d72/d73/d84/f35 [15614023,35915] 0 2024-04-26T10:44:32.012 INFO:tasks.workunit.client.0.smithi049.stdout:6/716: creat da/d4a/fed x:0 0 0 2024-04-26T10:44:32.012 INFO:tasks.workunit.client.0.smithi049.stdout:4/849: fsync de/d1b/d5e/d72/d73/f85 0 2024-04-26T10:44:32.014 INFO:tasks.workunit.client.0.smithi049.stdout:4/850: creat de/d1b/d5e/d72/d73/d84/f104 x:0 0 0 2024-04-26T10:44:32.014 INFO:tasks.workunit.client.0.smithi049.stdout:6/717: truncate da/dd/d47/d7b/f81 170468 0 2024-04-26T10:44:32.016 INFO:tasks.workunit.client.0.smithi049.stdout:0/827: dread d8/db/f33 [0,4194304] 0 2024-04-26T10:44:32.016 INFO:tasks.workunit.client.0.smithi049.stdout:6/718: chown da/dd/de/c60 4 1 2024-04-26T10:44:32.016 INFO:tasks.workunit.client.0.smithi049.stdout:7/827: dwrite d2/d3/f20 [0,4194304] 0 2024-04-26T10:44:32.019 INFO:tasks.workunit.client.0.smithi049.stdout:0/828: getdents d8/db 0 2024-04-26T10:44:32.019 INFO:tasks.workunit.client.0.smithi049.stdout:1/684: dwrite d1e/d20/d26/d3c/d54/d59/d73/dab/fb4 [0,4194304] 0 2024-04-26T10:44:32.022 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:32.022 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:32.022 INFO:tasks.workunit.client.0.smithi049.stdout:7/828: dwrite d2/dd/d38/fa1 [0,4194304] 0 2024-04-26T10:44:32.023 INFO:tasks.workunit.client.0.smithi049.stdout:5/790: truncate d7/d1d/d34/d123/f5c 1902505 0 2024-04-26T10:44:32.023 INFO:tasks.workunit.client.0.smithi049.stdout:1/685: chown d1e/d20/d4d/l79 2804 1 2024-04-26T10:44:32.023 INFO:tasks.workunit.client.0.smithi049.stdout:5/791: dread - d7/d66/ff9 zero size 2024-04-26T10:44:32.023 INFO:tasks.workunit.client.0.smithi049.stdout:1/686: stat d1e/d20/d26/d37/d6e 0 2024-04-26T10:44:32.024 INFO:tasks.workunit.client.0.smithi049.stdout:6/719: write da/dd/de/d42/d5a/f74 [1646071,92385] 0 2024-04-26T10:44:32.025 INFO:tasks.workunit.client.0.smithi049.stdout:5/792: rmdir d7/dc6 39 2024-04-26T10:44:32.026 INFO:tasks.workunit.client.0.smithi049.stdout:0/829: dwrite d8/db/d11/d1b/d4d/dae/ff5 [0,4194304] 0 2024-04-26T10:44:32.026 INFO:tasks.workunit.client.0.smithi049.stdout:1/687: link d1e/d20/d4d/fac d1e/d20/d26/d3c/d54/d59/fdc 0 2024-04-26T10:44:32.027 INFO:tasks.workunit.client.0.smithi049.stdout:6/720: rename da/dd/d47/da3/dcb to da/dd/de/d11/dee 0 2024-04-26T10:44:32.027 INFO:tasks.workunit.client.0.smithi049.stdout:1/688: mkdir d1e/d20/d26/d37/d8e/d97/ddd 0 2024-04-26T10:44:32.028 INFO:tasks.workunit.client.0.smithi049.stdout:6/721: mknod da/dd/de/d11/cef 0 2024-04-26T10:44:32.028 INFO:tasks.workunit.client.0.smithi049.stdout:0/830: creat d8/db/d93/d96/d9b/f11d x:0 0 0 2024-04-26T10:44:32.028 INFO:tasks.workunit.client.0.smithi049.stdout:6/722: chown da/dd/l87 29371490 1 2024-04-26T10:44:32.029 INFO:tasks.workunit.client.0.smithi049.stdout:1/689: creat d1e/d20/d26/d3c/d54/d59/d68/fde x:0 0 0 2024-04-26T10:44:32.029 INFO:tasks.workunit.client.0.smithi049.stdout:0/831: truncate d8/f18 985694 0 2024-04-26T10:44:32.030 INFO:tasks.workunit.client.0.smithi049.stdout:6/723: rename da/dd/d47/d7b/d84/daa/de4 to da/dd/df0 0 2024-04-26T10:44:32.031 INFO:tasks.workunit.client.0.smithi049.stdout:0/832: write d8/db/d11/d1c/dbb/dc1/dd7/de3/ff1 [307282,8080] 0 2024-04-26T10:44:32.031 INFO:tasks.workunit.client.0.smithi049.stdout:6/724: mkdir da/dd/de/db5/df1 0 2024-04-26T10:44:32.031 INFO:tasks.workunit.client.0.smithi049.stdout:0/833: readlink d8/db/d11/lb5 0 2024-04-26T10:44:32.032 INFO:tasks.workunit.client.0.smithi049.stdout:0/834: sync 2024-04-26T10:44:32.033 INFO:tasks.workunit.client.0.smithi049.stdout:1/690: getdents d1e/d20/d26/d3c/d54/d59/d73/dab 0 2024-04-26T10:44:32.033 INFO:tasks.workunit.client.0.smithi049.stdout:0/835: unlink d8/d66/ld9 0 2024-04-26T10:44:32.033 INFO:tasks.workunit.client.0.smithi049.stdout:6/725: mkdir da/d4a/de0/df2 0 2024-04-26T10:44:32.033 INFO:tasks.workunit.client.0.smithi049.stdout:5/793: truncate d7/d1d/d34/d123/d91/d3e/f42 4860853 0 2024-04-26T10:44:32.034 INFO:tasks.workunit.client.0.smithi049.stdout:5/794: symlink d7/d1d/d1f/l131 0 2024-04-26T10:44:32.034 INFO:tasks.workunit.client.0.smithi049.stdout:6/726: chown da/dd/de/d26/d22/d4c/fb2 57568 1 2024-04-26T10:44:32.034 INFO:tasks.workunit.client.0.smithi049.stdout:1/691: getdents d1e/d20/d26/d3c/d54/d59/d68 0 2024-04-26T10:44:32.035 INFO:tasks.workunit.client.0.smithi049.stdout:6/727: write da/dd/de/f96 [5391343,111002] 0 2024-04-26T10:44:32.035 INFO:tasks.workunit.client.0.smithi049.stdout:5/795: chown d7/d1d/d34/d123/d91/d3e/d60/f7a 10040 1 2024-04-26T10:44:32.037 INFO:tasks.workunit.client.0.smithi049.stdout:6/728: read da/dd/de/d26/f6f [8293731,91148] 0 2024-04-26T10:44:32.037 INFO:tasks.workunit.client.0.smithi049.stdout:1/692: link d1e/d20/f32 d1e/d20/d26/d37/d69/fdf 0 2024-04-26T10:44:32.038 INFO:tasks.workunit.client.0.smithi049.stdout:5/796: creat d7/d1d/d34/d123/d91/d3e/d60/d10d/f132 x:0 0 0 2024-04-26T10:44:32.038 INFO:tasks.workunit.client.0.smithi049.stdout:6/729: chown da/dd/de/d42/c86 49 1 2024-04-26T10:44:32.040 INFO:tasks.workunit.client.0.smithi049.stdout:0/836: dwrite d8/db/d26/d39/fa4 [0,4194304] 0 2024-04-26T10:44:32.041 INFO:tasks.workunit.client.0.smithi049.stdout:1/693: symlink d1e/d20/d26/d3c/d54/le0 0 2024-04-26T10:44:32.041 INFO:tasks.workunit.client.0.smithi049.stdout:6/730: fdatasync da/dd/de/d42/d5a/f4b 0 2024-04-26T10:44:32.041 INFO:tasks.workunit.client.0.smithi049.stdout:0/837: creat d8/db/d26/f11e x:0 0 0 2024-04-26T10:44:32.042 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:32.043 INFO:tasks.workunit.client.0.smithi049.stdout:0/838: stat d8/d66/fb4 0 2024-04-26T10:44:32.043 INFO:tasks.workunit.client.0.smithi049.stdout:6/731: creat da/d4a/de0/df2/ff3 x:0 0 0 2024-04-26T10:44:32.043 INFO:tasks.workunit.client.0.smithi049.stdout:9/887: dread d2/d25/d74/f59 [0,4194304] 0 2024-04-26T10:44:32.044 INFO:tasks.workunit.client.0.smithi049.stdout:0/839: read d8/db/d11/d1b/d4d/f64 [1078798,74769] 0 2024-04-26T10:44:32.045 INFO:tasks.workunit.client.0.smithi049.stdout:9/888: creat d2/d1a/df/f11d x:0 0 0 2024-04-26T10:44:32.045 INFO:tasks.workunit.client.0.smithi049.stdout:6/732: rename da/dd/de/d26/d22/l3a to da/dd/de/d26/lf4 0 2024-04-26T10:44:32.046 INFO:tasks.workunit.client.0.smithi049.stdout:5/797: dwrite d7/d1d/d34/d123/d91/d3e/fa7 [4194304,4194304] 0 2024-04-26T10:44:32.048 INFO:tasks.workunit.client.0.smithi049.stdout:0/840: truncate f2 5720298 0 2024-04-26T10:44:32.048 INFO:tasks.workunit.client.0.smithi049.stdout:6/733: mknod da/dd/de/d11/dbc/cf5 0 2024-04-26T10:44:32.049 INFO:tasks.workunit.client.0.smithi049.stdout:8/826: dread d2/d17/f69 [0,4194304] 0 2024-04-26T10:44:32.050 INFO:tasks.workunit.client.0.smithi049.stdout:0/841: fsync d8/db/d26/d39/f99 0 2024-04-26T10:44:32.050 INFO:tasks.workunit.client.0.smithi049.stdout:6/734: mkdir da/dd/de/d42/df6 0 2024-04-26T10:44:32.051 INFO:tasks.workunit.client.0.smithi049.stdout:8/827: mkdir d2/d16/d88/dfb/d110 0 2024-04-26T10:44:32.052 INFO:tasks.workunit.client.0.smithi049.stdout:0/842: rename d8/d42/c68 to d8/db/d93/d96/c11f 0 2024-04-26T10:44:32.052 INFO:tasks.workunit.client.0.smithi049.stdout:8/828: creat d2/df/f111 x:0 0 0 2024-04-26T10:44:32.052 INFO:tasks.workunit.client.0.smithi049.stdout:1/694: dwrite d1e/d20/d26/d3c/d54/d59/fdc [0,4194304] 0 2024-04-26T10:44:32.053 INFO:tasks.workunit.client.0.smithi049.stdout:6/735: rename da/dd/de/d26/d29/f31 to da/dd/de/d42/ff7 0 2024-04-26T10:44:32.053 INFO:tasks.workunit.client.0.smithi049.stdout:0/843: rmdir d8/d42 39 2024-04-26T10:44:32.053 INFO:tasks.workunit.client.0.smithi049.stdout:8/829: dread - d2/d1a/fff zero size 2024-04-26T10:44:32.054 INFO:tasks.workunit.client.0.smithi049.stdout:8/830: rmdir d2/d17 39 2024-04-26T10:44:32.054 INFO:tasks.workunit.client.0.smithi049.stdout:0/844: rmdir d8/db/d11/d1c/dbb 39 2024-04-26T10:44:32.054 INFO:tasks.workunit.client.0.smithi049.stdout:2/716: dread d6/f84 [0,4194304] 0 2024-04-26T10:44:32.056 INFO:tasks.workunit.client.0.smithi049.stdout:6/736: write da/dd/d47/d7b/fd6 [1237645,82484] 0 2024-04-26T10:44:32.057 INFO:tasks.workunit.client.0.smithi049.stdout:2/717: write d6/d9/d5f/dba/d11/d6a/dc3/fd5 [74837,101193] 0 2024-04-26T10:44:32.058 INFO:tasks.workunit.client.0.smithi049.stdout:0/845: getdents d8/db/d11/d1b/d4d/dae 0 2024-04-26T10:44:32.059 INFO:tasks.workunit.client.0.smithi049.stdout:2/718: mknod d6/d9/d5f/dba/df/cdd 0 2024-04-26T10:44:32.060 INFO:tasks.workunit.client.0.smithi049.stdout:0/846: unlink d8/d1e/d98/le6 0 2024-04-26T10:44:32.061 INFO:tasks.workunit.client.0.smithi049.stdout:8/831: dwrite d2/d17/d34/d40/d64/dcd/ff9 [0,4194304] 0 2024-04-26T10:44:32.061 INFO:tasks.workunit.client.0.smithi049.stdout:0/847: stat d8/d42/lca 0 2024-04-26T10:44:32.061 INFO:tasks.workunit.client.0.smithi049.stdout:0/848: sync 2024-04-26T10:44:32.062 INFO:tasks.workunit.client.0.smithi049.stdout:8/832: creat d2/df/dab/f112 x:0 0 0 2024-04-26T10:44:32.063 INFO:tasks.workunit.client.0.smithi049.stdout:8/833: write d2/d16/f8e [4002293,1764] 0 2024-04-26T10:44:32.063 INFO:tasks.workunit.client.0.smithi049.stdout:8/834: rmdir d2/df/d10 39 2024-04-26T10:44:32.064 INFO:tasks.workunit.client.0.smithi049.stdout:2/719: write d6/d9/d5f/dba/d1e/fd3 [3929187,36062] 0 2024-04-26T10:44:32.065 INFO:tasks.workunit.client.0.smithi049.stdout:2/720: symlink d6/d9/d5f/dba/d1e/lde 0 2024-04-26T10:44:32.066 INFO:tasks.workunit.client.0.smithi049.stdout:9/889: dread d2/d40/d53/f114 [0,4194304] 0 2024-04-26T10:44:32.068 INFO:tasks.workunit.client.0.smithi049.stdout:2/721: write d6/d9/d5f/dba/d11/d6a/dc3/fd5 [22180,120725] 0 2024-04-26T10:44:32.068 INFO:tasks.workunit.client.0.smithi049.stdout:0/849: dwrite d8/db/d26/d6f/f9c [0,4194304] 0 2024-04-26T10:44:32.068 INFO:tasks.workunit.client.0.smithi049.stdout:7/829: dread d2/dd/d7f/db1/fb9 [0,4194304] 0 2024-04-26T10:44:32.069 INFO:tasks.workunit.client.0.smithi049.stdout:9/890: mkdir d2/d25/dc5/d11e 0 2024-04-26T10:44:32.069 INFO:tasks.workunit.client.0.smithi049.stdout:8/835: dwrite d2/df/d10/d23/d6c/d5e/fb1 [0,4194304] 0 2024-04-26T10:44:32.072 INFO:tasks.workunit.client.0.smithi049.stdout:7/830: write d2/dab/fcb [620399,51401] 0 2024-04-26T10:44:32.072 INFO:tasks.workunit.client.0.smithi049.stdout:0/850: stat d8/db/d93/d96/d9b/d117 0 2024-04-26T10:44:32.072 INFO:tasks.workunit.client.0.smithi049.stdout:3/652: dread d3/d23/d2f/d6a/d6b/d8/d34/f44 [0,4194304] 0 2024-04-26T10:44:32.072 INFO:tasks.workunit.client.0.smithi049.stdout:9/891: rmdir d2/d40/d53/de7/df2 39 2024-04-26T10:44:32.072 INFO:tasks.workunit.client.0.smithi049.stdout:8/836: mknod d2/d16/d88/dfb/c113 0 2024-04-26T10:44:32.072 INFO:tasks.workunit.client.0.smithi049.stdout:7/831: fdatasync d2/dd/d48/d5c/fd4 0 2024-04-26T10:44:32.072 INFO:tasks.workunit.client.0.smithi049.stdout:0/851: write d8/db/d26/d39/f8f [907007,4808] 0 2024-04-26T10:44:32.072 INFO:tasks.workunit.client.0.smithi049.stdout:2/722: link d6/d32/d4a/c56 d6/d9/d5f/dba/d1e/cdf 0 2024-04-26T10:44:32.072 INFO:tasks.workunit.client.0.smithi049.stdout:9/892: fsync d2/d40/f78 0 2024-04-26T10:44:32.074 INFO:tasks.workunit.client.0.smithi049.stdout:4/851: dread de/d3f/d52/d9b/f6b [4194304,4194304] 0 2024-04-26T10:44:32.074 INFO:tasks.workunit.client.0.smithi049.stdout:4/852: chown de/d3f/dbf 1834 1 2024-04-26T10:44:32.075 INFO:tasks.workunit.client.0.smithi049.stdout:9/893: creat d2/d1a/df/f11f x:0 0 0 2024-04-26T10:44:32.075 INFO:tasks.workunit.client.0.smithi049.stdout:0/852: creat d8/d66/f120 x:0 0 0 2024-04-26T10:44:32.075 INFO:tasks.workunit.client.0.smithi049.stdout:8/837: getdents d2/d16/d19/d42/d7c/d10d 0 2024-04-26T10:44:32.075 INFO:tasks.workunit.client.0.smithi049.stdout:2/723: creat d6/d9/d5f/dba/d1e/fe0 x:0 0 0 2024-04-26T10:44:32.076 INFO:tasks.workunit.client.0.smithi049.stdout:2/724: creat d6/fe1 x:0 0 0 2024-04-26T10:44:32.077 INFO:tasks.workunit.client.0.smithi049.stdout:9/894: mknod d2/d40/d53/de7/c120 0 2024-04-26T10:44:32.078 INFO:tasks.workunit.client.0.smithi049.stdout:9/895: chown d2/d1a/d1b/d7a 24560 1 2024-04-26T10:44:32.079 INFO:tasks.workunit.client.0.smithi049.stdout:4/853: link de/d1b/d5e/d72/d73/d84/d24/fdc de/d1b/d5e/d90/db1/de5/f105 0 2024-04-26T10:44:32.079 INFO:tasks.workunit.client.0.smithi049.stdout:8/838: truncate d2/df/d10/d23/d6c/fbb 913864 0 2024-04-26T10:44:32.079 INFO:tasks.workunit.client.0.smithi049.stdout:3/653: read d3/d23/d2f/d6a/d6b/d26/f6d [3616770,98839] 0 2024-04-26T10:44:32.079 INFO:tasks.workunit.client.0.smithi049.stdout:2/725: creat d6/d9/d5f/dba/df/fe2 x:0 0 0 2024-04-26T10:44:32.079 INFO:tasks.workunit.client.0.smithi049.stdout:8/839: dread - d2/d17/d34/fd6 zero size 2024-04-26T10:44:32.080 INFO:tasks.workunit.client.0.smithi049.stdout:9/896: write d2/d1a/d42/f67 [3239738,79925] 0 2024-04-26T10:44:32.080 INFO:tasks.workunit.client.0.smithi049.stdout:4/854: readlink de/d1b/d5e/d72/d73/d84/d4b/db5/ld5 0 2024-04-26T10:44:32.080 INFO:tasks.workunit.client.0.smithi049.stdout:4/855: sync 2024-04-26T10:44:32.080 INFO:tasks.workunit.client.0.smithi049.stdout:7/832: dwrite d2/dd/d48/f69 [4194304,4194304] 0 2024-04-26T10:44:32.081 INFO:tasks.workunit.client.0.smithi049.stdout:8/840: stat d2/df/d10/c51 0 2024-04-26T10:44:32.081 INFO:tasks.workunit.client.0.smithi049.stdout:2/726: creat d6/d30/d97/dbe/fe3 x:0 0 0 2024-04-26T10:44:32.083 INFO:tasks.workunit.client.0.smithi049.stdout:7/833: creat d2/dd/d25/d27/d119/f11c x:0 0 0 2024-04-26T10:44:32.083 INFO:tasks.workunit.client.0.smithi049.stdout:9/897: getdents d2/d1a/df/ddb 0 2024-04-26T10:44:32.086 INFO:tasks.workunit.client.0.smithi049.stdout:7/834: fdatasync d2/dd/f14 0 2024-04-26T10:44:32.086 INFO:tasks.workunit.client.0.smithi049.stdout:3/654: rename d3/d23/d2f/d6a/d6b/d26/d29/f7d to d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/fd8 0 2024-04-26T10:44:32.087 INFO:tasks.workunit.client.0.smithi049.stdout:9/898: creat d2/d40/d53/de7/f121 x:0 0 0 2024-04-26T10:44:32.087 INFO:tasks.workunit.client.0.smithi049.stdout:1/695: dread d1e/d20/d26/d3c/f4f [0,4194304] 0 2024-04-26T10:44:32.087 INFO:tasks.workunit.client.0.smithi049.stdout:4/856: read de/d1b/d5e/d72/d73/d84/f60 [297508,122406] 0 2024-04-26T10:44:32.088 INFO:tasks.workunit.client.0.smithi049.stdout:4/857: fdatasync de/d1b/fba 0 2024-04-26T10:44:32.089 INFO:tasks.workunit.client.0.smithi049.stdout:7/835: getdents d2/dd/d7f/dd1/dfa 0 2024-04-26T10:44:32.089 INFO:tasks.workunit.client.0.smithi049.stdout:1/696: creat d1e/dd5/fe1 x:0 0 0 2024-04-26T10:44:32.089 INFO:tasks.workunit.client.0.smithi049.stdout:2/727: write d6/d9/d5f/dba/d34/d7b/f7e [1241482,94020] 0 2024-04-26T10:44:32.092 INFO:tasks.workunit.client.0.smithi049.stdout:8/841: dwrite d2/df/d10/d47/d75/dc3/fda [0,4194304] 0 2024-04-26T10:44:32.092 INFO:tasks.workunit.client.0.smithi049.stdout:3/655: write d3/d23/d2f/d6a/d6b/d26/d65/d70/d84/fc2 [974283,6401] 0 2024-04-26T10:44:32.092 INFO:tasks.workunit.client.0.smithi049.stdout:2/728: chown d6/c5b 0 1 2024-04-26T10:44:32.093 INFO:tasks.workunit.client.0.smithi049.stdout:7/836: symlink d2/dd/d48/df3/l11d 0 2024-04-26T10:44:32.093 INFO:tasks.workunit.client.0.smithi049.stdout:4/858: write de/d1b/d5e/d72/d73/d84/d24/f31 [2871084,7535] 0 2024-04-26T10:44:32.094 INFO:tasks.workunit.client.0.smithi049.stdout:2/729: stat d6/d9/d5f/dba/d34 0 2024-04-26T10:44:32.095 INFO:tasks.workunit.client.0.smithi049.stdout:3/656: creat d3/d23/d2f/d6a/d6b/d26/d65/d70/d84/fd9 x:0 0 0 2024-04-26T10:44:32.095 INFO:tasks.workunit.client.0.smithi049.stdout:8/842: dread - d2/d17/d34/d40/d64/dcd/df0/d109/d2a/d9f/de9/f104 zero size 2024-04-26T10:44:32.095 INFO:tasks.workunit.client.0.smithi049.stdout:4/859: chown de/d1b/d5e/d72/d73/d84/d24/db4 55400 1 2024-04-26T10:44:32.097 INFO:tasks.workunit.client.0.smithi049.stdout:7/837: creat d2/dd/d48/da3/d114/f11e x:0 0 0 2024-04-26T10:44:32.098 INFO:tasks.workunit.client.0.smithi049.stdout:9/899: dwrite d2/d1a/d1b/d1f/d34/fbe [0,4194304] 0 2024-04-26T10:44:32.098 INFO:tasks.workunit.client.0.smithi049.stdout:8/843: write d2/f1b [1713274,31086] 0 2024-04-26T10:44:32.098 INFO:tasks.workunit.client.0.smithi049.stdout:4/860: chown de/d3f/d48/fd8 305052 1 2024-04-26T10:44:32.098 INFO:tasks.workunit.client.0.smithi049.stdout:2/730: getdents d6/d32 0 2024-04-26T10:44:32.098 INFO:tasks.workunit.client.0.smithi049.stdout:5/798: dread d7/d66/fbb [0,4194304] 0 2024-04-26T10:44:32.098 INFO:tasks.workunit.client.0.smithi049.stdout:9/900: chown d2/d1a/l73 5160 1 2024-04-26T10:44:32.099 INFO:tasks.workunit.client.0.smithi049.stdout:5/799: stat d7/dc6 0 2024-04-26T10:44:32.099 INFO:tasks.workunit.client.0.smithi049.stdout:7/838: truncate d2/dd/d7f/db1/fb5 539120 0 2024-04-26T10:44:32.100 INFO:tasks.workunit.client.0.smithi049.stdout:2/731: rmdir d6/d9/d5f/dba/d34/d38/d3f/d60 39 2024-04-26T10:44:32.100 INFO:tasks.workunit.client.0.smithi049.stdout:4/861: creat de/d1b/d5e/d72/d73/d84/d24/f106 x:0 0 0 2024-04-26T10:44:32.100 INFO:tasks.workunit.client.0.smithi049.stdout:9/901: symlink d2/d1a/de2/l122 0 2024-04-26T10:44:32.101 INFO:tasks.workunit.client.0.smithi049.stdout:5/800: mknod d7/d1d/d34/d123/db2/c133 0 2024-04-26T10:44:32.101 INFO:tasks.workunit.client.0.smithi049.stdout:7/839: write d2/d3/d96/db3/ff9 [179914,89043] 0 2024-04-26T10:44:32.102 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:32.100+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:32.104 INFO:tasks.workunit.client.0.smithi049.stdout:2/732: unlink d6/d9/d5f/dba/d34/d38/d73/l8f 0 2024-04-26T10:44:32.104 INFO:tasks.workunit.client.0.smithi049.stdout:6/737: dread da/dd/d47/d7b/d84/fe8 [0,4194304] 0 2024-04-26T10:44:32.104 INFO:tasks.workunit.client.0.smithi049.stdout:7/840: mkdir d2/d3/de/d1c/d11f 0 2024-04-26T10:44:32.104 INFO:tasks.workunit.client.0.smithi049.stdout:5/801: creat d7/d1d/d34/d123/d91/d3e/d7b/f134 x:0 0 0 2024-04-26T10:44:32.105 INFO:tasks.workunit.client.0.smithi049.stdout:2/733: write d6/d30/f65 [488348,48040] 0 2024-04-26T10:44:32.105 INFO:tasks.workunit.client.0.smithi049.stdout:6/738: creat da/dd/d47/ff8 x:0 0 0 2024-04-26T10:44:32.105 INFO:tasks.workunit.client.0.smithi049.stdout:7/841: mknod d2/dab/c120 0 2024-04-26T10:44:32.105 INFO:tasks.workunit.client.0.smithi049.stdout:5/802: chown d7/d66/lde 240433871 1 2024-04-26T10:44:32.105 INFO:tasks.workunit.client.0.smithi049.stdout:6/739: write da/dd/f2a [213936,87271] 0 2024-04-26T10:44:32.106 INFO:tasks.workunit.client.0.smithi049.stdout:4/862: write de/d1b/d5e/d72/d73/d88/f89 [2300608,9318] 0 2024-04-26T10:44:32.106 INFO:tasks.workunit.client.0.smithi049.stdout:5/803: chown d7/d1d/d34/d123/d91/d3e/f40 19 1 2024-04-26T10:44:32.107 INFO:tasks.workunit.client.0.smithi049.stdout:6/740: fdatasync da/dd/de/d26/f6f 0 2024-04-26T10:44:32.109 INFO:tasks.workunit.client.0.smithi049.stdout:8/844: dwrite d2/d17/d34/d40/d64/dcd/df0/d109/d2a/f10c [0,4194304] 0 2024-04-26T10:44:32.109 INFO:tasks.workunit.client.0.smithi049.stdout:7/842: dwrite d2/d3/de/f1e [0,4194304] 0 2024-04-26T10:44:32.111 INFO:tasks.workunit.client.0.smithi049.stdout:7/843: fdatasync d2/dd/f26 0 2024-04-26T10:44:32.111 INFO:tasks.workunit.client.0.smithi049.stdout:0/853: dread d8/d66/fb1 [0,4194304] 0 2024-04-26T10:44:32.112 INFO:tasks.workunit.client.0.smithi049.stdout:8/845: mknod d2/d16/d19/d42/c114 0 2024-04-26T10:44:32.112 INFO:tasks.workunit.client.0.smithi049.stdout:0/854: mkdir d8/db/d121 0 2024-04-26T10:44:32.112 INFO:tasks.workunit.client.0.smithi049.stdout:7/844: chown d2/dd/d7f/dd1/l105 988458 1 2024-04-26T10:44:32.114 INFO:tasks.workunit.client.0.smithi049.stdout:1/697: dread d1e/d20/d26/d37/d69/fdf [0,4194304] 0 2024-04-26T10:44:32.114 INFO:tasks.workunit.client.0.smithi049.stdout:6/741: dwrite da/dd/d62/fce [0,4194304] 0 2024-04-26T10:44:32.115 INFO:tasks.workunit.client.0.smithi049.stdout:6/742: write f9 [4166935,87323] 0 2024-04-26T10:44:32.115 INFO:tasks.workunit.client.0.smithi049.stdout:7/845: rename d2/d3/de/d1c/d100 to d2/dd/dd3/df5/d121 0 2024-04-26T10:44:32.116 INFO:tasks.workunit.client.0.smithi049.stdout:1/698: mkdir d1e/d20/d26/d3c/d54/d59/de2 0 2024-04-26T10:44:32.116 INFO:tasks.workunit.client.0.smithi049.stdout:2/734: truncate d6/d32/f87 2725733 0 2024-04-26T10:44:32.118 INFO:tasks.workunit.client.0.smithi049.stdout:6/743: chown da/dd/de/d26/d22/f55 4585 1 2024-04-26T10:44:32.118 INFO:tasks.workunit.client.0.smithi049.stdout:4/863: read f1 [3549791,122116] 0 2024-04-26T10:44:32.118 INFO:tasks.workunit.client.0.smithi049.stdout:2/735: rmdir d6/d30/d97 39 2024-04-26T10:44:32.118 INFO:tasks.workunit.client.0.smithi049.stdout:6/744: chown da/dd/df0 3 1 2024-04-26T10:44:32.119 INFO:tasks.workunit.client.0.smithi049.stdout:8/846: dwrite d2/df/d10/d47/fb2 [0,4194304] 0 2024-04-26T10:44:32.119 INFO:tasks.workunit.client.0.smithi049.stdout:4/864: symlink de/d3f/d48/de3/l107 0 2024-04-26T10:44:32.119 INFO:tasks.workunit.client.0.smithi049.stdout:3/657: dread d3/d23/d2f/d6a/d6b/d8/d34/f51 [0,4194304] 0 2024-04-26T10:44:32.121 INFO:tasks.workunit.client.0.smithi049.stdout:8/847: unlink d2/d17/d34/d40/d64/dcd/df0/d109/l6f 0 2024-04-26T10:44:32.121 INFO:tasks.workunit.client.0.smithi049.stdout:2/736: write d6/d9/d5f/dba/d34/d38/d3f/d60/fc9 [808920,41901] 0 2024-04-26T10:44:32.122 INFO:tasks.workunit.client.0.smithi049.stdout:0/855: fsync d8/db/d93/d96/d9b/f11d 0 2024-04-26T10:44:32.122 INFO:tasks.workunit.client.0.smithi049.stdout:4/865: write de/d1b/f7a [664588,33504] 0 2024-04-26T10:44:32.122 INFO:tasks.workunit.client.0.smithi049.stdout:1/699: dwrite d1e/d20/d26/d3c/d54/d59/d68/fc7 [0,4194304] 0 2024-04-26T10:44:32.123 INFO:tasks.workunit.client.0.smithi049.stdout:2/737: readlink d6/d9/d5f/dba/d35/l59 0 2024-04-26T10:44:32.125 INFO:tasks.workunit.client.0.smithi049.stdout:3/658: rename d3/d23/d2f/d6a/d6b/d8/d55/db4/dca/dc4/lce to d3/d23/d2f/d6a/lda 0 2024-04-26T10:44:32.125 INFO:tasks.workunit.client.0.smithi049.stdout:4/866: unlink de/d3f/d48/de3/le8 0 2024-04-26T10:44:32.126 INFO:tasks.workunit.client.0.smithi049.stdout:3/659: fdatasync d3/d23/d2f/d6a/f7f 0 2024-04-26T10:44:32.127 INFO:tasks.workunit.client.0.smithi049.stdout:1/700: mknod d1e/d20/d26/d3c/d54/ce3 0 2024-04-26T10:44:32.127 INFO:tasks.workunit.client.0.smithi049.stdout:1/701: sync 2024-04-26T10:44:32.128 INFO:tasks.workunit.client.0.smithi049.stdout:2/738: rename d6/d9/d5f/dba/d34/l7a to d6/d9/d5f/dba/d11/le4 0 2024-04-26T10:44:32.128 INFO:tasks.workunit.client.0.smithi049.stdout:2/739: sync 2024-04-26T10:44:32.128 INFO:tasks.workunit.client.0.smithi049.stdout:4/867: write de/d1b/f40 [7633077,3015] 0 2024-04-26T10:44:32.128 INFO:tasks.workunit.client.0.smithi049.stdout:8/848: truncate d2/df/d10/d23/d6c/d5e/fb1 2212346 0 2024-04-26T10:44:32.129 INFO:tasks.workunit.client.0.smithi049.stdout:3/660: write d3/d23/d2f/d6a/d6b/d8/f32 [1457682,115559] 0 2024-04-26T10:44:32.130 INFO:tasks.workunit.client.0.smithi049.stdout:4/868: fdatasync de/d1b/d5e/d72/d73/d88/f94 0 2024-04-26T10:44:32.131 INFO:tasks.workunit.client.0.smithi049.stdout:8/849: creat d2/d16/d19/d42/f115 x:0 0 0 2024-04-26T10:44:32.132 INFO:tasks.workunit.client.0.smithi049.stdout:0/856: dwrite d8/db/d11/d1b/d4d/f80 [0,4194304] 0 2024-04-26T10:44:32.132 INFO:tasks.workunit.client.0.smithi049.stdout:3/661: dread - d3/d23/d2f/d6a/d6b/d26/d65/dae/fb9 zero size 2024-04-26T10:44:32.136 INFO:tasks.workunit.client.0.smithi049.stdout:2/740: dwrite d6/d9/d5f/dba/df/fcb [0,4194304] 0 2024-04-26T10:44:32.138 INFO:tasks.workunit.client.0.smithi049.stdout:8/850: write d2/d16/d19/f25 [1713145,43778] 0 2024-04-26T10:44:32.138 INFO:tasks.workunit.client.0.smithi049.stdout:4/869: dwrite de/d1b/d5e/d72/d73/f7c [0,4194304] 0 2024-04-26T10:44:32.139 INFO:tasks.workunit.client.0.smithi049.stdout:2/741: creat d6/d30/fe5 x:0 0 0 2024-04-26T10:44:32.139 INFO:tasks.workunit.client.0.smithi049.stdout:8/851: write d2/d16/d19/fb0 [935467,88826] 0 2024-04-26T10:44:32.140 INFO:tasks.workunit.client.0.smithi049.stdout:4/870: dread - de/d1b/d5e/d72/d73/d84/d24/f106 zero size 2024-04-26T10:44:32.141 INFO:tasks.workunit.client.0.smithi049.stdout:3/662: dwrite d3/d23/d2f/d6a/d6b/d26/d65/d70/fa1 [0,4194304] 0 2024-04-26T10:44:32.145 INFO:tasks.workunit.client.0.smithi049.stdout:4/871: symlink de/d1b/d5e/d72/d73/d84/d24/d50/dc5/l108 0 2024-04-26T10:44:32.146 INFO:tasks.workunit.client.0.smithi049.stdout:4/872: chown de/d1b/f40 1 1 2024-04-26T10:44:32.146 INFO:tasks.workunit.client.0.smithi049.stdout:4/873: stat de/d1b/l57 0 2024-04-26T10:44:32.146 INFO:tasks.workunit.client.0.smithi049.stdout:9/902: dread d2/d40/f106 [0,4194304] 0 2024-04-26T10:44:32.146 INFO:tasks.workunit.client.0.smithi049.stdout:3/663: dread d3/d23/d2f/d6a/d6b/d8/dd/f7c [0,4194304] 0 2024-04-26T10:44:32.148 INFO:tasks.workunit.client.0.smithi049.stdout:4/874: mkdir de/d1b/d5e/d72/d73/d84/d38/d109 0 2024-04-26T10:44:32.148 INFO:tasks.workunit.client.0.smithi049.stdout:9/903: mkdir d2/d1a/d42/de3/d11b/d123 0 2024-04-26T10:44:32.148 INFO:tasks.workunit.client.0.smithi049.stdout:9/904: stat d2/d25/d60/fa0 0 2024-04-26T10:44:32.148 INFO:tasks.workunit.client.0.smithi049.stdout:7/846: dread d2/dd/d25/f81 [0,4194304] 0 2024-04-26T10:44:32.149 INFO:tasks.workunit.client.0.smithi049.stdout:9/905: write d2/d1a/d1b/f24 [2667007,65336] 0 2024-04-26T10:44:32.150 INFO:tasks.workunit.client.0.smithi049.stdout:7/847: read - d2/d3/de/d1c/dac/f10b zero size 2024-04-26T10:44:32.151 INFO:tasks.workunit.client.0.smithi049.stdout:7/848: write d2/dd/d45/f97 [1216074,39104] 0 2024-04-26T10:44:32.152 INFO:tasks.workunit.client.0.smithi049.stdout:9/906: getdents d2/d40/d53/de7 0 2024-04-26T10:44:32.152 INFO:tasks.workunit.client.0.smithi049.stdout:7/849: getdents d2/d3 0 2024-04-26T10:44:32.153 INFO:tasks.workunit.client.0.smithi049.stdout:3/664: write d3/d23/d2f/d6a/d6b/d8/d55/d46/f4a [3155347,90181] 0 2024-04-26T10:44:32.153 INFO:tasks.workunit.client.0.smithi049.stdout:7/850: sync 2024-04-26T10:44:32.153 INFO:tasks.workunit.client.0.smithi049.stdout:9/907: truncate d2/d1a/d42/de3/f102 50324 0 2024-04-26T10:44:32.154 INFO:tasks.workunit.client.0.smithi049.stdout:3/665: write d3/d23/d2f/d6a/d6b/d8/dd/f7c [3027645,31970] 0 2024-04-26T10:44:32.155 INFO:tasks.workunit.client.0.smithi049.stdout:9/908: mknod d2/d1a/d42/de3/d11b/c124 0 2024-04-26T10:44:32.155 INFO:tasks.workunit.client.0.smithi049.stdout:9/909: mknod d2/d25/dc5/c125 0 2024-04-26T10:44:32.156 INFO:tasks.workunit.client.0.smithi049.stdout:3/666: write d3/d23/d2f/d6a/d6b/d26/f48 [1565745,81575] 0 2024-04-26T10:44:32.156 INFO:tasks.workunit.client.0.smithi049.stdout:9/910: stat d2/d1a/d1b/lbc 0 2024-04-26T10:44:32.158 INFO:tasks.workunit.client.0.smithi049.stdout:9/911: chown d2/d25/d74/f63 2 1 2024-04-26T10:44:32.158 INFO:tasks.workunit.client.0.smithi049.stdout:3/667: creat d3/d23/d2f/fdb x:0 0 0 2024-04-26T10:44:32.159 INFO:tasks.workunit.client.0.smithi049.stdout:9/912: chown d2/d1a/d8a/c11c 27196 1 2024-04-26T10:44:32.160 INFO:tasks.workunit.client.0.smithi049.stdout:7/851: dwrite d2/dd/d38/fa1 [0,4194304] 0 2024-04-26T10:44:32.160 INFO:tasks.workunit.client.0.smithi049.stdout:3/668: creat d3/d23/d2f/d6a/d6b/d8/d82/fdc x:0 0 0 2024-04-26T10:44:32.161 INFO:tasks.workunit.client.0.smithi049.stdout:9/913: mkdir d2/d1a/d42/de3/d126 0 2024-04-26T10:44:32.161 INFO:tasks.workunit.client.0.smithi049.stdout:7/852: write d2/d3/fdb [4684069,87311] 0 2024-04-26T10:44:32.161 INFO:tasks.workunit.client.0.smithi049.stdout:9/914: fdatasync d2/d1a/df/ddb/f104 0 2024-04-26T10:44:32.163 INFO:tasks.workunit.client.0.smithi049.stdout:7/853: write d2/d3/de/d1c/dac/f10b [840067,120640] 0 2024-04-26T10:44:32.164 INFO:tasks.workunit.client.0.smithi049.stdout:6/745: dread da/dd/d47/fb6 [0,4194304] 0 2024-04-26T10:44:32.164 INFO:tasks.workunit.client.0.smithi049.stdout:9/915: write d2/d1a/d1b/d7a/fb5 [1140820,10080] 0 2024-04-26T10:44:32.164 INFO:tasks.workunit.client.0.smithi049.stdout:7/854: truncate d2/d3/f91 898466 0 2024-04-26T10:44:32.165 INFO:tasks.workunit.client.0.smithi049.stdout:7/855: sync 2024-04-26T10:44:32.166 INFO:tasks.workunit.client.0.smithi049.stdout:9/916: fdatasync d2/d1a/d1b/d1f/d64/f6e 0 2024-04-26T10:44:32.166 INFO:tasks.workunit.client.0.smithi049.stdout:6/746: creat da/dd/de/d42/ff9 x:0 0 0 2024-04-26T10:44:32.166 INFO:tasks.workunit.client.0.smithi049.stdout:7/856: write d2/dd/d38/f10d [230329,111930] 0 2024-04-26T10:44:32.167 INFO:tasks.workunit.client.0.smithi049.stdout:2/742: dread d6/d9/d5f/dba/d1e/f81 [0,4194304] 0 2024-04-26T10:44:32.167 INFO:tasks.workunit.client.0.smithi049.stdout:9/917: fdatasync d2/d1a/d1b/d1f/d34/fbe 0 2024-04-26T10:44:32.167 INFO:tasks.workunit.client.0.smithi049.stdout:3/669: dwrite d3/d23/d2f/d6a/d6b/d26/d29/f3e [4194304,4194304] 0 2024-04-26T10:44:32.168 INFO:tasks.workunit.client.0.smithi049.stdout:1/702: dread d1e/d20/d26/d3c/d54/d59/d73/dab/fc1 [0,4194304] 0 2024-04-26T10:44:32.169 INFO:tasks.workunit.client.0.smithi049.stdout:6/747: rename da/dd/de/d26/da1 to da/dd/de/db5/df1/dfa 0 2024-04-26T10:44:32.169 INFO:tasks.workunit.client.0.smithi049.stdout:9/918: creat d2/d1a/d42/f127 x:0 0 0 2024-04-26T10:44:32.169 INFO:tasks.workunit.client.0.smithi049.stdout:3/670: creat d3/d23/d2f/d6a/d6b/d26/d65/fdd x:0 0 0 2024-04-26T10:44:32.170 INFO:tasks.workunit.client.0.smithi049.stdout:1/703: symlink d1e/d20/d26/d37/d8e/le4 0 2024-04-26T10:44:32.170 INFO:tasks.workunit.client.0.smithi049.stdout:4/875: dread de/d1b/d5e/d72/d73/d84/f22 [0,4194304] 0 2024-04-26T10:44:32.171 INFO:tasks.workunit.client.0.smithi049.stdout:6/748: unlink da/dd/d47/lda 0 2024-04-26T10:44:32.172 INFO:tasks.workunit.client.0.smithi049.stdout:4/876: chown de/d1b/d5e/d90/db1/cf3 0 1 2024-04-26T10:44:32.172 INFO:tasks.workunit.client.0.smithi049.stdout:1/704: rmdir d1e/d20/d26/d37/d8e 39 2024-04-26T10:44:32.172 INFO:tasks.workunit.client.0.smithi049.stdout:2/743: creat d6/d9/d5f/dba/d34/d38/d3f/fe6 x:0 0 0 2024-04-26T10:44:32.172 INFO:tasks.workunit.client.0.smithi049.stdout:5/804: dread d7/d1d/fbc [0,4194304] 0 2024-04-26T10:44:32.173 INFO:tasks.workunit.client.0.smithi049.stdout:6/749: unlink da/dd/de/d11/lb1 0 2024-04-26T10:44:32.176 INFO:tasks.workunit.client.0.smithi049.stdout:9/919: truncate d2/d25/fa1 7398268 0 2024-04-26T10:44:32.176 INFO:tasks.workunit.client.0.smithi049.stdout:2/744: write d6/d9/d5f/dba/d34/d38/d3f/d60/fa2 [82850,94950] 0 2024-04-26T10:44:32.177 INFO:tasks.workunit.client.0.smithi049.stdout:5/805: write d7/d1d/d34/d123/d91/d3e/d7b/f134 [43719,57807] 0 2024-04-26T10:44:32.177 INFO:tasks.workunit.client.0.smithi049.stdout:7/857: dwrite d2/f4f [4194304,4194304] 0 2024-04-26T10:44:32.177 INFO:tasks.workunit.client.0.smithi049.stdout:4/877: creat de/d1b/d5e/f10a x:0 0 0 2024-04-26T10:44:32.177 INFO:tasks.workunit.client.0.smithi049.stdout:1/705: fsync d1e/d20/d26/d3c/f87 0 2024-04-26T10:44:32.178 INFO:tasks.workunit.client.0.smithi049.stdout:9/920: mknod d2/c128 0 2024-04-26T10:44:32.178 INFO:tasks.workunit.client.0.smithi049.stdout:0/857: dread d8/db/d11/fa6 [0,4194304] 0 2024-04-26T10:44:32.179 INFO:tasks.workunit.client.0.smithi049.stdout:1/706: dread - d1e/d20/d26/d37/d6e/fbc zero size 2024-04-26T10:44:32.179 INFO:tasks.workunit.client.0.smithi049.stdout:7/858: stat d2/dd/d38/l80 0 2024-04-26T10:44:32.180 INFO:tasks.workunit.client.0.smithi049.stdout:6/750: link da/dd/de/d11/la2 da/dd/d62/dc1/lfb 0 2024-04-26T10:44:32.182 INFO:tasks.workunit.client.0.smithi049.stdout:3/671: dwrite d3/d23/d2f/d6a/d6b/d8/d34/f64 [0,4194304] 0 2024-04-26T10:44:32.182 INFO:tasks.workunit.client.0.smithi049.stdout:4/878: stat de/d1b/d5e/d72/d73/d88/f94 0 2024-04-26T10:44:32.182 INFO:tasks.workunit.client.0.smithi049.stdout:2/745: truncate d6/d30/d97/fae 46895 0 2024-04-26T10:44:32.182 INFO:tasks.workunit.client.0.smithi049.stdout:1/707: dread - d1e/dd5/fe1 zero size 2024-04-26T10:44:32.183 INFO:tasks.workunit.client.0.smithi049.stdout:9/921: write d2/d1a/d1b/d1f/f3d [2760322,4833] 0 2024-04-26T10:44:32.183 INFO:tasks.workunit.client.0.smithi049.stdout:6/751: creat da/dd/de/db5/ffc x:0 0 0 2024-04-26T10:44:32.184 INFO:tasks.workunit.client.0.smithi049.stdout:0/858: fsync d8/db/f112 0 2024-04-26T10:44:32.185 INFO:tasks.workunit.client.0.smithi049.stdout:7/859: creat d2/dd/d7f/d111/f122 x:0 0 0 2024-04-26T10:44:32.185 INFO:tasks.workunit.client.0.smithi049.stdout:8/852: dread d2/df/d10/fc4 [0,4194304] 0 2024-04-26T10:44:32.185 INFO:tasks.workunit.client.0.smithi049.stdout:4/879: dread - de/d1b/d5e/d72/d73/d84/f104 zero size 2024-04-26T10:44:32.186 INFO:tasks.workunit.client.0.smithi049.stdout:2/746: symlink d6/d30/d97/dbe/dd1/le7 0 2024-04-26T10:44:32.186 INFO:tasks.workunit.client.0.smithi049.stdout:7/860: symlink d2/dd/d7f/d111/l123 0 2024-04-26T10:44:32.187 INFO:tasks.workunit.client.0.smithi049.stdout:6/752: readlink da/dd/de/d11/l1f 0 2024-04-26T10:44:32.187 INFO:tasks.workunit.client.0.smithi049.stdout:1/708: rename d1e/d20/d26/f4b to d1e/dd5/fe5 0 2024-04-26T10:44:32.187 INFO:tasks.workunit.client.0.smithi049.stdout:9/922: getdents d2/d1a/d42/de3/deb 0 2024-04-26T10:44:32.187 INFO:tasks.workunit.client.0.smithi049.stdout:6/753: sync 2024-04-26T10:44:32.188 INFO:tasks.workunit.client.0.smithi049.stdout:5/806: dwrite d7/d66/ff9 [0,4194304] 0 2024-04-26T10:44:32.189 INFO:tasks.workunit.client.0.smithi049.stdout:7/861: write d2/d3/de/d1c/f90 [3019291,11854] 0 2024-04-26T10:44:32.189 INFO:tasks.workunit.client.0.smithi049.stdout:0/859: creat d8/db/d26/f122 x:0 0 0 2024-04-26T10:44:32.191 INFO:tasks.workunit.client.0.smithi049.stdout:8/853: symlink d2/df/d10/d23/d6c/l116 0 2024-04-26T10:44:32.191 INFO:tasks.workunit.client.0.smithi049.stdout:6/754: chown da/dd/de/d26/d22/d4c/le6 24 1 2024-04-26T10:44:32.191 INFO:tasks.workunit.client.0.smithi049.stdout:8/854: sync 2024-04-26T10:44:32.191 INFO:tasks.workunit.client.0.smithi049.stdout:2/747: creat d6/d9/d5f/dba/df/fe8 x:0 0 0 2024-04-26T10:44:32.191 INFO:tasks.workunit.client.0.smithi049.stdout:1/709: write d1e/d20/d26/d37/d8e/d97/fa9 [571270,1444] 0 2024-04-26T10:44:32.191 INFO:tasks.workunit.client.0.smithi049.stdout:7/862: unlink d2/d3/d96/ddc/l104 0 2024-04-26T10:44:32.192 INFO:tasks.workunit.client.0.smithi049.stdout:4/880: rename de/d3f/d48/de3/lf0 to de/d3f/d52/d9b/l10b 0 2024-04-26T10:44:32.192 INFO:tasks.workunit.client.0.smithi049.stdout:5/807: fsync d7/d1d/d34/d123/d91/d3e/d60/f7a 0 2024-04-26T10:44:32.192 INFO:tasks.workunit.client.0.smithi049.stdout:9/923: rmdir d2/d1a/d1b/d1f/d64/df6/d118 0 2024-04-26T10:44:32.192 INFO:tasks.workunit.client.0.smithi049.stdout:0/860: mkdir d8/db/d93/d96/d9b/d123 0 2024-04-26T10:44:32.193 INFO:tasks.workunit.client.0.smithi049.stdout:2/748: chown d6/d30/l49 10 1 2024-04-26T10:44:32.193 INFO:tasks.workunit.client.0.smithi049.stdout:8/855: fsync d2/df/d10/fc4 0 2024-04-26T10:44:32.193 INFO:tasks.workunit.client.0.smithi049.stdout:1/710: creat d1e/d20/d26/d3c/d96/da3/fe6 x:0 0 0 2024-04-26T10:44:32.193 INFO:tasks.workunit.client.0.smithi049.stdout:3/672: dwrite d3/d23/d2f/d6a/d6b/d8/dd/f7c [0,4194304] 0 2024-04-26T10:44:32.194 INFO:tasks.workunit.client.0.smithi049.stdout:5/808: creat d7/d14/d18/d2b/f135 x:0 0 0 2024-04-26T10:44:32.194 INFO:tasks.workunit.client.0.smithi049.stdout:0/861: creat d8/db/d26/db9/dcd/f124 x:0 0 0 2024-04-26T10:44:32.195 INFO:tasks.workunit.client.0.smithi049.stdout:9/924: mknod d2/d40/d53/de7/c129 0 2024-04-26T10:44:32.195 INFO:tasks.workunit.client.0.smithi049.stdout:2/749: creat d6/d9/d5f/dba/df/d31/fe9 x:0 0 0 2024-04-26T10:44:32.195 INFO:tasks.workunit.client.0.smithi049.stdout:6/755: fsync da/dd/de/d26/d22/f55 0 2024-04-26T10:44:32.196 INFO:tasks.workunit.client.0.smithi049.stdout:7/863: rename d2/dd/d48/da3/d114 to d2/d124 0 2024-04-26T10:44:32.196 INFO:tasks.workunit.client.0.smithi049.stdout:1/711: creat d1e/d82/fe7 x:0 0 0 2024-04-26T10:44:32.197 INFO:tasks.workunit.client.0.smithi049.stdout:8/856: creat d2/d16/d19/dc7/f117 x:0 0 0 2024-04-26T10:44:32.198 INFO:tasks.workunit.client.0.smithi049.stdout:3/673: write d3/d23/d2f/d6a/d6b/d8/f57 [3977096,98305] 0 2024-04-26T10:44:32.198 INFO:tasks.workunit.client.0.smithi049.stdout:4/881: rename de/d1b/d5e/d72/d73/d84/d4b/l4f to de/d3f/d52/l10c 0 2024-04-26T10:44:32.198 INFO:tasks.workunit.client.0.smithi049.stdout:9/925: write d2/d25/d60/da4/fe8 [678884,122897] 0 2024-04-26T10:44:32.199 INFO:tasks.workunit.client.0.smithi049.stdout:7/864: unlink d2/dd/l6b 0 2024-04-26T10:44:32.199 INFO:tasks.workunit.client.0.smithi049.stdout:8/857: symlink d2/df/dab/l118 0 2024-04-26T10:44:32.200 INFO:tasks.workunit.client.0.smithi049.stdout:6/756: chown da/dd/de/cb3 513196051 1 2024-04-26T10:44:32.200 INFO:tasks.workunit.client.0.smithi049.stdout:1/712: symlink d1e/d20/le8 0 2024-04-26T10:44:32.200 INFO:tasks.workunit.client.0.smithi049.stdout:2/750: truncate d6/d9/d5f/dba/d11/fb0 244665 0 2024-04-26T10:44:32.200 INFO:tasks.workunit.client.0.smithi049.stdout:0/862: getdents d8/db/d11/d1c/dbb/dcf 0 2024-04-26T10:44:32.200 INFO:tasks.workunit.client.0.smithi049.stdout:3/674: mkdir d3/d23/d2f/d6a/d6b/d26/d65/dde 0 2024-04-26T10:44:32.201 INFO:tasks.workunit.client.0.smithi049.stdout:7/865: unlink d2/dd/d25/d27/l71 0 2024-04-26T10:44:32.201 INFO:tasks.workunit.client.0.smithi049.stdout:7/866: sync 2024-04-26T10:44:32.201 INFO:tasks.workunit.client.0.smithi049.stdout:9/926: mknod d2/d40/c12a 0 2024-04-26T10:44:32.202 INFO:tasks.workunit.client.0.smithi049.stdout:1/713: write d1e/dd5/fe1 [414677,22338] 0 2024-04-26T10:44:32.202 INFO:tasks.workunit.client.0.smithi049.stdout:8/858: getdents d2/d16/d88/dfb/d110 0 2024-04-26T10:44:32.202 INFO:tasks.workunit.client.0.smithi049.stdout:9/927: stat d2/d1a/d8a/l96 0 2024-04-26T10:44:32.203 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:32.201+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:32.203 INFO:tasks.workunit.client.0.smithi049.stdout:8/859: readlink d2/d16/l82 0 2024-04-26T10:44:32.203 INFO:tasks.workunit.client.0.smithi049.stdout:7/867: creat d2/dd/d7f/d111/f125 x:0 0 0 2024-04-26T10:44:32.203 INFO:tasks.workunit.client.0.smithi049.stdout:3/675: symlink d3/d23/d2f/d6a/d6b/d8/d87/ldf 0 2024-04-26T10:44:32.204 INFO:tasks.workunit.client.0.smithi049.stdout:8/860: dread - d2/df/fa1 zero size 2024-04-26T10:44:32.205 INFO:tasks.workunit.client.0.smithi049.stdout:7/868: chown d2/f8c 303747394 1 2024-04-26T10:44:32.205 INFO:tasks.workunit.client.0.smithi049.stdout:2/751: rename d6/d9/d5f/dba/df/fe2 to d6/d9/d5f/dba/d34/d38/d73/dcd/fea 0 2024-04-26T10:44:32.205 INFO:tasks.workunit.client.0.smithi049.stdout:9/928: write d2/d25/f119 [557283,33889] 0 2024-04-26T10:44:32.206 INFO:tasks.workunit.client.0.smithi049.stdout:1/714: getdents d1e/d20/d26/d3c/d54/d59/d68 0 2024-04-26T10:44:32.208 INFO:tasks.workunit.client.0.smithi049.stdout:4/882: dwrite de/d1b/d5e/d99/fc0 [0,4194304] 0 2024-04-26T10:44:32.208 INFO:tasks.workunit.client.0.smithi049.stdout:6/757: truncate da/dd/de/d26/f45 1118445 0 2024-04-26T10:44:32.209 INFO:tasks.workunit.client.0.smithi049.stdout:3/676: unlink d3/d23/d2f/d6a/d6b/d8/f9 0 2024-04-26T10:44:32.209 INFO:tasks.workunit.client.0.smithi049.stdout:0/863: dwrite d8/db/d26/d6f/fba [0,4194304] 0 2024-04-26T10:44:32.209 INFO:tasks.workunit.client.0.smithi049.stdout:9/929: mknod d2/d1a/d8a/c12b 0 2024-04-26T10:44:32.209 INFO:tasks.workunit.client.0.smithi049.stdout:2/752: mknod d6/d9/d5f/dba/d35/d91/ceb 0 2024-04-26T10:44:32.210 INFO:tasks.workunit.client.0.smithi049.stdout:6/758: read - da/d4a/fed zero size 2024-04-26T10:44:32.211 INFO:tasks.workunit.client.0.smithi049.stdout:0/864: stat d8/db/ce 0 2024-04-26T10:44:32.212 INFO:tasks.workunit.client.0.smithi049.stdout:2/753: creat d6/d32/fec x:0 0 0 2024-04-26T10:44:32.213 INFO:tasks.workunit.client.0.smithi049.stdout:9/930: dread d2/d40/d53/f114 [0,4194304] 0 2024-04-26T10:44:32.213 INFO:tasks.workunit.client.0.smithi049.stdout:4/883: symlink de/d1b/d5e/d72/d73/d84/d4b/l10d 0 2024-04-26T10:44:32.214 INFO:tasks.workunit.client.0.smithi049.stdout:6/759: symlink da/dd/d47/da3/lfd 0 2024-04-26T10:44:32.216 INFO:tasks.workunit.client.0.smithi049.stdout:9/931: unlink d2/d1a/df/ff5 0 2024-04-26T10:44:32.216 INFO:tasks.workunit.client.0.smithi049.stdout:4/884: chown de/c3c 0 1 2024-04-26T10:44:32.217 INFO:tasks.workunit.client.0.smithi049.stdout:7/869: dwrite d2/d3/de/d1c/f36 [0,4194304] 0 2024-04-26T10:44:32.217 INFO:tasks.workunit.client.0.smithi049.stdout:6/760: mkdir da/d4a/de0/df2/dfe 0 2024-04-26T10:44:32.218 INFO:tasks.workunit.client.0.smithi049.stdout:3/677: truncate d3/d23/d2f/d6a/d6b/d26/d58/fa4 107579 0 2024-04-26T10:44:32.218 INFO:tasks.workunit.client.0.smithi049.stdout:1/715: dwrite d1e/d20/d26/d3c/d54/d59/d68/fc7 [0,4194304] 0 2024-04-26T10:44:32.219 INFO:tasks.workunit.client.0.smithi049.stdout:5/809: dread d7/d14/d18/d48/f49 [0,4194304] 0 2024-04-26T10:44:32.219 INFO:tasks.workunit.client.0.smithi049.stdout:9/932: rmdir d2/d1a/d1b/d7a 39 2024-04-26T10:44:32.220 INFO:tasks.workunit.client.0.smithi049.stdout:2/754: dread d6/d9/d5f/dba/d11/d6a/dc3/fd5 [0,4194304] 0 2024-04-26T10:44:32.221 INFO:tasks.workunit.client.0.smithi049.stdout:9/933: stat d2/d1a/f2c 0 2024-04-26T10:44:32.222 INFO:tasks.workunit.client.0.smithi049.stdout:3/678: mknod d3/d23/d2f/d6a/d6b/d8/d55/db4/dca/ce0 0 2024-04-26T10:44:32.222 INFO:tasks.workunit.client.0.smithi049.stdout:2/755: creat d6/d9/d5f/dba/df/d31/fed x:0 0 0 2024-04-26T10:44:32.225 INFO:tasks.workunit.client.0.smithi049.stdout:6/761: link da/dd/de/c76 da/d4a/cff 0 2024-04-26T10:44:32.226 INFO:tasks.workunit.client.0.smithi049.stdout:9/934: getdents d2/d25/d60/da4/dde 0 2024-04-26T10:44:32.228 INFO:tasks.workunit.client.0.smithi049.stdout:3/679: chown d3/d23/d2f/d6a/d6b/d8/d34 12608 1 2024-04-26T10:44:32.228 INFO:tasks.workunit.client.0.smithi049.stdout:7/870: dwrite d2/d3/f2a [0,4194304] 0 2024-04-26T10:44:32.228 INFO:tasks.workunit.client.0.smithi049.stdout:6/762: chown da/dd/de/d42/df6 113477 1 2024-04-26T10:44:32.229 INFO:tasks.workunit.client.0.smithi049.stdout:4/885: dwrite de/d1b/d5e/d72/d73/fd1 [4194304,4194304] 0 2024-04-26T10:44:32.229 INFO:tasks.workunit.client.0.smithi049.stdout:8/861: dread d2/d16/f8e [0,4194304] 0 2024-04-26T10:44:32.229 INFO:tasks.workunit.client.0.smithi049.stdout:1/716: dwrite d1e/d20/fd6 [0,4194304] 0 2024-04-26T10:44:32.230 INFO:tasks.workunit.client.0.smithi049.stdout:7/871: write d2/d3/f56 [1162559,33370] 0 2024-04-26T10:44:32.232 INFO:tasks.workunit.client.0.smithi049.stdout:3/680: readlink d3/d23/d2f/d6a/d6b/d8/d87/l8a 0 2024-04-26T10:44:32.233 INFO:tasks.workunit.client.0.smithi049.stdout:8/862: chown d2/d17/d34/fd6 159 1 2024-04-26T10:44:32.233 INFO:tasks.workunit.client.0.smithi049.stdout:5/810: dwrite d7/d1d/d1f/d4e/dad/f12c [0,4194304] 0 2024-04-26T10:44:32.234 INFO:tasks.workunit.client.0.smithi049.stdout:1/717: chown d1e/d20/d26/d3c/d54/d59/f88 17546 1 2024-04-26T10:44:32.234 INFO:tasks.workunit.client.0.smithi049.stdout:9/935: rename d2/d1a/de2 to d2/d1a/d42/de3/d11b/d123/d12c 0 2024-04-26T10:44:32.234 INFO:tasks.workunit.client.0.smithi049.stdout:4/886: symlink de/d1b/d5e/d72/d73/d88/l10e 0 2024-04-26T10:44:32.235 INFO:tasks.workunit.client.0.smithi049.stdout:3/681: symlink d3/d23/d2f/d6a/d6b/d26/d65/d70/d84/le1 0 2024-04-26T10:44:32.235 INFO:tasks.workunit.client.0.smithi049.stdout:1/718: stat d1e/d20/d26/d3c/d54/d59 0 2024-04-26T10:44:32.236 INFO:tasks.workunit.client.0.smithi049.stdout:4/887: read - de/d1b/d5e/d72/d73/d84/d4b/db5/fec zero size 2024-04-26T10:44:32.236 INFO:tasks.workunit.client.0.smithi049.stdout:2/756: dwrite d6/d9/d5f/dba/d34/d38/d3f/f45 [4194304,4194304] 0 2024-04-26T10:44:32.237 INFO:tasks.workunit.client.0.smithi049.stdout:3/682: write d3/d23/d2f/d6a/d6b/d26/fa7 [1532386,40574] 0 2024-04-26T10:44:32.237 INFO:tasks.workunit.client.0.smithi049.stdout:1/719: write d1e/d20/d67/f6c [1143799,99707] 0 2024-04-26T10:44:32.238 INFO:tasks.workunit.client.0.smithi049.stdout:4/888: mknod de/d1b/d5e/d99/dbb/c10f 0 2024-04-26T10:44:32.239 INFO:tasks.workunit.client.0.smithi049.stdout:2/757: creat d6/d9/d5f/dba/d11/fee x:0 0 0 2024-04-26T10:44:32.239 INFO:tasks.workunit.client.0.smithi049.stdout:3/683: mkdir d3/d23/d2f/d6a/d6b/d26/d65/d70/de2 0 2024-04-26T10:44:32.239 INFO:tasks.workunit.client.0.smithi049.stdout:1/720: creat d1e/d20/d26/d3c/fe9 x:0 0 0 2024-04-26T10:44:32.239 INFO:tasks.workunit.client.0.smithi049.stdout:4/889: rmdir de/d3f/d52/d9b/d9e/de7 0 2024-04-26T10:44:32.240 INFO:tasks.workunit.client.0.smithi049.stdout:3/684: readlink d3/d23/d2f/d6a/d6b/d8/ld7 0 2024-04-26T10:44:32.240 INFO:tasks.workunit.client.0.smithi049.stdout:2/758: mkdir d6/d30/d97/dbe/dd1/def 0 2024-04-26T10:44:32.240 INFO:tasks.workunit.client.0.smithi049.stdout:1/721: mkdir d1e/d20/d4d/d70/dea 0 2024-04-26T10:44:32.240 INFO:tasks.workunit.client.0.smithi049.stdout:4/890: mknod de/d3f/d52/da6/c110 0 2024-04-26T10:44:32.241 INFO:tasks.workunit.client.0.smithi049.stdout:8/863: truncate d2/f12 3508810 0 2024-04-26T10:44:32.242 INFO:tasks.workunit.client.0.smithi049.stdout:5/811: truncate d7/d14/d18/d48/f49 446872 0 2024-04-26T10:44:32.242 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:32.242 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:32.243 INFO:tasks.workunit.client.0.smithi049.stdout:3/685: write d3/d23/d2f/d6a/d6b/d8/f57 [509206,1357] 0 2024-04-26T10:44:32.243 INFO:tasks.workunit.client.0.smithi049.stdout:3/686: sync 2024-04-26T10:44:32.246 INFO:tasks.workunit.client.0.smithi049.stdout:5/812: read d7/d1d/fbc [4014826,40507] 0 2024-04-26T10:44:32.247 INFO:tasks.workunit.client.0.smithi049.stdout:9/936: dwrite d2/d25/fa3 [0,4194304] 0 2024-04-26T10:44:32.247 INFO:tasks.workunit.client.0.smithi049.stdout:1/722: dread d1e/f1f [0,4194304] 0 2024-04-26T10:44:32.249 INFO:tasks.workunit.client.0.smithi049.stdout:4/891: read de/d1b/d5e/d72/d73/d84/d24/f31 [3781642,35728] 0 2024-04-26T10:44:32.250 INFO:tasks.workunit.client.0.smithi049.stdout:5/813: rename d7/d14/d18/d48/lf6 to d7/d1d/d34/db9/l136 0 2024-04-26T10:44:32.250 INFO:tasks.workunit.client.0.smithi049.stdout:1/723: symlink d1e/d20/d26/d37/d69/d75/leb 0 2024-04-26T10:44:32.250 INFO:tasks.workunit.client.0.smithi049.stdout:8/864: dwrite d2/df/d10/d23/d6c/d5e/fd4 [0,4194304] 0 2024-04-26T10:44:32.250 INFO:tasks.workunit.client.0.smithi049.stdout:2/759: dwrite d6/d9/d5f/dba/d34/d38/d3f/d60/f93 [0,4194304] 0 2024-04-26T10:44:32.253 INFO:tasks.workunit.client.0.smithi049.stdout:5/814: write d7/d1d/d34/d123/d91/d3e/d60/faf [95470,55977] 0 2024-04-26T10:44:32.253 INFO:tasks.workunit.client.0.smithi049.stdout:5/815: fsync d7/d14/f38 0 2024-04-26T10:44:32.253 INFO:tasks.workunit.client.0.smithi049.stdout:1/724: rename d1e/d20/d26/d3c/d54/d59/d73/f91 to d1e/d20/d26/d37/fec 0 2024-04-26T10:44:32.254 INFO:tasks.workunit.client.0.smithi049.stdout:1/725: chown d1e/d20 18097194 1 2024-04-26T10:44:32.255 INFO:tasks.workunit.client.0.smithi049.stdout:5/816: write d7/d1d/d1f/d4e/d65/f75 [736813,49690] 0 2024-04-26T10:44:32.255 INFO:tasks.workunit.client.0.smithi049.stdout:2/760: dwrite d6/fe1 [0,4194304] 0 2024-04-26T10:44:32.257 INFO:tasks.workunit.client.0.smithi049.stdout:2/761: chown d6/d9/d5f/dba/df/fe8 1073502446 1 2024-04-26T10:44:32.258 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:32.259 INFO:tasks.workunit.client.0.smithi049.stdout:2/762: creat d6/d9/d5f/ff0 x:0 0 0 2024-04-26T10:44:32.259 INFO:tasks.workunit.client.0.smithi049.stdout:1/726: dread d1e/d20/d26/d3c/d54/d59/d73/dab/fc1 [0,4194304] 0 2024-04-26T10:44:32.259 INFO:tasks.workunit.client.0.smithi049.stdout:1/727: symlink d1e/d20/d67/dd9/led 0 2024-04-26T10:44:32.262 INFO:tasks.workunit.client.0.smithi049.stdout:0/865: dread d8/d1e/f72 [0,4194304] 0 2024-04-26T10:44:32.263 INFO:tasks.workunit.client.0.smithi049.stdout:0/866: chown d8/f3d 248788 1 2024-04-26T10:44:32.265 INFO:tasks.workunit.client.0.smithi049.stdout:2/763: dwrite d6/d9/d5f/dba/f70 [0,4194304] 0 2024-04-26T10:44:32.266 INFO:tasks.workunit.client.0.smithi049.stdout:6/763: dread da/dd/d47/f80 [0,4194304] 0 2024-04-26T10:44:32.268 INFO:tasks.workunit.client.0.smithi049.stdout:9/937: dread d2/d40/fa8 [0,4194304] 0 2024-04-26T10:44:32.268 INFO:tasks.workunit.client.0.smithi049.stdout:7/872: dread d2/dab/fd0 [0,4194304] 0 2024-04-26T10:44:32.268 INFO:tasks.workunit.client.0.smithi049.stdout:6/764: stat da/dd/f1e 0 2024-04-26T10:44:32.268 INFO:tasks.workunit.client.0.smithi049.stdout:1/728: dwrite d1e/d20/d26/d37/d8e/fa4 [0,4194304] 0 2024-04-26T10:44:32.268 INFO:tasks.workunit.client.0.smithi049.stdout:0/867: creat d8/db/d11/d1c/dbb/f125 x:0 0 0 2024-04-26T10:44:32.269 INFO:tasks.workunit.client.0.smithi049.stdout:9/938: stat d2/d1a/f2a 0 2024-04-26T10:44:32.269 INFO:tasks.workunit.client.0.smithi049.stdout:2/764: mknod d6/d30/d97/dbe/dd1/def/cf1 0 2024-04-26T10:44:32.269 INFO:tasks.workunit.client.0.smithi049.stdout:6/765: write da/f38 [494502,4448] 0 2024-04-26T10:44:32.270 INFO:tasks.workunit.client.0.smithi049.stdout:6/766: sync 2024-04-26T10:44:32.270 INFO:tasks.workunit.client.0.smithi049.stdout:9/939: fdatasync d2/d1a/d1b/d1f/fd0 0 2024-04-26T10:44:32.270 INFO:tasks.workunit.client.0.smithi049.stdout:9/940: sync 2024-04-26T10:44:32.271 INFO:tasks.workunit.client.0.smithi049.stdout:7/873: symlink d2/dd/d25/d27/d119/l126 0 2024-04-26T10:44:32.271 INFO:tasks.workunit.client.0.smithi049.stdout:4/892: dread de/d1b/f34 [4194304,4194304] 0 2024-04-26T10:44:32.271 INFO:tasks.workunit.client.0.smithi049.stdout:0/868: chown d8/db/d11/f65 820532 1 2024-04-26T10:44:32.273 INFO:tasks.workunit.client.0.smithi049.stdout:1/729: write d1e/d20/d26/d37/d69/d75/f85 [2768871,122222] 0 2024-04-26T10:44:32.273 INFO:tasks.workunit.client.0.smithi049.stdout:2/765: write d6/d9/d5f/dba/d35/d91/f92 [1459574,78911] 0 2024-04-26T10:44:32.273 INFO:tasks.workunit.client.0.smithi049.stdout:0/869: readlink d8/db/d11/d1b/ldf 0 2024-04-26T10:44:32.273 INFO:tasks.workunit.client.0.smithi049.stdout:9/941: symlink d2/d40/d5d/d10f/l12d 0 2024-04-26T10:44:32.274 INFO:tasks.workunit.client.0.smithi049.stdout:0/870: mknod d8/c126 0 2024-04-26T10:44:32.274 INFO:tasks.workunit.client.0.smithi049.stdout:2/766: truncate d6/d9/f76 692711 0 2024-04-26T10:44:32.275 INFO:tasks.workunit.client.0.smithi049.stdout:9/942: mknod d2/d1a/d1b/c12e 0 2024-04-26T10:44:32.276 INFO:tasks.workunit.client.0.smithi049.stdout:1/730: unlink d1e/d20/d26/d57/l66 0 2024-04-26T10:44:32.276 INFO:tasks.workunit.client.0.smithi049.stdout:0/871: stat d8/db/d11/d1c/dbb/db0/df9 0 2024-04-26T10:44:32.276 INFO:tasks.workunit.client.0.smithi049.stdout:2/767: fdatasync d6/d9/d5f/ff0 0 2024-04-26T10:44:32.279 INFO:tasks.workunit.client.0.smithi049.stdout:7/874: dwrite d2/d124/f11e [0,4194304] 0 2024-04-26T10:44:32.279 INFO:tasks.workunit.client.0.smithi049.stdout:4/893: dwrite de/d1b/f40 [8388608,4194304] 0 2024-04-26T10:44:32.281 INFO:tasks.workunit.client.0.smithi049.stdout:1/731: write d1e/d20/d67/f6c [2264546,72967] 0 2024-04-26T10:44:32.282 INFO:tasks.workunit.client.0.smithi049.stdout:6/767: dwrite da/dd/d47/f80 [0,4194304] 0 2024-04-26T10:44:32.282 INFO:tasks.workunit.client.0.smithi049.stdout:2/768: write d6/d9/d5f/dba/d11/d6a/d9f/fdc [168498,101033] 0 2024-04-26T10:44:32.282 INFO:tasks.workunit.client.0.smithi049.stdout:8/865: dread d2/d16/f9b [0,4194304] 0 2024-04-26T10:44:32.284 INFO:tasks.workunit.client.0.smithi049.stdout:1/732: write d1e/d20/d26/d37/d69/d75/f9e [372844,130350] 0 2024-04-26T10:44:32.284 INFO:tasks.workunit.client.0.smithi049.stdout:2/769: readlink d6/d9/d5f/dba/d34/d38/l63 0 2024-04-26T10:44:32.291 INFO:tasks.workunit.client.0.smithi049.stdout:7/875: getdents d2/dd/d48/d5c 0 2024-04-26T10:44:32.291 INFO:tasks.workunit.client.0.smithi049.stdout:1/733: symlink d1e/dd5/lee 0 2024-04-26T10:44:32.291 INFO:tasks.workunit.client.0.smithi049.stdout:2/770: symlink d6/d9/d5f/dba/d11/d6a/d9f/lf2 0 2024-04-26T10:44:32.291 INFO:tasks.workunit.client.0.smithi049.stdout:8/866: truncate d2/df/d10/d23/d6c/d5e/fb1 1720201 0 2024-04-26T10:44:32.291 INFO:tasks.workunit.client.0.smithi049.stdout:7/876: rename d2/d3/c43 to d2/dd/d48/d5c/c127 0 2024-04-26T10:44:32.291 INFO:tasks.workunit.client.0.smithi049.stdout:9/943: dwrite d2/d1a/d42/de3/d11b/d123/d12c/f8e [0,4194304] 0 2024-04-26T10:44:32.291 INFO:tasks.workunit.client.0.smithi049.stdout:6/768: truncate da/dd/de/d42/ff7 6051692 0 2024-04-26T10:44:32.292 INFO:tasks.workunit.client.0.smithi049.stdout:7/877: read - d2/dd/d25/f7d zero size 2024-04-26T10:44:32.292 INFO:tasks.workunit.client.0.smithi049.stdout:2/771: readlink d6/d9/d5f/dba/d34/d38/d3f/l61 0 2024-04-26T10:44:32.292 INFO:tasks.workunit.client.0.smithi049.stdout:8/867: chown d2/d17/d34/d40/d64/ff7 106881264 1 2024-04-26T10:44:32.292 INFO:tasks.workunit.client.0.smithi049.stdout:4/894: dwrite de/d1b/d5e/d90/feb [0,4194304] 0 2024-04-26T10:44:32.292 INFO:tasks.workunit.client.0.smithi049.stdout:7/878: read - d2/dab/fd6 zero size 2024-04-26T10:44:32.293 INFO:tasks.workunit.client.0.smithi049.stdout:2/772: symlink d6/d9/d5f/dba/lf3 0 2024-04-26T10:44:32.293 INFO:tasks.workunit.client.0.smithi049.stdout:2/773: sync 2024-04-26T10:44:32.293 INFO:tasks.workunit.client.0.smithi049.stdout:4/895: fsync de/d1b/d5e/d72/d73/d88/fb8 0 2024-04-26T10:44:32.293 INFO:tasks.workunit.client.0.smithi049.stdout:7/879: symlink d2/dd/dd3/l128 0 2024-04-26T10:44:32.294 INFO:tasks.workunit.client.0.smithi049.stdout:3/687: dread d3/d23/d2f/d6a/d6b/d26/f48 [4194304,4194304] 0 2024-04-26T10:44:32.294 INFO:tasks.workunit.client.0.smithi049.stdout:2/774: stat d6/d9/d5f/dba/d11/f43 0 2024-04-26T10:44:32.294 INFO:tasks.workunit.client.0.smithi049.stdout:8/868: chown d2/d17/d34/d40/d64/dcd/df0/d109/d2a/d9f/de9/lf8 99 1 2024-04-26T10:44:32.294 INFO:tasks.workunit.client.0.smithi049.stdout:4/896: fdatasync de/d1b/d5e/d72/d73/d88/f89 0 2024-04-26T10:44:32.294 INFO:tasks.workunit.client.0.smithi049.stdout:6/769: dread da/dd/de/d11/f43 [0,4194304] 0 2024-04-26T10:44:32.295 INFO:tasks.workunit.client.0.smithi049.stdout:2/775: chown d6/d9/d5f/dba/d11/d6a/d9f/lf2 280746598 1 2024-04-26T10:44:32.295 INFO:tasks.workunit.client.0.smithi049.stdout:3/688: creat d3/d23/d2f/d6a/d6b/d26/d5f/fe3 x:0 0 0 2024-04-26T10:44:32.295 INFO:tasks.workunit.client.0.smithi049.stdout:8/869: rename d2/d16/f56 to d2/d17/d34/d40/d64/dcd/df0/f119 0 2024-04-26T10:44:32.296 INFO:tasks.workunit.client.0.smithi049.stdout:3/689: chown d3/d23/l35 12285 1 2024-04-26T10:44:32.296 INFO:tasks.workunit.client.0.smithi049.stdout:6/770: rename da/dd/de/d26/f45 to da/dd/de/d11/dbc/f100 0 2024-04-26T10:44:32.296 INFO:tasks.workunit.client.0.smithi049.stdout:2/776: symlink d6/d9/d5f/dba/d34/d38/d3f/d60/lf4 0 2024-04-26T10:44:32.297 INFO:tasks.workunit.client.0.smithi049.stdout:2/777: readlink d6/d9/l1f 0 2024-04-26T10:44:32.297 INFO:tasks.workunit.client.0.smithi049.stdout:1/734: truncate d1e/d20/d26/d3c/d54/f9b 1659347 0 2024-04-26T10:44:32.297 INFO:tasks.workunit.client.0.smithi049.stdout:6/771: mknod da/dd/de/db5/df1/c101 0 2024-04-26T10:44:32.298 INFO:tasks.workunit.client.0.smithi049.stdout:3/690: creat d3/d23/d2f/d6a/d6b/d8/d55/db4/dca/dc4/fe4 x:0 0 0 2024-04-26T10:44:32.298 INFO:tasks.workunit.client.0.smithi049.stdout:2/778: chown d6/d9/d5f/dba/d1e/f21 16209776 1 2024-04-26T10:44:32.299 INFO:tasks.workunit.client.0.smithi049.stdout:5/817: dread d7/d53/fc4 [0,4194304] 0 2024-04-26T10:44:32.300 INFO:tasks.workunit.client.0.smithi049.stdout:6/772: rename da/dd/d47/lab to da/dd/de/d42/l102 0 2024-04-26T10:44:32.300 INFO:tasks.workunit.client.0.smithi049.stdout:2/779: mkdir d6/d30/d97/dbe/dd1/df5 0 2024-04-26T10:44:32.300 INFO:tasks.workunit.client.0.smithi049.stdout:6/773: fdatasync f9 0 2024-04-26T10:44:32.301 INFO:tasks.workunit.client.0.smithi049.stdout:5/818: fdatasync d7/d14/d18/f6e 0 2024-04-26T10:44:32.301 INFO:tasks.workunit.client.0.smithi049.stdout:3/691: creat d3/d23/d2f/d6a/d6b/d26/d65/dae/fe5 x:0 0 0 2024-04-26T10:44:32.301 INFO:tasks.workunit.client.0.smithi049.stdout:3/692: sync 2024-04-26T10:44:32.301 INFO:tasks.workunit.client.0.smithi049.stdout:0/872: dread d8/f3d [0,4194304] 0 2024-04-26T10:44:32.302 INFO:tasks.workunit.client.0.smithi049.stdout:0/873: sync 2024-04-26T10:44:32.302 INFO:tasks.workunit.client.0.smithi049.stdout:2/780: creat d6/d9/d5f/dba/d34/d38/ff6 x:0 0 0 2024-04-26T10:44:32.303 INFO:tasks.workunit.client.0.smithi049.stdout:6/774: mknod da/dd/de/d26/c103 0 2024-04-26T10:44:32.303 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:32.301+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:32.303 INFO:tasks.workunit.client.0.smithi049.stdout:7/880: write d2/d3/f91 [587208,11431] 0 2024-04-26T10:44:32.304 INFO:tasks.workunit.client.0.smithi049.stdout:0/874: dread - d8/db/d11/d1b/d4d/fcc zero size 2024-04-26T10:44:32.306 INFO:tasks.workunit.client.0.smithi049.stdout:1/735: dread d1e/d20/d26/d3c/d54/d59/f5e [0,4194304] 0 2024-04-26T10:44:32.306 INFO:tasks.workunit.client.0.smithi049.stdout:2/781: symlink d6/d32/d4a/lf7 0 2024-04-26T10:44:32.306 INFO:tasks.workunit.client.0.smithi049.stdout:6/775: write da/dd/d47/d7b/d84/fd2 [557580,84058] 0 2024-04-26T10:44:32.306 INFO:tasks.workunit.client.0.smithi049.stdout:4/897: dwrite de/d1b/d5e/d72/d73/d84/d38/f3b [0,4194304] 0 2024-04-26T10:44:32.307 INFO:tasks.workunit.client.0.smithi049.stdout:7/881: symlink d2/d3/de/d1c/dac/l129 0 2024-04-26T10:44:32.307 INFO:tasks.workunit.client.0.smithi049.stdout:6/776: dread - da/d4a/fed zero size 2024-04-26T10:44:32.308 INFO:tasks.workunit.client.0.smithi049.stdout:7/882: stat d2/dd 0 2024-04-26T10:44:32.308 INFO:tasks.workunit.client.0.smithi049.stdout:2/782: fsync d6/d9/fc 0 2024-04-26T10:44:32.309 INFO:tasks.workunit.client.0.smithi049.stdout:4/898: creat de/d1b/d5e/da2/f111 x:0 0 0 2024-04-26T10:44:32.310 INFO:tasks.workunit.client.0.smithi049.stdout:0/875: creat d8/db/d11/d1c/dbb/dc1/dd7/d113/f127 x:0 0 0 2024-04-26T10:44:32.310 INFO:tasks.workunit.client.0.smithi049.stdout:7/883: stat d2/dd/d25/d27/l39 0 2024-04-26T10:44:32.312 INFO:tasks.workunit.client.0.smithi049.stdout:7/884: read - d2/fef zero size 2024-04-26T10:44:32.313 INFO:tasks.workunit.client.0.smithi049.stdout:3/693: dwrite d3/d23/d2f/d6a/d6b/d26/d65/d70/d84/fc2 [0,4194304] 0 2024-04-26T10:44:32.315 INFO:tasks.workunit.client.0.smithi049.stdout:7/885: mknod d2/dd/d7f/dd1/dfa/c12a 0 2024-04-26T10:44:32.318 INFO:tasks.workunit.client.0.smithi049.stdout:7/886: chown d2/dd/d45/c54 962871 1 2024-04-26T10:44:32.319 INFO:tasks.workunit.client.0.smithi049.stdout:2/783: dwrite d6/d9/d5f/dba/d11/fdb [0,4194304] 0 2024-04-26T10:44:32.319 INFO:tasks.workunit.client.0.smithi049.stdout:6/777: dwrite da/dd/de/d11/f43 [0,4194304] 0 2024-04-26T10:44:32.320 INFO:tasks.workunit.client.0.smithi049.stdout:3/694: rename d3/d23/f75 to d3/d23/d2f/d6a/d6b/d8/d55/d46/fe6 0 2024-04-26T10:44:32.320 INFO:tasks.workunit.client.0.smithi049.stdout:0/876: truncate d8/db/d11/f83 3334204 0 2024-04-26T10:44:32.322 INFO:tasks.workunit.client.0.smithi049.stdout:7/887: rmdir d2/dd/d7f/dd1/dfa 39 2024-04-26T10:44:32.322 INFO:tasks.workunit.client.0.smithi049.stdout:6/778: getdents da/dd/d62/d9d 0 2024-04-26T10:44:32.322 INFO:tasks.workunit.client.0.smithi049.stdout:2/784: getdents d6/d9/d5f/dba/d11/d6a/d9f 0 2024-04-26T10:44:32.322 INFO:tasks.workunit.client.0.smithi049.stdout:0/877: fsync d8/db/d26/d6f/fd0 0 2024-04-26T10:44:32.322 INFO:tasks.workunit.client.0.smithi049.stdout:5/819: dread d7/d53/f11f [0,4194304] 0 2024-04-26T10:44:32.323 INFO:tasks.workunit.client.0.smithi049.stdout:8/870: dread d2/df/f62 [0,4194304] 0 2024-04-26T10:44:32.323 INFO:tasks.workunit.client.0.smithi049.stdout:2/785: chown d6/d9/c1a 1030 1 2024-04-26T10:44:32.323 INFO:tasks.workunit.client.0.smithi049.stdout:6/779: symlink da/dd/de/d11/l104 0 2024-04-26T10:44:32.323 INFO:tasks.workunit.client.0.smithi049.stdout:2/786: chown d6/fa5 636600438 1 2024-04-26T10:44:32.324 INFO:tasks.workunit.client.0.smithi049.stdout:5/820: unlink d7/dc6/fda 0 2024-04-26T10:44:32.324 INFO:tasks.workunit.client.0.smithi049.stdout:0/878: unlink d8/d1e/d98/lbf 0 2024-04-26T10:44:32.324 INFO:tasks.workunit.client.0.smithi049.stdout:2/787: stat d6/d9/f8c 0 2024-04-26T10:44:32.325 INFO:tasks.workunit.client.0.smithi049.stdout:8/871: write d2/df/d10/d47/d75/f7d [2835995,30154] 0 2024-04-26T10:44:32.325 INFO:tasks.workunit.client.0.smithi049.stdout:0/879: readlink d8/db/d11/d1c/l46 0 2024-04-26T10:44:32.326 INFO:tasks.workunit.client.0.smithi049.stdout:5/821: stat d7/d1d/d34/d123/d91/d3e/l96 0 2024-04-26T10:44:32.326 INFO:tasks.workunit.client.0.smithi049.stdout:7/888: write d2/d3/de/d1c/fc5 [6119,33836] 0 2024-04-26T10:44:32.326 INFO:tasks.workunit.client.0.smithi049.stdout:5/822: chown f3 2646455 1 2024-04-26T10:44:32.327 INFO:tasks.workunit.client.0.smithi049.stdout:6/780: getdents da/dd/de 0 2024-04-26T10:44:32.327 INFO:tasks.workunit.client.0.smithi049.stdout:0/880: fdatasync d8/db/d26/d39/f8f 0 2024-04-26T10:44:32.328 INFO:tasks.workunit.client.0.smithi049.stdout:9/944: dread d2/d25/d60/da4/dde/f101 [0,4194304] 0 2024-04-26T10:44:32.328 INFO:tasks.workunit.client.0.smithi049.stdout:3/695: dwrite d3/d23/d2f/d6a/d6b/d26/d65/d70/d96/fb3 [0,4194304] 0 2024-04-26T10:44:32.328 INFO:tasks.workunit.client.0.smithi049.stdout:8/872: rename d2/d17/ca3 to d2/d17/de1/de4/c11a 0 2024-04-26T10:44:32.329 INFO:tasks.workunit.client.0.smithi049.stdout:0/881: chown d8/d66/f120 1021313876 1 2024-04-26T10:44:32.330 INFO:tasks.workunit.client.0.smithi049.stdout:0/882: chown d8/db/d93/d96/d9b/dff 9867582 1 2024-04-26T10:44:32.330 INFO:tasks.workunit.client.0.smithi049.stdout:8/873: unlink d2/d16/d88/c8d 0 2024-04-26T10:44:32.331 INFO:tasks.workunit.client.0.smithi049.stdout:9/945: creat d2/d40/d53/f12f x:0 0 0 2024-04-26T10:44:32.332 INFO:tasks.workunit.client.0.smithi049.stdout:8/874: dread - d2/df/fa1 zero size 2024-04-26T10:44:32.332 INFO:tasks.workunit.client.0.smithi049.stdout:3/696: chown d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/f3f 456 1 2024-04-26T10:44:32.332 INFO:tasks.workunit.client.0.smithi049.stdout:6/781: getdents da/dd/de/db5/df1/dfa 0 2024-04-26T10:44:32.332 INFO:tasks.workunit.client.0.smithi049.stdout:9/946: creat d2/d25/d74/f130 x:0 0 0 2024-04-26T10:44:32.332 INFO:tasks.workunit.client.0.smithi049.stdout:0/883: creat d8/db/d11/d1c/dbb/db0/d102/f128 x:0 0 0 2024-04-26T10:44:32.333 INFO:tasks.workunit.client.0.smithi049.stdout:2/788: truncate d6/d9/d5f/dba/d1e/f21 3528979 0 2024-04-26T10:44:32.333 INFO:tasks.workunit.client.0.smithi049.stdout:6/782: dread - da/dd/d62/f83 zero size 2024-04-26T10:44:32.334 INFO:tasks.workunit.client.0.smithi049.stdout:9/947: creat d2/f131 x:0 0 0 2024-04-26T10:44:32.334 INFO:tasks.workunit.client.0.smithi049.stdout:8/875: rename d2/c49 to d2/d17/d34/d40/d7f/c11b 0 2024-04-26T10:44:32.336 INFO:tasks.workunit.client.0.smithi049.stdout:6/783: creat da/dd/d62/d9d/f105 x:0 0 0 2024-04-26T10:44:32.340 INFO:tasks.workunit.client.0.smithi049.stdout:2/789: mkdir d6/d9/d5f/dba/d35/df8 0 2024-04-26T10:44:32.340 INFO:tasks.workunit.client.0.smithi049.stdout:0/884: creat d8/db/d26/d39/f129 x:0 0 0 2024-04-26T10:44:32.340 INFO:tasks.workunit.client.0.smithi049.stdout:3/697: truncate d3/d23/d2f/d6a/d6b/d26/d58/fb0 911250 0 2024-04-26T10:44:32.340 INFO:tasks.workunit.client.0.smithi049.stdout:6/784: mkdir da/dd/d106 0 2024-04-26T10:44:32.340 INFO:tasks.workunit.client.0.smithi049.stdout:7/889: dwrite d2/f49 [0,4194304] 0 2024-04-26T10:44:32.340 INFO:tasks.workunit.client.0.smithi049.stdout:9/948: write d2/d25/d74/f71 [1077198,68111] 0 2024-04-26T10:44:32.340 INFO:tasks.workunit.client.0.smithi049.stdout:0/885: readlink d8/d42/l5c 0 2024-04-26T10:44:32.341 INFO:tasks.workunit.client.0.smithi049.stdout:2/790: creat d6/d32/ff9 x:0 0 0 2024-04-26T10:44:32.341 INFO:tasks.workunit.client.0.smithi049.stdout:7/890: dread - d2/dd/d7f/dd1/ffd zero size 2024-04-26T10:44:32.341 INFO:tasks.workunit.client.0.smithi049.stdout:8/876: rename d2/d17/f69 to d2/df/d10/d47/d75/dc3/f11c 0 2024-04-26T10:44:32.341 INFO:tasks.workunit.client.0.smithi049.stdout:5/823: dwrite d7/d1d/d1f/d4e/dad/db3/f11e [0,4194304] 0 2024-04-26T10:44:32.341 INFO:tasks.workunit.client.0.smithi049.stdout:6/785: chown da/dd/de/d26/d22/f8d 925 1 2024-04-26T10:44:32.342 INFO:tasks.workunit.client.0.smithi049.stdout:3/698: symlink d3/d23/d2f/d6a/d6b/d8/le7 0 2024-04-26T10:44:32.343 INFO:tasks.workunit.client.0.smithi049.stdout:9/949: write d2/d1a/df/f11d [653255,122530] 0 2024-04-26T10:44:32.343 INFO:tasks.workunit.client.0.smithi049.stdout:8/877: unlink d2/df/f3f 0 2024-04-26T10:44:32.343 INFO:tasks.workunit.client.0.smithi049.stdout:6/786: creat da/dd/de/f107 x:0 0 0 2024-04-26T10:44:32.344 INFO:tasks.workunit.client.0.smithi049.stdout:2/791: write d6/d9/d5f/dba/d34/d38/d73/fa4 [397475,6573] 0 2024-04-26T10:44:32.345 INFO:tasks.workunit.client.0.smithi049.stdout:5/824: chown d7/d1d/d34/d123/d91/d3e/fa7 2967379 1 2024-04-26T10:44:32.345 INFO:tasks.workunit.client.0.smithi049.stdout:5/825: sync 2024-04-26T10:44:32.345 INFO:tasks.workunit.client.0.smithi049.stdout:7/891: truncate d2/dd/d25/ff0 619348 0 2024-04-26T10:44:32.345 INFO:tasks.workunit.client.0.smithi049.stdout:3/699: creat d3/d23/d2f/d6a/d6b/d26/d65/d70/d96/fe8 x:0 0 0 2024-04-26T10:44:32.346 INFO:tasks.workunit.client.0.smithi049.stdout:2/792: symlink d6/d9/d5f/dba/df/lfa 0 2024-04-26T10:44:32.346 INFO:tasks.workunit.client.0.smithi049.stdout:9/950: creat d2/d40/d53/de7/f132 x:0 0 0 2024-04-26T10:44:32.347 INFO:tasks.workunit.client.0.smithi049.stdout:7/892: stat d2/d3/d96/ddc/cec 0 2024-04-26T10:44:32.347 INFO:tasks.workunit.client.0.smithi049.stdout:0/886: dwrite d8/d66/fb4 [0,4194304] 0 2024-04-26T10:44:32.347 INFO:tasks.workunit.client.0.smithi049.stdout:9/951: readlink d2/l18 0 2024-04-26T10:44:32.348 INFO:tasks.workunit.client.0.smithi049.stdout:7/893: stat d2/d124 0 2024-04-26T10:44:32.348 INFO:tasks.workunit.client.0.smithi049.stdout:2/793: fdatasync d6/d9/d5f/ff0 0 2024-04-26T10:44:32.349 INFO:tasks.workunit.client.0.smithi049.stdout:1/736: dread d1e/d20/d26/d3c/f3d [0,4194304] 0 2024-04-26T10:44:32.349 INFO:tasks.workunit.client.0.smithi049.stdout:9/952: symlink d2/d25/d60/l133 0 2024-04-26T10:44:32.350 INFO:tasks.workunit.client.0.smithi049.stdout:8/878: dwrite d2/d1a/d9c/fc8 [0,4194304] 0 2024-04-26T10:44:32.351 INFO:tasks.workunit.client.0.smithi049.stdout:8/879: truncate d2/d16/d19/d42/f96 520417 0 2024-04-26T10:44:32.352 INFO:tasks.workunit.client.0.smithi049.stdout:8/880: sync 2024-04-26T10:44:32.352 INFO:tasks.workunit.client.0.smithi049.stdout:3/700: symlink d3/d23/d2f/d6a/d6b/d8/d55/db4/dca/dc4/le9 0 2024-04-26T10:44:32.352 INFO:tasks.workunit.client.0.smithi049.stdout:7/894: creat d2/dd/dd3/df5/f12b x:0 0 0 2024-04-26T10:44:32.353 INFO:tasks.workunit.client.0.smithi049.stdout:2/794: mkdir d6/d9/d5f/dba/d34/dfb 0 2024-04-26T10:44:32.353 INFO:tasks.workunit.client.0.smithi049.stdout:0/887: symlink d8/db/d93/d96/d9b/d123/l12a 0 2024-04-26T10:44:32.353 INFO:tasks.workunit.client.0.smithi049.stdout:5/826: link d7/d1d/d20/l28 d7/d1d/d1f/d4e/d80/l137 0 2024-04-26T10:44:32.353 INFO:tasks.workunit.client.0.smithi049.stdout:1/737: mkdir d1e/d20/d4d/def 0 2024-04-26T10:44:32.353 INFO:tasks.workunit.client.0.smithi049.stdout:8/881: write d2/d16/d19/d42/daf/fb5 [352590,2205] 0 2024-04-26T10:44:32.354 INFO:tasks.workunit.client.0.smithi049.stdout:9/953: mknod d2/d1a/c134 0 2024-04-26T10:44:32.354 INFO:tasks.workunit.client.0.smithi049.stdout:0/888: rmdir d8/d109/d10e 39 2024-04-26T10:44:32.354 INFO:tasks.workunit.client.0.smithi049.stdout:5/827: unlink d7/d14/d18/d48/ldc 0 2024-04-26T10:44:32.355 INFO:tasks.workunit.client.0.smithi049.stdout:7/895: write d2/d3/f3c [15222,103911] 0 2024-04-26T10:44:32.355 INFO:tasks.workunit.client.0.smithi049.stdout:3/701: mknod d3/d23/d2f/d6a/d6b/d8/d34/cea 0 2024-04-26T10:44:32.356 INFO:tasks.workunit.client.0.smithi049.stdout:1/738: creat d1e/d20/d26/ff0 x:0 0 0 2024-04-26T10:44:32.356 INFO:tasks.workunit.client.0.smithi049.stdout:6/787: creat da/dd/de/d11/dbc/f108 x:0 0 0 2024-04-26T10:44:32.356 INFO:tasks.workunit.client.0.smithi049.stdout:0/889: creat d8/db/d26/db9/f12b x:0 0 0 2024-04-26T10:44:32.356 INFO:tasks.workunit.client.0.smithi049.stdout:1/739: read d1e/f44 [984132,45045] 0 2024-04-26T10:44:32.357 INFO:tasks.workunit.client.0.smithi049.stdout:6/788: rmdir da/d4a 39 2024-04-26T10:44:32.357 INFO:tasks.workunit.client.0.smithi049.stdout:8/882: fsync d2/d17/d34/d40/f10b 0 2024-04-26T10:44:32.357 INFO:tasks.workunit.client.0.smithi049.stdout:3/702: unlink d3/d23/d2f/d6a/d6b/d8/d55/db4/dca/ce0 0 2024-04-26T10:44:32.357 INFO:tasks.workunit.client.0.smithi049.stdout:2/795: truncate d6/d9/d5f/dba/d34/d7b/fd4 678590 0 2024-04-26T10:44:32.357 INFO:tasks.workunit.client.0.smithi049.stdout:7/896: link d2/f2c d2/dd/dd3/df5/d115/f12c 0 2024-04-26T10:44:32.359 INFO:tasks.workunit.client.0.smithi049.stdout:5/828: truncate d7/d66/d84/f9b 425456 0 2024-04-26T10:44:32.359 INFO:tasks.workunit.client.0.smithi049.stdout:0/890: read - d8/db/d11/d1b/d4d/dae/dc5/ffd zero size 2024-04-26T10:44:32.359 INFO:tasks.workunit.client.0.smithi049.stdout:8/883: stat d2/d16/d88/dfb/d110 0 2024-04-26T10:44:32.360 INFO:tasks.workunit.client.0.smithi049.stdout:4/899: dread de/d1b/d5e/d72/d73/d84/d4b/fa3 [0,4194304] 0 2024-04-26T10:44:32.361 INFO:tasks.workunit.client.0.smithi049.stdout:0/891: rmdir d8/d41 39 2024-04-26T10:44:32.361 INFO:tasks.workunit.client.0.smithi049.stdout:2/796: rmdir d6/d9/d5f/dba/d35 39 2024-04-26T10:44:32.361 INFO:tasks.workunit.client.0.smithi049.stdout:1/740: creat d1e/d20/d26/d3c/d54/ff1 x:0 0 0 2024-04-26T10:44:32.362 INFO:tasks.workunit.client.0.smithi049.stdout:5/829: read - d7/d1d/d34/d123/d91/fdb zero size 2024-04-26T10:44:32.362 INFO:tasks.workunit.client.0.smithi049.stdout:3/703: chown d3/d23/d2f/d6a/d6b/d8/f49 1 1 2024-04-26T10:44:32.362 INFO:tasks.workunit.client.0.smithi049.stdout:8/884: write d2/d16/d19/f25 [1965106,79709] 0 2024-04-26T10:44:32.362 INFO:tasks.workunit.client.0.smithi049.stdout:7/897: mknod d2/dd/d7f/dd1/dfa/c12d 0 2024-04-26T10:44:32.363 INFO:tasks.workunit.client.0.smithi049.stdout:2/797: chown d6/d9/l85 5305 1 2024-04-26T10:44:32.363 INFO:tasks.workunit.client.0.smithi049.stdout:8/885: stat d2/df/d10/c7b 0 2024-04-26T10:44:32.363 INFO:tasks.workunit.client.0.smithi049.stdout:1/741: symlink d1e/d20/d67/dd9/lf2 0 2024-04-26T10:44:32.364 INFO:tasks.workunit.client.0.smithi049.stdout:9/954: dwrite d2/d1a/d42/de3/d11b/d123/d12c/fd9 [0,4194304] 0 2024-04-26T10:44:32.365 INFO:tasks.workunit.client.0.smithi049.stdout:0/892: creat d8/db/d11/d1b/d4d/f12c x:0 0 0 2024-04-26T10:44:32.365 INFO:tasks.workunit.client.0.smithi049.stdout:5/830: unlink d7/d1d/d1f/d4e/dad/db3/dcc/l125 0 2024-04-26T10:44:32.366 INFO:tasks.workunit.client.0.smithi049.stdout:6/789: dwrite da/dd/d47/d7b/d84/fdd [0,4194304] 0 2024-04-26T10:44:32.367 INFO:tasks.workunit.client.0.smithi049.stdout:7/898: rename d2/dd/d25/d27/d119/l126 to d2/d3/d96/l12e 0 2024-04-26T10:44:32.368 INFO:tasks.workunit.client.0.smithi049.stdout:0/893: mkdir d8/db/d26/db9/dcd/d12d 0 2024-04-26T10:44:32.369 INFO:tasks.workunit.client.0.smithi049.stdout:4/900: creat de/d1b/d5e/d72/d73/d84/d24/f112 x:0 0 0 2024-04-26T10:44:32.369 INFO:tasks.workunit.client.0.smithi049.stdout:9/955: rename d2/d1a/df/ddb to d2/d1a/d42/de3/d11b/d123/d135 0 2024-04-26T10:44:32.370 INFO:tasks.workunit.client.0.smithi049.stdout:9/956: stat d2/d40/d5d 0 2024-04-26T10:44:32.370 INFO:tasks.workunit.client.0.smithi049.stdout:4/901: rmdir de/d1d 39 2024-04-26T10:44:32.371 INFO:tasks.workunit.client.0.smithi049.stdout:7/899: mknod d2/d3/d96/db3/db8/c12f 0 2024-04-26T10:44:32.372 INFO:tasks.workunit.client.0.smithi049.stdout:5/831: rename d7/d14/d18/d2b/fd9 to d7/d1d/d34/d123/d91/d3e/d60/f138 0 2024-04-26T10:44:32.374 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~76s 2024-04-26T10:44:32.374 INFO:tasks.workunit.client.0.smithi049.stdout:0/894: write d8/db/d26/d39/f129 [356643,71848] 0 2024-04-26T10:44:32.375 INFO:tasks.workunit.client.0.smithi049.stdout:2/798: dwrite d6/d30/fd6 [0,4194304] 0 2024-04-26T10:44:32.376 INFO:tasks.workunit.client.0.smithi049.stdout:0/895: chown d8/d42/f6c 182667 1 2024-04-26T10:44:32.377 INFO:tasks.workunit.client.0.smithi049.stdout:5/832: rmdir d7/d1d/d34/db9 39 2024-04-26T10:44:32.377 INFO:tasks.workunit.client.0.smithi049.stdout:4/902: chown de/d1b/d5e/d72/d73/cde 22217061 1 2024-04-26T10:44:32.379 INFO:tasks.workunit.client.0.smithi049.stdout:2/799: creat d6/d9/d5f/dba/d34/d38/ffc x:0 0 0 2024-04-26T10:44:32.379 INFO:tasks.workunit.client.0.smithi049.stdout:6/790: dwrite da/dd/d47/d7b/d84/fd2 [0,4194304] 0 2024-04-26T10:44:32.380 INFO:tasks.workunit.client.0.smithi049.stdout:7/900: link d2/dd/d48/da3/ff6 d2/d3/d96/db3/db8/f130 0 2024-04-26T10:44:32.381 INFO:tasks.workunit.client.0.smithi049.stdout:1/742: dwrite d1e/d20/d26/d3c/f99 [0,4194304] 0 2024-04-26T10:44:32.382 INFO:tasks.workunit.client.0.smithi049.stdout:5/833: unlink d7/d66/d84/ld3 0 2024-04-26T10:44:32.382 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:32.383 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:32.383 INFO:tasks.workunit.client.0.smithi049.stdout:7/901: truncate d2/f1b 5125236 0 2024-04-26T10:44:32.383 INFO:tasks.workunit.client.0.smithi049.stdout:1/743: stat d1e/d20/d26/d3c/d54/d59 0 2024-04-26T10:44:32.383 INFO:tasks.workunit.client.0.smithi049.stdout:4/903: symlink de/d1b/d5e/d72/d73/d84/d24/d50/dc5/l113 0 2024-04-26T10:44:32.384 INFO:tasks.workunit.client.0.smithi049.stdout:5/834: mknod d7/d1d/d34/d123/d91/d3e/c139 0 2024-04-26T10:44:32.384 INFO:tasks.workunit.client.0.smithi049.stdout:1/744: creat d1e/dd5/ff3 x:0 0 0 2024-04-26T10:44:32.384 INFO:tasks.workunit.client.0.smithi049.stdout:0/896: rename d8/db/d26/d39/ld1 to d8/d109/l12e 0 2024-04-26T10:44:32.385 INFO:tasks.workunit.client.0.smithi049.stdout:7/902: symlink d2/dd/d7f/dd1/dfa/l131 0 2024-04-26T10:44:32.385 INFO:tasks.workunit.client.0.smithi049.stdout:3/704: dread d3/d23/d2f/d6a/d6b/d26/f5a [0,4194304] 0 2024-04-26T10:44:32.386 INFO:tasks.workunit.client.0.smithi049.stdout:6/791: rename da/dd/d106 to da/dd/de/d11/d109 0 2024-04-26T10:44:32.386 INFO:tasks.workunit.client.0.smithi049.stdout:5/835: symlink d7/d1d/d34/d123/d91/d3e/l13a 0 2024-04-26T10:44:32.386 INFO:tasks.workunit.client.0.smithi049.stdout:9/957: truncate d2/d1a/d42/de3/d11b/d123/d12c/f8e 2571574 0 2024-04-26T10:44:32.387 INFO:tasks.workunit.client.0.smithi049.stdout:0/897: mkdir d8/db/d11/d1b/d4d/d12f 0 2024-04-26T10:44:32.387 INFO:tasks.workunit.client.0.smithi049.stdout:1/745: symlink d1e/d20/d26/d3c/d54/lf4 0 2024-04-26T10:44:32.388 INFO:tasks.workunit.client.0.smithi049.stdout:0/898: unlink d8/l14 0 2024-04-26T10:44:32.388 INFO:tasks.workunit.client.0.smithi049.stdout:9/958: symlink d2/d1a/l136 0 2024-04-26T10:44:32.388 INFO:tasks.workunit.client.0.smithi049.stdout:5/836: mkdir d7/d1d/d1f/d4e/dad/db3/dcc/d13b 0 2024-04-26T10:44:32.389 INFO:tasks.workunit.client.0.smithi049.stdout:3/705: link d3/d23/d2f/d6a/d6b/d8/fd0 d3/d23/d2f/d6a/d6b/d8/d82/feb 0 2024-04-26T10:44:32.389 INFO:tasks.workunit.client.0.smithi049.stdout:1/746: rename d1e/d20/d4d/def to d1e/d20/d67/dd9/df5 0 2024-04-26T10:44:32.389 INFO:tasks.workunit.client.0.smithi049.stdout:9/959: stat d2/d1a/d1b/d1f/d34/fc9 0 2024-04-26T10:44:32.390 INFO:tasks.workunit.client.0.smithi049.stdout:5/837: write d7/f88 [72901,16790] 0 2024-04-26T10:44:32.390 INFO:tasks.workunit.client.0.smithi049.stdout:3/706: creat d3/d23/fec x:0 0 0 2024-04-26T10:44:32.390 INFO:tasks.workunit.client.0.smithi049.stdout:6/792: truncate da/dd/de/d26/d29/fd8 123358 0 2024-04-26T10:44:32.391 INFO:tasks.workunit.client.0.smithi049.stdout:0/899: getdents d8/db/d11/d1c/dbb/dc1/dd7 0 2024-04-26T10:44:32.391 INFO:tasks.workunit.client.0.smithi049.stdout:5/838: creat d7/d14/d18/df3/f13c x:0 0 0 2024-04-26T10:44:32.392 INFO:tasks.workunit.client.0.smithi049.stdout:6/793: creat da/dd/de/db5/df1/f10a x:0 0 0 2024-04-26T10:44:32.393 INFO:tasks.workunit.client.0.smithi049.stdout:5/839: creat d7/d14/d18/d2b/d117/f13d x:0 0 0 2024-04-26T10:44:32.393 INFO:tasks.workunit.client.0.smithi049.stdout:6/794: chown da/f1b 112589 1 2024-04-26T10:44:32.394 INFO:tasks.workunit.client.0.smithi049.stdout:5/840: rename d7/d14/d18/l45 to d7/d1d/d1f/d95/l13e 0 2024-04-26T10:44:32.395 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:32.396 INFO:tasks.workunit.client.0.smithi049.stdout:9/960: dwrite d2/d1a/d1b/d1f/d49/fb7 [4194304,4194304] 0 2024-04-26T10:44:32.396 INFO:tasks.workunit.client.0.smithi049.stdout:0/900: stat d8/db/d26/d39/l4f 0 2024-04-26T10:44:32.396 INFO:tasks.workunit.client.0.smithi049.stdout:3/707: getdents d3/d23/d2f/d6a/d6b/d8/d82 0 2024-04-26T10:44:32.397 INFO:tasks.workunit.client.0.smithi049.stdout:9/961: readlink d2/d1a/d9c/lb0 0 2024-04-26T10:44:32.397 INFO:tasks.workunit.client.0.smithi049.stdout:2/800: read d6/d9/d5f/dba/d1e/fb2 [396194,119733] 0 2024-04-26T10:44:32.397 INFO:tasks.workunit.client.0.smithi049.stdout:8/886: dread d2/df/d10/d23/f31 [0,4194304] 0 2024-04-26T10:44:32.398 INFO:tasks.workunit.client.0.smithi049.stdout:1/747: write d1e/d20/d26/d3c/d54/f9b [1187079,68171] 0 2024-04-26T10:44:32.398 INFO:tasks.workunit.client.0.smithi049.stdout:0/901: mknod d8/db/d93/d96/c130 0 2024-04-26T10:44:32.398 INFO:tasks.workunit.client.0.smithi049.stdout:6/795: truncate da/dd/de/f96 93170 0 2024-04-26T10:44:32.399 INFO:tasks.workunit.client.0.smithi049.stdout:2/801: chown d6/d30/d97/dbe/dd1/def 122849 1 2024-04-26T10:44:32.399 INFO:tasks.workunit.client.0.smithi049.stdout:9/962: rename d2/d1a/fd to d2/d25/f137 0 2024-04-26T10:44:32.400 INFO:tasks.workunit.client.0.smithi049.stdout:3/708: mkdir d3/d23/d2f/d6a/d6b/d8/ded 0 2024-04-26T10:44:32.400 INFO:tasks.workunit.client.0.smithi049.stdout:8/887: chown d2/d16/d19/d42/d7c/l80 15 1 2024-04-26T10:44:32.400 INFO:tasks.workunit.client.0.smithi049.stdout:1/748: dread - d1e/d20/d26/d37/d69/d75/fc8 zero size 2024-04-26T10:44:32.401 INFO:tasks.workunit.client.0.smithi049.stdout:9/963: write d2/f8 [1031389,11069] 0 2024-04-26T10:44:32.402 INFO:tasks.workunit.client.0.smithi049.stdout:2/802: read d6/d9/d5f/dba/df/f12 [8065720,62006] 0 2024-04-26T10:44:32.402 INFO:tasks.workunit.client.0.smithi049.stdout:0/902: fsync d8/db/d11/d1c/dbb/dc1/dd7/de3/f101 0 2024-04-26T10:44:32.403 INFO:tasks.workunit.client.0.smithi049.stdout:9/964: write d2/d25/d60/f76 [155564,17698] 0 2024-04-26T10:44:32.403 INFO:tasks.workunit.client.0.smithi049.stdout:5/841: dwrite d7/fc [0,4194304] 0 2024-04-26T10:44:32.406 INFO:tasks.workunit.client.0.smithi049.stdout:2/803: mkdir d6/d9/d5f/dba/dfd 0 2024-04-26T10:44:32.406 INFO:tasks.workunit.client.0.smithi049.stdout:6/796: dwrite da/dd/de/d26/d22/d4c/f8b [0,4194304] 0 2024-04-26T10:44:32.406 INFO:tasks.workunit.client.0.smithi049.stdout:8/888: link d2/d16/d19/d42/d7c/cbd d2/d16/d19/d42/d7c/d10d/c11d 0 2024-04-26T10:44:32.406 INFO:tasks.workunit.client.0.smithi049.stdout:0/903: chown d8/db/d26/d39/fa4 152 1 2024-04-26T10:44:32.409 INFO:tasks.workunit.client.0.smithi049.stdout:7/903: dread d2/dd/dd3/fd7 [0,4194304] 0 2024-04-26T10:44:32.409 INFO:tasks.workunit.client.0.smithi049.stdout:8/889: symlink d2/d17/d34/d40/d7f/l11e 0 2024-04-26T10:44:32.410 INFO:tasks.workunit.client.0.smithi049.stdout:0/904: mknod d8/db/d121/c131 0 2024-04-26T10:44:32.410 INFO:tasks.workunit.client.0.smithi049.stdout:6/797: chown da/dd/de/f107 368989088 1 2024-04-26T10:44:32.410 INFO:tasks.workunit.client.0.smithi049.stdout:2/804: getdents d6/d30/d97/dbe/dd1/df5 0 2024-04-26T10:44:32.410 INFO:tasks.workunit.client.0.smithi049.stdout:8/890: rmdir d2/d16/d19/d42/deb 39 2024-04-26T10:44:32.410 INFO:tasks.workunit.client.0.smithi049.stdout:6/798: creat da/dd/de/d11/dee/f10b x:0 0 0 2024-04-26T10:44:32.410 INFO:tasks.workunit.client.0.smithi049.stdout:3/709: truncate d3/d23/d2f/d6a/d6b/d26/f5a 2012821 0 2024-04-26T10:44:32.410 INFO:tasks.workunit.client.0.smithi049.stdout:7/904: write d2/dd/d48/f88 [306285,11881] 0 2024-04-26T10:44:32.410 INFO:tasks.workunit.client.0.smithi049.stdout:5/842: truncate d7/d1d/d1f/f9a 1714074 0 2024-04-26T10:44:32.411 INFO:tasks.workunit.client.0.smithi049.stdout:2/805: creat d6/d9/d5f/dba/d35/d91/ffe x:0 0 0 2024-04-26T10:44:32.412 INFO:tasks.workunit.client.0.smithi049.stdout:6/799: mkdir da/dd/de/d26/d22/d4c/d10c 0 2024-04-26T10:44:32.412 INFO:tasks.workunit.client.0.smithi049.stdout:5/843: mkdir d7/d1d/d34/d123/d13f 0 2024-04-26T10:44:32.412 INFO:tasks.workunit.client.0.smithi049.stdout:8/891: rename d2/d17 to d2/d17/d34/d40/d64/dcd/df0/d11f 22 2024-04-26T10:44:32.412 INFO:tasks.workunit.client.0.smithi049.stdout:7/905: mkdir d2/d3/d96/ddc/d132 0 2024-04-26T10:44:32.414 INFO:tasks.workunit.client.0.smithi049.stdout:7/906: chown d2/dd/c15 25216 1 2024-04-26T10:44:32.414 INFO:tasks.workunit.client.0.smithi049.stdout:0/905: dwrite d8/db/d11/d1c/dbb/dc1/dd7/de3/ff1 [0,4194304] 0 2024-04-26T10:44:32.417 INFO:tasks.workunit.client.0.smithi049.stdout:6/800: truncate da/f91 5078172 0 2024-04-26T10:44:32.417 INFO:tasks.workunit.client.0.smithi049.stdout:2/806: write d6/d32/f87 [1839596,73846] 0 2024-04-26T10:44:32.418 INFO:tasks.workunit.client.0.smithi049.stdout:6/801: stat da/dd/d47/fa8 0 2024-04-26T10:44:32.420 INFO:tasks.workunit.client.0.smithi049.stdout:3/710: truncate d3/d23/d2f/d6a/d6b/d8/f32 736187 0 2024-04-26T10:44:32.420 INFO:tasks.workunit.client.0.smithi049.stdout:2/807: rmdir d6/d30/d97/dbe/dd1/def 39 2024-04-26T10:44:32.423 INFO:tasks.workunit.client.0.smithi049.stdout:7/907: dwrite d2/dd/d25/d27/d119/f11c [0,4194304] 0 2024-04-26T10:44:32.423 INFO:tasks.workunit.client.0.smithi049.stdout:0/906: dwrite d8/d66/f10f [0,4194304] 0 2024-04-26T10:44:32.423 INFO:tasks.workunit.client.0.smithi049.stdout:6/802: mkdir da/dd/d62/dc1/d10d 0 2024-04-26T10:44:32.424 INFO:tasks.workunit.client.0.smithi049.stdout:5/844: dwrite d7/d1d/d34/d123/d91/f4f [4194304,4194304] 0 2024-04-26T10:44:32.424 INFO:tasks.workunit.client.0.smithi049.stdout:3/711: symlink d3/d23/d2f/d6a/d6b/d26/d65/d70/d84/lee 0 2024-04-26T10:44:32.425 INFO:tasks.workunit.client.0.smithi049.stdout:0/907: write f3 [777971,15255] 0 2024-04-26T10:44:32.425 INFO:tasks.workunit.client.0.smithi049.stdout:7/908: write d2/d3/de/d1c/fae [496105,90411] 0 2024-04-26T10:44:32.425 INFO:tasks.workunit.client.0.smithi049.stdout:6/803: creat da/dd/df0/f10e x:0 0 0 2024-04-26T10:44:32.426 INFO:tasks.workunit.client.0.smithi049.stdout:5/845: mkdir d7/d1d/d1f/d4e/d77/d140 0 2024-04-26T10:44:32.426 INFO:tasks.workunit.client.0.smithi049.stdout:0/908: symlink d8/db/d26/daf/l132 0 2024-04-26T10:44:32.427 INFO:tasks.workunit.client.0.smithi049.stdout:7/909: creat d2/dd/d7f/db1/dc6/f133 x:0 0 0 2024-04-26T10:44:32.428 INFO:tasks.workunit.client.0.smithi049.stdout:5/846: chown d7/d1d/d1f/d4e/da0/c10a 6802 1 2024-04-26T10:44:32.428 INFO:tasks.workunit.client.0.smithi049.stdout:0/909: creat d8/d1e/f133 x:0 0 0 2024-04-26T10:44:32.431 INFO:tasks.workunit.client.0.smithi049.stdout:4/904: sync 2024-04-26T10:44:32.431 INFO:tasks.workunit.client.0.smithi049.stdout:1/749: sync 2024-04-26T10:44:32.431 INFO:tasks.workunit.client.0.smithi049.stdout:5/847: mknod d7/d66/d84/c141 0 2024-04-26T10:44:32.431 INFO:tasks.workunit.client.0.smithi049.stdout:2/808: dwrite d6/d30/d97/fab [0,4194304] 0 2024-04-26T10:44:32.433 INFO:tasks.workunit.client.0.smithi049.stdout:1/750: fdatasync d1e/d20/d26/d37/d8e/faa 0 2024-04-26T10:44:32.435 INFO:tasks.workunit.client.0.smithi049.stdout:3/712: dwrite d3/d23/d2f/d6a/d6b/d26/f2b [4194304,4194304] 0 2024-04-26T10:44:32.436 INFO:tasks.workunit.client.0.smithi049.stdout:5/848: rename d7/d14/d18/d2b/f135 to d7/d1d/d1f/d4e/da0/f142 0 2024-04-26T10:44:32.438 INFO:tasks.workunit.client.0.smithi049.stdout:4/905: creat de/dfe/f114 x:0 0 0 2024-04-26T10:44:32.438 INFO:tasks.workunit.client.0.smithi049.stdout:6/804: dwrite da/dd/de/d26/f72 [0,4194304] 0 2024-04-26T10:44:32.438 INFO:tasks.workunit.client.0.smithi049.stdout:7/910: dwrite d2/dab/fd0 [0,4194304] 0 2024-04-26T10:44:32.438 INFO:tasks.workunit.client.0.smithi049.stdout:3/713: chown d3/fc8 319 1 2024-04-26T10:44:32.439 INFO:tasks.workunit.client.0.smithi049.stdout:5/849: mknod d7/d1d/d1f/d95/c143 0 2024-04-26T10:44:32.439 INFO:tasks.workunit.client.0.smithi049.stdout:6/805: dread - da/f35 zero size 2024-04-26T10:44:32.440 INFO:tasks.workunit.client.0.smithi049.stdout:0/910: dwrite d8/db/d11/d1b/d4d/f80 [4194304,4194304] 0 2024-04-26T10:44:32.441 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:32.439+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:32.442 INFO:tasks.workunit.client.0.smithi049.stdout:1/751: truncate f12 157149 0 2024-04-26T10:44:32.442 INFO:tasks.workunit.client.0.smithi049.stdout:5/850: fdatasync d7/d1d/d34/d123/f5c 0 2024-04-26T10:44:32.442 INFO:tasks.workunit.client.0.smithi049.stdout:7/911: creat d2/dd/d7f/dd1/dfa/d113/f134 x:0 0 0 2024-04-26T10:44:32.444 INFO:tasks.workunit.client.0.smithi049.stdout:6/806: rename da/dd/de/d42/d5a to da/dd/d62/d9d/d10f 0 2024-04-26T10:44:32.445 INFO:tasks.workunit.client.0.smithi049.stdout:0/911: readlink d8/db/d11/d1b/l22 0 2024-04-26T10:44:32.445 INFO:tasks.workunit.client.0.smithi049.stdout:1/752: stat d1e/d20/d26/d3c/d54/d59/d68/c7a 0 2024-04-26T10:44:32.445 INFO:tasks.workunit.client.0.smithi049.stdout:3/714: truncate d3/d23/d2f/d6a/d6b/d26/d65/d70/d84/fd9 706500 0 2024-04-26T10:44:32.445 INFO:tasks.workunit.client.0.smithi049.stdout:9/965: dread d2/d1a/d42/de3/d11b/d123/d135/fbd [0,4194304] 0 2024-04-26T10:44:32.445 INFO:tasks.workunit.client.0.smithi049.stdout:5/851: creat d7/d1d/d34/d123/d91/d106/f144 x:0 0 0 2024-04-26T10:44:32.446 INFO:tasks.workunit.client.0.smithi049.stdout:0/912: dread - d8/db/d11/d1c/dbb/dc1/fd5 zero size 2024-04-26T10:44:32.446 INFO:tasks.workunit.client.0.smithi049.stdout:7/912: rename d2/dd/d38/f3d to d2/dd/d25/d27/d119/f135 0 2024-04-26T10:44:32.446 INFO:tasks.workunit.client.0.smithi049.stdout:1/753: mknod d1e/d20/d4d/d70/cf6 0 2024-04-26T10:44:32.449 INFO:tasks.workunit.client.0.smithi049.stdout:1/754: fdatasync d1e/d20/d26/d37/d6e/fbc 0 2024-04-26T10:44:32.449 INFO:tasks.workunit.client.0.smithi049.stdout:6/807: rename da/dd/d62/d9d/d10f/cac to da/d4a/de0/df2/dfe/c110 0 2024-04-26T10:44:32.449 INFO:tasks.workunit.client.0.smithi049.stdout:3/715: readlink d3/d23/d2f/d6a/d6b/d26/d65/d70/d84/l92 0 2024-04-26T10:44:32.451 INFO:tasks.workunit.client.0.smithi049.stdout:5/852: mknod d7/d1d/d34/db9/dd6/c145 0 2024-04-26T10:44:32.451 INFO:tasks.workunit.client.0.smithi049.stdout:0/913: creat d8/db/d11/d1c/dbb/dcf/f134 x:0 0 0 2024-04-26T10:44:32.451 INFO:tasks.workunit.client.0.smithi049.stdout:9/966: symlink d2/d40/d53/de7/l138 0 2024-04-26T10:44:32.451 INFO:tasks.workunit.client.0.smithi049.stdout:7/913: link d2/dd/f12 d2/d3/dcf/f136 0 2024-04-26T10:44:32.451 INFO:tasks.workunit.client.0.smithi049.stdout:6/808: stat da/dd/de/db5/df1/dfa 0 2024-04-26T10:44:32.451 INFO:tasks.workunit.client.0.smithi049.stdout:1/755: rmdir d1e/d20/d26/d37/d8e/d97/ddd 0 2024-04-26T10:44:32.451 INFO:tasks.workunit.client.0.smithi049.stdout:7/914: chown d2/dd/f26 0 1 2024-04-26T10:44:32.451 INFO:tasks.workunit.client.0.smithi049.stdout:9/967: mkdir d2/d1a/d42/de3/d126/d139 0 2024-04-26T10:44:32.451 INFO:tasks.workunit.client.0.smithi049.stdout:0/914: symlink d8/l135 0 2024-04-26T10:44:32.452 INFO:tasks.workunit.client.0.smithi049.stdout:9/968: readlink d2/d1a/l8b 0 2024-04-26T10:44:32.452 INFO:tasks.workunit.client.0.smithi049.stdout:5/853: mkdir d7/d14/d146 0 2024-04-26T10:44:32.452 INFO:tasks.workunit.client.0.smithi049.stdout:0/915: chown d8/db/d11/d1c/db8/f108 2980 1 2024-04-26T10:44:32.452 INFO:tasks.workunit.client.0.smithi049.stdout:5/854: write d7/d1d/fa2 [1204621,20904] 0 2024-04-26T10:44:32.453 INFO:tasks.workunit.client.0.smithi049.stdout:7/915: rename d2/dd/d48/da3/fb2 to d2/dd/dd3/df5/d121/f137 0 2024-04-26T10:44:32.453 INFO:tasks.workunit.client.0.smithi049.stdout:9/969: getdents d2/d1a/d42/de3/deb 0 2024-04-26T10:44:32.454 INFO:tasks.workunit.client.0.smithi049.stdout:5/855: stat d7/d1d/d1f/d4e/d80/lc1 0 2024-04-26T10:44:32.454 INFO:tasks.workunit.client.0.smithi049.stdout:7/916: symlink d2/dd/d48/d5c/l138 0 2024-04-26T10:44:32.455 INFO:tasks.workunit.client.0.smithi049.stdout:1/756: dwrite fb [0,4194304] 0 2024-04-26T10:44:32.455 INFO:tasks.workunit.client.0.smithi049.stdout:9/970: write d2/d1a/d42/f67 [5292225,81625] 0 2024-04-26T10:44:32.455 INFO:tasks.workunit.client.0.smithi049.stdout:6/809: dwrite da/dd/de/d26/d22/d4c/fb2 [0,4194304] 0 2024-04-26T10:44:32.456 INFO:tasks.workunit.client.0.smithi049.stdout:5/856: dread - d7/d1d/d34/d123/d91/f4a zero size 2024-04-26T10:44:32.456 INFO:tasks.workunit.client.0.smithi049.stdout:7/917: creat d2/dd/d38/f139 x:0 0 0 2024-04-26T10:44:32.458 INFO:tasks.workunit.client.0.smithi049.stdout:1/757: write d1e/d20/d26/d37/d8e/d97/fa9 [714138,78878] 0 2024-04-26T10:44:32.458 INFO:tasks.workunit.client.0.smithi049.stdout:6/810: chown da/dd/de/d26/d22/ce2 63 1 2024-04-26T10:44:32.458 INFO:tasks.workunit.client.0.smithi049.stdout:5/857: chown d7/d1d/d1f/d4e/d80/lc8 25295 1 2024-04-26T10:44:32.458 INFO:tasks.workunit.client.0.smithi049.stdout:9/971: write d2/d1a/f38 [4136160,4525] 0 2024-04-26T10:44:32.459 INFO:tasks.workunit.client.0.smithi049.stdout:4/906: dread de/d3f/d52/d9b/da5/f97 [0,4194304] 0 2024-04-26T10:44:32.459 INFO:tasks.workunit.client.0.smithi049.stdout:7/918: creat d2/d3/de/d1c/f13a x:0 0 0 2024-04-26T10:44:32.459 INFO:tasks.workunit.client.0.smithi049.stdout:6/811: mknod da/dd/de/d11/dbc/c111 0 2024-04-26T10:44:32.460 INFO:tasks.workunit.client.0.smithi049.stdout:5/858: write d7/d66/f73 [1194740,121226] 0 2024-04-26T10:44:32.460 INFO:tasks.workunit.client.0.smithi049.stdout:5/859: chown d7/d66 765 1 2024-04-26T10:44:32.461 INFO:tasks.workunit.client.0.smithi049.stdout:7/919: fdatasync d2/dd/d7f/d111/f125 0 2024-04-26T10:44:32.461 INFO:tasks.workunit.client.0.smithi049.stdout:6/812: chown da/dd/de/f18 296053078 1 2024-04-26T10:44:32.461 INFO:tasks.workunit.client.0.smithi049.stdout:7/920: chown d2/dd/d7f/dd1/dfa 371578316 1 2024-04-26T10:44:32.463 INFO:tasks.workunit.client.0.smithi049.stdout:7/921: write d2/dd/d38/fa1 [5178300,104613] 0 2024-04-26T10:44:32.463 INFO:tasks.workunit.client.0.smithi049.stdout:6/813: mkdir da/d4a/de0/d112 0 2024-04-26T10:44:32.463 INFO:tasks.workunit.client.0.smithi049.stdout:5/860: rename d7/d1d/d1f/d4e/dad/db3/dcc/l115 to d7/d1d/d34/db9/l147 0 2024-04-26T10:44:32.463 INFO:tasks.workunit.client.0.smithi049.stdout:5/861: stat d7/d1d/d1f/f121 0 2024-04-26T10:44:32.464 INFO:tasks.workunit.client.0.smithi049.stdout:7/922: dread - d2/dd/d7f/d111/f122 zero size 2024-04-26T10:44:32.464 INFO:tasks.workunit.client.0.smithi049.stdout:8/892: sync 2024-04-26T10:44:32.464 INFO:tasks.workunit.client.0.smithi049.stdout:2/809: sync 2024-04-26T10:44:32.465 INFO:tasks.workunit.client.0.smithi049.stdout:7/923: chown d2/dd/d7f/db1/dc6 3392 1 2024-04-26T10:44:32.466 INFO:tasks.workunit.client.0.smithi049.stdout:2/810: write d6/f84 [457871,63140] 0 2024-04-26T10:44:32.466 INFO:tasks.workunit.client.0.smithi049.stdout:4/907: dwrite de/d1b/f2c [4194304,4194304] 0 2024-04-26T10:44:32.467 INFO:tasks.workunit.client.0.smithi049.stdout:7/924: rmdir d2/dd/d48/da3/dda 39 2024-04-26T10:44:32.468 INFO:tasks.workunit.client.0.smithi049.stdout:4/908: creat de/d3f/d52/da6/f115 x:0 0 0 2024-04-26T10:44:32.468 INFO:tasks.workunit.client.0.smithi049.stdout:2/811: mknod d6/d9/d5f/dba/d34/d38/cff 0 2024-04-26T10:44:32.469 INFO:tasks.workunit.client.0.smithi049.stdout:7/925: chown d2/d3/de/d1c/dac/f10b 54 1 2024-04-26T10:44:32.469 INFO:tasks.workunit.client.0.smithi049.stdout:7/926: sync 2024-04-26T10:44:32.470 INFO:tasks.workunit.client.0.smithi049.stdout:4/909: symlink de/dfe/l116 0 2024-04-26T10:44:32.470 INFO:tasks.workunit.client.0.smithi049.stdout:6/814: dwrite f8 [0,4194304] 0 2024-04-26T10:44:32.471 INFO:tasks.workunit.client.0.smithi049.stdout:8/893: read d2/d16/d19/f25 [2510163,25466] 0 2024-04-26T10:44:32.472 INFO:tasks.workunit.client.0.smithi049.stdout:0/916: dread d8/d42/f6c [0,4194304] 0 2024-04-26T10:44:32.472 INFO:tasks.workunit.client.0.smithi049.stdout:4/910: chown de/d3f/d52 1947686 1 2024-04-26T10:44:32.474 INFO:tasks.workunit.client.0.smithi049.stdout:5/862: dwrite d7/d1d/d34/d123/d91/d3e/f42 [0,4194304] 0 2024-04-26T10:44:32.474 INFO:tasks.workunit.client.0.smithi049.stdout:7/927: symlink d2/dd/d7f/dd1/l13b 0 2024-04-26T10:44:32.475 INFO:tasks.workunit.client.0.smithi049.stdout:8/894: mkdir d2/df/d10/d47/d120 0 2024-04-26T10:44:32.475 INFO:tasks.workunit.client.0.smithi049.stdout:4/911: chown de/d1b/d5e/c83 0 1 2024-04-26T10:44:32.475 INFO:tasks.workunit.client.0.smithi049.stdout:7/928: fsync d2/dd/d7f/d111/f125 0 2024-04-26T10:44:32.475 INFO:tasks.workunit.client.0.smithi049.stdout:8/895: stat d2/d17/d34/fd6 0 2024-04-26T10:44:32.476 INFO:tasks.workunit.client.0.smithi049.stdout:0/917: mknod d8/db/d11/d1c/dbb/db0/c136 0 2024-04-26T10:44:32.476 INFO:tasks.workunit.client.0.smithi049.stdout:7/929: fdatasync d2/dd/dd3/fd7 0 2024-04-26T10:44:32.477 INFO:tasks.workunit.client.0.smithi049.stdout:7/930: sync 2024-04-26T10:44:32.478 INFO:tasks.workunit.client.0.smithi049.stdout:6/815: link da/dd/de/d26/d22/f56 da/d4a/de0/d112/f113 0 2024-04-26T10:44:32.478 INFO:tasks.workunit.client.0.smithi049.stdout:4/912: rename de/d1b/d5e/d90 to de/d1b/d5e/d72/d73/d84/d4b/da4/d117 0 2024-04-26T10:44:32.478 INFO:tasks.workunit.client.0.smithi049.stdout:7/931: mkdir d2/dd/d45/da5/d13c 0 2024-04-26T10:44:32.479 INFO:tasks.workunit.client.0.smithi049.stdout:1/758: dread d1e/d20/d26/d37/d69/fdf [0,4194304] 0 2024-04-26T10:44:32.480 INFO:tasks.workunit.client.0.smithi049.stdout:0/918: rename d8/db/l3c to d8/d109/d10e/l137 0 2024-04-26T10:44:32.480 INFO:tasks.workunit.client.0.smithi049.stdout:4/913: creat de/d1b/f118 x:0 0 0 2024-04-26T10:44:32.481 INFO:tasks.workunit.client.0.smithi049.stdout:6/816: rename da/dd/d62/ca5 to da/dd/d62/c114 0 2024-04-26T10:44:32.481 INFO:tasks.workunit.client.0.smithi049.stdout:7/932: symlink d2/dd/d38/l13d 0 2024-04-26T10:44:32.481 INFO:tasks.workunit.client.0.smithi049.stdout:1/759: chown d1e/d20/d26/d3c/d54/d59/d73/dab/fc1 525 1 2024-04-26T10:44:32.481 INFO:tasks.workunit.client.0.smithi049.stdout:5/863: dwrite d7/d1d/d34/d123/d91/d3e/d60/faf [0,4194304] 0 2024-04-26T10:44:32.482 INFO:tasks.workunit.client.0.smithi049.stdout:5/864: chown d7/d14/d18/d48/c10b 62 1 2024-04-26T10:44:32.483 INFO:tasks.workunit.client.0.smithi049.stdout:5/865: write d7/d66/f73 [72291,113776] 0 2024-04-26T10:44:32.484 INFO:tasks.workunit.client.0.smithi049.stdout:9/972: dread d2/d1a/d8a/fdd [0,4194304] 0 2024-04-26T10:44:32.485 INFO:tasks.workunit.client.0.smithi049.stdout:4/914: link de/d1b/d5e/d72/d73/d84/d4b/fda de/d1b/d5e/d99/dbb/f119 0 2024-04-26T10:44:32.485 INFO:tasks.workunit.client.0.smithi049.stdout:1/760: mkdir d1e/d20/d26/d3c/d54/df7 0 2024-04-26T10:44:32.485 INFO:tasks.workunit.client.0.smithi049.stdout:5/866: read - d7/d1d/d1f/d4e/da0/de2/f11c zero size 2024-04-26T10:44:32.485 INFO:tasks.workunit.client.0.smithi049.stdout:6/817: link da/dd/d47/da3/ce9 da/dd/d47/d7b/d84/daa/c115 0 2024-04-26T10:44:32.486 INFO:tasks.workunit.client.0.smithi049.stdout:9/973: unlink d2/d1a/l73 0 2024-04-26T10:44:32.486 INFO:tasks.workunit.client.0.smithi049.stdout:6/818: mkdir da/dd/df0/d116 0 2024-04-26T10:44:32.486 INFO:tasks.workunit.client.0.smithi049.stdout:5/867: chown d7/d14/d18/d48/fbf 1192966 1 2024-04-26T10:44:32.487 INFO:tasks.workunit.client.0.smithi049.stdout:1/761: chown d1e/d20/d26/d37/d69/l76 109931 1 2024-04-26T10:44:32.487 INFO:tasks.workunit.client.0.smithi049.stdout:5/868: fsync d7/d1d/d20/f24 0 2024-04-26T10:44:32.488 INFO:tasks.workunit.client.0.smithi049.stdout:1/762: write fa [3852794,26196] 0 2024-04-26T10:44:32.488 INFO:tasks.workunit.client.0.smithi049.stdout:9/974: link d2/d40/d53/f86 d2/d40/db2/f13a 0 2024-04-26T10:44:32.490 INFO:tasks.workunit.client.0.smithi049.stdout:5/869: symlink d7/d1d/d1f/d4e/d80/l148 0 2024-04-26T10:44:32.491 INFO:tasks.workunit.client.0.smithi049.stdout:0/919: truncate d8/db/d11/d1c/dbb/fd4 1012183 0 2024-04-26T10:44:32.493 INFO:tasks.workunit.client.0.smithi049.stdout:5/870: rmdir d7/d66 39 2024-04-26T10:44:32.493 INFO:tasks.workunit.client.0.smithi049.stdout:3/716: dread d3/fc8 [0,4194304] 0 2024-04-26T10:44:32.493 INFO:tasks.workunit.client.0.smithi049.stdout:6/819: truncate da/dd/fd9 3676992 0 2024-04-26T10:44:32.494 INFO:tasks.workunit.client.0.smithi049.stdout:7/933: dwrite d2/dd/dd3/df5/d115/f12c [0,4194304] 0 2024-04-26T10:44:32.495 INFO:tasks.workunit.client.0.smithi049.stdout:4/915: dwrite de/d1b/d5e/d99/dbb/fd9 [0,4194304] 0 2024-04-26T10:44:32.495 INFO:tasks.workunit.client.0.smithi049.stdout:2/812: dread d6/d9/d5f/dba/f24 [0,4194304] 0 2024-04-26T10:44:32.496 INFO:tasks.workunit.client.0.smithi049.stdout:0/920: mknod d8/db/d26/db9/c138 0 2024-04-26T10:44:32.497 INFO:tasks.workunit.client.0.smithi049.stdout:5/871: chown d7/d1d/d1f/f29 45331757 1 2024-04-26T10:44:32.497 INFO:tasks.workunit.client.0.smithi049.stdout:6/820: stat da/dd/de/d26/d22/cc3 0 2024-04-26T10:44:32.497 INFO:tasks.workunit.client.0.smithi049.stdout:4/916: mknod de/d3f/dbf/c11a 0 2024-04-26T10:44:32.499 INFO:tasks.workunit.client.0.smithi049.stdout:0/921: write d8/d1e/f72 [2286125,126834] 0 2024-04-26T10:44:32.501 INFO:tasks.workunit.client.0.smithi049.stdout:7/934: link d2/dd/d25/d27/l39 d2/dd/d45/l13e 0 2024-04-26T10:44:32.501 INFO:tasks.workunit.client.0.smithi049.stdout:1/763: dwrite d1e/d20/d26/d3c/f3d [4194304,4194304] 0 2024-04-26T10:44:32.501 INFO:tasks.workunit.client.0.smithi049.stdout:6/821: read - da/dd/de/db5/df1/f10a zero size 2024-04-26T10:44:32.502 INFO:tasks.workunit.client.0.smithi049.stdout:4/917: symlink de/d1b/d5e/d72/d73/d84/d4b/da4/d117/db1/l11b 0 2024-04-26T10:44:32.502 INFO:tasks.workunit.client.0.smithi049.stdout:1/764: rmdir d1e/d20/d4d 39 2024-04-26T10:44:32.504 INFO:tasks.workunit.client.0.smithi049.stdout:8/896: dread d2/d17/d34/d40/d64/dcd/ff9 [0,4194304] 0 2024-04-26T10:44:32.504 INFO:tasks.workunit.client.0.smithi049.stdout:0/922: write d8/db/d11/d1c/dbb/dcf/f134 [731243,17122] 0 2024-04-26T10:44:32.504 INFO:tasks.workunit.client.0.smithi049.stdout:4/918: write de/d1b/d5e/d72/d73/f85 [1210402,12173] 0 2024-04-26T10:44:32.505 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:32.502+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:32.506 INFO:tasks.workunit.client.0.smithi049.stdout:1/765: creat d1e/d20/d26/d3c/d96/ff8 x:0 0 0 2024-04-26T10:44:32.506 INFO:tasks.workunit.client.0.smithi049.stdout:8/897: write d2/d17/fa8 [650728,110089] 0 2024-04-26T10:44:32.506 INFO:tasks.workunit.client.0.smithi049.stdout:6/822: rename da/dd/de/d26/fd4 to da/dd/d47/d7b/d84/f117 0 2024-04-26T10:44:32.507 INFO:tasks.workunit.client.0.smithi049.stdout:3/717: dwrite d3/d23/d2f/d6a/d6b/d26/f7a [0,4194304] 0 2024-04-26T10:44:32.507 INFO:tasks.workunit.client.0.smithi049.stdout:2/813: dread d6/d30/fd6 [0,4194304] 0 2024-04-26T10:44:32.507 INFO:tasks.workunit.client.0.smithi049.stdout:6/823: read - da/dd/d62/d9d/d9e/fa6 zero size 2024-04-26T10:44:32.508 INFO:tasks.workunit.client.0.smithi049.stdout:8/898: unlink d2/df/ld8 0 2024-04-26T10:44:32.509 INFO:tasks.workunit.client.0.smithi049.stdout:2/814: write d6/d9/d5f/dba/d34/d7b/f7e [1604762,63902] 0 2024-04-26T10:44:32.509 INFO:tasks.workunit.client.0.smithi049.stdout:3/718: fsync d3/d23/d2f/d6a/d6b/d26/d65/dae/fd5 0 2024-04-26T10:44:32.509 INFO:tasks.workunit.client.0.smithi049.stdout:7/935: dwrite d2/fb7 [0,4194304] 0 2024-04-26T10:44:32.509 INFO:tasks.workunit.client.0.smithi049.stdout:3/719: sync 2024-04-26T10:44:32.509 INFO:tasks.workunit.client.0.smithi049.stdout:1/766: rename d1e/d20/d26/d37/d69/d75/leb to d1e/d20/d26/d3c/d54/d59/de2/lf9 0 2024-04-26T10:44:32.510 INFO:tasks.workunit.client.0.smithi049.stdout:2/815: readlink d6/d9/d5f/dba/d34/d38/l4b 0 2024-04-26T10:44:32.510 INFO:tasks.workunit.client.0.smithi049.stdout:7/936: symlink d2/dd/d25/d27/l13f 0 2024-04-26T10:44:32.511 INFO:tasks.workunit.client.0.smithi049.stdout:3/720: creat d3/d23/d2f/fef x:0 0 0 2024-04-26T10:44:32.511 INFO:tasks.workunit.client.0.smithi049.stdout:1/767: write d1e/d20/d26/d3c/d54/f9b [2024365,57537] 0 2024-04-26T10:44:32.512 INFO:tasks.workunit.client.0.smithi049.stdout:0/923: read d8/d66/f69 [3866706,59958] 0 2024-04-26T10:44:32.512 INFO:tasks.workunit.client.0.smithi049.stdout:7/937: creat d2/dd/d48/d5c/f140 x:0 0 0 2024-04-26T10:44:32.513 INFO:tasks.workunit.client.0.smithi049.stdout:6/824: write da/d4a/de0/d112/f113 [1920337,26462] 0 2024-04-26T10:44:32.514 INFO:tasks.workunit.client.0.smithi049.stdout:3/721: dread - d3/d23/d2f/d6a/d6b/d8/d82/feb zero size 2024-04-26T10:44:32.514 INFO:tasks.workunit.client.0.smithi049.stdout:1/768: symlink d1e/d20/d26/d37/d8e/lfa 0 2024-04-26T10:44:32.515 INFO:tasks.workunit.client.0.smithi049.stdout:7/938: mkdir d2/dab/d141 0 2024-04-26T10:44:32.516 INFO:tasks.workunit.client.0.smithi049.stdout:2/816: rename d6/d9/d5f/dba/df/f4c to d6/d9/d5f/dba/df/f100 0 2024-04-26T10:44:32.516 INFO:tasks.workunit.client.0.smithi049.stdout:8/899: dwrite d2/df/f5a [0,4194304] 0 2024-04-26T10:44:32.517 INFO:tasks.workunit.client.0.smithi049.stdout:6/825: creat da/dd/de/d26/d22/f118 x:0 0 0 2024-04-26T10:44:32.518 INFO:tasks.workunit.client.0.smithi049.stdout:7/939: symlink d2/d3/d96/db3/l142 0 2024-04-26T10:44:32.519 INFO:tasks.workunit.client.0.smithi049.stdout:6/826: fsync da/dd/d62/fb4 0 2024-04-26T10:44:32.520 INFO:tasks.workunit.client.0.smithi049.stdout:3/722: write d3/d23/d2f/d6a/d6b/d26/d58/fa4 [767672,93006] 0 2024-04-26T10:44:32.521 INFO:tasks.workunit.client.0.smithi049.stdout:2/817: creat d6/d32/d4a/f101 x:0 0 0 2024-04-26T10:44:32.521 INFO:tasks.workunit.client.0.smithi049.stdout:0/924: dread d8/d66/f10f [0,4194304] 0 2024-04-26T10:44:32.523 INFO:tasks.workunit.client.0.smithi049.stdout:0/925: fsync d8/db/d26/d39/f129 0 2024-04-26T10:44:32.523 INFO:tasks.workunit.client.0.smithi049.stdout:1/769: dwrite d1e/d62/fb5 [0,4194304] 0 2024-04-26T10:44:32.524 INFO:tasks.workunit.client.0.smithi049.stdout:2/818: rename d6/d9/d5f/ff0 to d6/d30/dc8/f102 0 2024-04-26T10:44:32.525 INFO:tasks.workunit.client.0.smithi049.stdout:8/900: dwrite d2/d17/d34/f5b [0,4194304] 0 2024-04-26T10:44:32.527 INFO:tasks.workunit.client.0.smithi049.stdout:8/901: write d2/d1a/f1e [283821,10267] 0 2024-04-26T10:44:32.528 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:32.528 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:32.529 INFO:tasks.workunit.client.0.smithi049.stdout:0/926: unlink d8/db/d11/d1c/db8/fee 0 2024-04-26T10:44:32.530 INFO:tasks.workunit.client.0.smithi049.stdout:7/940: dwrite d2/dd/d45/d82/f83 [0,4194304] 0 2024-04-26T10:44:32.534 INFO:tasks.workunit.client.0.smithi049.stdout:9/975: dread d2/d1a/fac [0,4194304] 0 2024-04-26T10:44:32.534 INFO:tasks.workunit.client.0.smithi049.stdout:2/819: dread d6/d9/d5f/dba/d11/fb0 [0,4194304] 0 2024-04-26T10:44:32.534 INFO:tasks.workunit.client.0.smithi049.stdout:3/723: truncate d3/d23/d2f/d6a/d6b/d8/dd/f9d 2973427 0 2024-04-26T10:44:32.535 INFO:tasks.workunit.client.0.smithi049.stdout:0/927: dwrite d8/db/d26/db9/dcd/f124 [0,4194304] 0 2024-04-26T10:44:32.535 INFO:tasks.workunit.client.0.smithi049.stdout:7/941: dwrite d2/f6 [12582912,4194304] 0 2024-04-26T10:44:32.536 INFO:tasks.workunit.client.0.smithi049.stdout:7/942: write d2/d3/f91 [859908,80370] 0 2024-04-26T10:44:32.537 INFO:tasks.workunit.client.0.smithi049.stdout:3/724: chown d3/d23/d2f/d6a/d6b/d8/d55/db4/dca 878684 1 2024-04-26T10:44:32.537 INFO:tasks.workunit.client.0.smithi049.stdout:9/976: creat d2/d1a/df/f13b x:0 0 0 2024-04-26T10:44:32.538 INFO:tasks.workunit.client.0.smithi049.stdout:2/820: write d6/d9/d5f/dba/d1e/f81 [2086121,72059] 0 2024-04-26T10:44:32.539 INFO:tasks.workunit.client.0.smithi049.stdout:9/977: chown d2/d40/db2/f13a 2533683 1 2024-04-26T10:44:32.539 INFO:tasks.workunit.client.0.smithi049.stdout:7/943: mkdir d2/dd/d25/d27/d143 0 2024-04-26T10:44:32.539 INFO:tasks.workunit.client.0.smithi049.stdout:0/928: mkdir d8/db/d11/d1c/db8/dec/d139 0 2024-04-26T10:44:32.539 INFO:tasks.workunit.client.0.smithi049.stdout:3/725: rmdir d3/d23/d2f/d6a/d6b/d8/d55/d2e 39 2024-04-26T10:44:32.539 INFO:tasks.workunit.client.0.smithi049.stdout:9/978: fdatasync d2/d1a/d1b/d1f/fd0 0 2024-04-26T10:44:32.540 INFO:tasks.workunit.client.0.smithi049.stdout:7/944: symlink d2/dd/dd3/df5/l144 0 2024-04-26T10:44:32.540 INFO:tasks.workunit.client.0.smithi049.stdout:2/821: symlink d6/d9/d5f/dba/d35/df8/l103 0 2024-04-26T10:44:32.541 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:32.542 INFO:tasks.workunit.client.0.smithi049.stdout:2/822: chown d6/d9/d5f/dba/d11/le4 1 1 2024-04-26T10:44:32.542 INFO:tasks.workunit.client.0.smithi049.stdout:0/929: truncate d8/db/d11/d1b/d4d/dae/ff6 302232 0 2024-04-26T10:44:32.543 INFO:tasks.workunit.client.0.smithi049.stdout:2/823: creat d6/d9/d5f/dba/d34/d38/d3f/d60/f104 x:0 0 0 2024-04-26T10:44:32.544 INFO:tasks.workunit.client.0.smithi049.stdout:0/930: creat d8/db/d26/d39/f13a x:0 0 0 2024-04-26T10:44:32.544 INFO:tasks.workunit.client.0.smithi049.stdout:3/726: read d3/d23/d2f/d6a/d6b/d26/d29/f72 [561789,45580] 0 2024-04-26T10:44:32.544 INFO:tasks.workunit.client.0.smithi049.stdout:5/872: dread d7/ff [0,4194304] 0 2024-04-26T10:44:32.544 INFO:tasks.workunit.client.0.smithi049.stdout:0/931: chown d8/l135 486987288 1 2024-04-26T10:44:32.546 INFO:tasks.workunit.client.0.smithi049.stdout:3/727: chown d3/d23/d2f/d6a/d6b/d26/d65/d70/de2 14 1 2024-04-26T10:44:32.546 INFO:tasks.workunit.client.0.smithi049.stdout:2/824: truncate d6/d9/d5f/dba/df/d31/fa6 5021885 0 2024-04-26T10:44:32.546 INFO:tasks.workunit.client.0.smithi049.stdout:5/873: dread - d7/d66/f7d zero size 2024-04-26T10:44:32.546 INFO:tasks.workunit.client.0.smithi049.stdout:0/932: write d8/db/d93/d96/fa1 [3977098,58231] 0 2024-04-26T10:44:32.548 INFO:tasks.workunit.client.0.smithi049.stdout:1/770: dread d1e/d20/d26/d37/d8e/d97/fa9 [0,4194304] 0 2024-04-26T10:44:32.548 INFO:tasks.workunit.client.0.smithi049.stdout:2/825: mkdir d6/d9/d5f/dba/d34/d105 0 2024-04-26T10:44:32.549 INFO:tasks.workunit.client.0.smithi049.stdout:3/728: chown d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/f28 518 1 2024-04-26T10:44:32.549 INFO:tasks.workunit.client.0.smithi049.stdout:9/979: dwrite d2/d25/f137 [0,4194304] 0 2024-04-26T10:44:32.549 INFO:tasks.workunit.client.0.smithi049.stdout:5/874: truncate d7/d1d/d34/d123/d91/fdb 928167 0 2024-04-26T10:44:32.550 INFO:tasks.workunit.client.0.smithi049.stdout:0/933: link d8/db/d26/d6f/fd0 d8/db/d26/db9/dcd/f13b 0 2024-04-26T10:44:32.550 INFO:tasks.workunit.client.0.smithi049.stdout:1/771: symlink d1e/d20/daf/lfb 0 2024-04-26T10:44:32.550 INFO:tasks.workunit.client.0.smithi049.stdout:2/826: mknod d6/d9/d5f/dba/d34/d38/c106 0 2024-04-26T10:44:32.551 INFO:tasks.workunit.client.0.smithi049.stdout:0/934: chown d8/d41/f8a 92 1 2024-04-26T10:44:32.551 INFO:tasks.workunit.client.0.smithi049.stdout:3/729: mknod d3/d23/d2f/d6a/d6b/d8/d55/db4/dca/cf0 0 2024-04-26T10:44:32.552 INFO:tasks.workunit.client.0.smithi049.stdout:1/772: creat d1e/d20/d26/d37/d69/ffc x:0 0 0 2024-04-26T10:44:32.552 INFO:tasks.workunit.client.0.smithi049.stdout:2/827: creat d6/d9/d5f/dba/d34/f107 x:0 0 0 2024-04-26T10:44:32.552 INFO:tasks.workunit.client.0.smithi049.stdout:9/980: truncate d2/d25/d74/f59 3796768 0 2024-04-26T10:44:32.554 INFO:tasks.workunit.client.0.smithi049.stdout:4/919: dread f8 [0,4194304] 0 2024-04-26T10:44:32.554 INFO:tasks.workunit.client.0.smithi049.stdout:0/935: fdatasync d8/db/d11/d1c/dbb/dc1/dd7/de3/f101 0 2024-04-26T10:44:32.554 INFO:tasks.workunit.client.0.smithi049.stdout:2/828: fsync d6/d9/d5f/f96 0 2024-04-26T10:44:32.554 INFO:tasks.workunit.client.0.smithi049.stdout:1/773: creat d1e/d20/d26/d37/d8e/ffd x:0 0 0 2024-04-26T10:44:32.554 INFO:tasks.workunit.client.0.smithi049.stdout:0/936: unlink d8/db/d11/f32 0 2024-04-26T10:44:32.555 INFO:tasks.workunit.client.0.smithi049.stdout:4/920: mkdir de/d1d/d11c 0 2024-04-26T10:44:32.555 INFO:tasks.workunit.client.0.smithi049.stdout:1/774: chown d1e/dd5/fe1 5 1 2024-04-26T10:44:32.557 INFO:tasks.workunit.client.0.smithi049.stdout:0/937: read d8/db/d26/daf/ffa [115032,100053] 0 2024-04-26T10:44:32.559 INFO:tasks.workunit.client.0.smithi049.stdout:9/981: dwrite d2/f131 [0,4194304] 0 2024-04-26T10:44:32.561 INFO:tasks.workunit.client.0.smithi049.stdout:0/938: truncate d8/db/d11/d1b/fa8 1859591 0 2024-04-26T10:44:32.562 INFO:tasks.workunit.client.0.smithi049.stdout:4/921: dwrite de/d3f/d52/f75 [0,4194304] 0 2024-04-26T10:44:32.563 INFO:tasks.workunit.client.0.smithi049.stdout:9/982: mkdir d2/d1a/d42/de3/d126/d139/d13c 0 2024-04-26T10:44:32.563 INFO:tasks.workunit.client.0.smithi049.stdout:1/775: dwrite d1e/d20/d26/d3c/d54/d59/d73/f7e [0,4194304] 0 2024-04-26T10:44:32.564 INFO:tasks.workunit.client.0.smithi049.stdout:0/939: creat d8/db/d93/d96/d9b/d123/f13c x:0 0 0 2024-04-26T10:44:32.565 INFO:tasks.workunit.client.0.smithi049.stdout:9/983: write d2/d1a/d1b/d1f/f43 [4329067,102043] 0 2024-04-26T10:44:32.565 INFO:tasks.workunit.client.0.smithi049.stdout:1/776: mkdir d1e/d20/d26/d37/d8e/dfe 0 2024-04-26T10:44:32.565 INFO:tasks.workunit.client.0.smithi049.stdout:4/922: mkdir de/d1b/d5e/d72/d73/d84/d4b/da4/d117/db1/d11d 0 2024-04-26T10:44:32.566 INFO:tasks.workunit.client.0.smithi049.stdout:9/984: write d2/d25/d74/f71 [2395033,107715] 0 2024-04-26T10:44:32.567 INFO:tasks.workunit.client.0.smithi049.stdout:0/940: write d8/db/d26/d39/f129 [875485,83923] 0 2024-04-26T10:44:32.567 INFO:tasks.workunit.client.0.smithi049.stdout:9/985: dread - d2/ff3 zero size 2024-04-26T10:44:32.567 INFO:tasks.workunit.client.0.smithi049.stdout:4/923: write de/d1b/d5e/d72/d73/d84/f104 [591893,63357] 0 2024-04-26T10:44:32.567 INFO:tasks.workunit.client.0.smithi049.stdout:4/924: write de/d1b/d5e/f10a [220581,108737] 0 2024-04-26T10:44:32.568 INFO:tasks.workunit.client.0.smithi049.stdout:0/941: creat d8/db/d11/d1b/d4d/dae/dc5/ddd/f13d x:0 0 0 2024-04-26T10:44:32.568 INFO:tasks.workunit.client.0.smithi049.stdout:9/986: rename d2/d1a/d1b/d1f/d34/laf to d2/d25/d60/da4/dde/l13d 0 2024-04-26T10:44:32.569 INFO:tasks.workunit.client.0.smithi049.stdout:4/925: write de/d1b/f96 [621410,109971] 0 2024-04-26T10:44:32.570 INFO:tasks.workunit.client.0.smithi049.stdout:2/829: dread d6/d9/f6b [0,4194304] 0 2024-04-26T10:44:32.570 INFO:tasks.workunit.client.0.smithi049.stdout:6/827: dread da/dd/d62/d9d/d10f/f65 [0,4194304] 0 2024-04-26T10:44:32.570 INFO:tasks.workunit.client.0.smithi049.stdout:0/942: rmdir d8/db/d11/d1b 39 2024-04-26T10:44:32.572 INFO:tasks.workunit.client.0.smithi049.stdout:9/987: rename d2/d25/cd8 to d2/d1a/d42/de3/d11b/d123/d12c/c13e 0 2024-04-26T10:44:32.572 INFO:tasks.workunit.client.0.smithi049.stdout:2/830: creat d6/d9/d5f/dba/d34/d7b/f108 x:0 0 0 2024-04-26T10:44:32.573 INFO:tasks.workunit.client.0.smithi049.stdout:4/926: rmdir de/d1b/d5e/d72/d73/d84/d38/d109 0 2024-04-26T10:44:32.573 INFO:tasks.workunit.client.0.smithi049.stdout:0/943: truncate d8/db/f33 4396587 0 2024-04-26T10:44:32.573 INFO:tasks.workunit.client.0.smithi049.stdout:6/828: rename da/dd/df0 to da/dd/de/d11/d109/d119 0 2024-04-26T10:44:32.573 INFO:tasks.workunit.client.0.smithi049.stdout:9/988: write d2/d1a/d1b/d1f/d34/fbe [3629752,39790] 0 2024-04-26T10:44:32.573 INFO:tasks.workunit.client.0.smithi049.stdout:6/829: unlink da/f91 0 2024-04-26T10:44:32.573 INFO:tasks.workunit.client.0.smithi049.stdout:0/944: mkdir d8/db/d11/d1c/dbb/db0/df9/d13e 0 2024-04-26T10:44:32.574 INFO:tasks.workunit.client.0.smithi049.stdout:9/989: symlink d2/d25/d60/da4/dde/l13f 0 2024-04-26T10:44:32.574 INFO:tasks.workunit.client.0.smithi049.stdout:6/830: symlink da/dd/d62/d9d/l11a 0 2024-04-26T10:44:32.574 INFO:tasks.workunit.client.0.smithi049.stdout:9/990: mkdir d2/d1a/d1b/d140 0 2024-04-26T10:44:32.574 INFO:tasks.workunit.client.0.smithi049.stdout:0/945: creat d8/db/d11/f13f x:0 0 0 2024-04-26T10:44:32.575 INFO:tasks.workunit.client.0.smithi049.stdout:9/991: dread - d2/d1a/d9c/fc7 zero size 2024-04-26T10:44:32.575 INFO:tasks.workunit.client.0.smithi049.stdout:0/946: readlink d8/db/d26/d6f/l70 0 2024-04-26T10:44:32.575 INFO:tasks.workunit.client.0.smithi049.stdout:9/992: write d2/d40/db2/fe5 [624368,89795] 0 2024-04-26T10:44:32.576 INFO:tasks.workunit.client.0.smithi049.stdout:0/947: rmdir d8/db/d26/db9 39 2024-04-26T10:44:32.576 INFO:tasks.workunit.client.0.smithi049.stdout:9/993: stat d2/d25/d60/fa0 0 2024-04-26T10:44:32.576 INFO:tasks.workunit.client.0.smithi049.stdout:8/902: dread d2/d17/d34/d40/f71 [0,4194304] 0 2024-04-26T10:44:32.577 INFO:tasks.workunit.client.0.smithi049.stdout:0/948: creat d8/db/d93/f140 x:0 0 0 2024-04-26T10:44:32.578 INFO:tasks.workunit.client.0.smithi049.stdout:8/903: mkdir d2/df/d10/d47/d75/dd5/d121 0 2024-04-26T10:44:32.578 INFO:tasks.workunit.client.0.smithi049.stdout:9/994: rename d2/d1a/d1b/c12e to d2/d1a/d1b/d1f/c141 0 2024-04-26T10:44:32.578 INFO:tasks.workunit.client.0.smithi049.stdout:0/949: chown d8/da5/lb2 25194 1 2024-04-26T10:44:32.578 INFO:tasks.workunit.client.0.smithi049.stdout:4/927: truncate f1 539705 0 2024-04-26T10:44:32.579 INFO:tasks.workunit.client.0.smithi049.stdout:0/950: dread - d8/db/f100 zero size 2024-04-26T10:44:32.579 INFO:tasks.workunit.client.0.smithi049.stdout:2/831: write d6/d9/d5f/dba/d1e/f21 [3430477,59727] 0 2024-04-26T10:44:32.581 INFO:tasks.workunit.client.0.smithi049.stdout:9/995: rename d2/d25/d60/l133 to d2/d1a/d42/de3/d11b/d123/d12c/l142 0 2024-04-26T10:44:32.582 INFO:tasks.workunit.client.0.smithi049.stdout:2/832: mkdir d6/d30/d97/dbe/d109 0 2024-04-26T10:44:32.582 INFO:tasks.workunit.client.0.smithi049.stdout:0/951: symlink d8/db/d26/db9/dcd/d12d/l141 0 2024-04-26T10:44:32.583 INFO:tasks.workunit.client.0.smithi049.stdout:9/996: chown d2/d40/d53/de7/l138 16491068 1 2024-04-26T10:44:32.583 INFO:tasks.workunit.client.0.smithi049.stdout:2/833: unlink d6/d9/l85 0 2024-04-26T10:44:32.583 INFO:tasks.workunit.client.0.smithi049.stdout:0/952: dread - d8/db/d11/d1c/db8/f108 zero size 2024-04-26T10:44:32.584 INFO:tasks.workunit.client.0.smithi049.stdout:0/953: dread - d8/d1e/fd2 zero size 2024-04-26T10:44:32.584 INFO:tasks.workunit.client.0.smithi049.stdout:2/834: write d6/d9/f94 [526364,86727] 0 2024-04-26T10:44:32.585 INFO:tasks.workunit.client.0.smithi049.stdout:9/997: mkdir d2/d1a/d42/de3/d11b/d123/d135/de9/d143 0 2024-04-26T10:44:32.586 INFO:tasks.workunit.client.0.smithi049.stdout:0/954: dread - d8/db/d11/d1c/dbb/dc1/dd7/d113/f127 zero size 2024-04-26T10:44:32.587 INFO:tasks.workunit.client.0.smithi049.stdout:7/945: dread d2/dd/d25/d27/ffb [0,4194304] 0 2024-04-26T10:44:32.587 INFO:tasks.workunit.client.0.smithi049.stdout:1/777: sync 2024-04-26T10:44:32.587 INFO:tasks.workunit.client.0.smithi049.stdout:4/928: dwrite de/f15 [0,4194304] 0 2024-04-26T10:44:32.588 INFO:tasks.workunit.client.0.smithi049.stdout:0/955: write d8/db/d11/d1c/dbb/dc1/fd5 [148843,4612] 0 2024-04-26T10:44:32.590 INFO:tasks.workunit.client.0.smithi049.stdout:5/875: dread d7/d66/ff9 [0,4194304] 0 2024-04-26T10:44:32.590 INFO:tasks.workunit.client.0.smithi049.stdout:1/778: chown d1e/d20/d4d/l6d 5 1 2024-04-26T10:44:32.591 INFO:tasks.workunit.client.0.smithi049.stdout:4/929: write de/d3f/d48/d8b/fcc [159383,2185] 0 2024-04-26T10:44:32.593 INFO:tasks.workunit.client.0.smithi049.stdout:0/956: symlink d8/db/d11/d1c/dbb/dc1/dd7/de3/l142 0 2024-04-26T10:44:32.593 INFO:tasks.workunit.client.0.smithi049.stdout:1/779: mkdir d1e/d20/d4d/d70/dce/dff 0 2024-04-26T10:44:32.593 INFO:tasks.workunit.client.0.smithi049.stdout:0/957: readlink d8/d66/l9a 0 2024-04-26T10:44:32.593 INFO:tasks.workunit.client.0.smithi049.stdout:9/998: dwrite d2/d40/fec [0,4194304] 0 2024-04-26T10:44:32.595 INFO:tasks.workunit.client.0.smithi049.stdout:4/930: creat de/d1b/d5e/d72/d73/d88/f11e x:0 0 0 2024-04-26T10:44:32.596 INFO:tasks.workunit.client.0.smithi049.stdout:9/999: creat d2/d40/d53/f144 x:0 0 0 2024-04-26T10:44:32.596 INFO:tasks.workunit.client.0.smithi049.stdout:0/958: rename d8/d42/lca to d8/db/d11/d1c/dbb/dc1/dd7/de3/l143 0 2024-04-26T10:44:32.596 INFO:tasks.workunit.client.0.smithi049.stdout:1/780: sync 2024-04-26T10:44:32.596 INFO:tasks.workunit.client.0.smithi049.stdout:4/931: fdatasync de/d3f/d52/d9b/f6b 0 2024-04-26T10:44:32.597 INFO:tasks.workunit.client.0.smithi049.stdout:0/959: readlink d8/db/d26/l2e 0 2024-04-26T10:44:32.597 INFO:tasks.workunit.client.0.smithi049.stdout:1/781: chown d1e/d20/d26/d3c/d54/fc4 13843333 1 2024-04-26T10:44:32.598 INFO:tasks.workunit.client.0.smithi049.stdout:4/932: dread - de/d1b/d5e/d72/d73/d84/d24/f106 zero size 2024-04-26T10:44:32.598 INFO:tasks.workunit.client.0.smithi049.stdout:0/960: mkdir d8/db/d26/daf/d144 0 2024-04-26T10:44:32.598 INFO:tasks.workunit.client.0.smithi049.stdout:4/933: rmdir de/d1d 39 2024-04-26T10:44:32.598 INFO:tasks.workunit.client.0.smithi049.stdout:0/961: write d8/d66/fb4 [2755608,79416] 0 2024-04-26T10:44:32.598 INFO:tasks.workunit.client.0.smithi049.stdout:1/782: truncate d1e/d20/d26/d37/d69/ffc 166935 0 2024-04-26T10:44:32.599 INFO:tasks.workunit.client.0.smithi049.stdout:4/934: creat de/d1b/d5e/d72/f11f x:0 0 0 2024-04-26T10:44:32.599 INFO:tasks.workunit.client.0.smithi049.stdout:3/730: dread d3/d23/d2f/d6a/d6b/d8/d82/f8b [4194304,4194304] 0 2024-04-26T10:44:32.599 INFO:tasks.workunit.client.0.smithi049.stdout:0/962: unlink d8/db/d11/d1b/ldf 0 2024-04-26T10:44:32.601 INFO:tasks.workunit.client.0.smithi049.stdout:4/935: write de/d3f/d52/d9b/fa7 [1368579,81847] 0 2024-04-26T10:44:32.601 INFO:tasks.workunit.client.0.smithi049.stdout:4/936: sync 2024-04-26T10:44:32.602 INFO:tasks.workunit.client.0.smithi049.stdout:1/783: getdents d1e/d20/d26/d37/d6e 0 2024-04-26T10:44:32.602 INFO:tasks.workunit.client.0.smithi049.stdout:6/831: dread da/dd/de/f18 [0,4194304] 0 2024-04-26T10:44:32.603 INFO:tasks.workunit.client.0.smithi049.stdout:1/784: read - d1e/d20/d26/d3c/d54/d59/fbb zero size 2024-04-26T10:44:32.604 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:32.603+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:32.606 INFO:tasks.workunit.client.0.smithi049.stdout:0/963: link d8/db/d93/d96/c11f d8/db/d26/db9/dcd/d12d/c145 0 2024-04-26T10:44:32.606 INFO:tasks.workunit.client.0.smithi049.stdout:8/904: dread d2/df/d10/d47/d75/f105 [0,4194304] 0 2024-04-26T10:44:32.606 INFO:tasks.workunit.client.0.smithi049.stdout:6/832: creat da/dd/d47/da3/f11b x:0 0 0 2024-04-26T10:44:32.607 INFO:tasks.workunit.client.0.smithi049.stdout:2/835: dread d6/d9/d5f/f80 [0,4194304] 0 2024-04-26T10:44:32.608 INFO:tasks.workunit.client.0.smithi049.stdout:1/785: write d1e/d20/d26/d3c/d54/d59/d68/fde [384358,310] 0 2024-04-26T10:44:32.610 INFO:tasks.workunit.client.0.smithi049.stdout:2/836: chown d6/d9/f8c 2 1 2024-04-26T10:44:32.610 INFO:tasks.workunit.client.0.smithi049.stdout:0/964: getdents d8/db/d26/daf/d144 0 2024-04-26T10:44:32.610 INFO:tasks.workunit.client.0.smithi049.stdout:3/731: dwrite d3/d23/d2f/d6a/d6b/d26/d65/dae/fb9 [0,4194304] 0 2024-04-26T10:44:32.610 INFO:tasks.workunit.client.0.smithi049.stdout:6/833: truncate da/dd/d62/fb4 1114427 0 2024-04-26T10:44:32.612 INFO:tasks.workunit.client.0.smithi049.stdout:6/834: readlink da/dd/de/d11/l82 0 2024-04-26T10:44:32.612 INFO:tasks.workunit.client.0.smithi049.stdout:4/937: dwrite de/d1b/d5e/d72/d73/d84/d24/fdc [0,4194304] 0 2024-04-26T10:44:32.612 INFO:tasks.workunit.client.0.smithi049.stdout:0/965: chown d8/da5/lb2 0 1 2024-04-26T10:44:32.612 INFO:tasks.workunit.client.0.smithi049.stdout:3/732: chown d3/d23/d2f/d6a/d6b/d26/d65/d70/c73 34429 1 2024-04-26T10:44:32.613 INFO:tasks.workunit.client.0.smithi049.stdout:1/786: rename d1e/d20/d4d/d70/c7f to d1e/d20/d26/d57/c100 0 2024-04-26T10:44:32.615 INFO:tasks.workunit.client.0.smithi049.stdout:0/966: write d8/d66/f10f [2968353,115825] 0 2024-04-26T10:44:32.616 INFO:tasks.workunit.client.0.smithi049.stdout:8/905: dwrite d2/df/f95 [0,4194304] 0 2024-04-26T10:44:32.616 INFO:tasks.workunit.client.0.smithi049.stdout:3/733: creat d3/d23/d2f/ff1 x:0 0 0 2024-04-26T10:44:32.617 INFO:tasks.workunit.client.0.smithi049.stdout:6/835: rename da/d4a/de0/df2/ff3 to da/dd/de/d11/f11c 0 2024-04-26T10:44:32.617 INFO:tasks.workunit.client.0.smithi049.stdout:5/876: dread d7/d1d/d34/d123/d91/d3e/f40 [0,4194304] 0 2024-04-26T10:44:32.617 INFO:tasks.workunit.client.0.smithi049.stdout:4/938: link de/d3f/d52/d9b/l10b de/d1b/l120 0 2024-04-26T10:44:32.618 INFO:tasks.workunit.client.0.smithi049.stdout:7/946: dread d2/dd/d25/fa4 [0,4194304] 0 2024-04-26T10:44:32.618 INFO:tasks.workunit.client.0.smithi049.stdout:8/906: mknod d2/d17/d34/dbf/c122 0 2024-04-26T10:44:32.618 INFO:tasks.workunit.client.0.smithi049.stdout:0/967: creat d8/db/d26/db9/dcd/f146 x:0 0 0 2024-04-26T10:44:32.619 INFO:tasks.workunit.client.0.smithi049.stdout:2/837: dwrite d6/d9/d5f/dba/d11/f62 [0,4194304] 0 2024-04-26T10:44:32.619 INFO:tasks.workunit.client.0.smithi049.stdout:7/947: rmdir d2/dd/d25 39 2024-04-26T10:44:32.619 INFO:tasks.workunit.client.0.smithi049.stdout:5/877: fsync d7/d14/d18/df3/f13c 0 2024-04-26T10:44:32.620 INFO:tasks.workunit.client.0.smithi049.stdout:3/734: write d3/d23/d2f/d6a/d6b/d8/dd/fac [3593734,24541] 0 2024-04-26T10:44:32.620 INFO:tasks.workunit.client.0.smithi049.stdout:0/968: creat d8/d1e/f147 x:0 0 0 2024-04-26T10:44:32.620 INFO:tasks.workunit.client.0.smithi049.stdout:4/939: stat de/d1b/d5e/d72/d73/d84/d4b/da4/d117 0 2024-04-26T10:44:32.621 INFO:tasks.workunit.client.0.smithi049.stdout:7/948: creat d2/dd/d45/d112/f145 x:0 0 0 2024-04-26T10:44:32.621 INFO:tasks.workunit.client.0.smithi049.stdout:8/907: getdents d2/d16/d19/d42/d7c 0 2024-04-26T10:44:32.622 INFO:tasks.workunit.client.0.smithi049.stdout:4/940: stat de/d1b/l120 0 2024-04-26T10:44:32.622 INFO:tasks.workunit.client.0.smithi049.stdout:1/787: write d1e/d20/f32 [230680,1874] 0 2024-04-26T10:44:32.622 INFO:tasks.workunit.client.0.smithi049.stdout:0/969: write d8/db/d26/db9/f110 [68156,56977] 0 2024-04-26T10:44:32.622 INFO:tasks.workunit.client.0.smithi049.stdout:7/949: mkdir d2/dd/d45/d146 0 2024-04-26T10:44:32.624 INFO:tasks.workunit.client.0.smithi049.stdout:3/735: dread - d3/d23/d2f/d6a/d6b/d26/d65/d70/d96/fe8 zero size 2024-04-26T10:44:32.624 INFO:tasks.workunit.client.0.smithi049.stdout:4/941: fsync de/d1b/fba 0 2024-04-26T10:44:32.624 INFO:tasks.workunit.client.0.smithi049.stdout:0/970: write d8/d1e/f133 [634289,8042] 0 2024-04-26T10:44:32.624 INFO:tasks.workunit.client.0.smithi049.stdout:0/971: readlink d8/d42/lc6 0 2024-04-26T10:44:32.625 INFO:tasks.workunit.client.0.smithi049.stdout:2/838: creat d6/d9/d5f/dba/d34/d38/d3f/d60/f10a x:0 0 0 2024-04-26T10:44:32.625 INFO:tasks.workunit.client.0.smithi049.stdout:5/878: dread d7/ff [0,4194304] 0 2024-04-26T10:44:32.625 INFO:tasks.workunit.client.0.smithi049.stdout:4/942: creat de/d3f/d48/d8b/f121 x:0 0 0 2024-04-26T10:44:32.625 INFO:tasks.workunit.client.0.smithi049.stdout:1/788: readlink d1e/d20/d26/d3c/l4c 0 2024-04-26T10:44:32.626 INFO:tasks.workunit.client.0.smithi049.stdout:7/950: mkdir d2/dd/d38/d102/d147 0 2024-04-26T10:44:32.626 INFO:tasks.workunit.client.0.smithi049.stdout:0/972: symlink d8/db/d11/d1c/db8/dec/l148 0 2024-04-26T10:44:32.626 INFO:tasks.workunit.client.0.smithi049.stdout:3/736: fdatasync d3/d23/d2f/d6a/d6b/d8/f32 0 2024-04-26T10:44:32.627 INFO:tasks.workunit.client.0.smithi049.stdout:7/951: creat d2/d3/dcf/f148 x:0 0 0 2024-04-26T10:44:32.628 INFO:tasks.workunit.client.0.smithi049.stdout:4/943: readlink de/d1b/d5e/d72/d73/d84/l9f 0 2024-04-26T10:44:32.628 INFO:tasks.workunit.client.0.smithi049.stdout:2/839: symlink d6/d9/d5f/dba/d34/d38/l10b 0 2024-04-26T10:44:32.628 INFO:tasks.workunit.client.0.smithi049.stdout:1/789: getdents d1e/d20/d67 0 2024-04-26T10:44:32.628 INFO:tasks.workunit.client.0.smithi049.stdout:3/737: stat d3/d23/d2f/d6a/d6b/d8/d34/cea 0 2024-04-26T10:44:32.629 INFO:tasks.workunit.client.0.smithi049.stdout:7/952: fsync d2/dab/fcb 0 2024-04-26T10:44:32.630 INFO:tasks.workunit.client.0.smithi049.stdout:0/973: mknod d8/db/d11/d1c/dbb/dc1/dd7/de3/c149 0 2024-04-26T10:44:32.630 INFO:tasks.workunit.client.0.smithi049.stdout:8/908: dwrite d2/df/d10/d23/d9a/ffd [0,4194304] 0 2024-04-26T10:44:32.631 INFO:tasks.workunit.client.0.smithi049.stdout:5/879: truncate d7/d1d/d34/d123/d91/fdb 1251147 0 2024-04-26T10:44:32.631 INFO:tasks.workunit.client.0.smithi049.stdout:2/840: stat d6/d9/d5f/dba/d11/d6a 0 2024-04-26T10:44:32.631 INFO:tasks.workunit.client.0.smithi049.stdout:1/790: chown d1e/d20/d26/d3c/d54/d59/d73 198817821 1 2024-04-26T10:44:32.631 INFO:tasks.workunit.client.0.smithi049.stdout:4/944: creat de/d3f/d52/d9b/d9e/db2/f122 x:0 0 0 2024-04-26T10:44:32.631 INFO:tasks.workunit.client.0.smithi049.stdout:2/841: readlink d6/d9/l2e 0 2024-04-26T10:44:32.632 INFO:tasks.workunit.client.0.smithi049.stdout:7/953: readlink d2/dd/d25/l5e 0 2024-04-26T10:44:32.632 INFO:tasks.workunit.client.0.smithi049.stdout:8/909: mknod d2/df/d10/d23/c123 0 2024-04-26T10:44:32.632 INFO:tasks.workunit.client.0.smithi049.stdout:7/954: truncate d2/dd/f11 9304493 0 2024-04-26T10:44:32.632 INFO:tasks.workunit.client.0.smithi049.stdout:5/880: creat d7/d1d/d34/d123/d13f/f149 x:0 0 0 2024-04-26T10:44:32.632 INFO:tasks.workunit.client.0.smithi049.stdout:8/910: creat d2/d16/d88/f124 x:0 0 0 2024-04-26T10:44:32.633 INFO:tasks.workunit.client.0.smithi049.stdout:2/842: dread - d6/d9/d5f/dba/d35/d91/fa7 zero size 2024-04-26T10:44:32.633 INFO:tasks.workunit.client.0.smithi049.stdout:1/791: rename d1e/d20/d26/d37/d69/fdf to d1e/d20/daf/f101 0 2024-04-26T10:44:32.633 INFO:tasks.workunit.client.0.smithi049.stdout:5/881: read - d7/d1d/d34/d123/d91/fee zero size 2024-04-26T10:44:32.634 INFO:tasks.workunit.client.0.smithi049.stdout:8/911: chown d2/d17/c6d 3313914 1 2024-04-26T10:44:32.634 INFO:tasks.workunit.client.0.smithi049.stdout:7/955: truncate d2/d3/de/d1c/f13a 907972 0 2024-04-26T10:44:32.634 INFO:tasks.workunit.client.0.smithi049.stdout:0/974: fsync d8/d1e/f133 0 2024-04-26T10:44:32.635 INFO:tasks.workunit.client.0.smithi049.stdout:2/843: creat d6/d30/dc8/f10c x:0 0 0 2024-04-26T10:44:32.635 INFO:tasks.workunit.client.0.smithi049.stdout:1/792: rmdir d1e/d20/d4d/d70/dce 39 2024-04-26T10:44:32.635 INFO:tasks.workunit.client.0.smithi049.stdout:5/882: mkdir d7/d14/d18/d14a 0 2024-04-26T10:44:32.635 INFO:tasks.workunit.client.0.smithi049.stdout:7/956: symlink d2/dd/d48/da3/dda/l149 0 2024-04-26T10:44:32.635 INFO:tasks.workunit.client.0.smithi049.stdout:4/945: truncate de/d1b/d5e/fac 88959 0 2024-04-26T10:44:32.636 INFO:tasks.workunit.client.0.smithi049.stdout:0/975: chown d8/db/d11/d1b/ca3 582587 1 2024-04-26T10:44:32.636 INFO:tasks.workunit.client.0.smithi049.stdout:1/793: readlink d1e/d20/d26/d3c/d96/da3/lb9 0 2024-04-26T10:44:32.637 INFO:tasks.workunit.client.0.smithi049.stdout:6/836: sync 2024-04-26T10:44:32.639 INFO:tasks.workunit.client.0.smithi049.stdout:1/794: symlink d1e/d20/d26/d3c/d54/d59/d73/l102 0 2024-04-26T10:44:32.639 INFO:tasks.workunit.client.0.smithi049.stdout:4/946: chown de/d1b/d5e/d72/d73/d84/l39 4888 1 2024-04-26T10:44:32.639 INFO:tasks.workunit.client.0.smithi049.stdout:7/957: link d2/dd/d7f/dd1/dfa/c12a d2/dd/d7f/db1/dc6/c14a 0 2024-04-26T10:44:32.639 INFO:tasks.workunit.client.0.smithi049.stdout:0/976: write d8/db/d11/d1b/d4d/dae/ff6 [665108,96451] 0 2024-04-26T10:44:32.640 INFO:tasks.workunit.client.0.smithi049.stdout:3/738: dwrite d3/d23/d2f/d6a/d6b/d8/fd0 [0,4194304] 0 2024-04-26T10:44:32.640 INFO:tasks.workunit.client.0.smithi049.stdout:6/837: chown da/dd/d47/d7b/d84/daa/lc0 1346632 1 2024-04-26T10:44:32.640 INFO:tasks.workunit.client.0.smithi049.stdout:8/912: truncate d2/df/d10/d47/f99 3452191 0 2024-04-26T10:44:32.640 INFO:tasks.workunit.client.0.smithi049.stdout:0/977: chown d8/db/d93/d96/d9b/f106 1 1 2024-04-26T10:44:32.640 INFO:tasks.workunit.client.0.smithi049.stdout:5/883: write d7/dc6/df7/f128 [781133,43500] 0 2024-04-26T10:44:32.643 INFO:tasks.workunit.client.0.smithi049.stdout:6/838: mknod da/dd/d47/d7b/c11d 0 2024-04-26T10:44:32.643 INFO:tasks.workunit.client.0.smithi049.stdout:4/947: creat de/d1b/d5e/d72/d73/d84/d24/d5c/f123 x:0 0 0 2024-04-26T10:44:32.643 INFO:tasks.workunit.client.0.smithi049.stdout:0/978: symlink d8/db/d26/db9/dcd/l14a 0 2024-04-26T10:44:32.643 INFO:tasks.workunit.client.0.smithi049.stdout:7/958: link d2/dd/d25/f75 d2/dd/d7f/dd1/dfa/d113/f14b 0 2024-04-26T10:44:32.643 INFO:tasks.workunit.client.0.smithi049.stdout:5/884: creat d7/d1d/f14b x:0 0 0 2024-04-26T10:44:32.644 INFO:tasks.workunit.client.0.smithi049.stdout:1/795: link d1e/d20/d4d/l6d d1e/d20/d26/d3c/d54/d59/l103 0 2024-04-26T10:44:32.645 INFO:tasks.workunit.client.0.smithi049.stdout:5/885: dread - d7/d1d/d34/d123/d91/f4a zero size 2024-04-26T10:44:32.645 INFO:tasks.workunit.client.0.smithi049.stdout:4/948: mkdir de/d1b/d5e/d72/d73/d84/d38/d124 0 2024-04-26T10:44:32.645 INFO:tasks.workunit.client.0.smithi049.stdout:3/739: getdents d3/d23/d2f/d6a/d6b/d8/d55/db4/dca 0 2024-04-26T10:44:32.645 INFO:tasks.workunit.client.0.smithi049.stdout:7/959: dread - d2/dab/de7/f101 zero size 2024-04-26T10:44:32.645 INFO:tasks.workunit.client.0.smithi049.stdout:6/839: dread - da/dd/de/db5/df1/dfa/fbd zero size 2024-04-26T10:44:32.645 INFO:tasks.workunit.client.0.smithi049.stdout:5/886: mknod d7/dc6/c14c 0 2024-04-26T10:44:32.646 INFO:tasks.workunit.client.0.smithi049.stdout:4/949: write de/f15 [1752456,36967] 0 2024-04-26T10:44:32.647 INFO:tasks.workunit.client.0.smithi049.stdout:8/913: write d2/df/d10/d23/d6c/d5e/fb1 [2409981,4640] 0 2024-04-26T10:44:32.647 INFO:tasks.workunit.client.0.smithi049.stdout:0/979: dread d8/db/d11/d1c/dbb/fd4 [0,4194304] 0 2024-04-26T10:44:32.647 INFO:tasks.workunit.client.0.smithi049.stdout:5/887: dread - d7/d1d/d34/d123/db2/f126 zero size 2024-04-26T10:44:32.649 INFO:tasks.workunit.client.0.smithi049.stdout:4/950: symlink de/d1b/d5e/d72/d73/d84/d4b/db5/l125 0 2024-04-26T10:44:32.650 INFO:tasks.workunit.client.0.smithi049.stdout:7/960: truncate d2/dd/d45/d112/f145 772893 0 2024-04-26T10:44:32.650 INFO:tasks.workunit.client.0.smithi049.stdout:3/740: dread d3/d23/d2f/d6a/d6b/d26/d65/d70/d84/fd9 [0,4194304] 0 2024-04-26T10:44:32.651 INFO:tasks.workunit.client.0.smithi049.stdout:8/914: dread - d2/d17/d34/d40/d7f/f108 zero size 2024-04-26T10:44:32.652 INFO:tasks.workunit.client.0.smithi049.stdout:5/888: creat d7/d1d/d1f/d4e/dad/db3/f14d x:0 0 0 2024-04-26T10:44:32.654 INFO:tasks.workunit.client.0.smithi049.stdout:6/840: dwrite da/d4a/f94 [0,4194304] 0 2024-04-26T10:44:32.654 INFO:tasks.workunit.client.0.smithi049.stdout:1/796: dwrite d1e/d20/d26/d3c/d54/d59/d73/f7e [0,4194304] 0 2024-04-26T10:44:32.654 INFO:tasks.workunit.client.0.smithi049.stdout:4/951: symlink de/d1b/d5e/d72/d73/d84/d24/db4/l126 0 2024-04-26T10:44:32.655 INFO:tasks.workunit.client.0.smithi049.stdout:7/961: rename d2/f53 to d2/dd/dd3/df5/d121/f14c 0 2024-04-26T10:44:32.656 INFO:tasks.workunit.client.0.smithi049.stdout:3/741: mkdir d3/d23/d2f/d6a/d6b/d8/d55/df2 0 2024-04-26T10:44:32.656 INFO:tasks.workunit.client.0.smithi049.stdout:5/889: unlink d7/d1d/d1f/d4e/d80/lc1 0 2024-04-26T10:44:32.657 INFO:tasks.workunit.client.0.smithi049.stdout:6/841: rmdir da/dd/d62/d9d 39 2024-04-26T10:44:32.657 INFO:tasks.workunit.client.0.smithi049.stdout:4/952: creat de/d3f/d48/f127 x:0 0 0 2024-04-26T10:44:32.658 INFO:tasks.workunit.client.0.smithi049.stdout:7/962: symlink d2/dd/d45/l14d 0 2024-04-26T10:44:32.659 INFO:tasks.workunit.client.0.smithi049.stdout:7/963: fdatasync d2/d3/d96/fe5 0 2024-04-26T10:44:32.660 INFO:tasks.workunit.client.0.smithi049.stdout:0/980: dwrite d8/db/d26/f11e [0,4194304] 0 2024-04-26T10:44:32.660 INFO:tasks.workunit.client.0.smithi049.stdout:3/742: creat d3/d23/d2f/db8/ff3 x:0 0 0 2024-04-26T10:44:32.660 INFO:tasks.workunit.client.0.smithi049.stdout:4/953: chown de/d1b/d5e/d72/d73/d84/f2e 50544 1 2024-04-26T10:44:32.660 INFO:tasks.workunit.client.0.smithi049.stdout:2/844: dread d6/f2f [0,4194304] 0 2024-04-26T10:44:32.661 INFO:tasks.workunit.client.0.smithi049.stdout:8/915: dread d2/d17/d34/d40/f71 [0,4194304] 0 2024-04-26T10:44:32.662 INFO:tasks.workunit.client.0.smithi049.stdout:6/842: creat da/dd/de/d26/d22/d4c/f11e x:0 0 0 2024-04-26T10:44:32.662 INFO:tasks.workunit.client.0.smithi049.stdout:3/743: dread - d3/d23/d2f/d6a/d6b/d8/d82/fdc zero size 2024-04-26T10:44:32.663 INFO:tasks.workunit.client.0.smithi049.stdout:2/845: mkdir d6/d9/d5f/d10d 0 2024-04-26T10:44:32.664 INFO:tasks.workunit.client.0.smithi049.stdout:4/954: truncate de/d1b/d5e/d72/d73/d84/d24/f112 9595 0 2024-04-26T10:44:32.664 INFO:tasks.workunit.client.0.smithi049.stdout:0/981: truncate d8/d42/f43 1538514 0 2024-04-26T10:44:32.664 INFO:tasks.workunit.client.0.smithi049.stdout:5/890: dwrite d7/f9 [4194304,4194304] 0 2024-04-26T10:44:32.665 INFO:tasks.workunit.client.0.smithi049.stdout:3/744: symlink d3/d23/d2f/d6a/d6b/d26/lf4 0 2024-04-26T10:44:32.666 INFO:tasks.workunit.client.0.smithi049.stdout:0/982: chown d8/db/d11/d1b/l78 1293 1 2024-04-26T10:44:32.667 INFO:tasks.workunit.client.0.smithi049.stdout:2/846: symlink d6/d30/d97/dbe/dd1/df5/l10e 0 2024-04-26T10:44:32.667 INFO:tasks.workunit.client.0.smithi049.stdout:6/843: truncate da/dd/de/db5/df1/f10a 1017778 0 2024-04-26T10:44:32.669 INFO:tasks.workunit.client.0.smithi049.stdout:5/891: rename d7/d1d/d1f/cf4 to d7/d66/d84/d103/c14e 0 2024-04-26T10:44:32.669 INFO:tasks.workunit.client.0.smithi049.stdout:0/983: truncate d8/db/d26/f122 840889 0 2024-04-26T10:44:32.669 INFO:tasks.workunit.client.0.smithi049.stdout:8/916: truncate d2/df/d10/d47/d75/fb3 2979509 0 2024-04-26T10:44:32.670 INFO:tasks.workunit.client.0.smithi049.stdout:1/797: dwrite d1e/d20/d26/f51 [0,4194304] 0 2024-04-26T10:44:32.670 INFO:tasks.workunit.client.0.smithi049.stdout:3/745: mkdir d3/d23/d2f/d6a/d6b/d8/dd/df5 0 2024-04-26T10:44:32.671 INFO:tasks.workunit.client.0.smithi049.stdout:6/844: getdents da/dd/de/d11 0 2024-04-26T10:44:32.671 INFO:tasks.workunit.client.0.smithi049.stdout:0/984: rmdir d8/db/d11 39 2024-04-26T10:44:32.671 INFO:tasks.workunit.client.0.smithi049.stdout:5/892: symlink d7/d66/d84/l14f 0 2024-04-26T10:44:32.672 INFO:tasks.workunit.client.0.smithi049.stdout:4/955: dwrite de/d3f/d52/fc1 [0,4194304] 0 2024-04-26T10:44:32.673 INFO:tasks.workunit.client.0.smithi049.stdout:8/917: readlink d2/d17/d34/d40/d64/dcd/df0/d109/d2a/d9f/de9/lf8 0 2024-04-26T10:44:32.674 INFO:tasks.workunit.client.0.smithi049.stdout:1/798: truncate d1e/d20/d26/d3c/d54/d59/d68/fcd 787898 0 2024-04-26T10:44:32.675 INFO:tasks.workunit.client.0.smithi049.stdout:0/985: mknod d8/db/d11/d1b/d4d/c14b 0 2024-04-26T10:44:32.675 INFO:tasks.workunit.client.0.smithi049.stdout:4/956: unlink de/d3f/d48/f127 0 2024-04-26T10:44:32.675 INFO:tasks.workunit.client.0.smithi049.stdout:6/845: creat da/dd/de/d26/d22/d4c/d10c/f11f x:0 0 0 2024-04-26T10:44:32.676 INFO:tasks.workunit.client.0.smithi049.stdout:3/746: unlink d3/d23/d2f/d6a/d6b/d26/lf4 0 2024-04-26T10:44:32.676 INFO:tasks.workunit.client.0.smithi049.stdout:8/918: chown d2/d16/d19/dd9/ded/c106 6962 1 2024-04-26T10:44:32.676 INFO:tasks.workunit.client.0.smithi049.stdout:1/799: write d1e/d20/d26/d37/d6e/f8c [368597,105753] 0 2024-04-26T10:44:32.676 INFO:tasks.workunit.client.0.smithi049.stdout:5/893: read d7/d1d/d1f/d4e/d80/fb1 [1392348,79442] 0 2024-04-26T10:44:32.676 INFO:tasks.workunit.client.0.smithi049.stdout:6/846: chown da/dd/d62/d9d/d10f/f65 1 1 2024-04-26T10:44:32.677 INFO:tasks.workunit.client.0.smithi049.stdout:3/747: dread - d3/d23/d2f/d6a/d6b/d26/d65/dae/fd5 zero size 2024-04-26T10:44:32.678 INFO:tasks.workunit.client.0.smithi049.stdout:2/847: truncate d6/d9/d5f/dba/df/d31/f5c 2974354 0 2024-04-26T10:44:32.678 INFO:tasks.workunit.client.0.smithi049.stdout:5/894: creat d7/d1d/f150 x:0 0 0 2024-04-26T10:44:32.680 INFO:tasks.workunit.client.0.smithi049.stdout:4/957: truncate de/d1b/d5e/d72/d73/d88/f89 793527 0 2024-04-26T10:44:32.680 INFO:tasks.workunit.client.0.smithi049.stdout:3/748: read - d3/d23/d2f/d6a/d6b/d8/d55/db4/dca/dc4/fe4 zero size 2024-04-26T10:44:32.683 INFO:tasks.workunit.client.0.smithi049.stdout:5/895: write d7/dc6/df7/f128 [1063733,70746] 0 2024-04-26T10:44:32.683 INFO:tasks.workunit.client.0.smithi049.stdout:2/848: chown d6/d9/d5f/dba/df/d31/f5c 994 1 2024-04-26T10:44:32.684 INFO:tasks.workunit.client.0.smithi049.stdout:1/800: truncate d1e/d20/d26/d3c/d54/d59/d68/fc0 879527 0 2024-04-26T10:44:32.684 INFO:tasks.workunit.client.0.smithi049.stdout:0/986: dread d8/db/d11/d1c/dbb/dcf/f134 [0,4194304] 0 2024-04-26T10:44:32.684 INFO:tasks.workunit.client.0.smithi049.stdout:4/958: fsync de/d1b/d5e/d72/d73/f7c 0 2024-04-26T10:44:32.684 INFO:tasks.workunit.client.0.smithi049.stdout:8/919: dwrite d2/df/f95 [4194304,4194304] 0 2024-04-26T10:44:32.684 INFO:tasks.workunit.client.0.smithi049.stdout:3/749: chown d3/d23/d2f/d6a/d6b/d8/c4f 714376834 1 2024-04-26T10:44:32.684 INFO:tasks.workunit.client.0.smithi049.stdout:5/896: rename d7/d1d/d1f/f12d to d7/d53/d130/f151 0 2024-04-26T10:44:32.685 INFO:tasks.workunit.client.0.smithi049.stdout:1/801: write d1e/d20/d26/d3c/f4f [4612174,65107] 0 2024-04-26T10:44:32.685 INFO:tasks.workunit.client.0.smithi049.stdout:0/987: write d8/db/d11/d1c/dbb/db0/d102/f128 [731642,1122] 0 2024-04-26T10:44:32.686 INFO:tasks.workunit.client.0.smithi049.stdout:8/920: creat d2/d17/d34/dbf/f125 x:0 0 0 2024-04-26T10:44:32.686 INFO:tasks.workunit.client.0.smithi049.stdout:2/849: rename d6/d30/d97/dbe/fe3 to d6/d9/d5f/dba/d11/f10f 0 2024-04-26T10:44:32.687 INFO:tasks.workunit.client.0.smithi049.stdout:3/750: fdatasync d3/d23/d2f/d6a/d6b/d26/d29/f72 0 2024-04-26T10:44:32.687 INFO:tasks.workunit.client.0.smithi049.stdout:8/921: rmdir d2/df/d10/d47 39 2024-04-26T10:44:32.688 INFO:tasks.workunit.client.0.smithi049.stdout:5/897: write d7/d1d/d34/d123/d91/d3e/d7b/f12f [761203,67175] 0 2024-04-26T10:44:32.688 INFO:tasks.workunit.client.0.smithi049.stdout:1/802: read d1e/d20/d26/d37/d69/d75/f9e [93898,50291] 0 2024-04-26T10:44:32.688 INFO:tasks.workunit.client.0.smithi049.stdout:2/850: fsync d6/d9/d5f/dba/d34/d38/ffc 0 2024-04-26T10:44:32.689 INFO:tasks.workunit.client.0.smithi049.stdout:0/988: write d8/d1e/fd2 [2388,46497] 0 2024-04-26T10:44:32.690 INFO:tasks.workunit.client.0.smithi049.stdout:7/964: dread d2/dd/f26 [0,4194304] 0 2024-04-26T10:44:32.690 INFO:tasks.workunit.client.0.smithi049.stdout:6/847: dwrite da/dd/de/f75 [0,4194304] 0 2024-04-26T10:44:32.690 INFO:tasks.workunit.client.0.smithi049.stdout:2/851: fdatasync d6/d32/ff9 0 2024-04-26T10:44:32.691 INFO:tasks.workunit.client.0.smithi049.stdout:3/751: creat d3/d23/d2f/d6a/d6b/d8/ded/ff6 x:0 0 0 2024-04-26T10:44:32.691 INFO:tasks.workunit.client.0.smithi049.stdout:8/922: creat d2/d16/d19/dd9/ded/f126 x:0 0 0 2024-04-26T10:44:32.691 INFO:tasks.workunit.client.0.smithi049.stdout:4/959: dwrite de/d1b/f92 [4194304,4194304] 0 2024-04-26T10:44:32.693 INFO:tasks.workunit.client.0.smithi049.stdout:3/752: dread - d3/d23/d2f/fc7 zero size 2024-04-26T10:44:32.693 INFO:tasks.workunit.client.0.smithi049.stdout:1/803: truncate d1e/d20/d26/d3c/d96/ff8 316771 0 2024-04-26T10:44:32.694 INFO:tasks.workunit.client.0.smithi049.stdout:6/848: chown da/dd/de/d26/d29/c33 1499567 1 2024-04-26T10:44:32.694 INFO:tasks.workunit.client.0.smithi049.stdout:8/923: truncate d2/f8a 1017368 0 2024-04-26T10:44:32.694 INFO:tasks.workunit.client.0.smithi049.stdout:2/852: mkdir d6/d9/d5f/d110 0 2024-04-26T10:44:32.694 INFO:tasks.workunit.client.0.smithi049.stdout:7/965: truncate d2/dd/d48/d5c/f109 913417 0 2024-04-26T10:44:32.695 INFO:tasks.workunit.client.0.smithi049.stdout:0/989: rename d8/db/d11/d1c/c81 to d8/db/d11/d115/c14c 0 2024-04-26T10:44:32.695 INFO:tasks.workunit.client.0.smithi049.stdout:1/804: stat d1e/d20/d4d 0 2024-04-26T10:44:32.695 INFO:tasks.workunit.client.0.smithi049.stdout:4/960: symlink de/d3f/d48/d8b/db9/l128 0 2024-04-26T10:44:32.696 INFO:tasks.workunit.client.0.smithi049.stdout:7/966: mkdir d2/d3/d96/ddc/d14e 0 2024-04-26T10:44:32.696 INFO:tasks.workunit.client.0.smithi049.stdout:1/805: mknod d1e/d20/d26/c104 0 2024-04-26T10:44:32.696 INFO:tasks.workunit.client.0.smithi049.stdout:5/898: dwrite d7/dc6/df7/f118 [0,4194304] 0 2024-04-26T10:44:32.697 INFO:tasks.workunit.client.0.smithi049.stdout:4/961: readlink de/d1b/d5e/d99/lcb 0 2024-04-26T10:44:32.697 INFO:tasks.workunit.client.0.smithi049.stdout:3/753: write d3/d23/d2f/d6a/d6b/d26/d65/d70/d96/fe8 [87694,23367] 0 2024-04-26T10:44:32.697 INFO:tasks.workunit.client.0.smithi049.stdout:1/806: chown d1e/d20/d26/d3c/d54/d59/f5e 120252311 1 2024-04-26T10:44:32.700 INFO:tasks.workunit.client.0.smithi049.stdout:6/849: creat da/dd/de/d11/d109/d119/d116/f120 x:0 0 0 2024-04-26T10:44:32.700 INFO:tasks.workunit.client.0.smithi049.stdout:8/924: write d2/fe [1239172,105100] 0 2024-04-26T10:44:32.700 INFO:tasks.workunit.client.0.smithi049.stdout:7/967: symlink d2/dd/d45/l14f 0 2024-04-26T10:44:32.700 INFO:tasks.workunit.client.0.smithi049.stdout:0/990: rename d8/db/d26/daf/ffa to d8/db/d26/daf/f14d 0 2024-04-26T10:44:32.700 INFO:tasks.workunit.client.0.smithi049.stdout:5/899: rename d7/d1d/d1f/d4e/f104 to d7/d53/f152 0 2024-04-26T10:44:32.700 INFO:tasks.workunit.client.0.smithi049.stdout:3/754: truncate d3/d23/d2f/d6a/d6b/d26/f86 584487 0 2024-04-26T10:44:32.702 INFO:tasks.workunit.client.0.smithi049.stdout:7/968: write d2/dd/d38/f44 [2945892,86538] 0 2024-04-26T10:44:32.703 INFO:tasks.workunit.client.0.smithi049.stdout:0/991: stat d8/f18 0 2024-04-26T10:44:32.703 INFO:tasks.workunit.client.0.smithi049.stdout:6/850: symlink da/dd/de/d11/dbc/l121 0 2024-04-26T10:44:32.703 INFO:tasks.workunit.client.0.smithi049.stdout:5/900: fdatasync d7/d1d/d34/d123/d91/d3e/d60/f120 0 2024-04-26T10:44:32.703 INFO:tasks.workunit.client.0.smithi049.stdout:4/962: dwrite de/d1b/f92 [0,4194304] 0 2024-04-26T10:44:32.704 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:32.704 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:32.704 INFO:tasks.workunit.client.0.smithi049.stdout:7/969: creat d2/dab/de7/f150 x:0 0 0 2024-04-26T10:44:32.704 INFO:tasks.workunit.client.0.smithi049.stdout:3/755: mknod d3/d23/d2f/d6a/d6b/d8/dd/df5/cf7 0 2024-04-26T10:44:32.705 INFO:tasks.workunit.client.0.smithi049.stdout:0/992: creat d8/db/d26/daf/f14e x:0 0 0 2024-04-26T10:44:32.705 INFO:tasks.workunit.client.0.smithi049.stdout:6/851: chown da/dd/de/d11/dbc/f100 20870 1 2024-04-26T10:44:32.705 INFO:tasks.workunit.client.0.smithi049.stdout:4/963: symlink de/d1b/d5e/d99/l129 0 2024-04-26T10:44:32.706 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:32.703+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:32.706 INFO:tasks.workunit.client.0.smithi049.stdout:7/970: getdents d2/dab/d141 0 2024-04-26T10:44:32.706 INFO:tasks.workunit.client.0.smithi049.stdout:5/901: rename d7/d1d/d1f/d4e/d77/fd4 to d7/d1d/d1f/f153 0 2024-04-26T10:44:32.707 INFO:tasks.workunit.client.0.smithi049.stdout:0/993: dread - d8/d1e/f147 zero size 2024-04-26T10:44:32.707 INFO:tasks.workunit.client.0.smithi049.stdout:8/925: truncate d2/d17/d34/d40/d64/dcd/df0/d109/d2a/f54 1142529 0 2024-04-26T10:44:32.707 INFO:tasks.workunit.client.0.smithi049.stdout:1/807: dwrite d1e/d20/d26/d3c/f7b [0,4194304] 0 2024-04-26T10:44:32.707 INFO:tasks.workunit.client.0.smithi049.stdout:5/902: stat d7/d1d/d1f/f9a 0 2024-04-26T10:44:32.707 INFO:tasks.workunit.client.0.smithi049.stdout:3/756: creat d3/d23/d2f/d6a/d6b/d26/d65/d70/de2/ff8 x:0 0 0 2024-04-26T10:44:32.709 INFO:tasks.workunit.client.0.smithi049.stdout:5/903: write d7/d1d/d34/d123/d91/d3e/d60/faa [2768081,41706] 0 2024-04-26T10:44:32.709 INFO:tasks.workunit.client.0.smithi049.stdout:8/926: getdents d2/df/dab 0 2024-04-26T10:44:32.709 INFO:tasks.workunit.client.0.smithi049.stdout:0/994: link d8/db/d93/d96/fa1 d8/db/d11/d1b/d4d/dae/dc5/ddd/f14f 0 2024-04-26T10:44:32.710 INFO:tasks.workunit.client.0.smithi049.stdout:6/852: rename da/d4a/de0/df2 to da/dd/de/d26/d22/d122 0 2024-04-26T10:44:32.710 INFO:tasks.workunit.client.0.smithi049.stdout:8/927: chown d2/d16/d19/d42/deb/ffa 5256782 1 2024-04-26T10:44:32.714 INFO:tasks.workunit.client.0.smithi049.stdout:3/757: read d3/f40 [3657188,23797] 0 2024-04-26T10:44:32.714 INFO:tasks.workunit.client.0.smithi049.stdout:5/904: creat d7/d1d/d34/d123/d91/d106/f154 x:0 0 0 2024-04-26T10:44:32.714 INFO:tasks.workunit.client.0.smithi049.stdout:7/971: rename d2/dd/d48 to d2/d3/de/d1c/dac/d151 0 2024-04-26T10:44:32.714 INFO:tasks.workunit.client.0.smithi049.stdout:6/853: fdatasync da/dd/d62/f6d 0 2024-04-26T10:44:32.715 INFO:tasks.workunit.client.0.smithi049.stdout:8/928: creat d2/d1a/f127 x:0 0 0 2024-04-26T10:44:32.715 INFO:tasks.workunit.client.0.smithi049.stdout:6/854: dread - da/dd/d62/f83 zero size 2024-04-26T10:44:32.715 INFO:tasks.workunit.client.0.smithi049.stdout:1/808: rename d1e/d20/d26/d37/d8e/d97/fd4 to d1e/d20/d26/d37/d8e/dfe/f105 0 2024-04-26T10:44:32.715 INFO:tasks.workunit.client.0.smithi049.stdout:7/972: creat d2/d3/de/d1c/dac/f152 x:0 0 0 2024-04-26T10:44:32.715 INFO:tasks.workunit.client.0.smithi049.stdout:1/809: chown d1e/dd5/ff3 3202 1 2024-04-26T10:44:32.715 INFO:tasks.workunit.client.0.smithi049.stdout:5/905: creat d7/d14/d18/d2b/d117/f155 x:0 0 0 2024-04-26T10:44:32.715 INFO:tasks.workunit.client.0.smithi049.stdout:6/855: fdatasync da/dd/de/d11/f7e 0 2024-04-26T10:44:32.715 INFO:tasks.workunit.client.0.smithi049.stdout:0/995: rename d8/db/d11/d1c/dbb/c77 to d8/db/d93/d96/d9b/c150 0 2024-04-26T10:44:32.715 INFO:tasks.workunit.client.0.smithi049.stdout:3/758: symlink d3/d23/d2f/d6a/d6b/d26/d65/lf9 0 2024-04-26T10:44:32.715 INFO:tasks.workunit.client.0.smithi049.stdout:5/906: mknod d7/dc6/c156 0 2024-04-26T10:44:32.715 INFO:tasks.workunit.client.0.smithi049.stdout:1/810: write d1e/d20/f38 [1413611,77516] 0 2024-04-26T10:44:32.715 INFO:tasks.workunit.client.0.smithi049.stdout:7/973: fdatasync d2/dd/d7f/dd1/dfa/d113/f14b 0 2024-04-26T10:44:32.716 INFO:tasks.workunit.client.0.smithi049.stdout:7/974: stat d2/dd/d38/f40 0 2024-04-26T10:44:32.716 INFO:tasks.workunit.client.0.smithi049.stdout:3/759: mkdir d3/d23/d2f/d6a/d6b/d8/dfa 0 2024-04-26T10:44:32.717 INFO:tasks.workunit.client.0.smithi049.stdout:6/856: unlink da/dd/de/d26/d29/ld1 0 2024-04-26T10:44:32.717 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:32.718 INFO:tasks.workunit.client.0.smithi049.stdout:6/857: dread - da/dd/f6b zero size 2024-04-26T10:44:32.718 INFO:tasks.workunit.client.0.smithi049.stdout:1/811: truncate d1e/d20/d26/d3c/d54/fc4 590344 0 2024-04-26T10:44:32.719 INFO:tasks.workunit.client.0.smithi049.stdout:7/975: link d2/dd/d38/ff4 d2/d3/de/d1c/f153 0 2024-04-26T10:44:32.720 INFO:tasks.workunit.client.0.smithi049.stdout:3/760: rmdir d3/d23/d2f/d6a/d6b/d8/d55/d2e 39 2024-04-26T10:44:32.720 INFO:tasks.workunit.client.0.smithi049.stdout:6/858: write da/dd/d62/d9d/d10f/f4b [4985785,27214] 0 2024-04-26T10:44:32.720 INFO:tasks.workunit.client.0.smithi049.stdout:0/996: dwrite d8/d1e/f2b [0,4194304] 0 2024-04-26T10:44:32.720 INFO:tasks.workunit.client.0.smithi049.stdout:8/929: dwrite d2/d16/d19/f25 [0,4194304] 0 2024-04-26T10:44:32.720 INFO:tasks.workunit.client.0.smithi049.stdout:1/812: creat d1e/d20/d67/dd9/df5/f106 x:0 0 0 2024-04-26T10:44:32.721 INFO:tasks.workunit.client.0.smithi049.stdout:5/907: truncate d7/d14/d18/ffa 862525 0 2024-04-26T10:44:32.721 INFO:tasks.workunit.client.0.smithi049.stdout:7/976: mkdir d2/dd/dd3/df5/d115/d154 0 2024-04-26T10:44:32.721 INFO:tasks.workunit.client.0.smithi049.stdout:2/853: sync 2024-04-26T10:44:32.721 INFO:tasks.workunit.client.0.smithi049.stdout:4/964: sync 2024-04-26T10:44:32.722 INFO:tasks.workunit.client.0.smithi049.stdout:6/859: mknod da/dd/d47/da3/c123 0 2024-04-26T10:44:32.722 INFO:tasks.workunit.client.0.smithi049.stdout:1/813: rename cf to d1e/d20/d26/d37/d8e/dfe/c107 0 2024-04-26T10:44:32.722 INFO:tasks.workunit.client.0.smithi049.stdout:3/761: truncate d3/d23/d2f/d6a/d6b/d26/d5f/fe3 177182 0 2024-04-26T10:44:32.723 INFO:tasks.workunit.client.0.smithi049.stdout:6/860: stat da/dd/de/d11/la2 0 2024-04-26T10:44:32.724 INFO:tasks.workunit.client.0.smithi049.stdout:8/930: write f1 [1254040,119026] 0 2024-04-26T10:44:32.725 INFO:tasks.workunit.client.0.smithi049.stdout:1/814: creat d1e/d20/d26/d37/d8e/dfe/f108 x:0 0 0 2024-04-26T10:44:32.726 INFO:tasks.workunit.client.0.smithi049.stdout:6/861: symlink da/dd/de/d26/d22/d122/l124 0 2024-04-26T10:44:32.727 INFO:tasks.workunit.client.0.smithi049.stdout:4/965: link de/l66 de/d1d/l12a 0 2024-04-26T10:44:32.727 INFO:tasks.workunit.client.0.smithi049.stdout:3/762: write d3/d23/d2f/d6a/d6b/d8/d55/db4/dca/f10 [57995,65306] 0 2024-04-26T10:44:32.727 INFO:tasks.workunit.client.0.smithi049.stdout:8/931: rmdir d2/d17/d34/d40/d64/dcd/df0 39 2024-04-26T10:44:32.727 INFO:tasks.workunit.client.0.smithi049.stdout:6/862: readlink da/dd/de/d11/dbc/l121 0 2024-04-26T10:44:32.728 INFO:tasks.workunit.client.0.smithi049.stdout:1/815: dread - d1e/d20/d26/d3c/d54/d59/d73/dab/fd7 zero size 2024-04-26T10:44:32.729 INFO:tasks.workunit.client.0.smithi049.stdout:4/966: chown de/d1b/d5e/d72/d73/d84/d4b 55779 1 2024-04-26T10:44:32.729 INFO:tasks.workunit.client.0.smithi049.stdout:6/863: chown da/dd/de/cb3 6464610 1 2024-04-26T10:44:32.729 INFO:tasks.workunit.client.0.smithi049.stdout:5/908: dwrite d7/d1d/d34/d123/d91/d106/f144 [0,4194304] 0 2024-04-26T10:44:32.729 INFO:tasks.workunit.client.0.smithi049.stdout:8/932: mknod d2/d17/d34/d40/d64/dcd/c128 0 2024-04-26T10:44:32.730 INFO:tasks.workunit.client.0.smithi049.stdout:0/997: sync 2024-04-26T10:44:32.730 INFO:tasks.workunit.client.0.smithi049.stdout:7/977: sync 2024-04-26T10:44:32.730 INFO:tasks.workunit.client.0.smithi049.stdout:1/816: readlink d1e/d20/d26/d3c/d54/d59/d73/l102 0 2024-04-26T10:44:32.731 INFO:tasks.workunit.client.0.smithi049.stdout:4/967: read - de/d1b/d5e/d72/d73/d84/d24/fe9 zero size 2024-04-26T10:44:32.732 INFO:tasks.workunit.client.0.smithi049.stdout:5/909: creat d7/d1d/d34/d123/db2/f157 x:0 0 0 2024-04-26T10:44:32.732 INFO:tasks.workunit.client.0.smithi049.stdout:0/998: symlink d8/db/d93/d96/d9b/dff/l151 0 2024-04-26T10:44:32.733 INFO:tasks.workunit.client.0.smithi049.stdout:8/933: creat d2/d16/d88/dfb/d110/f129 x:0 0 0 2024-04-26T10:44:32.733 INFO:tasks.workunit.client.0.smithi049.stdout:1/817: unlink d1e/d20/d26/d37/d8e/d97/fa9 0 2024-04-26T10:44:32.734 INFO:tasks.workunit.client.0.smithi049.stdout:7/978: mknod d2/d3/de/d1c/dac/d151/da3/d11a/c155 0 2024-04-26T10:44:32.734 INFO:tasks.workunit.client.0.smithi049.stdout:0/999: mknod d8/d109/d10e/d118/c152 0 2024-04-26T10:44:32.735 INFO:tasks.workunit.client.0.smithi049.stdout:5/910: rename d7/d1d/d34/c57 to d7/c158 0 2024-04-26T10:44:32.735 INFO:tasks.workunit.client.0.smithi049.stdout:8/934: rmdir d2/d16/d19/d42 39 2024-04-26T10:44:32.736 INFO:tasks.workunit.client.0.smithi049.stdout:7/979: mkdir d2/dd/d45/da5/d156 0 2024-04-26T10:44:32.736 INFO:tasks.workunit.client.0.smithi049.stdout:4/968: mknod de/d1b/d5e/d72/d73/d84/d24/d50/c12b 0 2024-04-26T10:44:32.736 INFO:tasks.workunit.client.0.smithi049.stdout:3/763: dwrite d3/d23/d2f/d6a/d6b/d26/d58/fa4 [0,4194304] 0 2024-04-26T10:44:32.736 INFO:tasks.workunit.client.0.smithi049.stdout:1/818: getdents d1e/d20 0 2024-04-26T10:44:32.737 INFO:tasks.workunit.client.0.smithi049.stdout:6/864: dwrite da/dd/de/d26/d29/fd7 [0,4194304] 0 2024-04-26T10:44:32.738 INFO:tasks.workunit.client.0.smithi049.stdout:7/980: dread - d2/d3/de/d1c/dac/fcd zero size 2024-04-26T10:44:32.738 INFO:tasks.workunit.client.0.smithi049.stdout:4/969: mknod de/d3f/d52/d9b/c12c 0 2024-04-26T10:44:32.739 INFO:tasks.workunit.client.0.smithi049.stdout:8/935: write d2/df/d10/d47/d75/fb9 [268251,37626] 0 2024-04-26T10:44:32.740 INFO:tasks.workunit.client.0.smithi049.stdout:1/819: truncate d1e/d20/d26/d37/f5d 972892 0 2024-04-26T10:44:32.740 INFO:tasks.workunit.client.0.smithi049.stdout:3/764: chown d3/d23/d2f/d6a/d6b/d26/d29/l54 936703 1 2024-04-26T10:44:32.740 INFO:tasks.workunit.client.0.smithi049.stdout:7/981: chown d2/d3/de/d1c/dac/d151/da3/lde 183173 1 2024-04-26T10:44:32.740 INFO:tasks.workunit.client.0.smithi049.stdout:6/865: rmdir da/dd/de/d26/d29 39 2024-04-26T10:44:32.741 INFO:tasks.workunit.client.0.smithi049.stdout:8/936: symlink d2/df/d10/d23/d6c/d5e/l12a 0 2024-04-26T10:44:32.741 INFO:tasks.workunit.client.0.smithi049.stdout:1/820: write d1e/d20/f32 [126424,52700] 0 2024-04-26T10:44:32.742 INFO:tasks.workunit.client.0.smithi049.stdout:7/982: rmdir d2/dd/d25/d27/d119 39 2024-04-26T10:44:32.742 INFO:tasks.workunit.client.0.smithi049.stdout:2/854: dread d6/d9/d5f/dba/f24 [0,4194304] 0 2024-04-26T10:44:32.742 INFO:tasks.workunit.client.0.smithi049.stdout:8/937: rmdir d2/df/d10/d47/dca 39 2024-04-26T10:44:32.742 INFO:tasks.workunit.client.0.smithi049.stdout:6/866: rename da/dd/de/d26/c103 to da/dd/de/db5/c125 0 2024-04-26T10:44:32.742 INFO:tasks.workunit.client.0.smithi049.stdout:1/821: read d1e/d20/d26/f51 [3225194,45750] 0 2024-04-26T10:44:32.743 INFO:tasks.workunit.client.0.smithi049.stdout:5/911: truncate d7/f88 3100118 0 2024-04-26T10:44:32.744 INFO:tasks.workunit.client.0.smithi049.stdout:2/855: fsync d6/d9/d5f/dba/d11/d6a/d9f/fdc 0 2024-04-26T10:44:32.744 INFO:tasks.workunit.client.0.smithi049.stdout:5/912: chown d7/l12 18590316 1 2024-04-26T10:44:32.744 INFO:tasks.workunit.client.0.smithi049.stdout:1/822: fdatasync d1e/d20/d26/d37/d8e/fa4 0 2024-04-26T10:44:32.745 INFO:tasks.workunit.client.0.smithi049.stdout:4/970: truncate de/d1b/f34 7501402 0 2024-04-26T10:44:32.745 INFO:tasks.workunit.client.0.smithi049.stdout:5/913: stat d7/d1d/d1f/d4e/f98 0 2024-04-26T10:44:32.746 INFO:tasks.workunit.client.0.smithi049.stdout:5/914: sync 2024-04-26T10:44:32.748 INFO:tasks.workunit.client.0.smithi049.stdout:2/856: dread - d6/d9/d5f/dba/d35/d91/fbd zero size 2024-04-26T10:44:32.749 INFO:tasks.workunit.client.0.smithi049.stdout:1/823: chown d1e/d20/d26/d3c/d54/fc4 469 1 2024-04-26T10:44:32.749 INFO:tasks.workunit.client.0.smithi049.stdout:4/971: write de/d1b/f2c [1279621,109685] 0 2024-04-26T10:44:32.749 INFO:tasks.workunit.client.0.smithi049.stdout:3/765: dwrite d3/d23/d2f/d6a/d6b/d26/d65/fdd [0,4194304] 0 2024-04-26T10:44:32.749 INFO:tasks.workunit.client.0.smithi049.stdout:5/915: fdatasync d7/d1d/d1f/d4e/dad/db3/fc5 0 2024-04-26T10:44:32.749 INFO:tasks.workunit.client.0.smithi049.stdout:5/916: stat d7/d14/d18/d2b 0 2024-04-26T10:44:32.750 INFO:tasks.workunit.client.0.smithi049.stdout:3/766: creat d3/d23/d2f/d6a/d6b/d26/d65/dae/ffb x:0 0 0 2024-04-26T10:44:32.750 INFO:tasks.workunit.client.0.smithi049.stdout:5/917: mknod d7/d14/c159 0 2024-04-26T10:44:32.752 INFO:tasks.workunit.client.0.smithi049.stdout:5/918: chown d7/d1d/d34/d123/d91/d3e 100397077 1 2024-04-26T10:44:32.752 INFO:tasks.workunit.client.0.smithi049.stdout:3/767: creat d3/d23/d2f/d6a/d6b/d26/d65/ffc x:0 0 0 2024-04-26T10:44:32.752 INFO:tasks.workunit.client.0.smithi049.stdout:7/983: write d2/f33 [1493281,117386] 0 2024-04-26T10:44:32.753 INFO:tasks.workunit.client.0.smithi049.stdout:2/857: dwrite d6/d9/d5f/dba/d1e/fd3 [0,4194304] 0 2024-04-26T10:44:32.753 INFO:tasks.workunit.client.0.smithi049.stdout:4/972: dwrite de/d3f/d48/d8b/fcc [0,4194304] 0 2024-04-26T10:44:32.754 INFO:tasks.workunit.client.0.smithi049.stdout:5/919: mkdir d7/d1d/d34/d123/d15a 0 2024-04-26T10:44:32.755 INFO:tasks.workunit.client.0.smithi049.stdout:2/858: chown d6/d30/d97/dbe/dd1/le7 267422877 1 2024-04-26T10:44:32.756 INFO:tasks.workunit.client.0.smithi049.stdout:3/768: mknod d3/d23/d2f/d6a/d6b/d8/ded/cfd 0 2024-04-26T10:44:32.757 INFO:tasks.workunit.client.0.smithi049.stdout:2/859: write d6/d9/d5f/dba/d34/d38/d73/fa4 [135397,97759] 0 2024-04-26T10:44:32.758 INFO:tasks.workunit.client.0.smithi049.stdout:5/920: rename d7/d1d/d34/d123/d91/d3e/d60/d10d to d7/d1d/d1f/d4e/d80/d15b 0 2024-04-26T10:44:32.758 INFO:tasks.workunit.client.0.smithi049.stdout:8/938: dwrite d2/d17/d34/d40/d64/dcd/df0/d109/d2a/f54 [0,4194304] 0 2024-04-26T10:44:32.758 INFO:tasks.workunit.client.0.smithi049.stdout:3/769: mknod d3/d23/d2f/d6a/d6b/d8/d55/db4/dca/dc4/cfe 0 2024-04-26T10:44:32.759 INFO:tasks.workunit.client.0.smithi049.stdout:5/921: mknod d7/d14/d18/d2b/c15c 0 2024-04-26T10:44:32.759 INFO:tasks.workunit.client.0.smithi049.stdout:2/860: rename d6/d32/fec to d6/d30/dc8/f111 0 2024-04-26T10:44:32.760 INFO:tasks.workunit.client.0.smithi049.stdout:8/939: fsync d2/d17/d34/d40/d64/dcd/ff9 0 2024-04-26T10:44:32.760 INFO:tasks.workunit.client.0.smithi049.stdout:2/861: dread - d6/d9/d5f/dba/d34/f107 zero size 2024-04-26T10:44:32.761 INFO:tasks.workunit.client.0.smithi049.stdout:3/770: rename d3/d23/d2f/d6a/d6b/d26/d65/d70/de2 to d3/d23/d2f/d6a/d6b/d8/d82/dff 0 2024-04-26T10:44:32.762 INFO:tasks.workunit.client.0.smithi049.stdout:5/922: dread d7/ff [0,4194304] 0 2024-04-26T10:44:32.763 INFO:tasks.workunit.client.0.smithi049.stdout:2/862: symlink d6/d30/d97/dbe/dd1/l112 0 2024-04-26T10:44:32.763 INFO:tasks.workunit.client.0.smithi049.stdout:3/771: symlink d3/d23/d2f/d6a/d6b/d8/dd/df5/l100 0 2024-04-26T10:44:32.763 INFO:tasks.workunit.client.0.smithi049.stdout:8/940: creat d2/d16/d19/d42/deb/f12b x:0 0 0 2024-04-26T10:44:32.763 INFO:tasks.workunit.client.0.smithi049.stdout:5/923: write d7/d1d/d1f/d4e/dad/fb7 [114224,53553] 0 2024-04-26T10:44:32.764 INFO:tasks.workunit.client.0.smithi049.stdout:8/941: fdatasync d2/df/d10/d47/d75/f105 0 2024-04-26T10:44:32.764 INFO:tasks.workunit.client.0.smithi049.stdout:3/772: creat d3/d23/d2f/d6a/d6b/f101 x:0 0 0 2024-04-26T10:44:32.764 INFO:tasks.workunit.client.0.smithi049.stdout:8/942: chown d2/d16/d88/dfb/d110 579995914 1 2024-04-26T10:44:32.765 INFO:tasks.workunit.client.0.smithi049.stdout:2/863: rename d6/d9/d5f/dba/d35/d91/cc0 to d6/d9/d5f/dba/d34/d7b/c113 0 2024-04-26T10:44:32.766 INFO:tasks.workunit.client.0.smithi049.stdout:5/924: symlink d7/d1d/d1f/d4e/dad/db3/dcc/d13b/l15d 0 2024-04-26T10:44:32.766 INFO:tasks.workunit.client.0.smithi049.stdout:4/973: truncate de/d1b/d5e/d72/d73/d84/d38/f3b 793500 0 2024-04-26T10:44:32.766 INFO:tasks.workunit.client.0.smithi049.stdout:8/943: creat d2/d16/d88/dfb/f12c x:0 0 0 2024-04-26T10:44:32.767 INFO:tasks.workunit.client.0.smithi049.stdout:3/773: write d3/d23/d2f/d6a/d6b/d8/d87/db1/fc6 [95929,128554] 0 2024-04-26T10:44:32.767 INFO:tasks.workunit.client.0.smithi049.stdout:4/974: read - de/d1b/d5e/d72/d73/d88/fb7 zero size 2024-04-26T10:44:32.767 INFO:tasks.workunit.client.0.smithi049.stdout:2/864: creat d6/d9/d5f/dba/d34/dfb/f114 x:0 0 0 2024-04-26T10:44:32.768 INFO:tasks.workunit.client.0.smithi049.stdout:5/925: rename d7/d1d/d1f/d95/ce4 to d7/d1d/d34/db9/c15e 0 2024-04-26T10:44:32.768 INFO:tasks.workunit.client.0.smithi049.stdout:8/944: creat d2/d17/d34/f12d x:0 0 0 2024-04-26T10:44:32.768 INFO:tasks.workunit.client.0.smithi049.stdout:2/865: readlink d6/d32/l53 0 2024-04-26T10:44:32.768 INFO:tasks.workunit.client.0.smithi049.stdout:4/975: mknod de/dea/c12d 0 2024-04-26T10:44:32.768 INFO:tasks.workunit.client.0.smithi049.stdout:2/866: sync 2024-04-26T10:44:32.769 INFO:tasks.workunit.client.0.smithi049.stdout:5/926: creat d7/d1d/d34/d123/f15f x:0 0 0 2024-04-26T10:44:32.769 INFO:tasks.workunit.client.0.smithi049.stdout:4/976: symlink de/dea/l12e 0 2024-04-26T10:44:32.769 INFO:tasks.workunit.client.0.smithi049.stdout:2/867: symlink d6/d9/d5f/dba/d34/d38/d73/dcd/l115 0 2024-04-26T10:44:32.770 INFO:tasks.workunit.client.0.smithi049.stdout:3/774: link d3/d23/d2f/d6a/d6b/d8/dd/c45 d3/d23/d2f/d6a/d6b/d8/d34/c102 0 2024-04-26T10:44:32.770 INFO:tasks.workunit.client.0.smithi049.stdout:5/927: mkdir d7/d1d/d1f/d4e/da0/de2/d127/d160 0 2024-04-26T10:44:32.770 INFO:tasks.workunit.client.0.smithi049.stdout:7/984: dread d2/dd/d38/f40 [0,4194304] 0 2024-04-26T10:44:32.771 INFO:tasks.workunit.client.0.smithi049.stdout:4/977: creat de/d1b/d5e/d72/d73/d84/d4b/da4/d117/f12f x:0 0 0 2024-04-26T10:44:32.771 INFO:tasks.workunit.client.0.smithi049.stdout:3/775: write d3/d23/d2f/db8/ff3 [362375,114117] 0 2024-04-26T10:44:32.772 INFO:tasks.workunit.client.0.smithi049.stdout:7/985: symlink d2/d3/de/d1c/dac/l157 0 2024-04-26T10:44:32.773 INFO:tasks.workunit.client.0.smithi049.stdout:8/945: dread d2/d16/f4b [0,4194304] 0 2024-04-26T10:44:32.773 INFO:tasks.workunit.client.0.smithi049.stdout:4/978: chown de/d1b/d5e/d72/d73/d84/d24/l2a 2739915 1 2024-04-26T10:44:32.773 INFO:tasks.workunit.client.0.smithi049.stdout:5/928: getdents d7/d1d/d34/d123/d91/d3e/d60 0 2024-04-26T10:44:32.773 INFO:tasks.workunit.client.0.smithi049.stdout:3/776: unlink d3/d23/d2f/d6a/d6b/d26/d65/d70/d84/le1 0 2024-04-26T10:44:32.774 INFO:tasks.workunit.client.0.smithi049.stdout:4/979: mknod de/d3f/d48/de3/c130 0 2024-04-26T10:44:32.774 INFO:tasks.workunit.client.0.smithi049.stdout:7/986: creat d2/d3/d96/ddc/d132/f158 x:0 0 0 2024-04-26T10:44:32.775 INFO:tasks.workunit.client.0.smithi049.stdout:5/929: symlink d7/d14/d18/l161 0 2024-04-26T10:44:32.775 INFO:tasks.workunit.client.0.smithi049.stdout:4/980: creat de/d3f/d52/da6/f131 x:0 0 0 2024-04-26T10:44:32.775 INFO:tasks.workunit.client.0.smithi049.stdout:6/867: dread da/dd/d47/d7b/fd6 [0,4194304] 0 2024-04-26T10:44:32.775 INFO:tasks.workunit.client.0.smithi049.stdout:7/987: symlink d2/d3/d96/l159 0 2024-04-26T10:44:32.776 INFO:tasks.workunit.client.0.smithi049.stdout:3/777: mkdir d3/d23/d2f/d6a/d6b/d8/d55/df2/d103 0 2024-04-26T10:44:32.776 INFO:tasks.workunit.client.0.smithi049.stdout:2/868: dwrite d6/d9/d5f/dba/fb1 [0,4194304] 0 2024-04-26T10:44:32.777 INFO:tasks.workunit.client.0.smithi049.stdout:7/988: truncate d2/dd/d45/ff8 152474 0 2024-04-26T10:44:32.778 INFO:tasks.workunit.client.0.smithi049.stdout:6/868: rmdir da/dd/de 39 2024-04-26T10:44:32.779 INFO:tasks.workunit.client.0.smithi049.stdout:4/981: mknod de/d3f/d52/d9b/d9e/c132 0 2024-04-26T10:44:32.780 INFO:tasks.workunit.client.0.smithi049.stdout:2/869: mknod d6/d30/d97/dbe/dd1/c116 0 2024-04-26T10:44:32.780 INFO:tasks.workunit.client.0.smithi049.stdout:8/946: fsync d2/d17/d34/d40/f10b 0 2024-04-26T10:44:32.780 INFO:tasks.workunit.client.0.smithi049.stdout:3/778: truncate d3/d23/d2f/d6a/d6b/d26/f7a 4664960 0 2024-04-26T10:44:32.780 INFO:tasks.workunit.client.0.smithi049.stdout:6/869: write da/f2b [982879,31014] 0 2024-04-26T10:44:32.780 INFO:tasks.workunit.client.0.smithi049.stdout:7/989: link d2/dd/d7f/db1/dc6/f133 d2/dab/f15a 0 2024-04-26T10:44:32.780 INFO:tasks.workunit.client.0.smithi049.stdout:6/870: chown da/dd/d62/d9d 30686764 1 2024-04-26T10:44:32.781 INFO:tasks.workunit.client.0.smithi049.stdout:8/947: truncate d2/df/f111 354389 0 2024-04-26T10:44:32.781 INFO:tasks.workunit.client.0.smithi049.stdout:3/779: write d3/d23/d2f/d6a/d6b/d26/f6d [783114,79751] 0 2024-04-26T10:44:32.781 INFO:tasks.workunit.client.0.smithi049.stdout:4/982: mkdir de/d1b/d5e/d72/d73/d84/d4b/da4/d133 0 2024-04-26T10:44:32.781 INFO:tasks.workunit.client.0.smithi049.stdout:7/990: mkdir d2/dd/d45/d146/d15b 0 2024-04-26T10:44:32.782 INFO:tasks.workunit.client.0.smithi049.stdout:3/780: sync 2024-04-26T10:44:32.782 INFO:tasks.workunit.client.0.smithi049.stdout:6/871: unlink da/dd/de/db5/ffc 0 2024-04-26T10:44:32.782 INFO:tasks.workunit.client.0.smithi049.stdout:8/948: write d2/df/d10/d47/fb2 [4965528,51295] 0 2024-04-26T10:44:32.783 INFO:tasks.workunit.client.0.smithi049.stdout:1/824: dread d1e/d20/d26/d37/f58 [0,4194304] 0 2024-04-26T10:44:32.783 INFO:tasks.workunit.client.0.smithi049.stdout:7/991: symlink d2/dd/dd3/df5/l15c 0 2024-04-26T10:44:32.784 INFO:tasks.workunit.client.0.smithi049.stdout:6/872: chown da/dd/de/f75 23587813 1 2024-04-26T10:44:32.784 INFO:tasks.workunit.client.0.smithi049.stdout:3/781: stat d3/d23/d2f/d6a/d6b/d26/d65/dae/ffb 0 2024-04-26T10:44:32.785 INFO:tasks.workunit.client.0.smithi049.stdout:1/825: write d1e/d20/d26/ff0 [318870,26460] 0 2024-04-26T10:44:32.785 INFO:tasks.workunit.client.0.smithi049.stdout:7/992: chown d2/dd/d7f/dd1/dfa/c12d 411420 1 2024-04-26T10:44:32.785 INFO:tasks.workunit.client.0.smithi049.stdout:8/949: write d2/d17/d34/d40/d64/dcd/df0/f119 [1223661,88797] 0 2024-04-26T10:44:32.786 INFO:tasks.workunit.client.0.smithi049.stdout:3/782: rmdir d3/d23/d2f/d6a/d6b/d26 39 2024-04-26T10:44:32.787 INFO:tasks.workunit.client.0.smithi049.stdout:2/870: dwrite d6/d9/d5f/f67 [0,4194304] 0 2024-04-26T10:44:32.788 INFO:tasks.workunit.client.0.smithi049.stdout:1/826: mkdir d1e/d20/d26/d3c/d96/da3/d109 0 2024-04-26T10:44:32.788 INFO:tasks.workunit.client.0.smithi049.stdout:3/783: fdatasync d3/d23/d2f/d6a/d6b/d26/d5f/fbc 0 2024-04-26T10:44:32.789 INFO:tasks.workunit.client.0.smithi049.stdout:2/871: unlink d6/f79 0 2024-04-26T10:44:32.790 INFO:tasks.workunit.client.0.smithi049.stdout:1/827: mknod d1e/d20/d26/d3c/d54/d59/d68/c10a 0 2024-04-26T10:44:32.790 INFO:tasks.workunit.client.0.smithi049.stdout:2/872: stat d6/d9/d5f/dba/d34/cd9 0 2024-04-26T10:44:32.791 INFO:tasks.workunit.client.0.smithi049.stdout:3/784: truncate d3/d23/d2f/db8/ff3 591487 0 2024-04-26T10:44:32.791 INFO:tasks.workunit.client.0.smithi049.stdout:6/873: dwrite da/dd/d47/f61 [0,4194304] 0 2024-04-26T10:44:32.792 INFO:tasks.workunit.client.0.smithi049.stdout:8/950: truncate d2/f2f 1440005 0 2024-04-26T10:44:32.792 INFO:tasks.workunit.client.0.smithi049.stdout:2/873: getdents d6/d30 0 2024-04-26T10:44:32.792 INFO:tasks.workunit.client.0.smithi049.stdout:1/828: symlink d1e/d20/d26/d3c/d54/d59/d68/l10b 0 2024-04-26T10:44:32.793 INFO:tasks.workunit.client.0.smithi049.stdout:6/874: symlink da/dd/d47/d7b/l126 0 2024-04-26T10:44:32.793 INFO:tasks.workunit.client.0.smithi049.stdout:2/874: readlink d6/d32/l53 0 2024-04-26T10:44:32.793 INFO:tasks.workunit.client.0.smithi049.stdout:1/829: write f16 [1664975,33494] 0 2024-04-26T10:44:32.794 INFO:tasks.workunit.client.0.smithi049.stdout:7/993: dwrite d2/d3/de/d1c/dac/d151/d5c/f5f [0,4194304] 0 2024-04-26T10:44:32.795 INFO:tasks.workunit.client.0.smithi049.stdout:3/785: write d3/d23/d2f/d6a/d6b/d8/d55/d2e/fcb [196236,26474] 0 2024-04-26T10:44:32.795 INFO:tasks.workunit.client.0.smithi049.stdout:1/830: chown fd 5514 1 2024-04-26T10:44:32.795 INFO:tasks.workunit.client.0.smithi049.stdout:3/786: sync 2024-04-26T10:44:32.796 INFO:tasks.workunit.client.0.smithi049.stdout:6/875: dread - da/dd/de/d11/d109/d119/f10e zero size 2024-04-26T10:44:32.796 INFO:tasks.workunit.client.0.smithi049.stdout:6/876: stat da/dd/de/db5 0 2024-04-26T10:44:32.796 INFO:tasks.workunit.client.0.smithi049.stdout:3/787: fdatasync d3/d23/d2f/d6a/d6b/d8/f88 0 2024-04-26T10:44:32.797 INFO:tasks.workunit.client.0.smithi049.stdout:1/831: link d1e/l27 d1e/d20/d26/d37/d8e/l10c 0 2024-04-26T10:44:32.798 INFO:tasks.workunit.client.0.smithi049.stdout:7/994: rename d2/d3/de/l58 to d2/dd/d7f/dd1/dfa/l15d 0 2024-04-26T10:44:32.798 INFO:tasks.workunit.client.0.smithi049.stdout:3/788: mkdir d3/d23/d2f/db8/d104 0 2024-04-26T10:44:32.800 INFO:tasks.workunit.client.0.smithi049.stdout:1/832: write d1e/d20/d26/d37/d6e/fbc [503393,115820] 0 2024-04-26T10:44:32.800 INFO:tasks.workunit.client.0.smithi049.stdout:7/995: creat d2/dd/d45/d82/f15e x:0 0 0 2024-04-26T10:44:32.801 INFO:tasks.workunit.client.0.smithi049.stdout:3/789: rmdir d3/d23/d2f/d6a/d6b/d8/d55/d2e 39 2024-04-26T10:44:32.801 INFO:tasks.workunit.client.0.smithi049.stdout:5/930: dread d7/d14/d18/f1e [0,4194304] 0 2024-04-26T10:44:32.802 INFO:tasks.workunit.client.0.smithi049.stdout:7/996: chown d2/dd/dd3/df5 815701 1 2024-04-26T10:44:32.803 INFO:tasks.workunit.client.0.smithi049.stdout:2/875: dwrite d6/d9/d5f/dba/d34/f5a [0,4194304] 0 2024-04-26T10:44:32.803 INFO:tasks.workunit.client.0.smithi049.stdout:8/951: dwrite d2/d17/d34/d40/d64/dcd/ff9 [4194304,4194304] 0 2024-04-26T10:44:32.803 INFO:tasks.workunit.client.0.smithi049.stdout:1/833: write d1e/d20/d26/d3c/f99 [3238239,58900] 0 2024-04-26T10:44:32.805 INFO:tasks.workunit.client.0.smithi049.stdout:5/931: rename d7/d14/d18 to d7/d1d/d1f/d4e/d65/d124/d162 0 2024-04-26T10:44:32.806 INFO:tasks.workunit.client.0.smithi049.stdout:3/790: mknod d3/d23/d2f/d6a/d6b/d8/d82/dff/c105 0 2024-04-26T10:44:32.806 INFO:tasks.workunit.client.0.smithi049.stdout:1/834: mknod d1e/c10d 0 2024-04-26T10:44:32.806 INFO:tasks.workunit.client.0.smithi049.stdout:2/876: stat d6/d9/d5f/dba/d11/f9c 0 2024-04-26T10:44:32.806 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:32.805+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:32.807 INFO:tasks.workunit.client.0.smithi049.stdout:6/877: dwrite da/dd/de/d11/dbc/fcc [0,4194304] 0 2024-04-26T10:44:32.807 INFO:tasks.workunit.client.0.smithi049.stdout:7/997: getdents d2/d3/de/d1c/dac/d151 0 2024-04-26T10:44:32.807 INFO:tasks.workunit.client.0.smithi049.stdout:5/932: chown d7/d1d/d1f/d4e/d77/d140 23 1 2024-04-26T10:44:32.811 INFO:tasks.workunit.client.0.smithi049.stdout:1/835: getdents d1e/d20/daf 0 2024-04-26T10:44:32.811 INFO:tasks.workunit.client.0.smithi049.stdout:7/998: mknod d2/d3/d96/db3/c15f 0 2024-04-26T10:44:32.812 INFO:tasks.workunit.client.0.smithi049.stdout:7/999: write d2/dab/fd6 [788402,60525] 0 2024-04-26T10:44:32.814 INFO:tasks.workunit.client.0.smithi049.stdout:8/952: dread d2/d16/d19/f25 [0,4194304] 0 2024-04-26T10:44:32.814 INFO:tasks.workunit.client.0.smithi049.stdout:5/933: dread d7/ff [0,4194304] 0 2024-04-26T10:44:32.815 INFO:tasks.workunit.client.0.smithi049.stdout:3/791: dwrite d3/d23/d2f/d6a/d6b/d8/d55/d2e/f31 [0,4194304] 0 2024-04-26T10:44:32.817 INFO:tasks.workunit.client.0.smithi049.stdout:4/983: dread de/d1b/f2c [4194304,4194304] 0 2024-04-26T10:44:32.817 INFO:tasks.workunit.client.0.smithi049.stdout:8/953: read d2/df/d10/d23/d6c/fbb [96556,28071] 0 2024-04-26T10:44:32.817 INFO:tasks.workunit.client.0.smithi049.stdout:1/836: dwrite fe [0,4194304] 0 2024-04-26T10:44:32.818 INFO:tasks.workunit.client.0.smithi049.stdout:3/792: rmdir d3/d23/d2f/d6a/d6b/d26/d5f 39 2024-04-26T10:44:32.818 INFO:tasks.workunit.client.0.smithi049.stdout:5/934: creat d7/d1d/d1f/d4e/d80/f163 x:0 0 0 2024-04-26T10:44:32.820 INFO:tasks.workunit.client.0.smithi049.stdout:1/837: write d1e/d20/d26/d37/d8e/fa4 [3807328,92139] 0 2024-04-26T10:44:32.820 INFO:tasks.workunit.client.0.smithi049.stdout:5/935: truncate d7/d66/d84/f9b 543155 0 2024-04-26T10:44:32.820 INFO:tasks.workunit.client.0.smithi049.stdout:1/838: readlink l1c 0 2024-04-26T10:44:32.821 INFO:tasks.workunit.client.0.smithi049.stdout:3/793: getdents d3/d23/d2f/d6a/d6b/d8/d55/d2e 0 2024-04-26T10:44:32.821 INFO:tasks.workunit.client.0.smithi049.stdout:5/936: mkdir d7/d1d/d1f/d4e/d77/d164 0 2024-04-26T10:44:32.823 INFO:tasks.workunit.client.0.smithi049.stdout:5/937: creat d7/dc6/f165 x:0 0 0 2024-04-26T10:44:32.823 INFO:tasks.workunit.client.0.smithi049.stdout:3/794: symlink d3/d23/d2f/d6a/d6b/d8/d55/l106 0 2024-04-26T10:44:32.824 INFO:tasks.workunit.client.0.smithi049.stdout:1/839: rename d1e/d20/d26/d37/d8e/dfe/f105 to d1e/d20/d26/d3c/d54/d59/f10e 0 2024-04-26T10:44:32.825 INFO:tasks.workunit.client.0.smithi049.stdout:8/954: dread d2/d16/d19/d42/f96 [0,4194304] 0 2024-04-26T10:44:32.826 INFO:tasks.workunit.client.0.smithi049.stdout:8/955: read - d2/d16/d88/f124 zero size 2024-04-26T10:44:32.828 INFO:tasks.workunit.client.0.smithi049.stdout:6/878: dread da/dd/de/d26/d22/f77 [0,4194304] 0 2024-04-26T10:44:32.829 INFO:tasks.workunit.client.0.smithi049.stdout:5/938: dwrite d7/d1d/d1f/d4e/f98 [0,4194304] 0 2024-04-26T10:44:32.831 INFO:tasks.workunit.client.0.smithi049.stdout:3/795: dwrite d3/d23/d2f/d6a/d6b/d8/d55/d2e/fcb [0,4194304] 0 2024-04-26T10:44:32.831 INFO:tasks.workunit.client.0.smithi049.stdout:2/877: dread d6/d9/d5f/dba/d34/d7b/f7e [0,4194304] 0 2024-04-26T10:44:32.832 INFO:tasks.workunit.client.0.smithi049.stdout:5/939: creat d7/d66/d84/d103/f166 x:0 0 0 2024-04-26T10:44:32.833 INFO:tasks.workunit.client.0.smithi049.stdout:1/840: dwrite d1e/d20/d26/d37/d69/d75/f9e [0,4194304] 0 2024-04-26T10:44:32.834 INFO:tasks.workunit.client.0.smithi049.stdout:2/878: creat d6/d9/d5f/dba/d1e/f117 x:0 0 0 2024-04-26T10:44:32.835 INFO:tasks.workunit.client.0.smithi049.stdout:1/841: truncate d1e/f44 5131665 0 2024-04-26T10:44:32.838 INFO:tasks.workunit.client.0.smithi049.stdout:5/940: getdents d7/d1d/d1f/d4e/d65/d124/d162/d2b 0 2024-04-26T10:44:32.838 INFO:tasks.workunit.client.0.smithi049.stdout:2/879: fdatasync d6/d9/d5f/dba/d35/f90 0 2024-04-26T10:44:32.838 INFO:tasks.workunit.client.0.smithi049.stdout:6/879: dwrite da/dd/de/f75 [0,4194304] 0 2024-04-26T10:44:32.838 INFO:tasks.workunit.client.0.smithi049.stdout:1/842: mknod d1e/d20/d26/d3c/d54/d59/c10f 0 2024-04-26T10:44:32.839 INFO:tasks.workunit.client.0.smithi049.stdout:8/956: dwrite d2/df/d10/d47/d75/f105 [0,4194304] 0 2024-04-26T10:44:32.839 INFO:tasks.workunit.client.0.smithi049.stdout:5/941: chown d7/d1d/d1f/d4e/dad/db3/f14d 19667838 1 2024-04-26T10:44:32.840 INFO:tasks.workunit.client.0.smithi049.stdout:8/957: dread - d2/d16/d19/dc7/f117 zero size 2024-04-26T10:44:32.840 INFO:tasks.workunit.client.0.smithi049.stdout:5/942: chown d7/d1d/d1f/d4e/d80/la6 2950689 1 2024-04-26T10:44:32.840 INFO:tasks.workunit.client.0.smithi049.stdout:8/958: chown d2/df/l32 451196 1 2024-04-26T10:44:32.841 INFO:tasks.workunit.client.0.smithi049.stdout:6/880: rename da/dd/de/db5/df1/c101 to da/dd/d62/c127 0 2024-04-26T10:44:32.841 INFO:tasks.workunit.client.0.smithi049.stdout:2/880: getdents d6/d9/d5f/dba/d35/df8 0 2024-04-26T10:44:32.841 INFO:tasks.workunit.client.0.smithi049.stdout:6/881: stat da/dd/de/d26 0 2024-04-26T10:44:32.841 INFO:tasks.workunit.client.0.smithi049.stdout:5/943: fsync d7/d1d/d34/d123/d91/d3e/d60/faf 0 2024-04-26T10:44:32.842 INFO:tasks.workunit.client.0.smithi049.stdout:1/843: rename d1e/d20/d26/d3c/fe9 to d1e/d20/d26/d3c/d54/d59/f110 0 2024-04-26T10:44:32.843 INFO:tasks.workunit.client.0.smithi049.stdout:2/881: write d6/d9/d5f/dba/d11/d6a/dc3/fd5 [762783,115166] 0 2024-04-26T10:44:32.843 INFO:tasks.workunit.client.0.smithi049.stdout:5/944: rmdir d7/d1d/d1f/d4e/d80/d15b 39 2024-04-26T10:44:32.846 INFO:tasks.workunit.client.0.smithi049.stdout:5/945: stat d7/f64 0 2024-04-26T10:44:32.847 INFO:tasks.workunit.client.0.smithi049.stdout:2/882: mknod d6/d30/d97/dbe/d109/c118 0 2024-04-26T10:44:32.848 INFO:tasks.workunit.client.0.smithi049.stdout:4/984: dread de/d1b/d5e/d72/d73/d84/f22 [0,4194304] 0 2024-04-26T10:44:32.848 INFO:tasks.workunit.client.0.smithi049.stdout:1/844: truncate d1e/d20/d26/d3c/d54/d59/d68/fde 1277128 0 2024-04-26T10:44:32.849 INFO:tasks.workunit.client.0.smithi049.stdout:5/946: rmdir d7/d1d/d1f/d4e/dad/db3 39 2024-04-26T10:44:32.850 INFO:tasks.workunit.client.0.smithi049.stdout:8/959: dwrite d2/d16/d88/dfb/f12c [0,4194304] 0 2024-04-26T10:44:32.851 INFO:tasks.workunit.client.0.smithi049.stdout:6/882: dwrite da/d4a/f2f [0,4194304] 0 2024-04-26T10:44:32.853 INFO:tasks.workunit.client.0.smithi049.stdout:4/985: truncate de/d1b/d5e/d72/d73/d84/f2e 2994494 0 2024-04-26T10:44:32.853 INFO:tasks.workunit.client.0.smithi049.stdout:6/883: write da/dd/d62/d9d/d10f/f4b [3940331,82604] 0 2024-04-26T10:44:32.854 INFO:tasks.workunit.client.0.smithi049.stdout:6/884: symlink da/dd/de/db5/df1/l128 0 2024-04-26T10:44:32.855 INFO:tasks.workunit.client.0.smithi049.stdout:4/986: rename de/d1b/d5e/d72/d73/dab to de/d1b/d5e/d99/dbb/d134 0 2024-04-26T10:44:32.855 INFO:tasks.workunit.client.0.smithi049.stdout:1/845: dwrite d1e/d20/d26/d3c/fb3 [0,4194304] 0 2024-04-26T10:44:32.855 INFO:tasks.workunit.client.0.smithi049.stdout:8/960: write d2/d17/d34/d40/d7f/fa6 [23845,118753] 0 2024-04-26T10:44:32.859 INFO:tasks.workunit.client.0.smithi049.stdout:1/846: write d1e/dd5/fe1 [660159,119552] 0 2024-04-26T10:44:32.859 INFO:tasks.workunit.client.0.smithi049.stdout:3/796: dread d3/d23/d2f/d6a/d6b/d8/d55/d46/f94 [0,4194304] 0 2024-04-26T10:44:32.859 INFO:tasks.workunit.client.0.smithi049.stdout:8/961: creat d2/df/d10/d23/f12e x:0 0 0 2024-04-26T10:44:32.859 INFO:tasks.workunit.client.0.smithi049.stdout:6/885: write da/dd/d62/d9d/d10f/f74 [677296,88675] 0 2024-04-26T10:44:32.860 INFO:tasks.workunit.client.0.smithi049.stdout:4/987: link de/d1b/d5e/d72/d73/d88/fb8 de/d3f/f135 0 2024-04-26T10:44:32.860 INFO:tasks.workunit.client.0.smithi049.stdout:5/947: truncate d7/f9 8016010 0 2024-04-26T10:44:32.860 INFO:tasks.workunit.client.0.smithi049.stdout:3/797: chown d3/d23/d2f/d6a/d6b/d8/d55/d2e/fcb 254322 1 2024-04-26T10:44:32.861 INFO:tasks.workunit.client.0.smithi049.stdout:8/962: rename d2/d16/d19/dd9 to d2/d16/d12f 0 2024-04-26T10:44:32.861 INFO:tasks.workunit.client.0.smithi049.stdout:5/948: mkdir d7/d1d/d1f/d4e/d77/d140/d167 0 2024-04-26T10:44:32.862 INFO:tasks.workunit.client.0.smithi049.stdout:4/988: fsync de/d1b/d5e/d72/d73/d84/d4b/da4/d117/db1/de5/f105 0 2024-04-26T10:44:32.862 INFO:tasks.workunit.client.0.smithi049.stdout:5/949: chown d7/d66/l108 58744052 1 2024-04-26T10:44:32.863 INFO:tasks.workunit.client.0.smithi049.stdout:4/989: stat de/d1b/d5e/d99/l129 0 2024-04-26T10:44:32.863 INFO:tasks.workunit.client.0.smithi049.stdout:3/798: write d3/d23/d2f/d6a/d6b/d8/d55/d2e/fcb [2158167,41891] 0 2024-04-26T10:44:32.863 INFO:tasks.workunit.client.0.smithi049.stdout:1/847: dwrite f0 [8388608,4194304] 0 2024-04-26T10:44:32.864 INFO:tasks.workunit.client.0.smithi049.stdout:5/950: write d7/d1d/d1f/f153 [1655296,23504] 0 2024-04-26T10:44:32.864 INFO:tasks.workunit.client.0.smithi049.stdout:4/990: stat de/d1b/d5e/d72/d73/d84/d38/l9d 0 2024-04-26T10:44:32.865 INFO:tasks.workunit.client.0.smithi049.stdout:1/848: dread - d1e/d82/fe7 zero size 2024-04-26T10:44:32.865 INFO:tasks.workunit.client.0.smithi049.stdout:5/951: symlink d7/d1d/l168 0 2024-04-26T10:44:32.866 INFO:tasks.workunit.client.0.smithi049.stdout:3/799: symlink d3/d23/d2f/d6a/d6b/d8/dd/df5/l107 0 2024-04-26T10:44:32.867 INFO:tasks.workunit.client.0.smithi049.stdout:4/991: mknod de/d1b/d5e/d99/dbb/d134/c136 0 2024-04-26T10:44:32.867 INFO:tasks.workunit.client.0.smithi049.stdout:5/952: mknod d7/d1d/c169 0 2024-04-26T10:44:32.868 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:32.868 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:32.869 INFO:tasks.workunit.client.0.smithi049.stdout:1/849: symlink d1e/d20/d26/d3c/d96/da3/d109/l111 0 2024-04-26T10:44:32.869 INFO:tasks.workunit.client.0.smithi049.stdout:8/963: dwrite d2/df/d10/d47/d75/fb9 [4194304,4194304] 0 2024-04-26T10:44:32.869 INFO:tasks.workunit.client.0.smithi049.stdout:3/800: fsync d3/d23/d2f/d6a/d6b/d8/fb2 0 2024-04-26T10:44:32.869 INFO:tasks.workunit.client.0.smithi049.stdout:1/850: creat d1e/d20/d67/f112 x:0 0 0 2024-04-26T10:44:32.869 INFO:tasks.workunit.client.0.smithi049.stdout:8/964: write d2/df/d10/d23/f5f [1086846,118366] 0 2024-04-26T10:44:32.871 INFO:tasks.workunit.client.0.smithi049.stdout:1/851: rename d1e/d20/d26/d3c/d54/d59/de2 to d1e/d62/d113 0 2024-04-26T10:44:32.871 INFO:tasks.workunit.client.0.smithi049.stdout:5/953: link d7/c87 d7/d1d/d34/d123/d91/d3e/d60/c16a 0 2024-04-26T10:44:32.872 INFO:tasks.workunit.client.0.smithi049.stdout:5/954: unlink d7/d1d/d1f/ffb 0 2024-04-26T10:44:32.873 INFO:tasks.workunit.client.0.smithi049.stdout:4/992: truncate de/d1b/d5e/d72/d73/fd1 7741925 0 2024-04-26T10:44:32.873 INFO:tasks.workunit.client.0.smithi049.stdout:6/886: dread da/dd/d47/f80 [0,4194304] 0 2024-04-26T10:44:32.875 INFO:tasks.workunit.client.0.smithi049.stdout:6/887: creat da/d4a/f129 x:0 0 0 2024-04-26T10:44:32.875 INFO:tasks.workunit.client.0.smithi049.stdout:1/852: link d1e/d20/d26/d37/d8e/l92 d1e/d20/d4d/d70/dce/dff/l114 0 2024-04-26T10:44:32.875 INFO:tasks.workunit.client.0.smithi049.stdout:4/993: rename de/d3f/d48 to de/d137 0 2024-04-26T10:44:32.876 INFO:tasks.workunit.client.0.smithi049.stdout:5/955: link d7/d1d/d34/d123/d91/d3e/fa7 d7/d1d/d1f/d4e/d65/f16b 0 2024-04-26T10:44:32.876 INFO:tasks.workunit.client.0.smithi049.stdout:3/801: dwrite d3/d23/d2f/d6a/d6b/d8c/f8e [0,4194304] 0 2024-04-26T10:44:32.877 INFO:tasks.workunit.client.0.smithi049.stdout:1/853: sync 2024-04-26T10:44:32.877 INFO:tasks.workunit.client.0.smithi049.stdout:4/994: symlink de/d137/de3/l138 0 2024-04-26T10:44:32.877 INFO:tasks.workunit.client.0.smithi049.stdout:6/888: chown da/dd/de/d11/d109/d119/f10e 120654 1 2024-04-26T10:44:32.878 INFO:tasks.workunit.client.0.smithi049.stdout:5/956: readlink d7/d1d/d1f/d4e/dad/db3/l109 0 2024-04-26T10:44:32.879 INFO:tasks.workunit.client.0.smithi049.stdout:3/802: chown d3/d23/d2f/d6a/d6b/d26/d29/c9a 4 1 2024-04-26T10:44:32.879 INFO:tasks.workunit.client.0.smithi049.stdout:1/854: mkdir d1e/d20/d4d/d70/d115 0 2024-04-26T10:44:32.879 INFO:tasks.workunit.client.0.smithi049.stdout:2/883: dread d6/d9/d5f/dba/d34/d38/d3f/d60/fc9 [0,4194304] 0 2024-04-26T10:44:32.879 INFO:tasks.workunit.client.0.smithi049.stdout:4/995: chown de/d1b/d5e/d72/d73/d84/d4b/db5 1104727098 1 2024-04-26T10:44:32.880 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:32.881 INFO:tasks.workunit.client.0.smithi049.stdout:3/803: fdatasync d3/d23/d2f/d6a/d6b/d26/d65/d70/fa1 0 2024-04-26T10:44:32.882 INFO:tasks.workunit.client.0.smithi049.stdout:5/957: rename d7/d1d/d1f/d4e/da0/c10a to d7/d1d/d1f/d4e/d65/d124/d162/df3/c16c 0 2024-04-26T10:44:32.882 INFO:tasks.workunit.client.0.smithi049.stdout:8/965: dread d2/df/d10/fc4 [0,4194304] 0 2024-04-26T10:44:32.883 INFO:tasks.workunit.client.0.smithi049.stdout:3/804: stat d3/d23/d2f/d6a/d6b/d8/cc3 0 2024-04-26T10:44:32.884 INFO:tasks.workunit.client.0.smithi049.stdout:8/966: chown d2/d17/d34/d40/d64/dcd/ldb 2082284 1 2024-04-26T10:44:32.884 INFO:tasks.workunit.client.0.smithi049.stdout:4/996: link de/d3f/d52/da6/c110 de/d137/d8b/db9/c139 0 2024-04-26T10:44:32.885 INFO:tasks.workunit.client.0.smithi049.stdout:5/958: fdatasync d7/d1d/d1f/d4e/d65/d124/d162/d48/f49 0 2024-04-26T10:44:32.886 INFO:tasks.workunit.client.0.smithi049.stdout:6/889: dwrite da/dd/de/d11/dee/f10b [0,4194304] 0 2024-04-26T10:44:32.886 INFO:tasks.workunit.client.0.smithi049.stdout:8/967: mkdir d2/df/d10/d47/d75/dd5/d130 0 2024-04-26T10:44:32.886 INFO:tasks.workunit.client.0.smithi049.stdout:3/805: mknod d3/d23/d2f/d6a/d6b/d8/dd/c108 0 2024-04-26T10:44:32.887 INFO:tasks.workunit.client.0.smithi049.stdout:1/855: dwrite d1e/d20/f32 [0,4194304] 0 2024-04-26T10:44:32.888 INFO:tasks.workunit.client.0.smithi049.stdout:6/890: rmdir da/dd/d47/d7b/d84/daa 39 2024-04-26T10:44:32.888 INFO:tasks.workunit.client.0.smithi049.stdout:8/968: creat d2/f131 x:0 0 0 2024-04-26T10:44:32.889 INFO:tasks.workunit.client.0.smithi049.stdout:1/856: fsync d1e/d20/d26/d37/f5d 0 2024-04-26T10:44:32.891 INFO:tasks.workunit.client.0.smithi049.stdout:6/891: dread - da/dd/de/d11/d109/d119/f10e zero size 2024-04-26T10:44:32.891 INFO:tasks.workunit.client.0.smithi049.stdout:8/969: fsync d2/d17/d34/d40/d64/dcd/df0/d109/d2a/f10c 0 2024-04-26T10:44:32.891 INFO:tasks.workunit.client.0.smithi049.stdout:8/970: rmdir d2/d16/d19/de7 39 2024-04-26T10:44:32.892 INFO:tasks.workunit.client.0.smithi049.stdout:6/892: creat da/dd/de/d26/d22/f12a x:0 0 0 2024-04-26T10:44:32.893 INFO:tasks.workunit.client.0.smithi049.stdout:5/959: dwrite d7/d66/d84/d103/f35 [0,4194304] 0 2024-04-26T10:44:32.896 INFO:tasks.workunit.client.0.smithi049.stdout:5/960: rename d7/d1d/d34/d123/db2/f157 to d7/d1d/d34/d123/d91/f16d 0 2024-04-26T10:44:32.896 INFO:tasks.workunit.client.0.smithi049.stdout:1/857: dwrite d1e/d20/d26/d37/d6e/fbc [0,4194304] 0 2024-04-26T10:44:32.896 INFO:tasks.workunit.client.0.smithi049.stdout:4/997: truncate de/d1b/d5e/d72/d73/d84/d4b/fa3 6746443 0 2024-04-26T10:44:32.898 INFO:tasks.workunit.client.0.smithi049.stdout:3/806: dwrite d3/d23/d2f/d6a/d6b/d8/d55/d46/fe6 [0,4194304] 0 2024-04-26T10:44:32.898 INFO:tasks.workunit.client.0.smithi049.stdout:4/998: read - de/dfe/f114 zero size 2024-04-26T10:44:32.898 INFO:tasks.workunit.client.0.smithi049.stdout:1/858: creat d1e/d20/d67/dd9/f116 x:0 0 0 2024-04-26T10:44:32.898 INFO:tasks.workunit.client.0.smithi049.stdout:1/859: sync 2024-04-26T10:44:32.899 INFO:tasks.workunit.client.0.smithi049.stdout:1/860: sync 2024-04-26T10:44:32.900 INFO:tasks.workunit.client.0.smithi049.stdout:8/971: dread d2/d17/d34/d40/d64/dcd/df0/f119 [0,4194304] 0 2024-04-26T10:44:32.900 INFO:tasks.workunit.client.0.smithi049.stdout:1/861: symlink d1e/d20/d4d/d70/l117 0 2024-04-26T10:44:32.901 INFO:tasks.workunit.client.0.smithi049.stdout:3/807: truncate d3/d23/d2f/d6a/d6b/d26/fa7 1910596 0 2024-04-26T10:44:32.901 INFO:tasks.workunit.client.0.smithi049.stdout:4/999: getdents de/d1b/d5e/d99/dbb 0 2024-04-26T10:44:32.901 INFO:tasks.workunit.client.0.smithi049.stdout:1/862: fdatasync fd 0 2024-04-26T10:44:32.901 INFO:tasks.workunit.client.0.smithi049.stdout:8/972: rmdir d2/d16/d19/d42/d7c/d10d 39 2024-04-26T10:44:32.904 INFO:tasks.workunit.client.0.smithi049.stdout:8/973: symlink d2/d17/d34/d40/d64/l132 0 2024-04-26T10:44:32.904 INFO:tasks.workunit.client.0.smithi049.stdout:1/863: unlink d1e/d20/d26/d3c/d54/d59/d73/l9a 0 2024-04-26T10:44:32.904 INFO:tasks.workunit.client.0.smithi049.stdout:8/974: chown d2/d16/d12f/ded 163 1 2024-04-26T10:44:32.905 INFO:tasks.workunit.client.0.smithi049.stdout:5/961: dwrite d7/d1d/d1f/d4e/d65/d124/d162/d2b/d117/f155 [0,4194304] 0 2024-04-26T10:44:32.906 INFO:tasks.workunit.client.0.smithi049.stdout:3/808: rename d3/d23/d2f/d6a/d6b/d8/d82/dff/c105 to d3/d23/d2f/d6a/d6b/d8/d55/d2e/c109 0 2024-04-26T10:44:32.906 INFO:tasks.workunit.client.0.smithi049.stdout:5/962: stat d7/d14/f17 0 2024-04-26T10:44:32.907 INFO:tasks.workunit.client.0.smithi049.stdout:5/963: symlink d7/d1d/d34/d123/d91/l16e 0 2024-04-26T10:44:32.907 INFO:tasks.workunit.client.0.smithi049.stdout:3/809: mkdir d3/d23/d2f/d6a/d6b/d8c/d10a 0 2024-04-26T10:44:32.907 INFO:tasks.workunit.client.0.smithi049.stdout:1/864: stat d1e/d20/d26/d37/d8e/le4 0 2024-04-26T10:44:32.908 INFO:tasks.workunit.client.0.smithi049.stdout:1/865: fdatasync f16 0 2024-04-26T10:44:32.910 INFO:tasks.workunit.client.0.smithi049.stdout:5/964: mkdir d7/d1d/d1f/d4e/d65/d16f 0 2024-04-26T10:44:32.910 INFO:tasks.workunit.client.0.smithi049.stdout:5/965: getdents d7/d1d/d1f/d4e 0 2024-04-26T10:44:32.911 INFO:tasks.workunit.client.0.smithi049.stdout:3/810: truncate d3/d23/d2f/d6a/d6b/d8/d55/d2e/f4c 744989 0 2024-04-26T10:44:32.911 INFO:tasks.workunit.client.0.smithi049.stdout:8/975: dwrite d2/d16/d19/d42/deb/ffa [0,4194304] 0 2024-04-26T10:44:32.911 INFO:tasks.workunit.client.0.smithi049.stdout:1/866: truncate d1e/d20/d26/d3c/d54/d59/f10e 44664 0 2024-04-26T10:44:32.912 INFO:tasks.workunit.client.0.smithi049.stdout:5/966: mknod d7/d1d/d34/d123/d91/d3e/d7b/c170 0 2024-04-26T10:44:32.912 INFO:tasks.workunit.client.0.smithi049.stdout:1/867: mknod d1e/d20/d26/d37/d69/d75/c118 0 2024-04-26T10:44:32.915 INFO:tasks.workunit.client.0.smithi049.stdout:1/868: link d1e/d20/d26/d3c/d96/lc9 d1e/d20/d4d/d70/l119 0 2024-04-26T10:44:32.915 INFO:tasks.workunit.client.0.smithi049.stdout:2/884: dread f4 [0,4194304] 0 2024-04-26T10:44:32.916 INFO:tasks.workunit.client.0.smithi049.stdout:1/869: mkdir d1e/d20/d26/d11a 0 2024-04-26T10:44:32.918 INFO:tasks.workunit.client.0.smithi049.stdout:3/811: getdents d3/d23/d2f/d6a/d6b/d8/d82/dff 0 2024-04-26T10:44:32.919 INFO:tasks.workunit.client.0.smithi049.stdout:5/967: dwrite d7/d14/f1a [4194304,4194304] 0 2024-04-26T10:44:32.920 INFO:tasks.workunit.client.0.smithi049.stdout:8/976: dwrite d2/f14 [0,4194304] 0 2024-04-26T10:44:32.920 INFO:tasks.workunit.client.0.smithi049.stdout:5/968: mknod d7/d1d/d1f/d4e/da0/de2/c171 0 2024-04-26T10:44:32.921 INFO:tasks.workunit.client.0.smithi049.stdout:5/969: readlink d7/d53/l7f 0 2024-04-26T10:44:32.921 INFO:tasks.workunit.client.0.smithi049.stdout:8/977: write d2/d16/d19/d42/deb/f12b [906180,103676] 0 2024-04-26T10:44:32.923 INFO:tasks.workunit.client.0.smithi049.stdout:8/978: read d2/f14 [1713785,42468] 0 2024-04-26T10:44:32.923 INFO:tasks.workunit.client.0.smithi049.stdout:6/893: dread da/d4a/de0/d112/f113 [0,4194304] 0 2024-04-26T10:44:32.923 INFO:tasks.workunit.client.0.smithi049.stdout:5/970: mkdir d7/d1d/d1f/d4e/da0/d172 0 2024-04-26T10:44:32.924 INFO:tasks.workunit.client.0.smithi049.stdout:5/971: mkdir d7/d1d/d1f/d4e/da0/de2/d127/d173 0 2024-04-26T10:44:32.924 INFO:tasks.workunit.client.0.smithi049.stdout:6/894: creat da/dd/d47/d7b/d84/daa/f12b x:0 0 0 2024-04-26T10:44:32.925 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:32.923+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:32.925 INFO:tasks.workunit.client.0.smithi049.stdout:3/812: dwrite d3/d23/d2f/d6a/d6b/d8/ded/ff6 [0,4194304] 0 2024-04-26T10:44:32.928 INFO:tasks.workunit.client.0.smithi049.stdout:5/972: mkdir d7/d1d/d1f/d4e/dad/db3/dcc/d174 0 2024-04-26T10:44:32.928 INFO:tasks.workunit.client.0.smithi049.stdout:3/813: creat d3/d23/d2f/db8/f10b x:0 0 0 2024-04-26T10:44:32.928 INFO:tasks.workunit.client.0.smithi049.stdout:6/895: rmdir da/dd/d62/dc1/d10d 0 2024-04-26T10:44:32.930 INFO:tasks.workunit.client.0.smithi049.stdout:6/896: truncate da/dd/d47/f66 1869465 0 2024-04-26T10:44:32.930 INFO:tasks.workunit.client.0.smithi049.stdout:3/814: truncate d3/d23/d2f/d6a/d6b/d26/d65/dae/fbe 4733532 0 2024-04-26T10:44:32.930 INFO:tasks.workunit.client.0.smithi049.stdout:3/815: sync 2024-04-26T10:44:32.932 INFO:tasks.workunit.client.0.smithi049.stdout:8/979: dread d2/df/d10/d47/faa [0,4194304] 0 2024-04-26T10:44:32.932 INFO:tasks.workunit.client.0.smithi049.stdout:3/816: write d3/d23/d2f/d6a/d6b/d26/d29/f3e [3617095,104218] 0 2024-04-26T10:44:32.933 INFO:tasks.workunit.client.0.smithi049.stdout:3/817: fsync d3/d23/d2f/d6a/d6b/d26/d65/ffc 0 2024-04-26T10:44:32.934 INFO:tasks.workunit.client.0.smithi049.stdout:8/980: read d2/d16/d19/fb0 [2119827,46331] 0 2024-04-26T10:44:32.935 INFO:tasks.workunit.client.0.smithi049.stdout:6/897: dwrite da/dd/de/d11/f5d [0,4194304] 0 2024-04-26T10:44:32.937 INFO:tasks.workunit.client.0.smithi049.stdout:6/898: mknod da/dd/de/d26/d22/c12c 0 2024-04-26T10:44:32.937 INFO:tasks.workunit.client.0.smithi049.stdout:8/981: rename d2/df/d10/d47/d75/dc3/fda to d2/d17/d34/d40/d64/dcd/df0/d109/f133 0 2024-04-26T10:44:32.938 INFO:tasks.workunit.client.0.smithi049.stdout:8/982: write d2/d16/d88/dfb/f12c [1124815,60745] 0 2024-04-26T10:44:32.938 INFO:tasks.workunit.client.0.smithi049.stdout:8/983: sync 2024-04-26T10:44:32.938 INFO:tasks.workunit.client.0.smithi049.stdout:3/818: read d3/d23/d2f/d6a/d6b/d26/d65/dae/fb9 [3886182,77833] 0 2024-04-26T10:44:32.940 INFO:tasks.workunit.client.0.smithi049.stdout:8/984: mknod d2/df/d10/d23/d6c/d5e/c134 0 2024-04-26T10:44:32.941 INFO:tasks.workunit.client.0.smithi049.stdout:3/819: write d3/d23/d2f/d6a/d6b/d26/d65/dae/fbe [1852939,76961] 0 2024-04-26T10:44:32.941 INFO:tasks.workunit.client.0.smithi049.stdout:8/985: unlink d2/d16/d19/d42/l10a 0 2024-04-26T10:44:32.941 INFO:tasks.workunit.client.0.smithi049.stdout:3/820: readlink d3/l93 0 2024-04-26T10:44:32.942 INFO:tasks.workunit.client.0.smithi049.stdout:6/899: dwrite da/dd/de/d26/f6f [4194304,4194304] 0 2024-04-26T10:44:32.944 INFO:tasks.workunit.client.0.smithi049.stdout:3/821: getdents d3/d23/d2f/d6a/d6b/d8/dd 0 2024-04-26T10:44:32.944 INFO:tasks.workunit.client.0.smithi049.stdout:3/822: sync 2024-04-26T10:44:32.946 INFO:tasks.workunit.client.0.smithi049.stdout:3/823: creat d3/d23/d2f/d6a/d6b/d26/d65/d70/d84/f10c x:0 0 0 2024-04-26T10:44:32.946 INFO:tasks.workunit.client.0.smithi049.stdout:8/986: dwrite d2/d17/de1/de4/fe8 [0,4194304] 0 2024-04-26T10:44:32.946 INFO:tasks.workunit.client.0.smithi049.stdout:2/885: dread d6/d9/d5f/dba/d1e/f21 [0,4194304] 0 2024-04-26T10:44:32.947 INFO:tasks.workunit.client.0.smithi049.stdout:8/987: stat d2/df/f111 0 2024-04-26T10:44:32.947 INFO:tasks.workunit.client.0.smithi049.stdout:8/988: stat d2/df/d10/d47/lad 0 2024-04-26T10:44:32.948 INFO:tasks.workunit.client.0.smithi049.stdout:2/886: rename f5 to d6/d9/d5f/dba/d1e/f119 0 2024-04-26T10:44:32.948 INFO:tasks.workunit.client.0.smithi049.stdout:6/900: write da/fb8 [299316,11652] 0 2024-04-26T10:44:32.949 INFO:tasks.workunit.client.0.smithi049.stdout:8/989: mkdir d2/d16/d19/d42/daf/d135 0 2024-04-26T10:44:32.950 INFO:tasks.workunit.client.0.smithi049.stdout:1/870: dread d1e/d20/f6b [4194304,4194304] 0 2024-04-26T10:44:32.950 INFO:tasks.workunit.client.0.smithi049.stdout:2/887: mkdir d6/d9/d5f/dba/d35/d11a 0 2024-04-26T10:44:32.951 INFO:tasks.workunit.client.0.smithi049.stdout:6/901: rename da/dd/de/d26/d22/c3c to da/dd/de/d11/dbc/c12d 0 2024-04-26T10:44:32.951 INFO:tasks.workunit.client.0.smithi049.stdout:8/990: write d2/df/d10/d23/d6c/d5e/fa4 [695313,96302] 0 2024-04-26T10:44:32.951 INFO:tasks.workunit.client.0.smithi049.stdout:1/871: fdatasync d1e/d20/d26/d3c/f99 0 2024-04-26T10:44:32.952 INFO:tasks.workunit.client.0.smithi049.stdout:3/824: dwrite d3/f40 [4194304,4194304] 0 2024-04-26T10:44:32.953 INFO:tasks.workunit.client.0.smithi049.stdout:1/872: creat d1e/d20/d26/d11a/f11b x:0 0 0 2024-04-26T10:44:32.953 INFO:tasks.workunit.client.0.smithi049.stdout:5/973: dread d7/d14/f38 [0,4194304] 0 2024-04-26T10:44:32.953 INFO:tasks.workunit.client.0.smithi049.stdout:6/902: fsync da/dd/de/d26/d29/fd8 0 2024-04-26T10:44:32.956 INFO:tasks.workunit.client.0.smithi049.stdout:2/888: dread d6/d9/d5f/dba/d34/d38/d3f/fa1 [0,4194304] 0 2024-04-26T10:44:32.956 INFO:tasks.workunit.client.0.smithi049.stdout:5/974: mkdir d7/d1d/d1f/d4e/d175 0 2024-04-26T10:44:32.956 INFO:tasks.workunit.client.0.smithi049.stdout:1/873: mkdir d1e/d20/d26/d3c/d54/d59/d68/d11c 0 2024-04-26T10:44:32.956 INFO:tasks.workunit.client.0.smithi049.stdout:2/889: rmdir d6/d9/d5f/dba/d11/d6a 39 2024-04-26T10:44:32.957 INFO:tasks.workunit.client.0.smithi049.stdout:8/991: write d2/df/d10/d47/d75/fb3 [2525252,55528] 0 2024-04-26T10:44:32.957 INFO:tasks.workunit.client.0.smithi049.stdout:1/874: write d1e/d20/d4d/f5f [1242695,85661] 0 2024-04-26T10:44:32.957 INFO:tasks.workunit.client.0.smithi049.stdout:8/992: sync 2024-04-26T10:44:32.958 INFO:tasks.workunit.client.0.smithi049.stdout:2/890: write d6/d32/d69/fb3 [991905,34187] 0 2024-04-26T10:44:32.959 INFO:tasks.workunit.client.0.smithi049.stdout:8/993: write d2/fe [2712481,45880] 0 2024-04-26T10:44:32.959 INFO:tasks.workunit.client.0.smithi049.stdout:1/875: write d1e/dd5/ff3 [334431,17538] 0 2024-04-26T10:44:32.959 INFO:tasks.workunit.client.0.smithi049.stdout:6/903: dwrite da/dd/f10 [0,4194304] 0 2024-04-26T10:44:32.960 INFO:tasks.workunit.client.0.smithi049.stdout:8/994: chown d2/d16/d19/f25 3022 1 2024-04-26T10:44:32.960 INFO:tasks.workunit.client.0.smithi049.stdout:2/891: creat d6/d9/d5f/dba/d35/df8/f11b x:0 0 0 2024-04-26T10:44:32.961 INFO:tasks.workunit.client.0.smithi049.stdout:1/876: truncate d1e/d20/d26/d3c/d96/da3/fe6 701307 0 2024-04-26T10:44:32.962 INFO:tasks.workunit.client.0.smithi049.stdout:8/995: fdatasync d2/df/d10/d47/faa 0 2024-04-26T10:44:32.963 INFO:tasks.workunit.client.0.smithi049.stdout:5/975: mkdir d7/d1d/d1f/d4e/dad/db3/dcc/d174/d176 0 2024-04-26T10:44:32.963 INFO:tasks.workunit.client.0.smithi049.stdout:8/996: fsync d2/d17/d34/f68 0 2024-04-26T10:44:32.963 INFO:tasks.workunit.client.0.smithi049.stdout:3/825: read d3/d23/d2f/d6a/d6b/d26/d65/d70/d84/fc2 [4067126,61648] 0 2024-04-26T10:44:32.964 INFO:tasks.workunit.client.0.smithi049.stdout:1/877: dread - d1e/d20/d26/d3c/d96/da3/fcc zero size 2024-04-26T10:44:32.965 INFO:tasks.workunit.client.0.smithi049.stdout:6/904: dread da/dd/f10 [0,4194304] 0 2024-04-26T10:44:32.965 INFO:tasks.workunit.client.0.smithi049.stdout:8/997: creat d2/d17/d34/d40/d64/f136 x:0 0 0 2024-04-26T10:44:32.966 INFO:tasks.workunit.client.0.smithi049.stdout:6/905: unlink da/dd/f2a 0 2024-04-26T10:44:32.966 INFO:tasks.workunit.client.0.smithi049.stdout:8/998: write d2/d17/d34/dbf/f125 [788641,47802] 0 2024-04-26T10:44:32.967 INFO:tasks.workunit.client.0.smithi049.stdout:2/892: dwrite d6/d9/d5f/dba/d34/f6c [0,4194304] 0 2024-04-26T10:44:32.967 INFO:tasks.workunit.client.0.smithi049.stdout:1/878: truncate d1e/d20/d26/d3c/d54/d59/d73/fba 41384 0 2024-04-26T10:44:32.968 INFO:tasks.workunit.client.0.smithi049.stdout:6/906: chown da/dd/d62/d9d/d9e/la9 1 1 2024-04-26T10:44:32.968 INFO:tasks.workunit.client.0.smithi049.stdout:1/879: chown d1e/d20/c2c 17510028 1 2024-04-26T10:44:32.968 INFO:tasks.workunit.client.0.smithi049.stdout:8/999: creat d2/d16/d19/d42/deb/f137 x:0 0 0 2024-04-26T10:44:32.968 INFO:tasks.workunit.client.0.smithi049.stdout:2/893: creat d6/d9/d5f/dba/d1e/f11c x:0 0 0 2024-04-26T10:44:32.970 INFO:tasks.workunit.client.0.smithi049.stdout:6/907: unlink da/dd/de/d11/dbc/fcc 0 2024-04-26T10:44:32.970 INFO:tasks.workunit.client.0.smithi049.stdout:5/976: truncate d7/d1d/d1f/d4e/d65/d124/d162/d48/fbf 2816303 0 2024-04-26T10:44:32.971 INFO:tasks.workunit.client.0.smithi049.stdout:1/880: rename d1e/d20/d26/d3c/d54/fc3 to d1e/d20/d67/dd9/f11d 0 2024-04-26T10:44:32.971 INFO:tasks.workunit.client.0.smithi049.stdout:6/908: write da/ff [1433792,49552] 0 2024-04-26T10:44:32.971 INFO:tasks.workunit.client.0.smithi049.stdout:5/977: rmdir d7/d1d/d34/d123/d13f 39 2024-04-26T10:44:32.972 INFO:tasks.workunit.client.0.smithi049.stdout:1/881: symlink d1e/d20/d26/d3c/d54/d59/l11e 0 2024-04-26T10:44:32.972 INFO:tasks.workunit.client.0.smithi049.stdout:6/909: chown da/dd/d62/d9d/d10f/c6a 786 1 2024-04-26T10:44:32.973 INFO:tasks.workunit.client.0.smithi049.stdout:5/978: mknod d7/d1d/d1f/d4e/d77/d140/d167/c177 0 2024-04-26T10:44:32.973 INFO:tasks.workunit.client.0.smithi049.stdout:6/910: chown da/dd/d47/f80 432 1 2024-04-26T10:44:32.973 INFO:tasks.workunit.client.0.smithi049.stdout:5/979: sync 2024-04-26T10:44:32.973 INFO:tasks.workunit.client.0.smithi049.stdout:1/882: mkdir d1e/d20/d26/d37/d8e/d11f 0 2024-04-26T10:44:32.974 INFO:tasks.workunit.client.0.smithi049.stdout:6/911: symlink da/dd/d62/dc1/l12e 0 2024-04-26T10:44:32.974 INFO:tasks.workunit.client.0.smithi049.stdout:2/894: dread d6/d9/d5f/dba/d11/d6a/d9f/fdc [0,4194304] 0 2024-04-26T10:44:32.975 INFO:tasks.workunit.client.0.smithi049.stdout:5/980: mknod d7/d1d/d1f/d4e/dad/c178 0 2024-04-26T10:44:32.975 INFO:tasks.workunit.client.0.smithi049.stdout:1/883: mknod d1e/d20/d26/d37/d69/d75/c120 0 2024-04-26T10:44:32.975 INFO:tasks.workunit.client.0.smithi049.stdout:1/884: chown d1e/d20/d4d/fac 1 1 2024-04-26T10:44:32.975 INFO:tasks.workunit.client.0.smithi049.stdout:2/895: symlink d6/d9/d5f/d10d/l11d 0 2024-04-26T10:44:32.976 INFO:tasks.workunit.client.0.smithi049.stdout:3/826: dread d3/d23/d2f/d6a/d6b/d8/f49 [0,4194304] 0 2024-04-26T10:44:32.976 INFO:tasks.workunit.client.0.smithi049.stdout:5/981: chown d7/d1d/d1f/d4e/d80/d15b/l10f 38 1 2024-04-26T10:44:32.976 INFO:tasks.workunit.client.0.smithi049.stdout:1/885: creat d1e/d62/f121 x:0 0 0 2024-04-26T10:44:32.976 INFO:tasks.workunit.client.0.smithi049.stdout:6/912: link da/dd/de/d26/l73 da/dd/de/d26/d22/d4c/d10c/l12f 0 2024-04-26T10:44:32.984 INFO:tasks.workunit.client.0.smithi049.stdout:1/886: dwrite d1e/d62/fb5 [0,4194304] 0 2024-04-26T10:44:32.984 INFO:tasks.workunit.client.0.smithi049.stdout:5/982: dwrite d7/d1d/d1f/d4e/da0/de2/f11c [0,4194304] 0 2024-04-26T10:44:32.985 INFO:tasks.workunit.client.0.smithi049.stdout:2/896: dwrite d6/d9/d5f/dba/d11/f5d [0,4194304] 0 2024-04-26T10:44:32.985 INFO:tasks.workunit.client.0.smithi049.stdout:6/913: dwrite da/dd/d47/d7b/fa4 [0,4194304] 0 2024-04-26T10:44:32.986 INFO:tasks.workunit.client.0.smithi049.stdout:2/897: chown d6/d9/d5f/dba/d1e/l39 0 1 2024-04-26T10:44:32.986 INFO:tasks.workunit.client.0.smithi049.stdout:5/983: fsync d7/d1d/d1f/d4e/d65/f92 0 2024-04-26T10:44:32.987 INFO:tasks.workunit.client.0.smithi049.stdout:2/898: chown d6/d9/d5f/f67 1 1 2024-04-26T10:44:32.988 INFO:tasks.workunit.client.0.smithi049.stdout:2/899: stat d6/d9/d5f/dba/d11/d6a/lb9 0 2024-04-26T10:44:32.988 INFO:tasks.workunit.client.0.smithi049.stdout:5/984: link d7/d1d/d1f/d4e/ffd d7/d1d/d1f/d4e/d65/d124/d162/d14a/f179 0 2024-04-26T10:44:32.988 INFO:tasks.workunit.client.0.smithi049.stdout:5/985: dread - d7/d1d/f150 zero size 2024-04-26T10:44:32.989 INFO:tasks.workunit.client.0.smithi049.stdout:5/986: symlink d7/d1d/d1f/d95/l17a 0 2024-04-26T10:44:32.990 INFO:tasks.workunit.client.0.smithi049.stdout:2/900: rename d6/d9/c88 to d6/d9/d5f/dba/d34/d38/d3f/dd2/c11e 0 2024-04-26T10:44:32.992 INFO:tasks.workunit.client.0.smithi049.stdout:2/901: mknod d6/d30/d97/dbe/c11f 0 2024-04-26T10:44:32.998 INFO:tasks.workunit.client.0.smithi049.stdout:5/987: read d7/d1d/d20/fa4 [1616362,33419] 0 2024-04-26T10:44:32.999 INFO:tasks.workunit.client.0.smithi049.stdout:1/887: dread d1e/d20/d26/ff0 [0,4194304] 0 2024-04-26T10:44:32.999 INFO:tasks.workunit.client.0.smithi049.stdout:5/988: symlink d7/d1d/d1f/d4e/dad/l17b 0 2024-04-26T10:44:33.000 INFO:tasks.workunit.client.0.smithi049.stdout:1/888: creat d1e/d20/d26/d37/f122 x:0 0 0 2024-04-26T10:44:33.001 INFO:tasks.workunit.client.0.smithi049.stdout:1/889: chown d1e/d20/l98 14741720 1 2024-04-26T10:44:33.002 INFO:tasks.workunit.client.0.smithi049.stdout:1/890: rename d1e/d20/d26/d3c/d54/lf4 to d1e/d20/d4d/d70/d115/l123 0 2024-04-26T10:44:33.004 INFO:tasks.workunit.client.0.smithi049.stdout:2/902: dread d6/d32/d69/fb4 [0,4194304] 0 2024-04-26T10:44:33.004 INFO:tasks.workunit.client.0.smithi049.stdout:2/903: fsync d6/d9/d5f/f67 0 2024-04-26T10:44:33.005 INFO:tasks.workunit.client.0.smithi049.stdout:2/904: readlink d6/d9/d5f/dba/d35/lbb 0 2024-04-26T10:44:33.005 INFO:tasks.workunit.client.0.smithi049.stdout:2/905: readlink d6/d9/d5f/laa 0 2024-04-26T10:44:33.006 INFO:tasks.workunit.client.0.smithi049.stdout:1/891: dwrite d1e/f31 [0,4194304] 0 2024-04-26T10:44:33.007 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:33.005+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:33.007 INFO:tasks.workunit.client.0.smithi049.stdout:2/906: mkdir d6/d9/d5f/dba/d34/d105/d120 0 2024-04-26T10:44:33.008 INFO:tasks.workunit.client.0.smithi049.stdout:3/827: dread d3/d23/d2f/d6a/d6b/d26/d5f/fbc [0,4194304] 0 2024-04-26T10:44:33.008 INFO:tasks.workunit.client.0.smithi049.stdout:1/892: mknod d1e/d20/d4d/d70/dce/dff/c124 0 2024-04-26T10:44:33.009 INFO:tasks.workunit.client.0.smithi049.stdout:2/907: creat d6/d9/d5f/dba/d34/d38/d3f/f121 x:0 0 0 2024-04-26T10:44:33.009 INFO:tasks.workunit.client.0.smithi049.stdout:2/908: sync 2024-04-26T10:44:33.011 INFO:tasks.workunit.client.0.smithi049.stdout:2/909: rmdir d6/d9/d5f/dba/d11/d6a 39 2024-04-26T10:44:33.011 INFO:tasks.workunit.client.0.smithi049.stdout:3/828: link d3/d23/d2f/d6a/d6b/d8/d34/c6e d3/d23/d2f/d6a/d6b/d8/d55/db4/dca/c10d 0 2024-04-26T10:44:33.011 INFO:tasks.workunit.client.0.smithi049.stdout:3/829: sync 2024-04-26T10:44:33.012 INFO:tasks.workunit.client.0.smithi049.stdout:2/910: chown d6/d32/d4a/c56 15695208 1 2024-04-26T10:44:33.012 INFO:tasks.workunit.client.0.smithi049.stdout:3/830: write d3/d23/d2f/d6a/d6b/d8/dd/f7c [3798122,66048] 0 2024-04-26T10:44:33.013 INFO:tasks.workunit.client.0.smithi049.stdout:2/911: creat d6/d9/d5f/dba/d34/d38/d73/dcd/f122 x:0 0 0 2024-04-26T10:44:33.013 INFO:tasks.workunit.client.0.smithi049.stdout:3/831: write d3/d23/d2f/d6a/d6b/d26/f2b [9226247,116942] 0 2024-04-26T10:44:33.013 INFO:tasks.workunit.client.0.smithi049.stdout:1/893: dwrite d1e/d20/d26/d3c/d96/da3/fcc [0,4194304] 0 2024-04-26T10:44:33.014 INFO:tasks.workunit.client.0.smithi049.stdout:1/894: sync 2024-04-26T10:44:33.015 INFO:tasks.workunit.client.0.smithi049.stdout:1/895: mkdir d1e/d20/d26/d37/d8e/d11f/d125 0 2024-04-26T10:44:33.016 INFO:tasks.workunit.client.0.smithi049.stdout:3/832: write d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/fd8 [7463518,41079] 0 2024-04-26T10:44:33.018 INFO:tasks.workunit.client.0.smithi049.stdout:3/833: stat d3/d23/d2f/d6a/d6b/d26/d65/d70 0 2024-04-26T10:44:33.018 INFO:tasks.workunit.client.0.smithi049.stdout:2/912: dwrite d6/d9/d5f/dba/d11/fee [0,4194304] 0 2024-04-26T10:44:33.020 INFO:tasks.workunit.client.0.smithi049.stdout:3/834: symlink d3/d23/d2f/d6a/d6b/d8/dfa/l10e 0 2024-04-26T10:44:33.020 INFO:tasks.workunit.client.0.smithi049.stdout:2/913: getdents d6/d9/d5f/dba/d35/d11a 0 2024-04-26T10:44:33.025 INFO:tasks.workunit.client.0.smithi049.stdout:1/896: dread d1e/f50 [0,4194304] 0 2024-04-26T10:44:33.026 INFO:tasks.workunit.client.0.smithi049.stdout:5/989: dread d7/d66/fbb [0,4194304] 0 2024-04-26T10:44:33.027 INFO:tasks.workunit.client.0.smithi049.stdout:1/897: getdents d1e/d20/d67/dd9 0 2024-04-26T10:44:33.027 INFO:tasks.workunit.client.0.smithi049.stdout:5/990: mknod d7/d1d/d20/c17c 0 2024-04-26T10:44:33.028 INFO:tasks.workunit.client.0.smithi049.stdout:3/835: read d3/d23/d2f/d6a/d6b/d26/d5f/f69 [2645537,66266] 0 2024-04-26T10:44:33.029 INFO:tasks.workunit.client.0.smithi049.stdout:6/914: dread da/fb8 [0,4194304] 0 2024-04-26T10:44:33.029 INFO:tasks.workunit.client.0.smithi049.stdout:1/898: read - d1e/d20/d26/d3c/d54/d59/f110 zero size 2024-04-26T10:44:33.029 INFO:tasks.workunit.client.0.smithi049.stdout:1/899: symlink d1e/d20/d26/d37/d8e/d11f/l126 0 2024-04-26T10:44:33.029 INFO:tasks.workunit.client.0.smithi049.stdout:6/915: creat da/dd/de/d26/d22/d4c/d10c/f130 x:0 0 0 2024-04-26T10:44:33.031 INFO:tasks.workunit.client.0.smithi049.stdout:6/916: write da/dd/de/f95 [3245807,29159] 0 2024-04-26T10:44:33.031 INFO:tasks.workunit.client.0.smithi049.stdout:1/900: creat d1e/d20/d26/d3c/d54/df7/f127 x:0 0 0 2024-04-26T10:44:33.031 INFO:tasks.workunit.client.0.smithi049.stdout:3/836: truncate d3/d23/d2f/d6a/d6b/d26/d58/f7b 1212095 0 2024-04-26T10:44:33.031 INFO:tasks.workunit.client.0.smithi049.stdout:6/917: chown da/dd/d47/fa8 24 1 2024-04-26T10:44:33.032 INFO:tasks.workunit.client.0.smithi049.stdout:1/901: mkdir d1e/d20/d128 0 2024-04-26T10:44:33.032 INFO:tasks.workunit.client.0.smithi049.stdout:3/837: read d3/d23/d2f/d6a/d6b/d8/ded/ff6 [3430625,45230] 0 2024-04-26T10:44:33.032 INFO:tasks.workunit.client.0.smithi049.stdout:1/902: mknod d1e/dd5/c129 0 2024-04-26T10:44:33.033 INFO:tasks.workunit.client.0.smithi049.stdout:1/903: write d1e/d20/d4d/f60 [3450804,10758] 0 2024-04-26T10:44:33.033 INFO:tasks.workunit.client.0.smithi049.stdout:3/838: creat d3/d23/d2f/d6a/d6b/d8/f10f x:0 0 0 2024-04-26T10:44:33.034 INFO:tasks.workunit.client.0.smithi049.stdout:2/914: dread d6/d9/f52 [0,4194304] 0 2024-04-26T10:44:33.035 INFO:tasks.workunit.client.0.smithi049.stdout:3/839: dread - d3/d23/d2f/d6a/d6b/d26/d65/dae/fe5 zero size 2024-04-26T10:44:33.035 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:33.036 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:33.036 INFO:tasks.workunit.client.0.smithi049.stdout:6/918: dwrite da/dd/de/d26/f6f [0,4194304] 0 2024-04-26T10:44:33.036 INFO:tasks.workunit.client.0.smithi049.stdout:1/904: link d1e/d20/d26/d3c/f87 d1e/d20/d26/d37/d8e/d11f/d125/f12a 0 2024-04-26T10:44:33.037 INFO:tasks.workunit.client.0.smithi049.stdout:6/919: stat da/dd/f13 0 2024-04-26T10:44:33.037 INFO:tasks.workunit.client.0.smithi049.stdout:1/905: chown d1e/d20/d26/d3c/d54/df7 86825 1 2024-04-26T10:44:33.038 INFO:tasks.workunit.client.0.smithi049.stdout:6/920: fdatasync da/dd/d62/d9d/d10f/f5e 0 2024-04-26T10:44:33.040 INFO:tasks.workunit.client.0.smithi049.stdout:6/921: creat da/dd/de/d42/df6/f131 x:0 0 0 2024-04-26T10:44:33.041 INFO:tasks.workunit.client.0.smithi049.stdout:2/915: dwrite d6/d9/d5f/dba/d35/d91/fbd [0,4194304] 0 2024-04-26T10:44:33.042 INFO:tasks.workunit.client.0.smithi049.stdout:3/840: dwrite d3/d23/d2f/d6a/d6b/d8/ded/ff6 [0,4194304] 0 2024-04-26T10:44:33.044 INFO:tasks.workunit.client.0.smithi049.stdout:2/916: chown d6/d9/d5f/dba/d11/d6a/d9f/fdc 0 1 2024-04-26T10:44:33.044 INFO:tasks.workunit.client.0.smithi049.stdout:3/841: creat d3/d23/d2f/d6a/d6b/d8/d55/df2/f110 x:0 0 0 2024-04-26T10:44:33.044 INFO:tasks.workunit.client.0.smithi049.stdout:6/922: getdents da/dd/de/d26/d22 0 2024-04-26T10:44:33.045 INFO:tasks.workunit.client.0.smithi049.stdout:6/923: symlink da/d4a/l132 0 2024-04-26T10:44:33.046 INFO:tasks.workunit.client.0.smithi049.stdout:2/917: rename d6/d30/fd6 to d6/d9/d5f/dba/d11/d6a/dc3/f123 0 2024-04-26T10:44:33.046 INFO:tasks.workunit.client.0.smithi049.stdout:3/842: mknod d3/d23/d2f/d6a/d6b/d26/d65/d70/d84/c111 0 2024-04-26T10:44:33.046 INFO:tasks.workunit.client.0.smithi049.stdout:6/924: creat da/dd/de/d42/f133 x:0 0 0 2024-04-26T10:44:33.046 INFO:tasks.workunit.client.0.smithi049.stdout:2/918: symlink d6/d9/d5f/dba/d35/df8/l124 0 2024-04-26T10:44:33.048 INFO:tasks.workunit.client.0.smithi049.stdout:3/843: write d3/d23/d2f/d6a/d6b/d26/f48 [2599053,27570] 0 2024-04-26T10:44:33.048 INFO:tasks.workunit.client.0.smithi049.stdout:3/844: sync 2024-04-26T10:44:33.049 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:33.050 INFO:tasks.workunit.client.0.smithi049.stdout:2/919: creat d6/d9/d5f/dba/dfd/f125 x:0 0 0 2024-04-26T10:44:33.050 INFO:tasks.workunit.client.0.smithi049.stdout:5/991: dread d7/d53/f11f [4194304,4194304] 0 2024-04-26T10:44:33.051 INFO:tasks.workunit.client.0.smithi049.stdout:3/845: write d3/d23/d2f/d6a/d6b/d26/d65/dae/fd5 [27804,81441] 0 2024-04-26T10:44:33.051 INFO:tasks.workunit.client.0.smithi049.stdout:5/992: chown d7/d1d/d1f/d4e/dad/db3/f11e 3 1 2024-04-26T10:44:33.051 INFO:tasks.workunit.client.0.smithi049.stdout:3/846: write d3/d23/d2f/d6a/d6b/d8/dd/f7c [1558382,72971] 0 2024-04-26T10:44:33.051 INFO:tasks.workunit.client.0.smithi049.stdout:1/906: dread d1e/d20/d26/d3c/f3f [0,4194304] 0 2024-04-26T10:44:33.051 INFO:tasks.workunit.client.0.smithi049.stdout:2/920: fdatasync d6/d30/fe5 0 2024-04-26T10:44:33.052 INFO:tasks.workunit.client.0.smithi049.stdout:2/921: read d6/d9/f52 [1241413,83848] 0 2024-04-26T10:44:33.054 INFO:tasks.workunit.client.0.smithi049.stdout:6/925: dwrite da/dd/d47/f66 [0,4194304] 0 2024-04-26T10:44:33.055 INFO:tasks.workunit.client.0.smithi049.stdout:3/847: dwrite d3/f56 [0,4194304] 0 2024-04-26T10:44:33.057 INFO:tasks.workunit.client.0.smithi049.stdout:3/848: creat d3/d23/d2f/db8/f112 x:0 0 0 2024-04-26T10:44:33.057 INFO:tasks.workunit.client.0.smithi049.stdout:6/926: rename da/dd/d47/d7b/l126 to da/dd/de/db5/df1/dfa/l134 0 2024-04-26T10:44:33.057 INFO:tasks.workunit.client.0.smithi049.stdout:2/922: write d6/d32/d4a/f51 [1336681,108629] 0 2024-04-26T10:44:33.058 INFO:tasks.workunit.client.0.smithi049.stdout:6/927: chown da/dd/d62/f6d 48428 1 2024-04-26T10:44:33.061 INFO:tasks.workunit.client.0.smithi049.stdout:2/923: rmdir d6/d30/dc8 39 2024-04-26T10:44:33.062 INFO:tasks.workunit.client.0.smithi049.stdout:3/849: dwrite d3/d23/d2f/d6a/d6b/d26/f7a [4194304,4194304] 0 2024-04-26T10:44:33.067 INFO:tasks.workunit.client.0.smithi049.stdout:2/924: truncate d6/d32/f87 1219768 0 2024-04-26T10:44:33.068 INFO:tasks.workunit.client.0.smithi049.stdout:2/925: mknod d6/d9/d5f/dba/d34/d38/d73/c126 0 2024-04-26T10:44:33.069 INFO:tasks.workunit.client.0.smithi049.stdout:3/850: read d3/d23/d2f/d6a/d6b/d8/d34/f51 [1352779,6243] 0 2024-04-26T10:44:33.070 INFO:tasks.workunit.client.0.smithi049.stdout:3/851: mkdir d3/d23/d2f/d6a/d6b/d8c/d10a/d113 0 2024-04-26T10:44:33.072 INFO:tasks.workunit.client.0.smithi049.stdout:2/926: dwrite d6/f9e [0,4194304] 0 2024-04-26T10:44:33.073 INFO:tasks.workunit.client.0.smithi049.stdout:5/993: dread d7/f9 [4194304,4194304] 0 2024-04-26T10:44:33.073 INFO:tasks.workunit.client.0.smithi049.stdout:3/852: link d3/d23/d2f/d6a/d6b/d8/dd/c108 d3/d23/d2f/d6a/d6b/d26/d5f/c114 0 2024-04-26T10:44:33.074 INFO:tasks.workunit.client.0.smithi049.stdout:3/853: fdatasync d3/d23/d2f/d6a/d6b/d8/fb2 0 2024-04-26T10:44:33.074 INFO:tasks.workunit.client.0.smithi049.stdout:2/927: getdents d6/d9/d5f/dba/d34/d38/d3f/d60 0 2024-04-26T10:44:33.075 INFO:tasks.workunit.client.0.smithi049.stdout:5/994: truncate d7/d1d/d1f/d4e/d80/fb1 1790307 0 2024-04-26T10:44:33.075 INFO:tasks.workunit.client.0.smithi049.stdout:2/928: mknod d6/d9/c127 0 2024-04-26T10:44:33.075 INFO:tasks.workunit.client.0.smithi049.stdout:5/995: creat d7/d1d/d1f/d95/f17d x:0 0 0 2024-04-26T10:44:33.076 INFO:tasks.workunit.client.0.smithi049.stdout:3/854: creat d3/d23/d2f/d6a/d6b/d8/dd/df5/f115 x:0 0 0 2024-04-26T10:44:33.076 INFO:tasks.workunit.client.0.smithi049.stdout:3/855: chown d3/d23/d2f/d6a/d6b/d8/d87/l8a 1 1 2024-04-26T10:44:33.077 INFO:tasks.workunit.client.0.smithi049.stdout:6/928: dread da/dd/de/d26/d29/f8f [0,4194304] 0 2024-04-26T10:44:33.077 INFO:tasks.workunit.client.0.smithi049.stdout:5/996: truncate d7/d1d/d20/f36 930182 0 2024-04-26T10:44:33.078 INFO:tasks.workunit.client.0.smithi049.stdout:6/929: symlink da/dd/d62/daf/l135 0 2024-04-26T10:44:33.078 INFO:tasks.workunit.client.0.smithi049.stdout:1/907: dread fb [0,4194304] 0 2024-04-26T10:44:33.078 INFO:tasks.workunit.client.0.smithi049.stdout:5/997: write d7/d66/f73 [1539289,48805] 0 2024-04-26T10:44:33.078 INFO:tasks.workunit.client.0.smithi049.stdout:3/856: write d3/d23/d2f/d6a/d6b/d26/d65/ffc [1020858,78072] 0 2024-04-26T10:44:33.078 INFO:tasks.workunit.client.0.smithi049.stdout:1/908: stat d1e/d20/d67/dd9/df5 0 2024-04-26T10:44:33.079 INFO:tasks.workunit.client.0.smithi049.stdout:6/930: creat da/dd/de/db5/df1/f136 x:0 0 0 2024-04-26T10:44:33.079 INFO:tasks.workunit.client.0.smithi049.stdout:6/931: fdatasync da/d4a/f129 0 2024-04-26T10:44:33.080 INFO:tasks.workunit.client.0.smithi049.stdout:5/998: mkdir d7/d1d/d34/d123/d13f/d17e 0 2024-04-26T10:44:33.080 INFO:tasks.workunit.client.0.smithi049.stdout:3/857: write d3/d23/d2f/d6a/d6b/d8/f88 [919578,29882] 0 2024-04-26T10:44:33.080 INFO:tasks.workunit.client.0.smithi049.stdout:1/909: readlink d1e/d20/d4d/l6d 0 2024-04-26T10:44:33.080 INFO:tasks.workunit.client.0.smithi049.stdout:1/910: getdents d1e/d20/d4d/d70/dea 0 2024-04-26T10:44:33.082 INFO:tasks.workunit.client.0.smithi049.stdout:5/999: creat d7/d1d/d1f/d4e/d65/d124/d162/d48/f17f x:0 0 0 2024-04-26T10:44:33.082 INFO:tasks.workunit.client.0.smithi049.stdout:1/911: symlink d1e/d20/d26/d3c/d54/l12b 0 2024-04-26T10:44:33.082 INFO:tasks.workunit.client.0.smithi049.stdout:6/932: getdents da/dd/de/db5/df1 0 2024-04-26T10:44:33.084 INFO:tasks.workunit.client.0.smithi049.stdout:1/912: link d1e/d20/d67/dd9/f11d d1e/d20/d26/d37/f12c 0 2024-04-26T10:44:33.084 INFO:tasks.workunit.client.0.smithi049.stdout:1/913: chown d1e/d20/d26/d3c/d54/d59/d73/dab 426460 1 2024-04-26T10:44:33.086 INFO:tasks.workunit.client.0.smithi049.stdout:1/914: rename d1e/d20/d26/d3c/d54/d59/d68/c10a to d1e/d20/d26/d3c/d54/d59/d68/c12d 0 2024-04-26T10:44:33.087 INFO:tasks.workunit.client.0.smithi049.stdout:6/933: dwrite da/dd/d62/fce [0,4194304] 0 2024-04-26T10:44:33.088 INFO:tasks.workunit.client.0.smithi049.stdout:1/915: rename fd to d1e/d20/d26/d37/d8e/d11f/d125/f12e 0 2024-04-26T10:44:33.088 INFO:tasks.workunit.client.0.smithi049.stdout:1/916: sync 2024-04-26T10:44:33.088 INFO:tasks.workunit.client.0.smithi049.stdout:6/934: dread - da/dd/de/d11/d109/d119/f10e zero size 2024-04-26T10:44:33.089 INFO:tasks.workunit.client.0.smithi049.stdout:2/929: dread d6/d9/d5f/dba/fb1 [0,4194304] 0 2024-04-26T10:44:33.090 INFO:tasks.workunit.client.0.smithi049.stdout:1/917: write d1e/d20/d26/d3c/d54/d59/f110 [369124,34836] 0 2024-04-26T10:44:33.090 INFO:tasks.workunit.client.0.smithi049.stdout:6/935: chown da/dd/d47/d7b/d84/daa/c115 250283262 1 2024-04-26T10:44:33.091 INFO:tasks.workunit.client.0.smithi049.stdout:2/930: creat d6/d30/d97/dbe/dd1/f128 x:0 0 0 2024-04-26T10:44:33.091 INFO:tasks.workunit.client.0.smithi049.stdout:6/936: mkdir da/dd/de/d42/df6/d137 0 2024-04-26T10:44:33.092 INFO:tasks.workunit.client.0.smithi049.stdout:2/931: mknod d6/d9/c129 0 2024-04-26T10:44:33.092 INFO:tasks.workunit.client.0.smithi049.stdout:6/937: fsync da/dd/de/d26/d22/d4c/d10c/f130 0 2024-04-26T10:44:33.092 INFO:tasks.workunit.client.0.smithi049.stdout:1/918: dread d1e/d20/d26/d3c/d54/d59/d68/fc0 [0,4194304] 0 2024-04-26T10:44:33.093 INFO:tasks.workunit.client.0.smithi049.stdout:6/938: creat da/dd/d47/f138 x:0 0 0 2024-04-26T10:44:33.093 INFO:tasks.workunit.client.0.smithi049.stdout:2/932: link d6/d30/d97/fab d6/d32/d69/f12a 0 2024-04-26T10:44:33.094 INFO:tasks.workunit.client.0.smithi049.stdout:1/919: getdents d1e/d20/d26/d3c/d96/da3 0 2024-04-26T10:44:33.098 INFO:tasks.workunit.client.0.smithi049.stdout:6/939: dwrite da/dd/de/d11/f7e [0,4194304] 0 2024-04-26T10:44:33.098 INFO:tasks.workunit.client.0.smithi049.stdout:3/858: dread d3/d23/d2f/d6a/d6b/d8/f57 [0,4194304] 0 2024-04-26T10:44:33.099 INFO:tasks.workunit.client.0.smithi049.stdout:6/940: chown da/dd/de/d26/d22/f8d 9 1 2024-04-26T10:44:33.100 INFO:tasks.workunit.client.0.smithi049.stdout:1/920: dwrite d1e/d20/d67/f6c [0,4194304] 0 2024-04-26T10:44:33.101 INFO:tasks.workunit.client.0.smithi049.stdout:1/921: chown d1e/d20/d26/d37/d69/d75 58487472 1 2024-04-26T10:44:33.101 INFO:tasks.workunit.client.0.smithi049.stdout:6/941: truncate da/dd/f1e 1369743 0 2024-04-26T10:44:33.102 INFO:tasks.workunit.client.0.smithi049.stdout:2/933: dwrite d6/d9/d5f/dba/df/d31/f5c [0,4194304] 0 2024-04-26T10:44:33.102 INFO:tasks.workunit.client.0.smithi049.stdout:6/942: stat da/dd/de/d26/d22/d4c/le6 0 2024-04-26T10:44:33.102 INFO:tasks.workunit.client.0.smithi049.stdout:3/859: rename d3/d23/d2f/d6a/d6b/d26/d65/d70/d84/f10c to d3/d23/d2f/d6a/d6b/d8/dfa/f116 0 2024-04-26T10:44:33.102 INFO:tasks.workunit.client.0.smithi049.stdout:1/922: stat d1e/d20/d26/d3c/d54/d59/f88 0 2024-04-26T10:44:33.103 INFO:tasks.workunit.client.0.smithi049.stdout:2/934: chown d6/d32/d4a/ca9 868 1 2024-04-26T10:44:33.103 INFO:tasks.workunit.client.0.smithi049.stdout:3/860: write d3/f56 [7423076,46306] 0 2024-04-26T10:44:33.104 INFO:tasks.workunit.client.0.smithi049.stdout:1/923: unlink d1e/d20/d26/d37/d69/l76 0 2024-04-26T10:44:33.104 INFO:tasks.workunit.client.0.smithi049.stdout:6/943: mknod da/dd/d62/c139 0 2024-04-26T10:44:33.104 INFO:tasks.workunit.client.0.smithi049.stdout:2/935: chown d6/d30/d97/dbe/dd1/f128 837793 1 2024-04-26T10:44:33.104 INFO:tasks.workunit.client.0.smithi049.stdout:1/924: symlink d1e/d20/d26/d37/d69/d75/l12f 0 2024-04-26T10:44:33.105 INFO:tasks.workunit.client.0.smithi049.stdout:2/936: mkdir d6/d9/d5f/dba/d11/d12b 0 2024-04-26T10:44:33.106 INFO:tasks.workunit.client.0.smithi049.stdout:2/937: sync 2024-04-26T10:44:33.106 INFO:tasks.workunit.client.0.smithi049.stdout:1/925: rename d1e/f3b to d1e/d20/d4d/d70/d115/f130 0 2024-04-26T10:44:33.107 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:33.105+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:33.110 INFO:tasks.workunit.client.0.smithi049.stdout:2/938: creat d6/d9/d5f/dba/d34/d38/db5/f12c x:0 0 0 2024-04-26T10:44:33.110 INFO:tasks.workunit.client.0.smithi049.stdout:1/926: mknod d1e/dd5/c131 0 2024-04-26T10:44:33.110 INFO:tasks.workunit.client.0.smithi049.stdout:6/944: write da/dd/de/d42/ff7 [154395,110682] 0 2024-04-26T10:44:33.110 INFO:tasks.workunit.client.0.smithi049.stdout:3/861: dwrite d3/d23/d2f/d6a/d6b/d26/d65/d70/fa1 [0,4194304] 0 2024-04-26T10:44:33.110 INFO:tasks.workunit.client.0.smithi049.stdout:1/927: write d1e/d20/d26/d3c/d54/ff1 [173722,121796] 0 2024-04-26T10:44:33.110 INFO:tasks.workunit.client.0.smithi049.stdout:3/862: write d3/d23/d2f/fdb [199184,57417] 0 2024-04-26T10:44:33.111 INFO:tasks.workunit.client.0.smithi049.stdout:1/928: symlink d1e/d20/d26/l132 0 2024-04-26T10:44:33.112 INFO:tasks.workunit.client.0.smithi049.stdout:2/939: truncate d6/d9/f52 1108001 0 2024-04-26T10:44:33.112 INFO:tasks.workunit.client.0.smithi049.stdout:6/945: dread da/dd/de/d11/f5d [0,4194304] 0 2024-04-26T10:44:33.113 INFO:tasks.workunit.client.0.smithi049.stdout:2/940: mkdir d6/d9/d5f/dba/d35/df8/d12d 0 2024-04-26T10:44:33.114 INFO:tasks.workunit.client.0.smithi049.stdout:6/946: getdents da/dd/d47/d7b/d84/daa 0 2024-04-26T10:44:33.114 INFO:tasks.workunit.client.0.smithi049.stdout:2/941: dread f3 [4194304,4194304] 0 2024-04-26T10:44:33.115 INFO:tasks.workunit.client.0.smithi049.stdout:6/947: creat da/dd/de/f13a x:0 0 0 2024-04-26T10:44:33.119 INFO:tasks.workunit.client.0.smithi049.stdout:6/948: truncate da/dd/d47/d7b/d84/fdd 2248203 0 2024-04-26T10:44:33.127 INFO:tasks.workunit.client.0.smithi049.stdout:1/929: dread d1e/d20/d26/f51 [0,4194304] 0 2024-04-26T10:44:33.128 INFO:tasks.workunit.client.0.smithi049.stdout:1/930: fdatasync d1e/d20/d26/d37/f122 0 2024-04-26T10:44:33.128 INFO:tasks.workunit.client.0.smithi049.stdout:1/931: creat d1e/d82/f133 x:0 0 0 2024-04-26T10:44:33.130 INFO:tasks.workunit.client.0.smithi049.stdout:2/942: dread d6/f84 [0,4194304] 0 2024-04-26T10:44:33.132 INFO:tasks.workunit.client.0.smithi049.stdout:2/943: mkdir d6/d9/d5f/dba/d34/d38/d73/d12e 0 2024-04-26T10:44:33.132 INFO:tasks.workunit.client.0.smithi049.stdout:2/944: fsync d6/d9/d5f/dba/d34/d38/d3f/d60/f86 0 2024-04-26T10:44:33.134 INFO:tasks.workunit.client.0.smithi049.stdout:2/945: truncate d6/d9/d5f/dba/d35/d91/fa7 215793 0 2024-04-26T10:44:33.135 INFO:tasks.workunit.client.0.smithi049.stdout:2/946: symlink d6/d9/d5f/d10d/l12f 0 2024-04-26T10:44:33.135 INFO:tasks.workunit.client.0.smithi049.stdout:1/932: dread d1e/d20/d26/d37/f5b [0,4194304] 0 2024-04-26T10:44:33.136 INFO:tasks.workunit.client.0.smithi049.stdout:6/949: dread da/dd/d47/d7b/d84/fdd [0,4194304] 0 2024-04-26T10:44:33.137 INFO:tasks.workunit.client.0.smithi049.stdout:1/933: write d1e/d62/f71 [553255,69778] 0 2024-04-26T10:44:33.137 INFO:tasks.workunit.client.0.smithi049.stdout:3/863: dread d3/d23/d2f/d6a/d6b/d26/d65/fc5 [0,4194304] 0 2024-04-26T10:44:33.138 INFO:tasks.workunit.client.0.smithi049.stdout:6/950: mkdir da/d4a/de0/d13b 0 2024-04-26T10:44:33.138 INFO:tasks.workunit.client.0.smithi049.stdout:1/934: unlink d1e/d20/d26/d37/d8e/le4 0 2024-04-26T10:44:33.140 INFO:tasks.workunit.client.0.smithi049.stdout:1/935: mkdir d1e/d20/d26/d37/d8e/d97/d134 0 2024-04-26T10:44:33.140 INFO:tasks.workunit.client.0.smithi049.stdout:2/947: dwrite d6/f9e [4194304,4194304] 0 2024-04-26T10:44:33.140 INFO:tasks.workunit.client.0.smithi049.stdout:3/864: write d3/d23/d2f/d6a/d6b/d8/d55/d46/f4a [4184381,43282] 0 2024-04-26T10:44:33.141 INFO:tasks.workunit.client.0.smithi049.stdout:2/948: unlink d6/d9/d5f/dba/d35/df8/l103 0 2024-04-26T10:44:33.141 INFO:tasks.workunit.client.0.smithi049.stdout:1/936: rename d1e/d20/d26/d37/d69/d75/f85 to d1e/d20/d26/d37/d8e/f135 0 2024-04-26T10:44:33.142 INFO:tasks.workunit.client.0.smithi049.stdout:3/865: creat d3/d23/d2f/d6a/d6b/d26/f117 x:0 0 0 2024-04-26T10:44:33.142 INFO:tasks.workunit.client.0.smithi049.stdout:2/949: stat d6/d32/d69/c83 0 2024-04-26T10:44:33.142 INFO:tasks.workunit.client.0.smithi049.stdout:6/951: write da/dd/fd9 [908253,125736] 0 2024-04-26T10:44:33.142 INFO:tasks.workunit.client.0.smithi049.stdout:2/950: sync 2024-04-26T10:44:33.144 INFO:tasks.workunit.client.0.smithi049.stdout:2/951: link d6/c68 d6/d9/d5f/dba/d1e/c130 0 2024-04-26T10:44:33.144 INFO:tasks.workunit.client.0.smithi049.stdout:2/952: sync 2024-04-26T10:44:33.145 INFO:tasks.workunit.client.0.smithi049.stdout:2/953: chown d6/d9/c127 10 1 2024-04-26T10:44:33.145 INFO:tasks.workunit.client.0.smithi049.stdout:6/952: dread da/dd/d47/d7b/fa4 [0,4194304] 0 2024-04-26T10:44:33.145 INFO:tasks.workunit.client.0.smithi049.stdout:3/866: truncate d3/d23/d2f/d6a/d6b/d26/d65/f9b 161325 0 2024-04-26T10:44:33.147 INFO:tasks.workunit.client.0.smithi049.stdout:3/867: getdents d3/d23/d2f/d6a/d6b/d26 0 2024-04-26T10:44:33.150 INFO:tasks.workunit.client.0.smithi049.stdout:6/953: truncate da/d4a/de0/d112/f113 822400 0 2024-04-26T10:44:33.151 INFO:tasks.workunit.client.0.smithi049.stdout:6/954: mkdir da/d4a/de0/d13b/d13c 0 2024-04-26T10:44:33.152 INFO:tasks.workunit.client.0.smithi049.stdout:1/937: dread d1e/d20/d26/d37/f58 [0,4194304] 0 2024-04-26T10:44:33.153 INFO:tasks.workunit.client.0.smithi049.stdout:1/938: rmdir d1e/d20/d26/d37/d8e/dfe 39 2024-04-26T10:44:33.154 INFO:tasks.workunit.client.0.smithi049.stdout:1/939: unlink d1e/d20/d26/d3c/d54/f5a 0 2024-04-26T10:44:33.156 INFO:tasks.workunit.client.0.smithi049.stdout:1/940: write d1e/d20/d26/d3c/d54/df7/f127 [1045403,119026] 0 2024-04-26T10:44:33.156 INFO:tasks.workunit.client.0.smithi049.stdout:6/955: dwrite da/dd/de/d11/dbc/f108 [0,4194304] 0 2024-04-26T10:44:33.158 INFO:tasks.workunit.client.0.smithi049.stdout:1/941: read d1e/f72 [385431,50026] 0 2024-04-26T10:44:33.159 INFO:tasks.workunit.client.0.smithi049.stdout:6/956: symlink da/dd/de/d11/l13d 0 2024-04-26T10:44:33.160 INFO:tasks.workunit.client.0.smithi049.stdout:6/957: write da/dd/d47/d7b/d84/fc2 [50779,7177] 0 2024-04-26T10:44:33.160 INFO:tasks.workunit.client.0.smithi049.stdout:1/942: rename d1e/d20/d26/d3c/d54/d59/f65 to d1e/d20/d26/d3c/d54/d59/f136 0 2024-04-26T10:44:33.161 INFO:tasks.workunit.client.0.smithi049.stdout:1/943: chown d1e/d20/d26/d3c/d96/da3/d109 123533 1 2024-04-26T10:44:33.162 INFO:tasks.workunit.client.0.smithi049.stdout:2/954: dread d6/d9/d5f/dba/df/f100 [0,4194304] 0 2024-04-26T10:44:33.164 INFO:tasks.workunit.client.0.smithi049.stdout:3/868: dread d3/d23/d2f/d6a/d6b/d8/d34/f44 [0,4194304] 0 2024-04-26T10:44:33.167 INFO:tasks.workunit.client.0.smithi049.stdout:1/944: dwrite d1e/d20/d26/d37/f4e [4194304,4194304] 0 2024-04-26T10:44:33.169 INFO:tasks.workunit.client.0.smithi049.stdout:1/945: creat d1e/d20/d4d/d70/d115/f137 x:0 0 0 2024-04-26T10:44:33.169 INFO:tasks.workunit.client.0.smithi049.stdout:3/869: dwrite d3/d23/d2f/d6a/d6b/d8/d82/dff/ff8 [0,4194304] 0 2024-04-26T10:44:33.171 INFO:tasks.workunit.client.0.smithi049.stdout:1/946: stat d1e/d20/d26/d3c/d54/d59/l11e 0 2024-04-26T10:44:33.171 INFO:tasks.workunit.client.0.smithi049.stdout:1/947: unlink fe 0 2024-04-26T10:44:33.171 INFO:tasks.workunit.client.0.smithi049.stdout:3/870: mknod d3/d23/d2f/d6a/d6b/d8/dfa/c118 0 2024-04-26T10:44:33.172 INFO:tasks.workunit.client.0.smithi049.stdout:3/871: write d3/d23/d2f/d6a/d6b/d26/f2b [5602430,65894] 0 2024-04-26T10:44:33.174 INFO:tasks.workunit.client.0.smithi049.stdout:1/948: mknod d1e/d20/d26/d3c/d54/df7/c138 0 2024-04-26T10:44:33.174 INFO:tasks.workunit.client.0.smithi049.stdout:3/872: unlink d3/d23/d2f/d6a/d6b/d8/d34/cea 0 2024-04-26T10:44:33.176 INFO:tasks.workunit.client.0.smithi049.stdout:1/949: rmdir d1e/d20/d26/d37/d69/d75 39 2024-04-26T10:44:33.177 INFO:tasks.workunit.client.0.smithi049.stdout:3/873: dwrite d3/d23/d2f/d6a/d6b/d26/d65/d70/d96/fb3 [0,4194304] 0 2024-04-26T10:44:33.178 INFO:tasks.workunit.client.0.smithi049.stdout:1/950: dread d1e/d20/d26/d3c/f3f [0,4194304] 0 2024-04-26T10:44:33.178 INFO:tasks.workunit.client.0.smithi049.stdout:1/951: stat d1e/d20/d26/d3c/d54/df7 0 2024-04-26T10:44:33.179 INFO:tasks.workunit.client.0.smithi049.stdout:1/952: stat d1e/c86 0 2024-04-26T10:44:33.179 INFO:tasks.workunit.client.0.smithi049.stdout:3/874: creat d3/d23/d2f/d6a/d6b/d8/d34/f119 x:0 0 0 2024-04-26T10:44:33.179 INFO:tasks.workunit.client.0.smithi049.stdout:2/955: dread d6/d9/d5f/dba/d34/d38/d3f/f42 [0,4194304] 0 2024-04-26T10:44:33.180 INFO:tasks.workunit.client.0.smithi049.stdout:2/956: sync 2024-04-26T10:44:33.180 INFO:tasks.workunit.client.0.smithi049.stdout:1/953: truncate d1e/d20/d26/d3c/d54/d59/fdc 4846239 0 2024-04-26T10:44:33.181 INFO:tasks.workunit.client.0.smithi049.stdout:2/957: creat d6/d9/d5f/dba/d11/d12b/f131 x:0 0 0 2024-04-26T10:44:33.182 INFO:tasks.workunit.client.0.smithi049.stdout:1/954: dread - d1e/d20/d67/dd9/df5/f106 zero size 2024-04-26T10:44:33.183 INFO:tasks.workunit.client.0.smithi049.stdout:1/955: chown d1e/d20/d26/d3c/f99 6298 1 2024-04-26T10:44:33.184 INFO:tasks.workunit.client.0.smithi049.stdout:6/958: dread da/dd/de/d11/f3e [4194304,4194304] 0 2024-04-26T10:44:33.184 INFO:tasks.workunit.client.0.smithi049.stdout:3/875: dwrite d3/d23/d2f/d6a/d6b/d26/d65/dae/fe5 [0,4194304] 0 2024-04-26T10:44:33.186 INFO:tasks.workunit.client.0.smithi049.stdout:6/959: fdatasync da/dd/d47/d7b/d84/f117 0 2024-04-26T10:44:33.186 INFO:tasks.workunit.client.0.smithi049.stdout:1/956: link d1e/d20/d4d/fac d1e/d20/d26/d3c/d54/d59/d73/dab/f139 0 2024-04-26T10:44:33.187 INFO:tasks.workunit.client.0.smithi049.stdout:1/957: fdatasync f0 0 2024-04-26T10:44:33.187 INFO:tasks.workunit.client.0.smithi049.stdout:3/876: mkdir d3/d23/d2f/d6a/d6b/d8/d55/d11a 0 2024-04-26T10:44:33.187 INFO:tasks.workunit.client.0.smithi049.stdout:2/958: dwrite d6/d9/d5f/dba/d34/d38/db5/f12c [0,4194304] 0 2024-04-26T10:44:33.187 INFO:tasks.workunit.client.0.smithi049.stdout:1/958: fdatasync d1e/d20/d26/d3c/fb3 0 2024-04-26T10:44:33.188 INFO:tasks.workunit.client.0.smithi049.stdout:6/960: rename da/d4a/de0/d13b/d13c to da/dd/de/db5/df1/d13e 0 2024-04-26T10:44:33.188 INFO:tasks.workunit.client.0.smithi049.stdout:3/877: symlink d3/d23/d2f/d6a/d6b/d8/d82/l11b 0 2024-04-26T10:44:33.188 INFO:tasks.workunit.client.0.smithi049.stdout:1/959: chown c17 0 1 2024-04-26T10:44:33.190 INFO:tasks.workunit.client.0.smithi049.stdout:6/961: rename da/dd/de/f95 to da/dd/de/d11/d109/d119/d116/f13f 0 2024-04-26T10:44:33.190 INFO:tasks.workunit.client.0.smithi049.stdout:3/878: chown d3/d23/d2f/d6a/d6b/d26/d58/cbd 177139812 1 2024-04-26T10:44:33.192 INFO:tasks.workunit.client.0.smithi049.stdout:2/959: dwrite d6/d32/d69/f9b [0,4194304] 0 2024-04-26T10:44:33.194 INFO:tasks.workunit.client.0.smithi049.stdout:3/879: link d3/d23/d2f/d6a/d6b/d8/fd0 d3/d23/d2f/d6a/d6b/d8/dfa/f11c 0 2024-04-26T10:44:33.194 INFO:tasks.workunit.client.0.smithi049.stdout:2/960: truncate d6/d9/d5f/dba/d11/f9c 4913 0 2024-04-26T10:44:33.194 INFO:tasks.workunit.client.0.smithi049.stdout:2/961: write d6/d9/d5f/dba/d35/d91/fa7 [1088148,14398] 0 2024-04-26T10:44:33.195 INFO:tasks.workunit.client.0.smithi049.stdout:6/962: rename da/dd/de/db5/df1 to da/dd/de/d11/d109/d119/d116/d140 0 2024-04-26T10:44:33.195 INFO:tasks.workunit.client.0.smithi049.stdout:1/960: truncate d1e/d62/f71 391408 0 2024-04-26T10:44:33.196 INFO:tasks.workunit.client.0.smithi049.stdout:2/962: truncate d6/f2f 1360776 0 2024-04-26T10:44:33.197 INFO:tasks.workunit.client.0.smithi049.stdout:6/963: write da/dd/de/d26/d22/f12a [912564,84840] 0 2024-04-26T10:44:33.197 INFO:tasks.workunit.client.0.smithi049.stdout:1/961: dread d1e/d20/d26/d3c/d54/d59/d68/fc0 [0,4194304] 0 2024-04-26T10:44:33.198 INFO:tasks.workunit.client.0.smithi049.stdout:2/963: creat d6/d9/d5f/dba/d34/d38/d73/d12e/f132 x:0 0 0 2024-04-26T10:44:33.198 INFO:tasks.workunit.client.0.smithi049.stdout:6/964: mkdir da/dd/de/d11/dbc/d141 0 2024-04-26T10:44:33.199 INFO:tasks.workunit.client.0.smithi049.stdout:3/880: dwrite d3/d23/d2f/d6a/d6b/d8/dd/fac [0,4194304] 0 2024-04-26T10:44:33.199 INFO:tasks.workunit.client.0.smithi049.stdout:1/962: creat d1e/d20/d4d/d70/f13a x:0 0 0 2024-04-26T10:44:33.199 INFO:tasks.workunit.client.0.smithi049.stdout:6/965: unlink da/dd/d47/da3/f11b 0 2024-04-26T10:44:33.200 INFO:tasks.workunit.client.0.smithi049.stdout:1/963: write d1e/d20/d26/d3c/f7b [4846113,116171] 0 2024-04-26T10:44:33.202 INFO:tasks.workunit.client.0.smithi049.stdout:1/964: rename d1e/d20/d26/d3c/d54/d59/d68/l10b to d1e/d20/d26/d3c/d54/df7/l13b 0 2024-04-26T10:44:33.203 INFO:tasks.workunit.client.0.smithi049.stdout:3/881: dread d3/d23/d2f/d6a/d6b/d26/d65/fc5 [0,4194304] 0 2024-04-26T10:44:33.203 INFO:tasks.workunit.client.0.smithi049.stdout:1/965: mknod d1e/d20/d26/d37/d6e/c13c 0 2024-04-26T10:44:33.204 INFO:tasks.workunit.client.0.smithi049.stdout:3/882: rmdir d3/d23/d2f/d6a/d6b/d8/d87/db1 39 2024-04-26T10:44:33.204 INFO:tasks.workunit.client.0.smithi049.stdout:1/966: write d1e/d20/d4d/d70/d115/f137 [533457,74786] 0 2024-04-26T10:44:33.205 INFO:tasks.workunit.client.0.smithi049.stdout:6/966: dread da/d4a/f63 [0,4194304] 0 2024-04-26T10:44:33.206 INFO:tasks.workunit.client.0.smithi049.stdout:3/883: dread d3/d23/d2f/d6a/d6b/d26/d65/d70/d84/fd9 [0,4194304] 0 2024-04-26T10:44:33.207 INFO:tasks.workunit.client.0.smithi049.stdout:6/967: truncate da/dd/d62/f83 163384 0 2024-04-26T10:44:33.207 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:33.205+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:33.208 INFO:tasks.workunit.client.0.smithi049.stdout:6/968: symlink da/dd/d62/d9d/d10f/l142 0 2024-04-26T10:44:33.209 INFO:tasks.workunit.client.0.smithi049.stdout:2/964: truncate d6/d9/d5f/dba/d35/d91/fbd 2392502 0 2024-04-26T10:44:33.210 INFO:tasks.workunit.client.0.smithi049.stdout:2/965: rmdir d6/d9/d5f/dba/df 39 2024-04-26T10:44:33.211 INFO:tasks.workunit.client.0.smithi049.stdout:3/884: dread d3/d23/d2f/d6a/d6b/d8/d55/d2e/f4c [0,4194304] 0 2024-04-26T10:44:33.211 INFO:tasks.workunit.client.0.smithi049.stdout:3/885: readlink d3/l30 0 2024-04-26T10:44:33.211 INFO:tasks.workunit.client.0.smithi049.stdout:2/966: write d6/d9/f9a [587862,12625] 0 2024-04-26T10:44:33.212 INFO:tasks.workunit.client.0.smithi049.stdout:6/969: dwrite da/dd/d62/d9d/d10f/f65 [0,4194304] 0 2024-04-26T10:44:33.213 INFO:tasks.workunit.client.0.smithi049.stdout:2/967: creat d6/d30/d97/dbe/dd1/def/f133 x:0 0 0 2024-04-26T10:44:33.214 INFO:tasks.workunit.client.0.smithi049.stdout:3/886: truncate d3/d23/d2f/d6a/d6b/d8c/fc0 771855 0 2024-04-26T10:44:33.214 INFO:tasks.workunit.client.0.smithi049.stdout:6/970: creat da/dd/de/d11/dbc/d141/f143 x:0 0 0 2024-04-26T10:44:33.217 INFO:tasks.workunit.client.0.smithi049.stdout:2/968: rename d6/d30/dc8/f10c to d6/d9/d5f/dba/d34/d38/d3f/d60/f134 0 2024-04-26T10:44:33.219 INFO:tasks.workunit.client.0.smithi049.stdout:6/971: dwrite da/dd/de/d11/d109/d119/d116/d140/dfa/fbd [0,4194304] 0 2024-04-26T10:44:33.220 INFO:tasks.workunit.client.0.smithi049.stdout:3/887: dwrite d3/d23/d2f/d6a/d6b/d8/dd/f9d [0,4194304] 0 2024-04-26T10:44:33.227 INFO:tasks.workunit.client.0.smithi049.stdout:6/972: dwrite da/dd/de/fa0 [4194304,4194304] 0 2024-04-26T10:44:33.227 INFO:tasks.workunit.client.0.smithi049.stdout:3/888: dwrite d3/d23/d2f/d6a/d6b/d26/d58/fb0 [0,4194304] 0 2024-04-26T10:44:33.227 INFO:tasks.workunit.client.0.smithi049.stdout:1/967: dread d1e/d20/d26/d3c/d54/d59/d73/dab/fc1 [0,4194304] 0 2024-04-26T10:44:33.228 INFO:tasks.workunit.client.0.smithi049.stdout:1/968: mkdir d1e/d62/d13d 0 2024-04-26T10:44:33.228 INFO:tasks.workunit.client.0.smithi049.stdout:3/889: write d3/d23/d2f/d6a/d6b/d26/d65/d70/d96/fb3 [2304566,123116] 0 2024-04-26T10:44:33.229 INFO:tasks.workunit.client.0.smithi049.stdout:3/890: dread - d3/d23/d2f/d6a/d6b/d8/d55/df2/f110 zero size 2024-04-26T10:44:33.229 INFO:tasks.workunit.client.0.smithi049.stdout:1/969: getdents d1e/d20/d4d/d70 0 2024-04-26T10:44:33.229 INFO:tasks.workunit.client.0.smithi049.stdout:1/970: fdatasync d1e/d20/f41 0 2024-04-26T10:44:33.231 INFO:tasks.workunit.client.0.smithi049.stdout:3/891: truncate d3/d23/d2f/d6a/d6b/d8/d82/fdc 418224 0 2024-04-26T10:44:33.231 INFO:tasks.workunit.client.0.smithi049.stdout:1/971: write d1e/d20/d26/d37/d69/d75/fc8 [1005138,32492] 0 2024-04-26T10:44:33.231 INFO:tasks.workunit.client.0.smithi049.stdout:1/972: mkdir d1e/d62/d13d/d13e 0 2024-04-26T10:44:33.231 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:33.231 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:33.232 INFO:tasks.workunit.client.0.smithi049.stdout:1/973: symlink d1e/d82/l13f 0 2024-04-26T10:44:33.233 INFO:tasks.workunit.client.0.smithi049.stdout:1/974: getdents d1e/d20/d26/d37/d69/d75 0 2024-04-26T10:44:33.234 INFO:tasks.workunit.client.0.smithi049.stdout:6/973: write da/dd/de/d26/d29/fd8 [955607,83424] 0 2024-04-26T10:44:33.235 INFO:tasks.workunit.client.0.smithi049.stdout:3/892: dwrite d3/d23/d2f/d6a/d6b/d26/d5f/fd6 [0,4194304] 0 2024-04-26T10:44:33.236 INFO:tasks.workunit.client.0.smithi049.stdout:6/974: rename da/dd/de/d11/dbc/d141/f143 to da/dd/de/f144 0 2024-04-26T10:44:33.237 INFO:tasks.workunit.client.0.smithi049.stdout:6/975: write da/dd/de/d42/f5f [1379791,85164] 0 2024-04-26T10:44:33.239 INFO:tasks.workunit.client.0.smithi049.stdout:1/975: dwrite d1e/f31 [0,4194304] 0 2024-04-26T10:44:33.241 INFO:tasks.workunit.client.0.smithi049.stdout:1/976: creat d1e/d20/d26/d3c/d96/f140 x:0 0 0 2024-04-26T10:44:33.241 INFO:tasks.workunit.client.0.smithi049.stdout:3/893: dwrite d3/d23/d2f/d6a/d6b/d26/d58/fa4 [0,4194304] 0 2024-04-26T10:44:33.242 INFO:tasks.workunit.client.0.smithi049.stdout:1/977: write d1e/d20/d26/d37/fec [4316625,110426] 0 2024-04-26T10:44:33.243 INFO:tasks.workunit.client.0.smithi049.stdout:3/894: dread - d3/d23/d2f/d6a/d6b/d8/d55/df2/f110 zero size 2024-04-26T10:44:33.243 INFO:tasks.workunit.client.0.smithi049.stdout:6/976: dwrite da/d4a/f6e [0,4194304] 0 2024-04-26T10:44:33.244 INFO:tasks.workunit.client.0.smithi049.stdout:1/978: creat d1e/d20/d26/d3c/d54/d59/d73/dab/f141 x:0 0 0 2024-04-26T10:44:33.244 INFO:tasks.workunit.client.0.smithi049.stdout:6/977: write da/dd/de/d26/d22/fe7 [1022054,67803] 0 2024-04-26T10:44:33.244 INFO:tasks.workunit.client.0.smithi049.stdout:3/895: write d3/d23/d2f/d6a/d6b/d26/d5f/fe3 [1068174,123969] 0 2024-04-26T10:44:33.245 INFO:tasks.workunit.client.0.smithi049.stdout:6/978: fdatasync da/dd/fe3 0 2024-04-26T10:44:33.245 INFO:tasks.workunit.client.0.smithi049.stdout:1/979: rmdir d1e/d20/d26/d37/d69 39 2024-04-26T10:44:33.245 INFO:tasks.workunit.client.0.smithi049.stdout:1/980: truncate d1e/d62/f121 500290 0 2024-04-26T10:44:33.247 INFO:tasks.workunit.client.0.smithi049.stdout:3/896: link d3/d23/d2f/d6a/d6b/d26/d65/d70/fa1 d3/d23/d2f/d6a/d6b/d8c/d10a/f11d 0 2024-04-26T10:44:33.247 INFO:tasks.workunit.client.0.smithi049.stdout:1/981: rename d1e/d20/d67 to d1e/d20/d67/dd9/df5/d142 22 2024-04-26T10:44:33.247 INFO:tasks.workunit.client.0.smithi049.stdout:6/979: read da/dd/f5c [3899776,25826] 0 2024-04-26T10:44:33.247 INFO:tasks.workunit.client.0.smithi049.stdout:1/982: symlink d1e/d20/d67/l143 0 2024-04-26T10:44:33.247 INFO:tasks.workunit.client.0.smithi049.stdout:6/980: rmdir da/dd/d62 39 2024-04-26T10:44:33.248 INFO:tasks.workunit.client.0.smithi049.stdout:3/897: fsync d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/f3f 0 2024-04-26T10:44:33.248 INFO:tasks.workunit.client.0.smithi049.stdout:3/898: readlink d3/d23/d2f/d6a/d6b/d8c/laa 0 2024-04-26T10:44:33.250 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:33.251 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:44:33.252 INFO:tasks.workunit.client.0.smithi049.stdout:6/981: symlink da/dd/d47/d7b/d84/l145 0 2024-04-26T10:44:33.252 INFO:tasks.workunit.client.0.smithi049.stdout:3/899: write d3/d23/d2f/d6a/d6b/d26/d65/d70/fa1 [2289502,84292] 0 2024-04-26T10:44:33.252 INFO:tasks.workunit.client.0.smithi049.stdout:6/982: chown da/dd/d47/d7b/fa4 10 1 2024-04-26T10:44:33.252 INFO:tasks.workunit.client.0.smithi049.stdout:3/900: fsync d3/d23/d2f/d6a/d6b/d26/f2b 0 2024-04-26T10:44:33.252 INFO:tasks.workunit.client.0.smithi049.stdout:6/983: stat da/dd/d47/da3/ce9 0 2024-04-26T10:44:33.252 INFO:tasks.workunit.client.0.smithi049.stdout:3/901: chown d3/d23/d2f/d6a/d6b/d8/dd/f18 491265 1 2024-04-26T10:44:33.252 INFO:tasks.workunit.client.0.smithi049.stdout:6/984: write da/dd/de/d11/dee/f10b [1630344,89896] 0 2024-04-26T10:44:33.254 INFO:tasks.workunit.client.0.smithi049.stdout:2/969: dread d6/d9/d5f/dba/d35/d91/fa7 [0,4194304] 0 2024-04-26T10:44:33.254 INFO:tasks.workunit.client.0.smithi049.stdout:3/902: chown d3/d23/d2f/d6a/d6b/d8/d55/db4/dca 281090102 1 2024-04-26T10:44:33.254 INFO:tasks.workunit.client.0.smithi049.stdout:6/985: creat da/dd/de/d26/d22/d122/dfe/f146 x:0 0 0 2024-04-26T10:44:33.254 INFO:tasks.workunit.client.0.smithi049.stdout:2/970: mknod d6/d30/d97/dbe/d109/c135 0 2024-04-26T10:44:33.255 INFO:tasks.workunit.client.0.smithi049.stdout:6/986: creat da/dd/de/d11/d109/f147 x:0 0 0 2024-04-26T10:44:33.255 INFO:tasks.workunit.client.0.smithi049.stdout:2/971: mknod d6/d32/c136 0 2024-04-26T10:44:33.256 INFO:tasks.workunit.client.0.smithi049.stdout:6/987: creat da/dd/de/d26/d22/d122/f148 x:0 0 0 2024-04-26T10:44:33.256 INFO:tasks.workunit.client.0.smithi049.stdout:2/972: rename d6/d30/d97/dbe/c11f to d6/d30/dc8/c137 0 2024-04-26T10:44:33.258 INFO:tasks.workunit.client.0.smithi049.stdout:6/988: mkdir da/dd/de/d11/d109/d119/d149 0 2024-04-26T10:44:33.258 INFO:tasks.workunit.client.0.smithi049.stdout:2/973: symlink d6/d9/d5f/dba/df/l138 0 2024-04-26T10:44:33.259 INFO:tasks.workunit.client.0.smithi049.stdout:6/989: fdatasync da/dd/d47/d7b/d84/daa/f12b 0 2024-04-26T10:44:33.259 INFO:tasks.workunit.client.0.smithi049.stdout:3/903: dwrite d3/d23/d2f/d6a/d6b/d8/dd/fa9 [0,4194304] 0 2024-04-26T10:44:33.260 INFO:tasks.workunit.client.0.smithi049.stdout:3/904: readlink d3/d23/d2f/d6a/d6b/l9e 0 2024-04-26T10:44:33.262 INFO:tasks.workunit.client.0.smithi049.stdout:3/905: creat d3/d23/d2f/d6a/d6b/d8/d82/f11e x:0 0 0 2024-04-26T10:44:33.264 INFO:tasks.workunit.client.0.smithi049.stdout:1/983: dread d1e/d20/d26/d3c/d54/d59/d73/dab/fb4 [0,4194304] 0 2024-04-26T10:44:33.265 INFO:tasks.workunit.client.0.smithi049.stdout:2/974: dwrite d6/d9/d5f/dba/d11/f1d [8388608,4194304] 0 2024-04-26T10:44:33.265 INFO:tasks.workunit.client.0.smithi049.stdout:3/906: fsync d3/d23/d2f/d6a/d6b/d8/d87/db1/fc6 0 2024-04-26T10:44:33.266 INFO:tasks.workunit.client.0.smithi049.stdout:6/990: dwrite da/dd/de/d26/f64 [0,4194304] 0 2024-04-26T10:44:33.267 INFO:tasks.workunit.client.0.smithi049.stdout:2/975: write d6/d9/d5f/dba/d11/f62 [208650,45456] 0 2024-04-26T10:44:33.271 INFO:tasks.workunit.client.0.smithi049.stdout:6/991: truncate da/dd/de/d11/f7e 3739306 0 2024-04-26T10:44:33.271 INFO:tasks.workunit.client.0.smithi049.stdout:1/984: dwrite d1e/dd5/ff3 [0,4194304] 0 2024-04-26T10:44:33.273 INFO:tasks.workunit.client.0.smithi049.stdout:1/985: truncate d1e/d20/d26/d37/fec 4899198 0 2024-04-26T10:44:33.274 INFO:tasks.workunit.client.0.smithi049.stdout:2/976: dwrite d6/d9/d5f/dba/d34/d38/d73/d12e/f132 [0,4194304] 0 2024-04-26T10:44:33.275 INFO:tasks.workunit.client.0.smithi049.stdout:1/986: write d1e/d20/d26/d3c/d54/d59/d68/fde [318729,34555] 0 2024-04-26T10:44:33.276 INFO:tasks.workunit.client.0.smithi049.stdout:2/977: creat d6/d9/d5f/dba/d35/df8/d12d/f139 x:0 0 0 2024-04-26T10:44:33.276 INFO:tasks.workunit.client.0.smithi049.stdout:1/987: unlink l4 0 2024-04-26T10:44:33.276 INFO:tasks.workunit.client.0.smithi049.stdout:1/988: symlink d1e/d20/d128/l144 0 2024-04-26T10:44:33.278 INFO:tasks.workunit.client.0.smithi049.stdout:2/978: write d6/d9/f6b [4141434,24794] 0 2024-04-26T10:44:33.280 INFO:tasks.workunit.client.0.smithi049.stdout:2/979: dread d6/d9/d5f/dba/d1e/f119 [0,4194304] 0 2024-04-26T10:44:33.283 INFO:tasks.workunit.client.0.smithi049.stdout:1/989: dwrite d1e/d20/d26/d3c/d96/f140 [0,4194304] 0 2024-04-26T10:44:33.285 INFO:tasks.workunit.client.0.smithi049.stdout:1/990: creat d1e/f145 x:0 0 0 2024-04-26T10:44:33.286 INFO:tasks.workunit.client.0.smithi049.stdout:2/980: dwrite d6/d9/d5f/dba/d34/d38/ff6 [0,4194304] 0 2024-04-26T10:44:33.286 INFO:tasks.workunit.client.0.smithi049.stdout:1/991: creat d1e/d20/d26/d37/d6e/f146 x:0 0 0 2024-04-26T10:44:33.286 INFO:tasks.workunit.client.0.smithi049.stdout:2/981: readlink d6/d9/l1f 0 2024-04-26T10:44:33.287 INFO:tasks.workunit.client.0.smithi049.stdout:1/992: chown d1e/d20/d26 178 1 2024-04-26T10:44:33.287 INFO:tasks.workunit.client.0.smithi049.stdout:3/907: sync 2024-04-26T10:44:33.288 INFO:tasks.workunit.client.0.smithi049.stdout:1/993: dread d1e/d20/d26/d3c/d54/d59/f10e [0,4194304] 0 2024-04-26T10:44:33.288 INFO:tasks.workunit.client.0.smithi049.stdout:3/908: fdatasync d3/d23/d2f/fef 0 2024-04-26T10:44:33.290 INFO:tasks.workunit.client.0.smithi049.stdout:1/994: mknod d1e/d20/d26/d3c/d54/d59/c147 0 2024-04-26T10:44:33.290 INFO:tasks.workunit.client.0.smithi049.stdout:3/909: read d3/d23/d2f/d6a/d6b/d8/d82/dff/ff8 [1904459,92613] 0 2024-04-26T10:44:33.290 INFO:tasks.workunit.client.0.smithi049.stdout:3/910: fdatasync d3/f40 0 2024-04-26T10:44:33.292 INFO:tasks.workunit.client.0.smithi049.stdout:2/982: dwrite d6/d30/d97/fae [0,4194304] 0 2024-04-26T10:44:33.293 INFO:tasks.workunit.client.0.smithi049.stdout:2/983: stat d6/d9/d5f/dba/d11/d6a/d9f 0 2024-04-26T10:44:33.294 INFO:tasks.workunit.client.0.smithi049.stdout:3/911: creat d3/d23/d2f/d6a/d6b/d8c/d10a/f11f x:0 0 0 2024-04-26T10:44:33.294 INFO:tasks.workunit.client.0.smithi049.stdout:2/984: dread - d6/d9/d5f/dba/df/d31/fe9 zero size 2024-04-26T10:44:33.295 INFO:tasks.workunit.client.0.smithi049.stdout:3/912: stat d3/d23/d2f/d6a/d6b/d8/dfa/f116 0 2024-04-26T10:44:33.296 INFO:tasks.workunit.client.0.smithi049.stdout:2/985: rmdir d6/d9/d5f/dba/d35/d91 39 2024-04-26T10:44:33.297 INFO:tasks.workunit.client.0.smithi049.stdout:1/995: dwrite d1e/d20/d26/d37/fa0 [0,4194304] 0 2024-04-26T10:44:33.297 INFO:tasks.workunit.client.0.smithi049.stdout:3/913: dread - d3/d23/d2f/d6a/d6b/d8/d34/fbb zero size 2024-04-26T10:44:33.297 INFO:tasks.workunit.client.0.smithi049.stdout:2/986: mkdir d6/d30/d13a 0 2024-04-26T10:44:33.298 INFO:tasks.workunit.client.0.smithi049.stdout:3/914: chown d3/d23/d2f/d6a/d6b/d8/d34/f64 54 1 2024-04-26T10:44:33.299 INFO:tasks.workunit.client.0.smithi049.stdout:1/996: link d1e/d20/d26/d37/d8e/lfa d1e/d20/d4d/d70/d115/l148 0 2024-04-26T10:44:33.303 INFO:tasks.workunit.client.0.smithi049.stdout:1/997: dread d1e/d20/d26/d3c/d96/ff8 [0,4194304] 0 2024-04-26T10:44:33.303 INFO:tasks.workunit.client.0.smithi049.stdout:2/987: dwrite d6/d9/d5f/dba/d35/d91/f92 [0,4194304] 0 2024-04-26T10:44:33.304 INFO:tasks.workunit.client.0.smithi049.stdout:2/988: mknod d6/d9/c13b 0 2024-04-26T10:44:33.306 INFO:tasks.workunit.client.0.smithi049.stdout:2/989: fdatasync d6/d9/d5f/dba/d34/fc5 0 2024-04-26T10:44:33.306 INFO:tasks.workunit.client.0.smithi049.stdout:1/998: link d1e/d20/d26/d3c/d96/da3/fcc d1e/d20/d26/d37/d69/f149 0 2024-04-26T10:44:33.308 INFO:tasks.workunit.client.0.smithi049.stdout:2/990: mkdir d6/d9/d5f/dba/d34/d38/d73/d12e/d13c 0 2024-04-26T10:44:33.308 INFO:tasks.workunit.client.0.smithi049.stdout:2/991: write d6/d9/d5f/dba/d11/d6a/d9f/fdc [930246,55964] 0 2024-04-26T10:44:33.309 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:33.306+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:33.309 INFO:tasks.workunit.client.0.smithi049.stdout:1/999: read d1e/d20/d4d/f5f [1779101,35425] 0 2024-04-26T10:44:33.309 INFO:tasks.workunit.client.0.smithi049.stdout:2/992: mkdir d6/d9/d5f/d13d 0 2024-04-26T10:44:33.309 INFO:tasks.workunit.client.0.smithi049.stdout:6/992: dread da/d4a/f94 [0,4194304] 0 2024-04-26T10:44:33.310 INFO:tasks.workunit.client.0.smithi049.stdout:2/993: write d6/d32/d4a/f51 [2217294,7177] 0 2024-04-26T10:44:33.310 INFO:tasks.workunit.client.0.smithi049.stdout:6/993: fsync da/dd/de/d11/dee/f10b 0 2024-04-26T10:44:33.313 INFO:tasks.workunit.client.0.smithi049.stdout:2/994: write d6/d32/d4a/fd0 [5493018,120656] 0 2024-04-26T10:44:33.315 INFO:tasks.workunit.client.0.smithi049.stdout:6/994: dwrite da/dd/d47/f48 [0,4194304] 0 2024-04-26T10:44:33.316 INFO:tasks.workunit.client.0.smithi049.stdout:2/995: dwrite d6/d9/d5f/dba/d34/d38/d3f/fe6 [0,4194304] 0 2024-04-26T10:44:33.320 INFO:tasks.workunit.client.0.smithi049.stdout:3/915: dread d3/d23/d2f/d6a/d6b/d26/d5f/fbc [0,4194304] 0 2024-04-26T10:44:33.321 INFO:tasks.workunit.client.0.smithi049.stdout:3/916: creat d3/d23/d2f/d6a/d6b/d8/d87/f120 x:0 0 0 2024-04-26T10:44:33.323 INFO:tasks.workunit.client.0.smithi049.stdout:3/917: write d3/d23/d2f/d6a/d6b/d26/f48 [3213552,27028] 0 2024-04-26T10:44:33.324 INFO:tasks.workunit.client.0.smithi049.stdout:3/918: fsync d3/fc8 0 2024-04-26T10:44:33.327 INFO:tasks.workunit.client.0.smithi049.stdout:3/919: dwrite d3/d23/d2f/db8/ff3 [0,4194304] 0 2024-04-26T10:44:33.328 INFO:tasks.workunit.client.0.smithi049.stdout:3/920: fsync d3/d23/d2f/d6a/d6b/d26/f48 0 2024-04-26T10:44:33.329 INFO:tasks.workunit.client.0.smithi049.stdout:3/921: write d3/d23/d2f/d6a/d6b/d8/d34/fbb [38281,26085] 0 2024-04-26T10:44:33.338 INFO:tasks.workunit.client.0.smithi049.stdout:2/996: sync 2024-04-26T10:44:33.338 INFO:tasks.workunit.client.0.smithi049.stdout:6/995: sync 2024-04-26T10:44:33.339 INFO:tasks.workunit.client.0.smithi049.stdout:2/997: dread - d6/d9/d5f/dba/d34/d38/d73/dcd/fea zero size 2024-04-26T10:44:33.340 INFO:tasks.workunit.client.0.smithi049.stdout:6/996: rename da/dd/de/d26/ce1 to da/dd/de/d42/df6/d137/c14a 0 2024-04-26T10:44:33.340 INFO:tasks.workunit.client.0.smithi049.stdout:2/998: rmdir d6/d32/d4a 39 2024-04-26T10:44:33.340 INFO:tasks.workunit.client.0.smithi049.stdout:2/999: write d6/f9e [231361,30472] 0 2024-04-26T10:44:33.340 INFO:tasks.workunit.client.0.smithi049.stdout:6/997: write da/dd/d47/fa8 [443218,54754] 0 2024-04-26T10:44:33.341 INFO:tasks.workunit.client.0.smithi049.stdout:6/998: rmdir da/dd/d62/d9d/d10f 39 2024-04-26T10:44:33.345 INFO:tasks.workunit.client.0.smithi049.stdout:3/922: dread d3/d23/d2f/d6a/d6b/d26/d29/f3e [4194304,4194304] 0 2024-04-26T10:44:33.346 INFO:tasks.workunit.client.0.smithi049.stdout:6/999: dwrite da/dd/de/d26/d29/f3d [0,4194304] 0 2024-04-26T10:44:33.346 INFO:tasks.workunit.client.0.smithi049.stdout:3/923: mkdir d3/d23/d2f/d6a/d6b/d26/d5f/d121 0 2024-04-26T10:44:33.350 INFO:tasks.workunit.client.0.smithi049.stdout:3/924: mknod d3/d23/d2f/d6a/d6b/d26/d65/d70/d84/c122 0 2024-04-26T10:44:33.363 INFO:tasks.workunit.client.0.smithi049.stdout:3/925: dread d3/d23/d2f/d6a/d6b/d8/d55/f99 [0,4194304] 0 2024-04-26T10:44:33.365 INFO:tasks.workunit.client.0.smithi049.stdout:3/926: symlink d3/d23/d2f/d6a/d6b/d8/d87/db1/l123 0 2024-04-26T10:44:33.365 INFO:tasks.workunit.client.0.smithi049.stdout:3/927: write d3/d23/d2f/d6a/d6b/d8/d34/f64 [2515594,84374] 0 2024-04-26T10:44:33.367 INFO:tasks.workunit.client.0.smithi049.stdout:3/928: link d3/d23/d2f/d6a/d6b/d8/d87/l8a d3/d23/d2f/d6a/d6b/d8/d82/l124 0 2024-04-26T10:44:33.367 INFO:tasks.workunit.client.0.smithi049.stdout:3/929: symlink d3/d23/d2f/db8/l125 0 2024-04-26T10:44:33.368 INFO:tasks.workunit.client.0.smithi049.stdout:3/930: dread - d3/d23/d2f/d6a/d6b/d26/f117 zero size 2024-04-26T10:44:33.369 INFO:tasks.workunit.client.0.smithi049.stdout:3/931: creat d3/d23/d2f/d6a/d6b/d26/d58/f126 x:0 0 0 2024-04-26T10:44:33.370 INFO:tasks.workunit.client.0.smithi049.stdout:3/932: readlink d3/d23/d2f/d6a/d6b/d8/d87/l8a 0 2024-04-26T10:44:33.372 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:33.372 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:33.373 INFO:tasks.workunit.client.0.smithi049.stdout:3/933: getdents d3/d23/d2f/d6a/d6b/d26/d58 0 2024-04-26T10:44:33.373 INFO:tasks.workunit.client.0.smithi049.stdout:3/934: write d3/d23/d2f/db8/f10b [930261,25383] 0 2024-04-26T10:44:33.374 INFO:tasks.workunit.client.0.smithi049.stdout:3/935: write d3/d23/d2f/d6a/d6b/d8/f88 [3555116,9785] 0 2024-04-26T10:44:33.377 INFO:tasks.workunit.client.0.smithi049.stdout:3/936: truncate d3/d23/d2f/d6a/d6b/d8/d55/d46/fe6 1652983 0 2024-04-26T10:44:33.378 INFO:tasks.workunit.client.0.smithi049.stdout:3/937: write d3/d23/d2f/d6a/d6b/d8/f57 [1665994,47003] 0 2024-04-26T10:44:33.382 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:33.405 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:44:33.408 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:33.407+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:33.410 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:33.410 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:33.410 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:33.421 INFO:tasks.workunit.client.0.smithi049.stdout:3/938: sync 2024-04-26T10:44:33.423 INFO:tasks.workunit.client.0.smithi049.stdout:3/939: unlink d3/d23/d2f/d6a/d6b/d8c/d10a/f11f 0 2024-04-26T10:44:33.425 INFO:tasks.workunit.client.0.smithi049.stdout:3/940: chown d3/d23/d2f/d6a/d6b/d8/d55/d46/c61 2069 1 2024-04-26T10:44:33.425 INFO:tasks.workunit.client.0.smithi049.stdout:3/941: rmdir d3/d23/d2f/d6a/d6b/d8c 39 2024-04-26T10:44:33.425 INFO:tasks.workunit.client.0.smithi049.stdout:3/942: mknod d3/d23/d2f/d6a/d6b/d8c/d10a/c127 0 2024-04-26T10:44:33.426 INFO:tasks.workunit.client.0.smithi049.stdout:3/943: truncate d3/d23/d2f/d6a/d6b/d8/d34/fbb 463312 0 2024-04-26T10:44:33.427 INFO:tasks.workunit.client.0.smithi049.stdout:3/944: fdatasync d3/d23/d2f/d6a/d6b/d26/d5f/f69 0 2024-04-26T10:44:33.428 INFO:tasks.workunit.client.0.smithi049.stdout:3/945: write d3/d23/d2f/db8/ff3 [3772785,37558] 0 2024-04-26T10:44:33.430 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:33.431 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:33.434 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:33.434 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:33.440 INFO:tasks.workunit.client.0.smithi049.stdout:3/946: dread d3/d23/d2f/d6a/d6b/d26/f6d [0,4194304] 0 2024-04-26T10:44:33.442 INFO:tasks.workunit.client.0.smithi049.stdout:3/947: rename d3/l1a to d3/d23/d2f/d6a/d6b/d8/d55/l128 0 2024-04-26T10:44:33.443 INFO:tasks.workunit.client.0.smithi049.stdout:3/948: getdents d3/d23/d2f/d6a/d6b/d26/d65 0 2024-04-26T10:44:33.444 INFO:tasks.workunit.client.0.smithi049.stdout:3/949: mkdir d3/d23/d2f/d6a/d6b/d8/d34/d129 0 2024-04-26T10:44:33.445 INFO:tasks.workunit.client.0.smithi049.stdout:3/950: fdatasync d3/d23/d2f/d6a/d6b/d26/d5f/fd6 0 2024-04-26T10:44:33.446 INFO:tasks.workunit.client.0.smithi049.stdout:3/951: chown d3/d23/d2f/d6a/d6b/d26/c59 109 1 2024-04-26T10:44:33.447 INFO:tasks.workunit.client.0.smithi049.stdout:3/952: creat d3/d23/d2f/d6a/d6b/d8/d55/df2/d103/f12a x:0 0 0 2024-04-26T10:44:33.448 INFO:tasks.workunit.client.0.smithi049.stdout:3/953: symlink d3/d23/l12b 0 2024-04-26T10:44:33.450 INFO:tasks.workunit.client.0.smithi049.stdout:3/954: truncate d3/d23/d2f/d6a/d6b/d8/d55/d46/fe6 1208398 0 2024-04-26T10:44:33.452 INFO:tasks.workunit.client.0.smithi049.stdout:3/955: truncate d3/d23/d2f/db8/ff3 3930330 0 2024-04-26T10:44:33.454 INFO:tasks.workunit.client.0.smithi049.stdout:3/956: rename d3/d23/d2f/d6a/d6b/d26/f2b to d3/d23/d2f/d6a/d6b/d8/d87/f12c 0 2024-04-26T10:44:33.455 INFO:tasks.workunit.client.0.smithi049.stdout:3/957: symlink d3/d23/d2f/d6a/d6b/d8/d55/d46/l12d 0 2024-04-26T10:44:33.456 INFO:tasks.workunit.client.0.smithi049.stdout:3/958: chown d3/d23/d2f/d6a/d6b/d26/d5f/c114 1 1 2024-04-26T10:44:33.461 INFO:tasks.workunit.client.0.smithi049.stdout:3/959: dwrite d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/f3f [0,4194304] 0 2024-04-26T10:44:33.464 INFO:tasks.workunit.client.0.smithi049.stdout:3/960: rename d3/d23/d2f/d6a/d6b/d8/d55/l62 to d3/d23/d2f/d6a/d6b/d8/d87/l12e 0 2024-04-26T10:44:33.465 INFO:tasks.workunit.client.0.smithi049.stdout:3/961: link d3/d23/d2f/db8/l125 d3/d23/l12f 0 2024-04-26T10:44:33.466 INFO:tasks.workunit.client.0.smithi049.stdout:3/962: symlink d3/d23/d2f/d6a/d6b/d8/d55/l130 0 2024-04-26T10:44:33.467 INFO:tasks.workunit.client.0.smithi049.stdout:3/963: fsync d3/d23/d2f/d6a/d6b/d8/d34/f64 0 2024-04-26T10:44:33.471 INFO:tasks.workunit.client.0.smithi049.stdout:3/964: dwrite d3/d23/d2f/d6a/d6b/f101 [0,4194304] 0 2024-04-26T10:44:33.473 INFO:tasks.workunit.client.0.smithi049.stdout:3/965: write d3/d23/d2f/d6a/d6b/d26/d65/dae/ffb [388677,63061] 0 2024-04-26T10:44:33.474 INFO:tasks.workunit.client.0.smithi049.stdout:3/966: chown d3/d23/d2f/db8 2 1 2024-04-26T10:44:33.510 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:33.508+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:33.520 INFO:tasks.workunit.client.0.smithi049.stdout:3/967: sync 2024-04-26T10:44:33.520 INFO:tasks.workunit.client.0.smithi049.stdout:3/968: chown d3/d23/d2f/d6a/d6b/d26/l85 3919339 1 2024-04-26T10:44:33.520 INFO:tasks.workunit.client.0.smithi049.stdout:3/969: rename d3/d23/d2f/d6a/d6b/d26/d58/cbd to d3/d23/d2f/d6a/d6b/d8/d55/db4/dca/c131 0 2024-04-26T10:44:33.520 INFO:tasks.workunit.client.0.smithi049.stdout:3/970: creat d3/d23/d2f/d6a/d6b/d26/d65/d70/f132 x:0 0 0 2024-04-26T10:44:33.520 INFO:tasks.workunit.client.0.smithi049.stdout:3/971: truncate d3/d23/d2f/d6a/f7f 176901 0 2024-04-26T10:44:33.524 INFO:tasks.workunit.client.0.smithi049.stdout:3/972: dwrite d3/d23/d2f/ff1 [0,4194304] 0 2024-04-26T10:44:33.526 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:33.526 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:33.526 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:33.526 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:33.526 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:33.530 INFO:tasks.workunit.client.0.smithi049.stdout:3/973: dwrite d3/d23/d2f/d6a/d6b/d26/d65/fc5 [0,4194304] 0 2024-04-26T10:44:33.535 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:33.590 INFO:tasks.workunit.client.0.smithi049.stdout:3/974: sync 2024-04-26T10:44:33.590 INFO:tasks.workunit.client.0.smithi049.stdout:3/975: chown d3/d23/d2f/d6a/d6b/d8/d55/db4/dca 0 1 2024-04-26T10:44:33.591 INFO:tasks.workunit.client.0.smithi049.stdout:3/976: chown d3/d23/d2f/d6a/ld1 25051779 1 2024-04-26T10:44:33.591 INFO:tasks.workunit.client.0.smithi049.stdout:3/977: rmdir d3/d23/d2f/d6a/d6b/d8c/d10a 39 2024-04-26T10:44:33.593 INFO:tasks.workunit.client.0.smithi049.stdout:3/978: rename d3/d23/d2f/d6a/d6b/d8c/d10a/f11d to d3/d23/d2f/d6a/d6b/d26/d65/d70/d96/f133 0 2024-04-26T10:44:33.594 INFO:tasks.workunit.client.0.smithi049.stdout:3/979: mkdir d3/d23/d2f/d6a/d6b/d8/d55/db4/dca/d134 0 2024-04-26T10:44:33.595 INFO:tasks.workunit.client.0.smithi049.stdout:3/980: read d3/d23/d2f/d6a/d6b/d26/d65/dae/fd5 [35089,49274] 0 2024-04-26T10:44:33.595 INFO:tasks.workunit.client.0.smithi049.stdout:3/981: mkdir d3/d135 0 2024-04-26T10:44:33.596 INFO:tasks.workunit.client.0.smithi049.stdout:3/982: rename d3/d23/d2f/d6a/d6b/d8c/fc0 to d3/d23/d2f/d6a/d6b/d8/d55/d11a/f136 0 2024-04-26T10:44:33.598 INFO:tasks.workunit.client.0.smithi049.stdout:3/983: rename d3/d23/d2f/d6a/d6b/d26/d65/d70/d84/c111 to d3/d23/d2f/d6a/d6b/d8/d55/d2e/c137 0 2024-04-26T10:44:33.599 INFO:tasks.workunit.client.0.smithi049.stdout:3/984: rename d3/d23/d2f/d6a/d6b/d8/d55/l130 to d3/d23/d2f/d6a/d6b/d8/d55/d46/l138 0 2024-04-26T10:44:33.600 INFO:tasks.workunit.client.0.smithi049.stdout:3/985: rename d3/d23/d2f/d6a/d6b/l20 to d3/d23/d2f/d6a/d6b/d8/d55/db4/l139 0 2024-04-26T10:44:33.601 INFO:tasks.workunit.client.0.smithi049.stdout:3/986: write d3/d23/d2f/d6a/d6b/d8/d34/f64 [361193,125238] 0 2024-04-26T10:44:33.602 INFO:tasks.workunit.client.0.smithi049.stdout:3/987: creat d3/f13a x:0 0 0 2024-04-26T10:44:33.603 INFO:tasks.workunit.client.0.smithi049.stdout:3/988: rename d3/d23/d2f/d6a/d6b/d8/d55/df2/d103 to d3/d23/d2f/d6a/d6b/d8/d55/d46/d4e/d13b 0 2024-04-26T10:44:33.606 INFO:tasks.workunit.client.0.smithi049.stdout:3/989: truncate d3/d23/d2f/ff1 56832 0 2024-04-26T10:44:33.608 INFO:tasks.workunit.client.0.smithi049.stdout:3/990: dread d3/d23/d2f/d6a/d6b/d26/d58/fb0 [0,4194304] 0 2024-04-26T10:44:33.609 INFO:tasks.workunit.client.0.smithi049.stdout:3/991: write d3/d23/d2f/d6a/d6b/d26/d5f/f69 [1580447,95666] 0 2024-04-26T10:44:33.610 INFO:tasks.workunit.client.0.smithi049.stdout:3/992: unlink d3/d23/d2f/d6a/d6b/d8/d82/dff/ff8 0 2024-04-26T10:44:33.611 INFO:tasks.workunit.client.0.smithi049.stdout:3/993: symlink d3/d23/d2f/d6a/d6b/d26/d5f/d121/l13c 0 2024-04-26T10:44:33.612 INFO:tasks.workunit.client.0.smithi049.stdout:3/994: chown d3/d23/d2f/d6a/d6b/d8/d55/f98 15195093 1 2024-04-26T10:44:33.614 INFO:tasks.workunit.client.0.smithi049.stdout:3/995: dread d3/d23/d2f/d6a/d6b/d26/d65/dae/fd5 [0,4194304] 0 2024-04-26T10:44:33.615 INFO:tasks.workunit.client.0.smithi049.stdout:3/996: rename d3/d23/d2f/d6a/d6b/d26/d58/l97 to d3/d23/l13d 0 2024-04-26T10:44:33.616 INFO:tasks.workunit.client.0.smithi049.stdout:3/997: mkdir d3/d23/d2f/d6a/d6b/d26/d65/d70/d13e 0 2024-04-26T10:44:33.617 INFO:tasks.workunit.client.0.smithi049.stdout:3/998: write d3/d23/d2f/d6a/d6b/d8/f57 [1018022,28562] 0 2024-04-26T10:44:33.619 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:33.618+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:33.622 INFO:tasks.workunit.client.0.smithi049.stdout:3/999: dread d3/d23/d2f/d6a/d6b/d26/d58/f7b [0,4194304] 0 2024-04-26T10:44:33.626 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm -rf -- ./tmp.0weVHK2n7l 2024-04-26T10:44:33.684 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:33.684 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:33.684 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:33.684 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:33.684 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.684 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:330 3.13 3:ceffbd45:::200.0000000a:head [write 1316140~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:33.684 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:33.684 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 7.1684266570000004, 2024-04-26T10:44:33.684 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022245654, 2024-04-26T10:44:33.684 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:33.685 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:33.685 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:33.685 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.685 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:33.685 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:33.685 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.685 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.685 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.685 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:33.685 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:33.685 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.685 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.685 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.686 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:33.686 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513139+0000", 2024-04-26T10:44:33.686 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:33.686 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.686 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.686 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:33.686 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513149+0000", 2024-04-26T10:44:33.686 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7550000000000006e-06 2024-04-26T10:44:33.686 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.686 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.686 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:33.686 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513157+0000", 2024-04-26T10:44:33.687 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1089999999999998e-06 2024-04-26T10:44:33.687 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.687 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.687 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:33.687 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513167+0000", 2024-04-26T10:44:33.687 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0539e-05 2024-04-26T10:44:33.687 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.687 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.687 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:33.687 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533830+0000", 2024-04-26T10:44:33.687 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020662852999999998 2024-04-26T10:44:33.687 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.687 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.688 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:33.688 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533875+0000", 2024-04-26T10:44:33.688 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.5071999999999998e-05 2024-04-26T10:44:33.688 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.688 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.688 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:33.688 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535319+0000", 2024-04-26T10:44:33.688 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001443578 2024-04-26T10:44:33.688 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.688 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.688 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:33.688 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535346+0000", 2024-04-26T10:44:33.688 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7415000000000001e-05 2024-04-26T10:44:33.688 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.689 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.689 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:33.689 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535385+0000", 2024-04-26T10:44:33.689 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8912999999999998e-05 2024-04-26T10:44:33.689 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.689 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:33.689 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.689 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.689 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.689 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:331 3.13 3:ceffbd45:::200.0000000a:head [write 1318049~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:33.689 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:33.689 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 7.1683873289999998, 2024-04-26T10:44:33.689 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023524521, 2024-04-26T10:44:33.689 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:33.690 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:33.690 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:33.690 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.690 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:33.690 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:33.690 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.690 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.690 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.690 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:33.690 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:33.690 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.690 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.691 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.691 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:33.691 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513178+0000", 2024-04-26T10:44:33.691 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:33.691 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.691 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.691 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:33.691 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513183+0000", 2024-04-26T10:44:33.691 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2549999999999999e-06 2024-04-26T10:44:33.691 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.691 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.691 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:33.691 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513190+0000", 2024-04-26T10:44:33.691 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8460000000000002e-06 2024-04-26T10:44:33.691 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.692 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.692 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:33.692 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513195+0000", 2024-04-26T10:44:33.692 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3630000000000002e-06 2024-04-26T10:44:33.692 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.692 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.692 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:33.692 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534463+0000", 2024-04-26T10:44:33.692 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021267823000000002 2024-04-26T10:44:33.692 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.692 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.692 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:33.692 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534520+0000", 2024-04-26T10:44:33.692 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7510000000000003e-05 2024-04-26T10:44:33.692 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.693 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.693 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:33.693 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536634+0000", 2024-04-26T10:44:33.693 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0021138900000000002 2024-04-26T10:44:33.693 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.693 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.693 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:33.693 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536663+0000", 2024-04-26T10:44:33.693 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8884e-05 2024-04-26T10:44:33.693 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.693 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.693 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:33.693 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536703+0000", 2024-04-26T10:44:33.693 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0479000000000003e-05 2024-04-26T10:44:33.694 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.694 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:33.694 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.694 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.694 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.694 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:332 3.13 3:ceffbd45:::200.0000000a:head [write 1319462~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:33.694 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:33.694 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 7.1683524959999998, 2024-04-26T10:44:33.694 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024543230999999999, 2024-04-26T10:44:33.694 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:33.694 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:33.694 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:33.694 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.694 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:33.695 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:33.695 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.695 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.695 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.695 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:33.695 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:33.695 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.695 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.695 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.695 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:33.695 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513213+0000", 2024-04-26T10:44:33.695 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:33.696 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.696 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.696 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:33.696 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513217+0000", 2024-04-26T10:44:33.696 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:44:33.696 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.696 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.696 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:33.696 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513229+0000", 2024-04-26T10:44:33.696 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2051e-05 2024-04-26T10:44:33.696 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.696 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.696 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:33.697 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513236+0000", 2024-04-26T10:44:33.697 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4470000000000003e-06 2024-04-26T10:44:33.697 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.697 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.697 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:33.697 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534891+0000", 2024-04-26T10:44:33.697 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021655863000000001 2024-04-26T10:44:33.697 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.697 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.697 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:33.697 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534933+0000", 2024-04-26T10:44:33.697 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1596e-05 2024-04-26T10:44:33.697 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.698 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.698 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:33.698 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537677+0000", 2024-04-26T10:44:33.698 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027440989999999998 2024-04-26T10:44:33.698 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.698 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.698 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:33.698 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537721+0000", 2024-04-26T10:44:33.698 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3813999999999998e-05 2024-04-26T10:44:33.698 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.698 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.698 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:33.699 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537757+0000", 2024-04-26T10:44:33.699 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6022999999999997e-05 2024-04-26T10:44:33.699 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.699 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:33.699 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.699 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.699 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.699 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:333 3.13 3:ceffbd45:::200.0000000a:head [write 1320870~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:33.699 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:33.699 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 7.1683095769999996, 2024-04-26T10:44:33.699 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024557151999999999, 2024-04-26T10:44:33.699 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:33.699 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:33.700 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:33.700 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.700 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:33.700 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:33.700 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.700 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.700 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.700 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:33.700 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:33.700 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.700 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.700 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.700 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:33.701 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513256+0000", 2024-04-26T10:44:33.701 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:33.701 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.701 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.701 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:33.701 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513260+0000", 2024-04-26T10:44:33.701 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6550000000000002e-06 2024-04-26T10:44:33.701 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.701 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.701 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:33.701 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513273+0000", 2024-04-26T10:44:33.701 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2965e-05 2024-04-26T10:44:33.701 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.701 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.702 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:33.702 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513279+0000", 2024-04-26T10:44:33.702 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:44:33.702 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.702 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.702 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:33.702 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535411+0000", 2024-04-26T10:44:33.702 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022132233000000001 2024-04-26T10:44:33.702 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.702 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.702 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:33.702 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535479+0000", 2024-04-26T10:44:33.702 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7554999999999999e-05 2024-04-26T10:44:33.703 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.703 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.703 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:33.703 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537762+0000", 2024-04-26T10:44:33.703 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022836499999999999 2024-04-26T10:44:33.703 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.703 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.703 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:33.703 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537783+0000", 2024-04-26T10:44:33.703 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0364e-05 2024-04-26T10:44:33.703 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.703 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.703 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:33.703 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537814+0000", 2024-04-26T10:44:33.704 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1170000000000001e-05 2024-04-26T10:44:33.704 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.704 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:33.704 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.704 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.704 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.704 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:334 3.13 3:ceffbd45:::200.0000000a:head [write 1322273~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:33.704 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:33.704 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 7.1664728179999999, 2024-04-26T10:44:33.704 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022778731999999999, 2024-04-26T10:44:33.704 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:33.704 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:33.704 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:33.705 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.705 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:33.705 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:33.705 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.705 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.705 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.705 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:33.705 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:33.705 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.705 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.705 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.705 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:33.705 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:33.705 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:33.706 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.706 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.706 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:33.706 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515099+0000", 2024-04-26T10:44:33.706 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6599999999999998e-06 2024-04-26T10:44:33.706 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.706 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.706 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:33.706 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515112+0000", 2024-04-26T10:44:33.706 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2707e-05 2024-04-26T10:44:33.706 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.706 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.706 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:33.707 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515120+0000", 2024-04-26T10:44:33.707 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8509999999999999e-06 2024-04-26T10:44:33.707 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.707 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.707 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:33.707 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535792+0000", 2024-04-26T10:44:33.707 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020672209 2024-04-26T10:44:33.707 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.707 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.707 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:33.707 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535833+0000", 2024-04-26T10:44:33.707 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1415000000000002e-05 2024-04-26T10:44:33.707 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.707 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.708 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:33.708 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537818+0000", 2024-04-26T10:44:33.708 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0019850900000000001 2024-04-26T10:44:33.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.708 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.708 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:33.708 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537839+0000", 2024-04-26T10:44:33.708 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0068000000000002e-05 2024-04-26T10:44:33.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.708 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.708 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:33.708 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537872+0000", 2024-04-26T10:44:33.708 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3680999999999998e-05 2024-04-26T10:44:33.709 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.709 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:33.709 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.709 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.709 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.709 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:335 3.13 3:ceffbd45:::200.0000000a:head [write 1325230~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:33.709 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:33.709 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 7.1664337189999996, 2024-04-26T10:44:33.709 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023487081, 2024-04-26T10:44:33.709 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:33.709 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:33.710 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:33.710 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.710 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:33.710 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:33.710 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.710 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.710 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.710 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:33.710 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:33.710 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.710 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.711 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.711 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:33.711 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515132+0000", 2024-04-26T10:44:33.711 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:33.711 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.711 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.711 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:33.711 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515136+0000", 2024-04-26T10:44:33.711 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0860000000000004e-06 2024-04-26T10:44:33.711 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.711 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.711 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:33.711 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515143+0000", 2024-04-26T10:44:33.711 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.0400000000000004e-06 2024-04-26T10:44:33.712 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.712 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.712 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:33.712 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515149+0000", 2024-04-26T10:44:33.712 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0789999999999997e-06 2024-04-26T10:44:33.712 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.712 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.712 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:33.712 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536200+0000", 2024-04-26T10:44:33.712 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021050993 2024-04-26T10:44:33.712 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.712 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.712 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:33.713 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536253+0000", 2024-04-26T10:44:33.713 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.2643999999999999e-05 2024-04-26T10:44:33.713 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.713 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.713 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:33.713 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538560+0000", 2024-04-26T10:44:33.713 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0023073389999999998 2024-04-26T10:44:33.713 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.713 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.713 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:33.713 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538584+0000", 2024-04-26T10:44:33.713 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3893999999999999e-05 2024-04-26T10:44:33.714 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.714 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.714 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:33.714 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538620+0000", 2024-04-26T10:44:33.714 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5611000000000002e-05 2024-04-26T10:44:33.714 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.714 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:33.714 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.714 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.714 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.714 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:336 3.13 3:ceffbd45:::200.0000000a:head [write 1327147~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:33.714 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:33.715 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 7.1651012639999996, 2024-04-26T10:44:33.715 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027687066, 2024-04-26T10:44:33.715 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:33.715 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:33.715 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:33.715 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.715 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:33.715 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:33.715 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.715 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.715 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.715 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:33.715 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:33.716 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.716 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.716 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.716 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:33.716 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516464+0000", 2024-04-26T10:44:33.716 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:33.716 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.716 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.716 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:33.716 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516491+0000", 2024-04-26T10:44:33.716 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6539000000000001e-05 2024-04-26T10:44:33.716 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.716 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.717 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:33.717 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516500+0000", 2024-04-26T10:44:33.717 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5480000000000007e-06 2024-04-26T10:44:33.717 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.717 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.717 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:33.717 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516511+0000", 2024-04-26T10:44:33.717 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0719e-05 2024-04-26T10:44:33.717 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.717 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.717 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:33.717 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536737+0000", 2024-04-26T10:44:33.717 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020225770000000001 2024-04-26T10:44:33.718 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.718 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.718 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:33.718 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536783+0000", 2024-04-26T10:44:33.718 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6168999999999998e-05 2024-04-26T10:44:33.718 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.718 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.718 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:33.718 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544080+0000", 2024-04-26T10:44:33.718 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0072966799999999998 2024-04-26T10:44:33.718 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.718 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.718 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:33.719 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544111+0000", 2024-04-26T10:44:33.719 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1056999999999998e-05 2024-04-26T10:44:33.719 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.719 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.719 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:33.719 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544152+0000", 2024-04-26T10:44:33.719 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1452000000000002e-05 2024-04-26T10:44:33.719 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.719 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:33.719 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.719 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.719 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.720 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:337 3.13 3:ceffbd45:::200.0000000a:head [write 1342136~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:33.720 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:33.720 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 7.165048326, 2024-04-26T10:44:33.720 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027711237, 2024-04-26T10:44:33.720 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:33.720 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:33.720 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:33.720 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.720 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:33.720 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:33.720 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.720 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.720 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.721 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:33.721 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:33.721 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.721 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.721 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.721 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:33.721 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516517+0000", 2024-04-26T10:44:33.721 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:33.721 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.721 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.721 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:33.721 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516521+0000", 2024-04-26T10:44:33.722 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6200000000000001e-06 2024-04-26T10:44:33.722 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.722 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.722 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:33.722 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516528+0000", 2024-04-26T10:44:33.722 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8639999999999998e-06 2024-04-26T10:44:33.722 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.722 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.722 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:33.722 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516533+0000", 2024-04-26T10:44:33.722 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6310000000000002e-06 2024-04-26T10:44:33.722 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.722 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.722 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:33.723 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537231+0000", 2024-04-26T10:44:33.723 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020698613000000001 2024-04-26T10:44:33.723 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.723 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.723 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:33.723 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537273+0000", 2024-04-26T10:44:33.723 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1529000000000002e-05 2024-04-26T10:44:33.723 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.723 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.723 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:33.723 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544157+0000", 2024-04-26T10:44:33.723 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068847090000000001 2024-04-26T10:44:33.723 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.724 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.724 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:33.724 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544180+0000", 2024-04-26T10:44:33.724 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.2532e-05 2024-04-26T10:44:33.724 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.724 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.724 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:33.724 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544229+0000", 2024-04-26T10:44:33.724 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9190000000000002e-05 2024-04-26T10:44:33.724 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.724 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:33.724 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.724 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.725 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.725 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:338 3.13 3:ceffbd45:::200.0000000a:head [write 1344569~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:33.725 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:33.725 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 7.1643820729999996, 2024-04-26T10:44:33.725 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027105598000000002, 2024-04-26T10:44:33.725 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:33.725 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:33.725 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:33.725 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.725 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:33.725 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:33.725 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.725 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.725 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.725 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:33.726 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:33.726 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.726 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.726 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.726 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:33.726 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517183+0000", 2024-04-26T10:44:33.726 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:33.726 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.726 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.726 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:33.726 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517188+0000", 2024-04-26T10:44:33.726 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7389999999999999e-06 2024-04-26T10:44:33.727 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.727 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.727 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:33.727 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517199+0000", 2024-04-26T10:44:33.727 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0652000000000001e-05 2024-04-26T10:44:33.727 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.727 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.727 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:33.727 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517206+0000", 2024-04-26T10:44:33.727 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6610000000000003e-06 2024-04-26T10:44:33.727 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.727 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.727 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:33.727 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537905+0000", 2024-04-26T10:44:33.728 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020699662000000001 2024-04-26T10:44:33.728 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.728 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.728 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:33.728 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537956+0000", 2024-04-26T10:44:33.728 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0954e-05 2024-04-26T10:44:33.728 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.728 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.728 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:33.728 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544233+0000", 2024-04-26T10:44:33.728 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062773009999999999 2024-04-26T10:44:33.728 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.728 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.728 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:33.729 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544258+0000", 2024-04-26T10:44:33.729 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4434999999999999e-05 2024-04-26T10:44:33.729 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.729 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.729 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:33.729 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544290+0000", 2024-04-26T10:44:33.729 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1918000000000002e-05 2024-04-26T10:44:33.729 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.729 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:33.729 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.729 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.729 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.730 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:339 3.13 3:ceffbd45:::200.0000000a:head [write 1346485~4322 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:33.730 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:33.730 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 7.16344358, 2024-04-26T10:44:33.730 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026221617999999999, 2024-04-26T10:44:33.730 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:33.730 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:33.730 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:33.730 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.730 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:33.730 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:33.730 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.730 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.731 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.731 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:33.731 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:33.731 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.731 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.731 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.731 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:33.731 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518122+0000", 2024-04-26T10:44:33.731 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:33.731 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.731 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.731 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:33.731 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518129+0000", 2024-04-26T10:44:33.732 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.43e-06 2024-04-26T10:44:33.732 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.732 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.732 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:33.732 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518138+0000", 2024-04-26T10:44:33.732 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9129999999999992e-06 2024-04-26T10:44:33.732 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.732 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.732 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:33.732 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518144+0000", 2024-04-26T10:44:33.732 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.1419999999999998e-06 2024-04-26T10:44:33.732 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.732 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.733 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:33.733 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538232+0000", 2024-04-26T10:44:33.733 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020087383 2024-04-26T10:44:33.733 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.733 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.733 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:33.733 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538274+0000", 2024-04-26T10:44:33.733 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2602999999999999e-05 2024-04-26T10:44:33.733 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.733 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.733 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:33.733 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544294+0000", 2024-04-26T10:44:33.733 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060194059999999997 2024-04-26T10:44:33.733 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.734 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.734 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:33.734 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544314+0000", 2024-04-26T10:44:33.734 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0091000000000001e-05 2024-04-26T10:44:33.734 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.734 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.734 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:33.734 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544344+0000", 2024-04-26T10:44:33.734 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0446e-05 2024-04-26T10:44:33.734 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.734 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:33.734 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.734 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.735 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.735 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:340 3.13 3:ceffbd45:::200.0000000a:head [write 1350807~2768 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:33.735 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:33.735 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 7.1609593440000001, 2024-04-26T10:44:33.735 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023795594, 2024-04-26T10:44:33.735 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:33.735 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:33.735 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:33.735 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.735 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:33.735 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:33.735 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.735 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.735 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.735 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:33.736 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:33.736 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.736 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.736 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.736 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:33.736 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520606+0000", 2024-04-26T10:44:33.736 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:33.736 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.736 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.736 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:33.736 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520612+0000", 2024-04-26T10:44:33.736 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.835e-06 2024-04-26T10:44:33.736 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.736 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.737 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:33.737 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520622+0000", 2024-04-26T10:44:33.737 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0173999999999999e-05 2024-04-26T10:44:33.737 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.737 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.737 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:33.737 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520629+0000", 2024-04-26T10:44:33.737 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7460000000000003e-06 2024-04-26T10:44:33.737 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.737 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.737 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:33.737 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538651+0000", 2024-04-26T10:44:33.737 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018022474 2024-04-26T10:44:33.738 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.738 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.738 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:33.738 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538697+0000", 2024-04-26T10:44:33.738 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6183999999999997e-05 2024-04-26T10:44:33.738 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.738 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.738 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:33.738 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544348+0000", 2024-04-26T10:44:33.738 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0056503509999999996 2024-04-26T10:44:33.738 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.738 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.738 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:33.738 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544369+0000", 2024-04-26T10:44:33.739 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1064999999999999e-05 2024-04-26T10:44:33.739 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.739 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.739 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:33.739 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544403+0000", 2024-04-26T10:44:33.739 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3695000000000002e-05 2024-04-26T10:44:33.739 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.739 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:33.739 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.739 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.739 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.739 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:341 3.13 3:ceffbd45:::200.0000000a:head [write 1353575~3816 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:33.739 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:33.740 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 7.1602240889999997, 2024-04-26T10:44:33.740 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023114967, 2024-04-26T10:44:33.740 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:33.740 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:33.740 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:33.740 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.740 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:33.740 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:33.740 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.740 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.740 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.740 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:33.740 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:33.741 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.741 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.741 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.741 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:33.741 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521341+0000", 2024-04-26T10:44:33.741 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:33.741 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.741 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.741 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:33.741 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521349+0000", 2024-04-26T10:44:33.741 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1550000000000001e-06 2024-04-26T10:44:33.741 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.741 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.741 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:33.742 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521358+0000", 2024-04-26T10:44:33.742 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.1500000000000005e-06 2024-04-26T10:44:33.742 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.742 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.742 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:33.742 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521364+0000", 2024-04-26T10:44:33.742 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3289999999999999e-06 2024-04-26T10:44:33.742 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.742 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.742 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:33.742 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539010+0000", 2024-04-26T10:44:33.742 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.017645965999999999 2024-04-26T10:44:33.742 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.743 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.743 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:33.743 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539051+0000", 2024-04-26T10:44:33.743 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.053e-05 2024-04-26T10:44:33.743 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.743 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.743 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:33.743 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544407+0000", 2024-04-26T10:44:33.743 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053560209999999999 2024-04-26T10:44:33.743 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.743 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.743 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:33.743 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544427+0000", 2024-04-26T10:44:33.743 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0228e-05 2024-04-26T10:44:33.744 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.744 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.744 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:33.744 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544457+0000", 2024-04-26T10:44:33.744 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0375e-05 2024-04-26T10:44:33.744 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.744 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:33.744 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.744 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.744 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.744 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11582 4.2f 4:f76ba295:::10000003252.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:33.744 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:33.745 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 4.6866085440000003, 2024-04-26T10:44:33.745 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024553994999999999, 2024-04-26T10:44:33.745 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:33.745 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:33.745 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:33.745 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:33.745 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:33.745 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11582 2024-04-26T10:44:33.745 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.745 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:33.745 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.745 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:33.745 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:33.746 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.746 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.746 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.746 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:33.746 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:33.746 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.746 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.746 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.746 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:33.746 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994957+0000", 2024-04-26T10:44:33.746 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:33.746 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.746 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.747 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:33.747 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002755+0000", 2024-04-26T10:44:33.747 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0077984719999999999 2024-04-26T10:44:33.747 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.747 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.747 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:33.747 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002770+0000", 2024-04-26T10:44:33.747 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4956e-05 2024-04-26T10:44:33.747 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.747 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.747 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:33.747 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002777+0000", 2024-04-26T10:44:33.747 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1899999999999998e-06 2024-04-26T10:44:33.748 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.748 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.748 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:33.748 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002833+0000", 2024-04-26T10:44:33.748 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5189999999999998e-05 2024-04-26T10:44:33.748 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.748 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.748 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:33.748 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002977+0000", 2024-04-26T10:44:33.748 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014444100000000001 2024-04-26T10:44:33.748 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.748 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.748 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:33.748 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.003108+0000", 2024-04-26T10:44:33.749 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000131068 2024-04-26T10:44:33.749 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.749 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.749 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:33.749 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.009040+0000", 2024-04-26T10:44:33.749 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059314149999999998 2024-04-26T10:44:33.749 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.749 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.749 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:33.749 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019462+0000", 2024-04-26T10:44:33.749 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010422803 2024-04-26T10:44:33.749 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.749 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.750 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:33.750 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019490+0000", 2024-04-26T10:44:33.750 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7773999999999999e-05 2024-04-26T10:44:33.750 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.750 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.750 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:33.750 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019512+0000", 2024-04-26T10:44:33.750 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1611999999999999e-05 2024-04-26T10:44:33.750 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.750 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:33.750 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.750 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.750 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.750 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11911 4.37 4:ec04ab04:::100000031ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:33.751 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:33.751 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 4.3448883370000004, 2024-04-26T10:44:33.751 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026810273999999999, 2024-04-26T10:44:33.751 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:33.751 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:33.751 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:33.751 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:33.751 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:33.751 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11911 2024-04-26T10:44:33.751 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.751 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:33.751 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.752 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:33.752 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:33.752 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.752 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.752 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.752 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:33.752 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:33.752 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.752 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.752 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.752 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:33.752 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336676+0000", 2024-04-26T10:44:33.753 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:33.753 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.753 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.753 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:33.753 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343119+0000", 2024-04-26T10:44:33.753 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0064424850000000004 2024-04-26T10:44:33.753 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.753 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.753 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:33.753 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343131+0000", 2024-04-26T10:44:33.753 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1708e-05 2024-04-26T10:44:33.753 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.753 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.754 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:33.754 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343137+0000", 2024-04-26T10:44:33.754 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9880000000000001e-06 2024-04-26T10:44:33.754 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.754 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.754 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:33.754 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343175+0000", 2024-04-26T10:44:33.754 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7913000000000001e-05 2024-04-26T10:44:33.754 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.754 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.754 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:33.754 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343269+0000", 2024-04-26T10:44:33.754 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4931000000000003e-05 2024-04-26T10:44:33.754 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.755 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.755 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:33.755 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343392+0000", 2024-04-26T10:44:33.755 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000122435 2024-04-26T10:44:33.755 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.755 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.755 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:33.755 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.347520+0000", 2024-04-26T10:44:33.755 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004128418 2024-04-26T10:44:33.755 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.755 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.755 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:33.756 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363410+0000", 2024-04-26T10:44:33.756 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.015889309000000001 2024-04-26T10:44:33.756 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.756 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.756 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:33.756 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363453+0000", 2024-04-26T10:44:33.756 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3244000000000001e-05 2024-04-26T10:44:33.756 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.756 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.756 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:33.756 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363488+0000", 2024-04-26T10:44:33.756 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5318000000000003e-05 2024-04-26T10:44:33.756 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.756 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:33.757 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.757 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.757 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.757 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12000 4.3c 4:3c2be35d:::100000030f7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:33.757 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:33.757 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 4.2622668250000002, 2024-04-26T10:44:33.757 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022808264000000002, 2024-04-26T10:44:33.757 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:33.757 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:33.757 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:33.757 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:33.757 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:33.757 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12000 2024-04-26T10:44:33.757 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.758 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:33.758 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.758 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:33.758 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:33.758 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.758 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.758 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.758 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:33.758 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:33.758 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.758 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.758 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.759 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:33.759 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:33.759 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:33.759 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.759 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.759 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:33.759 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430937+0000", 2024-04-26T10:44:33.759 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.011638097 2024-04-26T10:44:33.759 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.759 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.759 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:33.759 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430948+0000", 2024-04-26T10:44:33.759 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0824e-05 2024-04-26T10:44:33.760 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.760 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.760 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:33.760 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430953+0000", 2024-04-26T10:44:33.760 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5219999999999998e-06 2024-04-26T10:44:33.760 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.760 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.760 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:33.760 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430990+0000", 2024-04-26T10:44:33.760 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6458999999999998e-05 2024-04-26T10:44:33.760 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.760 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.760 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:33.761 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.431052+0000", 2024-04-26T10:44:33.761 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2687000000000005e-05 2024-04-26T10:44:33.761 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.761 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.761 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:33.761 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442027+0000", 2024-04-26T10:44:33.761 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010974513 2024-04-26T10:44:33.761 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.761 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.761 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:33.761 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442060+0000", 2024-04-26T10:44:33.761 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2849999999999999e-05 2024-04-26T10:44:33.761 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.761 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.762 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:33.762 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442108+0000", 2024-04-26T10:44:33.762 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8031999999999997e-05 2024-04-26T10:44:33.762 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.762 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:33.762 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.762 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.762 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.762 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12042 4.2f 4:f741970f:::10000003414.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:33.762 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:33.762 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 4.2230133480000003, 2024-04-26T10:44:33.762 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.029390757, 2024-04-26T10:44:33.762 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:33.763 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:33.763 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:33.763 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:33.763 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:33.763 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12042 2024-04-26T10:44:33.763 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.763 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:33.763 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.763 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:33.763 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:33.763 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.763 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.763 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.763 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:33.763 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:33.764 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.764 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.764 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.764 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:33.764 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458552+0000", 2024-04-26T10:44:33.764 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:33.764 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.764 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.764 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:33.764 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464335+0000", 2024-04-26T10:44:33.764 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.005783168 2024-04-26T10:44:33.764 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.764 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.764 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:33.765 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464347+0000", 2024-04-26T10:44:33.765 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1578e-05 2024-04-26T10:44:33.765 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.765 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.765 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:33.765 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464353+0000", 2024-04-26T10:44:33.765 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3709999999999996e-06 2024-04-26T10:44:33.765 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.765 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.765 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:33.765 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464407+0000", 2024-04-26T10:44:33.765 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3717000000000001e-05 2024-04-26T10:44:33.766 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.766 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.766 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:33.766 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464556+0000", 2024-04-26T10:44:33.766 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014899100000000001 2024-04-26T10:44:33.766 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.766 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.766 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:33.766 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464688+0000", 2024-04-26T10:44:33.766 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013238599999999999 2024-04-26T10:44:33.766 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.766 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.767 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:33.767 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.469725+0000", 2024-04-26T10:44:33.767 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0050369229999999996 2024-04-26T10:44:33.767 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.767 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.767 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:33.767 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487892+0000", 2024-04-26T10:44:33.767 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018167184999999999 2024-04-26T10:44:33.767 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.767 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.767 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:33.767 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487922+0000", 2024-04-26T10:44:33.767 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.9495000000000001e-05 2024-04-26T10:44:33.768 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.768 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.768 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:33.768 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487944+0000", 2024-04-26T10:44:33.768 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1823000000000001e-05 2024-04-26T10:44:33.768 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.768 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:33.768 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.768 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.768 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.768 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12050 4.2c 4:36b72e58:::100000031ba.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:33.768 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:33.768 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 4.2144727389999996, 2024-04-26T10:44:33.768 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022722497000000001, 2024-04-26T10:44:33.769 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:33.769 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:33.769 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:33.769 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:33.769 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:33.769 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12050 2024-04-26T10:44:33.769 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.769 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:33.769 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.769 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:33.769 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:33.769 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.769 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.769 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.770 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:33.770 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:33.770 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.770 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.770 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.770 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:33.770 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467093+0000", 2024-04-26T10:44:33.770 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:33.770 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.770 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.770 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:33.770 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476305+0000", 2024-04-26T10:44:33.770 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092125850000000006 2024-04-26T10:44:33.770 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.771 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.771 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:33.771 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476322+0000", 2024-04-26T10:44:33.771 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6860000000000001e-05 2024-04-26T10:44:33.771 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.771 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.771 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:33.771 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476328+0000", 2024-04-26T10:44:33.771 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.587e-06 2024-04-26T10:44:33.771 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.771 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.771 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:33.771 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476378+0000", 2024-04-26T10:44:33.771 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0519999999999997e-05 2024-04-26T10:44:33.772 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.772 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.772 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:33.772 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476474+0000", 2024-04-26T10:44:33.772 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5556000000000005e-05 2024-04-26T10:44:33.772 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.772 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.772 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:33.772 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489677+0000", 2024-04-26T10:44:33.772 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013203048 2024-04-26T10:44:33.772 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.772 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.772 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:33.772 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489722+0000", 2024-04-26T10:44:33.773 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4650000000000001e-05 2024-04-26T10:44:33.773 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.773 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.773 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:33.773 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489816+0000", 2024-04-26T10:44:33.773 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4402999999999997e-05 2024-04-26T10:44:33.773 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.773 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:33.773 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.773 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.773 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.773 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12516 4.37 4:ed0cb515:::10000003324.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:33.773 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:33.773 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 3.6943911740000002, 2024-04-26T10:44:33.774 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.030139677, 2024-04-26T10:44:33.774 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:33.774 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:33.774 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:33.774 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:33.774 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:33.774 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12516 2024-04-26T10:44:33.774 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.774 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:33.774 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.774 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:33.774 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:33.774 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.774 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.775 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.775 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:33.775 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:33.775 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.775 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.775 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.775 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:33.775 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987173+0000", 2024-04-26T10:44:33.775 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:33.775 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.775 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.775 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:33.775 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991339+0000", 2024-04-26T10:44:33.775 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0041663760000000003 2024-04-26T10:44:33.776 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.776 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.776 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:33.776 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991351+0000", 2024-04-26T10:44:33.776 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1333e-05 2024-04-26T10:44:33.776 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.776 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.776 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:33.776 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991357+0000", 2024-04-26T10:44:33.776 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3350000000000003e-06 2024-04-26T10:44:33.776 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.776 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.776 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:33.776 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991394+0000", 2024-04-26T10:44:33.777 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7054000000000001e-05 2024-04-26T10:44:33.777 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.777 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.777 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:33.777 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991495+0000", 2024-04-26T10:44:33.777 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000100386 2024-04-26T10:44:33.777 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.777 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.777 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:33.777 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991579+0000", 2024-04-26T10:44:33.777 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4295000000000005e-05 2024-04-26T10:44:33.777 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.777 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.778 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:33.778 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.996238+0000", 2024-04-26T10:44:33.778 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0046589309999999998 2024-04-26T10:44:33.778 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.778 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.778 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:33.778 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017237+0000", 2024-04-26T10:44:33.778 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020998993000000001 2024-04-26T10:44:33.778 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.778 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.778 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:33.778 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017280+0000", 2024-04-26T10:44:33.778 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3600000000000003e-05 2024-04-26T10:44:33.778 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.779 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.779 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:33.779 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017315+0000", 2024-04-26T10:44:33.779 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4381999999999997e-05 2024-04-26T10:44:33.779 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.779 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:33.779 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.779 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.779 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.779 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12644 4.37 4:ec5044d7:::100000032d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:33.779 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:33.779 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 3.5207183459999998, 2024-04-26T10:44:33.779 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.037018677, 2024-04-26T10:44:33.779 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:33.780 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:33.780 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:33.780 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:33.780 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:33.780 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12644 2024-04-26T10:44:33.780 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.780 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:33.780 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.780 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:33.780 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:33.780 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.780 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.780 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.780 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:33.781 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:33.781 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.781 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.781 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.781 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:33.781 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160847+0000", 2024-04-26T10:44:33.781 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:33.781 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.781 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.781 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:33.781 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170089+0000", 2024-04-26T10:44:33.781 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092424289999999999 2024-04-26T10:44:33.781 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.782 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.782 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:33.782 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170111+0000", 2024-04-26T10:44:33.782 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1733e-05 2024-04-26T10:44:33.782 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.782 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.782 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:33.782 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170124+0000", 2024-04-26T10:44:33.782 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.272e-05 2024-04-26T10:44:33.782 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.782 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.782 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:33.782 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170177+0000", 2024-04-26T10:44:33.783 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3745000000000001e-05 2024-04-26T10:44:33.783 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.783 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.783 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:33.783 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170350+0000", 2024-04-26T10:44:33.783 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017297699999999999 2024-04-26T10:44:33.783 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.783 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.783 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:33.783 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170458+0000", 2024-04-26T10:44:33.783 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000107583 2024-04-26T10:44:33.783 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.783 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.783 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:33.783 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.176693+0000", 2024-04-26T10:44:33.784 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062351799999999999 2024-04-26T10:44:33.784 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.784 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.784 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:33.784 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197774+0000", 2024-04-26T10:44:33.784 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021080471999999999 2024-04-26T10:44:33.784 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.784 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.784 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:33.784 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197824+0000", 2024-04-26T10:44:33.784 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0096000000000003e-05 2024-04-26T10:44:33.784 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.784 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.784 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:33.784 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197867+0000", 2024-04-26T10:44:33.785 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2882e-05 2024-04-26T10:44:33.785 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.785 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:33.785 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.785 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.785 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.785 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:13242 4.2f 4:f5e54bb5:::100000033c8.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:33.785 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:33.785 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 2.8424872080000001, 2024-04-26T10:44:33.785 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023873062, 2024-04-26T10:44:33.785 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:33.785 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:33.786 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:33.786 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:33.786 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:33.786 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 13242 2024-04-26T10:44:33.786 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.786 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:33.786 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.786 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:33.786 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:33.786 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.786 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.786 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.786 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:33.786 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:33.787 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:33.787 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.787 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.787 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:33.787 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839078+0000", 2024-04-26T10:44:33.787 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:33.787 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.787 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.787 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:33.787 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848098+0000", 2024-04-26T10:44:33.787 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090200750000000007 2024-04-26T10:44:33.787 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.787 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.787 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:33.787 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848108+0000", 2024-04-26T10:44:33.788 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.062e-05 2024-04-26T10:44:33.788 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.788 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.788 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:33.788 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848115+0000", 2024-04-26T10:44:33.788 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3040000000000001e-06 2024-04-26T10:44:33.788 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.788 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.788 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:33.788 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848157+0000", 2024-04-26T10:44:33.788 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2533000000000001e-05 2024-04-26T10:44:33.788 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.788 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.788 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:33.789 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848252+0000", 2024-04-26T10:44:33.789 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4480000000000003e-05 2024-04-26T10:44:33.789 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.789 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.789 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:33.789 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848393+0000", 2024-04-26T10:44:33.789 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000140863 2024-04-26T10:44:33.789 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.789 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.789 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:33.789 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.854434+0000", 2024-04-26T10:44:33.789 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060415590000000002 2024-04-26T10:44:33.789 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.789 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.790 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:33.790 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862894+0000", 2024-04-26T10:44:33.790 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0084598869999999993 2024-04-26T10:44:33.790 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.790 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.790 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:33.790 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862926+0000", 2024-04-26T10:44:33.790 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1473999999999997e-05 2024-04-26T10:44:33.790 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:33.790 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:33.790 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:33.790 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862952+0000", 2024-04-26T10:44:33.791 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6545000000000001e-05 2024-04-26T10:44:33.791 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.791 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:33.791 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.791 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:33.791 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:33.791 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:33.793 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:33.793 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:33.790+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:33.894 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:33.892+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:33.904 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:33.904 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:33.904 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:44:33.904 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:33.913 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:33.995 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:33.993+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:34.062 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:34.062 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:34.062 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:34.062 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:34.062 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:34.071 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:34.095 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:34.094+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:34.190 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:34.190 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:34.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:34.191 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:34.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.191 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:80 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:34.191 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:34.191 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 12.665817678, 2024-04-26T10:44:34.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029259192, 2024-04-26T10:44:34.191 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:34.191 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.191 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:34.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:34.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:34.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.192 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:34.192 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:34.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.192 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:34.192 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522252+0000", 2024-04-26T10:44:34.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:34.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.193 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:34.193 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523121+0000", 2024-04-26T10:44:34.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00086885100000000002 2024-04-26T10:44:34.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.193 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:34.193 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523133+0000", 2024-04-26T10:44:34.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2109999999999999e-05 2024-04-26T10:44:34.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.193 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.193 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523139+0000", 2024-04-26T10:44:34.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.541e-06 2024-04-26T10:44:34.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.194 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:34.194 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523176+0000", 2024-04-26T10:44:34.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6847999999999997e-05 2024-04-26T10:44:34.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.195 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:34.195 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523240+0000", 2024-04-26T10:44:34.195 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3941000000000003e-05 2024-04-26T10:44:34.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.195 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:34.195 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.536390+0000", 2024-04-26T10:44:34.195 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013150811 2024-04-26T10:44:34.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.195 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.195 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551071+0000", 2024-04-26T10:44:34.196 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014680021 2024-04-26T10:44:34.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:34.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551428+0000", 2024-04-26T10:44:34.196 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00035703900000000002 2024-04-26T10:44:34.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:34.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551462+0000", 2024-04-26T10:44:34.196 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4337e-05 2024-04-26T10:44:34.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:34.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551513+0000", 2024-04-26T10:44:34.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0875000000000003e-05 2024-04-26T10:44:34.197 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.197 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:34.197 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.197 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:129 3.1a 3:5e41ab69:::200.00000005:head [write 3557843~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:34.197 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:34.197 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 12.661759608000001, 2024-04-26T10:44:34.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029108253000000001, 2024-04-26T10:44:34.197 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:34.197 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.197 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:34.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.198 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:34.198 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:34.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.198 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:34.198 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:34.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.198 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:34.198 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526311+0000", 2024-04-26T10:44:34.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:34.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:34.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526315+0000", 2024-04-26T10:44:34.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4809999999999998e-06 2024-04-26T10:44:34.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:34.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526319+0000", 2024-04-26T10:44:34.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0690000000000003e-06 2024-04-26T10:44:34.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526321+0000", 2024-04-26T10:44:34.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4880000000000001e-06 2024-04-26T10:44:34.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:34.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553856+0000", 2024-04-26T10:44:34.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027534916 2024-04-26T10:44:34.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:34.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553900+0000", 2024-04-26T10:44:34.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3954e-05 2024-04-26T10:44:34.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:34.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553962+0000", 2024-04-26T10:44:34.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1519000000000005e-05 2024-04-26T10:44:34.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:34.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555348+0000", 2024-04-26T10:44:34.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013864579999999999 2024-04-26T10:44:34.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555378+0000", 2024-04-26T10:44:34.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9441000000000002e-05 2024-04-26T10:44:34.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.202 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:34.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555401+0000", 2024-04-26T10:44:34.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2815000000000001e-05 2024-04-26T10:44:34.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.202 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:34.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555420+0000", 2024-04-26T10:44:34.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9341e-05 2024-04-26T10:44:34.203 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.203 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:34.203 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.203 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:130 3.1a 3:5e41ab69:::200.00000005:head [write 3559243~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:34.203 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:34.203 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 12.661747773, 2024-04-26T10:44:34.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029188316999999998, 2024-04-26T10:44:34.203 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:34.203 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.203 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:34.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:34.204 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:34.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:34.204 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:34.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.205 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:34.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:34.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:34.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.205 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:34.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526325+0000", 2024-04-26T10:44:34.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4899999999999999e-06 2024-04-26T10:44:34.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:34.206 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526327+0000", 2024-04-26T10:44:34.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.745e-06 2024-04-26T10:44:34.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.206 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526330+0000", 2024-04-26T10:44:34.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5620000000000002e-06 2024-04-26T10:44:34.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:34.206 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554200+0000", 2024-04-26T10:44:34.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027869541000000001 2024-04-26T10:44:34.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:34.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554244+0000", 2024-04-26T10:44:34.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4464e-05 2024-04-26T10:44:34.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:34.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554304+0000", 2024-04-26T10:44:34.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9457999999999999e-05 2024-04-26T10:44:34.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555453+0000", 2024-04-26T10:44:34.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011494000000000001 2024-04-26T10:44:34.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:34.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555457+0000", 2024-04-26T10:44:34.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1779999999999996e-06 2024-04-26T10:44:34.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:34.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555480+0000", 2024-04-26T10:44:34.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2802e-05 2024-04-26T10:44:34.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.209 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:34.209 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555512+0000", 2024-04-26T10:44:34.209 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1885999999999999e-05 2024-04-26T10:44:34.209 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.209 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:34.209 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.209 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:131 3.1a 3:5e41ab69:::200.00000005:head [write 3560642~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:34.209 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:34.209 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 12.661739193000001, 2024-04-26T10:44:34.209 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029683102999999999, 2024-04-26T10:44:34.209 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:34.209 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.210 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:34.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.210 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:34.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:34.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.210 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:34.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:34.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.210 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:34.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:34.211 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:34.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.211 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:34.211 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526336+0000", 2024-04-26T10:44:34.211 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.681e-06 2024-04-26T10:44:34.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.211 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:34.211 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526338+0000", 2024-04-26T10:44:34.211 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8430000000000001e-06 2024-04-26T10:44:34.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.211 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526341+0000", 2024-04-26T10:44:34.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6180000000000002e-06 2024-04-26T10:44:34.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:34.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554745+0000", 2024-04-26T10:44:34.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028404088000000001 2024-04-26T10:44:34.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:34.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554788+0000", 2024-04-26T10:44:34.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2738999999999999e-05 2024-04-26T10:44:34.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.213 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:34.213 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554849+0000", 2024-04-26T10:44:34.213 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1362e-05 2024-04-26T10:44:34.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.213 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.213 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555963+0000", 2024-04-26T10:44:34.213 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001113597 2024-04-26T10:44:34.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.213 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:34.213 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555969+0000", 2024-04-26T10:44:34.213 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6900000000000003e-06 2024-04-26T10:44:34.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.214 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:34.214 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555995+0000", 2024-04-26T10:44:34.214 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5165999999999999e-05 2024-04-26T10:44:34.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.214 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:34.214 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556015+0000", 2024-04-26T10:44:34.214 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0522000000000001e-05 2024-04-26T10:44:34.214 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.214 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:34.214 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.215 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:132 3.1a 3:5e41ab69:::200.00000005:head [write 3562043~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:34.215 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:34.215 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 12.661718927999999, 2024-04-26T10:44:34.215 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030129895, 2024-04-26T10:44:34.215 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:34.215 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.215 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:34.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.215 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:34.215 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:34.215 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.215 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:34.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:34.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.216 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:34.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:34.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:34.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.216 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:34.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526354+0000", 2024-04-26T10:44:34.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8560000000000001e-06 2024-04-26T10:44:34.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.217 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:34.217 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526359+0000", 2024-04-26T10:44:34.217 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4700000000000001e-06 2024-04-26T10:44:34.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.217 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.217 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526365+0000", 2024-04-26T10:44:34.217 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2120000000000002e-06 2024-04-26T10:44:34.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.217 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:34.217 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555050+0000", 2024-04-26T10:44:34.217 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028685458 2024-04-26T10:44:34.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.218 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:34.218 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555093+0000", 2024-04-26T10:44:34.218 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3307999999999999e-05 2024-04-26T10:44:34.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.218 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:34.218 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555156+0000", 2024-04-26T10:44:34.218 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2396000000000004e-05 2024-04-26T10:44:34.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.218 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.218 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556052+0000", 2024-04-26T10:44:34.219 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00089650299999999999 2024-04-26T10:44:34.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:34.219 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556439+0000", 2024-04-26T10:44:34.219 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038647900000000001 2024-04-26T10:44:34.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:34.219 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556463+0000", 2024-04-26T10:44:34.219 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4071e-05 2024-04-26T10:44:34.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:34.220 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556482+0000", 2024-04-26T10:44:34.220 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9378999999999999e-05 2024-04-26T10:44:34.220 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.220 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:34.220 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.220 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 3563440~3660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:34.220 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:34.220 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 12.661702534, 2024-04-26T10:44:34.220 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030550738000000001, 2024-04-26T10:44:34.220 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:34.220 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.220 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:34.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.221 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:34.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:34.221 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.221 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:34.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:34.221 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.221 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:34.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526368+0000", 2024-04-26T10:44:34.222 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:34.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.222 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:34.222 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526375+0000", 2024-04-26T10:44:34.222 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7510000000000002e-06 2024-04-26T10:44:34.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.222 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:34.222 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526381+0000", 2024-04-26T10:44:34.222 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3929999999999996e-06 2024-04-26T10:44:34.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.222 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.223 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526387+0000", 2024-04-26T10:44:34.223 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.215e-06 2024-04-26T10:44:34.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.223 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.223 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:34.223 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555542+0000", 2024-04-26T10:44:34.223 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029154992000000001 2024-04-26T10:44:34.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.223 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.223 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:34.223 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555610+0000", 2024-04-26T10:44:34.223 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8610999999999998e-05 2024-04-26T10:44:34.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.223 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.224 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:34.224 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555681+0000", 2024-04-26T10:44:34.224 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1072e-05 2024-04-26T10:44:34.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.224 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.224 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556866+0000", 2024-04-26T10:44:34.224 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001184598 2024-04-26T10:44:34.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.224 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:34.224 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556872+0000", 2024-04-26T10:44:34.224 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.55e-06 2024-04-26T10:44:34.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:34.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556897+0000", 2024-04-26T10:44:34.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.516e-05 2024-04-26T10:44:34.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:34.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556919+0000", 2024-04-26T10:44:34.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1951e-05 2024-04-26T10:44:34.225 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.225 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:34.225 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.225 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:134 3.1a 3:5e41ab69:::200.00000005:head [write 3567100~2427 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:34.226 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:34.226 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 12.661669469, 2024-04-26T10:44:34.226 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031267445999999997, 2024-04-26T10:44:34.226 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:34.226 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.227 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:34.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.227 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:34.227 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:34.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.227 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:34.227 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:34.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.227 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:34.228 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526401+0000", 2024-04-26T10:44:34.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:34.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.228 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:34.228 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526408+0000", 2024-04-26T10:44:34.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7769999999999997e-06 2024-04-26T10:44:34.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.228 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:34.228 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526415+0000", 2024-04-26T10:44:34.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0720000000000002e-06 2024-04-26T10:44:34.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.228 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.229 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526421+0000", 2024-04-26T10:44:34.229 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9699999999999996e-06 2024-04-26T10:44:34.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.229 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:34.229 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556084+0000", 2024-04-26T10:44:34.229 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029662351999999999 2024-04-26T10:44:34.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.229 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:34.229 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556126+0000", 2024-04-26T10:44:34.229 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2385000000000002e-05 2024-04-26T10:44:34.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.230 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:34.230 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556186+0000", 2024-04-26T10:44:34.230 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9945999999999998e-05 2024-04-26T10:44:34.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.230 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:34.230 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557598+0000", 2024-04-26T10:44:34.230 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0014121559999999999 2024-04-26T10:44:34.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.230 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.230 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557626+0000", 2024-04-26T10:44:34.230 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7960999999999999e-05 2024-04-26T10:44:34.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.231 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:34.231 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557650+0000", 2024-04-26T10:44:34.231 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3969999999999999e-05 2024-04-26T10:44:34.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.231 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:34.231 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557669+0000", 2024-04-26T10:44:34.231 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9262e-05 2024-04-26T10:44:34.231 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.231 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:34.231 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.231 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:135 3.1a 3:5e41ab69:::200.00000005:head [write 3569527~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:34.232 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:34.232 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 12.661645202999999, 2024-04-26T10:44:34.232 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031322516000000002, 2024-04-26T10:44:34.232 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:34.232 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.232 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:34.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.232 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:34.232 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:34.232 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.232 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:34.232 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:34.232 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.233 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:34.233 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:34.233 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:34.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.233 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:34.233 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526429+0000", 2024-04-26T10:44:34.233 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0750000000000002e-06 2024-04-26T10:44:34.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.233 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:34.233 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526435+0000", 2024-04-26T10:44:34.234 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.263e-06 2024-04-26T10:44:34.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.234 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.234 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526442+0000", 2024-04-26T10:44:34.234 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1219999999999997e-06 2024-04-26T10:44:34.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.234 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:34.234 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556515+0000", 2024-04-26T10:44:34.234 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030073132999999998 2024-04-26T10:44:34.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.235 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:34.235 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556564+0000", 2024-04-26T10:44:34.235 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8871e-05 2024-04-26T10:44:34.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.235 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:34.235 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556625+0000", 2024-04-26T10:44:34.235 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1307000000000001e-05 2024-04-26T10:44:34.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.235 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:34.235 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557678+0000", 2024-04-26T10:44:34.235 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010523100000000001 2024-04-26T10:44:34.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.236 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.236 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557709+0000", 2024-04-26T10:44:34.236 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1748000000000002e-05 2024-04-26T10:44:34.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.236 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:34.236 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557732+0000", 2024-04-26T10:44:34.236 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2415000000000001e-05 2024-04-26T10:44:34.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.236 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:34.236 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557749+0000", 2024-04-26T10:44:34.236 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6736999999999999e-05 2024-04-26T10:44:34.237 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.237 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:34.237 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.237 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:136 3.1a 3:5e41ab69:::200.00000005:head [write 3571449~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:34.237 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:34.237 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 12.661624013000001, 2024-04-26T10:44:34.237 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032180937, 2024-04-26T10:44:34.237 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:34.237 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.237 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:34.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.237 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:34.238 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:34.238 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.238 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:34.238 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:34.238 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.238 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:34.238 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:34.238 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:34.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.239 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:34.239 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526455+0000", 2024-04-26T10:44:34.239 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6429999999999995e-06 2024-04-26T10:44:34.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.239 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:34.239 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526461+0000", 2024-04-26T10:44:34.239 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:34.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.239 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.239 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526467+0000", 2024-04-26T10:44:34.239 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4389999999999999e-06 2024-04-26T10:44:34.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.240 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:34.240 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556950+0000", 2024-04-26T10:44:34.240 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030483854000000001 2024-04-26T10:44:34.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.240 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:34.240 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556989+0000", 2024-04-26T10:44:34.240 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8415999999999999e-05 2024-04-26T10:44:34.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.240 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:34.240 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557051+0000", 2024-04-26T10:44:34.240 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2088999999999995e-05 2024-04-26T10:44:34.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.241 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:34.241 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558166+0000", 2024-04-26T10:44:34.241 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001114622 2024-04-26T10:44:34.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.241 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.241 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558584+0000", 2024-04-26T10:44:34.241 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000418033 2024-04-26T10:44:34.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.241 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:34.241 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558609+0000", 2024-04-26T10:44:34.241 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5344999999999999e-05 2024-04-26T10:44:34.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.242 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:34.242 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558628+0000", 2024-04-26T10:44:34.242 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9273999999999999e-05 2024-04-26T10:44:34.242 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.242 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:34.242 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.242 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:137 3.1a 3:5e41ab69:::200.00000005:head [write 3573699~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:34.242 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:34.242 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 12.661600364, 2024-04-26T10:44:34.242 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032241530999999997, 2024-04-26T10:44:34.243 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:34.243 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.243 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:34.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.243 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:34.243 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:34.243 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.243 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:34.243 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:34.243 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.243 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:34.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526470+0000", 2024-04-26T10:44:34.244 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:34.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.244 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:34.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526473+0000", 2024-04-26T10:44:34.244 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.818e-06 2024-04-26T10:44:34.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.244 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:34.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526480+0000", 2024-04-26T10:44:34.244 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4119999999999998e-06 2024-04-26T10:44:34.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.245 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.245 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526484+0000", 2024-04-26T10:44:34.245 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6840000000000004e-06 2024-04-26T10:44:34.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.245 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:34.245 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557323+0000", 2024-04-26T10:44:34.245 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030838956000000001 2024-04-26T10:44:34.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.245 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:34.245 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557362+0000", 2024-04-26T10:44:34.245 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8343999999999997e-05 2024-04-26T10:44:34.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.246 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:34.246 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557421+0000", 2024-04-26T10:44:34.246 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9176999999999999e-05 2024-04-26T10:44:34.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.246 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:34.246 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558636+0000", 2024-04-26T10:44:34.246 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012153789999999999 2024-04-26T10:44:34.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.246 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.246 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558668+0000", 2024-04-26T10:44:34.246 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1452999999999999e-05 2024-04-26T10:44:34.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.247 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:34.247 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558694+0000", 2024-04-26T10:44:34.247 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6288999999999999e-05 2024-04-26T10:44:34.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.247 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:34.247 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558712+0000", 2024-04-26T10:44:34.247 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8459000000000001e-05 2024-04-26T10:44:34.247 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.247 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:34.247 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.248 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:138 3.1a 3:5e41ab69:::200.00000005:head [write 3575103~4205 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:34.248 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:34.248 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 12.661583045, 2024-04-26T10:44:34.248 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032665567999999999, 2024-04-26T10:44:34.248 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:34.248 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.248 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:34.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.248 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:34.248 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:34.248 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.249 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:34.249 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:34.249 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.249 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:34.249 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:34.249 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:34.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.249 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:34.249 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526495+0000", 2024-04-26T10:44:34.249 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7580000000000003e-06 2024-04-26T10:44:34.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.250 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:34.250 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526501+0000", 2024-04-26T10:44:34.250 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1680000000000001e-06 2024-04-26T10:44:34.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.250 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.250 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526505+0000", 2024-04-26T10:44:34.250 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.673e-06 2024-04-26T10:44:34.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.250 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:34.250 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557781+0000", 2024-04-26T10:44:34.251 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031275718000000001 2024-04-26T10:44:34.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.251 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:34.251 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557825+0000", 2024-04-26T10:44:34.251 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4048000000000002e-05 2024-04-26T10:44:34.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.251 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:34.251 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557888+0000", 2024-04-26T10:44:34.251 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2562000000000002e-05 2024-04-26T10:44:34.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.251 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.252 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559073+0000", 2024-04-26T10:44:34.252 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011852239999999999 2024-04-26T10:44:34.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.252 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.252 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:34.252 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559112+0000", 2024-04-26T10:44:34.252 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9226e-05 2024-04-26T10:44:34.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.252 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.252 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:34.252 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559136+0000", 2024-04-26T10:44:34.252 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3966000000000001e-05 2024-04-26T10:44:34.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.252 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.252 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:34.253 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559154+0000", 2024-04-26T10:44:34.253 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7575e-05 2024-04-26T10:44:34.253 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.253 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:34.253 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.253 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.253 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.253 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:139 3.1a 3:5e41ab69:::200.00000005:head [write 3579308~2255 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:34.253 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:34.253 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 12.661561427000001, 2024-04-26T10:44:34.253 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033424720999999998, 2024-04-26T10:44:34.253 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:34.253 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.253 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:34.254 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.254 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:34.254 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:34.254 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.254 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.254 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:34.254 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:34.254 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.254 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.254 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:34.254 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526509+0000", 2024-04-26T10:44:34.254 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:34.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.255 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.255 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:34.255 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526516+0000", 2024-04-26T10:44:34.255 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5209999999999999e-06 2024-04-26T10:44:34.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.255 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.255 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:34.255 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526522+0000", 2024-04-26T10:44:34.255 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1229999999999997e-06 2024-04-26T10:44:34.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.255 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.255 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.255 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526527+0000", 2024-04-26T10:44:34.256 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7849999999999999e-06 2024-04-26T10:44:34.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.256 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.256 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:34.256 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558194+0000", 2024-04-26T10:44:34.256 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031667419000000002 2024-04-26T10:44:34.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.256 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.256 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:34.256 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558234+0000", 2024-04-26T10:44:34.256 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9774999999999998e-05 2024-04-26T10:44:34.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.256 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.257 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:34.257 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558294+0000", 2024-04-26T10:44:34.257 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0242999999999999e-05 2024-04-26T10:44:34.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.257 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.257 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.257 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559106+0000", 2024-04-26T10:44:34.257 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00081148099999999996 2024-04-26T10:44:34.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.257 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.257 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:34.257 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559890+0000", 2024-04-26T10:44:34.257 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00078439999999999998 2024-04-26T10:44:34.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.258 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.258 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:34.258 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559917+0000", 2024-04-26T10:44:34.258 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7044000000000001e-05 2024-04-26T10:44:34.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.258 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.258 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:34.258 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559935+0000", 2024-04-26T10:44:34.258 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7448e-05 2024-04-26T10:44:34.258 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.258 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:34.258 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.258 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.259 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:140 3.1a 3:5e41ab69:::200.00000005:head [write 3581563~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:34.259 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:34.259 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 12.661540005999999, 2024-04-26T10:44:34.259 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033867728, 2024-04-26T10:44:34.259 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:34.259 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.259 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:34.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.259 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:34.259 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:34.259 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.259 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.259 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:34.259 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:34.260 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.260 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:34.260 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:34.260 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:34.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.260 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:34.260 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526538+0000", 2024-04-26T10:44:34.260 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.905e-06 2024-04-26T10:44:34.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.260 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:34.260 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526542+0000", 2024-04-26T10:44:34.261 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9550000000000002e-06 2024-04-26T10:44:34.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.261 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.261 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526545+0000", 2024-04-26T10:44:34.261 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8499999999999998e-06 2024-04-26T10:44:34.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.261 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:34.261 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558744+0000", 2024-04-26T10:44:34.261 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032198986999999998 2024-04-26T10:44:34.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.261 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:34.262 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558788+0000", 2024-04-26T10:44:34.262 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4365e-05 2024-04-26T10:44:34.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.262 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:34.262 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558854+0000", 2024-04-26T10:44:34.262 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5952999999999997e-05 2024-04-26T10:44:34.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.262 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.262 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559971+0000", 2024-04-26T10:44:34.262 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011172770000000001 2024-04-26T10:44:34.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.263 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:34.263 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560354+0000", 2024-04-26T10:44:34.263 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038267599999999998 2024-04-26T10:44:34.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.263 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.263 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:34.263 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560380+0000", 2024-04-26T10:44:34.263 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6140999999999999e-05 2024-04-26T10:44:34.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.263 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.263 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:34.263 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560399+0000", 2024-04-26T10:44:34.263 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9032999999999999e-05 2024-04-26T10:44:34.263 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.264 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:34.264 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.264 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.264 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.264 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:141 3.1a 3:5e41ab69:::200.00000005:head [write 3583482~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:34.264 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:34.264 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 12.661524347, 2024-04-26T10:44:34.264 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034316301, 2024-04-26T10:44:34.264 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:34.264 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.264 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:34.264 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.264 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:34.264 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:34.265 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.265 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:34.265 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:34.265 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.265 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:34.265 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:34.265 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:34.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.266 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:34.266 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526548+0000", 2024-04-26T10:44:34.266 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.739e-06 2024-04-26T10:44:34.266 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.266 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.266 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:34.266 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526551+0000", 2024-04-26T10:44:34.266 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.044e-06 2024-04-26T10:44:34.266 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.266 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.266 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.266 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526562+0000", 2024-04-26T10:44:34.266 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0370000000000001e-05 2024-04-26T10:44:34.266 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.266 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.267 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:34.267 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559179+0000", 2024-04-26T10:44:34.267 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032617444000000002 2024-04-26T10:44:34.267 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.267 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.267 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:34.267 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559220+0000", 2024-04-26T10:44:34.267 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0364999999999997e-05 2024-04-26T10:44:34.267 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.267 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.267 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:34.267 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559280+0000", 2024-04-26T10:44:34.267 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0569000000000002e-05 2024-04-26T10:44:34.267 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.268 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.268 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560814+0000", 2024-04-26T10:44:34.268 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015337580000000001 2024-04-26T10:44:34.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.268 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:34.268 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560820+0000", 2024-04-26T10:44:34.268 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.455e-06 2024-04-26T10:44:34.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.268 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:34.268 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560846+0000", 2024-04-26T10:44:34.268 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5228999999999998e-05 2024-04-26T10:44:34.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.269 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.269 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:34.269 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560863+0000", 2024-04-26T10:44:34.269 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7555e-05 2024-04-26T10:44:34.269 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.269 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:34.269 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.269 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.269 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:142 3.1a 3:5e41ab69:::200.00000005:head [write 3585931~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:34.269 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:34.269 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 12.66150395, 2024-04-26T10:44:34.269 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034372373999999997, 2024-04-26T10:44:34.269 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:34.270 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.270 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:34.270 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.270 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:34.270 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:34.270 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.270 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.270 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.270 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:34.270 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:34.270 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.270 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.270 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.270 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:34.271 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:34.271 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:34.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.271 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.271 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:34.271 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526573+0000", 2024-04-26T10:44:34.271 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0800000000000002e-06 2024-04-26T10:44:34.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.271 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.271 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:34.271 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526580+0000", 2024-04-26T10:44:34.271 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5799999999999997e-06 2024-04-26T10:44:34.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.271 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.271 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.272 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526585+0000", 2024-04-26T10:44:34.272 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2270000000000001e-06 2024-04-26T10:44:34.272 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.272 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.272 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:34.272 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559601+0000", 2024-04-26T10:44:34.272 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033016684999999997 2024-04-26T10:44:34.272 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.272 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.272 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:34.272 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559642+0000", 2024-04-26T10:44:34.272 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0321000000000002e-05 2024-04-26T10:44:34.272 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.272 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.272 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:34.273 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559706+0000", 2024-04-26T10:44:34.273 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4228999999999998e-05 2024-04-26T10:44:34.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.273 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:34.273 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560871+0000", 2024-04-26T10:44:34.273 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001164893 2024-04-26T10:44:34.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.273 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.273 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560899+0000", 2024-04-26T10:44:34.273 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:34.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.273 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:34.274 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560922+0000", 2024-04-26T10:44:34.274 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3337999999999999e-05 2024-04-26T10:44:34.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.274 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:34.274 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560940+0000", 2024-04-26T10:44:34.274 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7289999999999999e-05 2024-04-26T10:44:34.274 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.274 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:34.274 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.274 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:143 3.1a 3:5e41ab69:::200.00000005:head [write 3587331~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:34.274 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:34.275 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 12.661482052, 2024-04-26T10:44:34.275 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035256000000000003, 2024-04-26T10:44:34.275 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:34.275 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.275 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:34.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.275 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:34.275 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:34.275 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.275 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:34.275 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:34.275 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.276 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:34.276 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:34.276 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:34.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.276 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:34.276 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526592+0000", 2024-04-26T10:44:34.276 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2449999999999998e-06 2024-04-26T10:44:34.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.276 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:34.276 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526596+0000", 2024-04-26T10:44:34.276 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7000000000000002e-06 2024-04-26T10:44:34.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.277 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.277 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526599+0000", 2024-04-26T10:44:34.277 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6160000000000002e-06 2024-04-26T10:44:34.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.277 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:34.277 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559997+0000", 2024-04-26T10:44:34.277 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033397835000000001 2024-04-26T10:44:34.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.277 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:34.277 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560051+0000", 2024-04-26T10:44:34.278 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3742000000000001e-05 2024-04-26T10:44:34.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.278 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.278 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:34.278 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560112+0000", 2024-04-26T10:44:34.278 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0851999999999999e-05 2024-04-26T10:44:34.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.278 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.278 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:34.278 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561404+0000", 2024-04-26T10:44:34.278 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001291869 2024-04-26T10:44:34.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.278 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.278 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.279 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561797+0000", 2024-04-26T10:44:34.279 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039383000000000002 2024-04-26T10:44:34.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.279 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:34.279 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561827+0000", 2024-04-26T10:44:34.279 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9247e-05 2024-04-26T10:44:34.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.279 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:34.279 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561845+0000", 2024-04-26T10:44:34.279 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8462999999999999e-05 2024-04-26T10:44:34.279 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.279 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:34.279 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.280 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:144 3.1a 3:5e41ab69:::200.00000005:head [write 3588736~4987 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:34.280 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:34.280 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 12.66135976, 2024-04-26T10:44:34.280 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035224283000000002, 2024-04-26T10:44:34.280 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:34.280 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.280 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:34.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.280 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:34.280 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:34.280 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.281 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.281 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:34.281 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:34.281 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.281 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.281 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.281 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:34.281 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:34.281 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:34.281 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.281 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.281 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:34.281 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526718+0000", 2024-04-26T10:44:34.281 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.43e-06 2024-04-26T10:44:34.281 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.282 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.282 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:34.282 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526726+0000", 2024-04-26T10:44:34.282 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:44:34.282 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.282 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.282 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.282 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526729+0000", 2024-04-26T10:44:34.282 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6480000000000001e-06 2024-04-26T10:44:34.282 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.282 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.283 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:34.283 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560427+0000", 2024-04-26T10:44:34.283 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033697280000000003 2024-04-26T10:44:34.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.283 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.283 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:34.283 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560466+0000", 2024-04-26T10:44:34.283 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9606e-05 2024-04-26T10:44:34.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.283 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.283 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:34.283 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560525+0000", 2024-04-26T10:44:34.283 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9218000000000001e-05 2024-04-26T10:44:34.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.284 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.284 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:34.284 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561854+0000", 2024-04-26T10:44:34.284 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001328421 2024-04-26T10:44:34.284 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.284 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.284 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.284 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561887+0000", 2024-04-26T10:44:34.284 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2746000000000001e-05 2024-04-26T10:44:34.284 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.284 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.284 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:34.284 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561912+0000", 2024-04-26T10:44:34.284 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5126999999999998e-05 2024-04-26T10:44:34.284 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.285 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.285 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:34.285 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561936+0000", 2024-04-26T10:44:34.285 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4032999999999998e-05 2024-04-26T10:44:34.285 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.285 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:34.285 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.285 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.285 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.285 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:145 3.1a 3:5e41ab69:::200.00000005:head [write 3593723~2939 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:34.285 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:34.285 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 12.658440714999999, 2024-04-26T10:44:34.285 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033294394999999997, 2024-04-26T10:44:34.285 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:34.286 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.286 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:34.286 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.286 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:34.286 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:34.286 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.286 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.286 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:34.286 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:34.286 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.286 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.286 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:34.287 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529630+0000", 2024-04-26T10:44:34.287 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:34.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.287 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.287 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:34.287 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529635+0000", 2024-04-26T10:44:34.287 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7960000000000003e-06 2024-04-26T10:44:34.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.287 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.287 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:34.287 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529643+0000", 2024-04-26T10:44:34.287 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0390000000000005e-06 2024-04-26T10:44:34.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.288 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.288 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.288 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529648+0000", 2024-04-26T10:44:34.288 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9599999999999999e-06 2024-04-26T10:44:34.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.288 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.288 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:34.288 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560969+0000", 2024-04-26T10:44:34.288 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031321767 2024-04-26T10:44:34.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.288 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.288 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:34.288 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561009+0000", 2024-04-26T10:44:34.289 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9904999999999998e-05 2024-04-26T10:44:34.289 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.289 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.289 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:34.289 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561070+0000", 2024-04-26T10:44:34.289 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0708999999999998e-05 2024-04-26T10:44:34.289 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.289 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.289 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:34.289 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562352+0000", 2024-04-26T10:44:34.289 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012818440000000001 2024-04-26T10:44:34.289 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.289 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.289 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.289 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562867+0000", 2024-04-26T10:44:34.290 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000515665 2024-04-26T10:44:34.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.290 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.290 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:34.290 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562893+0000", 2024-04-26T10:44:34.290 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5469999999999998e-05 2024-04-26T10:44:34.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.290 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.290 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:34.290 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562925+0000", 2024-04-26T10:44:34.290 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1974999999999998e-05 2024-04-26T10:44:34.290 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.290 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:34.290 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.291 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:146 3.1a 3:5e41ab69:::200.00000005:head [write 3596662~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:34.291 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:34.291 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 12.658212501, 2024-04-26T10:44:34.291 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033178429000000002, 2024-04-26T10:44:34.291 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:34.291 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.291 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:34.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.291 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:34.291 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:34.291 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.292 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:34.292 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:34.292 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.292 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:34.292 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529858+0000", 2024-04-26T10:44:34.292 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:34.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.292 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:34.292 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529863+0000", 2024-04-26T10:44:34.292 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4500000000000003e-06 2024-04-26T10:44:34.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.293 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.293 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:34.293 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529874+0000", 2024-04-26T10:44:34.293 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0552e-05 2024-04-26T10:44:34.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.293 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.293 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.293 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529882+0000", 2024-04-26T10:44:34.293 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4449999999999996e-06 2024-04-26T10:44:34.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.293 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.293 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:34.293 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561452+0000", 2024-04-26T10:44:34.293 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031569680000000003 2024-04-26T10:44:34.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.294 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:34.294 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561511+0000", 2024-04-26T10:44:34.294 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9332e-05 2024-04-26T10:44:34.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.294 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:34.294 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561583+0000", 2024-04-26T10:44:34.294 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1730000000000006e-05 2024-04-26T10:44:34.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.294 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:34.294 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562933+0000", 2024-04-26T10:44:34.294 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013500059999999999 2024-04-26T10:44:34.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.295 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.295 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562976+0000", 2024-04-26T10:44:34.295 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2987e-05 2024-04-26T10:44:34.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.295 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:34.295 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563015+0000", 2024-04-26T10:44:34.295 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9453999999999999e-05 2024-04-26T10:44:34.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.295 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:34.295 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563037+0000", 2024-04-26T10:44:34.295 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1679e-05 2024-04-26T10:44:34.296 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.296 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:34.296 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.296 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:277 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:34.296 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:34.296 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 7.673201798, 2024-04-26T10:44:34.296 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030430563000000001, 2024-04-26T10:44:34.296 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:34.296 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.296 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:34.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.296 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:34.297 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:34.297 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.297 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.297 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:34.297 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:34.297 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:34.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.297 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.297 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:34.297 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514867+0000", 2024-04-26T10:44:34.297 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:34.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.297 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.298 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:34.298 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515460+0000", 2024-04-26T10:44:34.298 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00059285800000000004 2024-04-26T10:44:34.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.298 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:34.298 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515474+0000", 2024-04-26T10:44:34.298 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3933e-05 2024-04-26T10:44:34.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.298 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.298 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515481+0000", 2024-04-26T10:44:34.298 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:34.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.299 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:34.299 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515522+0000", 2024-04-26T10:44:34.299 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1369000000000003e-05 2024-04-26T10:44:34.299 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.299 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.299 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:34.299 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515591+0000", 2024-04-26T10:44:34.299 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9377999999999999e-05 2024-04-26T10:44:34.299 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.299 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.299 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:34.299 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.526440+0000", 2024-04-26T10:44:34.299 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010848837 2024-04-26T10:44:34.299 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.300 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.300 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.300 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.543866+0000", 2024-04-26T10:44:34.300 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017426288000000002 2024-04-26T10:44:34.300 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.300 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.300 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:34.300 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545193+0000", 2024-04-26T10:44:34.300 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001326111 2024-04-26T10:44:34.300 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.300 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.300 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:34.300 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545229+0000", 2024-04-26T10:44:34.300 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6390999999999998e-05 2024-04-26T10:44:34.300 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:34.301 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:34.301 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:34.301 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545300+0000", 2024-04-26T10:44:34.301 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1073000000000002e-05 2024-04-26T10:44:34.301 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.301 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:34.301 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.301 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:34.301 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:34.301 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:34.302 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:34.301+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:34.303 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:34.403 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:34.402+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:34.412 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:34.412 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:34.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.412 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:3310 3.18 3:1cc859d9:::200.00000012:head [write 418739~3283 [fadvise_dontneed] in=3283b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2024-04-26T10:44:34.412 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:34.411445+0000", 2024-04-26T10:44:34.412 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.9098999999999995e-05, 2024-04-26T10:44:34.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000120969, 2024-04-26T10:44:34.413 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:34.413 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-26T10:44:34.413 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:34.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:34.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:34.411445+0000", 2024-04-26T10:44:34.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:34.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:34.411445+0000", 2024-04-26T10:44:34.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.414 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:34.414 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:34.411444+0000", 2024-04-26T10:44:34.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:34.414 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.414 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:34.414 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:34.411450+0000", 2024-04-26T10:44:34.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3260000000000001e-06 2024-04-26T10:44:34.414 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.414 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:34.414 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:34.411463+0000", 2024-04-26T10:44:34.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.3135e-05 2024-04-26T10:44:34.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:34.411471+0000", 2024-04-26T10:44:34.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.3320000000000003e-06 2024-04-26T10:44:34.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:34.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:34.411504+0000", 2024-04-26T10:44:34.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3472000000000001e-05 2024-04-26T10:44:34.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:34.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:34.411544+0000", 2024-04-26T10:44:34.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9984999999999997e-05 2024-04-26T10:44:34.416 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.416 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:34.416 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.416 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.416 INFO:teuthology.orchestra.run.smithi195.stdout: ], 2024-04-26T10:44:34.416 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 1 2024-04-26T10:44:34.416 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:34.421 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:34.449 INFO:teuthology.orchestra.run.smithi049.stderr:noscrub is set 2024-04-26T10:44:34.504 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:34.502+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:34.567 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:34.567 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:34.567 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:34.567 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:34.567 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:34.576 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:34.605 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:34.603+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:34.685 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:34.685 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:34.685 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:34.685 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:34.686 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.686 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:330 3.13 3:ceffbd45:::200.0000000a:head [write 1316140~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:34.686 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:34.686 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.1697470499999998, 2024-04-26T10:44:34.686 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022245654, 2024-04-26T10:44:34.686 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:34.686 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.686 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:34.686 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.686 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:34.686 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:34.686 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.686 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.687 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.687 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:34.687 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:34.687 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.687 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.687 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.687 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:34.687 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513139+0000", 2024-04-26T10:44:34.687 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:34.687 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.687 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.687 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:34.687 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513149+0000", 2024-04-26T10:44:34.687 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7550000000000006e-06 2024-04-26T10:44:34.688 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.688 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.688 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:34.688 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513157+0000", 2024-04-26T10:44:34.688 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1089999999999998e-06 2024-04-26T10:44:34.688 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.688 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.688 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.688 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513167+0000", 2024-04-26T10:44:34.688 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0539e-05 2024-04-26T10:44:34.688 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.688 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.688 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:34.688 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533830+0000", 2024-04-26T10:44:34.689 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020662852999999998 2024-04-26T10:44:34.689 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.689 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.689 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:34.689 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533875+0000", 2024-04-26T10:44:34.689 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.5071999999999998e-05 2024-04-26T10:44:34.689 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.689 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.689 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:34.689 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535319+0000", 2024-04-26T10:44:34.689 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001443578 2024-04-26T10:44:34.689 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.689 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.689 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:34.690 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535346+0000", 2024-04-26T10:44:34.690 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7415000000000001e-05 2024-04-26T10:44:34.690 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.690 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.690 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:34.690 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535385+0000", 2024-04-26T10:44:34.690 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8912999999999998e-05 2024-04-26T10:44:34.690 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.690 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:34.690 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.690 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.690 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.690 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:331 3.13 3:ceffbd45:::200.0000000a:head [write 1318049~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:34.691 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:34.691 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.1697077220000001, 2024-04-26T10:44:34.691 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023524521, 2024-04-26T10:44:34.691 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:34.691 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.691 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:34.691 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.691 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:34.691 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:34.691 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.691 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.691 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.691 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:34.691 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:34.691 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.692 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.692 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.692 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:34.692 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513178+0000", 2024-04-26T10:44:34.692 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:34.692 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.692 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.692 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:34.692 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513183+0000", 2024-04-26T10:44:34.692 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2549999999999999e-06 2024-04-26T10:44:34.692 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.692 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.692 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:34.692 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513190+0000", 2024-04-26T10:44:34.693 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8460000000000002e-06 2024-04-26T10:44:34.693 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.693 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.693 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.693 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513195+0000", 2024-04-26T10:44:34.693 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3630000000000002e-06 2024-04-26T10:44:34.693 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.693 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.693 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:34.693 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534463+0000", 2024-04-26T10:44:34.693 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021267823000000002 2024-04-26T10:44:34.693 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.693 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.694 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:34.694 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534520+0000", 2024-04-26T10:44:34.694 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7510000000000003e-05 2024-04-26T10:44:34.694 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.694 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.694 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:34.694 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536634+0000", 2024-04-26T10:44:34.694 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0021138900000000002 2024-04-26T10:44:34.694 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.694 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.694 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:34.694 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536663+0000", 2024-04-26T10:44:34.694 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8884e-05 2024-04-26T10:44:34.695 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.695 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.695 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:34.695 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536703+0000", 2024-04-26T10:44:34.695 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0479000000000003e-05 2024-04-26T10:44:34.695 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.695 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:34.695 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.695 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.695 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.695 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:332 3.13 3:ceffbd45:::200.0000000a:head [write 1319462~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:34.695 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:34.695 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.1696728889999992, 2024-04-26T10:44:34.695 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024543230999999999, 2024-04-26T10:44:34.696 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:34.696 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.696 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:34.696 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.696 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:34.696 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:34.696 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.696 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.696 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.696 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:34.696 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:34.696 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.696 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.696 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.697 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:34.697 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513213+0000", 2024-04-26T10:44:34.697 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:34.697 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.697 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.697 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:34.697 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513217+0000", 2024-04-26T10:44:34.697 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:44:34.697 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.697 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.697 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:34.697 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513229+0000", 2024-04-26T10:44:34.697 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2051e-05 2024-04-26T10:44:34.697 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.697 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.698 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.698 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513236+0000", 2024-04-26T10:44:34.698 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4470000000000003e-06 2024-04-26T10:44:34.698 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.698 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.698 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:34.698 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534891+0000", 2024-04-26T10:44:34.698 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021655863000000001 2024-04-26T10:44:34.698 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.698 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.698 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:34.698 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534933+0000", 2024-04-26T10:44:34.698 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1596e-05 2024-04-26T10:44:34.698 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.699 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.699 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:34.699 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537677+0000", 2024-04-26T10:44:34.699 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027440989999999998 2024-04-26T10:44:34.699 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.699 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.699 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:34.699 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537721+0000", 2024-04-26T10:44:34.699 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3813999999999998e-05 2024-04-26T10:44:34.699 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.699 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.699 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:34.699 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537757+0000", 2024-04-26T10:44:34.699 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6022999999999997e-05 2024-04-26T10:44:34.700 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.700 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:34.700 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.700 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.700 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.700 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:333 3.13 3:ceffbd45:::200.0000000a:head [write 1320870~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:34.700 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:34.700 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.1696299700000008, 2024-04-26T10:44:34.700 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024557151999999999, 2024-04-26T10:44:34.700 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:34.700 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.700 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:34.700 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.700 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:34.701 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:34.701 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.701 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.701 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.701 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:34.701 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:34.701 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.701 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.701 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.701 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:34.701 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513256+0000", 2024-04-26T10:44:34.701 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:34.701 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.701 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.701 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:34.702 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513260+0000", 2024-04-26T10:44:34.702 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6550000000000002e-06 2024-04-26T10:44:34.702 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.702 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.702 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:34.702 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513273+0000", 2024-04-26T10:44:34.702 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2965e-05 2024-04-26T10:44:34.702 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.702 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.702 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.702 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513279+0000", 2024-04-26T10:44:34.702 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:44:34.702 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.702 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.703 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:34.703 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535411+0000", 2024-04-26T10:44:34.703 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022132233000000001 2024-04-26T10:44:34.703 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.703 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.703 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:34.703 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535479+0000", 2024-04-26T10:44:34.703 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7554999999999999e-05 2024-04-26T10:44:34.703 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.703 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.703 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:34.703 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537762+0000", 2024-04-26T10:44:34.703 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022836499999999999 2024-04-26T10:44:34.703 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.704 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.704 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:34.704 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537783+0000", 2024-04-26T10:44:34.704 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0364e-05 2024-04-26T10:44:34.704 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.704 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.704 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:34.704 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537814+0000", 2024-04-26T10:44:34.704 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1170000000000001e-05 2024-04-26T10:44:34.704 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.704 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:34.704 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.704 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.704 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.705 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:334 3.13 3:ceffbd45:::200.0000000a:head [write 1322273~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:34.705 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:34.705 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.1677932109999993, 2024-04-26T10:44:34.705 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022778731999999999, 2024-04-26T10:44:34.705 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:34.705 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.705 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:34.705 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.705 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:34.705 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:34.706 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.706 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.706 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.706 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:34.706 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:34.706 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.706 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.706 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.706 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:34.706 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:34.706 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:34.706 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.706 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.706 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:34.707 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515099+0000", 2024-04-26T10:44:34.707 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6599999999999998e-06 2024-04-26T10:44:34.707 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.707 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.707 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:34.707 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515112+0000", 2024-04-26T10:44:34.707 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2707e-05 2024-04-26T10:44:34.707 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.707 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.707 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.707 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515120+0000", 2024-04-26T10:44:34.707 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8509999999999999e-06 2024-04-26T10:44:34.707 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.707 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.708 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:34.708 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535792+0000", 2024-04-26T10:44:34.708 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020672209 2024-04-26T10:44:34.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.708 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.708 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:34.708 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535833+0000", 2024-04-26T10:44:34.708 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1415000000000002e-05 2024-04-26T10:44:34.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.708 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.708 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:34.708 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537818+0000", 2024-04-26T10:44:34.708 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0019850900000000001 2024-04-26T10:44:34.708 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.709 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.709 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:34.709 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537839+0000", 2024-04-26T10:44:34.709 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0068000000000002e-05 2024-04-26T10:44:34.709 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.709 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.709 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:34.709 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537872+0000", 2024-04-26T10:44:34.709 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3680999999999998e-05 2024-04-26T10:44:34.709 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.709 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:34.709 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.709 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.709 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.709 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:335 3.13 3:ceffbd45:::200.0000000a:head [write 1325230~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:34.710 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:34.710 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.1677541120000008, 2024-04-26T10:44:34.710 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023487081, 2024-04-26T10:44:34.710 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:34.710 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.710 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:34.710 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.710 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:34.710 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:34.710 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.710 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.710 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.710 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:34.710 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:34.711 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.711 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.711 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.711 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:34.711 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515132+0000", 2024-04-26T10:44:34.711 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:34.711 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.711 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.711 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:34.711 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515136+0000", 2024-04-26T10:44:34.711 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0860000000000004e-06 2024-04-26T10:44:34.711 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.711 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.711 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:34.711 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515143+0000", 2024-04-26T10:44:34.712 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.0400000000000004e-06 2024-04-26T10:44:34.712 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.712 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.712 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.712 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515149+0000", 2024-04-26T10:44:34.712 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0789999999999997e-06 2024-04-26T10:44:34.712 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.712 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.712 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:34.712 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536200+0000", 2024-04-26T10:44:34.712 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021050993 2024-04-26T10:44:34.712 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.712 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.712 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:34.713 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536253+0000", 2024-04-26T10:44:34.713 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.2643999999999999e-05 2024-04-26T10:44:34.713 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.713 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.713 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:34.713 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538560+0000", 2024-04-26T10:44:34.713 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0023073389999999998 2024-04-26T10:44:34.713 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.713 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.713 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:34.713 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538584+0000", 2024-04-26T10:44:34.713 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3893999999999999e-05 2024-04-26T10:44:34.713 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.713 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.714 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:34.714 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538620+0000", 2024-04-26T10:44:34.714 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5611000000000002e-05 2024-04-26T10:44:34.714 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.714 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:34.714 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.714 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.714 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.714 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:336 3.13 3:ceffbd45:::200.0000000a:head [write 1327147~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:34.714 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:34.714 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.1664216570000008, 2024-04-26T10:44:34.714 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027687066, 2024-04-26T10:44:34.714 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:34.714 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.715 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:34.715 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.715 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:34.715 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:34.715 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.715 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.715 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.715 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:34.715 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:34.715 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.715 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.715 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.715 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:34.715 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516464+0000", 2024-04-26T10:44:34.716 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:34.716 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.716 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.716 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:34.716 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516491+0000", 2024-04-26T10:44:34.716 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6539000000000001e-05 2024-04-26T10:44:34.716 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.716 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.716 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:34.716 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516500+0000", 2024-04-26T10:44:34.716 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5480000000000007e-06 2024-04-26T10:44:34.716 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.716 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.716 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.717 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516511+0000", 2024-04-26T10:44:34.717 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0719e-05 2024-04-26T10:44:34.717 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.717 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.717 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:34.717 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536737+0000", 2024-04-26T10:44:34.717 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020225770000000001 2024-04-26T10:44:34.717 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.717 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.717 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:34.717 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536783+0000", 2024-04-26T10:44:34.717 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6168999999999998e-05 2024-04-26T10:44:34.717 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.717 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.718 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:34.718 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544080+0000", 2024-04-26T10:44:34.718 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0072966799999999998 2024-04-26T10:44:34.718 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.718 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.718 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:34.718 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544111+0000", 2024-04-26T10:44:34.718 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1056999999999998e-05 2024-04-26T10:44:34.718 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.718 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.718 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:34.718 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544152+0000", 2024-04-26T10:44:34.718 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1452000000000002e-05 2024-04-26T10:44:34.719 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.719 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:34.719 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.719 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.719 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.719 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:337 3.13 3:ceffbd45:::200.0000000a:head [write 1342136~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:34.719 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:34.719 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.1663687189999994, 2024-04-26T10:44:34.719 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027711237, 2024-04-26T10:44:34.719 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:34.719 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.719 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:34.719 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.719 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:34.719 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:34.720 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.720 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.720 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.720 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:34.720 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:34.720 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.720 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.720 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.720 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:34.720 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516517+0000", 2024-04-26T10:44:34.720 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:34.720 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.720 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.720 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:34.721 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516521+0000", 2024-04-26T10:44:34.721 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6200000000000001e-06 2024-04-26T10:44:34.721 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.721 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.721 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:34.721 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516528+0000", 2024-04-26T10:44:34.721 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8639999999999998e-06 2024-04-26T10:44:34.721 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.721 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.721 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.721 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516533+0000", 2024-04-26T10:44:34.721 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6310000000000002e-06 2024-04-26T10:44:34.721 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.721 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.722 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:34.722 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537231+0000", 2024-04-26T10:44:34.722 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020698613000000001 2024-04-26T10:44:34.722 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.722 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.722 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:34.722 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537273+0000", 2024-04-26T10:44:34.722 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1529000000000002e-05 2024-04-26T10:44:34.722 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.722 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.722 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:34.722 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544157+0000", 2024-04-26T10:44:34.722 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068847090000000001 2024-04-26T10:44:34.722 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.722 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.723 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:34.723 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544180+0000", 2024-04-26T10:44:34.723 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.2532e-05 2024-04-26T10:44:34.723 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.723 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.723 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:34.723 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544229+0000", 2024-04-26T10:44:34.723 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9190000000000002e-05 2024-04-26T10:44:34.723 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.723 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:34.723 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.723 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.723 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.723 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:338 3.13 3:ceffbd45:::200.0000000a:head [write 1344569~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:34.724 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:34.724 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.1657024660000008, 2024-04-26T10:44:34.724 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027105598000000002, 2024-04-26T10:44:34.724 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:34.724 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.724 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:34.724 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.724 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:34.724 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:34.724 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.724 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.724 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.724 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:34.724 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:34.724 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.725 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.725 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.725 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:34.725 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517183+0000", 2024-04-26T10:44:34.725 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:34.725 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.725 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.725 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:34.725 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517188+0000", 2024-04-26T10:44:34.725 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7389999999999999e-06 2024-04-26T10:44:34.725 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.725 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.725 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:34.725 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517199+0000", 2024-04-26T10:44:34.725 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0652000000000001e-05 2024-04-26T10:44:34.726 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.726 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.726 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.726 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517206+0000", 2024-04-26T10:44:34.726 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6610000000000003e-06 2024-04-26T10:44:34.726 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.726 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.726 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:34.726 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537905+0000", 2024-04-26T10:44:34.726 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020699662000000001 2024-04-26T10:44:34.726 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.726 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.726 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:34.726 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537956+0000", 2024-04-26T10:44:34.727 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0954e-05 2024-04-26T10:44:34.727 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.727 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.727 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:34.727 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544233+0000", 2024-04-26T10:44:34.727 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062773009999999999 2024-04-26T10:44:34.727 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.727 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.727 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:34.727 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544258+0000", 2024-04-26T10:44:34.727 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4434999999999999e-05 2024-04-26T10:44:34.727 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.727 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.727 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:34.727 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544290+0000", 2024-04-26T10:44:34.728 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1918000000000002e-05 2024-04-26T10:44:34.728 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.728 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:34.728 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.728 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.728 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.728 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:339 3.13 3:ceffbd45:::200.0000000a:head [write 1346485~4322 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:34.728 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:34.728 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.1647639729999995, 2024-04-26T10:44:34.728 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026221617999999999, 2024-04-26T10:44:34.728 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:34.728 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.728 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:34.728 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.729 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:34.729 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:34.729 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.729 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.729 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.729 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:34.729 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:34.729 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.729 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.729 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.729 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:34.729 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518122+0000", 2024-04-26T10:44:34.729 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:34.729 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.729 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.730 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:34.730 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518129+0000", 2024-04-26T10:44:34.730 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.43e-06 2024-04-26T10:44:34.730 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.730 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.730 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:34.730 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518138+0000", 2024-04-26T10:44:34.730 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9129999999999992e-06 2024-04-26T10:44:34.730 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.730 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.730 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.730 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518144+0000", 2024-04-26T10:44:34.730 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.1419999999999998e-06 2024-04-26T10:44:34.730 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.731 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.731 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:34.731 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538232+0000", 2024-04-26T10:44:34.731 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020087383 2024-04-26T10:44:34.731 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.731 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.731 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:34.731 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538274+0000", 2024-04-26T10:44:34.731 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2602999999999999e-05 2024-04-26T10:44:34.731 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.731 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.731 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:34.731 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544294+0000", 2024-04-26T10:44:34.731 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060194059999999997 2024-04-26T10:44:34.731 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.732 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.732 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:34.732 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544314+0000", 2024-04-26T10:44:34.732 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0091000000000001e-05 2024-04-26T10:44:34.732 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.732 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.732 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:34.732 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544344+0000", 2024-04-26T10:44:34.732 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0446e-05 2024-04-26T10:44:34.732 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.732 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:34.732 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.732 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.732 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.732 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:340 3.13 3:ceffbd45:::200.0000000a:head [write 1350807~2768 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:34.733 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:34.733 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.1622797370000004, 2024-04-26T10:44:34.733 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023795594, 2024-04-26T10:44:34.733 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:34.733 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.733 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:34.733 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.733 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:34.733 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:34.733 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.733 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.733 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.733 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:34.733 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:34.734 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.734 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.734 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.734 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:34.734 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520606+0000", 2024-04-26T10:44:34.734 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:34.734 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.734 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.734 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:34.734 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520612+0000", 2024-04-26T10:44:34.734 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.835e-06 2024-04-26T10:44:34.734 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.734 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.734 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:34.734 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520622+0000", 2024-04-26T10:44:34.735 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0173999999999999e-05 2024-04-26T10:44:34.735 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.735 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.735 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.735 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520629+0000", 2024-04-26T10:44:34.735 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7460000000000003e-06 2024-04-26T10:44:34.735 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.735 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.735 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:34.735 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538651+0000", 2024-04-26T10:44:34.735 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018022474 2024-04-26T10:44:34.735 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.735 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.735 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:34.735 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538697+0000", 2024-04-26T10:44:34.736 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6183999999999997e-05 2024-04-26T10:44:34.736 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.736 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.736 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:34.736 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544348+0000", 2024-04-26T10:44:34.736 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0056503509999999996 2024-04-26T10:44:34.736 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.736 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.736 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:34.736 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544369+0000", 2024-04-26T10:44:34.736 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1064999999999999e-05 2024-04-26T10:44:34.736 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.736 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.736 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:34.737 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544403+0000", 2024-04-26T10:44:34.737 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3695000000000002e-05 2024-04-26T10:44:34.737 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.737 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:34.737 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.737 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.737 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.737 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:341 3.13 3:ceffbd45:::200.0000000a:head [write 1353575~3816 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:34.737 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:34.737 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.161544482, 2024-04-26T10:44:34.737 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023114967, 2024-04-26T10:44:34.737 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:34.737 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.737 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:34.738 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.738 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:34.738 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:34.738 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.738 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.738 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.738 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:34.738 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:34.738 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.738 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.738 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.738 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:34.738 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521341+0000", 2024-04-26T10:44:34.738 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:34.739 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.739 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.739 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:34.739 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521349+0000", 2024-04-26T10:44:34.739 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1550000000000001e-06 2024-04-26T10:44:34.739 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.739 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.739 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:34.739 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521358+0000", 2024-04-26T10:44:34.739 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.1500000000000005e-06 2024-04-26T10:44:34.739 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.739 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.739 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.739 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521364+0000", 2024-04-26T10:44:34.740 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3289999999999999e-06 2024-04-26T10:44:34.740 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.740 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.740 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:34.740 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539010+0000", 2024-04-26T10:44:34.740 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.017645965999999999 2024-04-26T10:44:34.740 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.740 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.740 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:34.740 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539051+0000", 2024-04-26T10:44:34.740 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.053e-05 2024-04-26T10:44:34.740 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.740 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.740 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:34.741 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544407+0000", 2024-04-26T10:44:34.741 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053560209999999999 2024-04-26T10:44:34.741 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.741 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.741 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:34.741 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544427+0000", 2024-04-26T10:44:34.741 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0228e-05 2024-04-26T10:44:34.741 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.741 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.741 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:34.741 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544457+0000", 2024-04-26T10:44:34.741 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0375e-05 2024-04-26T10:44:34.741 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.741 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:34.742 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.742 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.742 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.742 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11582 4.2f 4:f76ba295:::10000003252.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:34.742 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:34.742 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 5.6879289369999997, 2024-04-26T10:44:34.742 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024553994999999999, 2024-04-26T10:44:34.742 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:34.742 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.742 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:34.742 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:34.742 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:34.742 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11582 2024-04-26T10:44:34.742 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.743 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:34.743 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.743 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:34.743 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:34.743 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.743 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.743 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.743 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:34.743 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:34.743 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.743 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.743 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.743 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:34.743 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994957+0000", 2024-04-26T10:44:34.744 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:34.744 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.744 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.744 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:34.744 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002755+0000", 2024-04-26T10:44:34.744 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0077984719999999999 2024-04-26T10:44:34.744 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.744 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.744 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:34.744 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002770+0000", 2024-04-26T10:44:34.744 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4956e-05 2024-04-26T10:44:34.744 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.744 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.744 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.745 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002777+0000", 2024-04-26T10:44:34.745 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1899999999999998e-06 2024-04-26T10:44:34.745 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.745 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.745 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:34.745 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002833+0000", 2024-04-26T10:44:34.745 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5189999999999998e-05 2024-04-26T10:44:34.745 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.745 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.745 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:34.745 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002977+0000", 2024-04-26T10:44:34.745 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014444100000000001 2024-04-26T10:44:34.745 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.745 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.746 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:34.746 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.003108+0000", 2024-04-26T10:44:34.746 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000131068 2024-04-26T10:44:34.746 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.746 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.746 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:34.746 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.009040+0000", 2024-04-26T10:44:34.746 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059314149999999998 2024-04-26T10:44:34.746 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.746 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.746 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.746 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019462+0000", 2024-04-26T10:44:34.746 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010422803 2024-04-26T10:44:34.746 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.747 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.747 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:34.747 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019490+0000", 2024-04-26T10:44:34.747 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7773999999999999e-05 2024-04-26T10:44:34.747 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.747 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.747 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:34.747 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019512+0000", 2024-04-26T10:44:34.747 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1611999999999999e-05 2024-04-26T10:44:34.747 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.747 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:34.747 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.747 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.747 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.747 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11911 4.37 4:ec04ab04:::100000031ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:34.748 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:34.748 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 5.3462087299999999, 2024-04-26T10:44:34.748 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026810273999999999, 2024-04-26T10:44:34.748 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:34.748 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.748 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:34.748 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:34.748 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:34.748 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11911 2024-04-26T10:44:34.748 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.748 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:34.748 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.748 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:34.749 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:34.749 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.749 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.749 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.749 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:34.749 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:34.749 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.749 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.749 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.749 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:34.749 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336676+0000", 2024-04-26T10:44:34.749 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:34.749 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.749 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.750 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:34.750 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343119+0000", 2024-04-26T10:44:34.750 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0064424850000000004 2024-04-26T10:44:34.750 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.750 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.750 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:34.750 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343131+0000", 2024-04-26T10:44:34.750 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1708e-05 2024-04-26T10:44:34.750 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.750 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.750 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.750 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343137+0000", 2024-04-26T10:44:34.750 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9880000000000001e-06 2024-04-26T10:44:34.750 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.751 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.751 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:34.751 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343175+0000", 2024-04-26T10:44:34.751 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7913000000000001e-05 2024-04-26T10:44:34.751 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.751 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.751 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:34.751 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343269+0000", 2024-04-26T10:44:34.751 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4931000000000003e-05 2024-04-26T10:44:34.751 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.751 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.751 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:34.751 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343392+0000", 2024-04-26T10:44:34.751 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000122435 2024-04-26T10:44:34.751 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.752 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.752 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:34.752 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.347520+0000", 2024-04-26T10:44:34.752 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004128418 2024-04-26T10:44:34.752 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.752 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.752 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.752 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363410+0000", 2024-04-26T10:44:34.752 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.015889309000000001 2024-04-26T10:44:34.752 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.752 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.752 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:34.752 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363453+0000", 2024-04-26T10:44:34.752 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3244000000000001e-05 2024-04-26T10:44:34.753 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.753 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.753 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:34.753 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363488+0000", 2024-04-26T10:44:34.753 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5318000000000003e-05 2024-04-26T10:44:34.753 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.753 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:34.753 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.753 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.753 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.753 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12000 4.3c 4:3c2be35d:::100000030f7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:34.753 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:34.753 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 5.2635872179999996, 2024-04-26T10:44:34.753 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022808264000000002, 2024-04-26T10:44:34.754 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:34.754 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.754 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:34.754 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:34.754 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:34.754 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12000 2024-04-26T10:44:34.754 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.754 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:34.754 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.754 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:34.754 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:34.754 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.754 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.755 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.755 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:34.755 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:34.755 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.755 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.755 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.755 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:34.755 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:34.755 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:34.755 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.755 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.755 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:34.755 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430937+0000", 2024-04-26T10:44:34.755 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.011638097 2024-04-26T10:44:34.755 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.756 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.756 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:34.756 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430948+0000", 2024-04-26T10:44:34.756 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0824e-05 2024-04-26T10:44:34.756 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.756 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.756 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.756 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430953+0000", 2024-04-26T10:44:34.756 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5219999999999998e-06 2024-04-26T10:44:34.756 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.756 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.756 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:34.756 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430990+0000", 2024-04-26T10:44:34.756 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6458999999999998e-05 2024-04-26T10:44:34.757 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.757 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.757 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:34.757 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.431052+0000", 2024-04-26T10:44:34.757 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2687000000000005e-05 2024-04-26T10:44:34.757 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.757 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.757 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:34.757 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442027+0000", 2024-04-26T10:44:34.757 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010974513 2024-04-26T10:44:34.757 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.757 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.757 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:34.757 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442060+0000", 2024-04-26T10:44:34.758 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2849999999999999e-05 2024-04-26T10:44:34.758 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.758 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.758 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:34.758 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442108+0000", 2024-04-26T10:44:34.758 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8031999999999997e-05 2024-04-26T10:44:34.758 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.758 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:34.758 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.758 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.758 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.758 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12042 4.2f 4:f741970f:::10000003414.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:34.758 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:34.758 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 5.2243337409999997, 2024-04-26T10:44:34.759 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.029390757, 2024-04-26T10:44:34.759 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:34.759 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.759 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:34.759 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:34.759 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:34.759 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12042 2024-04-26T10:44:34.759 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.759 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:34.759 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.759 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:34.759 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:34.759 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.759 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.760 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.760 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:34.760 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:34.760 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.760 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.760 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.760 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:34.760 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458552+0000", 2024-04-26T10:44:34.760 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:34.760 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.760 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.760 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:34.760 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464335+0000", 2024-04-26T10:44:34.760 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.005783168 2024-04-26T10:44:34.760 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.761 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.761 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:34.761 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464347+0000", 2024-04-26T10:44:34.761 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1578e-05 2024-04-26T10:44:34.761 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.761 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.761 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.761 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464353+0000", 2024-04-26T10:44:34.761 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3709999999999996e-06 2024-04-26T10:44:34.761 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.761 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.761 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:34.761 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464407+0000", 2024-04-26T10:44:34.761 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3717000000000001e-05 2024-04-26T10:44:34.761 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.762 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.762 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:34.762 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464556+0000", 2024-04-26T10:44:34.762 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014899100000000001 2024-04-26T10:44:34.762 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.762 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.762 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:34.762 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464688+0000", 2024-04-26T10:44:34.762 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013238599999999999 2024-04-26T10:44:34.762 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.762 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.762 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:34.762 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.469725+0000", 2024-04-26T10:44:34.762 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0050369229999999996 2024-04-26T10:44:34.763 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.763 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.763 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.763 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487892+0000", 2024-04-26T10:44:34.763 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018167184999999999 2024-04-26T10:44:34.763 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.763 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.763 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:34.763 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487922+0000", 2024-04-26T10:44:34.763 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.9495000000000001e-05 2024-04-26T10:44:34.763 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.763 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.763 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:34.763 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487944+0000", 2024-04-26T10:44:34.763 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1823000000000001e-05 2024-04-26T10:44:34.764 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.764 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:34.764 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.764 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.764 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.764 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12050 4.2c 4:36b72e58:::100000031ba.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:34.764 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:34.764 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 5.2157931319999999, 2024-04-26T10:44:34.764 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022722497000000001, 2024-04-26T10:44:34.764 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:34.764 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.764 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:34.764 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:34.765 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:34.765 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12050 2024-04-26T10:44:34.765 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.765 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:34.765 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.765 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:34.765 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:34.765 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.765 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.765 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.765 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:34.765 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:34.765 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.765 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.765 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.766 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:34.766 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467093+0000", 2024-04-26T10:44:34.766 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:34.766 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.766 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.766 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:34.766 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476305+0000", 2024-04-26T10:44:34.766 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092125850000000006 2024-04-26T10:44:34.766 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.766 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.766 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:34.766 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476322+0000", 2024-04-26T10:44:34.766 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6860000000000001e-05 2024-04-26T10:44:34.766 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.767 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.767 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.767 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476328+0000", 2024-04-26T10:44:34.767 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.587e-06 2024-04-26T10:44:34.767 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.767 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.767 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:34.767 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476378+0000", 2024-04-26T10:44:34.767 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0519999999999997e-05 2024-04-26T10:44:34.767 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.767 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.767 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:34.767 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476474+0000", 2024-04-26T10:44:34.767 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5556000000000005e-05 2024-04-26T10:44:34.768 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.768 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.768 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:34.768 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489677+0000", 2024-04-26T10:44:34.768 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013203048 2024-04-26T10:44:34.768 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.768 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.768 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:34.768 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489722+0000", 2024-04-26T10:44:34.768 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4650000000000001e-05 2024-04-26T10:44:34.768 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.768 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.768 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:34.768 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489816+0000", 2024-04-26T10:44:34.768 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4402999999999997e-05 2024-04-26T10:44:34.769 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.769 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:34.769 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.769 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.769 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.769 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12516 4.37 4:ed0cb515:::10000003324.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:34.769 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:34.769 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 4.695711567, 2024-04-26T10:44:34.769 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.030139677, 2024-04-26T10:44:34.769 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:34.769 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.769 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:34.769 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:34.769 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:34.770 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12516 2024-04-26T10:44:34.770 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.770 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:34.770 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.770 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:34.770 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:34.770 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.770 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.770 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.770 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:34.770 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:34.770 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.770 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.770 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.771 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:34.771 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987173+0000", 2024-04-26T10:44:34.771 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:34.771 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.771 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.771 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:34.771 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991339+0000", 2024-04-26T10:44:34.771 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0041663760000000003 2024-04-26T10:44:34.771 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.771 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.771 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:34.771 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991351+0000", 2024-04-26T10:44:34.771 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1333e-05 2024-04-26T10:44:34.771 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.771 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.772 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.772 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991357+0000", 2024-04-26T10:44:34.772 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3350000000000003e-06 2024-04-26T10:44:34.772 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.772 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.772 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:34.772 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991394+0000", 2024-04-26T10:44:34.772 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7054000000000001e-05 2024-04-26T10:44:34.772 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.772 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.772 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:34.772 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991495+0000", 2024-04-26T10:44:34.772 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000100386 2024-04-26T10:44:34.772 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.773 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.773 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:34.773 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991579+0000", 2024-04-26T10:44:34.773 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4295000000000005e-05 2024-04-26T10:44:34.773 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.773 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.773 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:34.773 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.996238+0000", 2024-04-26T10:44:34.773 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0046589309999999998 2024-04-26T10:44:34.773 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.773 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.773 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.773 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017237+0000", 2024-04-26T10:44:34.773 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020998993000000001 2024-04-26T10:44:34.773 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.774 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.774 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:34.774 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017280+0000", 2024-04-26T10:44:34.774 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3600000000000003e-05 2024-04-26T10:44:34.774 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.774 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.774 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:34.774 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017315+0000", 2024-04-26T10:44:34.774 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4381999999999997e-05 2024-04-26T10:44:34.774 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.774 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:34.774 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.774 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.774 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.774 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12644 4.37 4:ec5044d7:::100000032d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:34.775 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:34.775 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 4.5220387390000001, 2024-04-26T10:44:34.775 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.037018677, 2024-04-26T10:44:34.775 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:34.775 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.775 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:34.775 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:34.775 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:34.775 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12644 2024-04-26T10:44:34.775 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.775 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:34.775 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.775 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:34.775 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:34.776 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.776 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.776 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.776 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:34.776 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:34.776 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.776 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.776 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.776 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:34.776 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160847+0000", 2024-04-26T10:44:34.776 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:34.776 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.776 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.776 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:34.776 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170089+0000", 2024-04-26T10:44:34.777 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092424289999999999 2024-04-26T10:44:34.777 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.777 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.777 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:34.777 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170111+0000", 2024-04-26T10:44:34.777 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1733e-05 2024-04-26T10:44:34.777 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.777 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.777 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.777 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170124+0000", 2024-04-26T10:44:34.777 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.272e-05 2024-04-26T10:44:34.777 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.777 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.778 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:34.778 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170177+0000", 2024-04-26T10:44:34.778 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3745000000000001e-05 2024-04-26T10:44:34.778 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.778 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.778 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:34.778 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170350+0000", 2024-04-26T10:44:34.778 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017297699999999999 2024-04-26T10:44:34.778 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.778 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.778 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:34.778 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170458+0000", 2024-04-26T10:44:34.778 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000107583 2024-04-26T10:44:34.778 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.778 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.779 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:34.779 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.176693+0000", 2024-04-26T10:44:34.779 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062351799999999999 2024-04-26T10:44:34.779 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.779 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.779 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.779 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197774+0000", 2024-04-26T10:44:34.779 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021080471999999999 2024-04-26T10:44:34.779 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.779 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.779 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:34.779 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197824+0000", 2024-04-26T10:44:34.779 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0096000000000003e-05 2024-04-26T10:44:34.779 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.780 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.780 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:34.780 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197867+0000", 2024-04-26T10:44:34.780 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2882e-05 2024-04-26T10:44:34.780 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.780 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:34.780 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.780 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.780 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.780 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:13242 4.2f 4:f5e54bb5:::100000033c8.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:34.780 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:34.780 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 3.843807601, 2024-04-26T10:44:34.780 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023873062, 2024-04-26T10:44:34.780 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:34.781 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:34.781 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:34.781 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:34.781 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:34.781 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 13242 2024-04-26T10:44:34.781 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.781 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:34.781 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.781 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:34.781 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:34.781 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.781 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.781 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.781 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:34.782 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:34.782 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:34.782 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.782 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.782 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:34.782 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839078+0000", 2024-04-26T10:44:34.782 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:34.782 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.782 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.782 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:34.782 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848098+0000", 2024-04-26T10:44:34.782 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090200750000000007 2024-04-26T10:44:34.782 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.782 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.782 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:34.783 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848108+0000", 2024-04-26T10:44:34.783 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.062e-05 2024-04-26T10:44:34.783 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.783 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.783 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:34.783 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848115+0000", 2024-04-26T10:44:34.783 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3040000000000001e-06 2024-04-26T10:44:34.783 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.783 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.783 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:34.783 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848157+0000", 2024-04-26T10:44:34.783 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2533000000000001e-05 2024-04-26T10:44:34.783 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.783 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.784 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:34.784 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848252+0000", 2024-04-26T10:44:34.784 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4480000000000003e-05 2024-04-26T10:44:34.784 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.784 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.784 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:34.784 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848393+0000", 2024-04-26T10:44:34.784 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000140863 2024-04-26T10:44:34.784 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.784 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.784 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:34.784 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.854434+0000", 2024-04-26T10:44:34.784 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060415590000000002 2024-04-26T10:44:34.784 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.784 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.785 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:34.785 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862894+0000", 2024-04-26T10:44:34.785 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0084598869999999993 2024-04-26T10:44:34.785 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.785 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.785 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:34.785 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862926+0000", 2024-04-26T10:44:34.785 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1473999999999997e-05 2024-04-26T10:44:34.785 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:34.785 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:34.785 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:34.785 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862952+0000", 2024-04-26T10:44:34.785 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6545000000000001e-05 2024-04-26T10:44:34.785 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.785 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:34.786 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.786 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:34.786 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:34.786 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:34.787 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:34.788 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:34.785+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:34.888 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:34.887+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:34.898 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:34.898 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:34.898 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:44:34.898 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:34.908 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:34.989 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:34.988+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:35.020 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:35.020 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:35.020 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:35.020 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:35.020 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:35.029 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:35.090 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:35.088+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:35.143 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:35.143 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:35.143 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:35.144 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:35.144 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.144 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:80 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:35.144 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:35.144 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.618806725000001, 2024-04-26T10:44:35.144 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029259192, 2024-04-26T10:44:35.144 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:35.144 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:35.144 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:35.144 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.144 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:35.144 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:35.145 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.145 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.145 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:35.145 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:35.145 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.145 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.145 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:35.145 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522252+0000", 2024-04-26T10:44:35.145 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:35.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.146 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.146 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:35.146 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523121+0000", 2024-04-26T10:44:35.146 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00086885100000000002 2024-04-26T10:44:35.146 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.146 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.146 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:35.146 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523133+0000", 2024-04-26T10:44:35.146 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2109999999999999e-05 2024-04-26T10:44:35.146 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.146 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.146 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:35.147 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523139+0000", 2024-04-26T10:44:35.147 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.541e-06 2024-04-26T10:44:35.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.147 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:35.147 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523176+0000", 2024-04-26T10:44:35.147 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6847999999999997e-05 2024-04-26T10:44:35.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.147 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:35.147 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523240+0000", 2024-04-26T10:44:35.147 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3941000000000003e-05 2024-04-26T10:44:35.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.148 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:35.148 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.536390+0000", 2024-04-26T10:44:35.148 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013150811 2024-04-26T10:44:35.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.148 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:35.148 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551071+0000", 2024-04-26T10:44:35.148 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014680021 2024-04-26T10:44:35.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.148 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:35.148 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551428+0000", 2024-04-26T10:44:35.148 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00035703900000000002 2024-04-26T10:44:35.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.149 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:35.149 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551462+0000", 2024-04-26T10:44:35.149 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4337e-05 2024-04-26T10:44:35.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.149 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:35.149 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551513+0000", 2024-04-26T10:44:35.149 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0875000000000003e-05 2024-04-26T10:44:35.149 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.149 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:35.149 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.150 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.150 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:129 3.1a 3:5e41ab69:::200.00000005:head [write 3557843~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:35.150 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:35.150 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.614748655, 2024-04-26T10:44:35.150 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029108253000000001, 2024-04-26T10:44:35.150 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:35.150 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:35.150 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:35.150 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.150 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:35.150 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:35.151 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.151 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:35.151 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:35.151 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.151 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:35.151 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526311+0000", 2024-04-26T10:44:35.151 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:35.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.151 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:35.152 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526315+0000", 2024-04-26T10:44:35.152 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4809999999999998e-06 2024-04-26T10:44:35.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.152 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:35.152 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526319+0000", 2024-04-26T10:44:35.152 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0690000000000003e-06 2024-04-26T10:44:35.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.152 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:35.152 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526321+0000", 2024-04-26T10:44:35.152 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4880000000000001e-06 2024-04-26T10:44:35.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.153 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:35.153 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553856+0000", 2024-04-26T10:44:35.153 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027534916 2024-04-26T10:44:35.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.153 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:35.153 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553900+0000", 2024-04-26T10:44:35.153 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3954e-05 2024-04-26T10:44:35.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.153 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:35.153 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553962+0000", 2024-04-26T10:44:35.153 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1519000000000005e-05 2024-04-26T10:44:35.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.154 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:35.154 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555348+0000", 2024-04-26T10:44:35.154 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013864579999999999 2024-04-26T10:44:35.154 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.154 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:35.154 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555378+0000", 2024-04-26T10:44:35.154 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9441000000000002e-05 2024-04-26T10:44:35.154 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.154 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:35.154 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555401+0000", 2024-04-26T10:44:35.154 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2815000000000001e-05 2024-04-26T10:44:35.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.155 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:35.155 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555420+0000", 2024-04-26T10:44:35.155 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9341e-05 2024-04-26T10:44:35.155 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.155 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:35.155 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.155 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:130 3.1a 3:5e41ab69:::200.00000005:head [write 3559243~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:35.155 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:35.155 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.614736819999999, 2024-04-26T10:44:35.155 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029188316999999998, 2024-04-26T10:44:35.155 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:35.156 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:35.156 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:35.156 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.156 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:35.156 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:35.156 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.156 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.157 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:35.157 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:35.157 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.158 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:35.158 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:35.158 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:35.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.158 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:35.158 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526325+0000", 2024-04-26T10:44:35.158 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4899999999999999e-06 2024-04-26T10:44:35.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.158 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:35.158 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526327+0000", 2024-04-26T10:44:35.158 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.745e-06 2024-04-26T10:44:35.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.159 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:35.159 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526330+0000", 2024-04-26T10:44:35.159 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5620000000000002e-06 2024-04-26T10:44:35.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.159 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:35.159 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554200+0000", 2024-04-26T10:44:35.159 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027869541000000001 2024-04-26T10:44:35.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.159 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:35.159 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554244+0000", 2024-04-26T10:44:35.159 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4464e-05 2024-04-26T10:44:35.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.160 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:35.160 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554304+0000", 2024-04-26T10:44:35.160 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9457999999999999e-05 2024-04-26T10:44:35.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.160 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:35.160 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555453+0000", 2024-04-26T10:44:35.160 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011494000000000001 2024-04-26T10:44:35.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.160 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:35.160 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555457+0000", 2024-04-26T10:44:35.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1779999999999996e-06 2024-04-26T10:44:35.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.161 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:35.161 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555480+0000", 2024-04-26T10:44:35.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2802e-05 2024-04-26T10:44:35.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.161 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:35.161 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555512+0000", 2024-04-26T10:44:35.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1885999999999999e-05 2024-04-26T10:44:35.161 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.161 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:35.161 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.162 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:131 3.1a 3:5e41ab69:::200.00000005:head [write 3560642~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:35.162 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:35.162 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.61472824, 2024-04-26T10:44:35.162 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029683102999999999, 2024-04-26T10:44:35.162 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:35.162 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:35.162 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:35.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.162 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:35.162 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:35.162 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.163 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:35.163 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:35.163 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.163 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:35.163 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:35.163 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:35.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.163 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:35.163 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526336+0000", 2024-04-26T10:44:35.163 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.681e-06 2024-04-26T10:44:35.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.164 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:35.164 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526338+0000", 2024-04-26T10:44:35.164 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8430000000000001e-06 2024-04-26T10:44:35.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.164 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:35.164 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526341+0000", 2024-04-26T10:44:35.164 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6180000000000002e-06 2024-04-26T10:44:35.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.164 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:35.164 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554745+0000", 2024-04-26T10:44:35.165 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028404088000000001 2024-04-26T10:44:35.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.165 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:35.165 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554788+0000", 2024-04-26T10:44:35.165 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2738999999999999e-05 2024-04-26T10:44:35.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.165 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:35.165 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554849+0000", 2024-04-26T10:44:35.165 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1362e-05 2024-04-26T10:44:35.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.165 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:35.166 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555963+0000", 2024-04-26T10:44:35.166 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001113597 2024-04-26T10:44:35.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.166 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:35.166 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555969+0000", 2024-04-26T10:44:35.166 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6900000000000003e-06 2024-04-26T10:44:35.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.166 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:35.166 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555995+0000", 2024-04-26T10:44:35.166 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5165999999999999e-05 2024-04-26T10:44:35.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.167 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:35.167 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556015+0000", 2024-04-26T10:44:35.167 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0522000000000001e-05 2024-04-26T10:44:35.167 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.167 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:35.167 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.167 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:132 3.1a 3:5e41ab69:::200.00000005:head [write 3562043~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:35.167 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:35.167 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.614707975, 2024-04-26T10:44:35.167 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030129895, 2024-04-26T10:44:35.167 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:35.168 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:35.168 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:35.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.168 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:35.168 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:35.168 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.168 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:35.168 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:35.168 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.168 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:35.168 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:35.169 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:35.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.169 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.169 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:35.169 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526354+0000", 2024-04-26T10:44:35.169 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8560000000000001e-06 2024-04-26T10:44:35.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.169 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.169 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:35.169 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526359+0000", 2024-04-26T10:44:35.169 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4700000000000001e-06 2024-04-26T10:44:35.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.169 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.170 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:35.170 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526365+0000", 2024-04-26T10:44:35.170 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2120000000000002e-06 2024-04-26T10:44:35.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.170 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.170 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:35.170 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555050+0000", 2024-04-26T10:44:35.170 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028685458 2024-04-26T10:44:35.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.170 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.170 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:35.170 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555093+0000", 2024-04-26T10:44:35.170 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3307999999999999e-05 2024-04-26T10:44:35.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.171 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:35.171 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555156+0000", 2024-04-26T10:44:35.171 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2396000000000004e-05 2024-04-26T10:44:35.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.171 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:35.171 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556052+0000", 2024-04-26T10:44:35.171 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00089650299999999999 2024-04-26T10:44:35.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.171 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:35.171 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556439+0000", 2024-04-26T10:44:35.172 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038647900000000001 2024-04-26T10:44:35.172 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.172 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.172 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:35.172 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556463+0000", 2024-04-26T10:44:35.172 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4071e-05 2024-04-26T10:44:35.172 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.172 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.172 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:35.172 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556482+0000", 2024-04-26T10:44:35.172 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9378999999999999e-05 2024-04-26T10:44:35.172 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.172 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:35.173 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.173 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 3563440~3660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:35.173 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:35.173 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.614691581000001, 2024-04-26T10:44:35.173 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030550738000000001, 2024-04-26T10:44:35.173 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:35.173 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:35.173 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:35.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.173 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:35.173 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:35.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.174 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:35.174 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:35.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.174 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:35.174 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526368+0000", 2024-04-26T10:44:35.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:35.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.174 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:35.175 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526375+0000", 2024-04-26T10:44:35.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7510000000000002e-06 2024-04-26T10:44:35.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.175 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:35.175 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526381+0000", 2024-04-26T10:44:35.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3929999999999996e-06 2024-04-26T10:44:35.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.175 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:35.175 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526387+0000", 2024-04-26T10:44:35.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.215e-06 2024-04-26T10:44:35.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.176 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:35.176 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555542+0000", 2024-04-26T10:44:35.176 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029154992000000001 2024-04-26T10:44:35.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.176 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:35.176 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555610+0000", 2024-04-26T10:44:35.176 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8610999999999998e-05 2024-04-26T10:44:35.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.176 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:35.176 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555681+0000", 2024-04-26T10:44:35.176 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1072e-05 2024-04-26T10:44:35.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.177 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:35.177 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556866+0000", 2024-04-26T10:44:35.177 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001184598 2024-04-26T10:44:35.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.177 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:35.177 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556872+0000", 2024-04-26T10:44:35.177 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.55e-06 2024-04-26T10:44:35.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.177 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:35.177 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556897+0000", 2024-04-26T10:44:35.177 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.516e-05 2024-04-26T10:44:35.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.178 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:35.178 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556919+0000", 2024-04-26T10:44:35.178 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1951e-05 2024-04-26T10:44:35.178 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.178 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:35.178 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.178 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:134 3.1a 3:5e41ab69:::200.00000005:head [write 3567100~2427 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:35.178 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:35.179 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.614658516, 2024-04-26T10:44:35.179 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031267445999999997, 2024-04-26T10:44:35.179 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:35.179 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:35.179 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:35.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.179 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:35.179 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:35.179 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.179 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:35.179 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:35.180 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.180 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:35.180 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526401+0000", 2024-04-26T10:44:35.180 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:35.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.180 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:35.180 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526408+0000", 2024-04-26T10:44:35.180 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7769999999999997e-06 2024-04-26T10:44:35.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.181 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:35.181 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526415+0000", 2024-04-26T10:44:35.181 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0720000000000002e-06 2024-04-26T10:44:35.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.181 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:35.181 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526421+0000", 2024-04-26T10:44:35.181 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9699999999999996e-06 2024-04-26T10:44:35.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.181 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:35.181 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556084+0000", 2024-04-26T10:44:35.181 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029662351999999999 2024-04-26T10:44:35.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.182 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:35.182 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556126+0000", 2024-04-26T10:44:35.182 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2385000000000002e-05 2024-04-26T10:44:35.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.182 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:35.182 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556186+0000", 2024-04-26T10:44:35.182 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9945999999999998e-05 2024-04-26T10:44:35.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.182 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:35.182 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557598+0000", 2024-04-26T10:44:35.183 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0014121559999999999 2024-04-26T10:44:35.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.183 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:35.183 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557626+0000", 2024-04-26T10:44:35.183 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7960999999999999e-05 2024-04-26T10:44:35.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.183 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:35.183 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557650+0000", 2024-04-26T10:44:35.183 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3969999999999999e-05 2024-04-26T10:44:35.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.183 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:35.184 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557669+0000", 2024-04-26T10:44:35.184 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9262e-05 2024-04-26T10:44:35.184 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.184 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:35.184 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.184 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.184 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:135 3.1a 3:5e41ab69:::200.00000005:head [write 3569527~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:35.184 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:35.184 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.61463425, 2024-04-26T10:44:35.184 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031322516000000002, 2024-04-26T10:44:35.184 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:35.184 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:35.184 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:35.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.185 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:35.185 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:35.185 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.185 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:35.185 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:35.185 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.185 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:35.185 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:35.185 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:35.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:35.186 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526429+0000", 2024-04-26T10:44:35.186 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0750000000000002e-06 2024-04-26T10:44:35.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:35.186 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526435+0000", 2024-04-26T10:44:35.186 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.263e-06 2024-04-26T10:44:35.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:35.186 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526442+0000", 2024-04-26T10:44:35.187 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1219999999999997e-06 2024-04-26T10:44:35.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.187 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:35.187 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556515+0000", 2024-04-26T10:44:35.187 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030073132999999998 2024-04-26T10:44:35.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.187 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:35.187 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556564+0000", 2024-04-26T10:44:35.187 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8871e-05 2024-04-26T10:44:35.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.187 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:35.188 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556625+0000", 2024-04-26T10:44:35.188 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1307000000000001e-05 2024-04-26T10:44:35.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.188 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:35.188 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557678+0000", 2024-04-26T10:44:35.188 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010523100000000001 2024-04-26T10:44:35.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.188 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:35.188 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557709+0000", 2024-04-26T10:44:35.188 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1748000000000002e-05 2024-04-26T10:44:35.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.188 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:35.189 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557732+0000", 2024-04-26T10:44:35.189 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2415000000000001e-05 2024-04-26T10:44:35.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.189 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.189 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:35.189 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557749+0000", 2024-04-26T10:44:35.189 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6736999999999999e-05 2024-04-26T10:44:35.189 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.189 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:35.189 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.189 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.189 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:136 3.1a 3:5e41ab69:::200.00000005:head [write 3571449~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:35.189 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:35.189 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.61461306, 2024-04-26T10:44:35.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032180937, 2024-04-26T10:44:35.190 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:35.190 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:35.190 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:35.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.190 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:35.190 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:35.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.190 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.190 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:35.190 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:35.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:35.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:35.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:35.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:35.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526455+0000", 2024-04-26T10:44:35.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6429999999999995e-06 2024-04-26T10:44:35.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:35.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526461+0000", 2024-04-26T10:44:35.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:35.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.192 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:35.192 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526467+0000", 2024-04-26T10:44:35.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4389999999999999e-06 2024-04-26T10:44:35.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.192 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:35.192 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556950+0000", 2024-04-26T10:44:35.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030483854000000001 2024-04-26T10:44:35.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.192 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:35.192 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556989+0000", 2024-04-26T10:44:35.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8415999999999999e-05 2024-04-26T10:44:35.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.193 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:35.193 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557051+0000", 2024-04-26T10:44:35.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2088999999999995e-05 2024-04-26T10:44:35.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.193 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:35.193 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558166+0000", 2024-04-26T10:44:35.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001114622 2024-04-26T10:44:35.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.193 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:35.193 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558584+0000", 2024-04-26T10:44:35.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000418033 2024-04-26T10:44:35.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.194 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:35.194 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558609+0000", 2024-04-26T10:44:35.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5344999999999999e-05 2024-04-26T10:44:35.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.194 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:35.194 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558628+0000", 2024-04-26T10:44:35.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9273999999999999e-05 2024-04-26T10:44:35.194 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.194 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:35.194 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.195 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:137 3.1a 3:5e41ab69:::200.00000005:head [write 3573699~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:35.195 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:35.195 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.614589411000001, 2024-04-26T10:44:35.195 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032241530999999997, 2024-04-26T10:44:35.195 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:35.195 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:35.195 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:35.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.195 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:35.195 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:35.195 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:35.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:35.196 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:35.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526470+0000", 2024-04-26T10:44:35.196 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:35.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:35.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526473+0000", 2024-04-26T10:44:35.196 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.818e-06 2024-04-26T10:44:35.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.197 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:35.197 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526480+0000", 2024-04-26T10:44:35.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4119999999999998e-06 2024-04-26T10:44:35.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.197 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:35.197 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526484+0000", 2024-04-26T10:44:35.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6840000000000004e-06 2024-04-26T10:44:35.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.197 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:35.197 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557323+0000", 2024-04-26T10:44:35.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030838956000000001 2024-04-26T10:44:35.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.198 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:35.198 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557362+0000", 2024-04-26T10:44:35.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8343999999999997e-05 2024-04-26T10:44:35.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.198 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:35.198 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557421+0000", 2024-04-26T10:44:35.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9176999999999999e-05 2024-04-26T10:44:35.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.198 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:35.198 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558636+0000", 2024-04-26T10:44:35.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012153789999999999 2024-04-26T10:44:35.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:35.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558668+0000", 2024-04-26T10:44:35.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1452999999999999e-05 2024-04-26T10:44:35.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:35.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558694+0000", 2024-04-26T10:44:35.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6288999999999999e-05 2024-04-26T10:44:35.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:35.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558712+0000", 2024-04-26T10:44:35.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8459000000000001e-05 2024-04-26T10:44:35.200 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.200 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:35.200 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.200 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:138 3.1a 3:5e41ab69:::200.00000005:head [write 3575103~4205 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:35.200 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:35.200 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.614572092, 2024-04-26T10:44:35.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032665567999999999, 2024-04-26T10:44:35.200 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:35.200 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:35.200 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:35.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:35.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:35.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:35.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:35.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:35.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:35.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:35.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.202 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:35.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526495+0000", 2024-04-26T10:44:35.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7580000000000003e-06 2024-04-26T10:44:35.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.202 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:35.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526501+0000", 2024-04-26T10:44:35.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1680000000000001e-06 2024-04-26T10:44:35.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.202 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:35.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526505+0000", 2024-04-26T10:44:35.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.673e-06 2024-04-26T10:44:35.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:35.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557781+0000", 2024-04-26T10:44:35.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031275718000000001 2024-04-26T10:44:35.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:35.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557825+0000", 2024-04-26T10:44:35.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4048000000000002e-05 2024-04-26T10:44:35.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:35.204 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557888+0000", 2024-04-26T10:44:35.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2562000000000002e-05 2024-04-26T10:44:35.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:35.204 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559073+0000", 2024-04-26T10:44:35.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011852239999999999 2024-04-26T10:44:35.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:35.204 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559112+0000", 2024-04-26T10:44:35.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9226e-05 2024-04-26T10:44:35.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.205 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:35.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559136+0000", 2024-04-26T10:44:35.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3966000000000001e-05 2024-04-26T10:44:35.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.205 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:35.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559154+0000", 2024-04-26T10:44:35.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7575e-05 2024-04-26T10:44:35.205 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.205 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:35.205 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.205 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:139 3.1a 3:5e41ab69:::200.00000005:head [write 3579308~2255 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:35.206 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:35.206 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.614550474, 2024-04-26T10:44:35.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033424720999999998, 2024-04-26T10:44:35.206 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:35.206 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:35.206 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:35.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:35.206 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:35.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:35.206 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:35.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:35.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526509+0000", 2024-04-26T10:44:35.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:35.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:35.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526516+0000", 2024-04-26T10:44:35.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5209999999999999e-06 2024-04-26T10:44:35.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:35.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526522+0000", 2024-04-26T10:44:35.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1229999999999997e-06 2024-04-26T10:44:35.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:35.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526527+0000", 2024-04-26T10:44:35.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7849999999999999e-06 2024-04-26T10:44:35.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:35.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558194+0000", 2024-04-26T10:44:35.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031667419000000002 2024-04-26T10:44:35.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.209 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:35.209 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558234+0000", 2024-04-26T10:44:35.209 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9774999999999998e-05 2024-04-26T10:44:35.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.209 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:35.209 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558294+0000", 2024-04-26T10:44:35.209 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0242999999999999e-05 2024-04-26T10:44:35.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.209 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:35.209 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559106+0000", 2024-04-26T10:44:35.209 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00081148099999999996 2024-04-26T10:44:35.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.210 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:35.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559890+0000", 2024-04-26T10:44:35.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00078439999999999998 2024-04-26T10:44:35.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.210 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:35.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559917+0000", 2024-04-26T10:44:35.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7044000000000001e-05 2024-04-26T10:44:35.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.210 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:35.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559935+0000", 2024-04-26T10:44:35.211 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7448e-05 2024-04-26T10:44:35.211 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.211 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:35.211 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.211 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:140 3.1a 3:5e41ab69:::200.00000005:head [write 3581563~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:35.211 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:35.211 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.614529053, 2024-04-26T10:44:35.211 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033867728, 2024-04-26T10:44:35.211 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:35.211 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:35.211 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:35.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:35.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:35.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:35.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:35.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:35.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:35.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:35.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.213 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:35.213 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526538+0000", 2024-04-26T10:44:35.213 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.905e-06 2024-04-26T10:44:35.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.213 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:35.213 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526542+0000", 2024-04-26T10:44:35.213 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9550000000000002e-06 2024-04-26T10:44:35.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.213 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:35.214 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526545+0000", 2024-04-26T10:44:35.214 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8499999999999998e-06 2024-04-26T10:44:35.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.214 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:35.214 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558744+0000", 2024-04-26T10:44:35.214 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032198986999999998 2024-04-26T10:44:35.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.214 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:35.214 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558788+0000", 2024-04-26T10:44:35.214 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4365e-05 2024-04-26T10:44:35.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.215 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:35.215 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558854+0000", 2024-04-26T10:44:35.215 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5952999999999997e-05 2024-04-26T10:44:35.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.215 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:35.215 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559971+0000", 2024-04-26T10:44:35.215 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011172770000000001 2024-04-26T10:44:35.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.215 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:35.215 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560354+0000", 2024-04-26T10:44:35.215 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038267599999999998 2024-04-26T10:44:35.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.216 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:35.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560380+0000", 2024-04-26T10:44:35.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6140999999999999e-05 2024-04-26T10:44:35.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.216 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:35.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560399+0000", 2024-04-26T10:44:35.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9032999999999999e-05 2024-04-26T10:44:35.216 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.216 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:35.216 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.217 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:141 3.1a 3:5e41ab69:::200.00000005:head [write 3583482~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:35.217 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:35.217 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.614513393999999, 2024-04-26T10:44:35.217 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034316301, 2024-04-26T10:44:35.217 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:35.217 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:35.217 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:35.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.217 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:35.217 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:35.217 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.218 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:35.218 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:35.218 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.218 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:35.218 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:35.218 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:35.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.218 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:35.219 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526548+0000", 2024-04-26T10:44:35.219 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.739e-06 2024-04-26T10:44:35.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:35.219 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526551+0000", 2024-04-26T10:44:35.219 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.044e-06 2024-04-26T10:44:35.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:35.219 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526562+0000", 2024-04-26T10:44:35.219 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0370000000000001e-05 2024-04-26T10:44:35.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559179+0000", 2024-04-26T10:44:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032617444000000002 2024-04-26T10:44:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559220+0000", 2024-04-26T10:44:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0364999999999997e-05 2024-04-26T10:44:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559280+0000", 2024-04-26T10:44:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0569000000000002e-05 2024-04-26T10:44:35.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.221 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:35.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560814+0000", 2024-04-26T10:44:35.221 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015337580000000001 2024-04-26T10:44:35.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.221 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:35.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560820+0000", 2024-04-26T10:44:35.221 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.455e-06 2024-04-26T10:44:35.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.221 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:35.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560846+0000", 2024-04-26T10:44:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5228999999999998e-05 2024-04-26T10:44:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560863+0000", 2024-04-26T10:44:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7555e-05 2024-04-26T10:44:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:142 3.1a 3:5e41ab69:::200.00000005:head [write 3585931~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:35.222 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.614492996999999, 2024-04-26T10:44:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034372373999999997, 2024-04-26T10:44:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526573+0000", 2024-04-26T10:44:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0800000000000002e-06 2024-04-26T10:44:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526580+0000", 2024-04-26T10:44:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5799999999999997e-06 2024-04-26T10:44:35.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526585+0000", 2024-04-26T10:44:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2270000000000001e-06 2024-04-26T10:44:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559601+0000", 2024-04-26T10:44:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033016684999999997 2024-04-26T10:44:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559642+0000", 2024-04-26T10:44:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0321000000000002e-05 2024-04-26T10:44:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559706+0000", 2024-04-26T10:44:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4228999999999998e-05 2024-04-26T10:44:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560871+0000", 2024-04-26T10:44:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001164893 2024-04-26T10:44:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:35.226 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560899+0000", 2024-04-26T10:44:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560922+0000", 2024-04-26T10:44:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3337999999999999e-05 2024-04-26T10:44:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560940+0000", 2024-04-26T10:44:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7289999999999999e-05 2024-04-26T10:44:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.227 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:143 3.1a 3:5e41ab69:::200.00000005:head [write 3587331~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.614471098999999, 2024-04-26T10:44:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035256000000000003, 2024-04-26T10:44:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:35.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.229 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526592+0000", 2024-04-26T10:44:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2449999999999998e-06 2024-04-26T10:44:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526596+0000", 2024-04-26T10:44:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7000000000000002e-06 2024-04-26T10:44:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526599+0000", 2024-04-26T10:44:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6160000000000002e-06 2024-04-26T10:44:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559997+0000", 2024-04-26T10:44:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033397835000000001 2024-04-26T10:44:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560051+0000", 2024-04-26T10:44:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3742000000000001e-05 2024-04-26T10:44:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560112+0000", 2024-04-26T10:44:35.231 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0851999999999999e-05 2024-04-26T10:44:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561404+0000", 2024-04-26T10:44:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001291869 2024-04-26T10:44:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561797+0000", 2024-04-26T10:44:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039383000000000002 2024-04-26T10:44:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:35.232 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561827+0000", 2024-04-26T10:44:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9247e-05 2024-04-26T10:44:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561845+0000", 2024-04-26T10:44:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8462999999999999e-05 2024-04-26T10:44:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:144 3.1a 3:5e41ab69:::200.00000005:head [write 3588736~4987 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:35.233 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.614348807000001, 2024-04-26T10:44:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035224283000000002, 2024-04-26T10:44:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.234 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526718+0000", 2024-04-26T10:44:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.43e-06 2024-04-26T10:44:35.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526726+0000", 2024-04-26T10:44:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:44:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526729+0000", 2024-04-26T10:44:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6480000000000001e-06 2024-04-26T10:44:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560427+0000", 2024-04-26T10:44:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033697280000000003 2024-04-26T10:44:35.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.237 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:35.237 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560466+0000", 2024-04-26T10:44:35.237 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9606e-05 2024-04-26T10:44:35.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.237 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:35.237 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560525+0000", 2024-04-26T10:44:35.237 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9218000000000001e-05 2024-04-26T10:44:35.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.237 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:35.237 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561854+0000", 2024-04-26T10:44:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001328421 2024-04-26T10:44:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561887+0000", 2024-04-26T10:44:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2746000000000001e-05 2024-04-26T10:44:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561912+0000", 2024-04-26T10:44:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5126999999999998e-05 2024-04-26T10:44:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:35.238 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561936+0000", 2024-04-26T10:44:35.239 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4032999999999998e-05 2024-04-26T10:44:35.239 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.239 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:35.239 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.239 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:145 3.1a 3:5e41ab69:::200.00000005:head [write 3593723~2939 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:35.239 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:35.239 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.611429762, 2024-04-26T10:44:35.239 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033294394999999997, 2024-04-26T10:44:35.239 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:35.239 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:35.239 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:35.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529630+0000", 2024-04-26T10:44:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:35.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529635+0000", 2024-04-26T10:44:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7960000000000003e-06 2024-04-26T10:44:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529643+0000", 2024-04-26T10:44:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0390000000000005e-06 2024-04-26T10:44:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529648+0000", 2024-04-26T10:44:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9599999999999999e-06 2024-04-26T10:44:35.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.242 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:35.242 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560969+0000", 2024-04-26T10:44:35.242 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031321767 2024-04-26T10:44:35.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.242 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:35.242 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561009+0000", 2024-04-26T10:44:35.242 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9904999999999998e-05 2024-04-26T10:44:35.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.242 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:35.242 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561070+0000", 2024-04-26T10:44:35.243 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0708999999999998e-05 2024-04-26T10:44:35.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.243 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:35.243 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562352+0000", 2024-04-26T10:44:35.243 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012818440000000001 2024-04-26T10:44:35.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.243 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:35.243 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562867+0000", 2024-04-26T10:44:35.243 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000515665 2024-04-26T10:44:35.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.243 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562893+0000", 2024-04-26T10:44:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5469999999999998e-05 2024-04-26T10:44:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562925+0000", 2024-04-26T10:44:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1974999999999998e-05 2024-04-26T10:44:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:146 3.1a 3:5e41ab69:::200.00000005:head [write 3596662~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:35.244 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:35.245 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.611201548, 2024-04-26T10:44:35.245 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033178429000000002, 2024-04-26T10:44:35.245 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:35.245 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:35.245 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:35.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.245 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:35.245 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:35.245 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.245 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:35.246 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:35.246 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.246 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:35.246 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529858+0000", 2024-04-26T10:44:35.246 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:35.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.246 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:35.246 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529863+0000", 2024-04-26T10:44:35.246 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4500000000000003e-06 2024-04-26T10:44:35.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.247 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:35.247 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529874+0000", 2024-04-26T10:44:35.247 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0552e-05 2024-04-26T10:44:35.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.247 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:35.247 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529882+0000", 2024-04-26T10:44:35.247 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4449999999999996e-06 2024-04-26T10:44:35.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.247 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:35.247 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561452+0000", 2024-04-26T10:44:35.248 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031569680000000003 2024-04-26T10:44:35.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.248 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:35.248 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561511+0000", 2024-04-26T10:44:35.248 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9332e-05 2024-04-26T10:44:35.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.248 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:35.248 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561583+0000", 2024-04-26T10:44:35.248 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1730000000000006e-05 2024-04-26T10:44:35.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.249 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:35.249 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562933+0000", 2024-04-26T10:44:35.249 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013500059999999999 2024-04-26T10:44:35.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.249 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:35.249 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562976+0000", 2024-04-26T10:44:35.249 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2987e-05 2024-04-26T10:44:35.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.249 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:35.249 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563015+0000", 2024-04-26T10:44:35.250 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9453999999999999e-05 2024-04-26T10:44:35.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.250 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:35.250 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563037+0000", 2024-04-26T10:44:35.250 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1679e-05 2024-04-26T10:44:35.250 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.250 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:35.250 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.251 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:277 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:35.251 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:35.251 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.626190845, 2024-04-26T10:44:35.251 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030430563000000001, 2024-04-26T10:44:35.252 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:35.252 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:35.252 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:35.252 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.252 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:35.252 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:35.252 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.253 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.253 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:35.253 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:35.253 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:35.253 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.253 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.254 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:35.254 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514867+0000", 2024-04-26T10:44:35.254 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:35.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.254 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.254 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:35.255 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515460+0000", 2024-04-26T10:44:35.255 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00059285800000000004 2024-04-26T10:44:35.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.255 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.255 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:35.255 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515474+0000", 2024-04-26T10:44:35.255 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3933e-05 2024-04-26T10:44:35.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.256 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.256 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:35.256 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515481+0000", 2024-04-26T10:44:35.256 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:35.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.256 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.257 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:35.257 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515522+0000", 2024-04-26T10:44:35.257 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1369000000000003e-05 2024-04-26T10:44:35.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.257 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.257 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:35.257 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515591+0000", 2024-04-26T10:44:35.257 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9377999999999999e-05 2024-04-26T10:44:35.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.258 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.258 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:35.258 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.526440+0000", 2024-04-26T10:44:35.258 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010848837 2024-04-26T10:44:35.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.258 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.258 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:35.259 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.543866+0000", 2024-04-26T10:44:35.259 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017426288000000002 2024-04-26T10:44:35.259 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.259 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:35.259 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545193+0000", 2024-04-26T10:44:35.260 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001326111 2024-04-26T10:44:35.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.260 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:35.260 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545229+0000", 2024-04-26T10:44:35.261 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6390999999999998e-05 2024-04-26T10:44:35.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:35.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:35.261 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:35.261 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545300+0000", 2024-04-26T10:44:35.261 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1073000000000002e-05 2024-04-26T10:44:35.262 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.262 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:35.262 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.263 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:35.263 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:35.263 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:35.270 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:35.271 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:35.264+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:35.365 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:35.364+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:35.376 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:35.376 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:35.376 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:44:35.376 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:35.384 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:35.435 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:44:35.469 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:35.468+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:35.527 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:35.528 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:35.528 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:35.528 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:35.528 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:35.537 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:35.567 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:35.565+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:35.574 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:35.575 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:35.575 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:35.595 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:35.595 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:35.598 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:35.599 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:35.668 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:35.666+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:35.679 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:35.679 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:35.687 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:35.770 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:35.768+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:35.801 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:35.801 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:35.811 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:35.871 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:35.870+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:35.888 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T10:44:35.888 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T10:44:35.961 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:35.962 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:35.971 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:35.972 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:35.971+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:36.073 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:36.071+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:36.080 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:36.080 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:36.089 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:36.175 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:36.173+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:36.246 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:36.246 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:36.260 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:36.275 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:36.273+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:36.363 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:36.363 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:36.372 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:36.375 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:36.374+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:36.464 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:44:36.475 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:36.475 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:36.476 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:36.474+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:36.484 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:36.577 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:36.576+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:36.601 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:36.602 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:36.611 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:36.678 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:36.676+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:36.718 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:36.718 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:36.728 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:36.778 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:36.777+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:36.879 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:36.878+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:36.883 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:36.883 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:36.894 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:36.981 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:36.979+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:36.996 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:36.996 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:37.005 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:37.082 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:37.080+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:37.107 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:37.107 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:37.116 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:37.183 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:37.181+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:37.265 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:37.265 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:37.277 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:37.318 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:37.317+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:37.384 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:37.383+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:37.446 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:37.447 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:37.455 INFO:teuthology.orchestra.run.smithi049.stderr:nodeep-scrub is set 2024-04-26T10:44:37.457 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:37.486 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:37.484+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:37.573 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:37.574 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:37.583 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:37.587 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:37.585+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:37.599 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:44:37.688 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:37.686+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:37.690 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:37.690 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:37.700 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:37.736 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:37.737 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:37.737 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:37.756 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:37.756 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:37.759 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:37.760 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:37.790 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:37.789+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:37.803 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:37.803 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:37.803 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:44:37.803 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:37.812 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:37.891 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:37.890+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:37.915 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:37.915 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:37.915 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:37.915 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:37.915 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:37.924 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:37.992 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:37.991+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:38.028 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:38.029 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:38.029 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:38.029 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:38.029 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.029 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:330 3.13 3:ceffbd45:::200.0000000a:head [write 1316140~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:38.029 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:38.029 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 11.512722870999999, 2024-04-26T10:44:38.029 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022245654, 2024-04-26T10:44:38.030 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:38.030 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.030 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:38.030 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.030 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:38.030 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:38.030 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.030 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.030 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.030 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:38.030 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:38.030 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.031 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.031 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:38.031 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513139+0000", 2024-04-26T10:44:38.031 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:38.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.031 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.031 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:38.031 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513149+0000", 2024-04-26T10:44:38.031 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7550000000000006e-06 2024-04-26T10:44:38.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.032 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:38.032 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513157+0000", 2024-04-26T10:44:38.032 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1089999999999998e-06 2024-04-26T10:44:38.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.032 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.032 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513167+0000", 2024-04-26T10:44:38.032 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0539e-05 2024-04-26T10:44:38.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.032 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:38.033 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533830+0000", 2024-04-26T10:44:38.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020662852999999998 2024-04-26T10:44:38.033 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.033 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.033 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:38.033 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533875+0000", 2024-04-26T10:44:38.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.5071999999999998e-05 2024-04-26T10:44:38.033 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.033 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.033 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:38.033 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535319+0000", 2024-04-26T10:44:38.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001443578 2024-04-26T10:44:38.034 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.034 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.034 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:38.034 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535346+0000", 2024-04-26T10:44:38.034 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7415000000000001e-05 2024-04-26T10:44:38.034 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.034 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.034 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:38.034 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535385+0000", 2024-04-26T10:44:38.034 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8912999999999998e-05 2024-04-26T10:44:38.034 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.034 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:38.035 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.035 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.035 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.035 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:331 3.13 3:ceffbd45:::200.0000000a:head [write 1318049~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:38.035 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:38.035 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 11.512683543, 2024-04-26T10:44:38.035 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023524521, 2024-04-26T10:44:38.035 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:38.035 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.035 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:38.035 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.035 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:38.036 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:38.036 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.036 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.036 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.036 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:38.036 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:38.036 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.036 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.036 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.036 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:38.036 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513178+0000", 2024-04-26T10:44:38.036 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:38.037 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.037 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.037 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:38.037 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513183+0000", 2024-04-26T10:44:38.037 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2549999999999999e-06 2024-04-26T10:44:38.037 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.037 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.037 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:38.038 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513190+0000", 2024-04-26T10:44:38.038 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8460000000000002e-06 2024-04-26T10:44:38.038 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.038 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.038 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.038 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513195+0000", 2024-04-26T10:44:38.038 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3630000000000002e-06 2024-04-26T10:44:38.038 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.038 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.038 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:38.038 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534463+0000", 2024-04-26T10:44:38.038 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021267823000000002 2024-04-26T10:44:38.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.039 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:38.039 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534520+0000", 2024-04-26T10:44:38.039 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7510000000000003e-05 2024-04-26T10:44:38.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.039 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:38.039 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536634+0000", 2024-04-26T10:44:38.039 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0021138900000000002 2024-04-26T10:44:38.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.039 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:38.040 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536663+0000", 2024-04-26T10:44:38.040 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8884e-05 2024-04-26T10:44:38.040 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.040 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.040 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:38.040 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536703+0000", 2024-04-26T10:44:38.040 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0479000000000003e-05 2024-04-26T10:44:38.040 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.040 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:38.040 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.040 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.040 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.041 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:332 3.13 3:ceffbd45:::200.0000000a:head [write 1319462~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:38.041 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:38.041 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 11.512648710000001, 2024-04-26T10:44:38.041 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024543230999999999, 2024-04-26T10:44:38.041 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:38.041 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.041 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:38.041 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.041 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:38.041 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:38.041 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.041 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.041 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:38.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:38.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.042 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.042 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:38.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513213+0000", 2024-04-26T10:44:38.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:38.042 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.042 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:38.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513217+0000", 2024-04-26T10:44:38.043 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:44:38.043 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.043 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.043 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:38.043 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513229+0000", 2024-04-26T10:44:38.043 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2051e-05 2024-04-26T10:44:38.043 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.043 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.043 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.043 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513236+0000", 2024-04-26T10:44:38.043 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4470000000000003e-06 2024-04-26T10:44:38.043 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.044 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.044 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:38.044 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534891+0000", 2024-04-26T10:44:38.044 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021655863000000001 2024-04-26T10:44:38.044 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.044 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.044 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:38.044 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534933+0000", 2024-04-26T10:44:38.044 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1596e-05 2024-04-26T10:44:38.044 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.044 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.044 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:38.044 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537677+0000", 2024-04-26T10:44:38.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027440989999999998 2024-04-26T10:44:38.045 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.045 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.045 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:38.045 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537721+0000", 2024-04-26T10:44:38.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3813999999999998e-05 2024-04-26T10:44:38.045 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.045 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.045 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:38.045 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537757+0000", 2024-04-26T10:44:38.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6022999999999997e-05 2024-04-26T10:44:38.046 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.046 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:38.046 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.046 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.046 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.046 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:333 3.13 3:ceffbd45:::200.0000000a:head [write 1320870~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:38.046 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:38.046 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 11.512605791, 2024-04-26T10:44:38.046 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024557151999999999, 2024-04-26T10:44:38.046 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:38.046 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.047 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:38.047 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.047 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:38.047 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:38.047 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.047 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.047 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.047 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:38.047 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:38.047 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.047 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.047 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.048 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:38.048 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513256+0000", 2024-04-26T10:44:38.048 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:38.048 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.048 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.048 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:38.048 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513260+0000", 2024-04-26T10:44:38.048 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6550000000000002e-06 2024-04-26T10:44:38.048 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.048 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.048 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:38.048 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513273+0000", 2024-04-26T10:44:38.049 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2965e-05 2024-04-26T10:44:38.049 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.049 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.049 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.049 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513279+0000", 2024-04-26T10:44:38.049 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:44:38.049 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.049 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.049 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:38.049 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535411+0000", 2024-04-26T10:44:38.049 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022132233000000001 2024-04-26T10:44:38.049 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.049 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.050 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:38.050 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535479+0000", 2024-04-26T10:44:38.050 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7554999999999999e-05 2024-04-26T10:44:38.050 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.050 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:38.050 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537762+0000", 2024-04-26T10:44:38.050 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022836499999999999 2024-04-26T10:44:38.050 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.050 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:38.051 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537783+0000", 2024-04-26T10:44:38.051 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0364e-05 2024-04-26T10:44:38.051 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.051 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.051 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:38.051 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537814+0000", 2024-04-26T10:44:38.051 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1170000000000001e-05 2024-04-26T10:44:38.051 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.051 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:38.051 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.051 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.051 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.051 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:334 3.13 3:ceffbd45:::200.0000000a:head [write 1322273~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:38.052 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:38.052 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 11.510769032000001, 2024-04-26T10:44:38.052 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022778731999999999, 2024-04-26T10:44:38.052 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:38.052 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.052 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:38.052 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.052 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:38.052 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:38.052 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.052 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.052 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.053 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:38.053 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:38.053 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.053 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.053 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.053 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:38.053 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:38.053 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:38.053 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.053 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.053 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:38.053 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515099+0000", 2024-04-26T10:44:38.054 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6599999999999998e-06 2024-04-26T10:44:38.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.054 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:38.054 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515112+0000", 2024-04-26T10:44:38.054 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2707e-05 2024-04-26T10:44:38.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.054 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.054 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515120+0000", 2024-04-26T10:44:38.054 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8509999999999999e-06 2024-04-26T10:44:38.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.055 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.055 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:38.055 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535792+0000", 2024-04-26T10:44:38.055 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020672209 2024-04-26T10:44:38.055 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.055 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.055 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:38.055 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535833+0000", 2024-04-26T10:44:38.055 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1415000000000002e-05 2024-04-26T10:44:38.055 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.055 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.055 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:38.055 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537818+0000", 2024-04-26T10:44:38.056 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0019850900000000001 2024-04-26T10:44:38.056 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.056 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:38.056 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537839+0000", 2024-04-26T10:44:38.056 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0068000000000002e-05 2024-04-26T10:44:38.056 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.056 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:38.057 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537872+0000", 2024-04-26T10:44:38.057 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3680999999999998e-05 2024-04-26T10:44:38.057 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.057 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:38.057 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.057 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.057 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.057 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:335 3.13 3:ceffbd45:::200.0000000a:head [write 1325230~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:38.057 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:38.057 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 11.510729933, 2024-04-26T10:44:38.058 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023487081, 2024-04-26T10:44:38.058 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:38.058 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.058 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:38.058 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.058 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:38.058 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:38.058 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.058 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.058 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.058 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:38.059 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:38.059 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.059 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.059 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.059 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:38.059 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515132+0000", 2024-04-26T10:44:38.059 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:38.059 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.060 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.060 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:38.060 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515136+0000", 2024-04-26T10:44:38.060 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0860000000000004e-06 2024-04-26T10:44:38.060 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.060 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.060 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:38.060 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515143+0000", 2024-04-26T10:44:38.060 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.0400000000000004e-06 2024-04-26T10:44:38.060 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.060 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.060 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.061 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515149+0000", 2024-04-26T10:44:38.061 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0789999999999997e-06 2024-04-26T10:44:38.061 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.061 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.061 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:38.061 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536200+0000", 2024-04-26T10:44:38.061 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021050993 2024-04-26T10:44:38.061 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.061 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.061 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:38.061 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536253+0000", 2024-04-26T10:44:38.061 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.2643999999999999e-05 2024-04-26T10:44:38.062 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.062 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.062 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:38.062 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538560+0000", 2024-04-26T10:44:38.062 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0023073389999999998 2024-04-26T10:44:38.062 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.062 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.062 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:38.062 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538584+0000", 2024-04-26T10:44:38.062 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3893999999999999e-05 2024-04-26T10:44:38.062 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.063 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.063 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:38.063 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538620+0000", 2024-04-26T10:44:38.063 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5611000000000002e-05 2024-04-26T10:44:38.063 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.063 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:38.063 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.063 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.063 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.063 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:336 3.13 3:ceffbd45:::200.0000000a:head [write 1327147~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:38.063 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:38.063 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 11.509397478, 2024-04-26T10:44:38.064 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027687066, 2024-04-26T10:44:38.064 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:38.064 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.064 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:38.064 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.064 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:38.064 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:38.064 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.064 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.064 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.064 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:38.064 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:38.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:38.065 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516464+0000", 2024-04-26T10:44:38.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:38.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:38.065 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516491+0000", 2024-04-26T10:44:38.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6539000000000001e-05 2024-04-26T10:44:38.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.066 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.066 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:38.066 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516500+0000", 2024-04-26T10:44:38.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5480000000000007e-06 2024-04-26T10:44:38.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.066 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.066 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.066 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516511+0000", 2024-04-26T10:44:38.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0719e-05 2024-04-26T10:44:38.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536737+0000", 2024-04-26T10:44:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020225770000000001 2024-04-26T10:44:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536783+0000", 2024-04-26T10:44:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6168999999999998e-05 2024-04-26T10:44:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.067 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544080+0000", 2024-04-26T10:44:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0072966799999999998 2024-04-26T10:44:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544111+0000", 2024-04-26T10:44:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1056999999999998e-05 2024-04-26T10:44:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:38.068 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544152+0000", 2024-04-26T10:44:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1452000000000002e-05 2024-04-26T10:44:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:337 3.13 3:ceffbd45:::200.0000000a:head [write 1342136~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 11.509344540000001, 2024-04-26T10:44:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027711237, 2024-04-26T10:44:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.069 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.070 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516517+0000", 2024-04-26T10:44:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516521+0000", 2024-04-26T10:44:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6200000000000001e-06 2024-04-26T10:44:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.071 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516528+0000", 2024-04-26T10:44:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8639999999999998e-06 2024-04-26T10:44:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516533+0000", 2024-04-26T10:44:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6310000000000002e-06 2024-04-26T10:44:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537231+0000", 2024-04-26T10:44:38.072 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020698613000000001 2024-04-26T10:44:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537273+0000", 2024-04-26T10:44:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1529000000000002e-05 2024-04-26T10:44:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544157+0000", 2024-04-26T10:44:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068847090000000001 2024-04-26T10:44:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.073 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544180+0000", 2024-04-26T10:44:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.2532e-05 2024-04-26T10:44:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544229+0000", 2024-04-26T10:44:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9190000000000002e-05 2024-04-26T10:44:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:38.074 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:338 3.13 3:ceffbd45:::200.0000000a:head [write 1344569~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 11.508678287, 2024-04-26T10:44:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027105598000000002, 2024-04-26T10:44:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:38.075 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517183+0000", 2024-04-26T10:44:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:38.076 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517188+0000", 2024-04-26T10:44:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7389999999999999e-06 2024-04-26T10:44:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517199+0000", 2024-04-26T10:44:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0652000000000001e-05 2024-04-26T10:44:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.077 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517206+0000", 2024-04-26T10:44:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6610000000000003e-06 2024-04-26T10:44:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537905+0000", 2024-04-26T10:44:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020699662000000001 2024-04-26T10:44:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:38.078 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537956+0000", 2024-04-26T10:44:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0954e-05 2024-04-26T10:44:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544233+0000", 2024-04-26T10:44:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062773009999999999 2024-04-26T10:44:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544258+0000", 2024-04-26T10:44:38.079 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4434999999999999e-05 2024-04-26T10:44:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544290+0000", 2024-04-26T10:44:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1918000000000002e-05 2024-04-26T10:44:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.080 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:339 3.13 3:ceffbd45:::200.0000000a:head [write 1346485~4322 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 11.507739794000001, 2024-04-26T10:44:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026221617999999999, 2024-04-26T10:44:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.081 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518122+0000", 2024-04-26T10:44:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.082 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:38.083 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518129+0000", 2024-04-26T10:44:38.083 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.43e-06 2024-04-26T10:44:38.083 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.083 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.083 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:38.083 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518138+0000", 2024-04-26T10:44:38.083 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9129999999999992e-06 2024-04-26T10:44:38.083 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.083 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518144+0000", 2024-04-26T10:44:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.1419999999999998e-06 2024-04-26T10:44:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538232+0000", 2024-04-26T10:44:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020087383 2024-04-26T10:44:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.084 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538274+0000", 2024-04-26T10:44:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2602999999999999e-05 2024-04-26T10:44:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544294+0000", 2024-04-26T10:44:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060194059999999997 2024-04-26T10:44:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544314+0000", 2024-04-26T10:44:38.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0091000000000001e-05 2024-04-26T10:44:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544344+0000", 2024-04-26T10:44:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0446e-05 2024-04-26T10:44:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.086 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:340 3.13 3:ceffbd45:::200.0000000a:head [write 1350807~2768 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 11.505255558, 2024-04-26T10:44:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023795594, 2024-04-26T10:44:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.087 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520606+0000", 2024-04-26T10:44:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.088 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520612+0000", 2024-04-26T10:44:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.835e-06 2024-04-26T10:44:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520622+0000", 2024-04-26T10:44:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0173999999999999e-05 2024-04-26T10:44:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.089 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520629+0000", 2024-04-26T10:44:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7460000000000003e-06 2024-04-26T10:44:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538651+0000", 2024-04-26T10:44:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018022474 2024-04-26T10:44:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538697+0000", 2024-04-26T10:44:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6183999999999997e-05 2024-04-26T10:44:38.090 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544348+0000", 2024-04-26T10:44:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0056503509999999996 2024-04-26T10:44:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544369+0000", 2024-04-26T10:44:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1064999999999999e-05 2024-04-26T10:44:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.091 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544403+0000", 2024-04-26T10:44:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3695000000000002e-05 2024-04-26T10:44:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:341 3.13 3:ceffbd45:::200.0000000a:head [write 1353575~3816 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 11.504520303, 2024-04-26T10:44:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023114967, 2024-04-26T10:44:38.092 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.093 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521341+0000", 2024-04-26T10:44:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521349+0000", 2024-04-26T10:44:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1550000000000001e-06 2024-04-26T10:44:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:38.094 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521358+0000", 2024-04-26T10:44:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.1500000000000005e-06 2024-04-26T10:44:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521364+0000", 2024-04-26T10:44:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3289999999999999e-06 2024-04-26T10:44:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539010+0000", 2024-04-26T10:44:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.017645965999999999 2024-04-26T10:44:38.095 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.096 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.096 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:38.096 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539051+0000", 2024-04-26T10:44:38.096 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.053e-05 2024-04-26T10:44:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544407+0000", 2024-04-26T10:44:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053560209999999999 2024-04-26T10:44:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544427+0000", 2024-04-26T10:44:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0228e-05 2024-04-26T10:44:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.097 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544457+0000", 2024-04-26T10:44:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0375e-05 2024-04-26T10:44:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11582 4.2f 4:f76ba295:::10000003252.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 9.0309047580000001, 2024-04-26T10:44:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024553994999999999, 2024-04-26T10:44:38.098 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11582 2024-04-26T10:44:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:38.099 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994957+0000", 2024-04-26T10:44:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.100 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002755+0000", 2024-04-26T10:44:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0077984719999999999 2024-04-26T10:44:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002770+0000", 2024-04-26T10:44:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4956e-05 2024-04-26T10:44:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002777+0000", 2024-04-26T10:44:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1899999999999998e-06 2024-04-26T10:44:38.101 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002833+0000", 2024-04-26T10:44:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5189999999999998e-05 2024-04-26T10:44:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002977+0000", 2024-04-26T10:44:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014444100000000001 2024-04-26T10:44:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:38.102 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.003108+0000", 2024-04-26T10:44:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000131068 2024-04-26T10:44:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.009040+0000", 2024-04-26T10:44:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059314149999999998 2024-04-26T10:44:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019462+0000", 2024-04-26T10:44:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010422803 2024-04-26T10:44:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.103 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019490+0000", 2024-04-26T10:44:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7773999999999999e-05 2024-04-26T10:44:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019512+0000", 2024-04-26T10:44:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1611999999999999e-05 2024-04-26T10:44:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.104 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11911 4.37 4:ec04ab04:::100000031ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.6891845510000003, 2024-04-26T10:44:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026810273999999999, 2024-04-26T10:44:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11911 2024-04-26T10:44:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:38.105 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336676+0000", 2024-04-26T10:44:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.106 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343119+0000", 2024-04-26T10:44:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0064424850000000004 2024-04-26T10:44:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343131+0000", 2024-04-26T10:44:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1708e-05 2024-04-26T10:44:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343137+0000", 2024-04-26T10:44:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9880000000000001e-06 2024-04-26T10:44:38.107 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343175+0000", 2024-04-26T10:44:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7913000000000001e-05 2024-04-26T10:44:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343269+0000", 2024-04-26T10:44:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4931000000000003e-05 2024-04-26T10:44:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343392+0000", 2024-04-26T10:44:38.108 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000122435 2024-04-26T10:44:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.347520+0000", 2024-04-26T10:44:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004128418 2024-04-26T10:44:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363410+0000", 2024-04-26T10:44:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.015889309000000001 2024-04-26T10:44:38.109 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363453+0000", 2024-04-26T10:44:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3244000000000001e-05 2024-04-26T10:44:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363488+0000", 2024-04-26T10:44:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5318000000000003e-05 2024-04-26T10:44:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.110 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12000 4.3c 4:3c2be35d:::100000030f7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.6065630389999992, 2024-04-26T10:44:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022808264000000002, 2024-04-26T10:44:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12000 2024-04-26T10:44:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.111 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.112 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430937+0000", 2024-04-26T10:44:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.011638097 2024-04-26T10:44:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430948+0000", 2024-04-26T10:44:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0824e-05 2024-04-26T10:44:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430953+0000", 2024-04-26T10:44:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5219999999999998e-06 2024-04-26T10:44:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430990+0000", 2024-04-26T10:44:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6458999999999998e-05 2024-04-26T10:44:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.431052+0000", 2024-04-26T10:44:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2687000000000005e-05 2024-04-26T10:44:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442027+0000", 2024-04-26T10:44:38.114 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010974513 2024-04-26T10:44:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442060+0000", 2024-04-26T10:44:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2849999999999999e-05 2024-04-26T10:44:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442108+0000", 2024-04-26T10:44:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8031999999999997e-05 2024-04-26T10:44:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.115 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12042 4.2f 4:f741970f:::10000003414.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.5673095620000002, 2024-04-26T10:44:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.029390757, 2024-04-26T10:44:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12042 2024-04-26T10:44:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.116 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458552+0000", 2024-04-26T10:44:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.117 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464335+0000", 2024-04-26T10:44:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.005783168 2024-04-26T10:44:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464347+0000", 2024-04-26T10:44:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1578e-05 2024-04-26T10:44:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.118 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464353+0000", 2024-04-26T10:44:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3709999999999996e-06 2024-04-26T10:44:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464407+0000", 2024-04-26T10:44:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3717000000000001e-05 2024-04-26T10:44:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464556+0000", 2024-04-26T10:44:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014899100000000001 2024-04-26T10:44:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:38.119 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464688+0000", 2024-04-26T10:44:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013238599999999999 2024-04-26T10:44:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.469725+0000", 2024-04-26T10:44:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0050369229999999996 2024-04-26T10:44:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487892+0000", 2024-04-26T10:44:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018167184999999999 2024-04-26T10:44:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:38.120 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487922+0000", 2024-04-26T10:44:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.9495000000000001e-05 2024-04-26T10:44:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487944+0000", 2024-04-26T10:44:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1823000000000001e-05 2024-04-26T10:44:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12050 4.2c 4:36b72e58:::100000031ba.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:38.121 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.5587689529999995, 2024-04-26T10:44:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022722497000000001, 2024-04-26T10:44:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12050 2024-04-26T10:44:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.122 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467093+0000", 2024-04-26T10:44:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476305+0000", 2024-04-26T10:44:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092125850000000006 2024-04-26T10:44:38.123 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476322+0000", 2024-04-26T10:44:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6860000000000001e-05 2024-04-26T10:44:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476328+0000", 2024-04-26T10:44:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.587e-06 2024-04-26T10:44:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476378+0000", 2024-04-26T10:44:38.124 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0519999999999997e-05 2024-04-26T10:44:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476474+0000", 2024-04-26T10:44:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5556000000000005e-05 2024-04-26T10:44:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489677+0000", 2024-04-26T10:44:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013203048 2024-04-26T10:44:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:38.125 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489722+0000", 2024-04-26T10:44:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4650000000000001e-05 2024-04-26T10:44:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489816+0000", 2024-04-26T10:44:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4402999999999997e-05 2024-04-26T10:44:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12516 4.37 4:ed0cb515:::10000003324.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:38.126 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.0386873879999996, 2024-04-26T10:44:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.030139677, 2024-04-26T10:44:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12516 2024-04-26T10:44:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.127 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987173+0000", 2024-04-26T10:44:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991339+0000", 2024-04-26T10:44:38.128 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0041663760000000003 2024-04-26T10:44:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991351+0000", 2024-04-26T10:44:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1333e-05 2024-04-26T10:44:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991357+0000", 2024-04-26T10:44:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3350000000000003e-06 2024-04-26T10:44:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991394+0000", 2024-04-26T10:44:38.129 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7054000000000001e-05 2024-04-26T10:44:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991495+0000", 2024-04-26T10:44:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000100386 2024-04-26T10:44:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991579+0000", 2024-04-26T10:44:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4295000000000005e-05 2024-04-26T10:44:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.130 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.996238+0000", 2024-04-26T10:44:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0046589309999999998 2024-04-26T10:44:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017237+0000", 2024-04-26T10:44:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020998993000000001 2024-04-26T10:44:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017280+0000", 2024-04-26T10:44:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3600000000000003e-05 2024-04-26T10:44:38.131 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017315+0000", 2024-04-26T10:44:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4381999999999997e-05 2024-04-26T10:44:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12644 4.37 4:ec5044d7:::100000032d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 7.8650145599999997, 2024-04-26T10:44:38.132 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.037018677, 2024-04-26T10:44:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12644 2024-04-26T10:44:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.133 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160847+0000", 2024-04-26T10:44:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170089+0000", 2024-04-26T10:44:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092424289999999999 2024-04-26T10:44:38.134 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170111+0000", 2024-04-26T10:44:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1733e-05 2024-04-26T10:44:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170124+0000", 2024-04-26T10:44:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.272e-05 2024-04-26T10:44:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170177+0000", 2024-04-26T10:44:38.135 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3745000000000001e-05 2024-04-26T10:44:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170350+0000", 2024-04-26T10:44:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017297699999999999 2024-04-26T10:44:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170458+0000", 2024-04-26T10:44:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000107583 2024-04-26T10:44:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:38.136 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.176693+0000", 2024-04-26T10:44:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062351799999999999 2024-04-26T10:44:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197774+0000", 2024-04-26T10:44:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021080471999999999 2024-04-26T10:44:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197824+0000", 2024-04-26T10:44:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0096000000000003e-05 2024-04-26T10:44:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:38.137 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197867+0000", 2024-04-26T10:44:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2882e-05 2024-04-26T10:44:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:13242 4.2f 4:f5e54bb5:::100000033c8.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 7.1867834220000004, 2024-04-26T10:44:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023873062, 2024-04-26T10:44:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.138 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 13242 2024-04-26T10:44:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:38.139 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839078+0000", 2024-04-26T10:44:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848098+0000", 2024-04-26T10:44:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090200750000000007 2024-04-26T10:44:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848108+0000", 2024-04-26T10:44:38.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.062e-05 2024-04-26T10:44:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848115+0000", 2024-04-26T10:44:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3040000000000001e-06 2024-04-26T10:44:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848157+0000", 2024-04-26T10:44:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2533000000000001e-05 2024-04-26T10:44:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:38.141 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848252+0000", 2024-04-26T10:44:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4480000000000003e-05 2024-04-26T10:44:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848393+0000", 2024-04-26T10:44:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000140863 2024-04-26T10:44:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.854434+0000", 2024-04-26T10:44:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060415590000000002 2024-04-26T10:44:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.142 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862894+0000", 2024-04-26T10:44:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0084598869999999993 2024-04-26T10:44:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862926+0000", 2024-04-26T10:44:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1473999999999997e-05 2024-04-26T10:44:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862952+0000", 2024-04-26T10:44:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6545000000000001e-05 2024-04-26T10:44:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:38.143 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.144 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:38.144 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:38.144 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:38.146 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:38.144+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:38.146 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:38.245 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~82s 2024-04-26T10:44:38.246 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:38.244+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:38.252 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:38.253 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:38.253 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:44:38.253 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:38.262 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:38.347 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:38.345+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:38.408 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:38.408 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:38.408 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:38.408 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:38.408 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:38.417 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:38.448 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:38.446+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:38.548 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:38.547+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:38.564 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:38.564 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:38.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:38.564 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:38.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.564 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:80 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:38.564 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.039688447, 2024-04-26T10:44:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029259192, 2024-04-26T10:44:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:38.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522252+0000", 2024-04-26T10:44:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523121+0000", 2024-04-26T10:44:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00086885100000000002 2024-04-26T10:44:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:38.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523133+0000", 2024-04-26T10:44:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2109999999999999e-05 2024-04-26T10:44:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523139+0000", 2024-04-26T10:44:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.541e-06 2024-04-26T10:44:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523176+0000", 2024-04-26T10:44:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6847999999999997e-05 2024-04-26T10:44:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523240+0000", 2024-04-26T10:44:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3941000000000003e-05 2024-04-26T10:44:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.536390+0000", 2024-04-26T10:44:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013150811 2024-04-26T10:44:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551071+0000", 2024-04-26T10:44:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014680021 2024-04-26T10:44:38.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551428+0000", 2024-04-26T10:44:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00035703900000000002 2024-04-26T10:44:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551462+0000", 2024-04-26T10:44:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4337e-05 2024-04-26T10:44:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551513+0000", 2024-04-26T10:44:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0875000000000003e-05 2024-04-26T10:44:38.569 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:129 3.1a 3:5e41ab69:::200.00000005:head [write 3557843~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.035630377, 2024-04-26T10:44:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029108253000000001, 2024-04-26T10:44:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:38.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526311+0000", 2024-04-26T10:44:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.571 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526315+0000", 2024-04-26T10:44:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4809999999999998e-06 2024-04-26T10:44:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526319+0000", 2024-04-26T10:44:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0690000000000003e-06 2024-04-26T10:44:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526321+0000", 2024-04-26T10:44:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4880000000000001e-06 2024-04-26T10:44:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553856+0000", 2024-04-26T10:44:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027534916 2024-04-26T10:44:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553900+0000", 2024-04-26T10:44:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3954e-05 2024-04-26T10:44:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553962+0000", 2024-04-26T10:44:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1519000000000005e-05 2024-04-26T10:44:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555348+0000", 2024-04-26T10:44:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013864579999999999 2024-04-26T10:44:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555378+0000", 2024-04-26T10:44:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9441000000000002e-05 2024-04-26T10:44:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555401+0000", 2024-04-26T10:44:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2815000000000001e-05 2024-04-26T10:44:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555420+0000", 2024-04-26T10:44:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9341e-05 2024-04-26T10:44:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:130 3.1a 3:5e41ab69:::200.00000005:head [write 3559243~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.035618542000002, 2024-04-26T10:44:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029188316999999998, 2024-04-26T10:44:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.575 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:38.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526325+0000", 2024-04-26T10:44:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4899999999999999e-06 2024-04-26T10:44:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526327+0000", 2024-04-26T10:44:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.745e-06 2024-04-26T10:44:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526330+0000", 2024-04-26T10:44:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5620000000000002e-06 2024-04-26T10:44:38.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554200+0000", 2024-04-26T10:44:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027869541000000001 2024-04-26T10:44:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554244+0000", 2024-04-26T10:44:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4464e-05 2024-04-26T10:44:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:38.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554304+0000", 2024-04-26T10:44:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9457999999999999e-05 2024-04-26T10:44:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555453+0000", 2024-04-26T10:44:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011494000000000001 2024-04-26T10:44:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555457+0000", 2024-04-26T10:44:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1779999999999996e-06 2024-04-26T10:44:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:38.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555480+0000", 2024-04-26T10:44:38.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2802e-05 2024-04-26T10:44:38.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.580 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:38.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555512+0000", 2024-04-26T10:44:38.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1885999999999999e-05 2024-04-26T10:44:38.580 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.580 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:131 3.1a 3:5e41ab69:::200.00000005:head [write 3560642~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.035609961999999, 2024-04-26T10:44:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029683102999999999, 2024-04-26T10:44:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:38.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:38.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526336+0000", 2024-04-26T10:44:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.681e-06 2024-04-26T10:44:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526338+0000", 2024-04-26T10:44:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8430000000000001e-06 2024-04-26T10:44:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526341+0000", 2024-04-26T10:44:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6180000000000002e-06 2024-04-26T10:44:38.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554745+0000", 2024-04-26T10:44:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028404088000000001 2024-04-26T10:44:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554788+0000", 2024-04-26T10:44:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2738999999999999e-05 2024-04-26T10:44:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554849+0000", 2024-04-26T10:44:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1362e-05 2024-04-26T10:44:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555963+0000", 2024-04-26T10:44:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001113597 2024-04-26T10:44:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555969+0000", 2024-04-26T10:44:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6900000000000003e-06 2024-04-26T10:44:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555995+0000", 2024-04-26T10:44:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5165999999999999e-05 2024-04-26T10:44:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556015+0000", 2024-04-26T10:44:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0522000000000001e-05 2024-04-26T10:44:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:132 3.1a 3:5e41ab69:::200.00000005:head [write 3562043~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:38.586 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.035589696999999, 2024-04-26T10:44:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030129895, 2024-04-26T10:44:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526354+0000", 2024-04-26T10:44:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8560000000000001e-06 2024-04-26T10:44:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526359+0000", 2024-04-26T10:44:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4700000000000001e-06 2024-04-26T10:44:38.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526365+0000", 2024-04-26T10:44:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2120000000000002e-06 2024-04-26T10:44:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555050+0000", 2024-04-26T10:44:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028685458 2024-04-26T10:44:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555093+0000", 2024-04-26T10:44:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3307999999999999e-05 2024-04-26T10:44:38.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555156+0000", 2024-04-26T10:44:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2396000000000004e-05 2024-04-26T10:44:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556052+0000", 2024-04-26T10:44:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00089650299999999999 2024-04-26T10:44:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556439+0000", 2024-04-26T10:44:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038647900000000001 2024-04-26T10:44:38.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556463+0000", 2024-04-26T10:44:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4071e-05 2024-04-26T10:44:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556482+0000", 2024-04-26T10:44:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9378999999999999e-05 2024-04-26T10:44:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 3563440~3660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.035573303, 2024-04-26T10:44:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030550738000000001, 2024-04-26T10:44:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:38.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:38.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526368+0000", 2024-04-26T10:44:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526375+0000", 2024-04-26T10:44:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7510000000000002e-06 2024-04-26T10:44:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:38.594 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526381+0000", 2024-04-26T10:44:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3929999999999996e-06 2024-04-26T10:44:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526387+0000", 2024-04-26T10:44:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.215e-06 2024-04-26T10:44:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555542+0000", 2024-04-26T10:44:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029154992000000001 2024-04-26T10:44:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:38.595 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555610+0000", 2024-04-26T10:44:38.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8610999999999998e-05 2024-04-26T10:44:38.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.596 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:38.596 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555681+0000", 2024-04-26T10:44:38.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1072e-05 2024-04-26T10:44:38.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.596 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.596 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556866+0000", 2024-04-26T10:44:38.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001184598 2024-04-26T10:44:38.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.596 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:38.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556872+0000", 2024-04-26T10:44:38.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.55e-06 2024-04-26T10:44:38.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:38.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556897+0000", 2024-04-26T10:44:38.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.516e-05 2024-04-26T10:44:38.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:38.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556919+0000", 2024-04-26T10:44:38.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1951e-05 2024-04-26T10:44:38.597 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.597 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:38.597 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.598 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:134 3.1a 3:5e41ab69:::200.00000005:head [write 3567100~2427 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:38.598 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:38.598 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.035540237999999, 2024-04-26T10:44:38.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031267445999999997, 2024-04-26T10:44:38.598 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:38.598 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.598 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:38.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:38.598 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:38.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.599 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:38.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:38.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.599 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:38.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526401+0000", 2024-04-26T10:44:38.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:38.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.599 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:38.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526408+0000", 2024-04-26T10:44:38.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7769999999999997e-06 2024-04-26T10:44:38.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.600 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:38.600 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526415+0000", 2024-04-26T10:44:38.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0720000000000002e-06 2024-04-26T10:44:38.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.600 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.600 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526421+0000", 2024-04-26T10:44:38.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9699999999999996e-06 2024-04-26T10:44:38.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.600 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:38.600 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556084+0000", 2024-04-26T10:44:38.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029662351999999999 2024-04-26T10:44:38.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.601 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:38.601 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556126+0000", 2024-04-26T10:44:38.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2385000000000002e-05 2024-04-26T10:44:38.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.601 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:38.601 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556186+0000", 2024-04-26T10:44:38.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9945999999999998e-05 2024-04-26T10:44:38.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:38.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557598+0000", 2024-04-26T10:44:38.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0014121559999999999 2024-04-26T10:44:38.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557626+0000", 2024-04-26T10:44:38.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7960999999999999e-05 2024-04-26T10:44:38.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:38.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557650+0000", 2024-04-26T10:44:38.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3969999999999999e-05 2024-04-26T10:44:38.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:38.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557669+0000", 2024-04-26T10:44:38.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9262e-05 2024-04-26T10:44:38.603 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.603 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:38.603 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.603 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:135 3.1a 3:5e41ab69:::200.00000005:head [write 3569527~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:38.603 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:38.603 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.035515971999999, 2024-04-26T10:44:38.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031322516000000002, 2024-04-26T10:44:38.604 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:38.604 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.604 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:38.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:38.604 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:38.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:38.605 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:38.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.605 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:38.605 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:38.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:38.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.605 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:38.605 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526429+0000", 2024-04-26T10:44:38.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0750000000000002e-06 2024-04-26T10:44:38.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.606 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:38.606 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526435+0000", 2024-04-26T10:44:38.606 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.263e-06 2024-04-26T10:44:38.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.606 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.606 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526442+0000", 2024-04-26T10:44:38.606 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1219999999999997e-06 2024-04-26T10:44:38.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.606 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:38.606 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556515+0000", 2024-04-26T10:44:38.606 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030073132999999998 2024-04-26T10:44:38.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:38.607 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556564+0000", 2024-04-26T10:44:38.607 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8871e-05 2024-04-26T10:44:38.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:38.607 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556625+0000", 2024-04-26T10:44:38.607 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1307000000000001e-05 2024-04-26T10:44:38.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:38.607 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557678+0000", 2024-04-26T10:44:38.607 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010523100000000001 2024-04-26T10:44:38.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.608 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557709+0000", 2024-04-26T10:44:38.608 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1748000000000002e-05 2024-04-26T10:44:38.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.608 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:38.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557732+0000", 2024-04-26T10:44:38.608 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2415000000000001e-05 2024-04-26T10:44:38.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.608 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:38.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557749+0000", 2024-04-26T10:44:38.609 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6736999999999999e-05 2024-04-26T10:44:38.609 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.609 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:38.609 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.609 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:136 3.1a 3:5e41ab69:::200.00000005:head [write 3571449~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:38.609 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:38.609 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.035494782000001, 2024-04-26T10:44:38.609 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032180937, 2024-04-26T10:44:38.609 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:38.609 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.609 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:38.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.609 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:38.610 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:38.610 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.610 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:38.610 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:38.610 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.610 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:38.610 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:38.610 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:38.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.611 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:38.611 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526455+0000", 2024-04-26T10:44:38.611 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6429999999999995e-06 2024-04-26T10:44:38.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.611 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:38.611 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526461+0000", 2024-04-26T10:44:38.611 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:38.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.612 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.612 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526467+0000", 2024-04-26T10:44:38.612 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4389999999999999e-06 2024-04-26T10:44:38.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.612 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:38.612 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556950+0000", 2024-04-26T10:44:38.612 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030483854000000001 2024-04-26T10:44:38.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.612 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:38.613 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556989+0000", 2024-04-26T10:44:38.613 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8415999999999999e-05 2024-04-26T10:44:38.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.613 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:38.613 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557051+0000", 2024-04-26T10:44:38.613 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2088999999999995e-05 2024-04-26T10:44:38.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.613 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:38.613 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558166+0000", 2024-04-26T10:44:38.613 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001114622 2024-04-26T10:44:38.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.613 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.614 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558584+0000", 2024-04-26T10:44:38.614 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000418033 2024-04-26T10:44:38.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.614 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:38.614 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558609+0000", 2024-04-26T10:44:38.614 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5344999999999999e-05 2024-04-26T10:44:38.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.614 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:38.614 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558628+0000", 2024-04-26T10:44:38.614 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9273999999999999e-05 2024-04-26T10:44:38.614 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.614 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:38.615 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.615 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:137 3.1a 3:5e41ab69:::200.00000005:head [write 3573699~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:38.615 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:38.615 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.035471133000001, 2024-04-26T10:44:38.615 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032241530999999997, 2024-04-26T10:44:38.615 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:38.615 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.615 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:38.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.615 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:38.615 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:38.615 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.616 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:38.616 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:38.616 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.616 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:38.616 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526470+0000", 2024-04-26T10:44:38.616 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:38.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.616 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:38.616 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526473+0000", 2024-04-26T10:44:38.616 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.818e-06 2024-04-26T10:44:38.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.617 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:38.617 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526480+0000", 2024-04-26T10:44:38.617 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4119999999999998e-06 2024-04-26T10:44:38.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.617 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.617 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526484+0000", 2024-04-26T10:44:38.617 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6840000000000004e-06 2024-04-26T10:44:38.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.617 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:38.618 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557323+0000", 2024-04-26T10:44:38.618 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030838956000000001 2024-04-26T10:44:38.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.618 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:38.618 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557362+0000", 2024-04-26T10:44:38.618 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8343999999999997e-05 2024-04-26T10:44:38.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.618 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:38.618 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557421+0000", 2024-04-26T10:44:38.618 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9176999999999999e-05 2024-04-26T10:44:38.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.619 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:38.619 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558636+0000", 2024-04-26T10:44:38.619 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012153789999999999 2024-04-26T10:44:38.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.619 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.619 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558668+0000", 2024-04-26T10:44:38.619 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1452999999999999e-05 2024-04-26T10:44:38.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.619 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:38.619 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558694+0000", 2024-04-26T10:44:38.620 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6288999999999999e-05 2024-04-26T10:44:38.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.620 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.620 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:38.620 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558712+0000", 2024-04-26T10:44:38.620 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8459000000000001e-05 2024-04-26T10:44:38.620 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.620 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:38.620 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.620 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.620 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:138 3.1a 3:5e41ab69:::200.00000005:head [write 3575103~4205 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:38.620 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:38.620 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.035453814, 2024-04-26T10:44:38.621 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032665567999999999, 2024-04-26T10:44:38.621 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:38.621 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.621 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:38.621 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.621 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:38.621 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:38.621 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.621 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.621 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:38.621 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:38.621 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.622 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:38.622 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:38.622 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:38.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.622 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:38.622 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526495+0000", 2024-04-26T10:44:38.622 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7580000000000003e-06 2024-04-26T10:44:38.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.622 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:38.622 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526501+0000", 2024-04-26T10:44:38.622 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1680000000000001e-06 2024-04-26T10:44:38.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.623 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.623 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526505+0000", 2024-04-26T10:44:38.623 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.673e-06 2024-04-26T10:44:38.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.623 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:38.623 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557781+0000", 2024-04-26T10:44:38.623 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031275718000000001 2024-04-26T10:44:38.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.624 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:38.624 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557825+0000", 2024-04-26T10:44:38.624 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4048000000000002e-05 2024-04-26T10:44:38.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.624 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:38.624 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557888+0000", 2024-04-26T10:44:38.624 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2562000000000002e-05 2024-04-26T10:44:38.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.624 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.625 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559073+0000", 2024-04-26T10:44:38.625 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011852239999999999 2024-04-26T10:44:38.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.625 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:38.625 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559112+0000", 2024-04-26T10:44:38.625 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9226e-05 2024-04-26T10:44:38.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.625 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:38.625 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559136+0000", 2024-04-26T10:44:38.625 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3966000000000001e-05 2024-04-26T10:44:38.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.625 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:38.626 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559154+0000", 2024-04-26T10:44:38.626 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7575e-05 2024-04-26T10:44:38.626 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.626 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:38.626 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.626 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.626 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.626 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:139 3.1a 3:5e41ab69:::200.00000005:head [write 3579308~2255 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:38.626 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:38.626 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.035432195999999, 2024-04-26T10:44:38.626 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033424720999999998, 2024-04-26T10:44:38.626 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:38.626 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.626 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:38.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.627 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:38.627 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:38.627 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.627 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:38.627 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:38.627 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.627 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:38.627 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526509+0000", 2024-04-26T10:44:38.627 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:38.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.628 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:38.628 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526516+0000", 2024-04-26T10:44:38.628 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5209999999999999e-06 2024-04-26T10:44:38.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.628 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:38.628 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526522+0000", 2024-04-26T10:44:38.628 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1229999999999997e-06 2024-04-26T10:44:38.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.628 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.628 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526527+0000", 2024-04-26T10:44:38.628 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7849999999999999e-06 2024-04-26T10:44:38.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.629 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:38.629 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558194+0000", 2024-04-26T10:44:38.629 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031667419000000002 2024-04-26T10:44:38.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.629 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:38.629 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558234+0000", 2024-04-26T10:44:38.629 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9774999999999998e-05 2024-04-26T10:44:38.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.629 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:38.629 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558294+0000", 2024-04-26T10:44:38.629 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0242999999999999e-05 2024-04-26T10:44:38.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.630 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.630 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559106+0000", 2024-04-26T10:44:38.630 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00081148099999999996 2024-04-26T10:44:38.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.630 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:38.630 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559890+0000", 2024-04-26T10:44:38.630 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00078439999999999998 2024-04-26T10:44:38.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.630 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:38.630 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559917+0000", 2024-04-26T10:44:38.631 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7044000000000001e-05 2024-04-26T10:44:38.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.631 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:38.631 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559935+0000", 2024-04-26T10:44:38.631 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7448e-05 2024-04-26T10:44:38.631 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.631 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:38.631 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.631 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:140 3.1a 3:5e41ab69:::200.00000005:head [write 3581563~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:38.631 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:38.631 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.035410774999999, 2024-04-26T10:44:38.631 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033867728, 2024-04-26T10:44:38.632 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:38.632 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.632 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:38.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.632 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:38.632 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:38.632 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.632 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.632 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:38.633 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:38.633 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.633 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:38.633 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:38.633 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:38.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.633 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:38.633 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526538+0000", 2024-04-26T10:44:38.633 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.905e-06 2024-04-26T10:44:38.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.634 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:38.634 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526542+0000", 2024-04-26T10:44:38.634 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9550000000000002e-06 2024-04-26T10:44:38.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.634 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.634 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526545+0000", 2024-04-26T10:44:38.634 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8499999999999998e-06 2024-04-26T10:44:38.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.635 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:38.635 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558744+0000", 2024-04-26T10:44:38.635 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032198986999999998 2024-04-26T10:44:38.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.635 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:38.635 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558788+0000", 2024-04-26T10:44:38.635 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4365e-05 2024-04-26T10:44:38.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.635 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:38.635 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558854+0000", 2024-04-26T10:44:38.635 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5952999999999997e-05 2024-04-26T10:44:38.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.636 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.636 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559971+0000", 2024-04-26T10:44:38.636 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011172770000000001 2024-04-26T10:44:38.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.636 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:38.636 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560354+0000", 2024-04-26T10:44:38.636 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038267599999999998 2024-04-26T10:44:38.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.636 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:38.636 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560380+0000", 2024-04-26T10:44:38.636 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6140999999999999e-05 2024-04-26T10:44:38.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.637 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.637 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:38.637 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560399+0000", 2024-04-26T10:44:38.637 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9032999999999999e-05 2024-04-26T10:44:38.637 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.637 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:38.637 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.637 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.637 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:141 3.1a 3:5e41ab69:::200.00000005:head [write 3583482~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:38.637 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:38.637 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.035395116, 2024-04-26T10:44:38.637 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034316301, 2024-04-26T10:44:38.638 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:38.638 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.638 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:38.638 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.638 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:38.638 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:38.638 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.638 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.638 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.638 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:38.638 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:38.638 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.638 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.638 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.638 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:38.639 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:38.639 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:38.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.639 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:38.639 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526548+0000", 2024-04-26T10:44:38.639 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.739e-06 2024-04-26T10:44:38.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.639 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:38.641 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526551+0000", 2024-04-26T10:44:38.641 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.044e-06 2024-04-26T10:44:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526562+0000", 2024-04-26T10:44:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0370000000000001e-05 2024-04-26T10:44:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559179+0000", 2024-04-26T10:44:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032617444000000002 2024-04-26T10:44:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:38.642 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559220+0000", 2024-04-26T10:44:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0364999999999997e-05 2024-04-26T10:44:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559280+0000", 2024-04-26T10:44:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0569000000000002e-05 2024-04-26T10:44:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560814+0000", 2024-04-26T10:44:38.643 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015337580000000001 2024-04-26T10:44:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560820+0000", 2024-04-26T10:44:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.455e-06 2024-04-26T10:44:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560846+0000", 2024-04-26T10:44:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5228999999999998e-05 2024-04-26T10:44:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:38.644 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560863+0000", 2024-04-26T10:44:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7555e-05 2024-04-26T10:44:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:142 3.1a 3:5e41ab69:::200.00000005:head [write 3585931~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.035374719, 2024-04-26T10:44:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034372373999999997, 2024-04-26T10:44:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.646 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:38.647 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526573+0000", 2024-04-26T10:44:38.647 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0800000000000002e-06 2024-04-26T10:44:38.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.647 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:38.647 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526580+0000", 2024-04-26T10:44:38.647 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5799999999999997e-06 2024-04-26T10:44:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526585+0000", 2024-04-26T10:44:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2270000000000001e-06 2024-04-26T10:44:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559601+0000", 2024-04-26T10:44:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033016684999999997 2024-04-26T10:44:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:38.648 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559642+0000", 2024-04-26T10:44:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0321000000000002e-05 2024-04-26T10:44:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559706+0000", 2024-04-26T10:44:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4228999999999998e-05 2024-04-26T10:44:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560871+0000", 2024-04-26T10:44:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001164893 2024-04-26T10:44:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.649 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560899+0000", 2024-04-26T10:44:38.650 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:38.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.650 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:38.650 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560922+0000", 2024-04-26T10:44:38.650 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3337999999999999e-05 2024-04-26T10:44:38.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.650 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:38.651 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560940+0000", 2024-04-26T10:44:38.651 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7289999999999999e-05 2024-04-26T10:44:38.651 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.651 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:38.651 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.651 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.651 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:143 3.1a 3:5e41ab69:::200.00000005:head [write 3587331~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:38.651 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:38.651 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.035352821, 2024-04-26T10:44:38.651 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035256000000000003, 2024-04-26T10:44:38.652 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:38.652 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.652 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:38.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.652 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:38.652 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:38.652 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.652 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:38.652 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:38.652 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.653 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:38.653 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:38.653 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:38.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.653 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:38.653 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526592+0000", 2024-04-26T10:44:38.653 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2449999999999998e-06 2024-04-26T10:44:38.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.653 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:38.653 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526596+0000", 2024-04-26T10:44:38.653 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7000000000000002e-06 2024-04-26T10:44:38.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.654 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.654 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526599+0000", 2024-04-26T10:44:38.654 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6160000000000002e-06 2024-04-26T10:44:38.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.654 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:38.654 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559997+0000", 2024-04-26T10:44:38.654 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033397835000000001 2024-04-26T10:44:38.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.654 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:38.654 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560051+0000", 2024-04-26T10:44:38.654 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3742000000000001e-05 2024-04-26T10:44:38.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.655 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:38.655 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560112+0000", 2024-04-26T10:44:38.655 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0851999999999999e-05 2024-04-26T10:44:38.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.655 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:38.655 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561404+0000", 2024-04-26T10:44:38.655 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001291869 2024-04-26T10:44:38.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.655 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.655 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561797+0000", 2024-04-26T10:44:38.655 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039383000000000002 2024-04-26T10:44:38.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.656 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:38.656 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561827+0000", 2024-04-26T10:44:38.656 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9247e-05 2024-04-26T10:44:38.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.656 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:38.656 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561845+0000", 2024-04-26T10:44:38.656 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8462999999999999e-05 2024-04-26T10:44:38.656 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.656 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:38.656 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.657 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:144 3.1a 3:5e41ab69:::200.00000005:head [write 3588736~4987 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:38.657 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:38.657 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.035230529, 2024-04-26T10:44:38.657 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035224283000000002, 2024-04-26T10:44:38.657 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:38.657 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.657 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:38.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.657 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:38.657 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:38.657 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.657 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:38.658 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:38.658 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.658 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:38.658 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:38.658 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:38.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.658 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:38.658 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526718+0000", 2024-04-26T10:44:38.658 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.43e-06 2024-04-26T10:44:38.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.659 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:38.659 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526726+0000", 2024-04-26T10:44:38.659 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:44:38.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.659 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.659 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526729+0000", 2024-04-26T10:44:38.659 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6480000000000001e-06 2024-04-26T10:44:38.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.659 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:38.659 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560427+0000", 2024-04-26T10:44:38.659 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033697280000000003 2024-04-26T10:44:38.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.660 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:38.660 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560466+0000", 2024-04-26T10:44:38.660 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9606e-05 2024-04-26T10:44:38.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.660 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:38.660 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560525+0000", 2024-04-26T10:44:38.660 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9218000000000001e-05 2024-04-26T10:44:38.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.660 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:38.660 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561854+0000", 2024-04-26T10:44:38.660 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001328421 2024-04-26T10:44:38.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.661 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.661 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561887+0000", 2024-04-26T10:44:38.661 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2746000000000001e-05 2024-04-26T10:44:38.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.661 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:38.661 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561912+0000", 2024-04-26T10:44:38.661 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5126999999999998e-05 2024-04-26T10:44:38.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.661 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:38.661 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561936+0000", 2024-04-26T10:44:38.661 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4032999999999998e-05 2024-04-26T10:44:38.661 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.661 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:38.662 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.662 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.662 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:145 3.1a 3:5e41ab69:::200.00000005:head [write 3593723~2939 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:38.662 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:38.662 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.032311484000001, 2024-04-26T10:44:38.662 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033294394999999997, 2024-04-26T10:44:38.662 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:38.662 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.662 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:38.662 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.662 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:38.662 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:38.662 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.663 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:38.663 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:38.663 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.663 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:38.663 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529630+0000", 2024-04-26T10:44:38.663 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:38.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.663 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:38.663 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529635+0000", 2024-04-26T10:44:38.663 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7960000000000003e-06 2024-04-26T10:44:38.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.664 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:38.664 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529643+0000", 2024-04-26T10:44:38.664 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0390000000000005e-06 2024-04-26T10:44:38.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.664 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.664 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529648+0000", 2024-04-26T10:44:38.664 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9599999999999999e-06 2024-04-26T10:44:38.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.664 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:38.664 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560969+0000", 2024-04-26T10:44:38.665 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031321767 2024-04-26T10:44:38.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.665 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:38.665 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561009+0000", 2024-04-26T10:44:38.665 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9904999999999998e-05 2024-04-26T10:44:38.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.665 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:38.665 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561070+0000", 2024-04-26T10:44:38.665 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0708999999999998e-05 2024-04-26T10:44:38.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.665 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:38.666 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562352+0000", 2024-04-26T10:44:38.666 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012818440000000001 2024-04-26T10:44:38.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.666 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.666 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562867+0000", 2024-04-26T10:44:38.666 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000515665 2024-04-26T10:44:38.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.666 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:38.666 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562893+0000", 2024-04-26T10:44:38.666 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5469999999999998e-05 2024-04-26T10:44:38.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.667 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:38.667 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562925+0000", 2024-04-26T10:44:38.667 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1974999999999998e-05 2024-04-26T10:44:38.667 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.667 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:38.667 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.667 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:146 3.1a 3:5e41ab69:::200.00000005:head [write 3596662~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:38.667 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:38.667 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.032083270000001, 2024-04-26T10:44:38.667 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033178429000000002, 2024-04-26T10:44:38.667 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:38.667 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.667 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:38.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.668 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:38.668 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:38.668 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.668 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:38.668 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:38.668 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.668 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:38.668 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529858+0000", 2024-04-26T10:44:38.668 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:38.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.669 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:38.669 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529863+0000", 2024-04-26T10:44:38.669 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4500000000000003e-06 2024-04-26T10:44:38.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.669 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:38.669 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529874+0000", 2024-04-26T10:44:38.669 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0552e-05 2024-04-26T10:44:38.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.669 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.669 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529882+0000", 2024-04-26T10:44:38.669 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4449999999999996e-06 2024-04-26T10:44:38.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.670 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:38.670 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561452+0000", 2024-04-26T10:44:38.670 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031569680000000003 2024-04-26T10:44:38.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.670 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:38.670 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561511+0000", 2024-04-26T10:44:38.670 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9332e-05 2024-04-26T10:44:38.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.670 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:38.670 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561583+0000", 2024-04-26T10:44:38.671 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1730000000000006e-05 2024-04-26T10:44:38.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.671 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:38.671 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562933+0000", 2024-04-26T10:44:38.671 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013500059999999999 2024-04-26T10:44:38.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.671 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.671 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562976+0000", 2024-04-26T10:44:38.671 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2987e-05 2024-04-26T10:44:38.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.671 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:38.671 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563015+0000", 2024-04-26T10:44:38.672 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9453999999999999e-05 2024-04-26T10:44:38.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.672 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:38.672 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563037+0000", 2024-04-26T10:44:38.672 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1679e-05 2024-04-26T10:44:38.672 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.672 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:38.672 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.672 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:277 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:38.672 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:38.672 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 12.047072567000001, 2024-04-26T10:44:38.672 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030430563000000001, 2024-04-26T10:44:38.673 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:38.673 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:38.673 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:38.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.673 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:38.673 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:38.673 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.673 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:38.673 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:38.673 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:38.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.673 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:38.674 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514867+0000", 2024-04-26T10:44:38.674 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:38.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.674 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:38.674 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515460+0000", 2024-04-26T10:44:38.674 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00059285800000000004 2024-04-26T10:44:38.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.674 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:38.674 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515474+0000", 2024-04-26T10:44:38.674 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3933e-05 2024-04-26T10:44:38.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.675 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:38.675 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515481+0000", 2024-04-26T10:44:38.675 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:38.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.675 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:38.675 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515522+0000", 2024-04-26T10:44:38.675 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1369000000000003e-05 2024-04-26T10:44:38.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.675 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:38.675 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515591+0000", 2024-04-26T10:44:38.675 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9377999999999999e-05 2024-04-26T10:44:38.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.676 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:38.676 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.526440+0000", 2024-04-26T10:44:38.676 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010848837 2024-04-26T10:44:38.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.676 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:38.676 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.543866+0000", 2024-04-26T10:44:38.676 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017426288000000002 2024-04-26T10:44:38.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.676 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:38.676 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545193+0000", 2024-04-26T10:44:38.676 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001326111 2024-04-26T10:44:38.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.677 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:38.677 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545229+0000", 2024-04-26T10:44:38.677 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6390999999999998e-05 2024-04-26T10:44:38.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:38.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:38.677 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:38.677 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545300+0000", 2024-04-26T10:44:38.677 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1073000000000002e-05 2024-04-26T10:44:38.677 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.677 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:38.677 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.677 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:38.677 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:38.677 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:38.679 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:38.680 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:38.677+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:38.779 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:38.778+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:38.784 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:38.784 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:38.784 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:44:38.784 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:38.793 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:38.880 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:38.879+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:38.938 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:38.938 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:38.938 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:38.938 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:38.938 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:38.947 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:38.982 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:38.980+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:39.082 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:39.080+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:39.091 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:39.091 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:39.091 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:39.091 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:39.091 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.091 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:330 3.13 3:ceffbd45:::200.0000000a:head [write 1316140~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:39.091 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:39.091 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 12.575841860000001, 2024-04-26T10:44:39.091 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022245654, 2024-04-26T10:44:39.092 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:39.092 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.092 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:39.092 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.092 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:39.092 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:39.092 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.092 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.092 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.092 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:39.092 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:39.092 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.093 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.093 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.093 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:39.093 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513139+0000", 2024-04-26T10:44:39.093 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:39.093 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.093 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.093 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:39.093 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513149+0000", 2024-04-26T10:44:39.093 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7550000000000006e-06 2024-04-26T10:44:39.093 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.093 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.093 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:39.094 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513157+0000", 2024-04-26T10:44:39.094 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1089999999999998e-06 2024-04-26T10:44:39.094 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.094 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.094 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.094 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513167+0000", 2024-04-26T10:44:39.094 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0539e-05 2024-04-26T10:44:39.094 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.094 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.094 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:39.094 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533830+0000", 2024-04-26T10:44:39.094 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020662852999999998 2024-04-26T10:44:39.095 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.095 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.095 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:39.095 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533875+0000", 2024-04-26T10:44:39.095 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.5071999999999998e-05 2024-04-26T10:44:39.095 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.095 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.095 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:39.095 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535319+0000", 2024-04-26T10:44:39.095 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001443578 2024-04-26T10:44:39.095 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.095 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.095 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:39.095 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535346+0000", 2024-04-26T10:44:39.096 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7415000000000001e-05 2024-04-26T10:44:39.096 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.096 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.096 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:39.096 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535385+0000", 2024-04-26T10:44:39.096 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8912999999999998e-05 2024-04-26T10:44:39.096 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.096 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:39.096 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.096 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.097 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.097 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:331 3.13 3:ceffbd45:::200.0000000a:head [write 1318049~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:39.097 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:39.097 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 12.575802532000001, 2024-04-26T10:44:39.097 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023524521, 2024-04-26T10:44:39.097 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:39.097 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.097 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:39.097 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.097 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:39.097 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:39.097 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.097 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.098 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.098 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:39.098 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:39.098 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.098 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.098 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.098 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:39.098 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513178+0000", 2024-04-26T10:44:39.098 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:39.098 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.098 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.098 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:39.098 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513183+0000", 2024-04-26T10:44:39.098 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2549999999999999e-06 2024-04-26T10:44:39.099 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.099 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.099 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:39.099 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513190+0000", 2024-04-26T10:44:39.099 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8460000000000002e-06 2024-04-26T10:44:39.099 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.099 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.099 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.099 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513195+0000", 2024-04-26T10:44:39.099 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3630000000000002e-06 2024-04-26T10:44:39.100 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.100 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.100 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:39.100 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534463+0000", 2024-04-26T10:44:39.100 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021267823000000002 2024-04-26T10:44:39.100 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.100 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.100 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:39.100 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534520+0000", 2024-04-26T10:44:39.100 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7510000000000003e-05 2024-04-26T10:44:39.100 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.100 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.100 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:39.100 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536634+0000", 2024-04-26T10:44:39.101 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0021138900000000002 2024-04-26T10:44:39.101 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.101 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.101 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:39.101 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536663+0000", 2024-04-26T10:44:39.101 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8884e-05 2024-04-26T10:44:39.101 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.101 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.101 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:39.101 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536703+0000", 2024-04-26T10:44:39.101 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0479000000000003e-05 2024-04-26T10:44:39.101 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.101 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:39.101 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.102 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.102 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.102 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:332 3.13 3:ceffbd45:::200.0000000a:head [write 1319462~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:39.102 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:39.102 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 12.575767699, 2024-04-26T10:44:39.102 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024543230999999999, 2024-04-26T10:44:39.102 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:39.102 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.102 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:39.102 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.102 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:39.102 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:39.102 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.102 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.103 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.103 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:39.103 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:39.103 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.103 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.103 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.103 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:39.103 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513213+0000", 2024-04-26T10:44:39.103 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:39.103 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.103 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.103 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:39.103 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513217+0000", 2024-04-26T10:44:39.103 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:44:39.104 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.104 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.104 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:39.104 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513229+0000", 2024-04-26T10:44:39.104 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2051e-05 2024-04-26T10:44:39.104 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.104 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.104 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.104 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513236+0000", 2024-04-26T10:44:39.104 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4470000000000003e-06 2024-04-26T10:44:39.104 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.104 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.104 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:39.104 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534891+0000", 2024-04-26T10:44:39.104 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021655863000000001 2024-04-26T10:44:39.105 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.105 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.105 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:39.105 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534933+0000", 2024-04-26T10:44:39.105 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1596e-05 2024-04-26T10:44:39.105 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.105 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.105 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:39.105 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537677+0000", 2024-04-26T10:44:39.105 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027440989999999998 2024-04-26T10:44:39.105 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.105 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.105 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:39.105 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537721+0000", 2024-04-26T10:44:39.106 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3813999999999998e-05 2024-04-26T10:44:39.106 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.106 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.106 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:39.106 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537757+0000", 2024-04-26T10:44:39.106 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6022999999999997e-05 2024-04-26T10:44:39.106 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.106 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:39.106 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.106 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.106 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.106 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:333 3.13 3:ceffbd45:::200.0000000a:head [write 1320870~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:39.106 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:39.106 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 12.57572478, 2024-04-26T10:44:39.107 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024557151999999999, 2024-04-26T10:44:39.107 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:39.107 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.107 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:39.107 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.107 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:39.107 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:39.107 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.107 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.107 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.107 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:39.107 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:39.107 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.107 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.107 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.108 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:39.108 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513256+0000", 2024-04-26T10:44:39.108 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:39.108 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.108 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.108 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:39.108 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513260+0000", 2024-04-26T10:44:39.108 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6550000000000002e-06 2024-04-26T10:44:39.108 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.108 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.108 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:39.108 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513273+0000", 2024-04-26T10:44:39.108 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2965e-05 2024-04-26T10:44:39.108 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.109 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.109 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.109 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513279+0000", 2024-04-26T10:44:39.109 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:44:39.109 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.109 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.109 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:39.109 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535411+0000", 2024-04-26T10:44:39.109 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022132233000000001 2024-04-26T10:44:39.109 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.109 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.109 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:39.109 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535479+0000", 2024-04-26T10:44:39.109 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7554999999999999e-05 2024-04-26T10:44:39.110 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.110 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.110 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:39.110 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537762+0000", 2024-04-26T10:44:39.110 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022836499999999999 2024-04-26T10:44:39.110 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.110 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.110 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:39.110 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537783+0000", 2024-04-26T10:44:39.110 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0364e-05 2024-04-26T10:44:39.110 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.110 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.110 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:39.110 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537814+0000", 2024-04-26T10:44:39.111 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1170000000000001e-05 2024-04-26T10:44:39.111 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.111 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:39.111 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.111 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.111 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.111 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:334 3.13 3:ceffbd45:::200.0000000a:head [write 1322273~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:39.111 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:39.111 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 12.573888021, 2024-04-26T10:44:39.111 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022778731999999999, 2024-04-26T10:44:39.111 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:39.111 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.111 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:39.111 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.111 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:39.112 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:39.112 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.112 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.112 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:39.112 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:39.112 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.112 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.112 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:39.112 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:39.112 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:39.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.112 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.113 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:39.113 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515099+0000", 2024-04-26T10:44:39.113 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6599999999999998e-06 2024-04-26T10:44:39.113 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.113 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.113 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:39.113 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515112+0000", 2024-04-26T10:44:39.113 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2707e-05 2024-04-26T10:44:39.113 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.113 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.113 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.113 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515120+0000", 2024-04-26T10:44:39.113 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8509999999999999e-06 2024-04-26T10:44:39.113 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.114 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.114 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:39.114 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535792+0000", 2024-04-26T10:44:39.114 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020672209 2024-04-26T10:44:39.114 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.114 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.114 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:39.114 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535833+0000", 2024-04-26T10:44:39.114 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1415000000000002e-05 2024-04-26T10:44:39.114 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.114 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.114 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:39.115 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537818+0000", 2024-04-26T10:44:39.115 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0019850900000000001 2024-04-26T10:44:39.115 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.115 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.115 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:39.115 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537839+0000", 2024-04-26T10:44:39.115 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0068000000000002e-05 2024-04-26T10:44:39.115 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.115 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.115 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:39.115 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537872+0000", 2024-04-26T10:44:39.115 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3680999999999998e-05 2024-04-26T10:44:39.115 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.116 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:39.116 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.116 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.116 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.116 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:335 3.13 3:ceffbd45:::200.0000000a:head [write 1325230~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:39.116 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:39.116 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 12.573848922, 2024-04-26T10:44:39.116 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023487081, 2024-04-26T10:44:39.116 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:39.116 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.116 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:39.116 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.116 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:39.116 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:39.117 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.117 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.117 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.117 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:39.117 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:39.118 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.118 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.118 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.118 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:39.118 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515132+0000", 2024-04-26T10:44:39.118 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:39.118 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.118 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.118 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:39.118 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515136+0000", 2024-04-26T10:44:39.118 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0860000000000004e-06 2024-04-26T10:44:39.118 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.118 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.119 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:39.119 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515143+0000", 2024-04-26T10:44:39.119 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.0400000000000004e-06 2024-04-26T10:44:39.119 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.119 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.119 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.119 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515149+0000", 2024-04-26T10:44:39.119 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0789999999999997e-06 2024-04-26T10:44:39.119 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.119 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.119 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:39.119 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536200+0000", 2024-04-26T10:44:39.119 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021050993 2024-04-26T10:44:39.119 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.120 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.120 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:39.120 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536253+0000", 2024-04-26T10:44:39.120 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.2643999999999999e-05 2024-04-26T10:44:39.120 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.120 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.120 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:39.120 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538560+0000", 2024-04-26T10:44:39.120 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0023073389999999998 2024-04-26T10:44:39.120 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.121 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.121 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:39.121 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538584+0000", 2024-04-26T10:44:39.121 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3893999999999999e-05 2024-04-26T10:44:39.121 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.121 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.121 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:39.121 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538620+0000", 2024-04-26T10:44:39.121 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5611000000000002e-05 2024-04-26T10:44:39.121 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.121 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:39.121 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.121 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.122 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.122 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:336 3.13 3:ceffbd45:::200.0000000a:head [write 1327147~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:39.122 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:39.122 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 12.572516467, 2024-04-26T10:44:39.122 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027687066, 2024-04-26T10:44:39.122 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:39.122 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.122 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:39.122 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.122 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:39.122 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:39.122 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.122 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.122 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.123 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:39.123 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:39.123 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.123 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.123 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.123 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:39.123 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516464+0000", 2024-04-26T10:44:39.123 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:39.123 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.123 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.123 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:39.123 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516491+0000", 2024-04-26T10:44:39.123 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6539000000000001e-05 2024-04-26T10:44:39.123 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.123 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.124 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:39.124 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516500+0000", 2024-04-26T10:44:39.124 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5480000000000007e-06 2024-04-26T10:44:39.124 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.124 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.124 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.124 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516511+0000", 2024-04-26T10:44:39.124 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0719e-05 2024-04-26T10:44:39.124 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.124 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.124 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:39.124 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536737+0000", 2024-04-26T10:44:39.125 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020225770000000001 2024-04-26T10:44:39.125 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.125 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.125 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:39.125 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536783+0000", 2024-04-26T10:44:39.125 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6168999999999998e-05 2024-04-26T10:44:39.125 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.125 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.125 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:39.126 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544080+0000", 2024-04-26T10:44:39.126 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0072966799999999998 2024-04-26T10:44:39.126 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.126 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.126 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:39.126 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544111+0000", 2024-04-26T10:44:39.126 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1056999999999998e-05 2024-04-26T10:44:39.127 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.127 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.127 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:39.127 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544152+0000", 2024-04-26T10:44:39.127 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1452000000000002e-05 2024-04-26T10:44:39.127 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.127 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:39.127 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.127 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.127 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.127 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:337 3.13 3:ceffbd45:::200.0000000a:head [write 1342136~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:39.127 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:39.127 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 12.572463529, 2024-04-26T10:44:39.127 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027711237, 2024-04-26T10:44:39.128 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:39.128 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.128 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:39.128 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.128 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:39.128 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:39.128 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.128 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.128 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.128 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:39.128 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:39.128 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.128 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.128 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.128 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:39.129 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516517+0000", 2024-04-26T10:44:39.129 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:39.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.129 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.129 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:39.129 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516521+0000", 2024-04-26T10:44:39.129 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6200000000000001e-06 2024-04-26T10:44:39.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.129 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.129 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:39.129 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516528+0000", 2024-04-26T10:44:39.129 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8639999999999998e-06 2024-04-26T10:44:39.129 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.130 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.130 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.130 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516533+0000", 2024-04-26T10:44:39.130 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6310000000000002e-06 2024-04-26T10:44:39.130 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.130 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.130 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:39.130 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537231+0000", 2024-04-26T10:44:39.130 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020698613000000001 2024-04-26T10:44:39.130 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.130 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.130 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:39.130 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537273+0000", 2024-04-26T10:44:39.130 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1529000000000002e-05 2024-04-26T10:44:39.131 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.131 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.131 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:39.131 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544157+0000", 2024-04-26T10:44:39.131 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068847090000000001 2024-04-26T10:44:39.131 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.131 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.131 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:39.131 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544180+0000", 2024-04-26T10:44:39.131 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.2532e-05 2024-04-26T10:44:39.131 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.131 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.131 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:39.131 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544229+0000", 2024-04-26T10:44:39.131 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9190000000000002e-05 2024-04-26T10:44:39.132 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.132 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:39.132 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.132 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.132 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:338 3.13 3:ceffbd45:::200.0000000a:head [write 1344569~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:39.132 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:39.132 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 12.571797276, 2024-04-26T10:44:39.132 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027105598000000002, 2024-04-26T10:44:39.132 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:39.132 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.132 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:39.132 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.132 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:39.132 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:39.133 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.133 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:39.133 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:39.133 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.133 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:39.133 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517183+0000", 2024-04-26T10:44:39.133 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:39.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.133 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:39.133 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517188+0000", 2024-04-26T10:44:39.134 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7389999999999999e-06 2024-04-26T10:44:39.134 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.134 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.134 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:39.134 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517199+0000", 2024-04-26T10:44:39.134 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0652000000000001e-05 2024-04-26T10:44:39.134 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.134 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.134 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.134 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517206+0000", 2024-04-26T10:44:39.134 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6610000000000003e-06 2024-04-26T10:44:39.134 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.134 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.134 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:39.135 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537905+0000", 2024-04-26T10:44:39.135 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020699662000000001 2024-04-26T10:44:39.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.135 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.135 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:39.135 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537956+0000", 2024-04-26T10:44:39.135 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0954e-05 2024-04-26T10:44:39.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.135 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.135 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:39.135 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544233+0000", 2024-04-26T10:44:39.135 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062773009999999999 2024-04-26T10:44:39.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.136 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.136 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:39.136 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544258+0000", 2024-04-26T10:44:39.136 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4434999999999999e-05 2024-04-26T10:44:39.136 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.136 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.136 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:39.136 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544290+0000", 2024-04-26T10:44:39.136 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1918000000000002e-05 2024-04-26T10:44:39.136 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.136 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:39.136 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.136 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.136 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.136 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:339 3.13 3:ceffbd45:::200.0000000a:head [write 1346485~4322 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:39.137 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:39.137 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 12.570858783, 2024-04-26T10:44:39.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026221617999999999, 2024-04-26T10:44:39.137 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:39.137 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.137 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:39.137 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.137 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:39.137 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:39.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.137 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.137 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.137 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:39.137 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:39.138 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.138 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.138 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.138 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:39.138 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518122+0000", 2024-04-26T10:44:39.138 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:39.138 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.138 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.138 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:39.138 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518129+0000", 2024-04-26T10:44:39.138 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.43e-06 2024-04-26T10:44:39.138 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.138 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.138 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:39.139 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518138+0000", 2024-04-26T10:44:39.139 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9129999999999992e-06 2024-04-26T10:44:39.139 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.139 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.139 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.139 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518144+0000", 2024-04-26T10:44:39.139 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.1419999999999998e-06 2024-04-26T10:44:39.139 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.139 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.139 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:39.139 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538232+0000", 2024-04-26T10:44:39.139 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020087383 2024-04-26T10:44:39.139 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.139 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.139 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:39.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538274+0000", 2024-04-26T10:44:39.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2602999999999999e-05 2024-04-26T10:44:39.140 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.140 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.140 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:39.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544294+0000", 2024-04-26T10:44:39.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060194059999999997 2024-04-26T10:44:39.140 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.140 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.140 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:39.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544314+0000", 2024-04-26T10:44:39.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0091000000000001e-05 2024-04-26T10:44:39.140 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.140 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.140 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:39.141 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544344+0000", 2024-04-26T10:44:39.141 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0446e-05 2024-04-26T10:44:39.141 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.141 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:39.141 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.141 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.141 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.141 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:340 3.13 3:ceffbd45:::200.0000000a:head [write 1350807~2768 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:39.141 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:39.141 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 12.568374546999999, 2024-04-26T10:44:39.141 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023795594, 2024-04-26T10:44:39.141 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:39.141 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.141 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:39.141 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.142 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:39.142 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:39.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.142 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.142 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.142 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:39.142 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:39.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.142 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.142 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.142 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:39.142 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520606+0000", 2024-04-26T10:44:39.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:39.142 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.142 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:39.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520612+0000", 2024-04-26T10:44:39.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.835e-06 2024-04-26T10:44:39.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:39.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520622+0000", 2024-04-26T10:44:39.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0173999999999999e-05 2024-04-26T10:44:39.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520629+0000", 2024-04-26T10:44:39.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7460000000000003e-06 2024-04-26T10:44:39.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.144 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:39.144 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538651+0000", 2024-04-26T10:44:39.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018022474 2024-04-26T10:44:39.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.144 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:39.144 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538697+0000", 2024-04-26T10:44:39.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6183999999999997e-05 2024-04-26T10:44:39.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.144 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:39.144 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544348+0000", 2024-04-26T10:44:39.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0056503509999999996 2024-04-26T10:44:39.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.145 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:39.145 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544369+0000", 2024-04-26T10:44:39.145 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1064999999999999e-05 2024-04-26T10:44:39.145 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.145 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.145 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:39.145 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544403+0000", 2024-04-26T10:44:39.145 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3695000000000002e-05 2024-04-26T10:44:39.145 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.145 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:39.145 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.145 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.145 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.145 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:341 3.13 3:ceffbd45:::200.0000000a:head [write 1353575~3816 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:39.145 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:39.146 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 12.567639291999999, 2024-04-26T10:44:39.146 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023114967, 2024-04-26T10:44:39.146 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:39.146 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.146 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:39.146 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.146 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:39.146 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:39.146 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.146 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.146 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.146 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:39.146 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:39.146 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.146 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.147 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.147 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:39.147 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521341+0000", 2024-04-26T10:44:39.147 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:39.147 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.147 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.147 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:39.147 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521349+0000", 2024-04-26T10:44:39.147 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1550000000000001e-06 2024-04-26T10:44:39.147 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.147 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.147 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:39.147 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521358+0000", 2024-04-26T10:44:39.147 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.1500000000000005e-06 2024-04-26T10:44:39.147 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521364+0000", 2024-04-26T10:44:39.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3289999999999999e-06 2024-04-26T10:44:39.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:39.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539010+0000", 2024-04-26T10:44:39.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.017645965999999999 2024-04-26T10:44:39.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:39.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539051+0000", 2024-04-26T10:44:39.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.053e-05 2024-04-26T10:44:39.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.149 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:39.149 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544407+0000", 2024-04-26T10:44:39.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053560209999999999 2024-04-26T10:44:39.149 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.149 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:39.149 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544427+0000", 2024-04-26T10:44:39.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0228e-05 2024-04-26T10:44:39.149 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.149 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:39.149 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544457+0000", 2024-04-26T10:44:39.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0375e-05 2024-04-26T10:44:39.150 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.150 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:39.150 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.150 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.150 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.150 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11582 4.2f 4:f76ba295:::10000003252.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:39.150 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:39.150 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 10.094023747, 2024-04-26T10:44:39.150 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024553994999999999, 2024-04-26T10:44:39.150 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:39.150 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.150 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:39.150 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:39.150 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:39.150 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11582 2024-04-26T10:44:39.151 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.151 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:39.151 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.151 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:39.151 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:39.151 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.151 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.151 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.151 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:39.151 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:39.151 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.151 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.151 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.151 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:39.152 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994957+0000", 2024-04-26T10:44:39.152 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:39.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.152 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.152 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:39.152 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002755+0000", 2024-04-26T10:44:39.152 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0077984719999999999 2024-04-26T10:44:39.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.152 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.152 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:39.152 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002770+0000", 2024-04-26T10:44:39.152 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4956e-05 2024-04-26T10:44:39.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.152 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.152 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.152 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002777+0000", 2024-04-26T10:44:39.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1899999999999998e-06 2024-04-26T10:44:39.153 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:39.153 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002833+0000", 2024-04-26T10:44:39.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5189999999999998e-05 2024-04-26T10:44:39.153 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:39.153 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002977+0000", 2024-04-26T10:44:39.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014444100000000001 2024-04-26T10:44:39.153 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:39.154 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.003108+0000", 2024-04-26T10:44:39.154 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000131068 2024-04-26T10:44:39.154 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.154 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.154 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:39.154 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.009040+0000", 2024-04-26T10:44:39.154 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059314149999999998 2024-04-26T10:44:39.154 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.154 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.154 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.154 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019462+0000", 2024-04-26T10:44:39.154 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010422803 2024-04-26T10:44:39.154 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.154 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.154 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:39.155 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019490+0000", 2024-04-26T10:44:39.155 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7773999999999999e-05 2024-04-26T10:44:39.155 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.155 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.155 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:39.155 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019512+0000", 2024-04-26T10:44:39.155 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1611999999999999e-05 2024-04-26T10:44:39.155 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.155 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:39.155 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.155 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.155 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.155 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11911 4.37 4:ec04ab04:::100000031ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:39.155 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:39.156 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 9.7523035399999998, 2024-04-26T10:44:39.156 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026810273999999999, 2024-04-26T10:44:39.156 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:39.156 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.156 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:39.156 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:39.156 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:39.156 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11911 2024-04-26T10:44:39.156 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.156 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:39.156 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.156 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:39.156 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:39.157 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.157 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.157 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.157 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:39.157 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:39.157 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.157 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.157 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.157 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:39.158 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336676+0000", 2024-04-26T10:44:39.158 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:39.158 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.158 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.158 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:39.158 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343119+0000", 2024-04-26T10:44:39.158 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0064424850000000004 2024-04-26T10:44:39.158 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.158 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.158 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:39.158 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343131+0000", 2024-04-26T10:44:39.158 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1708e-05 2024-04-26T10:44:39.158 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.159 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.159 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.159 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343137+0000", 2024-04-26T10:44:39.159 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9880000000000001e-06 2024-04-26T10:44:39.159 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.159 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.159 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:39.159 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343175+0000", 2024-04-26T10:44:39.159 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7913000000000001e-05 2024-04-26T10:44:39.159 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.159 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.159 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:39.159 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343269+0000", 2024-04-26T10:44:39.159 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4931000000000003e-05 2024-04-26T10:44:39.160 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.160 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.160 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:39.160 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343392+0000", 2024-04-26T10:44:39.160 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000122435 2024-04-26T10:44:39.160 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.160 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.160 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:39.160 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.347520+0000", 2024-04-26T10:44:39.160 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004128418 2024-04-26T10:44:39.160 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.160 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.160 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.160 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363410+0000", 2024-04-26T10:44:39.161 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.015889309000000001 2024-04-26T10:44:39.161 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.161 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.161 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:39.161 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363453+0000", 2024-04-26T10:44:39.161 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3244000000000001e-05 2024-04-26T10:44:39.161 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.161 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.161 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:39.161 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363488+0000", 2024-04-26T10:44:39.161 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5318000000000003e-05 2024-04-26T10:44:39.161 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.161 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:39.161 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.161 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.161 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.162 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12000 4.3c 4:3c2be35d:::100000030f7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:39.162 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:39.162 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 9.6696820280000004, 2024-04-26T10:44:39.162 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022808264000000002, 2024-04-26T10:44:39.162 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:39.162 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.162 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:39.162 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:39.162 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:39.162 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12000 2024-04-26T10:44:39.162 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.162 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:39.162 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.163 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:39.163 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:39.163 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.163 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.163 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.163 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:39.163 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:39.163 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.163 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.163 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.163 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:39.163 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:39.163 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:39.163 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.163 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.164 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:39.164 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430937+0000", 2024-04-26T10:44:39.164 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.011638097 2024-04-26T10:44:39.164 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.164 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.164 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:39.164 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430948+0000", 2024-04-26T10:44:39.164 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0824e-05 2024-04-26T10:44:39.164 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.164 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.164 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.164 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430953+0000", 2024-04-26T10:44:39.164 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5219999999999998e-06 2024-04-26T10:44:39.164 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.164 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.165 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:39.165 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430990+0000", 2024-04-26T10:44:39.165 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6458999999999998e-05 2024-04-26T10:44:39.165 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.165 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.165 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:39.165 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.431052+0000", 2024-04-26T10:44:39.165 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2687000000000005e-05 2024-04-26T10:44:39.165 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.165 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.165 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:39.165 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442027+0000", 2024-04-26T10:44:39.165 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010974513 2024-04-26T10:44:39.165 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.165 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.166 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:39.166 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442060+0000", 2024-04-26T10:44:39.166 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2849999999999999e-05 2024-04-26T10:44:39.166 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.166 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.166 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:39.166 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442108+0000", 2024-04-26T10:44:39.166 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8031999999999997e-05 2024-04-26T10:44:39.166 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.166 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:39.166 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.166 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.166 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.166 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12042 4.2f 4:f741970f:::10000003414.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:39.167 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:39.167 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 9.6304285509999996, 2024-04-26T10:44:39.167 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.029390757, 2024-04-26T10:44:39.167 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:39.167 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.167 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:39.167 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:39.167 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:39.167 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12042 2024-04-26T10:44:39.167 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.167 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:39.167 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.167 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:39.167 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:39.167 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.168 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.168 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.168 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:39.168 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:39.168 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.168 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.168 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.168 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:39.168 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458552+0000", 2024-04-26T10:44:39.168 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:39.168 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.168 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.168 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:39.168 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464335+0000", 2024-04-26T10:44:39.168 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.005783168 2024-04-26T10:44:39.169 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.169 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.169 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:39.169 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464347+0000", 2024-04-26T10:44:39.169 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1578e-05 2024-04-26T10:44:39.169 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.169 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.169 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.169 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464353+0000", 2024-04-26T10:44:39.169 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3709999999999996e-06 2024-04-26T10:44:39.169 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.169 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.169 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:39.169 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464407+0000", 2024-04-26T10:44:39.169 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3717000000000001e-05 2024-04-26T10:44:39.169 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.170 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.170 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:39.170 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464556+0000", 2024-04-26T10:44:39.170 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014899100000000001 2024-04-26T10:44:39.170 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.170 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.170 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:39.170 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464688+0000", 2024-04-26T10:44:39.170 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013238599999999999 2024-04-26T10:44:39.170 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.170 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.170 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:39.170 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.469725+0000", 2024-04-26T10:44:39.170 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0050369229999999996 2024-04-26T10:44:39.171 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.171 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.171 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.171 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487892+0000", 2024-04-26T10:44:39.171 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018167184999999999 2024-04-26T10:44:39.171 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.171 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.171 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:39.171 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487922+0000", 2024-04-26T10:44:39.171 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.9495000000000001e-05 2024-04-26T10:44:39.171 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.171 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.171 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:39.171 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487944+0000", 2024-04-26T10:44:39.171 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1823000000000001e-05 2024-04-26T10:44:39.172 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.172 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:39.172 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.172 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.172 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.172 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12050 4.2c 4:36b72e58:::100000031ba.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:39.172 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:39.172 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 9.6218879420000007, 2024-04-26T10:44:39.172 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022722497000000001, 2024-04-26T10:44:39.172 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:39.172 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.172 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:39.172 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:39.172 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:39.172 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12050 2024-04-26T10:44:39.173 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.173 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:39.173 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.173 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:39.173 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:39.173 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.173 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.173 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.173 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:39.173 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:39.173 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.173 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.173 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.173 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:39.173 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467093+0000", 2024-04-26T10:44:39.174 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:39.174 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.174 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.174 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:39.174 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476305+0000", 2024-04-26T10:44:39.174 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092125850000000006 2024-04-26T10:44:39.174 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.174 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.174 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:39.174 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476322+0000", 2024-04-26T10:44:39.174 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6860000000000001e-05 2024-04-26T10:44:39.174 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.174 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.174 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.174 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476328+0000", 2024-04-26T10:44:39.175 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.587e-06 2024-04-26T10:44:39.175 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.175 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.175 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:39.175 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476378+0000", 2024-04-26T10:44:39.175 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0519999999999997e-05 2024-04-26T10:44:39.175 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.175 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.175 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:39.175 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476474+0000", 2024-04-26T10:44:39.175 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5556000000000005e-05 2024-04-26T10:44:39.175 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.175 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.175 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:39.176 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489677+0000", 2024-04-26T10:44:39.176 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013203048 2024-04-26T10:44:39.176 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.176 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.176 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:39.176 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489722+0000", 2024-04-26T10:44:39.176 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4650000000000001e-05 2024-04-26T10:44:39.176 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.176 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.176 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:39.176 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489816+0000", 2024-04-26T10:44:39.176 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4402999999999997e-05 2024-04-26T10:44:39.176 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.176 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:39.176 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.177 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.177 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.177 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12516 4.37 4:ed0cb515:::10000003324.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:39.177 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:39.177 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 9.1018063770000008, 2024-04-26T10:44:39.177 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.030139677, 2024-04-26T10:44:39.177 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:39.177 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.177 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:39.177 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:39.177 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:39.177 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12516 2024-04-26T10:44:39.177 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.177 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:39.177 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.177 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:39.178 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:39.178 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.178 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.178 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.178 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:39.178 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:39.178 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.178 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.178 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.178 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:39.178 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987173+0000", 2024-04-26T10:44:39.178 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:39.178 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.178 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.179 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:39.179 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991339+0000", 2024-04-26T10:44:39.179 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0041663760000000003 2024-04-26T10:44:39.179 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.179 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.179 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:39.179 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991351+0000", 2024-04-26T10:44:39.179 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1333e-05 2024-04-26T10:44:39.179 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.179 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.179 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.179 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991357+0000", 2024-04-26T10:44:39.179 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3350000000000003e-06 2024-04-26T10:44:39.179 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.179 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.180 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:39.180 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991394+0000", 2024-04-26T10:44:39.180 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7054000000000001e-05 2024-04-26T10:44:39.180 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.180 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.180 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:39.180 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991495+0000", 2024-04-26T10:44:39.180 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000100386 2024-04-26T10:44:39.180 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.180 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.180 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:39.180 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991579+0000", 2024-04-26T10:44:39.180 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4295000000000005e-05 2024-04-26T10:44:39.180 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.180 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.181 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:39.181 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.996238+0000", 2024-04-26T10:44:39.181 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0046589309999999998 2024-04-26T10:44:39.181 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.181 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.181 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.181 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017237+0000", 2024-04-26T10:44:39.181 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020998993000000001 2024-04-26T10:44:39.181 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.181 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.181 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:39.181 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017280+0000", 2024-04-26T10:44:39.181 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3600000000000003e-05 2024-04-26T10:44:39.181 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.181 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.182 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:39.182 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017315+0000", 2024-04-26T10:44:39.182 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4381999999999997e-05 2024-04-26T10:44:39.182 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.182 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:39.182 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.182 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.182 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.182 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12644 4.37 4:ec5044d7:::100000032d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:39.182 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:39.182 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.928133549, 2024-04-26T10:44:39.182 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.037018677, 2024-04-26T10:44:39.182 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:39.182 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.182 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:39.183 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:39.183 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:39.183 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12644 2024-04-26T10:44:39.183 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.183 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:39.183 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.183 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:39.183 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:39.183 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.183 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.183 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.183 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:39.183 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:39.183 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.184 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.184 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.184 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:39.184 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160847+0000", 2024-04-26T10:44:39.184 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:39.184 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.184 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.184 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:39.184 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170089+0000", 2024-04-26T10:44:39.184 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092424289999999999 2024-04-26T10:44:39.184 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.184 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.184 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:39.184 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170111+0000", 2024-04-26T10:44:39.184 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1733e-05 2024-04-26T10:44:39.185 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.185 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.185 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.185 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170124+0000", 2024-04-26T10:44:39.185 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.272e-05 2024-04-26T10:44:39.185 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.185 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.185 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:39.185 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170177+0000", 2024-04-26T10:44:39.185 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3745000000000001e-05 2024-04-26T10:44:39.185 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.185 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.185 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:39.186 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170350+0000", 2024-04-26T10:44:39.186 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017297699999999999 2024-04-26T10:44:39.186 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.186 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.186 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:39.186 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170458+0000", 2024-04-26T10:44:39.186 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000107583 2024-04-26T10:44:39.186 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.186 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.186 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:39.187 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.176693+0000", 2024-04-26T10:44:39.187 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062351799999999999 2024-04-26T10:44:39.187 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.187 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.187 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.187 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197774+0000", 2024-04-26T10:44:39.187 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021080471999999999 2024-04-26T10:44:39.187 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.187 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.187 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:39.187 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197824+0000", 2024-04-26T10:44:39.187 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0096000000000003e-05 2024-04-26T10:44:39.187 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.187 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.187 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:39.188 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197867+0000", 2024-04-26T10:44:39.188 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2882e-05 2024-04-26T10:44:39.188 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.188 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:39.188 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.188 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.188 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.188 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:13242 4.2f 4:f5e54bb5:::100000033c8.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:39.188 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:39.188 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.2499024110000008, 2024-04-26T10:44:39.188 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023873062, 2024-04-26T10:44:39.188 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:39.188 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.188 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:39.188 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:39.189 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:39.189 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 13242 2024-04-26T10:44:39.189 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.189 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:39.189 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.189 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:39.189 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:39.189 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.189 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.189 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.189 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:39.189 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:39.189 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:39.189 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.190 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.190 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:39.190 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839078+0000", 2024-04-26T10:44:39.190 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:39.190 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.190 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.190 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:39.190 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848098+0000", 2024-04-26T10:44:39.190 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090200750000000007 2024-04-26T10:44:39.190 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.190 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.190 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:39.190 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848108+0000", 2024-04-26T10:44:39.190 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.062e-05 2024-04-26T10:44:39.190 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.191 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.191 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.191 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848115+0000", 2024-04-26T10:44:39.191 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3040000000000001e-06 2024-04-26T10:44:39.191 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.191 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.191 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:39.191 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848157+0000", 2024-04-26T10:44:39.191 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2533000000000001e-05 2024-04-26T10:44:39.191 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.191 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.191 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:39.191 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848252+0000", 2024-04-26T10:44:39.191 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4480000000000003e-05 2024-04-26T10:44:39.192 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.192 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.192 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:39.192 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848393+0000", 2024-04-26T10:44:39.192 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000140863 2024-04-26T10:44:39.192 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.192 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.192 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:39.192 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.854434+0000", 2024-04-26T10:44:39.192 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060415590000000002 2024-04-26T10:44:39.192 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.192 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.192 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.192 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862894+0000", 2024-04-26T10:44:39.192 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0084598869999999993 2024-04-26T10:44:39.192 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.193 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.193 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:39.193 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862926+0000", 2024-04-26T10:44:39.193 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1473999999999997e-05 2024-04-26T10:44:39.193 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:39.193 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:39.193 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:39.193 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862952+0000", 2024-04-26T10:44:39.193 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6545000000000001e-05 2024-04-26T10:44:39.193 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.193 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:39.193 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.193 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:39.193 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:39.193 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:39.195 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:39.196 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:39.193+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:39.296 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:39.294+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:39.338 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:39.338 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:39.338 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:44:39.338 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:39.346 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:39.397 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:39.396+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:39.469 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:44:39.499 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:39.497+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:39.500 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:39.500 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:39.500 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:39.500 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:39.500 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:39.510 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:39.600 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:39.598+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:39.620 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:39.620 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:39.621 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:39.621 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:39.621 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.621 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:80 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:39.621 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:39.621 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 18.095893791000002, 2024-04-26T10:44:39.621 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029259192, 2024-04-26T10:44:39.621 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:39.621 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.621 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:39.621 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.621 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:39.621 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:39.621 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.622 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:39.622 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:39.622 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.622 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:39.622 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522252+0000", 2024-04-26T10:44:39.622 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:39.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.622 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:39.623 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523121+0000", 2024-04-26T10:44:39.623 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00086885100000000002 2024-04-26T10:44:39.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.623 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:39.623 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523133+0000", 2024-04-26T10:44:39.623 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2109999999999999e-05 2024-04-26T10:44:39.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.623 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.623 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523139+0000", 2024-04-26T10:44:39.623 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.541e-06 2024-04-26T10:44:39.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.624 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:39.624 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523176+0000", 2024-04-26T10:44:39.624 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6847999999999997e-05 2024-04-26T10:44:39.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.624 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:39.624 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523240+0000", 2024-04-26T10:44:39.624 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3941000000000003e-05 2024-04-26T10:44:39.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.624 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:39.624 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.536390+0000", 2024-04-26T10:44:39.624 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013150811 2024-04-26T10:44:39.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.625 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.625 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551071+0000", 2024-04-26T10:44:39.625 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014680021 2024-04-26T10:44:39.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.625 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:39.625 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551428+0000", 2024-04-26T10:44:39.625 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00035703900000000002 2024-04-26T10:44:39.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.625 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:39.625 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551462+0000", 2024-04-26T10:44:39.625 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4337e-05 2024-04-26T10:44:39.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.626 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.626 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:39.626 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551513+0000", 2024-04-26T10:44:39.626 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0875000000000003e-05 2024-04-26T10:44:39.626 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.626 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:39.626 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.626 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.626 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.626 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:129 3.1a 3:5e41ab69:::200.00000005:head [write 3557843~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:39.626 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:39.626 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 18.091835720999999, 2024-04-26T10:44:39.626 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029108253000000001, 2024-04-26T10:44:39.627 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:39.627 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.627 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:39.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.627 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:39.627 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:39.627 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.627 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:39.627 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:39.627 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.628 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:39.628 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526311+0000", 2024-04-26T10:44:39.628 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:39.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.628 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:39.628 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526315+0000", 2024-04-26T10:44:39.628 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4809999999999998e-06 2024-04-26T10:44:39.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.628 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:39.628 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526319+0000", 2024-04-26T10:44:39.628 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0690000000000003e-06 2024-04-26T10:44:39.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.629 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.629 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526321+0000", 2024-04-26T10:44:39.629 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4880000000000001e-06 2024-04-26T10:44:39.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.629 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:39.629 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553856+0000", 2024-04-26T10:44:39.629 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027534916 2024-04-26T10:44:39.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.629 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:39.629 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553900+0000", 2024-04-26T10:44:39.629 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3954e-05 2024-04-26T10:44:39.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.630 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:39.630 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553962+0000", 2024-04-26T10:44:39.630 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1519000000000005e-05 2024-04-26T10:44:39.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.630 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:39.630 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555348+0000", 2024-04-26T10:44:39.630 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013864579999999999 2024-04-26T10:44:39.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.630 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.631 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555378+0000", 2024-04-26T10:44:39.631 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9441000000000002e-05 2024-04-26T10:44:39.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.631 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:39.631 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555401+0000", 2024-04-26T10:44:39.631 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2815000000000001e-05 2024-04-26T10:44:39.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.631 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:39.631 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555420+0000", 2024-04-26T10:44:39.631 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9341e-05 2024-04-26T10:44:39.631 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.631 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:39.631 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.632 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.632 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:130 3.1a 3:5e41ab69:::200.00000005:head [write 3559243~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:39.632 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:39.632 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 18.091823886, 2024-04-26T10:44:39.632 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029188316999999998, 2024-04-26T10:44:39.632 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:39.632 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.632 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:39.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.632 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:39.632 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:39.632 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.632 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.633 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:39.633 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:39.633 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.633 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:39.633 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:39.633 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:39.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.633 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:39.633 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526325+0000", 2024-04-26T10:44:39.633 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4899999999999999e-06 2024-04-26T10:44:39.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.634 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:39.634 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526327+0000", 2024-04-26T10:44:39.634 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.745e-06 2024-04-26T10:44:39.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.634 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.634 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526330+0000", 2024-04-26T10:44:39.634 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5620000000000002e-06 2024-04-26T10:44:39.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.634 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:39.634 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554200+0000", 2024-04-26T10:44:39.635 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027869541000000001 2024-04-26T10:44:39.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.635 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:39.635 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554244+0000", 2024-04-26T10:44:39.635 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4464e-05 2024-04-26T10:44:39.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.635 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:39.635 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554304+0000", 2024-04-26T10:44:39.635 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9457999999999999e-05 2024-04-26T10:44:39.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.635 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.635 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555453+0000", 2024-04-26T10:44:39.636 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011494000000000001 2024-04-26T10:44:39.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.636 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:39.636 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555457+0000", 2024-04-26T10:44:39.636 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1779999999999996e-06 2024-04-26T10:44:39.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.636 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:39.636 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555480+0000", 2024-04-26T10:44:39.636 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2802e-05 2024-04-26T10:44:39.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.636 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:39.636 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555512+0000", 2024-04-26T10:44:39.637 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1885999999999999e-05 2024-04-26T10:44:39.637 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.637 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:39.637 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.637 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.637 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:131 3.1a 3:5e41ab69:::200.00000005:head [write 3560642~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:39.637 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:39.637 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 18.091815306000001, 2024-04-26T10:44:39.637 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029683102999999999, 2024-04-26T10:44:39.637 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:39.637 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.637 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:39.637 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:39.638 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526336+0000", 2024-04-26T10:44:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.681e-06 2024-04-26T10:44:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526338+0000", 2024-04-26T10:44:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8430000000000001e-06 2024-04-26T10:44:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526341+0000", 2024-04-26T10:44:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6180000000000002e-06 2024-04-26T10:44:39.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554745+0000", 2024-04-26T10:44:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028404088000000001 2024-04-26T10:44:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554788+0000", 2024-04-26T10:44:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2738999999999999e-05 2024-04-26T10:44:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554849+0000", 2024-04-26T10:44:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1362e-05 2024-04-26T10:44:39.640 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555963+0000", 2024-04-26T10:44:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001113597 2024-04-26T10:44:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555969+0000", 2024-04-26T10:44:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6900000000000003e-06 2024-04-26T10:44:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555995+0000", 2024-04-26T10:44:39.641 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5165999999999999e-05 2024-04-26T10:44:39.642 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.642 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.642 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:39.642 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556015+0000", 2024-04-26T10:44:39.642 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0522000000000001e-05 2024-04-26T10:44:39.642 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.642 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:39.642 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.642 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:132 3.1a 3:5e41ab69:::200.00000005:head [write 3562043~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 18.091795041000001, 2024-04-26T10:44:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030129895, 2024-04-26T10:44:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.643 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526354+0000", 2024-04-26T10:44:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8560000000000001e-06 2024-04-26T10:44:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526359+0000", 2024-04-26T10:44:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4700000000000001e-06 2024-04-26T10:44:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526365+0000", 2024-04-26T10:44:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2120000000000002e-06 2024-04-26T10:44:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555050+0000", 2024-04-26T10:44:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028685458 2024-04-26T10:44:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555093+0000", 2024-04-26T10:44:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3307999999999999e-05 2024-04-26T10:44:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555156+0000", 2024-04-26T10:44:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2396000000000004e-05 2024-04-26T10:44:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556052+0000", 2024-04-26T10:44:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00089650299999999999 2024-04-26T10:44:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556439+0000", 2024-04-26T10:44:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038647900000000001 2024-04-26T10:44:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556463+0000", 2024-04-26T10:44:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4071e-05 2024-04-26T10:44:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556482+0000", 2024-04-26T10:44:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9378999999999999e-05 2024-04-26T10:44:39.647 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 3563440~3660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 18.091778647000002, 2024-04-26T10:44:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030550738000000001, 2024-04-26T10:44:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:39.648 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526368+0000", 2024-04-26T10:44:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:39.649 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526375+0000", 2024-04-26T10:44:39.650 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7510000000000002e-06 2024-04-26T10:44:39.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.650 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:39.650 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526381+0000", 2024-04-26T10:44:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3929999999999996e-06 2024-04-26T10:44:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526387+0000", 2024-04-26T10:44:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.215e-06 2024-04-26T10:44:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555542+0000", 2024-04-26T10:44:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029154992000000001 2024-04-26T10:44:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:39.651 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555610+0000", 2024-04-26T10:44:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8610999999999998e-05 2024-04-26T10:44:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555681+0000", 2024-04-26T10:44:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1072e-05 2024-04-26T10:44:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556866+0000", 2024-04-26T10:44:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001184598 2024-04-26T10:44:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.652 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556872+0000", 2024-04-26T10:44:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.55e-06 2024-04-26T10:44:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556897+0000", 2024-04-26T10:44:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.516e-05 2024-04-26T10:44:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556919+0000", 2024-04-26T10:44:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1951e-05 2024-04-26T10:44:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.653 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:134 3.1a 3:5e41ab69:::200.00000005:head [write 3567100~2427 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 18.091745582000001, 2024-04-26T10:44:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031267445999999997, 2024-04-26T10:44:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:39.654 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526401+0000", 2024-04-26T10:44:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.655 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526408+0000", 2024-04-26T10:44:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7769999999999997e-06 2024-04-26T10:44:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526415+0000", 2024-04-26T10:44:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0720000000000002e-06 2024-04-26T10:44:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526421+0000", 2024-04-26T10:44:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9699999999999996e-06 2024-04-26T10:44:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.656 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556084+0000", 2024-04-26T10:44:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029662351999999999 2024-04-26T10:44:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556126+0000", 2024-04-26T10:44:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2385000000000002e-05 2024-04-26T10:44:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556186+0000", 2024-04-26T10:44:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9945999999999998e-05 2024-04-26T10:44:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.657 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557598+0000", 2024-04-26T10:44:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0014121559999999999 2024-04-26T10:44:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557626+0000", 2024-04-26T10:44:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7960999999999999e-05 2024-04-26T10:44:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557650+0000", 2024-04-26T10:44:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3969999999999999e-05 2024-04-26T10:44:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557669+0000", 2024-04-26T10:44:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9262e-05 2024-04-26T10:44:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:135 3.1a 3:5e41ab69:::200.00000005:head [write 3569527~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 18.091721316000001, 2024-04-26T10:44:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031322516000000002, 2024-04-26T10:44:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.659 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:39.660 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:39.661 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526429+0000", 2024-04-26T10:44:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0750000000000002e-06 2024-04-26T10:44:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526435+0000", 2024-04-26T10:44:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.263e-06 2024-04-26T10:44:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.662 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526442+0000", 2024-04-26T10:44:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1219999999999997e-06 2024-04-26T10:44:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556515+0000", 2024-04-26T10:44:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030073132999999998 2024-04-26T10:44:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556564+0000", 2024-04-26T10:44:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8871e-05 2024-04-26T10:44:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.663 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556625+0000", 2024-04-26T10:44:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1307000000000001e-05 2024-04-26T10:44:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557678+0000", 2024-04-26T10:44:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010523100000000001 2024-04-26T10:44:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557709+0000", 2024-04-26T10:44:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1748000000000002e-05 2024-04-26T10:44:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.664 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557732+0000", 2024-04-26T10:44:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2415000000000001e-05 2024-04-26T10:44:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557749+0000", 2024-04-26T10:44:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6736999999999999e-05 2024-04-26T10:44:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:136 3.1a 3:5e41ab69:::200.00000005:head [write 3571449~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:39.665 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 18.091700125999999, 2024-04-26T10:44:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032180937, 2024-04-26T10:44:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526455+0000", 2024-04-26T10:44:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6429999999999995e-06 2024-04-26T10:44:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526461+0000", 2024-04-26T10:44:39.667 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526467+0000", 2024-04-26T10:44:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4389999999999999e-06 2024-04-26T10:44:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556950+0000", 2024-04-26T10:44:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030483854000000001 2024-04-26T10:44:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556989+0000", 2024-04-26T10:44:39.668 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8415999999999999e-05 2024-04-26T10:44:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557051+0000", 2024-04-26T10:44:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2088999999999995e-05 2024-04-26T10:44:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558166+0000", 2024-04-26T10:44:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001114622 2024-04-26T10:44:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.669 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558584+0000", 2024-04-26T10:44:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000418033 2024-04-26T10:44:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558609+0000", 2024-04-26T10:44:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5344999999999999e-05 2024-04-26T10:44:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558628+0000", 2024-04-26T10:44:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9273999999999999e-05 2024-04-26T10:44:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:39.670 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:137 3.1a 3:5e41ab69:::200.00000005:head [write 3573699~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 18.091676477, 2024-04-26T10:44:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032241530999999997, 2024-04-26T10:44:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526470+0000", 2024-04-26T10:44:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526473+0000", 2024-04-26T10:44:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.818e-06 2024-04-26T10:44:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526480+0000", 2024-04-26T10:44:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4119999999999998e-06 2024-04-26T10:44:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526484+0000", 2024-04-26T10:44:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6840000000000004e-06 2024-04-26T10:44:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557323+0000", 2024-04-26T10:44:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030838956000000001 2024-04-26T10:44:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.674 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:39.674 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557362+0000", 2024-04-26T10:44:39.674 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8343999999999997e-05 2024-04-26T10:44:39.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557421+0000", 2024-04-26T10:44:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9176999999999999e-05 2024-04-26T10:44:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558636+0000", 2024-04-26T10:44:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012153789999999999 2024-04-26T10:44:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558668+0000", 2024-04-26T10:44:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1452999999999999e-05 2024-04-26T10:44:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558694+0000", 2024-04-26T10:44:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6288999999999999e-05 2024-04-26T10:44:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558712+0000", 2024-04-26T10:44:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8459000000000001e-05 2024-04-26T10:44:39.676 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:138 3.1a 3:5e41ab69:::200.00000005:head [write 3575103~4205 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 18.091659157999999, 2024-04-26T10:44:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032665567999999999, 2024-04-26T10:44:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:39.677 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:39.678 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526495+0000", 2024-04-26T10:44:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7580000000000003e-06 2024-04-26T10:44:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526501+0000", 2024-04-26T10:44:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1680000000000001e-06 2024-04-26T10:44:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526505+0000", 2024-04-26T10:44:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.673e-06 2024-04-26T10:44:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.679 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557781+0000", 2024-04-26T10:44:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031275718000000001 2024-04-26T10:44:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557825+0000", 2024-04-26T10:44:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4048000000000002e-05 2024-04-26T10:44:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557888+0000", 2024-04-26T10:44:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2562000000000002e-05 2024-04-26T10:44:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559073+0000", 2024-04-26T10:44:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011852239999999999 2024-04-26T10:44:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559112+0000", 2024-04-26T10:44:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9226e-05 2024-04-26T10:44:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559136+0000", 2024-04-26T10:44:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3966000000000001e-05 2024-04-26T10:44:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559154+0000", 2024-04-26T10:44:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7575e-05 2024-04-26T10:44:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:139 3.1a 3:5e41ab69:::200.00000005:head [write 3579308~2255 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 18.091637540000001, 2024-04-26T10:44:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033424720999999998, 2024-04-26T10:44:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:39.682 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526509+0000", 2024-04-26T10:44:39.684 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526516+0000", 2024-04-26T10:44:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5209999999999999e-06 2024-04-26T10:44:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526522+0000", 2024-04-26T10:44:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1229999999999997e-06 2024-04-26T10:44:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.685 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526527+0000", 2024-04-26T10:44:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7849999999999999e-06 2024-04-26T10:44:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558194+0000", 2024-04-26T10:44:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031667419000000002 2024-04-26T10:44:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558234+0000", 2024-04-26T10:44:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9774999999999998e-05 2024-04-26T10:44:39.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558294+0000", 2024-04-26T10:44:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0242999999999999e-05 2024-04-26T10:44:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559106+0000", 2024-04-26T10:44:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00081148099999999996 2024-04-26T10:44:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559890+0000", 2024-04-26T10:44:39.687 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00078439999999999998 2024-04-26T10:44:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559917+0000", 2024-04-26T10:44:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7044000000000001e-05 2024-04-26T10:44:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559935+0000", 2024-04-26T10:44:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7448e-05 2024-04-26T10:44:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:140 3.1a 3:5e41ab69:::200.00000005:head [write 3581563~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 18.091616119000001, 2024-04-26T10:44:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033867728, 2024-04-26T10:44:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.689 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526538+0000", 2024-04-26T10:44:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.905e-06 2024-04-26T10:44:39.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526542+0000", 2024-04-26T10:44:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9550000000000002e-06 2024-04-26T10:44:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526545+0000", 2024-04-26T10:44:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8499999999999998e-06 2024-04-26T10:44:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558744+0000", 2024-04-26T10:44:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032198986999999998 2024-04-26T10:44:39.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558788+0000", 2024-04-26T10:44:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4365e-05 2024-04-26T10:44:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558854+0000", 2024-04-26T10:44:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5952999999999997e-05 2024-04-26T10:44:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559971+0000", 2024-04-26T10:44:39.692 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011172770000000001 2024-04-26T10:44:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560354+0000", 2024-04-26T10:44:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038267599999999998 2024-04-26T10:44:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560380+0000", 2024-04-26T10:44:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6140999999999999e-05 2024-04-26T10:44:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:39.693 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560399+0000", 2024-04-26T10:44:39.694 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9032999999999999e-05 2024-04-26T10:44:39.694 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.694 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:39.694 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.695 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:141 3.1a 3:5e41ab69:::200.00000005:head [write 3583482~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:39.696 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:39.696 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 18.091600459999999, 2024-04-26T10:44:39.696 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034316301, 2024-04-26T10:44:39.696 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:39.696 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.696 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:39.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.696 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:39.696 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.697 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526548+0000", 2024-04-26T10:44:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.739e-06 2024-04-26T10:44:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526551+0000", 2024-04-26T10:44:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.044e-06 2024-04-26T10:44:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526562+0000", 2024-04-26T10:44:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0370000000000001e-05 2024-04-26T10:44:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.698 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559179+0000", 2024-04-26T10:44:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032617444000000002 2024-04-26T10:44:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559220+0000", 2024-04-26T10:44:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0364999999999997e-05 2024-04-26T10:44:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559280+0000", 2024-04-26T10:44:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0569000000000002e-05 2024-04-26T10:44:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560814+0000", 2024-04-26T10:44:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015337580000000001 2024-04-26T10:44:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560820+0000", 2024-04-26T10:44:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.455e-06 2024-04-26T10:44:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560846+0000", 2024-04-26T10:44:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5228999999999998e-05 2024-04-26T10:44:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.701 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:39.701 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560863+0000", 2024-04-26T10:44:39.701 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7555e-05 2024-04-26T10:44:39.701 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.701 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:39.701 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.701 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:142 3.1a 3:5e41ab69:::200.00000005:head [write 3585931~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:39.701 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:39.701 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 18.091580062999999, 2024-04-26T10:44:39.701 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034372373999999997, 2024-04-26T10:44:39.701 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:39.701 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.701 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:39.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.702 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:39.702 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:39.702 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.702 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:39.702 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:39.702 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.702 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:39.702 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:39.702 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526573+0000", 2024-04-26T10:44:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0800000000000002e-06 2024-04-26T10:44:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526580+0000", 2024-04-26T10:44:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5799999999999997e-06 2024-04-26T10:44:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526585+0000", 2024-04-26T10:44:39.703 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2270000000000001e-06 2024-04-26T10:44:39.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.704 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:39.704 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559601+0000", 2024-04-26T10:44:39.704 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033016684999999997 2024-04-26T10:44:39.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.704 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:39.705 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559642+0000", 2024-04-26T10:44:39.705 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0321000000000002e-05 2024-04-26T10:44:39.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.705 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:39.706 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559706+0000", 2024-04-26T10:44:39.706 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4228999999999998e-05 2024-04-26T10:44:39.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.706 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560871+0000", 2024-04-26T10:44:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001164893 2024-04-26T10:44:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560899+0000", 2024-04-26T10:44:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560922+0000", 2024-04-26T10:44:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3337999999999999e-05 2024-04-26T10:44:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.707 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560940+0000", 2024-04-26T10:44:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7289999999999999e-05 2024-04-26T10:44:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:143 3.1a 3:5e41ab69:::200.00000005:head [write 3587331~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 18.091558164999999, 2024-04-26T10:44:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035256000000000003, 2024-04-26T10:44:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:39.708 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:39.709 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526592+0000", 2024-04-26T10:44:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2449999999999998e-06 2024-04-26T10:44:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526596+0000", 2024-04-26T10:44:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7000000000000002e-06 2024-04-26T10:44:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.710 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526599+0000", 2024-04-26T10:44:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6160000000000002e-06 2024-04-26T10:44:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559997+0000", 2024-04-26T10:44:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033397835000000001 2024-04-26T10:44:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560051+0000", 2024-04-26T10:44:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3742000000000001e-05 2024-04-26T10:44:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.711 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560112+0000", 2024-04-26T10:44:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0851999999999999e-05 2024-04-26T10:44:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561404+0000", 2024-04-26T10:44:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001291869 2024-04-26T10:44:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561797+0000", 2024-04-26T10:44:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039383000000000002 2024-04-26T10:44:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561827+0000", 2024-04-26T10:44:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9247e-05 2024-04-26T10:44:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561845+0000", 2024-04-26T10:44:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8462999999999999e-05 2024-04-26T10:44:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:144 3.1a 3:5e41ab69:::200.00000005:head [write 3588736~4987 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:39.713 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 18.091435873000002, 2024-04-26T10:44:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035224283000000002, 2024-04-26T10:44:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:39.714 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.715 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:39.715 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:39.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526718+0000", 2024-04-26T10:44:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.43e-06 2024-04-26T10:44:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526726+0000", 2024-04-26T10:44:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:44:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526729+0000", 2024-04-26T10:44:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6480000000000001e-06 2024-04-26T10:44:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560427+0000", 2024-04-26T10:44:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033697280000000003 2024-04-26T10:44:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:39.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560466+0000", 2024-04-26T10:44:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9606e-05 2024-04-26T10:44:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560525+0000", 2024-04-26T10:44:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9218000000000001e-05 2024-04-26T10:44:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561854+0000", 2024-04-26T10:44:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001328421 2024-04-26T10:44:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.718 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561887+0000", 2024-04-26T10:44:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2746000000000001e-05 2024-04-26T10:44:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561912+0000", 2024-04-26T10:44:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5126999999999998e-05 2024-04-26T10:44:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561936+0000", 2024-04-26T10:44:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4032999999999998e-05 2024-04-26T10:44:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:39.719 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:145 3.1a 3:5e41ab69:::200.00000005:head [write 3593723~2939 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 18.088516827999999, 2024-04-26T10:44:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033294394999999997, 2024-04-26T10:44:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.721 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:39.721 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:39.721 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.721 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:39.721 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529630+0000", 2024-04-26T10:44:39.721 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:39.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.721 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:39.721 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529635+0000", 2024-04-26T10:44:39.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7960000000000003e-06 2024-04-26T10:44:39.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:39.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529643+0000", 2024-04-26T10:44:39.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0390000000000005e-06 2024-04-26T10:44:39.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529648+0000", 2024-04-26T10:44:39.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9599999999999999e-06 2024-04-26T10:44:39.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.723 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:39.723 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560969+0000", 2024-04-26T10:44:39.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031321767 2024-04-26T10:44:39.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.723 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:39.723 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561009+0000", 2024-04-26T10:44:39.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9904999999999998e-05 2024-04-26T10:44:39.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.723 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:39.723 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561070+0000", 2024-04-26T10:44:39.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0708999999999998e-05 2024-04-26T10:44:39.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.724 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:39.724 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562352+0000", 2024-04-26T10:44:39.724 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012818440000000001 2024-04-26T10:44:39.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.724 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.724 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.724 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562867+0000", 2024-04-26T10:44:39.724 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000515665 2024-04-26T10:44:39.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.724 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.724 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:39.724 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562893+0000", 2024-04-26T10:44:39.724 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5469999999999998e-05 2024-04-26T10:44:39.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.724 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.725 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:39.725 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562925+0000", 2024-04-26T10:44:39.725 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1974999999999998e-05 2024-04-26T10:44:39.725 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.725 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:39.725 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.725 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:146 3.1a 3:5e41ab69:::200.00000005:head [write 3596662~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:39.725 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:39.725 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 18.088288614, 2024-04-26T10:44:39.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033178429000000002, 2024-04-26T10:44:39.726 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:39.727 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.727 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:39.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:39.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:39.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:39.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:39.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:39.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529858+0000", 2024-04-26T10:44:39.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:39.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:39.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529863+0000", 2024-04-26T10:44:39.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4500000000000003e-06 2024-04-26T10:44:39.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:39.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529874+0000", 2024-04-26T10:44:39.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0552e-05 2024-04-26T10:44:39.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.729 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.729 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529882+0000", 2024-04-26T10:44:39.729 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4449999999999996e-06 2024-04-26T10:44:39.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.729 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:39.729 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561452+0000", 2024-04-26T10:44:39.729 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031569680000000003 2024-04-26T10:44:39.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.729 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:39.729 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561511+0000", 2024-04-26T10:44:39.729 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9332e-05 2024-04-26T10:44:39.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.730 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:39.730 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561583+0000", 2024-04-26T10:44:39.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1730000000000006e-05 2024-04-26T10:44:39.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.730 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:39.730 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562933+0000", 2024-04-26T10:44:39.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013500059999999999 2024-04-26T10:44:39.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.730 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.730 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562976+0000", 2024-04-26T10:44:39.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2987e-05 2024-04-26T10:44:39.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:39.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563015+0000", 2024-04-26T10:44:39.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9453999999999999e-05 2024-04-26T10:44:39.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:39.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563037+0000", 2024-04-26T10:44:39.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1679e-05 2024-04-26T10:44:39.731 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.731 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:39.731 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.732 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:277 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:39.732 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:39.732 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.103277910999999, 2024-04-26T10:44:39.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030430563000000001, 2024-04-26T10:44:39.732 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:39.732 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:39.732 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:39.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.732 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:39.732 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:39.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.732 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:39.733 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:39.733 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:39.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.733 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:39.733 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514867+0000", 2024-04-26T10:44:39.733 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:39.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.733 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:39.733 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515460+0000", 2024-04-26T10:44:39.733 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00059285800000000004 2024-04-26T10:44:39.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.734 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:39.734 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515474+0000", 2024-04-26T10:44:39.734 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3933e-05 2024-04-26T10:44:39.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.734 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:39.734 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515481+0000", 2024-04-26T10:44:39.734 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:39.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.734 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:39.734 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515522+0000", 2024-04-26T10:44:39.734 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1369000000000003e-05 2024-04-26T10:44:39.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.735 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:39.735 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515591+0000", 2024-04-26T10:44:39.735 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9377999999999999e-05 2024-04-26T10:44:39.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.735 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:39.735 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.526440+0000", 2024-04-26T10:44:39.735 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010848837 2024-04-26T10:44:39.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.735 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:39.735 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.543866+0000", 2024-04-26T10:44:39.735 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017426288000000002 2024-04-26T10:44:39.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.736 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:39.736 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545193+0000", 2024-04-26T10:44:39.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001326111 2024-04-26T10:44:39.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.736 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:39.736 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545229+0000", 2024-04-26T10:44:39.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6390999999999998e-05 2024-04-26T10:44:39.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:39.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:39.736 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:39.736 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545300+0000", 2024-04-26T10:44:39.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1073000000000002e-05 2024-04-26T10:44:39.736 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.737 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:39.737 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.737 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:39.737 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:39.737 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:39.739 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:39.739 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:39.736+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:39.761 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:44:39.839 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:39.837+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:39.845 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:39.845 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:39.845 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:44:39.845 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:39.855 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:39.897 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:39.898 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:39.898 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:39.918 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:39.918 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:39.922 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:39.922 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:39.940 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:39.939+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:39.996 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:39.996 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:40.004 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:40.048 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:40.047+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:40.106 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:40.106 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:40.114 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:40.160 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:40.156+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:40.243 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:40.240+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:40.277 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:40.277 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:40.291 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:40.343 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:40.342+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:40.444 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:40.443+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:40.467 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:40.467 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:40.477 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:40.544 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:40.543+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:40.588 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:40.588 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:40.597 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:40.646 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:40.644+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:40.683 INFO:teuthology.orchestra.run.smithi049.stderr:noscrub is unset 2024-04-26T10:44:40.700 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:40.700 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:40.709 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:40.752 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:40.751+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:40.810 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:40.810 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:40.820 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:40.860 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:40.859+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:40.948 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:40.946+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:40.967 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:40.967 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:40.976 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:41.049 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:41.047+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:41.085 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:41.085 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:41.094 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:41.150 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:41.148+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:41.244 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:41.244 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:41.251 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:41.250+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:41.258 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:41.353 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:41.350+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:41.453 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:41.451+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:41.459 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:41.459 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:41.469 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:41.553 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:41.552+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:41.579 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:41.579 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:41.589 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:41.654 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:41.653+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:41.693 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:41.693 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:41.701 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:41.786 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:41.785+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:41.847 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:41.847 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:41.856 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:41.854+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:41.857 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:41.923 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:44:41.956 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:41.954+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:41.967 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:41.967 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:41.976 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:42.061 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:42.059+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:42.062 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:42.063 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:42.063 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:42.084 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:42.084 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:42.086 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:42.087 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:42.127 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:42.127 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:42.127 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:42.127 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:42.127 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:42.137 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:42.158 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:42.157+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:42.259 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:42.257+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:42.332 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:42.332 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:80 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 20.807891326, 2024-04-26T10:44:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029259192, 2024-04-26T10:44:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:42.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522252+0000", 2024-04-26T10:44:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:42.334 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523121+0000", 2024-04-26T10:44:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00086885100000000002 2024-04-26T10:44:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523133+0000", 2024-04-26T10:44:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2109999999999999e-05 2024-04-26T10:44:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.335 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523139+0000", 2024-04-26T10:44:42.336 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.541e-06 2024-04-26T10:44:42.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.336 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:42.336 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523176+0000", 2024-04-26T10:44:42.336 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6847999999999997e-05 2024-04-26T10:44:42.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.336 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:42.337 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523240+0000", 2024-04-26T10:44:42.337 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3941000000000003e-05 2024-04-26T10:44:42.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.337 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:42.337 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.536390+0000", 2024-04-26T10:44:42.337 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013150811 2024-04-26T10:44:42.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.338 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.338 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.338 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551071+0000", 2024-04-26T10:44:42.338 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014680021 2024-04-26T10:44:42.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551428+0000", 2024-04-26T10:44:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00035703900000000002 2024-04-26T10:44:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551462+0000", 2024-04-26T10:44:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4337e-05 2024-04-26T10:44:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.339 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551513+0000", 2024-04-26T10:44:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0875000000000003e-05 2024-04-26T10:44:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:129 3.1a 3:5e41ab69:::200.00000005:head [write 3557843~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 20.803833256000001, 2024-04-26T10:44:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029108253000000001, 2024-04-26T10:44:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:42.340 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526311+0000", 2024-04-26T10:44:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526315+0000", 2024-04-26T10:44:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4809999999999998e-06 2024-04-26T10:44:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:42.342 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526319+0000", 2024-04-26T10:44:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0690000000000003e-06 2024-04-26T10:44:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526321+0000", 2024-04-26T10:44:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4880000000000001e-06 2024-04-26T10:44:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553856+0000", 2024-04-26T10:44:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027534916 2024-04-26T10:44:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.343 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553900+0000", 2024-04-26T10:44:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3954e-05 2024-04-26T10:44:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553962+0000", 2024-04-26T10:44:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1519000000000005e-05 2024-04-26T10:44:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555348+0000", 2024-04-26T10:44:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013864579999999999 2024-04-26T10:44:42.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555378+0000", 2024-04-26T10:44:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9441000000000002e-05 2024-04-26T10:44:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555401+0000", 2024-04-26T10:44:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2815000000000001e-05 2024-04-26T10:44:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555420+0000", 2024-04-26T10:44:42.345 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9341e-05 2024-04-26T10:44:42.346 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.346 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:42.346 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.346 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:130 3.1a 3:5e41ab69:::200.00000005:head [write 3559243~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:42.346 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:42.346 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 20.803821420999999, 2024-04-26T10:44:42.347 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029188316999999998, 2024-04-26T10:44:42.347 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:42.347 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.348 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:42.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.348 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:42.348 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:42.348 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.348 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526325+0000", 2024-04-26T10:44:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4899999999999999e-06 2024-04-26T10:44:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.349 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526327+0000", 2024-04-26T10:44:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.745e-06 2024-04-26T10:44:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526330+0000", 2024-04-26T10:44:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5620000000000002e-06 2024-04-26T10:44:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554200+0000", 2024-04-26T10:44:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027869541000000001 2024-04-26T10:44:42.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554244+0000", 2024-04-26T10:44:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4464e-05 2024-04-26T10:44:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554304+0000", 2024-04-26T10:44:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9457999999999999e-05 2024-04-26T10:44:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555453+0000", 2024-04-26T10:44:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011494000000000001 2024-04-26T10:44:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555457+0000", 2024-04-26T10:44:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1779999999999996e-06 2024-04-26T10:44:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555480+0000", 2024-04-26T10:44:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2802e-05 2024-04-26T10:44:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555512+0000", 2024-04-26T10:44:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1885999999999999e-05 2024-04-26T10:44:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:131 3.1a 3:5e41ab69:::200.00000005:head [write 3560642~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 20.803812840999999, 2024-04-26T10:44:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029683102999999999, 2024-04-26T10:44:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:42.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:42.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526336+0000", 2024-04-26T10:44:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.681e-06 2024-04-26T10:44:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526338+0000", 2024-04-26T10:44:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8430000000000001e-06 2024-04-26T10:44:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526341+0000", 2024-04-26T10:44:42.355 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6180000000000002e-06 2024-04-26T10:44:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554745+0000", 2024-04-26T10:44:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028404088000000001 2024-04-26T10:44:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554788+0000", 2024-04-26T10:44:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2738999999999999e-05 2024-04-26T10:44:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554849+0000", 2024-04-26T10:44:42.356 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1362e-05 2024-04-26T10:44:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555963+0000", 2024-04-26T10:44:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001113597 2024-04-26T10:44:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555969+0000", 2024-04-26T10:44:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6900000000000003e-06 2024-04-26T10:44:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555995+0000", 2024-04-26T10:44:42.357 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5165999999999999e-05 2024-04-26T10:44:42.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.358 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:42.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556015+0000", 2024-04-26T10:44:42.358 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0522000000000001e-05 2024-04-26T10:44:42.358 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.358 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:42.358 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:132 3.1a 3:5e41ab69:::200.00000005:head [write 3562043~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 20.803792575999999, 2024-04-26T10:44:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030129895, 2024-04-26T10:44:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526354+0000", 2024-04-26T10:44:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8560000000000001e-06 2024-04-26T10:44:42.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526359+0000", 2024-04-26T10:44:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4700000000000001e-06 2024-04-26T10:44:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526365+0000", 2024-04-26T10:44:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2120000000000002e-06 2024-04-26T10:44:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555050+0000", 2024-04-26T10:44:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028685458 2024-04-26T10:44:42.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555093+0000", 2024-04-26T10:44:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3307999999999999e-05 2024-04-26T10:44:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555156+0000", 2024-04-26T10:44:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2396000000000004e-05 2024-04-26T10:44:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556052+0000", 2024-04-26T10:44:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00089650299999999999 2024-04-26T10:44:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556439+0000", 2024-04-26T10:44:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038647900000000001 2024-04-26T10:44:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556463+0000", 2024-04-26T10:44:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4071e-05 2024-04-26T10:44:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556482+0000", 2024-04-26T10:44:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9378999999999999e-05 2024-04-26T10:44:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 3563440~3660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 20.803776182, 2024-04-26T10:44:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030550738000000001, 2024-04-26T10:44:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.364 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526368+0000", 2024-04-26T10:44:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:42.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526375+0000", 2024-04-26T10:44:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7510000000000002e-06 2024-04-26T10:44:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526381+0000", 2024-04-26T10:44:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3929999999999996e-06 2024-04-26T10:44:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526387+0000", 2024-04-26T10:44:42.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.215e-06 2024-04-26T10:44:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555542+0000", 2024-04-26T10:44:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029154992000000001 2024-04-26T10:44:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555610+0000", 2024-04-26T10:44:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8610999999999998e-05 2024-04-26T10:44:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:42.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555681+0000", 2024-04-26T10:44:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1072e-05 2024-04-26T10:44:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556866+0000", 2024-04-26T10:44:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001184598 2024-04-26T10:44:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556872+0000", 2024-04-26T10:44:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.55e-06 2024-04-26T10:44:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:42.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556897+0000", 2024-04-26T10:44:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.516e-05 2024-04-26T10:44:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556919+0000", 2024-04-26T10:44:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1951e-05 2024-04-26T10:44:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:134 3.1a 3:5e41ab69:::200.00000005:head [write 3567100~2427 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 20.803743117, 2024-04-26T10:44:42.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031267445999999997, 2024-04-26T10:44:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526401+0000", 2024-04-26T10:44:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526408+0000", 2024-04-26T10:44:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7769999999999997e-06 2024-04-26T10:44:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526415+0000", 2024-04-26T10:44:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0720000000000002e-06 2024-04-26T10:44:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526421+0000", 2024-04-26T10:44:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9699999999999996e-06 2024-04-26T10:44:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556084+0000", 2024-04-26T10:44:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029662351999999999 2024-04-26T10:44:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556126+0000", 2024-04-26T10:44:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2385000000000002e-05 2024-04-26T10:44:42.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556186+0000", 2024-04-26T10:44:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9945999999999998e-05 2024-04-26T10:44:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557598+0000", 2024-04-26T10:44:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0014121559999999999 2024-04-26T10:44:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557626+0000", 2024-04-26T10:44:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7960999999999999e-05 2024-04-26T10:44:42.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557650+0000", 2024-04-26T10:44:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3969999999999999e-05 2024-04-26T10:44:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557669+0000", 2024-04-26T10:44:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9262e-05 2024-04-26T10:44:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.374 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:135 3.1a 3:5e41ab69:::200.00000005:head [write 3569527~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 20.803718850999999, 2024-04-26T10:44:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031322516000000002, 2024-04-26T10:44:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526429+0000", 2024-04-26T10:44:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0750000000000002e-06 2024-04-26T10:44:42.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526435+0000", 2024-04-26T10:44:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.263e-06 2024-04-26T10:44:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526442+0000", 2024-04-26T10:44:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1219999999999997e-06 2024-04-26T10:44:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556515+0000", 2024-04-26T10:44:42.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030073132999999998 2024-04-26T10:44:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556564+0000", 2024-04-26T10:44:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8871e-05 2024-04-26T10:44:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556625+0000", 2024-04-26T10:44:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1307000000000001e-05 2024-04-26T10:44:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557678+0000", 2024-04-26T10:44:42.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010523100000000001 2024-04-26T10:44:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557709+0000", 2024-04-26T10:44:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1748000000000002e-05 2024-04-26T10:44:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557732+0000", 2024-04-26T10:44:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2415000000000001e-05 2024-04-26T10:44:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:42.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557749+0000", 2024-04-26T10:44:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6736999999999999e-05 2024-04-26T10:44:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:136 3.1a 3:5e41ab69:::200.00000005:head [write 3571449~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 20.803697661000001, 2024-04-26T10:44:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032180937, 2024-04-26T10:44:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.380 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:42.381 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:42.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:42.381 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:42.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526455+0000", 2024-04-26T10:44:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6429999999999995e-06 2024-04-26T10:44:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526461+0000", 2024-04-26T10:44:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:42.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526467+0000", 2024-04-26T10:44:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4389999999999999e-06 2024-04-26T10:44:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556950+0000", 2024-04-26T10:44:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030483854000000001 2024-04-26T10:44:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556989+0000", 2024-04-26T10:44:42.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8415999999999999e-05 2024-04-26T10:44:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557051+0000", 2024-04-26T10:44:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2088999999999995e-05 2024-04-26T10:44:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558166+0000", 2024-04-26T10:44:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001114622 2024-04-26T10:44:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558584+0000", 2024-04-26T10:44:42.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000418033 2024-04-26T10:44:42.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:42.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558609+0000", 2024-04-26T10:44:42.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5344999999999999e-05 2024-04-26T10:44:42.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558628+0000", 2024-04-26T10:44:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9273999999999999e-05 2024-04-26T10:44:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:137 3.1a 3:5e41ab69:::200.00000005:head [write 3573699~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 20.803674011999998, 2024-04-26T10:44:42.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032241530999999997, 2024-04-26T10:44:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526470+0000", 2024-04-26T10:44:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526473+0000", 2024-04-26T10:44:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.818e-06 2024-04-26T10:44:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526480+0000", 2024-04-26T10:44:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4119999999999998e-06 2024-04-26T10:44:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526484+0000", 2024-04-26T10:44:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6840000000000004e-06 2024-04-26T10:44:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557323+0000", 2024-04-26T10:44:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030838956000000001 2024-04-26T10:44:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557362+0000", 2024-04-26T10:44:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8343999999999997e-05 2024-04-26T10:44:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557421+0000", 2024-04-26T10:44:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9176999999999999e-05 2024-04-26T10:44:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558636+0000", 2024-04-26T10:44:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012153789999999999 2024-04-26T10:44:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558668+0000", 2024-04-26T10:44:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1452999999999999e-05 2024-04-26T10:44:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558694+0000", 2024-04-26T10:44:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6288999999999999e-05 2024-04-26T10:44:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558712+0000", 2024-04-26T10:44:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8459000000000001e-05 2024-04-26T10:44:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:138 3.1a 3:5e41ab69:::200.00000005:head [write 3575103~4205 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 20.803656693000001, 2024-04-26T10:44:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032665567999999999, 2024-04-26T10:44:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:42.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526495+0000", 2024-04-26T10:44:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7580000000000003e-06 2024-04-26T10:44:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526501+0000", 2024-04-26T10:44:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1680000000000001e-06 2024-04-26T10:44:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526505+0000", 2024-04-26T10:44:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.673e-06 2024-04-26T10:44:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557781+0000", 2024-04-26T10:44:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031275718000000001 2024-04-26T10:44:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557825+0000", 2024-04-26T10:44:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4048000000000002e-05 2024-04-26T10:44:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557888+0000", 2024-04-26T10:44:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2562000000000002e-05 2024-04-26T10:44:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559073+0000", 2024-04-26T10:44:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011852239999999999 2024-04-26T10:44:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559112+0000", 2024-04-26T10:44:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9226e-05 2024-04-26T10:44:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559136+0000", 2024-04-26T10:44:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3966000000000001e-05 2024-04-26T10:44:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559154+0000", 2024-04-26T10:44:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7575e-05 2024-04-26T10:44:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:42.396 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:139 3.1a 3:5e41ab69:::200.00000005:head [write 3579308~2255 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 20.803635074999999, 2024-04-26T10:44:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033424720999999998, 2024-04-26T10:44:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526509+0000", 2024-04-26T10:44:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526516+0000", 2024-04-26T10:44:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5209999999999999e-06 2024-04-26T10:44:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526522+0000", 2024-04-26T10:44:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1229999999999997e-06 2024-04-26T10:44:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526527+0000", 2024-04-26T10:44:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7849999999999999e-06 2024-04-26T10:44:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558194+0000", 2024-04-26T10:44:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031667419000000002 2024-04-26T10:44:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558234+0000", 2024-04-26T10:44:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9774999999999998e-05 2024-04-26T10:44:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558294+0000", 2024-04-26T10:44:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0242999999999999e-05 2024-04-26T10:44:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559106+0000", 2024-04-26T10:44:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00081148099999999996 2024-04-26T10:44:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:42.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559890+0000", 2024-04-26T10:44:42.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00078439999999999998 2024-04-26T10:44:42.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:42.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559917+0000", 2024-04-26T10:44:42.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7044000000000001e-05 2024-04-26T10:44:42.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:42.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559935+0000", 2024-04-26T10:44:42.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7448e-05 2024-04-26T10:44:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:140 3.1a 3:5e41ab69:::200.00000005:head [write 3581563~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 20.803613653999999, 2024-04-26T10:44:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033867728, 2024-04-26T10:44:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526538+0000", 2024-04-26T10:44:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.905e-06 2024-04-26T10:44:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526542+0000", 2024-04-26T10:44:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9550000000000002e-06 2024-04-26T10:44:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526545+0000", 2024-04-26T10:44:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8499999999999998e-06 2024-04-26T10:44:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558744+0000", 2024-04-26T10:44:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032198986999999998 2024-04-26T10:44:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558788+0000", 2024-04-26T10:44:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4365e-05 2024-04-26T10:44:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558854+0000", 2024-04-26T10:44:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5952999999999997e-05 2024-04-26T10:44:42.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559971+0000", 2024-04-26T10:44:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011172770000000001 2024-04-26T10:44:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560354+0000", 2024-04-26T10:44:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038267599999999998 2024-04-26T10:44:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560380+0000", 2024-04-26T10:44:42.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6140999999999999e-05 2024-04-26T10:44:42.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:42.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560399+0000", 2024-04-26T10:44:42.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9032999999999999e-05 2024-04-26T10:44:42.408 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.408 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:42.408 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.408 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:141 3.1a 3:5e41ab69:::200.00000005:head [write 3583482~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:42.408 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:42.408 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 20.803597995000001, 2024-04-26T10:44:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034316301, 2024-04-26T10:44:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526548+0000", 2024-04-26T10:44:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.739e-06 2024-04-26T10:44:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526551+0000", 2024-04-26T10:44:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.044e-06 2024-04-26T10:44:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526562+0000", 2024-04-26T10:44:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0370000000000001e-05 2024-04-26T10:44:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559179+0000", 2024-04-26T10:44:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032617444000000002 2024-04-26T10:44:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559220+0000", 2024-04-26T10:44:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0364999999999997e-05 2024-04-26T10:44:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559280+0000", 2024-04-26T10:44:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0569000000000002e-05 2024-04-26T10:44:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560814+0000", 2024-04-26T10:44:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015337580000000001 2024-04-26T10:44:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560820+0000", 2024-04-26T10:44:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.455e-06 2024-04-26T10:44:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560846+0000", 2024-04-26T10:44:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5228999999999998e-05 2024-04-26T10:44:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560863+0000", 2024-04-26T10:44:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7555e-05 2024-04-26T10:44:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.415 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:142 3.1a 3:5e41ab69:::200.00000005:head [write 3585931~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:42.415 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:42.415 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 20.803577598, 2024-04-26T10:44:42.415 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034372373999999997, 2024-04-26T10:44:42.415 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:42.415 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.415 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:42.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.415 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:42.415 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:42.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526573+0000", 2024-04-26T10:44:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0800000000000002e-06 2024-04-26T10:44:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526580+0000", 2024-04-26T10:44:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5799999999999997e-06 2024-04-26T10:44:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526585+0000", 2024-04-26T10:44:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2270000000000001e-06 2024-04-26T10:44:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:42.418 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559601+0000", 2024-04-26T10:44:42.418 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033016684999999997 2024-04-26T10:44:42.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.418 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:42.418 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559642+0000", 2024-04-26T10:44:42.418 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0321000000000002e-05 2024-04-26T10:44:42.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.418 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559706+0000", 2024-04-26T10:44:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4228999999999998e-05 2024-04-26T10:44:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560871+0000", 2024-04-26T10:44:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001164893 2024-04-26T10:44:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560899+0000", 2024-04-26T10:44:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:42.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560922+0000", 2024-04-26T10:44:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3337999999999999e-05 2024-04-26T10:44:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560940+0000", 2024-04-26T10:44:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7289999999999999e-05 2024-04-26T10:44:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:143 3.1a 3:5e41ab69:::200.00000005:head [write 3587331~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 20.8035557, 2024-04-26T10:44:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035256000000000003, 2024-04-26T10:44:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:42.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526592+0000", 2024-04-26T10:44:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2449999999999998e-06 2024-04-26T10:44:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526596+0000", 2024-04-26T10:44:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7000000000000002e-06 2024-04-26T10:44:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526599+0000", 2024-04-26T10:44:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6160000000000002e-06 2024-04-26T10:44:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559997+0000", 2024-04-26T10:44:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033397835000000001 2024-04-26T10:44:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560051+0000", 2024-04-26T10:44:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3742000000000001e-05 2024-04-26T10:44:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:42.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560112+0000", 2024-04-26T10:44:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0851999999999999e-05 2024-04-26T10:44:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561404+0000", 2024-04-26T10:44:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001291869 2024-04-26T10:44:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561797+0000", 2024-04-26T10:44:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039383000000000002 2024-04-26T10:44:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:42.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561827+0000", 2024-04-26T10:44:42.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9247e-05 2024-04-26T10:44:42.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.426 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:42.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561845+0000", 2024-04-26T10:44:42.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8462999999999999e-05 2024-04-26T10:44:42.426 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.426 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:42.426 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:144 3.1a 3:5e41ab69:::200.00000005:head [write 3588736~4987 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 20.803433408, 2024-04-26T10:44:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035224283000000002, 2024-04-26T10:44:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:42.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:42.428 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526718+0000", 2024-04-26T10:44:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.43e-06 2024-04-26T10:44:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526726+0000", 2024-04-26T10:44:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:44:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526729+0000", 2024-04-26T10:44:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6480000000000001e-06 2024-04-26T10:44:42.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560427+0000", 2024-04-26T10:44:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033697280000000003 2024-04-26T10:44:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560466+0000", 2024-04-26T10:44:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9606e-05 2024-04-26T10:44:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560525+0000", 2024-04-26T10:44:42.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9218000000000001e-05 2024-04-26T10:44:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561854+0000", 2024-04-26T10:44:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001328421 2024-04-26T10:44:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561887+0000", 2024-04-26T10:44:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2746000000000001e-05 2024-04-26T10:44:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561912+0000", 2024-04-26T10:44:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5126999999999998e-05 2024-04-26T10:44:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561936+0000", 2024-04-26T10:44:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4032999999999998e-05 2024-04-26T10:44:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.432 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:145 3.1a 3:5e41ab69:::200.00000005:head [write 3593723~2939 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:42.433 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:42.433 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 20.800514363000001, 2024-04-26T10:44:42.433 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033294394999999997, 2024-04-26T10:44:42.433 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:42.433 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.433 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:42.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.433 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:42.433 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:42.433 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.433 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529630+0000", 2024-04-26T10:44:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529635+0000", 2024-04-26T10:44:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7960000000000003e-06 2024-04-26T10:44:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:42.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529643+0000", 2024-04-26T10:44:42.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0390000000000005e-06 2024-04-26T10:44:42.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529648+0000", 2024-04-26T10:44:42.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9599999999999999e-06 2024-04-26T10:44:42.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:42.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560969+0000", 2024-04-26T10:44:42.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031321767 2024-04-26T10:44:42.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:42.436 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561009+0000", 2024-04-26T10:44:42.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9904999999999998e-05 2024-04-26T10:44:42.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:42.436 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561070+0000", 2024-04-26T10:44:42.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0708999999999998e-05 2024-04-26T10:44:42.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562352+0000", 2024-04-26T10:44:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012818440000000001 2024-04-26T10:44:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562867+0000", 2024-04-26T10:44:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000515665 2024-04-26T10:44:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562893+0000", 2024-04-26T10:44:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5469999999999998e-05 2024-04-26T10:44:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:42.438 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562925+0000", 2024-04-26T10:44:42.438 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1974999999999998e-05 2024-04-26T10:44:42.438 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.438 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:42.438 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.438 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:146 3.1a 3:5e41ab69:::200.00000005:head [write 3596662~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:42.438 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:42.438 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 20.800286149000002, 2024-04-26T10:44:42.438 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033178429000000002, 2024-04-26T10:44:42.438 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:42.439 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529858+0000", 2024-04-26T10:44:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529863+0000", 2024-04-26T10:44:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4500000000000003e-06 2024-04-26T10:44:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529874+0000", 2024-04-26T10:44:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0552e-05 2024-04-26T10:44:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.440 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529882+0000", 2024-04-26T10:44:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4449999999999996e-06 2024-04-26T10:44:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561452+0000", 2024-04-26T10:44:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031569680000000003 2024-04-26T10:44:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561511+0000", 2024-04-26T10:44:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9332e-05 2024-04-26T10:44:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:42.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561583+0000", 2024-04-26T10:44:42.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1730000000000006e-05 2024-04-26T10:44:42.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:42.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562933+0000", 2024-04-26T10:44:42.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013500059999999999 2024-04-26T10:44:42.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.443 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562976+0000", 2024-04-26T10:44:42.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2987e-05 2024-04-26T10:44:42.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:42.443 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563015+0000", 2024-04-26T10:44:42.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9453999999999999e-05 2024-04-26T10:44:42.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:42.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563037+0000", 2024-04-26T10:44:42.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1679e-05 2024-04-26T10:44:42.444 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.444 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:42.444 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:277 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.815275445999999, 2024-04-26T10:44:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030430563000000001, 2024-04-26T10:44:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514867+0000", 2024-04-26T10:44:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515460+0000", 2024-04-26T10:44:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00059285800000000004 2024-04-26T10:44:42.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515474+0000", 2024-04-26T10:44:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3933e-05 2024-04-26T10:44:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515481+0000", 2024-04-26T10:44:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515522+0000", 2024-04-26T10:44:42.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1369000000000003e-05 2024-04-26T10:44:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515591+0000", 2024-04-26T10:44:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9377999999999999e-05 2024-04-26T10:44:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.526440+0000", 2024-04-26T10:44:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010848837 2024-04-26T10:44:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.543866+0000", 2024-04-26T10:44:42.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017426288000000002 2024-04-26T10:44:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545193+0000", 2024-04-26T10:44:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001326111 2024-04-26T10:44:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545229+0000", 2024-04-26T10:44:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6390999999999998e-05 2024-04-26T10:44:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:42.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545300+0000", 2024-04-26T10:44:42.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1073000000000002e-05 2024-04-26T10:44:42.450 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.450 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:42.450 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.450 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:42.450 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:42.450 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:42.452 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:42.452 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:42.449+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:42.553 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:42.551+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:42.556 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:42.556 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:42.556 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:44:42.557 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:42.565 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:42.653 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:42.652+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:42.676 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:42.676 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:42.676 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:42.677 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:42.677 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:42.686 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:42.698 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:44:42.754 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:42.753+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:42.794 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:42.794 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:42.794 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:42.794 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:42.794 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.795 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:330 3.13 3:ceffbd45:::200.0000000a:head [write 1316140~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:42.795 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:42.795 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 16.279036898000001, 2024-04-26T10:44:42.795 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022245654, 2024-04-26T10:44:42.795 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:42.795 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.795 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:42.795 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.795 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:42.795 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:42.795 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.795 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.795 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.795 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:42.796 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:42.796 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.796 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.796 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.796 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:42.796 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513139+0000", 2024-04-26T10:44:42.796 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:42.796 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.796 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.796 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:42.796 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513149+0000", 2024-04-26T10:44:42.796 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7550000000000006e-06 2024-04-26T10:44:42.796 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.796 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.796 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:42.797 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513157+0000", 2024-04-26T10:44:42.797 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1089999999999998e-06 2024-04-26T10:44:42.797 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.797 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.797 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.797 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513167+0000", 2024-04-26T10:44:42.797 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0539e-05 2024-04-26T10:44:42.797 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.797 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.797 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:42.797 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533830+0000", 2024-04-26T10:44:42.797 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020662852999999998 2024-04-26T10:44:42.797 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.797 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.798 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:42.798 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533875+0000", 2024-04-26T10:44:42.798 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.5071999999999998e-05 2024-04-26T10:44:42.798 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.798 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.798 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:42.798 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535319+0000", 2024-04-26T10:44:42.798 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001443578 2024-04-26T10:44:42.798 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.798 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.798 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:42.798 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535346+0000", 2024-04-26T10:44:42.798 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7415000000000001e-05 2024-04-26T10:44:42.798 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.798 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.799 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:42.799 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535385+0000", 2024-04-26T10:44:42.799 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8912999999999998e-05 2024-04-26T10:44:42.799 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.799 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:42.799 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.799 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.799 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.799 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:331 3.13 3:ceffbd45:::200.0000000a:head [write 1318049~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:42.799 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:42.799 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 16.278997570000001, 2024-04-26T10:44:42.799 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023524521, 2024-04-26T10:44:42.799 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:42.799 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.799 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:42.800 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.800 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:42.800 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:42.800 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.800 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.800 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.800 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:42.800 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:42.800 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.800 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.800 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.800 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:42.800 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513178+0000", 2024-04-26T10:44:42.800 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:42.800 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.801 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.801 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:42.801 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513183+0000", 2024-04-26T10:44:42.801 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2549999999999999e-06 2024-04-26T10:44:42.801 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.801 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.801 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:42.801 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513190+0000", 2024-04-26T10:44:42.801 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8460000000000002e-06 2024-04-26T10:44:42.801 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.801 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.801 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.801 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513195+0000", 2024-04-26T10:44:42.801 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3630000000000002e-06 2024-04-26T10:44:42.801 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.802 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.802 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:42.802 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534463+0000", 2024-04-26T10:44:42.802 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021267823000000002 2024-04-26T10:44:42.802 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.802 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.802 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:42.802 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534520+0000", 2024-04-26T10:44:42.802 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7510000000000003e-05 2024-04-26T10:44:42.802 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.802 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.802 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:42.802 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536634+0000", 2024-04-26T10:44:42.802 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0021138900000000002 2024-04-26T10:44:42.803 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.803 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.803 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:42.803 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536663+0000", 2024-04-26T10:44:42.803 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8884e-05 2024-04-26T10:44:42.803 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.803 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.803 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:42.803 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536703+0000", 2024-04-26T10:44:42.803 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0479000000000003e-05 2024-04-26T10:44:42.803 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.803 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:42.803 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.803 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.803 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.803 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:332 3.13 3:ceffbd45:::200.0000000a:head [write 1319462~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:42.804 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:42.804 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 16.278962737000001, 2024-04-26T10:44:42.804 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024543230999999999, 2024-04-26T10:44:42.804 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:42.804 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.804 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:42.804 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.804 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:42.804 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:42.804 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.804 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.804 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.804 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:42.804 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:42.804 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.805 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.805 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.805 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:42.805 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513213+0000", 2024-04-26T10:44:42.805 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:42.805 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.805 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.805 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:42.805 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513217+0000", 2024-04-26T10:44:42.805 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:44:42.805 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.805 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.805 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:42.805 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513229+0000", 2024-04-26T10:44:42.805 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2051e-05 2024-04-26T10:44:42.806 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.806 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.806 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.806 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513236+0000", 2024-04-26T10:44:42.806 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4470000000000003e-06 2024-04-26T10:44:42.806 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.806 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.806 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:42.806 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534891+0000", 2024-04-26T10:44:42.806 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021655863000000001 2024-04-26T10:44:42.806 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.806 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.806 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:42.806 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534933+0000", 2024-04-26T10:44:42.806 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1596e-05 2024-04-26T10:44:42.807 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.807 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.807 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:42.807 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537677+0000", 2024-04-26T10:44:42.807 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027440989999999998 2024-04-26T10:44:42.807 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.807 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.807 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:42.807 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537721+0000", 2024-04-26T10:44:42.807 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3813999999999998e-05 2024-04-26T10:44:42.807 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.807 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.807 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:42.807 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537757+0000", 2024-04-26T10:44:42.807 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6022999999999997e-05 2024-04-26T10:44:42.808 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.808 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:42.808 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.808 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.808 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.808 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:333 3.13 3:ceffbd45:::200.0000000a:head [write 1320870~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:42.808 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:42.808 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 16.278919817999999, 2024-04-26T10:44:42.808 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024557151999999999, 2024-04-26T10:44:42.808 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:42.808 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.808 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:42.808 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.808 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:42.809 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:42.809 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.809 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.809 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.809 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:42.809 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:42.809 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.809 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.809 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.809 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:42.809 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513256+0000", 2024-04-26T10:44:42.809 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:42.809 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.809 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.809 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:42.810 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513260+0000", 2024-04-26T10:44:42.810 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6550000000000002e-06 2024-04-26T10:44:42.810 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.810 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.810 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:42.810 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513273+0000", 2024-04-26T10:44:42.810 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2965e-05 2024-04-26T10:44:42.810 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.810 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.810 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.810 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513279+0000", 2024-04-26T10:44:42.810 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:44:42.810 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.810 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.811 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:42.811 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535411+0000", 2024-04-26T10:44:42.811 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022132233000000001 2024-04-26T10:44:42.811 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.811 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.811 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:42.811 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535479+0000", 2024-04-26T10:44:42.811 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7554999999999999e-05 2024-04-26T10:44:42.811 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.811 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.811 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:42.811 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537762+0000", 2024-04-26T10:44:42.811 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022836499999999999 2024-04-26T10:44:42.811 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.812 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.812 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:42.812 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537783+0000", 2024-04-26T10:44:42.812 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0364e-05 2024-04-26T10:44:42.812 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.812 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.812 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:42.812 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537814+0000", 2024-04-26T10:44:42.812 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1170000000000001e-05 2024-04-26T10:44:42.812 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.812 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:42.812 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.812 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.812 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.812 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:334 3.13 3:ceffbd45:::200.0000000a:head [write 1322273~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:42.812 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:42.813 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 16.277083058999999, 2024-04-26T10:44:42.813 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022778731999999999, 2024-04-26T10:44:42.813 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:42.813 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.813 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:42.813 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.813 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:42.813 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:42.813 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.813 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.813 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.813 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:42.813 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:42.813 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.813 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.814 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.814 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:42.814 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:42.814 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:42.814 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.814 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.814 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:42.814 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515099+0000", 2024-04-26T10:44:42.814 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6599999999999998e-06 2024-04-26T10:44:42.814 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.814 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.814 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:42.814 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515112+0000", 2024-04-26T10:44:42.814 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2707e-05 2024-04-26T10:44:42.814 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.815 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.815 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.815 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515120+0000", 2024-04-26T10:44:42.815 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8509999999999999e-06 2024-04-26T10:44:42.815 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.815 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.815 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:42.815 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535792+0000", 2024-04-26T10:44:42.815 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020672209 2024-04-26T10:44:42.815 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.815 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.815 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:42.815 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535833+0000", 2024-04-26T10:44:42.815 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1415000000000002e-05 2024-04-26T10:44:42.815 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.816 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.816 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:42.816 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537818+0000", 2024-04-26T10:44:42.816 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0019850900000000001 2024-04-26T10:44:42.816 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.816 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.816 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:42.816 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537839+0000", 2024-04-26T10:44:42.816 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0068000000000002e-05 2024-04-26T10:44:42.816 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.816 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.816 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:42.816 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537872+0000", 2024-04-26T10:44:42.816 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3680999999999998e-05 2024-04-26T10:44:42.816 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.817 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:42.817 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.817 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.817 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.817 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:335 3.13 3:ceffbd45:::200.0000000a:head [write 1325230~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:42.817 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:42.817 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 16.27704396, 2024-04-26T10:44:42.817 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023487081, 2024-04-26T10:44:42.817 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:42.817 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.817 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:42.817 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.817 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:42.817 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:42.817 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.818 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.818 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.818 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:42.818 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:42.818 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.818 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.818 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.818 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:42.818 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515132+0000", 2024-04-26T10:44:42.818 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:42.818 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.818 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.818 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:42.818 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515136+0000", 2024-04-26T10:44:42.819 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0860000000000004e-06 2024-04-26T10:44:42.819 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.819 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.819 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:42.819 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515143+0000", 2024-04-26T10:44:42.819 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.0400000000000004e-06 2024-04-26T10:44:42.819 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.819 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.819 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.819 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515149+0000", 2024-04-26T10:44:42.819 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0789999999999997e-06 2024-04-26T10:44:42.819 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.819 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.819 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:42.819 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536200+0000", 2024-04-26T10:44:42.820 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021050993 2024-04-26T10:44:42.820 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.820 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.820 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:42.820 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536253+0000", 2024-04-26T10:44:42.820 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.2643999999999999e-05 2024-04-26T10:44:42.820 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.820 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.820 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:42.820 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538560+0000", 2024-04-26T10:44:42.820 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0023073389999999998 2024-04-26T10:44:42.820 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.820 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.820 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:42.820 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538584+0000", 2024-04-26T10:44:42.821 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3893999999999999e-05 2024-04-26T10:44:42.821 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.821 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.821 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:42.821 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538620+0000", 2024-04-26T10:44:42.821 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5611000000000002e-05 2024-04-26T10:44:42.821 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.821 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:42.821 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.821 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.821 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.821 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:336 3.13 3:ceffbd45:::200.0000000a:head [write 1327147~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:42.821 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:42.821 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 16.275711505, 2024-04-26T10:44:42.821 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027687066, 2024-04-26T10:44:42.822 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:42.822 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.822 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:42.822 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.822 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:42.822 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:42.822 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.822 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.822 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.822 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:42.822 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:42.822 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.822 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.822 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.823 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:42.823 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516464+0000", 2024-04-26T10:44:42.823 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:42.823 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.823 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.823 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:42.823 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516491+0000", 2024-04-26T10:44:42.823 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6539000000000001e-05 2024-04-26T10:44:42.823 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.823 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.823 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:42.823 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516500+0000", 2024-04-26T10:44:42.823 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5480000000000007e-06 2024-04-26T10:44:42.823 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.823 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.824 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.824 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516511+0000", 2024-04-26T10:44:42.824 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0719e-05 2024-04-26T10:44:42.824 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.824 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.824 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:42.824 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536737+0000", 2024-04-26T10:44:42.824 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020225770000000001 2024-04-26T10:44:42.824 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.824 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.824 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:42.824 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536783+0000", 2024-04-26T10:44:42.824 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6168999999999998e-05 2024-04-26T10:44:42.824 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.825 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.825 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:42.825 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544080+0000", 2024-04-26T10:44:42.825 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0072966799999999998 2024-04-26T10:44:42.825 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.825 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.825 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:42.825 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544111+0000", 2024-04-26T10:44:42.825 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1056999999999998e-05 2024-04-26T10:44:42.825 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.825 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.825 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:42.825 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544152+0000", 2024-04-26T10:44:42.825 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1452000000000002e-05 2024-04-26T10:44:42.825 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.826 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:42.826 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.826 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.826 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.826 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:337 3.13 3:ceffbd45:::200.0000000a:head [write 1342136~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:42.826 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:42.826 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 16.275658567000001, 2024-04-26T10:44:42.826 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027711237, 2024-04-26T10:44:42.826 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:42.826 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.826 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:42.826 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.826 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:42.827 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:42.827 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.827 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.827 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.827 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:42.827 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:42.827 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.827 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.827 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.827 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:42.827 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516517+0000", 2024-04-26T10:44:42.827 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:42.827 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.827 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.827 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:42.827 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516521+0000", 2024-04-26T10:44:42.828 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6200000000000001e-06 2024-04-26T10:44:42.828 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.828 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.828 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:42.828 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516528+0000", 2024-04-26T10:44:42.828 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8639999999999998e-06 2024-04-26T10:44:42.828 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.828 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.828 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.828 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516533+0000", 2024-04-26T10:44:42.828 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6310000000000002e-06 2024-04-26T10:44:42.828 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.828 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.828 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:42.828 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537231+0000", 2024-04-26T10:44:42.829 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020698613000000001 2024-04-26T10:44:42.829 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.829 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.829 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:42.829 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537273+0000", 2024-04-26T10:44:42.829 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1529000000000002e-05 2024-04-26T10:44:42.829 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.829 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.829 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:42.829 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544157+0000", 2024-04-26T10:44:42.829 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068847090000000001 2024-04-26T10:44:42.829 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.829 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.829 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:42.829 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544180+0000", 2024-04-26T10:44:42.830 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.2532e-05 2024-04-26T10:44:42.830 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.830 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.830 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:42.830 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544229+0000", 2024-04-26T10:44:42.830 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9190000000000002e-05 2024-04-26T10:44:42.830 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.830 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:42.830 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.830 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.830 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.830 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:338 3.13 3:ceffbd45:::200.0000000a:head [write 1344569~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:42.830 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:42.830 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 16.274992313999999, 2024-04-26T10:44:42.831 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027105598000000002, 2024-04-26T10:44:42.831 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:42.831 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.831 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:42.831 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.831 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:42.831 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:42.831 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.831 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.831 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.831 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:42.831 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:42.831 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.831 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.831 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.831 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:42.832 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517183+0000", 2024-04-26T10:44:42.832 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:42.832 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.832 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.832 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:42.832 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517188+0000", 2024-04-26T10:44:42.832 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7389999999999999e-06 2024-04-26T10:44:42.832 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.832 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.832 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:42.832 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517199+0000", 2024-04-26T10:44:42.832 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0652000000000001e-05 2024-04-26T10:44:42.832 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.832 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.832 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.833 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517206+0000", 2024-04-26T10:44:42.833 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6610000000000003e-06 2024-04-26T10:44:42.833 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.833 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.833 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:42.833 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537905+0000", 2024-04-26T10:44:42.833 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020699662000000001 2024-04-26T10:44:42.833 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.833 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.833 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:42.833 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537956+0000", 2024-04-26T10:44:42.833 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0954e-05 2024-04-26T10:44:42.833 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.833 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.834 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:42.834 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544233+0000", 2024-04-26T10:44:42.834 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062773009999999999 2024-04-26T10:44:42.834 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.834 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.834 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:42.834 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544258+0000", 2024-04-26T10:44:42.834 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4434999999999999e-05 2024-04-26T10:44:42.834 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.834 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.834 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:42.834 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544290+0000", 2024-04-26T10:44:42.834 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1918000000000002e-05 2024-04-26T10:44:42.834 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.835 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:42.835 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.835 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.835 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.835 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:339 3.13 3:ceffbd45:::200.0000000a:head [write 1346485~4322 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:42.835 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:42.835 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 16.274053820999999, 2024-04-26T10:44:42.835 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026221617999999999, 2024-04-26T10:44:42.835 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:42.835 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.835 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:42.835 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.835 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:42.835 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:42.835 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.836 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.836 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.836 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:42.836 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:42.836 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.836 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.836 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.836 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:42.836 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518122+0000", 2024-04-26T10:44:42.836 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:42.836 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.836 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.836 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:42.836 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518129+0000", 2024-04-26T10:44:42.836 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.43e-06 2024-04-26T10:44:42.837 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.837 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.837 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:42.837 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518138+0000", 2024-04-26T10:44:42.837 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9129999999999992e-06 2024-04-26T10:44:42.837 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.837 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.837 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.837 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518144+0000", 2024-04-26T10:44:42.837 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.1419999999999998e-06 2024-04-26T10:44:42.837 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.837 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.837 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:42.837 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538232+0000", 2024-04-26T10:44:42.838 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020087383 2024-04-26T10:44:42.838 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.838 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.838 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:42.838 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538274+0000", 2024-04-26T10:44:42.838 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2602999999999999e-05 2024-04-26T10:44:42.838 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.838 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.838 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:42.838 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544294+0000", 2024-04-26T10:44:42.838 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060194059999999997 2024-04-26T10:44:42.838 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.838 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.838 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:42.838 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544314+0000", 2024-04-26T10:44:42.839 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0091000000000001e-05 2024-04-26T10:44:42.839 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.839 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.839 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:42.839 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544344+0000", 2024-04-26T10:44:42.839 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0446e-05 2024-04-26T10:44:42.839 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.839 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:42.839 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.839 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.839 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.839 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:340 3.13 3:ceffbd45:::200.0000000a:head [write 1350807~2768 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:42.839 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:42.839 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 16.271569585000002, 2024-04-26T10:44:42.840 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023795594, 2024-04-26T10:44:42.840 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:42.840 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.840 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:42.840 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.840 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:42.840 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:42.840 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.840 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.840 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.840 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:42.840 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:42.840 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.840 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.841 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.841 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:42.841 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520606+0000", 2024-04-26T10:44:42.841 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:42.841 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.841 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.841 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:42.841 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520612+0000", 2024-04-26T10:44:42.841 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.835e-06 2024-04-26T10:44:42.841 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.841 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.841 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:42.841 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520622+0000", 2024-04-26T10:44:42.841 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0173999999999999e-05 2024-04-26T10:44:42.841 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.842 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.842 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.842 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520629+0000", 2024-04-26T10:44:42.842 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7460000000000003e-06 2024-04-26T10:44:42.842 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.842 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.842 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:42.842 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538651+0000", 2024-04-26T10:44:42.842 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018022474 2024-04-26T10:44:42.842 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.842 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.842 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:42.842 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538697+0000", 2024-04-26T10:44:42.842 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6183999999999997e-05 2024-04-26T10:44:42.843 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.843 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.843 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:42.843 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544348+0000", 2024-04-26T10:44:42.843 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0056503509999999996 2024-04-26T10:44:42.843 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.843 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.843 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:42.843 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544369+0000", 2024-04-26T10:44:42.843 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1064999999999999e-05 2024-04-26T10:44:42.843 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.843 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.843 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:42.843 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544403+0000", 2024-04-26T10:44:42.843 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3695000000000002e-05 2024-04-26T10:44:42.844 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.844 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:42.844 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.844 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.844 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.844 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:341 3.13 3:ceffbd45:::200.0000000a:head [write 1353575~3816 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:42.844 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:42.844 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 16.27083433, 2024-04-26T10:44:42.844 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023114967, 2024-04-26T10:44:42.844 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:42.844 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.844 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:42.844 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.844 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:42.845 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:42.845 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.845 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.845 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.845 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:42.845 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:42.845 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.845 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.845 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.845 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:42.845 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521341+0000", 2024-04-26T10:44:42.845 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:42.845 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.845 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.846 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:42.846 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521349+0000", 2024-04-26T10:44:42.846 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1550000000000001e-06 2024-04-26T10:44:42.846 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.846 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.846 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:42.846 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521358+0000", 2024-04-26T10:44:42.846 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.1500000000000005e-06 2024-04-26T10:44:42.846 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.846 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.846 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.846 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521364+0000", 2024-04-26T10:44:42.846 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3289999999999999e-06 2024-04-26T10:44:42.847 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.847 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.847 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:42.847 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539010+0000", 2024-04-26T10:44:42.847 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.017645965999999999 2024-04-26T10:44:42.847 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.847 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.847 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:42.847 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539051+0000", 2024-04-26T10:44:42.847 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.053e-05 2024-04-26T10:44:42.847 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.847 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.847 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:42.847 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544407+0000", 2024-04-26T10:44:42.847 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053560209999999999 2024-04-26T10:44:42.848 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.848 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.848 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:42.848 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544427+0000", 2024-04-26T10:44:42.848 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0228e-05 2024-04-26T10:44:42.848 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.848 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.848 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:42.848 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544457+0000", 2024-04-26T10:44:42.848 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0375e-05 2024-04-26T10:44:42.848 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.848 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:42.848 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.848 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.849 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.849 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11582 4.2f 4:f76ba295:::10000003252.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:42.849 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:42.849 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 13.797218785, 2024-04-26T10:44:42.849 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024553994999999999, 2024-04-26T10:44:42.849 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:42.849 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.849 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:42.849 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:42.849 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:42.849 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11582 2024-04-26T10:44:42.849 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.849 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:42.849 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.849 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:42.850 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:42.850 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.850 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.850 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.850 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:42.850 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:42.850 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.850 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.850 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.850 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:42.850 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994957+0000", 2024-04-26T10:44:42.850 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:42.850 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.850 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.851 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:42.851 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002755+0000", 2024-04-26T10:44:42.851 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0077984719999999999 2024-04-26T10:44:42.851 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.851 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.851 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:42.851 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002770+0000", 2024-04-26T10:44:42.851 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4956e-05 2024-04-26T10:44:42.851 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.851 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.851 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.851 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002777+0000", 2024-04-26T10:44:42.851 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1899999999999998e-06 2024-04-26T10:44:42.851 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.851 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.851 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:42.852 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002833+0000", 2024-04-26T10:44:42.852 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5189999999999998e-05 2024-04-26T10:44:42.852 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.852 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.852 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:42.852 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002977+0000", 2024-04-26T10:44:42.852 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014444100000000001 2024-04-26T10:44:42.852 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.852 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.852 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:42.852 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.003108+0000", 2024-04-26T10:44:42.852 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000131068 2024-04-26T10:44:42.852 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.852 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.852 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:42.853 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.009040+0000", 2024-04-26T10:44:42.853 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059314149999999998 2024-04-26T10:44:42.853 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.853 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.853 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.853 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019462+0000", 2024-04-26T10:44:42.853 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010422803 2024-04-26T10:44:42.853 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.853 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.853 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:42.853 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019490+0000", 2024-04-26T10:44:42.853 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7773999999999999e-05 2024-04-26T10:44:42.853 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.853 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.853 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:42.854 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019512+0000", 2024-04-26T10:44:42.854 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1611999999999999e-05 2024-04-26T10:44:42.854 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.854 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:42.854 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.854 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.854 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.854 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11911 4.37 4:ec04ab04:::100000031ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:42.854 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:42.854 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 13.455498578, 2024-04-26T10:44:42.854 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026810273999999999, 2024-04-26T10:44:42.854 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:42.854 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.854 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:42.854 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:42.855 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:42.855 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11911 2024-04-26T10:44:42.855 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.855 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:42.855 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.855 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:42.855 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:42.855 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.855 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.855 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.855 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:42.855 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:42.855 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.855 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.856 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.856 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:42.856 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336676+0000", 2024-04-26T10:44:42.856 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:42.856 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.856 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.856 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:42.856 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343119+0000", 2024-04-26T10:44:42.856 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0064424850000000004 2024-04-26T10:44:42.856 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.856 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.856 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:42.856 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343131+0000", 2024-04-26T10:44:42.856 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1708e-05 2024-04-26T10:44:42.856 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.857 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.857 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.857 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343137+0000", 2024-04-26T10:44:42.857 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9880000000000001e-06 2024-04-26T10:44:42.857 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.857 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.857 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:42.857 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343175+0000", 2024-04-26T10:44:42.857 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7913000000000001e-05 2024-04-26T10:44:42.857 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.857 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.857 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:42.857 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343269+0000", 2024-04-26T10:44:42.858 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4931000000000003e-05 2024-04-26T10:44:42.858 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.858 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.858 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:42.858 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343392+0000", 2024-04-26T10:44:42.858 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000122435 2024-04-26T10:44:42.858 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.858 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.858 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:42.858 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.347520+0000", 2024-04-26T10:44:42.858 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004128418 2024-04-26T10:44:42.858 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.859 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.859 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.859 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363410+0000", 2024-04-26T10:44:42.859 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.015889309000000001 2024-04-26T10:44:42.859 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.859 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.859 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:42.859 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363453+0000", 2024-04-26T10:44:42.859 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3244000000000001e-05 2024-04-26T10:44:42.859 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.859 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.859 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:42.859 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363488+0000", 2024-04-26T10:44:42.859 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5318000000000003e-05 2024-04-26T10:44:42.859 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.860 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:42.860 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.860 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.860 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.860 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12000 4.3c 4:3c2be35d:::100000030f7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:42.860 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:42.860 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 13.372877065999999, 2024-04-26T10:44:42.860 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022808264000000002, 2024-04-26T10:44:42.860 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:42.860 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.860 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:42.860 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:42.860 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:42.860 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12000 2024-04-26T10:44:42.861 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.861 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:42.861 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.861 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:42.861 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:42.861 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.861 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.861 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.861 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:42.861 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:42.861 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.861 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.861 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.861 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:42.862 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:42.862 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:42.862 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.862 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.862 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:42.862 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430937+0000", 2024-04-26T10:44:42.862 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.011638097 2024-04-26T10:44:42.862 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.862 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.862 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:42.862 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430948+0000", 2024-04-26T10:44:42.862 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0824e-05 2024-04-26T10:44:42.862 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.863 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.863 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.863 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430953+0000", 2024-04-26T10:44:42.863 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5219999999999998e-06 2024-04-26T10:44:42.863 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.863 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.863 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:42.863 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430990+0000", 2024-04-26T10:44:42.863 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6458999999999998e-05 2024-04-26T10:44:42.863 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.863 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.863 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:42.863 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.431052+0000", 2024-04-26T10:44:42.863 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2687000000000005e-05 2024-04-26T10:44:42.863 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.864 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.864 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:42.864 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442027+0000", 2024-04-26T10:44:42.864 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010974513 2024-04-26T10:44:42.864 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.864 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.864 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:42.864 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442060+0000", 2024-04-26T10:44:42.864 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2849999999999999e-05 2024-04-26T10:44:42.864 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.864 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.864 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:42.864 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442108+0000", 2024-04-26T10:44:42.864 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8031999999999997e-05 2024-04-26T10:44:42.865 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.865 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:42.865 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.865 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.865 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.865 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12042 4.2f 4:f741970f:::10000003414.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:42.865 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:42.865 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 13.333623589, 2024-04-26T10:44:42.865 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.029390757, 2024-04-26T10:44:42.865 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:42.865 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.865 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:42.865 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:42.865 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:42.865 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12042 2024-04-26T10:44:42.865 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.866 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:42.866 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.866 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:42.866 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:42.866 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.866 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.866 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.866 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:42.866 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:42.866 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.866 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.866 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.866 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:42.866 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458552+0000", 2024-04-26T10:44:42.867 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:42.867 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.867 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.867 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:42.867 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464335+0000", 2024-04-26T10:44:42.867 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.005783168 2024-04-26T10:44:42.867 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.867 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.867 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:42.867 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464347+0000", 2024-04-26T10:44:42.867 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1578e-05 2024-04-26T10:44:42.867 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.867 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.867 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.868 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464353+0000", 2024-04-26T10:44:42.868 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3709999999999996e-06 2024-04-26T10:44:42.868 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.868 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.868 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:42.868 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464407+0000", 2024-04-26T10:44:42.868 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3717000000000001e-05 2024-04-26T10:44:42.868 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.868 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.869 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:42.869 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464556+0000", 2024-04-26T10:44:42.869 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014899100000000001 2024-04-26T10:44:42.869 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.869 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.869 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:42.869 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464688+0000", 2024-04-26T10:44:42.869 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013238599999999999 2024-04-26T10:44:42.869 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.869 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.869 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:42.869 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.469725+0000", 2024-04-26T10:44:42.869 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0050369229999999996 2024-04-26T10:44:42.869 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.869 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.870 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.870 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487892+0000", 2024-04-26T10:44:42.870 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018167184999999999 2024-04-26T10:44:42.870 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.870 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.870 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:42.870 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487922+0000", 2024-04-26T10:44:42.870 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.9495000000000001e-05 2024-04-26T10:44:42.870 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.870 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.870 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:42.870 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487944+0000", 2024-04-26T10:44:42.870 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1823000000000001e-05 2024-04-26T10:44:42.871 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.871 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:42.871 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.871 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.871 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.871 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12050 4.2c 4:36b72e58:::100000031ba.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:42.871 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:42.871 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 13.325082979999999, 2024-04-26T10:44:42.871 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022722497000000001, 2024-04-26T10:44:42.871 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:42.871 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.871 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:42.871 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:42.871 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:42.871 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12050 2024-04-26T10:44:42.872 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.872 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:42.872 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.872 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:42.872 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:42.872 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.872 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.872 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.872 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:42.872 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:42.872 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.872 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.872 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.872 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:42.873 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467093+0000", 2024-04-26T10:44:42.873 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:42.873 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.873 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.873 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:42.873 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476305+0000", 2024-04-26T10:44:42.873 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092125850000000006 2024-04-26T10:44:42.873 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.873 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.873 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:42.873 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476322+0000", 2024-04-26T10:44:42.873 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6860000000000001e-05 2024-04-26T10:44:42.873 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.873 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.873 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.874 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476328+0000", 2024-04-26T10:44:42.874 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.587e-06 2024-04-26T10:44:42.874 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.874 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.874 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:42.874 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476378+0000", 2024-04-26T10:44:42.874 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0519999999999997e-05 2024-04-26T10:44:42.874 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.874 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.874 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:42.874 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476474+0000", 2024-04-26T10:44:42.874 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5556000000000005e-05 2024-04-26T10:44:42.874 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.874 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.875 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:42.875 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489677+0000", 2024-04-26T10:44:42.875 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013203048 2024-04-26T10:44:42.875 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.875 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.875 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:42.875 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489722+0000", 2024-04-26T10:44:42.875 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4650000000000001e-05 2024-04-26T10:44:42.875 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.875 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.875 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:42.875 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489816+0000", 2024-04-26T10:44:42.875 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4402999999999997e-05 2024-04-26T10:44:42.875 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.875 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:42.876 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.876 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.876 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.876 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12516 4.37 4:ed0cb515:::10000003324.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:42.876 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:42.876 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 12.805001415, 2024-04-26T10:44:42.876 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.030139677, 2024-04-26T10:44:42.876 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:42.876 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.876 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:42.876 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:42.876 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:42.876 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12516 2024-04-26T10:44:42.876 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.876 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:42.876 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.877 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:42.877 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:42.877 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.877 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.877 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.877 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:42.877 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:42.877 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.877 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.877 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.877 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:42.877 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987173+0000", 2024-04-26T10:44:42.877 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:42.877 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.877 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.877 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:42.878 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991339+0000", 2024-04-26T10:44:42.878 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0041663760000000003 2024-04-26T10:44:42.878 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.878 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.878 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:42.878 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991351+0000", 2024-04-26T10:44:42.878 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1333e-05 2024-04-26T10:44:42.878 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.878 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.878 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.878 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991357+0000", 2024-04-26T10:44:42.878 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3350000000000003e-06 2024-04-26T10:44:42.878 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.878 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.878 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:42.879 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991394+0000", 2024-04-26T10:44:42.879 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7054000000000001e-05 2024-04-26T10:44:42.879 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.879 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.879 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:42.879 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991495+0000", 2024-04-26T10:44:42.879 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000100386 2024-04-26T10:44:42.879 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.879 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.879 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:42.879 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991579+0000", 2024-04-26T10:44:42.879 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4295000000000005e-05 2024-04-26T10:44:42.879 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.879 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.879 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:42.880 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.996238+0000", 2024-04-26T10:44:42.880 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0046589309999999998 2024-04-26T10:44:42.880 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.880 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.880 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.880 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017237+0000", 2024-04-26T10:44:42.880 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020998993000000001 2024-04-26T10:44:42.880 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.880 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.880 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:42.880 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017280+0000", 2024-04-26T10:44:42.880 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3600000000000003e-05 2024-04-26T10:44:42.880 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.880 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.880 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:42.881 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017315+0000", 2024-04-26T10:44:42.881 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4381999999999997e-05 2024-04-26T10:44:42.881 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.881 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:42.881 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.881 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.881 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.881 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12644 4.37 4:ec5044d7:::100000032d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:42.881 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:42.881 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 12.631328587, 2024-04-26T10:44:42.881 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.037018677, 2024-04-26T10:44:42.881 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:42.881 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.881 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:42.881 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:42.881 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:42.882 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12644 2024-04-26T10:44:42.882 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.882 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:42.882 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.882 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:42.882 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:42.882 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.882 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.882 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.882 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:42.882 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:42.882 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.882 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.882 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.882 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:42.883 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160847+0000", 2024-04-26T10:44:42.883 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:42.883 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.883 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.883 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:42.883 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170089+0000", 2024-04-26T10:44:42.883 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092424289999999999 2024-04-26T10:44:42.883 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.883 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.883 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:42.883 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170111+0000", 2024-04-26T10:44:42.883 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1733e-05 2024-04-26T10:44:42.883 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.883 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.883 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.884 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170124+0000", 2024-04-26T10:44:42.884 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.272e-05 2024-04-26T10:44:42.884 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.884 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.884 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:42.884 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170177+0000", 2024-04-26T10:44:42.884 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3745000000000001e-05 2024-04-26T10:44:42.884 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.884 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.884 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:42.884 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170350+0000", 2024-04-26T10:44:42.884 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017297699999999999 2024-04-26T10:44:42.884 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.884 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.885 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:42.885 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170458+0000", 2024-04-26T10:44:42.885 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000107583 2024-04-26T10:44:42.885 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.885 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.885 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:42.885 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.176693+0000", 2024-04-26T10:44:42.885 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062351799999999999 2024-04-26T10:44:42.885 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.885 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.885 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.885 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197774+0000", 2024-04-26T10:44:42.885 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021080471999999999 2024-04-26T10:44:42.885 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.885 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.885 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:42.885 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197824+0000", 2024-04-26T10:44:42.886 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0096000000000003e-05 2024-04-26T10:44:42.886 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.886 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.886 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:42.886 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197867+0000", 2024-04-26T10:44:42.886 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2882e-05 2024-04-26T10:44:42.886 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.886 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:42.886 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.886 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.886 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.886 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:13242 4.2f 4:f5e54bb5:::100000033c8.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:42.886 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:42.886 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 11.953097448999999, 2024-04-26T10:44:42.886 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023873062, 2024-04-26T10:44:42.887 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:42.887 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:42.887 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:42.887 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:42.887 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:42.887 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 13242 2024-04-26T10:44:42.887 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.887 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:42.887 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.887 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:42.887 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:42.887 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.887 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.887 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.887 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:42.887 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:42.888 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:42.888 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.888 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.888 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:42.888 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839078+0000", 2024-04-26T10:44:42.888 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:42.888 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.888 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.888 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:42.888 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848098+0000", 2024-04-26T10:44:42.888 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090200750000000007 2024-04-26T10:44:42.888 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.888 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.888 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:42.888 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848108+0000", 2024-04-26T10:44:42.889 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.062e-05 2024-04-26T10:44:42.889 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.889 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.889 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:42.889 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848115+0000", 2024-04-26T10:44:42.889 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3040000000000001e-06 2024-04-26T10:44:42.889 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.889 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.889 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:42.889 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848157+0000", 2024-04-26T10:44:42.889 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2533000000000001e-05 2024-04-26T10:44:42.889 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.889 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.889 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:42.889 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848252+0000", 2024-04-26T10:44:42.890 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4480000000000003e-05 2024-04-26T10:44:42.890 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.890 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.890 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:42.890 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848393+0000", 2024-04-26T10:44:42.890 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000140863 2024-04-26T10:44:42.890 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.890 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.890 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:42.890 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.854434+0000", 2024-04-26T10:44:42.890 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060415590000000002 2024-04-26T10:44:42.890 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.890 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.890 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:42.891 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862894+0000", 2024-04-26T10:44:42.891 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0084598869999999993 2024-04-26T10:44:42.891 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.891 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.891 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:42.891 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862926+0000", 2024-04-26T10:44:42.891 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1473999999999997e-05 2024-04-26T10:44:42.891 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:42.891 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:42.891 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:42.891 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862952+0000", 2024-04-26T10:44:42.891 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6545000000000001e-05 2024-04-26T10:44:42.891 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.892 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:42.892 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.892 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:42.892 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:42.892 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:42.893 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:42.894 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:42.892+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:42.994 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:42.993+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:43.005 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:43.005 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:43.005 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:44:43.005 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:43.014 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:43.095 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:43.094+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:43.120 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:43.120 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:43.120 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:43.120 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:43.120 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:43.129 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:43.214 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:43.211+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:43.299 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:43.297+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:43.320 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:43.320 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:43.320 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:43.321 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:43.321 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.321 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:80 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:43.321 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:43.321 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.795603886999999, 2024-04-26T10:44:43.321 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029259192, 2024-04-26T10:44:43.321 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:43.321 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.321 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:43.321 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.321 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:43.321 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:43.321 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.321 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.322 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.322 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:43.322 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:43.322 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.322 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.322 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.322 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:43.322 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522252+0000", 2024-04-26T10:44:43.322 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:43.322 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.322 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.322 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:43.323 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523121+0000", 2024-04-26T10:44:43.323 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00086885100000000002 2024-04-26T10:44:43.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.323 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.323 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:43.323 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523133+0000", 2024-04-26T10:44:43.323 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2109999999999999e-05 2024-04-26T10:44:43.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.323 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.323 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.323 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523139+0000", 2024-04-26T10:44:43.323 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.541e-06 2024-04-26T10:44:43.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.323 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.323 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:43.324 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523176+0000", 2024-04-26T10:44:43.324 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6847999999999997e-05 2024-04-26T10:44:43.324 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.324 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.324 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:43.324 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523240+0000", 2024-04-26T10:44:43.324 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3941000000000003e-05 2024-04-26T10:44:43.324 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.324 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.324 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:43.324 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.536390+0000", 2024-04-26T10:44:43.324 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013150811 2024-04-26T10:44:43.324 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.325 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.325 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551071+0000", 2024-04-26T10:44:43.325 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014680021 2024-04-26T10:44:43.325 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.325 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:43.325 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551428+0000", 2024-04-26T10:44:43.325 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00035703900000000002 2024-04-26T10:44:43.325 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.325 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:43.325 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551462+0000", 2024-04-26T10:44:43.325 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4337e-05 2024-04-26T10:44:43.325 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.326 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.326 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:43.326 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551513+0000", 2024-04-26T10:44:43.326 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0875000000000003e-05 2024-04-26T10:44:43.326 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.326 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:43.326 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.326 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.326 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:129 3.1a 3:5e41ab69:::200.00000005:head [write 3557843~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:43.326 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:43.326 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.791545816999999, 2024-04-26T10:44:43.326 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029108253000000001, 2024-04-26T10:44:43.326 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:43.327 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.327 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:43.327 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.327 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:43.327 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:43.327 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.327 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.327 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:43.327 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:43.327 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.328 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.328 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:43.328 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526311+0000", 2024-04-26T10:44:43.328 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:43.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.328 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.328 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:43.328 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526315+0000", 2024-04-26T10:44:43.328 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4809999999999998e-06 2024-04-26T10:44:43.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.328 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.328 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:43.328 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526319+0000", 2024-04-26T10:44:43.329 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0690000000000003e-06 2024-04-26T10:44:43.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.329 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.329 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526321+0000", 2024-04-26T10:44:43.329 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4880000000000001e-06 2024-04-26T10:44:43.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.329 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:43.329 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553856+0000", 2024-04-26T10:44:43.329 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027534916 2024-04-26T10:44:43.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.330 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:43.330 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553900+0000", 2024-04-26T10:44:43.330 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3954e-05 2024-04-26T10:44:43.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.330 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.330 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:43.330 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553962+0000", 2024-04-26T10:44:43.330 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1519000000000005e-05 2024-04-26T10:44:43.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.330 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.331 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:43.331 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555348+0000", 2024-04-26T10:44:43.331 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013864579999999999 2024-04-26T10:44:43.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.331 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.331 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555378+0000", 2024-04-26T10:44:43.331 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9441000000000002e-05 2024-04-26T10:44:43.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.331 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:43.331 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555401+0000", 2024-04-26T10:44:43.331 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2815000000000001e-05 2024-04-26T10:44:43.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.332 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:43.332 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555420+0000", 2024-04-26T10:44:43.332 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9341e-05 2024-04-26T10:44:43.332 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.332 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:43.332 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.332 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:130 3.1a 3:5e41ab69:::200.00000005:head [write 3559243~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:43.332 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:43.332 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.791533982000001, 2024-04-26T10:44:43.332 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029188316999999998, 2024-04-26T10:44:43.332 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:43.332 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.333 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:43.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.333 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:43.333 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:43.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.333 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:43.333 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:43.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.333 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:43.333 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:43.334 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:43.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.334 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:43.334 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526325+0000", 2024-04-26T10:44:43.334 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4899999999999999e-06 2024-04-26T10:44:43.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.334 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:43.334 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526327+0000", 2024-04-26T10:44:43.334 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.745e-06 2024-04-26T10:44:43.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.335 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.335 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526330+0000", 2024-04-26T10:44:43.335 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5620000000000002e-06 2024-04-26T10:44:43.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.335 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:43.335 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554200+0000", 2024-04-26T10:44:43.335 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027869541000000001 2024-04-26T10:44:43.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.335 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:43.335 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554244+0000", 2024-04-26T10:44:43.335 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4464e-05 2024-04-26T10:44:43.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.336 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:43.336 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554304+0000", 2024-04-26T10:44:43.336 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9457999999999999e-05 2024-04-26T10:44:43.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.336 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.336 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555453+0000", 2024-04-26T10:44:43.336 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011494000000000001 2024-04-26T10:44:43.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.336 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:43.336 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555457+0000", 2024-04-26T10:44:43.336 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1779999999999996e-06 2024-04-26T10:44:43.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.337 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:43.337 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555480+0000", 2024-04-26T10:44:43.337 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2802e-05 2024-04-26T10:44:43.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.337 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:43.337 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555512+0000", 2024-04-26T10:44:43.337 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1885999999999999e-05 2024-04-26T10:44:43.337 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.337 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:43.337 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.338 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.338 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:131 3.1a 3:5e41ab69:::200.00000005:head [write 3560642~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:43.338 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:43.338 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.791525402000001, 2024-04-26T10:44:43.338 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029683102999999999, 2024-04-26T10:44:43.338 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:43.338 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.338 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:43.338 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.338 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:43.338 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:43.339 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.339 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:43.339 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:43.339 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.339 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:43.339 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:43.339 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:43.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.340 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:43.340 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526336+0000", 2024-04-26T10:44:43.340 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.681e-06 2024-04-26T10:44:43.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.340 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:43.340 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526338+0000", 2024-04-26T10:44:43.340 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8430000000000001e-06 2024-04-26T10:44:43.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.340 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.340 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526341+0000", 2024-04-26T10:44:43.340 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6180000000000002e-06 2024-04-26T10:44:43.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.341 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:43.341 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554745+0000", 2024-04-26T10:44:43.341 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028404088000000001 2024-04-26T10:44:43.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.341 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:43.341 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554788+0000", 2024-04-26T10:44:43.341 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2738999999999999e-05 2024-04-26T10:44:43.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.341 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:43.341 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554849+0000", 2024-04-26T10:44:43.341 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1362e-05 2024-04-26T10:44:43.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.342 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.342 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555963+0000", 2024-04-26T10:44:43.342 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001113597 2024-04-26T10:44:43.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.342 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:43.342 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555969+0000", 2024-04-26T10:44:43.345 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6900000000000003e-06 2024-04-26T10:44:43.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.346 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:43.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555995+0000", 2024-04-26T10:44:43.346 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5165999999999999e-05 2024-04-26T10:44:43.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.346 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:43.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556015+0000", 2024-04-26T10:44:43.346 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0522000000000001e-05 2024-04-26T10:44:43.346 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.346 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:43.346 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.346 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:132 3.1a 3:5e41ab69:::200.00000005:head [write 3562043~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:43.347 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:43.347 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.791505137000001, 2024-04-26T10:44:43.347 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030129895, 2024-04-26T10:44:43.347 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:43.347 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.347 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:43.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.347 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:43.347 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:43.347 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.347 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:43.347 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:43.347 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.348 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:43.348 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:43.348 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:43.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.348 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:43.348 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526354+0000", 2024-04-26T10:44:43.348 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8560000000000001e-06 2024-04-26T10:44:43.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.348 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:43.348 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526359+0000", 2024-04-26T10:44:43.348 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4700000000000001e-06 2024-04-26T10:44:43.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.349 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526365+0000", 2024-04-26T10:44:43.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2120000000000002e-06 2024-04-26T10:44:43.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.349 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:43.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555050+0000", 2024-04-26T10:44:43.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028685458 2024-04-26T10:44:43.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.349 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:43.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555093+0000", 2024-04-26T10:44:43.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3307999999999999e-05 2024-04-26T10:44:43.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.350 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:43.350 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555156+0000", 2024-04-26T10:44:43.350 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2396000000000004e-05 2024-04-26T10:44:43.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.350 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.350 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556052+0000", 2024-04-26T10:44:43.350 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00089650299999999999 2024-04-26T10:44:43.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.350 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:43.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556439+0000", 2024-04-26T10:44:43.351 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038647900000000001 2024-04-26T10:44:43.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:43.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556463+0000", 2024-04-26T10:44:43.351 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4071e-05 2024-04-26T10:44:43.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:43.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556482+0000", 2024-04-26T10:44:43.351 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9378999999999999e-05 2024-04-26T10:44:43.351 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.351 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:43.352 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.352 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 3563440~3660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:43.352 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:43.352 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.791488742999999, 2024-04-26T10:44:43.352 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030550738000000001, 2024-04-26T10:44:43.352 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:43.352 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.352 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:43.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:43.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:43.352 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.353 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:43.353 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:43.353 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.353 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:43.353 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526368+0000", 2024-04-26T10:44:43.353 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:43.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.353 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:43.353 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526375+0000", 2024-04-26T10:44:43.353 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7510000000000002e-06 2024-04-26T10:44:43.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.354 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:43.354 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526381+0000", 2024-04-26T10:44:43.354 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3929999999999996e-06 2024-04-26T10:44:43.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.354 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.354 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526387+0000", 2024-04-26T10:44:43.354 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.215e-06 2024-04-26T10:44:43.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.354 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:43.354 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555542+0000", 2024-04-26T10:44:43.354 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029154992000000001 2024-04-26T10:44:43.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:43.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555610+0000", 2024-04-26T10:44:43.355 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8610999999999998e-05 2024-04-26T10:44:43.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:43.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555681+0000", 2024-04-26T10:44:43.355 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1072e-05 2024-04-26T10:44:43.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556866+0000", 2024-04-26T10:44:43.355 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001184598 2024-04-26T10:44:43.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:43.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556872+0000", 2024-04-26T10:44:43.356 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.55e-06 2024-04-26T10:44:43.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:43.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556897+0000", 2024-04-26T10:44:43.356 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.516e-05 2024-04-26T10:44:43.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:43.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556919+0000", 2024-04-26T10:44:43.356 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1951e-05 2024-04-26T10:44:43.357 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.357 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:43.357 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.357 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:134 3.1a 3:5e41ab69:::200.00000005:head [write 3567100~2427 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:43.357 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:43.357 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.791455677999998, 2024-04-26T10:44:43.357 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031267445999999997, 2024-04-26T10:44:43.357 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:43.357 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.357 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:43.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.357 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:43.357 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:43.357 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.358 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:43.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:43.358 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.358 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:43.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526401+0000", 2024-04-26T10:44:43.358 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:43.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.358 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:43.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526408+0000", 2024-04-26T10:44:43.359 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7769999999999997e-06 2024-04-26T10:44:43.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.359 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:43.359 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526415+0000", 2024-04-26T10:44:43.359 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0720000000000002e-06 2024-04-26T10:44:43.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.359 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.359 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526421+0000", 2024-04-26T10:44:43.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9699999999999996e-06 2024-04-26T10:44:43.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:43.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556084+0000", 2024-04-26T10:44:43.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029662351999999999 2024-04-26T10:44:43.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:43.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556126+0000", 2024-04-26T10:44:43.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2385000000000002e-05 2024-04-26T10:44:43.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:43.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556186+0000", 2024-04-26T10:44:43.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9945999999999998e-05 2024-04-26T10:44:43.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:43.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557598+0000", 2024-04-26T10:44:43.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0014121559999999999 2024-04-26T10:44:43.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557626+0000", 2024-04-26T10:44:43.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7960999999999999e-05 2024-04-26T10:44:43.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:43.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557650+0000", 2024-04-26T10:44:43.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3969999999999999e-05 2024-04-26T10:44:43.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:43.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557669+0000", 2024-04-26T10:44:43.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9262e-05 2024-04-26T10:44:43.362 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.362 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:43.362 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.363 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:135 3.1a 3:5e41ab69:::200.00000005:head [write 3569527~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:43.363 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:43.363 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.791431412000001, 2024-04-26T10:44:43.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031322516000000002, 2024-04-26T10:44:43.363 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:43.363 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.363 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:43.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:43.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:43.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:43.364 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:43.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.364 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:43.364 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:43.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:43.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.364 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:43.364 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526429+0000", 2024-04-26T10:44:43.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0750000000000002e-06 2024-04-26T10:44:43.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:43.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526435+0000", 2024-04-26T10:44:43.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.263e-06 2024-04-26T10:44:43.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526442+0000", 2024-04-26T10:44:43.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1219999999999997e-06 2024-04-26T10:44:43.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:43.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556515+0000", 2024-04-26T10:44:43.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030073132999999998 2024-04-26T10:44:43.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:43.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556564+0000", 2024-04-26T10:44:43.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8871e-05 2024-04-26T10:44:43.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:43.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556625+0000", 2024-04-26T10:44:43.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1307000000000001e-05 2024-04-26T10:44:43.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:43.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557678+0000", 2024-04-26T10:44:43.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010523100000000001 2024-04-26T10:44:43.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557709+0000", 2024-04-26T10:44:43.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1748000000000002e-05 2024-04-26T10:44:43.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:43.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557732+0000", 2024-04-26T10:44:43.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2415000000000001e-05 2024-04-26T10:44:43.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:43.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557749+0000", 2024-04-26T10:44:43.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6736999999999999e-05 2024-04-26T10:44:43.368 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.368 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:43.368 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.368 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:136 3.1a 3:5e41ab69:::200.00000005:head [write 3571449~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:43.369 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:43.369 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.791410222, 2024-04-26T10:44:43.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032180937, 2024-04-26T10:44:43.369 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:43.369 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.369 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:43.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:43.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:43.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:43.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:43.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:43.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:43.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:43.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:43.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526455+0000", 2024-04-26T10:44:43.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6429999999999995e-06 2024-04-26T10:44:43.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:43.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526461+0000", 2024-04-26T10:44:43.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:43.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526467+0000", 2024-04-26T10:44:43.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4389999999999999e-06 2024-04-26T10:44:43.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:43.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556950+0000", 2024-04-26T10:44:43.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030483854000000001 2024-04-26T10:44:43.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:43.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556989+0000", 2024-04-26T10:44:43.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8415999999999999e-05 2024-04-26T10:44:43.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:43.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557051+0000", 2024-04-26T10:44:43.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2088999999999995e-05 2024-04-26T10:44:43.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:43.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558166+0000", 2024-04-26T10:44:43.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001114622 2024-04-26T10:44:43.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558584+0000", 2024-04-26T10:44:43.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000418033 2024-04-26T10:44:43.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:43.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558609+0000", 2024-04-26T10:44:43.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5344999999999999e-05 2024-04-26T10:44:43.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:43.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558628+0000", 2024-04-26T10:44:43.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9273999999999999e-05 2024-04-26T10:44:43.374 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.374 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:43.374 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.374 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:137 3.1a 3:5e41ab69:::200.00000005:head [write 3573699~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:43.374 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:43.374 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.791386573, 2024-04-26T10:44:43.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032241530999999997, 2024-04-26T10:44:43.374 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:43.375 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.375 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:43.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:43.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:43.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:43.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:43.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:43.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526470+0000", 2024-04-26T10:44:43.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:43.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:43.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526473+0000", 2024-04-26T10:44:43.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.818e-06 2024-04-26T10:44:43.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:43.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526480+0000", 2024-04-26T10:44:43.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4119999999999998e-06 2024-04-26T10:44:43.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526484+0000", 2024-04-26T10:44:43.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6840000000000004e-06 2024-04-26T10:44:43.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:43.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557323+0000", 2024-04-26T10:44:43.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030838956000000001 2024-04-26T10:44:43.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:43.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557362+0000", 2024-04-26T10:44:43.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8343999999999997e-05 2024-04-26T10:44:43.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:43.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557421+0000", 2024-04-26T10:44:43.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9176999999999999e-05 2024-04-26T10:44:43.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:43.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558636+0000", 2024-04-26T10:44:43.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012153789999999999 2024-04-26T10:44:43.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558668+0000", 2024-04-26T10:44:43.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1452999999999999e-05 2024-04-26T10:44:43.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:43.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558694+0000", 2024-04-26T10:44:43.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6288999999999999e-05 2024-04-26T10:44:43.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:43.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558712+0000", 2024-04-26T10:44:43.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8459000000000001e-05 2024-04-26T10:44:43.379 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.379 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:43.379 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.379 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:138 3.1a 3:5e41ab69:::200.00000005:head [write 3575103~4205 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:43.379 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:43.379 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.791369253999999, 2024-04-26T10:44:43.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032665567999999999, 2024-04-26T10:44:43.380 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:43.380 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.380 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:43.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.380 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:43.380 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:43.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.380 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:43.380 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:43.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:43.381 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:43.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:43.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:43.381 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526495+0000", 2024-04-26T10:44:43.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7580000000000003e-06 2024-04-26T10:44:43.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:43.381 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526501+0000", 2024-04-26T10:44:43.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1680000000000001e-06 2024-04-26T10:44:43.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526505+0000", 2024-04-26T10:44:43.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.673e-06 2024-04-26T10:44:43.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:43.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557781+0000", 2024-04-26T10:44:43.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031275718000000001 2024-04-26T10:44:43.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:43.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557825+0000", 2024-04-26T10:44:43.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4048000000000002e-05 2024-04-26T10:44:43.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:43.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557888+0000", 2024-04-26T10:44:43.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2562000000000002e-05 2024-04-26T10:44:43.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559073+0000", 2024-04-26T10:44:43.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011852239999999999 2024-04-26T10:44:43.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:43.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559112+0000", 2024-04-26T10:44:43.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9226e-05 2024-04-26T10:44:43.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:43.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559136+0000", 2024-04-26T10:44:43.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3966000000000001e-05 2024-04-26T10:44:43.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:43.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559154+0000", 2024-04-26T10:44:43.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7575e-05 2024-04-26T10:44:43.384 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.384 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:43.384 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.385 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:139 3.1a 3:5e41ab69:::200.00000005:head [write 3579308~2255 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:43.385 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:43.385 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.791347636000001, 2024-04-26T10:44:43.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033424720999999998, 2024-04-26T10:44:43.385 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:43.385 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.385 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:43.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:43.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:43.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:43.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:43.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.386 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:43.386 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526509+0000", 2024-04-26T10:44:43.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:43.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.386 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:43.386 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526516+0000", 2024-04-26T10:44:43.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5209999999999999e-06 2024-04-26T10:44:43.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:43.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526522+0000", 2024-04-26T10:44:43.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1229999999999997e-06 2024-04-26T10:44:43.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526527+0000", 2024-04-26T10:44:43.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7849999999999999e-06 2024-04-26T10:44:43.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:43.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558194+0000", 2024-04-26T10:44:43.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031667419000000002 2024-04-26T10:44:43.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:43.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558234+0000", 2024-04-26T10:44:43.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9774999999999998e-05 2024-04-26T10:44:43.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:43.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558294+0000", 2024-04-26T10:44:43.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0242999999999999e-05 2024-04-26T10:44:43.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559106+0000", 2024-04-26T10:44:43.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00081148099999999996 2024-04-26T10:44:43.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:43.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559890+0000", 2024-04-26T10:44:43.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00078439999999999998 2024-04-26T10:44:43.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:43.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559917+0000", 2024-04-26T10:44:43.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7044000000000001e-05 2024-04-26T10:44:43.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:43.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559935+0000", 2024-04-26T10:44:43.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7448e-05 2024-04-26T10:44:43.389 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.389 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:43.390 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.390 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:140 3.1a 3:5e41ab69:::200.00000005:head [write 3581563~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:43.390 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:43.390 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.791326215000002, 2024-04-26T10:44:43.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033867728, 2024-04-26T10:44:43.390 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:43.390 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.390 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:43.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:43.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:43.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:43.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:43.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:43.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:43.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:43.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:43.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526538+0000", 2024-04-26T10:44:43.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.905e-06 2024-04-26T10:44:43.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:43.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526542+0000", 2024-04-26T10:44:43.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9550000000000002e-06 2024-04-26T10:44:43.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526545+0000", 2024-04-26T10:44:43.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8499999999999998e-06 2024-04-26T10:44:43.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:43.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558744+0000", 2024-04-26T10:44:43.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032198986999999998 2024-04-26T10:44:43.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:43.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558788+0000", 2024-04-26T10:44:43.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4365e-05 2024-04-26T10:44:43.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:43.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558854+0000", 2024-04-26T10:44:43.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5952999999999997e-05 2024-04-26T10:44:43.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559971+0000", 2024-04-26T10:44:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011172770000000001 2024-04-26T10:44:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560354+0000", 2024-04-26T10:44:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038267599999999998 2024-04-26T10:44:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560380+0000", 2024-04-26T10:44:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6140999999999999e-05 2024-04-26T10:44:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:43.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560399+0000", 2024-04-26T10:44:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9032999999999999e-05 2024-04-26T10:44:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:141 3.1a 3:5e41ab69:::200.00000005:head [write 3583482~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.791310555999999, 2024-04-26T10:44:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034316301, 2024-04-26T10:44:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:43.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.397 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:43.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526548+0000", 2024-04-26T10:44:43.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.739e-06 2024-04-26T10:44:43.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.397 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:43.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526551+0000", 2024-04-26T10:44:43.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.044e-06 2024-04-26T10:44:43.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.397 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526562+0000", 2024-04-26T10:44:43.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0370000000000001e-05 2024-04-26T10:44:43.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559179+0000", 2024-04-26T10:44:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032617444000000002 2024-04-26T10:44:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559220+0000", 2024-04-26T10:44:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0364999999999997e-05 2024-04-26T10:44:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559280+0000", 2024-04-26T10:44:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0569000000000002e-05 2024-04-26T10:44:43.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560814+0000", 2024-04-26T10:44:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015337580000000001 2024-04-26T10:44:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560820+0000", 2024-04-26T10:44:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.455e-06 2024-04-26T10:44:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560846+0000", 2024-04-26T10:44:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5228999999999998e-05 2024-04-26T10:44:43.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560863+0000", 2024-04-26T10:44:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7555e-05 2024-04-26T10:44:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:142 3.1a 3:5e41ab69:::200.00000005:head [write 3585931~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.791290158999999, 2024-04-26T10:44:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034372373999999997, 2024-04-26T10:44:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:43.400 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:43.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526573+0000", 2024-04-26T10:44:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0800000000000002e-06 2024-04-26T10:44:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526580+0000", 2024-04-26T10:44:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5799999999999997e-06 2024-04-26T10:44:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526585+0000", 2024-04-26T10:44:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2270000000000001e-06 2024-04-26T10:44:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559601+0000", 2024-04-26T10:44:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033016684999999997 2024-04-26T10:44:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559642+0000", 2024-04-26T10:44:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0321000000000002e-05 2024-04-26T10:44:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559706+0000", 2024-04-26T10:44:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4228999999999998e-05 2024-04-26T10:44:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560871+0000", 2024-04-26T10:44:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001164893 2024-04-26T10:44:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560899+0000", 2024-04-26T10:44:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:43.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560922+0000", 2024-04-26T10:44:43.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3337999999999999e-05 2024-04-26T10:44:43.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.405 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:43.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560940+0000", 2024-04-26T10:44:43.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7289999999999999e-05 2024-04-26T10:44:43.405 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.405 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:43.405 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.405 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:143 3.1a 3:5e41ab69:::200.00000005:head [write 3587331~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:43.405 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:43.405 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.791268260999999, 2024-04-26T10:44:43.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035256000000000003, 2024-04-26T10:44:43.406 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:43.406 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.406 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:43.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:43.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:43.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:43.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:43.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:43.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:43.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:43.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:43.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526592+0000", 2024-04-26T10:44:43.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2449999999999998e-06 2024-04-26T10:44:43.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:43.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526596+0000", 2024-04-26T10:44:43.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7000000000000002e-06 2024-04-26T10:44:43.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526599+0000", 2024-04-26T10:44:43.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6160000000000002e-06 2024-04-26T10:44:43.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:43.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559997+0000", 2024-04-26T10:44:43.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033397835000000001 2024-04-26T10:44:43.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:43.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560051+0000", 2024-04-26T10:44:43.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3742000000000001e-05 2024-04-26T10:44:43.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.409 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:43.409 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560112+0000", 2024-04-26T10:44:43.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0851999999999999e-05 2024-04-26T10:44:43.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.409 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:43.409 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561404+0000", 2024-04-26T10:44:43.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001291869 2024-04-26T10:44:43.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.409 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.409 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561797+0000", 2024-04-26T10:44:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039383000000000002 2024-04-26T10:44:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561827+0000", 2024-04-26T10:44:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9247e-05 2024-04-26T10:44:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561845+0000", 2024-04-26T10:44:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8462999999999999e-05 2024-04-26T10:44:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:144 3.1a 3:5e41ab69:::200.00000005:head [write 3588736~4987 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.791145968999999, 2024-04-26T10:44:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035224283000000002, 2024-04-26T10:44:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526718+0000", 2024-04-26T10:44:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.43e-06 2024-04-26T10:44:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526726+0000", 2024-04-26T10:44:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:44:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526729+0000", 2024-04-26T10:44:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6480000000000001e-06 2024-04-26T10:44:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560427+0000", 2024-04-26T10:44:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033697280000000003 2024-04-26T10:44:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560466+0000", 2024-04-26T10:44:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9606e-05 2024-04-26T10:44:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560525+0000", 2024-04-26T10:44:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9218000000000001e-05 2024-04-26T10:44:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561854+0000", 2024-04-26T10:44:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001328421 2024-04-26T10:44:43.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561887+0000", 2024-04-26T10:44:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2746000000000001e-05 2024-04-26T10:44:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561912+0000", 2024-04-26T10:44:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5126999999999998e-05 2024-04-26T10:44:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561936+0000", 2024-04-26T10:44:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4032999999999998e-05 2024-04-26T10:44:43.415 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:145 3.1a 3:5e41ab69:::200.00000005:head [write 3593723~2939 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.788226924, 2024-04-26T10:44:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033294394999999997, 2024-04-26T10:44:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:43.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529630+0000", 2024-04-26T10:44:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529635+0000", 2024-04-26T10:44:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7960000000000003e-06 2024-04-26T10:44:43.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529643+0000", 2024-04-26T10:44:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0390000000000005e-06 2024-04-26T10:44:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529648+0000", 2024-04-26T10:44:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9599999999999999e-06 2024-04-26T10:44:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:43.418 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560969+0000", 2024-04-26T10:44:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031321767 2024-04-26T10:44:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561009+0000", 2024-04-26T10:44:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9904999999999998e-05 2024-04-26T10:44:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561070+0000", 2024-04-26T10:44:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0708999999999998e-05 2024-04-26T10:44:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:43.419 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562352+0000", 2024-04-26T10:44:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012818440000000001 2024-04-26T10:44:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562867+0000", 2024-04-26T10:44:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000515665 2024-04-26T10:44:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562893+0000", 2024-04-26T10:44:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5469999999999998e-05 2024-04-26T10:44:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:43.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562925+0000", 2024-04-26T10:44:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1974999999999998e-05 2024-04-26T10:44:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:146 3.1a 3:5e41ab69:::200.00000005:head [write 3596662~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.78799871, 2024-04-26T10:44:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033178429000000002, 2024-04-26T10:44:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:43.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529858+0000", 2024-04-26T10:44:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:43.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529863+0000", 2024-04-26T10:44:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4500000000000003e-06 2024-04-26T10:44:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529874+0000", 2024-04-26T10:44:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0552e-05 2024-04-26T10:44:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529882+0000", 2024-04-26T10:44:43.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4449999999999996e-06 2024-04-26T10:44:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561452+0000", 2024-04-26T10:44:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031569680000000003 2024-04-26T10:44:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561511+0000", 2024-04-26T10:44:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9332e-05 2024-04-26T10:44:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:43.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561583+0000", 2024-04-26T10:44:43.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1730000000000006e-05 2024-04-26T10:44:43.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:43.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562933+0000", 2024-04-26T10:44:43.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013500059999999999 2024-04-26T10:44:43.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562976+0000", 2024-04-26T10:44:43.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2987e-05 2024-04-26T10:44:43.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:43.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563015+0000", 2024-04-26T10:44:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9453999999999999e-05 2024-04-26T10:44:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563037+0000", 2024-04-26T10:44:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1679e-05 2024-04-26T10:44:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:277 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:43.426 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 16.802988007, 2024-04-26T10:44:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030430563000000001, 2024-04-26T10:44:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514867+0000", 2024-04-26T10:44:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515460+0000", 2024-04-26T10:44:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00059285800000000004 2024-04-26T10:44:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515474+0000", 2024-04-26T10:44:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3933e-05 2024-04-26T10:44:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515481+0000", 2024-04-26T10:44:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515522+0000", 2024-04-26T10:44:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1369000000000003e-05 2024-04-26T10:44:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515591+0000", 2024-04-26T10:44:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9377999999999999e-05 2024-04-26T10:44:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.526440+0000", 2024-04-26T10:44:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010848837 2024-04-26T10:44:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.543866+0000", 2024-04-26T10:44:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017426288000000002 2024-04-26T10:44:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545193+0000", 2024-04-26T10:44:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001326111 2024-04-26T10:44:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545229+0000", 2024-04-26T10:44:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6390999999999998e-05 2024-04-26T10:44:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545300+0000", 2024-04-26T10:44:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1073000000000002e-05 2024-04-26T10:44:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:43.431 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:43.431 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:43.433 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:43.431+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:43.433 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:43.534 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:43.532+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:43.537 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:43.538 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:43.538 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:44:43.538 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:43.550 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:43.635 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:43.633+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:43.689 INFO:teuthology.orchestra.run.smithi049.stderr:nodeep-scrub is unset 2024-04-26T10:44:43.695 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:43.695 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:43.695 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:43.695 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:43.695 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:43.705 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:43.749 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:43.747+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:43.811 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:43.811 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:43.811 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:43.811 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:43.811 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.811 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:330 3.13 3:ceffbd45:::200.0000000a:head [write 1316140~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:43.812 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:43.812 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 17.295751550999999, 2024-04-26T10:44:43.812 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022245654, 2024-04-26T10:44:43.812 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:43.812 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.812 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:43.812 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.812 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:43.812 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:43.812 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.812 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.812 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.812 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:43.812 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:43.812 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.812 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.813 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.813 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:43.813 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513139+0000", 2024-04-26T10:44:43.813 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:43.813 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.813 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.813 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:43.813 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513149+0000", 2024-04-26T10:44:43.813 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7550000000000006e-06 2024-04-26T10:44:43.813 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.813 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.813 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:43.813 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513157+0000", 2024-04-26T10:44:43.813 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1089999999999998e-06 2024-04-26T10:44:43.814 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.814 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.814 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.814 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513167+0000", 2024-04-26T10:44:43.814 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0539e-05 2024-04-26T10:44:43.814 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.814 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.814 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:43.814 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533830+0000", 2024-04-26T10:44:43.814 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020662852999999998 2024-04-26T10:44:43.814 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.814 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.814 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:43.815 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533875+0000", 2024-04-26T10:44:43.815 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.5071999999999998e-05 2024-04-26T10:44:43.815 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.815 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.815 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:43.815 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535319+0000", 2024-04-26T10:44:43.815 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001443578 2024-04-26T10:44:43.815 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.815 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.815 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:43.815 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535346+0000", 2024-04-26T10:44:43.815 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7415000000000001e-05 2024-04-26T10:44:43.815 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.815 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.815 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:43.816 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535385+0000", 2024-04-26T10:44:43.816 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8912999999999998e-05 2024-04-26T10:44:43.816 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.816 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:43.816 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.816 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.816 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.816 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:331 3.13 3:ceffbd45:::200.0000000a:head [write 1318049~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:43.816 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:43.816 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 17.295712222999999, 2024-04-26T10:44:43.816 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023524521, 2024-04-26T10:44:43.816 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:43.816 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.816 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:43.816 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.816 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:43.817 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:43.817 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.817 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.817 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.817 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:43.817 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:43.817 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.817 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.817 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.817 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:43.817 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513178+0000", 2024-04-26T10:44:43.817 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:43.817 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.817 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.818 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:43.818 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513183+0000", 2024-04-26T10:44:43.818 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2549999999999999e-06 2024-04-26T10:44:43.818 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.818 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.818 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:43.818 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513190+0000", 2024-04-26T10:44:43.818 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8460000000000002e-06 2024-04-26T10:44:43.818 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.818 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.818 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.818 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513195+0000", 2024-04-26T10:44:43.818 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3630000000000002e-06 2024-04-26T10:44:43.818 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.819 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.819 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:43.819 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534463+0000", 2024-04-26T10:44:43.819 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021267823000000002 2024-04-26T10:44:43.819 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.819 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.819 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:43.819 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534520+0000", 2024-04-26T10:44:43.819 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7510000000000003e-05 2024-04-26T10:44:43.819 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.819 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.819 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:43.819 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536634+0000", 2024-04-26T10:44:43.819 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0021138900000000002 2024-04-26T10:44:43.820 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.820 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.820 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:43.820 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536663+0000", 2024-04-26T10:44:43.820 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8884e-05 2024-04-26T10:44:43.820 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.820 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.820 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:43.820 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536703+0000", 2024-04-26T10:44:43.820 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0479000000000003e-05 2024-04-26T10:44:43.820 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.820 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:43.820 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.820 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.821 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.821 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:332 3.13 3:ceffbd45:::200.0000000a:head [write 1319462~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:43.821 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:43.821 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 17.295677390000002, 2024-04-26T10:44:43.821 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024543230999999999, 2024-04-26T10:44:43.821 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:43.821 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.821 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:43.821 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.821 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:43.821 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:43.821 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.821 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.821 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.821 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:43.822 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:43.822 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.822 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.822 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.822 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:43.822 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513213+0000", 2024-04-26T10:44:43.822 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:43.822 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.822 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.822 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:43.822 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513217+0000", 2024-04-26T10:44:43.822 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:44:43.822 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.822 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.822 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:43.823 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513229+0000", 2024-04-26T10:44:43.823 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2051e-05 2024-04-26T10:44:43.823 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.823 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.823 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.823 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513236+0000", 2024-04-26T10:44:43.823 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4470000000000003e-06 2024-04-26T10:44:43.823 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.823 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.823 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:43.823 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534891+0000", 2024-04-26T10:44:43.823 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021655863000000001 2024-04-26T10:44:43.823 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.823 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.823 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:43.824 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534933+0000", 2024-04-26T10:44:43.824 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1596e-05 2024-04-26T10:44:43.824 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.824 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.824 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:43.824 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537677+0000", 2024-04-26T10:44:43.824 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027440989999999998 2024-04-26T10:44:43.824 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.824 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.824 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:43.824 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537721+0000", 2024-04-26T10:44:43.824 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3813999999999998e-05 2024-04-26T10:44:43.824 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.825 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.825 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:43.825 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537757+0000", 2024-04-26T10:44:43.825 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6022999999999997e-05 2024-04-26T10:44:43.825 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.825 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:43.825 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.825 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.825 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.825 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:333 3.13 3:ceffbd45:::200.0000000a:head [write 1320870~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:43.825 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:43.825 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 17.295634471, 2024-04-26T10:44:43.825 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024557151999999999, 2024-04-26T10:44:43.826 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:43.826 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.826 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:43.826 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.826 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:43.826 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:43.826 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.826 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.826 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.826 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:43.826 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:43.826 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.826 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.826 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513256+0000", 2024-04-26T10:44:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513260+0000", 2024-04-26T10:44:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6550000000000002e-06 2024-04-26T10:44:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513273+0000", 2024-04-26T10:44:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2965e-05 2024-04-26T10:44:43.827 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.828 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.828 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.828 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513279+0000", 2024-04-26T10:44:43.828 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:44:43.828 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.828 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.828 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:43.828 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535411+0000", 2024-04-26T10:44:43.828 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022132233000000001 2024-04-26T10:44:43.828 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.828 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.828 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:43.828 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535479+0000", 2024-04-26T10:44:43.828 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7554999999999999e-05 2024-04-26T10:44:43.829 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.829 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.829 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:43.829 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537762+0000", 2024-04-26T10:44:43.829 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022836499999999999 2024-04-26T10:44:43.829 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.829 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.829 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:43.829 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537783+0000", 2024-04-26T10:44:43.829 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0364e-05 2024-04-26T10:44:43.829 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.829 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.829 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:43.829 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537814+0000", 2024-04-26T10:44:43.829 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1170000000000001e-05 2024-04-26T10:44:43.830 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.830 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:43.830 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.830 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.830 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.830 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:334 3.13 3:ceffbd45:::200.0000000a:head [write 1322273~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:43.830 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:43.830 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 17.293797712, 2024-04-26T10:44:43.830 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022778731999999999, 2024-04-26T10:44:43.830 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:43.830 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.830 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:43.830 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.830 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:43.831 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:43.831 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.831 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.831 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.831 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:43.831 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:43.831 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.831 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.831 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.832 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:43.832 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:43.832 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:43.832 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.832 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.832 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:43.832 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515099+0000", 2024-04-26T10:44:43.832 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6599999999999998e-06 2024-04-26T10:44:43.832 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.832 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.832 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:43.832 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515112+0000", 2024-04-26T10:44:43.832 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2707e-05 2024-04-26T10:44:43.832 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.832 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.833 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.833 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515120+0000", 2024-04-26T10:44:43.833 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8509999999999999e-06 2024-04-26T10:44:43.833 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.833 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.833 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:43.833 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535792+0000", 2024-04-26T10:44:43.833 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020672209 2024-04-26T10:44:43.833 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.833 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.833 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:43.833 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535833+0000", 2024-04-26T10:44:43.834 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1415000000000002e-05 2024-04-26T10:44:43.834 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.834 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.834 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:43.834 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537818+0000", 2024-04-26T10:44:43.834 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0019850900000000001 2024-04-26T10:44:43.834 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.834 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.834 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:43.834 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537839+0000", 2024-04-26T10:44:43.834 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0068000000000002e-05 2024-04-26T10:44:43.834 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.834 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.835 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:43.835 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537872+0000", 2024-04-26T10:44:43.835 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3680999999999998e-05 2024-04-26T10:44:43.835 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.835 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:43.835 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.835 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.835 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.835 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:335 3.13 3:ceffbd45:::200.0000000a:head [write 1325230~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:43.835 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:43.835 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 17.293758613000001, 2024-04-26T10:44:43.835 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023487081, 2024-04-26T10:44:43.835 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:43.836 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.836 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:43.836 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.836 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:43.836 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:43.836 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.836 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.836 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.836 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:43.836 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:43.837 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.837 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.837 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.837 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:43.837 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515132+0000", 2024-04-26T10:44:43.837 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:43.837 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.837 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.837 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:43.837 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515136+0000", 2024-04-26T10:44:43.837 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0860000000000004e-06 2024-04-26T10:44:43.837 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.837 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.837 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:43.838 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515143+0000", 2024-04-26T10:44:43.838 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.0400000000000004e-06 2024-04-26T10:44:43.838 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.838 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.838 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.838 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515149+0000", 2024-04-26T10:44:43.838 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0789999999999997e-06 2024-04-26T10:44:43.839 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.839 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.839 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:43.839 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536200+0000", 2024-04-26T10:44:43.839 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021050993 2024-04-26T10:44:43.839 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.839 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.839 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:43.839 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536253+0000", 2024-04-26T10:44:43.839 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.2643999999999999e-05 2024-04-26T10:44:43.839 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.839 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.840 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:43.840 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538560+0000", 2024-04-26T10:44:43.840 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0023073389999999998 2024-04-26T10:44:43.840 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.840 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.840 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:43.840 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538584+0000", 2024-04-26T10:44:43.840 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3893999999999999e-05 2024-04-26T10:44:43.840 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.840 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.840 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:43.840 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538620+0000", 2024-04-26T10:44:43.841 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5611000000000002e-05 2024-04-26T10:44:43.841 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.841 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:43.841 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.841 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.841 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.841 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:336 3.13 3:ceffbd45:::200.0000000a:head [write 1327147~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:43.841 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:43.841 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 17.292426158000001, 2024-04-26T10:44:43.841 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027687066, 2024-04-26T10:44:43.841 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:43.841 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.841 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:43.841 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.841 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:43.842 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:43.842 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.842 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.842 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.842 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:43.842 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:43.842 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.842 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.842 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.842 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:43.842 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516464+0000", 2024-04-26T10:44:43.842 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:43.842 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.843 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.843 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:43.843 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516491+0000", 2024-04-26T10:44:43.843 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6539000000000001e-05 2024-04-26T10:44:43.843 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.843 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.843 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:43.843 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516500+0000", 2024-04-26T10:44:43.843 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5480000000000007e-06 2024-04-26T10:44:43.843 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.843 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.843 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.843 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516511+0000", 2024-04-26T10:44:43.843 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0719e-05 2024-04-26T10:44:43.843 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.844 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.844 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:43.844 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536737+0000", 2024-04-26T10:44:43.844 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020225770000000001 2024-04-26T10:44:43.844 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.844 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.844 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:43.844 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536783+0000", 2024-04-26T10:44:43.844 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6168999999999998e-05 2024-04-26T10:44:43.844 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.844 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.844 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:43.844 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544080+0000", 2024-04-26T10:44:43.844 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0072966799999999998 2024-04-26T10:44:43.844 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.844 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.845 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:43.845 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544111+0000", 2024-04-26T10:44:43.845 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1056999999999998e-05 2024-04-26T10:44:43.845 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.845 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.845 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:43.845 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544152+0000", 2024-04-26T10:44:43.845 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1452000000000002e-05 2024-04-26T10:44:43.845 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.845 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:43.845 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.845 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.845 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.845 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:337 3.13 3:ceffbd45:::200.0000000a:head [write 1342136~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:43.845 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:43.846 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 17.292373220000002, 2024-04-26T10:44:43.846 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027711237, 2024-04-26T10:44:43.846 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:43.846 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.846 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:43.846 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.846 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:43.846 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:43.846 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.846 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.846 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.846 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:43.846 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:43.846 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.847 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.847 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.847 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:43.847 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516517+0000", 2024-04-26T10:44:43.847 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:43.847 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.847 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.847 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:43.847 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516521+0000", 2024-04-26T10:44:43.847 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6200000000000001e-06 2024-04-26T10:44:43.847 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.847 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.847 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:43.847 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516528+0000", 2024-04-26T10:44:43.848 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8639999999999998e-06 2024-04-26T10:44:43.848 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.848 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.848 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.848 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516533+0000", 2024-04-26T10:44:43.848 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6310000000000002e-06 2024-04-26T10:44:43.848 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.848 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.848 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:43.848 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537231+0000", 2024-04-26T10:44:43.848 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020698613000000001 2024-04-26T10:44:43.848 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.848 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.849 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:43.849 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537273+0000", 2024-04-26T10:44:43.849 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1529000000000002e-05 2024-04-26T10:44:43.849 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.849 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.849 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:43.849 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544157+0000", 2024-04-26T10:44:43.849 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068847090000000001 2024-04-26T10:44:43.849 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.849 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.849 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:43.849 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544180+0000", 2024-04-26T10:44:43.849 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.2532e-05 2024-04-26T10:44:43.849 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.849 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.850 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:43.850 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544229+0000", 2024-04-26T10:44:43.850 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9190000000000002e-05 2024-04-26T10:44:43.850 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.850 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:43.850 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.850 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.850 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.850 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:338 3.13 3:ceffbd45:::200.0000000a:head [write 1344569~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:43.850 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:43.850 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 17.291706967, 2024-04-26T10:44:43.850 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027105598000000002, 2024-04-26T10:44:43.851 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:43.851 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.851 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:43.851 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.851 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:43.851 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:43.851 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.851 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.851 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.851 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:43.851 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:43.851 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.851 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.851 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.851 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:43.852 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517183+0000", 2024-04-26T10:44:43.852 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:43.852 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.852 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.852 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:43.852 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517188+0000", 2024-04-26T10:44:43.852 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7389999999999999e-06 2024-04-26T10:44:43.852 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.852 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.852 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:43.852 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517199+0000", 2024-04-26T10:44:43.852 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0652000000000001e-05 2024-04-26T10:44:43.852 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.852 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.852 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.853 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517206+0000", 2024-04-26T10:44:43.853 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6610000000000003e-06 2024-04-26T10:44:43.853 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.853 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.853 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:43.853 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537905+0000", 2024-04-26T10:44:43.853 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020699662000000001 2024-04-26T10:44:43.853 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.853 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.853 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:43.853 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537956+0000", 2024-04-26T10:44:43.853 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0954e-05 2024-04-26T10:44:43.853 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.854 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.854 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:43.854 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544233+0000", 2024-04-26T10:44:43.854 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062773009999999999 2024-04-26T10:44:43.854 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.854 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.854 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:43.854 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544258+0000", 2024-04-26T10:44:43.854 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4434999999999999e-05 2024-04-26T10:44:43.854 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.854 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.854 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:43.854 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544290+0000", 2024-04-26T10:44:43.855 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1918000000000002e-05 2024-04-26T10:44:43.855 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.855 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:43.855 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.855 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.855 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.855 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:339 3.13 3:ceffbd45:::200.0000000a:head [write 1346485~4322 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:43.855 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:43.855 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 17.290768474, 2024-04-26T10:44:43.855 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026221617999999999, 2024-04-26T10:44:43.855 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:43.855 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.855 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:43.856 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.856 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:43.856 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:43.856 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.856 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.856 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.856 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:43.856 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:43.856 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.856 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.856 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.856 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:43.856 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518122+0000", 2024-04-26T10:44:43.857 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:43.857 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.857 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.857 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:43.857 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518129+0000", 2024-04-26T10:44:43.857 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.43e-06 2024-04-26T10:44:43.857 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.857 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.857 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:43.857 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518138+0000", 2024-04-26T10:44:43.857 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9129999999999992e-06 2024-04-26T10:44:43.857 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.857 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.857 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.858 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518144+0000", 2024-04-26T10:44:43.858 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.1419999999999998e-06 2024-04-26T10:44:43.858 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.858 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.858 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:43.858 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538232+0000", 2024-04-26T10:44:43.858 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020087383 2024-04-26T10:44:43.858 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.858 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.858 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:43.858 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538274+0000", 2024-04-26T10:44:43.858 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2602999999999999e-05 2024-04-26T10:44:43.859 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.859 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.859 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:43.859 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544294+0000", 2024-04-26T10:44:43.859 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060194059999999997 2024-04-26T10:44:43.859 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.859 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.859 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:43.859 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544314+0000", 2024-04-26T10:44:43.859 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0091000000000001e-05 2024-04-26T10:44:43.859 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.859 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.859 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:43.859 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544344+0000", 2024-04-26T10:44:43.860 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0446e-05 2024-04-26T10:44:43.860 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.860 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:43.860 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.860 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.860 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.860 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:340 3.13 3:ceffbd45:::200.0000000a:head [write 1350807~2768 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:43.860 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:43.860 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 17.288284237999999, 2024-04-26T10:44:43.860 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023795594, 2024-04-26T10:44:43.861 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:43.861 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.861 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:43.861 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.861 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:43.861 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:43.861 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.861 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.861 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.861 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:43.861 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:43.861 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.862 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.862 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.862 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:43.862 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520606+0000", 2024-04-26T10:44:43.862 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:43.862 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.862 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.862 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:43.862 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520612+0000", 2024-04-26T10:44:43.862 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.835e-06 2024-04-26T10:44:43.862 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.862 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.862 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:43.862 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520622+0000", 2024-04-26T10:44:43.862 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0173999999999999e-05 2024-04-26T10:44:43.863 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.863 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.863 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.863 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520629+0000", 2024-04-26T10:44:43.863 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7460000000000003e-06 2024-04-26T10:44:43.863 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.863 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.863 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:43.863 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538651+0000", 2024-04-26T10:44:43.863 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018022474 2024-04-26T10:44:43.863 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.863 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.863 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:43.863 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538697+0000", 2024-04-26T10:44:43.864 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6183999999999997e-05 2024-04-26T10:44:43.864 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.864 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.864 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:43.864 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544348+0000", 2024-04-26T10:44:43.864 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0056503509999999996 2024-04-26T10:44:43.864 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.864 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.864 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:43.864 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544369+0000", 2024-04-26T10:44:43.864 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1064999999999999e-05 2024-04-26T10:44:43.864 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.864 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.864 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:43.864 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544403+0000", 2024-04-26T10:44:43.865 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3695000000000002e-05 2024-04-26T10:44:43.865 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.865 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:43.865 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.865 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.865 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.865 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:341 3.13 3:ceffbd45:::200.0000000a:head [write 1353575~3816 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:43.865 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:43.865 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 17.287548983000001, 2024-04-26T10:44:43.865 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023114967, 2024-04-26T10:44:43.865 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:43.865 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.866 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:43.866 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.866 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:43.866 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:43.866 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.866 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.866 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.866 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:43.866 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:43.866 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.866 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.867 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.867 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:43.867 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521341+0000", 2024-04-26T10:44:43.867 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:43.867 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.867 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.867 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:43.867 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521349+0000", 2024-04-26T10:44:43.867 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1550000000000001e-06 2024-04-26T10:44:43.867 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.867 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.867 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:43.867 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521358+0000", 2024-04-26T10:44:43.867 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.1500000000000005e-06 2024-04-26T10:44:43.868 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.868 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.868 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.868 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521364+0000", 2024-04-26T10:44:43.868 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3289999999999999e-06 2024-04-26T10:44:43.868 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.868 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.868 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:43.868 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539010+0000", 2024-04-26T10:44:43.868 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.017645965999999999 2024-04-26T10:44:43.868 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.868 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.868 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:43.868 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539051+0000", 2024-04-26T10:44:43.869 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.053e-05 2024-04-26T10:44:43.869 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.869 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.869 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:43.869 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544407+0000", 2024-04-26T10:44:43.869 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053560209999999999 2024-04-26T10:44:43.869 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.869 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.869 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:43.869 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544427+0000", 2024-04-26T10:44:43.869 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0228e-05 2024-04-26T10:44:43.869 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.869 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.869 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:43.870 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544457+0000", 2024-04-26T10:44:43.870 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0375e-05 2024-04-26T10:44:43.870 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.870 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:43.870 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.870 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.870 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.870 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11582 4.2f 4:f76ba295:::10000003252.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:43.870 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:43.870 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 14.813933437999999, 2024-04-26T10:44:43.870 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024553994999999999, 2024-04-26T10:44:43.870 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:43.870 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.870 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:43.871 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:43.871 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:43.871 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11582 2024-04-26T10:44:43.871 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.871 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:43.871 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.871 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:43.871 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:43.871 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.871 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.871 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.871 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:43.871 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:43.871 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.872 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.872 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.872 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:43.872 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994957+0000", 2024-04-26T10:44:43.872 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:43.872 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.872 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.872 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:43.872 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002755+0000", 2024-04-26T10:44:43.872 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0077984719999999999 2024-04-26T10:44:43.872 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.872 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.872 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:43.873 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002770+0000", 2024-04-26T10:44:43.873 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4956e-05 2024-04-26T10:44:43.873 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.873 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.873 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.873 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002777+0000", 2024-04-26T10:44:43.873 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1899999999999998e-06 2024-04-26T10:44:43.873 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.873 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.873 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:43.873 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002833+0000", 2024-04-26T10:44:43.873 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5189999999999998e-05 2024-04-26T10:44:43.873 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.874 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.874 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:43.874 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002977+0000", 2024-04-26T10:44:43.874 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014444100000000001 2024-04-26T10:44:43.874 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.874 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.874 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:43.874 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.003108+0000", 2024-04-26T10:44:43.874 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000131068 2024-04-26T10:44:43.874 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.874 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.874 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:43.874 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.009040+0000", 2024-04-26T10:44:43.874 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059314149999999998 2024-04-26T10:44:43.875 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.875 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.875 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.875 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019462+0000", 2024-04-26T10:44:43.875 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010422803 2024-04-26T10:44:43.875 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.875 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.875 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:43.875 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019490+0000", 2024-04-26T10:44:43.875 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7773999999999999e-05 2024-04-26T10:44:43.875 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.875 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.875 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:43.875 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019512+0000", 2024-04-26T10:44:43.876 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1611999999999999e-05 2024-04-26T10:44:43.876 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.876 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:43.876 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.876 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.876 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.876 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11911 4.37 4:ec04ab04:::100000031ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:43.876 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:43.876 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 14.472213231, 2024-04-26T10:44:43.876 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026810273999999999, 2024-04-26T10:44:43.876 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:43.876 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.876 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:43.876 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:43.876 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:43.876 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11911 2024-04-26T10:44:43.877 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.877 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:43.877 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.877 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:43.877 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:43.877 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.877 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.877 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.877 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:43.877 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:43.877 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.877 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.877 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.877 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:43.877 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336676+0000", 2024-04-26T10:44:43.878 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:43.878 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.878 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.878 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:43.878 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343119+0000", 2024-04-26T10:44:43.878 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0064424850000000004 2024-04-26T10:44:43.878 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.878 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.878 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:43.878 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343131+0000", 2024-04-26T10:44:43.878 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1708e-05 2024-04-26T10:44:43.878 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.878 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.878 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.879 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343137+0000", 2024-04-26T10:44:43.879 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9880000000000001e-06 2024-04-26T10:44:43.879 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.879 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.879 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:43.879 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343175+0000", 2024-04-26T10:44:43.879 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7913000000000001e-05 2024-04-26T10:44:43.879 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.879 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.879 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:43.879 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343269+0000", 2024-04-26T10:44:43.879 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4931000000000003e-05 2024-04-26T10:44:43.879 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.879 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.880 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:43.880 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343392+0000", 2024-04-26T10:44:43.880 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000122435 2024-04-26T10:44:43.880 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.880 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.880 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:43.880 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.347520+0000", 2024-04-26T10:44:43.880 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004128418 2024-04-26T10:44:43.880 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.880 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.880 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.880 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363410+0000", 2024-04-26T10:44:43.880 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.015889309000000001 2024-04-26T10:44:43.880 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.880 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.881 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:43.881 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363453+0000", 2024-04-26T10:44:43.881 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3244000000000001e-05 2024-04-26T10:44:43.881 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.881 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.881 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:43.881 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363488+0000", 2024-04-26T10:44:43.881 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5318000000000003e-05 2024-04-26T10:44:43.881 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.881 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:43.881 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.881 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.881 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.881 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12000 4.3c 4:3c2be35d:::100000030f7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:43.882 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:43.882 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 14.389591719, 2024-04-26T10:44:43.882 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022808264000000002, 2024-04-26T10:44:43.882 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:43.882 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.882 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:43.882 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:43.882 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:43.882 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12000 2024-04-26T10:44:43.882 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.882 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:43.882 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.882 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:43.883 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:43.883 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.883 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.883 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.883 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:43.883 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:43.883 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.883 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.883 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.883 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:43.883 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:43.883 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:43.883 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.884 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.884 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:43.884 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430937+0000", 2024-04-26T10:44:43.884 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.011638097 2024-04-26T10:44:43.884 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.884 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.884 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:43.884 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430948+0000", 2024-04-26T10:44:43.884 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0824e-05 2024-04-26T10:44:43.884 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.884 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.884 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.884 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430953+0000", 2024-04-26T10:44:43.885 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5219999999999998e-06 2024-04-26T10:44:43.885 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.885 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.885 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:43.885 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430990+0000", 2024-04-26T10:44:43.885 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6458999999999998e-05 2024-04-26T10:44:43.885 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.885 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.885 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:43.885 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.431052+0000", 2024-04-26T10:44:43.885 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2687000000000005e-05 2024-04-26T10:44:43.885 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.885 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.885 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:43.886 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442027+0000", 2024-04-26T10:44:43.886 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010974513 2024-04-26T10:44:43.886 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.886 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.886 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:43.886 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442060+0000", 2024-04-26T10:44:43.886 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2849999999999999e-05 2024-04-26T10:44:43.886 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.886 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.886 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:43.886 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442108+0000", 2024-04-26T10:44:43.886 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8031999999999997e-05 2024-04-26T10:44:43.886 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.886 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:43.887 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.887 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.887 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.887 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12042 4.2f 4:f741970f:::10000003414.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:43.887 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:43.887 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 14.350338241999999, 2024-04-26T10:44:43.887 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.029390757, 2024-04-26T10:44:43.887 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:43.887 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.887 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:43.887 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:43.887 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:43.887 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12042 2024-04-26T10:44:43.887 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.887 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:43.887 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.888 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:43.888 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:43.888 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.888 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.888 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.888 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:43.888 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:43.888 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.888 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.888 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.888 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:43.888 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458552+0000", 2024-04-26T10:44:43.888 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:43.888 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.889 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.889 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:43.889 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464335+0000", 2024-04-26T10:44:43.889 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.005783168 2024-04-26T10:44:43.889 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.889 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.889 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:43.889 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464347+0000", 2024-04-26T10:44:43.889 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1578e-05 2024-04-26T10:44:43.889 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.889 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.889 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.889 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464353+0000", 2024-04-26T10:44:43.889 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3709999999999996e-06 2024-04-26T10:44:43.889 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.889 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.890 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:43.890 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464407+0000", 2024-04-26T10:44:43.890 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3717000000000001e-05 2024-04-26T10:44:43.890 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.890 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.890 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:43.890 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464556+0000", 2024-04-26T10:44:43.890 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014899100000000001 2024-04-26T10:44:43.890 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.890 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.890 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:43.890 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464688+0000", 2024-04-26T10:44:43.890 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013238599999999999 2024-04-26T10:44:43.890 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.891 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.891 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:43.891 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.469725+0000", 2024-04-26T10:44:43.891 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0050369229999999996 2024-04-26T10:44:43.891 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.891 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.891 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.891 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487892+0000", 2024-04-26T10:44:43.891 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018167184999999999 2024-04-26T10:44:43.891 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.891 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.891 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:43.891 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487922+0000", 2024-04-26T10:44:43.892 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.9495000000000001e-05 2024-04-26T10:44:43.892 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.892 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.892 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:43.892 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487944+0000", 2024-04-26T10:44:43.892 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1823000000000001e-05 2024-04-26T10:44:43.892 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.892 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:43.892 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.892 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.892 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.892 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12050 4.2c 4:36b72e58:::100000031ba.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:43.892 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:43.892 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 14.341797633000001, 2024-04-26T10:44:43.892 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022722497000000001, 2024-04-26T10:44:43.893 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:43.893 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.893 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:43.893 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:43.893 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:43.893 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12050 2024-04-26T10:44:43.893 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.893 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:43.893 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.893 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:43.893 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:43.894 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.894 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.894 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.894 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:43.894 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:43.894 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.894 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.894 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.894 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:43.894 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467093+0000", 2024-04-26T10:44:43.894 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:43.894 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.894 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.895 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:43.895 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476305+0000", 2024-04-26T10:44:43.895 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092125850000000006 2024-04-26T10:44:43.895 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.895 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.895 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:43.895 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476322+0000", 2024-04-26T10:44:43.895 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6860000000000001e-05 2024-04-26T10:44:43.895 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.895 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.895 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.895 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476328+0000", 2024-04-26T10:44:43.895 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.587e-06 2024-04-26T10:44:43.896 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.896 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.896 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:43.896 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476378+0000", 2024-04-26T10:44:43.896 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0519999999999997e-05 2024-04-26T10:44:43.896 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.896 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.896 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:43.896 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476474+0000", 2024-04-26T10:44:43.896 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5556000000000005e-05 2024-04-26T10:44:43.896 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.896 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.896 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:43.896 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489677+0000", 2024-04-26T10:44:43.897 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013203048 2024-04-26T10:44:43.897 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.897 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.897 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:43.897 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489722+0000", 2024-04-26T10:44:43.897 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4650000000000001e-05 2024-04-26T10:44:43.897 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.897 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.897 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:43.897 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489816+0000", 2024-04-26T10:44:43.897 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4402999999999997e-05 2024-04-26T10:44:43.897 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.897 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:43.898 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.898 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.898 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.898 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12516 4.37 4:ed0cb515:::10000003324.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:43.898 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:43.898 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 13.821716068000001, 2024-04-26T10:44:43.898 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.030139677, 2024-04-26T10:44:43.898 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:43.898 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.898 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:43.898 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:43.898 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:43.898 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12516 2024-04-26T10:44:43.899 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.899 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:43.899 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.899 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:43.899 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:43.899 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.899 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.899 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.899 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:43.899 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:43.899 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.899 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.900 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.900 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:43.900 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987173+0000", 2024-04-26T10:44:43.900 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:43.900 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.900 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.900 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:43.900 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991339+0000", 2024-04-26T10:44:43.900 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0041663760000000003 2024-04-26T10:44:43.900 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.900 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.900 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:43.900 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991351+0000", 2024-04-26T10:44:43.900 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1333e-05 2024-04-26T10:44:43.900 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.901 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.901 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.901 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991357+0000", 2024-04-26T10:44:43.901 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3350000000000003e-06 2024-04-26T10:44:43.901 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.901 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.901 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:43.901 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991394+0000", 2024-04-26T10:44:43.901 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7054000000000001e-05 2024-04-26T10:44:43.901 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.901 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.901 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:43.901 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991495+0000", 2024-04-26T10:44:43.901 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000100386 2024-04-26T10:44:43.901 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.902 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.902 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:43.902 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991579+0000", 2024-04-26T10:44:43.902 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4295000000000005e-05 2024-04-26T10:44:43.902 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.902 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.902 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:43.902 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.996238+0000", 2024-04-26T10:44:43.902 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0046589309999999998 2024-04-26T10:44:43.902 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.902 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.902 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.902 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017237+0000", 2024-04-26T10:44:43.902 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020998993000000001 2024-04-26T10:44:43.903 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.903 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.903 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:43.903 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017280+0000", 2024-04-26T10:44:43.903 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3600000000000003e-05 2024-04-26T10:44:43.903 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.903 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.903 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:43.903 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017315+0000", 2024-04-26T10:44:43.903 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4381999999999997e-05 2024-04-26T10:44:43.903 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.903 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:43.903 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.903 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.903 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.904 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12644 4.37 4:ec5044d7:::100000032d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:43.904 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:43.904 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 13.64804324, 2024-04-26T10:44:43.904 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.037018677, 2024-04-26T10:44:43.904 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:43.904 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.904 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:43.904 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:43.904 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:43.904 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12644 2024-04-26T10:44:43.904 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.904 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:43.904 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.904 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:43.904 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:43.904 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.905 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.905 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.905 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:43.905 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:43.905 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.905 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.905 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.905 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:43.905 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160847+0000", 2024-04-26T10:44:43.905 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:43.905 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.905 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.906 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:43.906 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170089+0000", 2024-04-26T10:44:43.906 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092424289999999999 2024-04-26T10:44:43.906 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.906 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.906 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:43.906 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170111+0000", 2024-04-26T10:44:43.906 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1733e-05 2024-04-26T10:44:43.906 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.906 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.906 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.906 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170124+0000", 2024-04-26T10:44:43.906 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.272e-05 2024-04-26T10:44:43.906 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.907 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.907 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:43.907 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170177+0000", 2024-04-26T10:44:43.907 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3745000000000001e-05 2024-04-26T10:44:43.907 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.907 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.907 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:43.907 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170350+0000", 2024-04-26T10:44:43.907 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017297699999999999 2024-04-26T10:44:43.907 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.907 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.907 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:43.907 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170458+0000", 2024-04-26T10:44:43.907 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000107583 2024-04-26T10:44:43.908 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.908 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.908 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:43.908 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.176693+0000", 2024-04-26T10:44:43.908 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062351799999999999 2024-04-26T10:44:43.908 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.908 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.908 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.908 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197774+0000", 2024-04-26T10:44:43.908 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021080471999999999 2024-04-26T10:44:43.908 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.908 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.908 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:43.909 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197824+0000", 2024-04-26T10:44:43.909 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0096000000000003e-05 2024-04-26T10:44:43.909 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.909 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.909 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:43.909 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197867+0000", 2024-04-26T10:44:43.909 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2882e-05 2024-04-26T10:44:43.909 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.909 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:43.909 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.909 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.909 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.909 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:13242 4.2f 4:f5e54bb5:::100000033c8.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:43.909 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:43.910 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 12.969812102000001, 2024-04-26T10:44:43.910 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023873062, 2024-04-26T10:44:43.910 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:43.910 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:43.910 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:43.910 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:43.910 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:43.910 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 13242 2024-04-26T10:44:43.910 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.910 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:43.910 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.910 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:43.910 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:43.910 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.911 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.911 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.911 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:43.911 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:43.911 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:43.911 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.911 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.911 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:43.911 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839078+0000", 2024-04-26T10:44:43.911 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:43.911 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.911 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.911 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:43.911 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848098+0000", 2024-04-26T10:44:43.911 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090200750000000007 2024-04-26T10:44:43.911 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.912 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.912 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:43.912 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848108+0000", 2024-04-26T10:44:43.912 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.062e-05 2024-04-26T10:44:43.912 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.912 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.912 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:43.912 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848115+0000", 2024-04-26T10:44:43.912 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3040000000000001e-06 2024-04-26T10:44:43.912 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.912 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.912 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:43.912 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848157+0000", 2024-04-26T10:44:43.912 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2533000000000001e-05 2024-04-26T10:44:43.912 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.912 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.912 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:43.913 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848252+0000", 2024-04-26T10:44:43.913 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4480000000000003e-05 2024-04-26T10:44:43.913 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.913 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.913 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:43.913 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848393+0000", 2024-04-26T10:44:43.913 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000140863 2024-04-26T10:44:43.913 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.913 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.913 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:43.913 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.854434+0000", 2024-04-26T10:44:43.913 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060415590000000002 2024-04-26T10:44:43.913 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.913 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.913 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:43.913 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862894+0000", 2024-04-26T10:44:43.914 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0084598869999999993 2024-04-26T10:44:43.914 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.914 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.914 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:43.914 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862926+0000", 2024-04-26T10:44:43.914 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1473999999999997e-05 2024-04-26T10:44:43.914 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:43.914 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:43.914 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:43.914 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862952+0000", 2024-04-26T10:44:43.914 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6545000000000001e-05 2024-04-26T10:44:43.914 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.914 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:43.914 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.914 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:43.914 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:43.915 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:43.916 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:43.917 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:43.914+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:44.017 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:44.015+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:44.026 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:44.027 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:44.027 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:44:44.027 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:44.036 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:44.087 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:44:44.121 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:44.119+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:44.205 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:44.205 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:44.205 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:44.205 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:44.205 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:44.218 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~88s 2024-04-26T10:44:44.218 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:44.217+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:44.220 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:44.227 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:44.227 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:44.227 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:44.248 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:44.248 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:44.251 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:44.252 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:44.287 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-26T10:44:44.288 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-26T10:44:44.319 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:44.317+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:44.388 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:44.388 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:44.397 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:44.438 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:44.436+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:44.499 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:44.499 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:44.508 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:44.552 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:44.550+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:44.608 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:44.609 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:44.618 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:44.636 DEBUG:teuthology.parallel:result is None 2024-04-26T10:44:44.636 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T10:44:44.659 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:44.657+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:44.663 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T10:44:44.664 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-26T10:44:44.675 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-26T10:44:44.675 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-04-26T10:44:44.675 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T10:44:44.720 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-04-26T10:44:44.720 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T10:44:44.723 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:44.722+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:44.761 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:44.761 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:44.769 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:44.778 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:44:44.824 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:44.822+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:44.877 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:44.877 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:44.886 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:44.925 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:44.924+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:44.991 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:44.991 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:45.000 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:45.043 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:45.041+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:45.105 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:45.105 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:45.111 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:44:45.111 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":62,"fsid":"9837de44-a9e8-4979-adc4-611f3ddc44ce","created":"2024-04-26T10:42:11.337159+0000","modified":"2024-04-26T10:44:43.682266+0000","last_up_change":"2024-04-26T10:43:10.777788+0000","last_in_change":"2024-04-26T10:42:12.136647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:42:19.632084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":3.0299999713897705,"score_stable":3.0299999713897705,"optimal_score":0.33000001311302185,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:42:19.779089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8700000047683716,"score_stable":1.8700000047683716,"optimal_score":0.67000001668930054,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:42:24.266614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.2400000095367432,"score_stable":2.2400000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:42:25.014684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2.3299999237060547,"score_stable":2.3299999237060547,"optimal_score":0.67000001668930054,"raw_score_acting":1.559999942779541,"raw_score_stable":1.559999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eabed31c-c043-43de-a756-e217d5287116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":28839},{"type":"v1","addr":"172.21.15.60:6801","nonce":28839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":28839},{"type":"v1","addr":"172.21.15.60:6803","nonce":28839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":28839},{"type":"v1","addr":"172.21.15.60:6807","nonce":28839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":28839},{"type":"v1","addr":"172.21.15.60:6805","nonce":28839}]},"public_addr":"172.21.15.60:6801/28839","cluster_addr":"172.21.15.60:6803/28839","heartbeat_back_addr":"172.21.15.60:6807/28839","heartbeat_front_addr":"172.21.15.60:6805/28839","state":["exists","up"]},{"osd":1,"uuid":"7013621f-db09-4096-bc24-428bb170edd1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":28598},{"type":"v1","addr":"172.21.15.87:6801","nonce":28598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":28598},{"type":"v1","addr":"172.21.15.87:6803","nonce":28598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":28598},{"type":"v1","addr":"172.21.15.87:6807","nonce":28598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":28598},{"type":"v1","addr":"172.21.15.87:6805","nonce":28598}]},"public_addr":"172.21.15.87:6801/28598","cluster_addr":"172.21.15.87:6803/28598","heartbeat_back_addr":"172.21.15.87:6807/28598","heartbeat_front_addr":"172.21.15.87:6805/28598","state":["exists"]},{"osd":2,"uuid":"a1efeadd-cf55-4ed5-9918-36607fd62229","up":1,"in":1,"weight":0.5399627685546875,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":28733},{"type":"v1","addr":"172.21.15.195:6801","nonce":28733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":28733},{"type":"v1","addr":"172.21.15.195:6803","nonce":28733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":28733},{"type":"v1","addr":"172.21.15.195:6807","nonce":28733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":28733},{"type":"v1","addr":"172.21.15.195:6805","nonce":28733}]},"public_addr":"172.21.15.195:6801/28733","cluster_addr":"172.21.15.195:6803/28733","heartbeat_back_addr":"172.21.15.195:6807/28733","heartbeat_front_addr":"172.21.15.195:6805/28733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.152046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.177399+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.123066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":0,"to":1}]},{"pgid":"4.6","mappings":[{"from":0,"to":1}]},{"pgid":"4.12","mappings":[{"from":2,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"2.1","osds":[0,2]},{"pgid":"2.5","osds":[0,2]},{"pgid":"2.6","osds":[0,2]},{"pgid":"3.1","osds":[0,2]},{"pgid":"3.4","osds":[0,2]},{"pgid":"3.6","osds":[0,2]},{"pgid":"3.7","osds":[0,2]},{"pgid":"3.8","osds":[0,2]},{"pgid":"3.b","osds":[0,2]},{"pgid":"3.16","osds":[0,2]},{"pgid":"3.17","osds":[0,2]},{"pgid":"3.19","osds":[0,2]},{"pgid":"3.1c","osds":[0,2]},{"pgid":"3.1e","osds":[0,2]},{"pgid":"3.1f","osds":[0,2]},{"pgid":"4.0","osds":[0,2]},{"pgid":"4.4","osds":[0,2]},{"pgid":"4.6","osds":[0,2]},{"pgid":"4.7","osds":[0,2]},{"pgid":"4.9","osds":[0,2]},{"pgid":"4.a","osds":[0,2]},{"pgid":"4.b","osds":[0,2]},{"pgid":"4.c","osds":[0,2]},{"pgid":"4.f","osds":[0,2]},{"pgid":"4.10","osds":[0,2]},{"pgid":"4.12","osds":[0,2]},{"pgid":"4.1a","osds":[0,2]},{"pgid":"4.1b","osds":[0,2]},{"pgid":"4.1c","osds":[0,2]},{"pgid":"4.1e","osds":[0,2]},{"pgid":"4.21","osds":[0,2]},{"pgid":"4.23","osds":[0,2]},{"pgid":"4.28","osds":[0,2]},{"pgid":"4.29","osds":[0,2]},{"pgid":"4.2b","osds":[0,2]},{"pgid":"4.2d","osds":[0,2]},{"pgid":"4.2e","osds":[0,2]},{"pgid":"4.36","osds":[0,2]},{"pgid":"4.38","osds":[0,2]},{"pgid":"4.3e","osds":[0,2]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:44:45.114 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:45.125 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T10:42:19.632084+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T10:42:19.779089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.8700000047683716, 'score_stable': 1.8700000047683716, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T10:42:24.266614+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.240000009536743, 'score_stable': 2.240000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T10:42:25.014684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2.3299999237060547, 'score_stable': 2.3299999237060547, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.559999942779541, 'raw_score_stable': 1.559999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T10:44:45.125 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T10:44:45.158 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:45.157+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:45.228 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:45.226+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:45.249 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:45.250 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:45.264 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:45.349 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:45.347+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:45.406 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:45.406 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:45.415 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:45.427 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-04-26T10:44:45.441 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T10:44:45.456 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:45.454+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:45.531 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:45.529+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:45.556 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:45.556 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:45.564 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:45.631 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:45.630+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:45.673 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:45.673 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:45.682 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:45.704 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:44:45.732 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:45.731+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:45.738 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-04-26T10:44:45.752 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T10:44:45.788 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:45.788 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:45.796 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:45.833 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:45.832+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:45.901 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:45.902 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:45.911 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:45.934 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:45.933+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:46.012 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:46.013 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:46.021 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:46.036 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:46.035+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:46.092 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-04-26T10:44:46.106 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T10:44:46.122 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:46.122 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:46.130 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:46.136 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:46.135+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:46.238 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:46.235+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:46.253 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:44:46.263 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:46.263 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:46.272 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:46.338 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:46.336+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:46.377 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:46.377 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:46.378 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:46.378 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:46.378 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:46.378 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:44:46.379 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:46.387 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:46.396 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:46.396 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:46.399 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:46.399 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:46.409 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-04-26T10:44:46.422 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T10:44:46.438 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:46.437+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:46.534 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:46.534 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:46.534 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:46.534 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:46.534 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:46.539 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:46.537+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:46.542 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:46.641 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:46.639+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:46.690 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:46.690 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:46.690 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:46.690 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:46.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.691 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:80 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:46.691 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:46.691 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.165561987, 2024-04-26T10:44:46.691 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029259192, 2024-04-26T10:44:46.691 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:46.691 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:46.691 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:46.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.691 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:46.691 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:46.691 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.692 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:46.692 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:46.692 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.692 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:46.692 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522252+0000", 2024-04-26T10:44:46.692 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:46.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.692 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:46.692 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523121+0000", 2024-04-26T10:44:46.692 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00086885100000000002 2024-04-26T10:44:46.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.693 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:46.693 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523133+0000", 2024-04-26T10:44:46.693 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2109999999999999e-05 2024-04-26T10:44:46.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.693 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:46.693 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523139+0000", 2024-04-26T10:44:46.693 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.541e-06 2024-04-26T10:44:46.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.693 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:46.693 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523176+0000", 2024-04-26T10:44:46.693 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6847999999999997e-05 2024-04-26T10:44:46.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.694 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:46.694 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523240+0000", 2024-04-26T10:44:46.694 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3941000000000003e-05 2024-04-26T10:44:46.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.694 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:46.694 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.536390+0000", 2024-04-26T10:44:46.694 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013150811 2024-04-26T10:44:46.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.694 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:46.694 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551071+0000", 2024-04-26T10:44:46.695 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014680021 2024-04-26T10:44:46.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.695 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:46.695 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551428+0000", 2024-04-26T10:44:46.695 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00035703900000000002 2024-04-26T10:44:46.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.695 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:46.695 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551462+0000", 2024-04-26T10:44:46.695 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4337e-05 2024-04-26T10:44:46.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.696 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:46.696 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551513+0000", 2024-04-26T10:44:46.696 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0875000000000003e-05 2024-04-26T10:44:46.696 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.696 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:46.696 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.696 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:129 3.1a 3:5e41ab69:::200.00000005:head [write 3557843~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:46.696 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:46.696 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.161503917000001, 2024-04-26T10:44:46.696 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029108253000000001, 2024-04-26T10:44:46.696 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:46.697 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:46.697 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:46.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.697 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:46.697 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:46.697 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.698 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:46.698 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:46.698 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.698 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:46.698 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526311+0000", 2024-04-26T10:44:46.698 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:46.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.698 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:46.698 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526315+0000", 2024-04-26T10:44:46.698 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4809999999999998e-06 2024-04-26T10:44:46.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.699 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:46.699 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526319+0000", 2024-04-26T10:44:46.699 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0690000000000003e-06 2024-04-26T10:44:46.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.699 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:46.699 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526321+0000", 2024-04-26T10:44:46.699 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4880000000000001e-06 2024-04-26T10:44:46.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.699 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:46.699 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553856+0000", 2024-04-26T10:44:46.700 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027534916 2024-04-26T10:44:46.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.700 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:46.700 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553900+0000", 2024-04-26T10:44:46.700 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3954e-05 2024-04-26T10:44:46.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.700 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:46.700 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553962+0000", 2024-04-26T10:44:46.700 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1519000000000005e-05 2024-04-26T10:44:46.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.700 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:46.700 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555348+0000", 2024-04-26T10:44:46.701 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013864579999999999 2024-04-26T10:44:46.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.701 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:46.701 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555378+0000", 2024-04-26T10:44:46.701 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9441000000000002e-05 2024-04-26T10:44:46.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.701 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:46.701 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555401+0000", 2024-04-26T10:44:46.701 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2815000000000001e-05 2024-04-26T10:44:46.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.702 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:46.702 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555420+0000", 2024-04-26T10:44:46.702 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9341e-05 2024-04-26T10:44:46.702 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.702 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:46.702 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.702 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:130 3.1a 3:5e41ab69:::200.00000005:head [write 3559243~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:46.702 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:46.703 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.161492081999999, 2024-04-26T10:44:46.703 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029188316999999998, 2024-04-26T10:44:46.703 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:46.703 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:46.703 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:46.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.703 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:46.703 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:46.703 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.703 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:46.703 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:46.703 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.704 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:46.704 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:46.704 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:46.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.704 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:46.704 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526325+0000", 2024-04-26T10:44:46.704 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4899999999999999e-06 2024-04-26T10:44:46.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.704 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:46.704 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526327+0000", 2024-04-26T10:44:46.704 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.745e-06 2024-04-26T10:44:46.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.705 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:46.705 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526330+0000", 2024-04-26T10:44:46.705 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5620000000000002e-06 2024-04-26T10:44:46.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.705 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:46.705 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554200+0000", 2024-04-26T10:44:46.705 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027869541000000001 2024-04-26T10:44:46.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.705 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:46.705 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554244+0000", 2024-04-26T10:44:46.706 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4464e-05 2024-04-26T10:44:46.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.706 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:46.706 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554304+0000", 2024-04-26T10:44:46.706 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9457999999999999e-05 2024-04-26T10:44:46.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.706 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:46.706 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555453+0000", 2024-04-26T10:44:46.706 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011494000000000001 2024-04-26T10:44:46.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.706 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:46.707 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555457+0000", 2024-04-26T10:44:46.707 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1779999999999996e-06 2024-04-26T10:44:46.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.707 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:46.707 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555480+0000", 2024-04-26T10:44:46.707 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2802e-05 2024-04-26T10:44:46.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.707 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:46.707 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555512+0000", 2024-04-26T10:44:46.707 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1885999999999999e-05 2024-04-26T10:44:46.707 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.707 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:46.708 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.708 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:131 3.1a 3:5e41ab69:::200.00000005:head [write 3560642~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:46.708 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:46.708 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.161483501999999, 2024-04-26T10:44:46.708 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029683102999999999, 2024-04-26T10:44:46.708 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:46.708 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:46.708 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:46.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.708 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:46.708 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:46.708 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.709 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:46.709 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:46.709 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.709 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:46.709 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:46.709 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:46.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.709 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:46.709 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526336+0000", 2024-04-26T10:44:46.709 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.681e-06 2024-04-26T10:44:46.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.710 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:46.710 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526338+0000", 2024-04-26T10:44:46.710 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8430000000000001e-06 2024-04-26T10:44:46.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.710 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:46.710 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526341+0000", 2024-04-26T10:44:46.710 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6180000000000002e-06 2024-04-26T10:44:46.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.710 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:46.710 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554745+0000", 2024-04-26T10:44:46.711 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028404088000000001 2024-04-26T10:44:46.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.711 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:46.711 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554788+0000", 2024-04-26T10:44:46.711 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2738999999999999e-05 2024-04-26T10:44:46.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.711 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:46.711 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554849+0000", 2024-04-26T10:44:46.711 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1362e-05 2024-04-26T10:44:46.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.711 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:46.712 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555963+0000", 2024-04-26T10:44:46.712 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001113597 2024-04-26T10:44:46.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.712 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:46.712 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555969+0000", 2024-04-26T10:44:46.712 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6900000000000003e-06 2024-04-26T10:44:46.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.712 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:46.712 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555995+0000", 2024-04-26T10:44:46.712 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5165999999999999e-05 2024-04-26T10:44:46.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.713 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:46.713 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556015+0000", 2024-04-26T10:44:46.713 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0522000000000001e-05 2024-04-26T10:44:46.713 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.713 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:46.713 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.713 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:132 3.1a 3:5e41ab69:::200.00000005:head [write 3562043~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:46.713 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:46.713 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.161463237, 2024-04-26T10:44:46.713 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030129895, 2024-04-26T10:44:46.713 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:46.713 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:46.713 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:46.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.714 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:46.714 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:46.714 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.714 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:46.714 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:46.714 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.714 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:46.714 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:46.714 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:46.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.715 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:46.715 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526354+0000", 2024-04-26T10:44:46.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8560000000000001e-06 2024-04-26T10:44:46.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.715 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:46.715 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526359+0000", 2024-04-26T10:44:46.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4700000000000001e-06 2024-04-26T10:44:46.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.715 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:46.715 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526365+0000", 2024-04-26T10:44:46.716 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2120000000000002e-06 2024-04-26T10:44:46.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:46.716 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555050+0000", 2024-04-26T10:44:46.716 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028685458 2024-04-26T10:44:46.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:46.716 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555093+0000", 2024-04-26T10:44:46.716 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3307999999999999e-05 2024-04-26T10:44:46.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:46.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555156+0000", 2024-04-26T10:44:46.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2396000000000004e-05 2024-04-26T10:44:46.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.717 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:46.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556052+0000", 2024-04-26T10:44:46.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00089650299999999999 2024-04-26T10:44:46.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.717 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:46.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556439+0000", 2024-04-26T10:44:46.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038647900000000001 2024-04-26T10:44:46.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.718 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:46.718 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556463+0000", 2024-04-26T10:44:46.718 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4071e-05 2024-04-26T10:44:46.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.718 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:46.718 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556482+0000", 2024-04-26T10:44:46.718 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9378999999999999e-05 2024-04-26T10:44:46.718 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.719 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:46.719 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.719 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 3563440~3660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:46.719 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:46.719 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.161446843, 2024-04-26T10:44:46.719 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030550738000000001, 2024-04-26T10:44:46.719 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:46.719 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:46.719 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:46.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.719 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:46.719 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:46.720 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.720 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:46.720 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:46.720 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.720 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:46.720 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526368+0000", 2024-04-26T10:44:46.720 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:46.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.720 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:46.720 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526375+0000", 2024-04-26T10:44:46.721 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7510000000000002e-06 2024-04-26T10:44:46.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.721 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:46.721 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526381+0000", 2024-04-26T10:44:46.721 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3929999999999996e-06 2024-04-26T10:44:46.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.721 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:46.721 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526387+0000", 2024-04-26T10:44:46.721 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.215e-06 2024-04-26T10:44:46.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.721 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:46.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555542+0000", 2024-04-26T10:44:46.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029154992000000001 2024-04-26T10:44:46.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:46.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555610+0000", 2024-04-26T10:44:46.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8610999999999998e-05 2024-04-26T10:44:46.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:46.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555681+0000", 2024-04-26T10:44:46.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1072e-05 2024-04-26T10:44:46.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.723 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:46.723 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556866+0000", 2024-04-26T10:44:46.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001184598 2024-04-26T10:44:46.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.723 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:46.723 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556872+0000", 2024-04-26T10:44:46.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.55e-06 2024-04-26T10:44:46.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.723 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:46.723 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556897+0000", 2024-04-26T10:44:46.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.516e-05 2024-04-26T10:44:46.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.724 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:46.724 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556919+0000", 2024-04-26T10:44:46.724 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1951e-05 2024-04-26T10:44:46.724 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.724 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:46.724 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.724 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.724 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:134 3.1a 3:5e41ab69:::200.00000005:head [write 3567100~2427 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:46.724 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:46.724 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.161413778, 2024-04-26T10:44:46.724 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031267445999999997, 2024-04-26T10:44:46.724 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:46.724 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:46.724 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:46.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.725 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:46.725 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:46.725 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.725 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:46.725 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:46.725 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.725 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:46.725 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526401+0000", 2024-04-26T10:44:46.725 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:46.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.726 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:46.726 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526408+0000", 2024-04-26T10:44:46.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7769999999999997e-06 2024-04-26T10:44:46.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.726 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:46.726 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526415+0000", 2024-04-26T10:44:46.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0720000000000002e-06 2024-04-26T10:44:46.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.726 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:46.726 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526421+0000", 2024-04-26T10:44:46.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9699999999999996e-06 2024-04-26T10:44:46.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:46.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556084+0000", 2024-04-26T10:44:46.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029662351999999999 2024-04-26T10:44:46.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:46.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556126+0000", 2024-04-26T10:44:46.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2385000000000002e-05 2024-04-26T10:44:46.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:46.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556186+0000", 2024-04-26T10:44:46.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9945999999999998e-05 2024-04-26T10:44:46.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:46.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557598+0000", 2024-04-26T10:44:46.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0014121559999999999 2024-04-26T10:44:46.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:46.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557626+0000", 2024-04-26T10:44:46.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7960999999999999e-05 2024-04-26T10:44:46.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:46.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557650+0000", 2024-04-26T10:44:46.729 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3969999999999999e-05 2024-04-26T10:44:46.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.729 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:46.729 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557669+0000", 2024-04-26T10:44:46.729 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9262e-05 2024-04-26T10:44:46.729 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.729 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:46.729 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.729 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:135 3.1a 3:5e41ab69:::200.00000005:head [write 3569527~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:46.729 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:46.729 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.161389512, 2024-04-26T10:44:46.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031322516000000002, 2024-04-26T10:44:46.730 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:46.730 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:46.730 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:46.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.730 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:46.730 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:46.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:46.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:46.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:46.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:46.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:46.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:46.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526429+0000", 2024-04-26T10:44:46.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0750000000000002e-06 2024-04-26T10:44:46.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.732 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:46.732 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526435+0000", 2024-04-26T10:44:46.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.263e-06 2024-04-26T10:44:46.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.732 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:46.732 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526442+0000", 2024-04-26T10:44:46.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1219999999999997e-06 2024-04-26T10:44:46.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.732 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:46.733 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556515+0000", 2024-04-26T10:44:46.733 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030073132999999998 2024-04-26T10:44:46.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.733 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:46.733 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556564+0000", 2024-04-26T10:44:46.733 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8871e-05 2024-04-26T10:44:46.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.733 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:46.733 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556625+0000", 2024-04-26T10:44:46.733 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1307000000000001e-05 2024-04-26T10:44:46.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.734 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:46.734 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557678+0000", 2024-04-26T10:44:46.734 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010523100000000001 2024-04-26T10:44:46.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.734 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:46.734 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557709+0000", 2024-04-26T10:44:46.734 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1748000000000002e-05 2024-04-26T10:44:46.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.734 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:46.734 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557732+0000", 2024-04-26T10:44:46.734 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2415000000000001e-05 2024-04-26T10:44:46.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.735 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:46.735 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557749+0000", 2024-04-26T10:44:46.735 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6736999999999999e-05 2024-04-26T10:44:46.735 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.735 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:46.735 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.735 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:136 3.1a 3:5e41ab69:::200.00000005:head [write 3571449~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:46.735 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:46.735 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.161368322000001, 2024-04-26T10:44:46.735 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032180937, 2024-04-26T10:44:46.736 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:46.736 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:46.736 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:46.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.736 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:46.736 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:46.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.736 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:46.736 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:46.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.737 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:46.737 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:46.737 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:46.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.737 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:46.737 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526455+0000", 2024-04-26T10:44:46.737 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6429999999999995e-06 2024-04-26T10:44:46.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.737 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:46.737 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526461+0000", 2024-04-26T10:44:46.737 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:46.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.738 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:46.738 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526467+0000", 2024-04-26T10:44:46.738 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4389999999999999e-06 2024-04-26T10:44:46.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.738 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:46.738 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556950+0000", 2024-04-26T10:44:46.738 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030483854000000001 2024-04-26T10:44:46.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.738 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:46.738 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556989+0000", 2024-04-26T10:44:46.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8415999999999999e-05 2024-04-26T10:44:46.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.739 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:46.739 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557051+0000", 2024-04-26T10:44:46.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2088999999999995e-05 2024-04-26T10:44:46.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.739 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:46.739 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558166+0000", 2024-04-26T10:44:46.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001114622 2024-04-26T10:44:46.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.740 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:46.740 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558584+0000", 2024-04-26T10:44:46.740 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000418033 2024-04-26T10:44:46.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.740 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:46.740 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558609+0000", 2024-04-26T10:44:46.740 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5344999999999999e-05 2024-04-26T10:44:46.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.740 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:46.740 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558628+0000", 2024-04-26T10:44:46.740 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9273999999999999e-05 2024-04-26T10:44:46.740 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.741 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:46.741 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.741 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:137 3.1a 3:5e41ab69:::200.00000005:head [write 3573699~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:46.741 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:46.741 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.161344672999999, 2024-04-26T10:44:46.741 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032241530999999997, 2024-04-26T10:44:46.741 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:46.741 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:46.741 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:46.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.741 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:46.741 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:46.741 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.742 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:46.742 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:46.743 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.743 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:46.743 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526470+0000", 2024-04-26T10:44:46.743 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:46.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.743 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:46.743 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526473+0000", 2024-04-26T10:44:46.743 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.818e-06 2024-04-26T10:44:46.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.744 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:46.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526480+0000", 2024-04-26T10:44:46.744 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4119999999999998e-06 2024-04-26T10:44:46.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.744 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:46.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526484+0000", 2024-04-26T10:44:46.744 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6840000000000004e-06 2024-04-26T10:44:46.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.745 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:46.745 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557323+0000", 2024-04-26T10:44:46.745 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030838956000000001 2024-04-26T10:44:46.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.745 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:46.745 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557362+0000", 2024-04-26T10:44:46.745 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8343999999999997e-05 2024-04-26T10:44:46.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.745 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:46.745 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557421+0000", 2024-04-26T10:44:46.745 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9176999999999999e-05 2024-04-26T10:44:46.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.746 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:46.746 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558636+0000", 2024-04-26T10:44:46.746 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012153789999999999 2024-04-26T10:44:46.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.746 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:46.746 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558668+0000", 2024-04-26T10:44:46.746 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1452999999999999e-05 2024-04-26T10:44:46.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.746 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:46.746 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558694+0000", 2024-04-26T10:44:46.746 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6288999999999999e-05 2024-04-26T10:44:46.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.747 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:46.747 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558712+0000", 2024-04-26T10:44:46.747 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8459000000000001e-05 2024-04-26T10:44:46.747 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.747 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:46.747 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.747 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:138 3.1a 3:5e41ab69:::200.00000005:head [write 3575103~4205 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:46.747 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:46.747 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.161327354000001, 2024-04-26T10:44:46.747 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032665567999999999, 2024-04-26T10:44:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.748 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526495+0000", 2024-04-26T10:44:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7580000000000003e-06 2024-04-26T10:44:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526501+0000", 2024-04-26T10:44:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1680000000000001e-06 2024-04-26T10:44:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526505+0000", 2024-04-26T10:44:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.673e-06 2024-04-26T10:44:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557781+0000", 2024-04-26T10:44:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031275718000000001 2024-04-26T10:44:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557825+0000", 2024-04-26T10:44:46.750 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4048000000000002e-05 2024-04-26T10:44:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557888+0000", 2024-04-26T10:44:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2562000000000002e-05 2024-04-26T10:44:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559073+0000", 2024-04-26T10:44:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011852239999999999 2024-04-26T10:44:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559112+0000", 2024-04-26T10:44:46.751 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9226e-05 2024-04-26T10:44:46.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.752 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:46.752 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559136+0000", 2024-04-26T10:44:46.752 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3966000000000001e-05 2024-04-26T10:44:46.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.752 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:46.752 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559154+0000", 2024-04-26T10:44:46.752 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7575e-05 2024-04-26T10:44:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:139 3.1a 3:5e41ab69:::200.00000005:head [write 3579308~2255 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.161305735999999, 2024-04-26T10:44:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033424720999999998, 2024-04-26T10:44:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.753 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526509+0000", 2024-04-26T10:44:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526516+0000", 2024-04-26T10:44:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5209999999999999e-06 2024-04-26T10:44:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526522+0000", 2024-04-26T10:44:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1229999999999997e-06 2024-04-26T10:44:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526527+0000", 2024-04-26T10:44:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7849999999999999e-06 2024-04-26T10:44:46.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558194+0000", 2024-04-26T10:44:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031667419000000002 2024-04-26T10:44:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558234+0000", 2024-04-26T10:44:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9774999999999998e-05 2024-04-26T10:44:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558294+0000", 2024-04-26T10:44:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0242999999999999e-05 2024-04-26T10:44:46.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559106+0000", 2024-04-26T10:44:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00081148099999999996 2024-04-26T10:44:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559890+0000", 2024-04-26T10:44:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00078439999999999998 2024-04-26T10:44:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559917+0000", 2024-04-26T10:44:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7044000000000001e-05 2024-04-26T10:44:46.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559935+0000", 2024-04-26T10:44:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7448e-05 2024-04-26T10:44:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:140 3.1a 3:5e41ab69:::200.00000005:head [write 3581563~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.161284315, 2024-04-26T10:44:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033867728, 2024-04-26T10:44:46.758 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526538+0000", 2024-04-26T10:44:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.905e-06 2024-04-26T10:44:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.760 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526542+0000", 2024-04-26T10:44:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9550000000000002e-06 2024-04-26T10:44:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526545+0000", 2024-04-26T10:44:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8499999999999998e-06 2024-04-26T10:44:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558744+0000", 2024-04-26T10:44:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032198986999999998 2024-04-26T10:44:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.761 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:46.762 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558788+0000", 2024-04-26T10:44:46.762 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4365e-05 2024-04-26T10:44:46.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.762 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.762 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:46.762 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558854+0000", 2024-04-26T10:44:46.762 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5952999999999997e-05 2024-04-26T10:44:46.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.762 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.762 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:46.762 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559971+0000", 2024-04-26T10:44:46.762 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011172770000000001 2024-04-26T10:44:46.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.763 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:46.763 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560354+0000", 2024-04-26T10:44:46.763 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038267599999999998 2024-04-26T10:44:46.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.763 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:46.763 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560380+0000", 2024-04-26T10:44:46.763 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6140999999999999e-05 2024-04-26T10:44:46.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.763 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:46.763 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560399+0000", 2024-04-26T10:44:46.764 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9032999999999999e-05 2024-04-26T10:44:46.764 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.764 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:46.764 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.764 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.764 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:141 3.1a 3:5e41ab69:::200.00000005:head [write 3583482~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:46.764 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:46.764 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.161268656000001, 2024-04-26T10:44:46.764 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034316301, 2024-04-26T10:44:46.764 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:46.764 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:46.764 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:46.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.765 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:46.765 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:46.765 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.765 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:46.765 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:46.765 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.765 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:46.765 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:46.765 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:46.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.766 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:46.766 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526548+0000", 2024-04-26T10:44:46.766 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.739e-06 2024-04-26T10:44:46.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.766 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:46.766 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526551+0000", 2024-04-26T10:44:46.766 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.044e-06 2024-04-26T10:44:46.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.766 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:46.766 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526562+0000", 2024-04-26T10:44:46.767 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0370000000000001e-05 2024-04-26T10:44:46.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.767 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:46.767 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559179+0000", 2024-04-26T10:44:46.767 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032617444000000002 2024-04-26T10:44:46.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.767 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:46.767 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559220+0000", 2024-04-26T10:44:46.767 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0364999999999997e-05 2024-04-26T10:44:46.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.767 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:46.768 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559280+0000", 2024-04-26T10:44:46.768 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0569000000000002e-05 2024-04-26T10:44:46.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.768 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:46.768 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560814+0000", 2024-04-26T10:44:46.768 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015337580000000001 2024-04-26T10:44:46.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.768 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:46.768 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560820+0000", 2024-04-26T10:44:46.768 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.455e-06 2024-04-26T10:44:46.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.768 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:46.769 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560846+0000", 2024-04-26T10:44:46.769 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5228999999999998e-05 2024-04-26T10:44:46.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.769 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:46.769 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560863+0000", 2024-04-26T10:44:46.769 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7555e-05 2024-04-26T10:44:46.769 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.769 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:46.769 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.769 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:142 3.1a 3:5e41ab69:::200.00000005:head [write 3585931~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:46.769 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:46.770 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.161248259000001, 2024-04-26T10:44:46.770 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034372373999999997, 2024-04-26T10:44:46.770 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:46.770 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:46.770 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:46.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.770 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:46.770 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:46.770 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.770 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:46.770 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:46.770 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.771 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:46.771 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:46.771 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:46.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.771 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:46.771 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526573+0000", 2024-04-26T10:44:46.771 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0800000000000002e-06 2024-04-26T10:44:46.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.771 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:46.771 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526580+0000", 2024-04-26T10:44:46.771 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5799999999999997e-06 2024-04-26T10:44:46.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.772 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:46.772 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526585+0000", 2024-04-26T10:44:46.772 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2270000000000001e-06 2024-04-26T10:44:46.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.772 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:46.772 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559601+0000", 2024-04-26T10:44:46.772 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033016684999999997 2024-04-26T10:44:46.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.772 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:46.772 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559642+0000", 2024-04-26T10:44:46.773 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0321000000000002e-05 2024-04-26T10:44:46.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.773 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:46.773 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559706+0000", 2024-04-26T10:44:46.773 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4228999999999998e-05 2024-04-26T10:44:46.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.773 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:46.773 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560871+0000", 2024-04-26T10:44:46.773 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001164893 2024-04-26T10:44:46.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.773 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:46.774 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560899+0000", 2024-04-26T10:44:46.774 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:46.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.774 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:46.774 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560922+0000", 2024-04-26T10:44:46.774 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3337999999999999e-05 2024-04-26T10:44:46.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.774 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:46.774 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560940+0000", 2024-04-26T10:44:46.774 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7289999999999999e-05 2024-04-26T10:44:46.774 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.775 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:46.775 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.775 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:143 3.1a 3:5e41ab69:::200.00000005:head [write 3587331~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:46.775 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:46.775 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.161226361000001, 2024-04-26T10:44:46.775 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035256000000000003, 2024-04-26T10:44:46.775 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:46.775 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:46.775 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:46.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.775 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:46.776 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:46.776 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.776 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:46.776 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:46.776 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.776 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:46.776 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:46.776 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:46.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.777 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:46.777 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526592+0000", 2024-04-26T10:44:46.777 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2449999999999998e-06 2024-04-26T10:44:46.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.777 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:46.777 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526596+0000", 2024-04-26T10:44:46.777 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7000000000000002e-06 2024-04-26T10:44:46.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.777 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:46.777 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526599+0000", 2024-04-26T10:44:46.777 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6160000000000002e-06 2024-04-26T10:44:46.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.778 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:46.778 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559997+0000", 2024-04-26T10:44:46.778 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033397835000000001 2024-04-26T10:44:46.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.778 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:46.778 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560051+0000", 2024-04-26T10:44:46.778 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3742000000000001e-05 2024-04-26T10:44:46.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.778 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:46.778 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560112+0000", 2024-04-26T10:44:46.778 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0851999999999999e-05 2024-04-26T10:44:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561404+0000", 2024-04-26T10:44:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001291869 2024-04-26T10:44:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561797+0000", 2024-04-26T10:44:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039383000000000002 2024-04-26T10:44:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:46.779 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561827+0000", 2024-04-26T10:44:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9247e-05 2024-04-26T10:44:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561845+0000", 2024-04-26T10:44:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8462999999999999e-05 2024-04-26T10:44:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:144 3.1a 3:5e41ab69:::200.00000005:head [write 3588736~4987 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.161104069, 2024-04-26T10:44:46.780 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035224283000000002, 2024-04-26T10:44:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526718+0000", 2024-04-26T10:44:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.43e-06 2024-04-26T10:44:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526726+0000", 2024-04-26T10:44:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:44:46.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526729+0000", 2024-04-26T10:44:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6480000000000001e-06 2024-04-26T10:44:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560427+0000", 2024-04-26T10:44:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033697280000000003 2024-04-26T10:44:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560466+0000", 2024-04-26T10:44:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9606e-05 2024-04-26T10:44:46.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560525+0000", 2024-04-26T10:44:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9218000000000001e-05 2024-04-26T10:44:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561854+0000", 2024-04-26T10:44:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001328421 2024-04-26T10:44:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561887+0000", 2024-04-26T10:44:46.784 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2746000000000001e-05 2024-04-26T10:44:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561912+0000", 2024-04-26T10:44:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5126999999999998e-05 2024-04-26T10:44:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561936+0000", 2024-04-26T10:44:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4032999999999998e-05 2024-04-26T10:44:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:145 3.1a 3:5e41ab69:::200.00000005:head [write 3593723~2939 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.158185024000002, 2024-04-26T10:44:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033294394999999997, 2024-04-26T10:44:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.786 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529630+0000", 2024-04-26T10:44:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529635+0000", 2024-04-26T10:44:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7960000000000003e-06 2024-04-26T10:44:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:46.787 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529643+0000", 2024-04-26T10:44:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0390000000000005e-06 2024-04-26T10:44:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529648+0000", 2024-04-26T10:44:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9599999999999999e-06 2024-04-26T10:44:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560969+0000", 2024-04-26T10:44:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031321767 2024-04-26T10:44:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.788 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561009+0000", 2024-04-26T10:44:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9904999999999998e-05 2024-04-26T10:44:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561070+0000", 2024-04-26T10:44:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0708999999999998e-05 2024-04-26T10:44:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562352+0000", 2024-04-26T10:44:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012818440000000001 2024-04-26T10:44:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562867+0000", 2024-04-26T10:44:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000515665 2024-04-26T10:44:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562893+0000", 2024-04-26T10:44:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5469999999999998e-05 2024-04-26T10:44:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562925+0000", 2024-04-26T10:44:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1974999999999998e-05 2024-04-26T10:44:46.790 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:146 3.1a 3:5e41ab69:::200.00000005:head [write 3596662~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.157956810000002, 2024-04-26T10:44:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033178429000000002, 2024-04-26T10:44:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:46.791 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529858+0000", 2024-04-26T10:44:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.792 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529863+0000", 2024-04-26T10:44:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4500000000000003e-06 2024-04-26T10:44:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529874+0000", 2024-04-26T10:44:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0552e-05 2024-04-26T10:44:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529882+0000", 2024-04-26T10:44:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4449999999999996e-06 2024-04-26T10:44:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.793 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:46.794 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561452+0000", 2024-04-26T10:44:46.794 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031569680000000003 2024-04-26T10:44:46.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.794 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:46.794 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561511+0000", 2024-04-26T10:44:46.794 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9332e-05 2024-04-26T10:44:46.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.794 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:46.794 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561583+0000", 2024-04-26T10:44:46.794 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1730000000000006e-05 2024-04-26T10:44:46.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.795 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:46.795 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562933+0000", 2024-04-26T10:44:46.795 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013500059999999999 2024-04-26T10:44:46.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.795 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:46.795 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562976+0000", 2024-04-26T10:44:46.795 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2987e-05 2024-04-26T10:44:46.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.795 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:46.795 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563015+0000", 2024-04-26T10:44:46.795 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9453999999999999e-05 2024-04-26T10:44:46.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.796 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.796 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:46.796 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563037+0000", 2024-04-26T10:44:46.796 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1679e-05 2024-04-26T10:44:46.796 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.796 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:46.796 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.796 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.796 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:277 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:46.796 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:46.796 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 20.172946107000001, 2024-04-26T10:44:46.796 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030430563000000001, 2024-04-26T10:44:46.796 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:46.796 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:46.797 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:46.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.797 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:46.797 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:46.797 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.797 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:46.797 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:46.797 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:46.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.797 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:46.797 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514867+0000", 2024-04-26T10:44:46.797 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:46.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.798 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:46.798 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515460+0000", 2024-04-26T10:44:46.798 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00059285800000000004 2024-04-26T10:44:46.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.798 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:46.798 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515474+0000", 2024-04-26T10:44:46.798 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3933e-05 2024-04-26T10:44:46.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.799 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:46.799 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515481+0000", 2024-04-26T10:44:46.799 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:46.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.799 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:46.799 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515522+0000", 2024-04-26T10:44:46.799 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1369000000000003e-05 2024-04-26T10:44:46.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.799 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:46.799 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515591+0000", 2024-04-26T10:44:46.799 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9377999999999999e-05 2024-04-26T10:44:46.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.800 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:46.800 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.526440+0000", 2024-04-26T10:44:46.800 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010848837 2024-04-26T10:44:46.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.800 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:46.800 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.543866+0000", 2024-04-26T10:44:46.800 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017426288000000002 2024-04-26T10:44:46.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.800 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:46.800 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545193+0000", 2024-04-26T10:44:46.800 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001326111 2024-04-26T10:44:46.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.801 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:46.801 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545229+0000", 2024-04-26T10:44:46.801 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6390999999999998e-05 2024-04-26T10:44:46.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:46.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:46.801 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:46.801 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545300+0000", 2024-04-26T10:44:46.801 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1073000000000002e-05 2024-04-26T10:44:46.801 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.801 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:46.801 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.801 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:46.801 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:46.802 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:46.803 INFO:teuthology.orchestra.run.smithi049.stderr:noscrub is set 2024-04-26T10:44:46.804 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:46.805 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2024-04-26T10:44:46.805 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-04-26T10:44:46.805 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T10:44:46.806 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:46.802+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:46.821 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:44:46.904 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:46.903+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:46.908 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:46.908 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:46.908 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:44:46.908 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:46.917 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:47.005 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:47.003+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:47.018 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:47.018 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:47.018 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:47.018 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:47.018 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:47.026 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:47.105 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:47.104+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:47.130 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:47.130 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:47.130 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:47.130 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:47.130 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.130 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:330 3.13 3:ceffbd45:::200.0000000a:head [write 1316140~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:47.130 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:47.130 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 20.614703716000001, 2024-04-26T10:44:47.130 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022245654, 2024-04-26T10:44:47.130 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:47.131 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.131 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:47.131 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.131 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:47.131 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:47.131 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.131 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.131 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.131 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:47.131 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:47.131 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.131 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.131 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.131 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:47.131 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513139+0000", 2024-04-26T10:44:47.132 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:47.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.132 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.132 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:47.132 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513149+0000", 2024-04-26T10:44:47.132 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7550000000000006e-06 2024-04-26T10:44:47.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.132 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.132 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:47.132 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513157+0000", 2024-04-26T10:44:47.132 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1089999999999998e-06 2024-04-26T10:44:47.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.133 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.133 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513167+0000", 2024-04-26T10:44:47.133 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0539e-05 2024-04-26T10:44:47.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.133 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:47.133 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533830+0000", 2024-04-26T10:44:47.133 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020662852999999998 2024-04-26T10:44:47.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.133 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.133 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:47.133 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533875+0000", 2024-04-26T10:44:47.133 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.5071999999999998e-05 2024-04-26T10:44:47.134 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.134 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.134 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:47.134 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535319+0000", 2024-04-26T10:44:47.134 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001443578 2024-04-26T10:44:47.134 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.135 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.135 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:47.135 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535346+0000", 2024-04-26T10:44:47.135 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7415000000000001e-05 2024-04-26T10:44:47.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.135 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.135 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:47.135 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535385+0000", 2024-04-26T10:44:47.135 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8912999999999998e-05 2024-04-26T10:44:47.135 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.135 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:47.135 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.135 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.135 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:331 3.13 3:ceffbd45:::200.0000000a:head [write 1318049~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:47.136 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:47.136 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 20.614664388000001, 2024-04-26T10:44:47.136 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023524521, 2024-04-26T10:44:47.136 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:47.136 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.136 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:47.136 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.136 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:47.136 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:47.136 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.136 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.136 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.136 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:47.136 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:47.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.137 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.137 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.137 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:47.137 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513178+0000", 2024-04-26T10:44:47.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:47.137 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.137 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.137 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:47.137 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513183+0000", 2024-04-26T10:44:47.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2549999999999999e-06 2024-04-26T10:44:47.137 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.137 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.137 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:47.137 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513190+0000", 2024-04-26T10:44:47.137 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8460000000000002e-06 2024-04-26T10:44:47.138 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.138 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.138 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.138 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513195+0000", 2024-04-26T10:44:47.138 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3630000000000002e-06 2024-04-26T10:44:47.138 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.138 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.138 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:47.138 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534463+0000", 2024-04-26T10:44:47.138 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021267823000000002 2024-04-26T10:44:47.138 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.138 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.138 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:47.139 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534520+0000", 2024-04-26T10:44:47.139 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7510000000000003e-05 2024-04-26T10:44:47.139 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.139 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.139 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:47.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536634+0000", 2024-04-26T10:44:47.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0021138900000000002 2024-04-26T10:44:47.140 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.140 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.140 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:47.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536663+0000", 2024-04-26T10:44:47.140 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8884e-05 2024-04-26T10:44:47.140 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.140 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.140 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:47.140 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536703+0000", 2024-04-26T10:44:47.141 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0479000000000003e-05 2024-04-26T10:44:47.141 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.141 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:47.141 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.141 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.141 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.141 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:332 3.13 3:ceffbd45:::200.0000000a:head [write 1319462~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:47.141 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:47.141 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 20.614629555, 2024-04-26T10:44:47.141 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024543230999999999, 2024-04-26T10:44:47.141 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:47.141 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.141 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:47.141 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.141 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:47.142 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:47.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.142 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.142 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.142 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:47.142 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:47.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.142 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.142 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.142 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:47.142 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513213+0000", 2024-04-26T10:44:47.142 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:47.142 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.142 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:47.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513217+0000", 2024-04-26T10:44:47.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:44:47.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:47.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513229+0000", 2024-04-26T10:44:47.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2051e-05 2024-04-26T10:44:47.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.143 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513236+0000", 2024-04-26T10:44:47.143 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4470000000000003e-06 2024-04-26T10:44:47.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.143 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.143 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:47.144 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534891+0000", 2024-04-26T10:44:47.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021655863000000001 2024-04-26T10:44:47.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.144 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:47.144 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534933+0000", 2024-04-26T10:44:47.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1596e-05 2024-04-26T10:44:47.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.144 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:47.144 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537677+0000", 2024-04-26T10:44:47.144 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027440989999999998 2024-04-26T10:44:47.144 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.144 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.144 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:47.145 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537721+0000", 2024-04-26T10:44:47.145 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3813999999999998e-05 2024-04-26T10:44:47.145 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.145 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.145 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:47.145 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537757+0000", 2024-04-26T10:44:47.145 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6022999999999997e-05 2024-04-26T10:44:47.145 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.145 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:47.145 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.145 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.146 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.146 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:333 3.13 3:ceffbd45:::200.0000000a:head [write 1320870~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:47.146 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:47.146 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 20.614586635999999, 2024-04-26T10:44:47.146 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024557151999999999, 2024-04-26T10:44:47.146 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:47.146 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.146 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:47.146 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.146 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:47.146 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:47.146 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.146 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.146 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.146 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:47.147 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:47.147 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.147 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.147 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.147 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:47.147 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513256+0000", 2024-04-26T10:44:47.147 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:47.147 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.147 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.147 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:47.147 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513260+0000", 2024-04-26T10:44:47.147 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6550000000000002e-06 2024-04-26T10:44:47.147 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.147 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.147 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:47.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513273+0000", 2024-04-26T10:44:47.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2965e-05 2024-04-26T10:44:47.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513279+0000", 2024-04-26T10:44:47.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:44:47.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:47.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535411+0000", 2024-04-26T10:44:47.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022132233000000001 2024-04-26T10:44:47.148 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:47.149 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535479+0000", 2024-04-26T10:44:47.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7554999999999999e-05 2024-04-26T10:44:47.149 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.149 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:47.149 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537762+0000", 2024-04-26T10:44:47.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022836499999999999 2024-04-26T10:44:47.149 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.149 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:47.149 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537783+0000", 2024-04-26T10:44:47.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0364e-05 2024-04-26T10:44:47.149 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.149 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:47.150 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537814+0000", 2024-04-26T10:44:47.150 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1170000000000001e-05 2024-04-26T10:44:47.150 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.150 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:47.150 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.150 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.150 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.150 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:334 3.13 3:ceffbd45:::200.0000000a:head [write 1322273~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:47.150 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:47.150 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 20.612749876999999, 2024-04-26T10:44:47.150 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022778731999999999, 2024-04-26T10:44:47.150 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:47.150 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.150 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:47.151 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.151 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:47.151 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:47.151 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.151 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.151 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.151 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:47.151 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:47.151 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.151 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.151 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.151 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:47.151 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:47.151 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:47.151 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.152 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.152 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:47.152 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515099+0000", 2024-04-26T10:44:47.152 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6599999999999998e-06 2024-04-26T10:44:47.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.152 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.152 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:47.152 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515112+0000", 2024-04-26T10:44:47.152 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2707e-05 2024-04-26T10:44:47.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.152 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.152 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.152 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515120+0000", 2024-04-26T10:44:47.152 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8509999999999999e-06 2024-04-26T10:44:47.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:47.153 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535792+0000", 2024-04-26T10:44:47.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020672209 2024-04-26T10:44:47.153 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:47.153 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535833+0000", 2024-04-26T10:44:47.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1415000000000002e-05 2024-04-26T10:44:47.153 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:47.153 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537818+0000", 2024-04-26T10:44:47.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0019850900000000001 2024-04-26T10:44:47.153 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.154 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.154 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:47.154 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537839+0000", 2024-04-26T10:44:47.154 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0068000000000002e-05 2024-04-26T10:44:47.154 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.154 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.154 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:47.154 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537872+0000", 2024-04-26T10:44:47.154 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3680999999999998e-05 2024-04-26T10:44:47.154 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.154 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:47.154 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.154 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.154 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.154 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:335 3.13 3:ceffbd45:::200.0000000a:head [write 1325230~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:47.155 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:47.155 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 20.612710778, 2024-04-26T10:44:47.155 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023487081, 2024-04-26T10:44:47.155 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:47.155 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.155 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:47.155 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.155 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:47.155 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:47.155 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.155 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.155 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.155 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:47.155 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:47.155 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.156 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.156 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.156 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:47.156 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515132+0000", 2024-04-26T10:44:47.156 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:47.156 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.156 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.156 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:47.156 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515136+0000", 2024-04-26T10:44:47.156 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0860000000000004e-06 2024-04-26T10:44:47.156 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.156 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.156 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:47.156 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515143+0000", 2024-04-26T10:44:47.156 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.0400000000000004e-06 2024-04-26T10:44:47.157 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.157 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.157 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.157 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515149+0000", 2024-04-26T10:44:47.157 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0789999999999997e-06 2024-04-26T10:44:47.157 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.157 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.157 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:47.157 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536200+0000", 2024-04-26T10:44:47.157 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021050993 2024-04-26T10:44:47.157 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.157 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.157 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:47.157 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536253+0000", 2024-04-26T10:44:47.157 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.2643999999999999e-05 2024-04-26T10:44:47.158 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.158 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.158 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:47.158 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538560+0000", 2024-04-26T10:44:47.158 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0023073389999999998 2024-04-26T10:44:47.158 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.158 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.158 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:47.158 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538584+0000", 2024-04-26T10:44:47.158 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3893999999999999e-05 2024-04-26T10:44:47.158 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.158 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.158 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:47.158 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538620+0000", 2024-04-26T10:44:47.159 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5611000000000002e-05 2024-04-26T10:44:47.159 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.159 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:47.159 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.159 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.159 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.159 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:336 3.13 3:ceffbd45:::200.0000000a:head [write 1327147~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:47.159 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:47.159 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 20.611378323, 2024-04-26T10:44:47.159 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027687066, 2024-04-26T10:44:47.159 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:47.159 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.159 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:47.159 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.159 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:47.160 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:47.160 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.160 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.160 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.160 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:47.160 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:47.160 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.160 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.160 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.160 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:47.160 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516464+0000", 2024-04-26T10:44:47.160 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:47.160 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.160 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.160 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:47.161 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516491+0000", 2024-04-26T10:44:47.161 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6539000000000001e-05 2024-04-26T10:44:47.161 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.161 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.161 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:47.161 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516500+0000", 2024-04-26T10:44:47.161 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5480000000000007e-06 2024-04-26T10:44:47.161 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.161 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.161 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.161 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516511+0000", 2024-04-26T10:44:47.161 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0719e-05 2024-04-26T10:44:47.161 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.161 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.161 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:47.162 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536737+0000", 2024-04-26T10:44:47.162 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020225770000000001 2024-04-26T10:44:47.162 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.162 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.162 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:47.162 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536783+0000", 2024-04-26T10:44:47.162 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6168999999999998e-05 2024-04-26T10:44:47.162 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.162 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.162 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:47.162 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544080+0000", 2024-04-26T10:44:47.162 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0072966799999999998 2024-04-26T10:44:47.162 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.162 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.163 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:47.163 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544111+0000", 2024-04-26T10:44:47.163 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1056999999999998e-05 2024-04-26T10:44:47.163 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.163 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.163 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:47.163 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544152+0000", 2024-04-26T10:44:47.163 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1452000000000002e-05 2024-04-26T10:44:47.163 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.163 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:47.163 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.163 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.163 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.163 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:337 3.13 3:ceffbd45:::200.0000000a:head [write 1342136~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:47.163 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:47.164 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 20.611325385000001, 2024-04-26T10:44:47.164 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027711237, 2024-04-26T10:44:47.164 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:47.164 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.164 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:47.164 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.164 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:47.164 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:47.164 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.164 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.164 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.164 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:47.164 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:47.164 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.164 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.164 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.165 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:47.165 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516517+0000", 2024-04-26T10:44:47.165 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:47.165 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.165 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.165 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:47.165 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516521+0000", 2024-04-26T10:44:47.165 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6200000000000001e-06 2024-04-26T10:44:47.165 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.165 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.165 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:47.165 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516528+0000", 2024-04-26T10:44:47.165 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8639999999999998e-06 2024-04-26T10:44:47.165 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.165 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.166 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.166 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516533+0000", 2024-04-26T10:44:47.166 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6310000000000002e-06 2024-04-26T10:44:47.166 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.166 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.166 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:47.166 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537231+0000", 2024-04-26T10:44:47.166 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020698613000000001 2024-04-26T10:44:47.166 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.166 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.166 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:47.166 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537273+0000", 2024-04-26T10:44:47.166 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1529000000000002e-05 2024-04-26T10:44:47.166 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.167 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.167 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:47.167 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544157+0000", 2024-04-26T10:44:47.167 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068847090000000001 2024-04-26T10:44:47.167 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.167 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.167 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:47.167 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544180+0000", 2024-04-26T10:44:47.167 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.2532e-05 2024-04-26T10:44:47.167 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.167 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.167 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:47.167 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544229+0000", 2024-04-26T10:44:47.167 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9190000000000002e-05 2024-04-26T10:44:47.168 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.168 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:47.168 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.168 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.168 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.168 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:338 3.13 3:ceffbd45:::200.0000000a:head [write 1344569~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:47.168 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:47.168 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 20.610659131999999, 2024-04-26T10:44:47.168 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027105598000000002, 2024-04-26T10:44:47.168 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:47.168 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.168 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:47.168 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.168 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:47.169 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:47.169 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.169 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.169 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.169 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:47.169 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:47.169 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.169 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.169 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.169 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:47.169 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517183+0000", 2024-04-26T10:44:47.169 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:47.169 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.169 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.170 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:47.170 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517188+0000", 2024-04-26T10:44:47.170 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7389999999999999e-06 2024-04-26T10:44:47.170 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.170 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.170 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:47.170 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517199+0000", 2024-04-26T10:44:47.170 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0652000000000001e-05 2024-04-26T10:44:47.170 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.170 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.170 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.170 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517206+0000", 2024-04-26T10:44:47.170 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6610000000000003e-06 2024-04-26T10:44:47.170 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.171 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.171 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:47.171 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537905+0000", 2024-04-26T10:44:47.171 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020699662000000001 2024-04-26T10:44:47.171 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.171 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.171 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:47.171 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537956+0000", 2024-04-26T10:44:47.171 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0954e-05 2024-04-26T10:44:47.171 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.171 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.171 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:47.171 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544233+0000", 2024-04-26T10:44:47.171 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062773009999999999 2024-04-26T10:44:47.171 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.172 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.172 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:47.172 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544258+0000", 2024-04-26T10:44:47.172 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4434999999999999e-05 2024-04-26T10:44:47.172 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.172 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.172 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:47.172 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544290+0000", 2024-04-26T10:44:47.172 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1918000000000002e-05 2024-04-26T10:44:47.172 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.172 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:47.172 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.172 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.172 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.172 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:339 3.13 3:ceffbd45:::200.0000000a:head [write 1346485~4322 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:47.173 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:47.173 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 20.609720638999999, 2024-04-26T10:44:47.173 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026221617999999999, 2024-04-26T10:44:47.173 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:47.173 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.173 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:47.173 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.173 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:47.173 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:47.173 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.173 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.173 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.173 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:47.173 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:47.173 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.174 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.174 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.174 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:47.174 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518122+0000", 2024-04-26T10:44:47.174 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:47.174 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.174 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.174 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:47.174 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518129+0000", 2024-04-26T10:44:47.174 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.43e-06 2024-04-26T10:44:47.174 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.174 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.174 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:47.174 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518138+0000", 2024-04-26T10:44:47.175 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9129999999999992e-06 2024-04-26T10:44:47.175 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.175 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.175 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.175 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518144+0000", 2024-04-26T10:44:47.175 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.1419999999999998e-06 2024-04-26T10:44:47.175 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.175 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.175 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:47.175 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538232+0000", 2024-04-26T10:44:47.175 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020087383 2024-04-26T10:44:47.175 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.175 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.175 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:47.175 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538274+0000", 2024-04-26T10:44:47.176 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2602999999999999e-05 2024-04-26T10:44:47.176 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.176 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.176 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:47.176 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544294+0000", 2024-04-26T10:44:47.176 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060194059999999997 2024-04-26T10:44:47.176 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.176 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.176 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:47.176 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544314+0000", 2024-04-26T10:44:47.176 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0091000000000001e-05 2024-04-26T10:44:47.176 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.176 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.176 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:47.176 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544344+0000", 2024-04-26T10:44:47.177 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0446e-05 2024-04-26T10:44:47.177 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.177 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:47.177 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.177 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.177 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.177 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:340 3.13 3:ceffbd45:::200.0000000a:head [write 1350807~2768 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:47.177 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:47.177 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 20.607236403000002, 2024-04-26T10:44:47.177 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023795594, 2024-04-26T10:44:47.177 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:47.177 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.177 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:47.177 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.177 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:47.178 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:47.178 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.178 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.178 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.178 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:47.178 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:47.178 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.178 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.178 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.178 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:47.178 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520606+0000", 2024-04-26T10:44:47.178 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:47.178 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.178 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.179 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:47.179 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520612+0000", 2024-04-26T10:44:47.179 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.835e-06 2024-04-26T10:44:47.179 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.179 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.179 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:47.179 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520622+0000", 2024-04-26T10:44:47.179 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0173999999999999e-05 2024-04-26T10:44:47.179 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.179 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.179 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.179 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520629+0000", 2024-04-26T10:44:47.179 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7460000000000003e-06 2024-04-26T10:44:47.179 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.179 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.180 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:47.180 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538651+0000", 2024-04-26T10:44:47.180 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018022474 2024-04-26T10:44:47.180 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.180 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.180 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:47.180 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538697+0000", 2024-04-26T10:44:47.180 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6183999999999997e-05 2024-04-26T10:44:47.180 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.180 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.180 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:47.180 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544348+0000", 2024-04-26T10:44:47.180 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0056503509999999996 2024-04-26T10:44:47.180 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.180 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.181 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:47.181 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544369+0000", 2024-04-26T10:44:47.181 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1064999999999999e-05 2024-04-26T10:44:47.181 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.181 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.181 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:47.181 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544403+0000", 2024-04-26T10:44:47.181 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3695000000000002e-05 2024-04-26T10:44:47.181 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.181 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:47.181 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.181 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.181 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.181 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:341 3.13 3:ceffbd45:::200.0000000a:head [write 1353575~3816 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:47.181 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:47.182 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 20.606501148, 2024-04-26T10:44:47.182 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023114967, 2024-04-26T10:44:47.182 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:47.182 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.182 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:47.182 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.182 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:47.182 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:47.182 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.182 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.182 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.182 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:47.182 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:47.182 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.182 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.183 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.183 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:47.183 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521341+0000", 2024-04-26T10:44:47.183 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:47.183 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.183 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.183 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:47.183 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521349+0000", 2024-04-26T10:44:47.183 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1550000000000001e-06 2024-04-26T10:44:47.183 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.183 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.183 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:47.183 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521358+0000", 2024-04-26T10:44:47.183 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.1500000000000005e-06 2024-04-26T10:44:47.183 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.184 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.184 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.184 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521364+0000", 2024-04-26T10:44:47.184 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3289999999999999e-06 2024-04-26T10:44:47.184 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.184 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.184 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:47.184 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539010+0000", 2024-04-26T10:44:47.184 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.017645965999999999 2024-04-26T10:44:47.184 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.184 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.184 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:47.184 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539051+0000", 2024-04-26T10:44:47.184 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.053e-05 2024-04-26T10:44:47.185 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.185 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.185 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:47.185 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544407+0000", 2024-04-26T10:44:47.185 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053560209999999999 2024-04-26T10:44:47.185 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.185 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.185 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:47.185 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544427+0000", 2024-04-26T10:44:47.185 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0228e-05 2024-04-26T10:44:47.185 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.185 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.185 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:47.185 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544457+0000", 2024-04-26T10:44:47.185 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0375e-05 2024-04-26T10:44:47.186 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.186 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:47.186 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.186 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.186 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.186 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11582 4.2f 4:f76ba295:::10000003252.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:47.186 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:47.186 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 18.132885602999998, 2024-04-26T10:44:47.186 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024553994999999999, 2024-04-26T10:44:47.186 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:47.186 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.186 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:47.186 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:47.186 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:47.186 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11582 2024-04-26T10:44:47.187 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.187 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:47.187 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.187 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:47.187 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:47.187 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.187 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.187 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.187 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:47.187 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:47.187 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.187 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.187 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.187 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:47.187 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994957+0000", 2024-04-26T10:44:47.188 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:47.188 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.188 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.188 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:47.188 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002755+0000", 2024-04-26T10:44:47.188 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0077984719999999999 2024-04-26T10:44:47.188 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.188 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.188 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:47.188 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002770+0000", 2024-04-26T10:44:47.188 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4956e-05 2024-04-26T10:44:47.188 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.188 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.188 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.189 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002777+0000", 2024-04-26T10:44:47.189 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1899999999999998e-06 2024-04-26T10:44:47.189 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.189 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.189 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:47.189 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002833+0000", 2024-04-26T10:44:47.189 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5189999999999998e-05 2024-04-26T10:44:47.189 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.189 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.189 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:47.189 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002977+0000", 2024-04-26T10:44:47.189 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014444100000000001 2024-04-26T10:44:47.189 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.189 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.189 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:47.190 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.003108+0000", 2024-04-26T10:44:47.190 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000131068 2024-04-26T10:44:47.190 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.190 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.190 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:47.190 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.009040+0000", 2024-04-26T10:44:47.190 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059314149999999998 2024-04-26T10:44:47.190 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.190 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.190 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.190 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019462+0000", 2024-04-26T10:44:47.190 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010422803 2024-04-26T10:44:47.190 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.190 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.191 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:47.191 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019490+0000", 2024-04-26T10:44:47.191 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7773999999999999e-05 2024-04-26T10:44:47.191 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.191 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.191 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:47.191 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019512+0000", 2024-04-26T10:44:47.191 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1611999999999999e-05 2024-04-26T10:44:47.191 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.191 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:47.191 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.191 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.191 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.191 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11911 4.37 4:ec04ab04:::100000031ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:47.191 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:47.192 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 17.791165396, 2024-04-26T10:44:47.192 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026810273999999999, 2024-04-26T10:44:47.192 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:47.192 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.192 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:47.192 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:47.192 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:47.192 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11911 2024-04-26T10:44:47.192 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.192 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:47.192 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.192 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:47.192 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:47.192 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.193 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.193 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.193 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:47.193 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:47.193 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.193 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.193 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.193 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:47.193 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336676+0000", 2024-04-26T10:44:47.193 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:47.193 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.193 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.193 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:47.193 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343119+0000", 2024-04-26T10:44:47.193 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0064424850000000004 2024-04-26T10:44:47.194 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.194 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.194 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:47.194 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343131+0000", 2024-04-26T10:44:47.194 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1708e-05 2024-04-26T10:44:47.194 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.194 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.194 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.194 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343137+0000", 2024-04-26T10:44:47.194 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9880000000000001e-06 2024-04-26T10:44:47.194 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.194 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.194 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:47.194 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343175+0000", 2024-04-26T10:44:47.195 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7913000000000001e-05 2024-04-26T10:44:47.195 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.195 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.195 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:47.195 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343269+0000", 2024-04-26T10:44:47.195 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4931000000000003e-05 2024-04-26T10:44:47.195 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.195 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.195 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:47.195 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343392+0000", 2024-04-26T10:44:47.195 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000122435 2024-04-26T10:44:47.195 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.195 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.195 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:47.196 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.347520+0000", 2024-04-26T10:44:47.196 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004128418 2024-04-26T10:44:47.196 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.196 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.196 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.196 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363410+0000", 2024-04-26T10:44:47.196 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.015889309000000001 2024-04-26T10:44:47.196 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.196 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.196 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:47.196 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363453+0000", 2024-04-26T10:44:47.196 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3244000000000001e-05 2024-04-26T10:44:47.196 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.196 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.196 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:47.197 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363488+0000", 2024-04-26T10:44:47.197 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5318000000000003e-05 2024-04-26T10:44:47.197 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.197 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:47.197 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.197 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.197 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.197 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12000 4.3c 4:3c2be35d:::100000030f7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:47.197 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:47.197 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 17.708543884000001, 2024-04-26T10:44:47.197 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022808264000000002, 2024-04-26T10:44:47.197 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:47.197 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.197 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:47.198 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:47.198 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:47.198 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12000 2024-04-26T10:44:47.198 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.198 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:47.198 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.198 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:47.198 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:47.198 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.198 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.198 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.198 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:47.198 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:47.198 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.199 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.199 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.199 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:47.199 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:47.199 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:47.199 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.199 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.199 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:47.199 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430937+0000", 2024-04-26T10:44:47.199 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.011638097 2024-04-26T10:44:47.199 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.199 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.199 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:47.199 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430948+0000", 2024-04-26T10:44:47.199 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0824e-05 2024-04-26T10:44:47.200 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.200 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.200 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.200 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430953+0000", 2024-04-26T10:44:47.200 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5219999999999998e-06 2024-04-26T10:44:47.200 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.200 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.200 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:47.200 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430990+0000", 2024-04-26T10:44:47.200 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6458999999999998e-05 2024-04-26T10:44:47.200 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.200 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.200 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:47.200 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.431052+0000", 2024-04-26T10:44:47.201 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2687000000000005e-05 2024-04-26T10:44:47.201 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.201 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.201 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:47.201 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442027+0000", 2024-04-26T10:44:47.201 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010974513 2024-04-26T10:44:47.201 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.201 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.201 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:47.201 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442060+0000", 2024-04-26T10:44:47.201 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2849999999999999e-05 2024-04-26T10:44:47.201 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.201 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.201 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:47.201 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442108+0000", 2024-04-26T10:44:47.202 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8031999999999997e-05 2024-04-26T10:44:47.202 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.202 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:47.202 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.202 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.202 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.202 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12042 4.2f 4:f741970f:::10000003414.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:47.202 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:47.202 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 17.669290406999998, 2024-04-26T10:44:47.202 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.029390757, 2024-04-26T10:44:47.202 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:47.202 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.202 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:47.202 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:47.203 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:47.203 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12042 2024-04-26T10:44:47.203 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.203 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:47.203 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.203 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:47.203 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:47.203 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.203 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.203 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.203 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:47.203 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:47.203 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.203 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.203 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.204 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:47.204 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458552+0000", 2024-04-26T10:44:47.204 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:47.204 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.204 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.204 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:47.204 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464335+0000", 2024-04-26T10:44:47.204 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.005783168 2024-04-26T10:44:47.204 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.204 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.204 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:47.204 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464347+0000", 2024-04-26T10:44:47.204 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1578e-05 2024-04-26T10:44:47.204 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.205 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.205 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.205 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464353+0000", 2024-04-26T10:44:47.205 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3709999999999996e-06 2024-04-26T10:44:47.205 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.205 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.205 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:47.205 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464407+0000", 2024-04-26T10:44:47.205 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3717000000000001e-05 2024-04-26T10:44:47.205 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.205 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.205 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:47.205 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464556+0000", 2024-04-26T10:44:47.205 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014899100000000001 2024-04-26T10:44:47.205 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.206 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.206 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:47.206 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464688+0000", 2024-04-26T10:44:47.206 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013238599999999999 2024-04-26T10:44:47.206 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.206 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.206 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:47.206 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.469725+0000", 2024-04-26T10:44:47.206 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0050369229999999996 2024-04-26T10:44:47.206 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.206 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.206 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.206 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487892+0000", 2024-04-26T10:44:47.206 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018167184999999999 2024-04-26T10:44:47.207 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.207 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.207 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:47.207 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487922+0000", 2024-04-26T10:44:47.207 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.9495000000000001e-05 2024-04-26T10:44:47.207 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.207 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.207 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:47.207 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487944+0000", 2024-04-26T10:44:47.207 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1823000000000001e-05 2024-04-26T10:44:47.207 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.207 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:47.207 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.207 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.207 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.208 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12050 4.2c 4:36b72e58:::100000031ba.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:47.208 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:47.208 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 17.660749798000001, 2024-04-26T10:44:47.208 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022722497000000001, 2024-04-26T10:44:47.208 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:47.208 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.208 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:47.208 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:47.208 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:47.208 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12050 2024-04-26T10:44:47.208 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.208 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:47.208 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.208 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:47.209 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:47.209 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.209 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.209 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.209 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:47.209 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:47.209 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.209 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.209 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.209 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:47.209 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467093+0000", 2024-04-26T10:44:47.209 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:47.209 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.209 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.209 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:47.209 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476305+0000", 2024-04-26T10:44:47.210 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092125850000000006 2024-04-26T10:44:47.210 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.210 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.210 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:47.210 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476322+0000", 2024-04-26T10:44:47.210 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6860000000000001e-05 2024-04-26T10:44:47.210 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.210 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.210 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.210 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476328+0000", 2024-04-26T10:44:47.210 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.587e-06 2024-04-26T10:44:47.210 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.210 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.211 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:47.211 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476378+0000", 2024-04-26T10:44:47.211 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0519999999999997e-05 2024-04-26T10:44:47.211 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.211 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.211 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:47.211 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476474+0000", 2024-04-26T10:44:47.211 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5556000000000005e-05 2024-04-26T10:44:47.211 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.211 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.211 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:47.211 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489677+0000", 2024-04-26T10:44:47.211 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013203048 2024-04-26T10:44:47.211 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.211 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.212 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:47.212 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489722+0000", 2024-04-26T10:44:47.212 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4650000000000001e-05 2024-04-26T10:44:47.212 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.212 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.212 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:47.212 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489816+0000", 2024-04-26T10:44:47.212 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4402999999999997e-05 2024-04-26T10:44:47.212 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.212 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:47.212 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.212 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.212 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.212 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12516 4.37 4:ed0cb515:::10000003324.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:47.212 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:47.213 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 17.140668233, 2024-04-26T10:44:47.213 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.030139677, 2024-04-26T10:44:47.213 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:47.213 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.213 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:47.213 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:47.213 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:47.213 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12516 2024-04-26T10:44:47.213 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.213 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:47.213 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.213 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:47.213 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:47.213 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.214 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.214 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.214 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:47.214 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:47.214 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.214 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.214 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.214 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:47.214 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987173+0000", 2024-04-26T10:44:47.214 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:47.214 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.214 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.214 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:47.214 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991339+0000", 2024-04-26T10:44:47.214 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0041663760000000003 2024-04-26T10:44:47.215 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.215 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.215 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:47.215 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991351+0000", 2024-04-26T10:44:47.215 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1333e-05 2024-04-26T10:44:47.215 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.215 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.215 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.215 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991357+0000", 2024-04-26T10:44:47.215 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3350000000000003e-06 2024-04-26T10:44:47.215 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.215 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.215 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:47.215 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991394+0000", 2024-04-26T10:44:47.215 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7054000000000001e-05 2024-04-26T10:44:47.216 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.216 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.216 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:47.216 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991495+0000", 2024-04-26T10:44:47.216 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000100386 2024-04-26T10:44:47.216 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.216 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.216 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:47.216 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991579+0000", 2024-04-26T10:44:47.216 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4295000000000005e-05 2024-04-26T10:44:47.216 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.216 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.216 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:47.216 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.996238+0000", 2024-04-26T10:44:47.216 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0046589309999999998 2024-04-26T10:44:47.217 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.217 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.217 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.217 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017237+0000", 2024-04-26T10:44:47.217 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020998993000000001 2024-04-26T10:44:47.217 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.217 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.217 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:47.217 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017280+0000", 2024-04-26T10:44:47.217 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3600000000000003e-05 2024-04-26T10:44:47.217 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.217 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.217 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:47.217 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017315+0000", 2024-04-26T10:44:47.217 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4381999999999997e-05 2024-04-26T10:44:47.218 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.218 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:47.218 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.218 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.218 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.218 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12644 4.37 4:ec5044d7:::100000032d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:47.218 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:47.218 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 16.966995404999999, 2024-04-26T10:44:47.218 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.037018677, 2024-04-26T10:44:47.218 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:47.218 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.218 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:47.218 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:47.218 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:47.219 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12644 2024-04-26T10:44:47.219 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.219 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:47.219 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.219 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:47.219 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:47.219 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.219 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.219 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.219 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:47.219 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:47.219 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.219 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.219 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.219 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:47.220 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160847+0000", 2024-04-26T10:44:47.220 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:47.220 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.220 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.220 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:47.220 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170089+0000", 2024-04-26T10:44:47.220 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092424289999999999 2024-04-26T10:44:47.220 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.220 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.220 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:47.220 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170111+0000", 2024-04-26T10:44:47.220 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1733e-05 2024-04-26T10:44:47.220 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.220 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.220 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.221 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170124+0000", 2024-04-26T10:44:47.221 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.272e-05 2024-04-26T10:44:47.221 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.221 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.221 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:47.221 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170177+0000", 2024-04-26T10:44:47.221 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3745000000000001e-05 2024-04-26T10:44:47.221 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.221 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.221 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:47.221 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170350+0000", 2024-04-26T10:44:47.221 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017297699999999999 2024-04-26T10:44:47.221 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.221 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.221 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:47.222 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170458+0000", 2024-04-26T10:44:47.222 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000107583 2024-04-26T10:44:47.222 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.222 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.222 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:47.222 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.176693+0000", 2024-04-26T10:44:47.222 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062351799999999999 2024-04-26T10:44:47.222 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.222 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.222 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.222 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197774+0000", 2024-04-26T10:44:47.222 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021080471999999999 2024-04-26T10:44:47.222 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.222 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.223 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:47.223 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197824+0000", 2024-04-26T10:44:47.223 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0096000000000003e-05 2024-04-26T10:44:47.223 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.223 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.223 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:47.223 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197867+0000", 2024-04-26T10:44:47.223 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2882e-05 2024-04-26T10:44:47.223 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.223 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:47.223 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.223 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.223 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.223 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:13242 4.2f 4:f5e54bb5:::100000033c8.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:47.223 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:47.224 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 16.288764267000001, 2024-04-26T10:44:47.224 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023873062, 2024-04-26T10:44:47.224 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:47.224 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.224 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:47.224 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:47.224 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:47.224 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 13242 2024-04-26T10:44:47.224 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.224 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:47.224 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.224 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:47.225 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:47.225 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.225 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.225 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.225 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:47.225 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:47.225 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:47.225 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.225 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.225 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:47.225 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839078+0000", 2024-04-26T10:44:47.225 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:47.225 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.225 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.226 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:47.226 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848098+0000", 2024-04-26T10:44:47.226 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090200750000000007 2024-04-26T10:44:47.226 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.226 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.226 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:47.226 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848108+0000", 2024-04-26T10:44:47.226 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.062e-05 2024-04-26T10:44:47.226 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.226 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.226 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.226 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848115+0000", 2024-04-26T10:44:47.226 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3040000000000001e-06 2024-04-26T10:44:47.226 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.226 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.227 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:47.227 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848157+0000", 2024-04-26T10:44:47.227 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2533000000000001e-05 2024-04-26T10:44:47.227 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.227 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.227 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:47.227 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848252+0000", 2024-04-26T10:44:47.227 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4480000000000003e-05 2024-04-26T10:44:47.227 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.227 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.227 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:47.227 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848393+0000", 2024-04-26T10:44:47.227 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000140863 2024-04-26T10:44:47.227 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.228 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.228 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:47.228 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.854434+0000", 2024-04-26T10:44:47.228 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060415590000000002 2024-04-26T10:44:47.228 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.228 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.228 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.228 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862894+0000", 2024-04-26T10:44:47.228 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0084598869999999993 2024-04-26T10:44:47.228 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.228 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.228 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:47.228 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862926+0000", 2024-04-26T10:44:47.228 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1473999999999997e-05 2024-04-26T10:44:47.228 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:47.229 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:47.229 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:47.229 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862952+0000", 2024-04-26T10:44:47.229 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6545000000000001e-05 2024-04-26T10:44:47.229 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.229 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:47.229 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.229 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:47.229 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:47.229 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:47.231 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:47.229+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:47.231 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:44:47.232 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":63,"fsid":"9837de44-a9e8-4979-adc4-611f3ddc44ce","created":"2024-04-26T10:42:11.337159+0000","modified":"2024-04-26T10:44:46.688321+0000","last_up_change":"2024-04-26T10:43:10.777788+0000","last_in_change":"2024-04-26T10:42:12.136647+0000","flags":"noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5801984,"flags_set":["noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:42:19.632084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":3.0299999713897705,"score_stable":3.0299999713897705,"optimal_score":0.33000001311302185,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:42:19.779089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8700000047683716,"score_stable":1.8700000047683716,"optimal_score":0.67000001668930054,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:42:24.266614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.2400000095367432,"score_stable":2.2400000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:42:25.014684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2.3299999237060547,"score_stable":2.3299999237060547,"optimal_score":0.67000001668930054,"raw_score_acting":1.559999942779541,"raw_score_stable":1.559999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eabed31c-c043-43de-a756-e217d5287116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":28839},{"type":"v1","addr":"172.21.15.60:6801","nonce":28839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":28839},{"type":"v1","addr":"172.21.15.60:6803","nonce":28839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":28839},{"type":"v1","addr":"172.21.15.60:6807","nonce":28839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":28839},{"type":"v1","addr":"172.21.15.60:6805","nonce":28839}]},"public_addr":"172.21.15.60:6801/28839","cluster_addr":"172.21.15.60:6803/28839","heartbeat_back_addr":"172.21.15.60:6807/28839","heartbeat_front_addr":"172.21.15.60:6805/28839","state":["exists","up"]},{"osd":1,"uuid":"7013621f-db09-4096-bc24-428bb170edd1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":28598},{"type":"v1","addr":"172.21.15.87:6801","nonce":28598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":28598},{"type":"v1","addr":"172.21.15.87:6803","nonce":28598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":28598},{"type":"v1","addr":"172.21.15.87:6807","nonce":28598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":28598},{"type":"v1","addr":"172.21.15.87:6805","nonce":28598}]},"public_addr":"172.21.15.87:6801/28598","cluster_addr":"172.21.15.87:6803/28598","heartbeat_back_addr":"172.21.15.87:6807/28598","heartbeat_front_addr":"172.21.15.87:6805/28598","state":["exists"]},{"osd":2,"uuid":"a1efeadd-cf55-4ed5-9918-36607fd62229","up":1,"in":1,"weight":0.5399627685546875,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":28733},{"type":"v1","addr":"172.21.15.195:6801","nonce":28733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":28733},{"type":"v1","addr":"172.21.15.195:6803","nonce":28733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":28733},{"type":"v1","addr":"172.21.15.195:6807","nonce":28733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":28733},{"type":"v1","addr":"172.21.15.195:6805","nonce":28733}]},"public_addr":"172.21.15.195:6801/28733","cluster_addr":"172.21.15.195:6803/28733","heartbeat_back_addr":"172.21.15.195:6807/28733","heartbeat_front_addr":"172.21.15.195:6805/28733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.152046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.177399+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.123066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":0,"to":1}]},{"pgid":"4.6","mappings":[{"from":0,"to":1}]},{"pgid":"4.12","mappings":[{"from":2,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"2.1","osds":[0,2]},{"pgid":"2.5","osds":[0,2]},{"pgid":"2.6","osds":[0,2]},{"pgid":"3.1","osds":[0,2]},{"pgid":"3.4","osds":[0,2]},{"pgid":"3.6","osds":[0,2]},{"pgid":"3.7","osds":[0,2]},{"pgid":"3.8","osds":[0,2]},{"pgid":"3.b","osds":[0,2]},{"pgid":"3.16","osds":[0,2]},{"pgid":"3.17","osds":[0,2]},{"pgid":"3.19","osds":[0,2]},{"pgid":"3.1c","osds":[0,2]},{"pgid":"3.1e","osds":[0,2]},{"pgid":"3.1f","osds":[0,2]},{"pgid":"4.0","osds":[0,2]},{"pgid":"4.4","osds":[0,2]},{"pgid":"4.6","osds":[0,2]},{"pgid":"4.7","osds":[0,2]},{"pgid":"4.9","osds":[0,2]},{"pgid":"4.a","osds":[0,2]},{"pgid":"4.b","osds":[0,2]},{"pgid":"4.c","osds":[0,2]},{"pgid":"4.f","osds":[0,2]},{"pgid":"4.10","osds":[0,2]},{"pgid":"4.12","osds":[0,2]},{"pgid":"4.1a","osds":[0,2]},{"pgid":"4.1b","osds":[0,2]},{"pgid":"4.1c","osds":[0,2]},{"pgid":"4.1e","osds":[0,2]},{"pgid":"4.21","osds":[0,2]},{"pgid":"4.23","osds":[0,2]},{"pgid":"4.28","osds":[0,2]},{"pgid":"4.29","osds":[0,2]},{"pgid":"4.2b","osds":[0,2]},{"pgid":"4.2d","osds":[0,2]},{"pgid":"4.2e","osds":[0,2]},{"pgid":"4.36","osds":[0,2]},{"pgid":"4.38","osds":[0,2]},{"pgid":"4.3e","osds":[0,2]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:44:47.232 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T10:42:19.632084+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T10:42:19.779089+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.8700000047683716, 'score_stable': 1.8700000047683716, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T10:42:24.266614+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.240000009536743, 'score_stable': 2.240000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T10:42:25.014684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2.3299999237060547, 'score_stable': 2.3299999237060547, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.559999942779541, 'raw_score_stable': 1.559999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T10:44:47.233 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T10:44:47.233 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:47.331 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:47.330+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:47.352 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:47.352 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:47.352 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:44:47.352 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:47.361 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:47.432 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:47.430+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:47.468 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:47.468 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:47.468 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:47.468 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:47.468 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:47.476 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:47.525 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-04-26T10:44:47.539 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T10:44:47.561 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:47.559+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:47.625 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:47.625 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:47.625 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:47.625 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:47.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.625 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:80 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:47.625 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:47.625 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 26.100062382000001, 2024-04-26T10:44:47.626 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029259192, 2024-04-26T10:44:47.626 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:47.626 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.626 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:47.626 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.626 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:47.626 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:47.626 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.626 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.626 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.626 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:47.626 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:47.627 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.627 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:47.627 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522252+0000", 2024-04-26T10:44:47.627 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:47.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.627 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:47.627 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523121+0000", 2024-04-26T10:44:47.627 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00086885100000000002 2024-04-26T10:44:47.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.627 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:47.627 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523133+0000", 2024-04-26T10:44:47.628 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2109999999999999e-05 2024-04-26T10:44:47.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.628 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.628 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523139+0000", 2024-04-26T10:44:47.628 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.541e-06 2024-04-26T10:44:47.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.628 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:47.628 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523176+0000", 2024-04-26T10:44:47.628 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6847999999999997e-05 2024-04-26T10:44:47.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.629 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:47.629 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523240+0000", 2024-04-26T10:44:47.629 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3941000000000003e-05 2024-04-26T10:44:47.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.629 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:47.629 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.536390+0000", 2024-04-26T10:44:47.629 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013150811 2024-04-26T10:44:47.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.629 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.629 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551071+0000", 2024-04-26T10:44:47.629 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014680021 2024-04-26T10:44:47.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.630 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:47.630 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551428+0000", 2024-04-26T10:44:47.630 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00035703900000000002 2024-04-26T10:44:47.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.630 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:47.630 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551462+0000", 2024-04-26T10:44:47.630 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4337e-05 2024-04-26T10:44:47.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.630 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:47.630 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551513+0000", 2024-04-26T10:44:47.631 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0875000000000003e-05 2024-04-26T10:44:47.631 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.631 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:47.631 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.631 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:129 3.1a 3:5e41ab69:::200.00000005:head [write 3557843~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:47.631 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:47.631 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 26.096004312000002, 2024-04-26T10:44:47.631 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029108253000000001, 2024-04-26T10:44:47.631 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:47.631 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.631 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:47.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.632 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:47.632 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:47.632 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.632 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.632 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:47.632 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:47.632 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.632 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.632 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:47.632 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526311+0000", 2024-04-26T10:44:47.632 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:47.632 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.633 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:47.633 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526315+0000", 2024-04-26T10:44:47.633 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4809999999999998e-06 2024-04-26T10:44:47.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.633 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:47.633 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526319+0000", 2024-04-26T10:44:47.633 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0690000000000003e-06 2024-04-26T10:44:47.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.633 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.633 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526321+0000", 2024-04-26T10:44:47.633 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4880000000000001e-06 2024-04-26T10:44:47.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.634 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:47.634 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553856+0000", 2024-04-26T10:44:47.634 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027534916 2024-04-26T10:44:47.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.634 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:47.634 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553900+0000", 2024-04-26T10:44:47.634 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3954e-05 2024-04-26T10:44:47.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.635 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:47.635 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553962+0000", 2024-04-26T10:44:47.635 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1519000000000005e-05 2024-04-26T10:44:47.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.635 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:47.636 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555348+0000", 2024-04-26T10:44:47.636 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013864579999999999 2024-04-26T10:44:47.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.636 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.636 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555378+0000", 2024-04-26T10:44:47.637 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9441000000000002e-05 2024-04-26T10:44:47.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.637 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.637 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:47.637 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555401+0000", 2024-04-26T10:44:47.637 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2815000000000001e-05 2024-04-26T10:44:47.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.637 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.637 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:47.637 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555420+0000", 2024-04-26T10:44:47.637 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9341e-05 2024-04-26T10:44:47.638 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.638 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:47.638 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.638 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.638 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.638 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:130 3.1a 3:5e41ab69:::200.00000005:head [write 3559243~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:47.638 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:47.638 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 26.095992476999999, 2024-04-26T10:44:47.638 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029188316999999998, 2024-04-26T10:44:47.638 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:47.638 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.638 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:47.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.639 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:47.639 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:47.639 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.639 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:47.639 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:47.639 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.639 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:47.639 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:47.639 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:47.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.640 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.640 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:47.640 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526325+0000", 2024-04-26T10:44:47.640 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4899999999999999e-06 2024-04-26T10:44:47.640 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.640 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.640 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:47.640 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526327+0000", 2024-04-26T10:44:47.640 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.745e-06 2024-04-26T10:44:47.640 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.640 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.640 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.640 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526330+0000", 2024-04-26T10:44:47.641 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5620000000000002e-06 2024-04-26T10:44:47.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.641 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.641 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:47.641 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554200+0000", 2024-04-26T10:44:47.641 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027869541000000001 2024-04-26T10:44:47.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.641 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.641 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:47.641 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554244+0000", 2024-04-26T10:44:47.641 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4464e-05 2024-04-26T10:44:47.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.641 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.641 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:47.642 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554304+0000", 2024-04-26T10:44:47.642 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9457999999999999e-05 2024-04-26T10:44:47.642 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.642 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.642 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.642 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555453+0000", 2024-04-26T10:44:47.642 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011494000000000001 2024-04-26T10:44:47.642 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.642 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.642 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:47.642 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555457+0000", 2024-04-26T10:44:47.642 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1779999999999996e-06 2024-04-26T10:44:47.642 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.643 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:47.643 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555480+0000", 2024-04-26T10:44:47.643 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2802e-05 2024-04-26T10:44:47.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.643 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:47.643 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555512+0000", 2024-04-26T10:44:47.643 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1885999999999999e-05 2024-04-26T10:44:47.643 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.643 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:47.643 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.644 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:131 3.1a 3:5e41ab69:::200.00000005:head [write 3560642~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:47.644 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:47.644 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 26.095983897, 2024-04-26T10:44:47.644 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029683102999999999, 2024-04-26T10:44:47.644 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:47.644 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.644 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:47.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.644 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:47.645 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:47.645 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.645 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:47.645 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:47.645 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.645 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:47.645 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:47.645 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:47.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.645 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:47.646 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526336+0000", 2024-04-26T10:44:47.646 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.681e-06 2024-04-26T10:44:47.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.646 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:47.646 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526338+0000", 2024-04-26T10:44:47.646 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8430000000000001e-06 2024-04-26T10:44:47.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.646 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.646 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526341+0000", 2024-04-26T10:44:47.646 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6180000000000002e-06 2024-04-26T10:44:47.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.647 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:47.647 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554745+0000", 2024-04-26T10:44:47.647 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028404088000000001 2024-04-26T10:44:47.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.647 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:47.647 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554788+0000", 2024-04-26T10:44:47.647 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2738999999999999e-05 2024-04-26T10:44:47.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.647 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.648 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:47.648 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554849+0000", 2024-04-26T10:44:47.648 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1362e-05 2024-04-26T10:44:47.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.648 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.648 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555963+0000", 2024-04-26T10:44:47.648 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001113597 2024-04-26T10:44:47.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.649 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:47.649 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555969+0000", 2024-04-26T10:44:47.649 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6900000000000003e-06 2024-04-26T10:44:47.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.649 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:47.649 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555995+0000", 2024-04-26T10:44:47.649 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5165999999999999e-05 2024-04-26T10:44:47.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.649 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:47.649 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556015+0000", 2024-04-26T10:44:47.649 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0522000000000001e-05 2024-04-26T10:44:47.649 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.649 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:47.650 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.650 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:132 3.1a 3:5e41ab69:::200.00000005:head [write 3562043~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:47.650 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:47.650 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 26.095963632, 2024-04-26T10:44:47.650 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030129895, 2024-04-26T10:44:47.650 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:47.650 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.650 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:47.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.650 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:47.650 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:47.651 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.651 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.651 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:47.651 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:47.651 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.651 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.651 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:47.651 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:47.651 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:47.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.651 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.651 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:47.651 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526354+0000", 2024-04-26T10:44:47.652 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8560000000000001e-06 2024-04-26T10:44:47.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.652 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:47.652 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526359+0000", 2024-04-26T10:44:47.652 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4700000000000001e-06 2024-04-26T10:44:47.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.652 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.652 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526365+0000", 2024-04-26T10:44:47.652 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2120000000000002e-06 2024-04-26T10:44:47.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.652 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:47.652 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555050+0000", 2024-04-26T10:44:47.653 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028685458 2024-04-26T10:44:47.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.653 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:47.653 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555093+0000", 2024-04-26T10:44:47.653 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3307999999999999e-05 2024-04-26T10:44:47.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.653 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:47.653 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555156+0000", 2024-04-26T10:44:47.653 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2396000000000004e-05 2024-04-26T10:44:47.653 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.653 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.653 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.653 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556052+0000", 2024-04-26T10:44:47.654 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00089650299999999999 2024-04-26T10:44:47.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.654 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:47.654 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556439+0000", 2024-04-26T10:44:47.654 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038647900000000001 2024-04-26T10:44:47.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.654 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:47.654 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556463+0000", 2024-04-26T10:44:47.654 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4071e-05 2024-04-26T10:44:47.654 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.654 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:47.655 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556482+0000", 2024-04-26T10:44:47.655 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9378999999999999e-05 2024-04-26T10:44:47.655 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.655 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:47.655 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.655 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 3563440~3660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:47.655 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:47.655 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 26.095947238000001, 2024-04-26T10:44:47.655 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030550738000000001, 2024-04-26T10:44:47.655 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:47.655 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.655 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:47.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.656 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:47.656 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:47.656 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.656 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:47.656 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:47.656 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.656 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:47.657 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526368+0000", 2024-04-26T10:44:47.657 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:47.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.657 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:47.657 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526375+0000", 2024-04-26T10:44:47.657 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7510000000000002e-06 2024-04-26T10:44:47.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.657 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:47.657 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526381+0000", 2024-04-26T10:44:47.658 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3929999999999996e-06 2024-04-26T10:44:47.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.658 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.658 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526387+0000", 2024-04-26T10:44:47.658 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.215e-06 2024-04-26T10:44:47.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.662 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.662 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:47.662 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555542+0000", 2024-04-26T10:44:47.662 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029154992000000001 2024-04-26T10:44:47.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.662 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.662 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:47.662 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555610+0000", 2024-04-26T10:44:47.662 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8610999999999998e-05 2024-04-26T10:44:47.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.663 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:47.663 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555681+0000", 2024-04-26T10:44:47.663 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1072e-05 2024-04-26T10:44:47.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.663 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.663 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556866+0000", 2024-04-26T10:44:47.663 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001184598 2024-04-26T10:44:47.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.663 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:47.663 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556872+0000", 2024-04-26T10:44:47.663 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.55e-06 2024-04-26T10:44:47.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.664 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:47.664 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556897+0000", 2024-04-26T10:44:47.664 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.516e-05 2024-04-26T10:44:47.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.664 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:47.664 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556919+0000", 2024-04-26T10:44:47.664 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1951e-05 2024-04-26T10:44:47.664 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.664 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:47.664 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.665 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:134 3.1a 3:5e41ab69:::200.00000005:head [write 3567100~2427 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:47.665 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:47.665 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 26.095914173000001, 2024-04-26T10:44:47.665 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031267445999999997, 2024-04-26T10:44:47.665 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:47.665 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.665 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:47.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.665 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:47.665 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:47.665 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.665 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.665 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:47.665 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:47.666 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.666 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:47.666 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526401+0000", 2024-04-26T10:44:47.666 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:47.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.666 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:47.666 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526408+0000", 2024-04-26T10:44:47.667 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7769999999999997e-06 2024-04-26T10:44:47.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.667 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:47.667 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526415+0000", 2024-04-26T10:44:47.667 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0720000000000002e-06 2024-04-26T10:44:47.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.667 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.667 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526421+0000", 2024-04-26T10:44:47.667 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9699999999999996e-06 2024-04-26T10:44:47.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.667 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:47.668 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556084+0000", 2024-04-26T10:44:47.668 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029662351999999999 2024-04-26T10:44:47.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.668 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:47.668 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556126+0000", 2024-04-26T10:44:47.668 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2385000000000002e-05 2024-04-26T10:44:47.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.669 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:47.669 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556186+0000", 2024-04-26T10:44:47.669 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9945999999999998e-05 2024-04-26T10:44:47.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.669 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:47.669 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557598+0000", 2024-04-26T10:44:47.669 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0014121559999999999 2024-04-26T10:44:47.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.669 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.669 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557626+0000", 2024-04-26T10:44:47.669 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7960999999999999e-05 2024-04-26T10:44:47.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.670 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:47.670 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557650+0000", 2024-04-26T10:44:47.670 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3969999999999999e-05 2024-04-26T10:44:47.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.670 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:47.670 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557669+0000", 2024-04-26T10:44:47.670 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9262e-05 2024-04-26T10:44:47.670 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.670 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:47.670 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.671 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:135 3.1a 3:5e41ab69:::200.00000005:head [write 3569527~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:47.671 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:47.671 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 26.095889907, 2024-04-26T10:44:47.671 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031322516000000002, 2024-04-26T10:44:47.671 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:47.671 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.671 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:47.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.671 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:47.671 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:47.671 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.672 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:47.672 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:47.672 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.672 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:47.672 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:47.672 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:47.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.672 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:47.672 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526429+0000", 2024-04-26T10:44:47.672 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0750000000000002e-06 2024-04-26T10:44:47.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.673 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:47.673 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526435+0000", 2024-04-26T10:44:47.673 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.263e-06 2024-04-26T10:44:47.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.673 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.673 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526442+0000", 2024-04-26T10:44:47.673 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1219999999999997e-06 2024-04-26T10:44:47.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.673 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:47.674 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556515+0000", 2024-04-26T10:44:47.674 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030073132999999998 2024-04-26T10:44:47.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.674 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:47.674 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556564+0000", 2024-04-26T10:44:47.675 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8871e-05 2024-04-26T10:44:47.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.675 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:47.675 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556625+0000", 2024-04-26T10:44:47.675 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1307000000000001e-05 2024-04-26T10:44:47.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.676 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:47.676 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557678+0000", 2024-04-26T10:44:47.676 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010523100000000001 2024-04-26T10:44:47.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.677 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.677 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557709+0000", 2024-04-26T10:44:47.677 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1748000000000002e-05 2024-04-26T10:44:47.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.678 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:47.678 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557732+0000", 2024-04-26T10:44:47.678 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2415000000000001e-05 2024-04-26T10:44:47.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.678 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:47.678 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557749+0000", 2024-04-26T10:44:47.679 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6736999999999999e-05 2024-04-26T10:44:47.679 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.679 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:47.679 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.680 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:136 3.1a 3:5e41ab69:::200.00000005:head [write 3571449~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:47.680 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:47.680 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 26.095868716999998, 2024-04-26T10:44:47.680 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032180937, 2024-04-26T10:44:47.680 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:47.680 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.681 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:47.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.681 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:47.681 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:47.681 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.682 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:47.682 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:47.682 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.683 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:47.683 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:47.683 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:47.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.683 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:47.684 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526455+0000", 2024-04-26T10:44:47.684 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6429999999999995e-06 2024-04-26T10:44:47.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.684 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:47.684 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526461+0000", 2024-04-26T10:44:47.685 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:47.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.685 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.685 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526467+0000", 2024-04-26T10:44:47.685 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4389999999999999e-06 2024-04-26T10:44:47.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.686 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:47.686 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556950+0000", 2024-04-26T10:44:47.686 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030483854000000001 2024-04-26T10:44:47.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.687 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:47.687 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556989+0000", 2024-04-26T10:44:47.687 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8415999999999999e-05 2024-04-26T10:44:47.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.687 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:47.688 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557051+0000", 2024-04-26T10:44:47.688 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2088999999999995e-05 2024-04-26T10:44:47.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.688 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:47.688 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558166+0000", 2024-04-26T10:44:47.689 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001114622 2024-04-26T10:44:47.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.689 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.689 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558584+0000", 2024-04-26T10:44:47.689 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000418033 2024-04-26T10:44:47.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.690 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:47.690 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558609+0000", 2024-04-26T10:44:47.690 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5344999999999999e-05 2024-04-26T10:44:47.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.691 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:47.691 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558628+0000", 2024-04-26T10:44:47.691 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9273999999999999e-05 2024-04-26T10:44:47.691 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.691 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:47.692 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.692 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:137 3.1a 3:5e41ab69:::200.00000005:head [write 3573699~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:47.692 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:47.692 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 26.095845067999999, 2024-04-26T10:44:47.692 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032241530999999997, 2024-04-26T10:44:47.692 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:47.693 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.693 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:47.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.693 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:47.693 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:47.693 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.693 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:47.693 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:47.693 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.694 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:47.694 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526470+0000", 2024-04-26T10:44:47.694 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:47.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.694 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:47.694 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526473+0000", 2024-04-26T10:44:47.695 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.818e-06 2024-04-26T10:44:47.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.695 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:47.695 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526480+0000", 2024-04-26T10:44:47.695 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4119999999999998e-06 2024-04-26T10:44:47.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.695 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.695 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526484+0000", 2024-04-26T10:44:47.695 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6840000000000004e-06 2024-04-26T10:44:47.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.695 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:47.695 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557323+0000", 2024-04-26T10:44:47.696 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030838956000000001 2024-04-26T10:44:47.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.696 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:47.696 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557362+0000", 2024-04-26T10:44:47.696 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8343999999999997e-05 2024-04-26T10:44:47.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.696 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:47.696 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557421+0000", 2024-04-26T10:44:47.696 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9176999999999999e-05 2024-04-26T10:44:47.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.696 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:47.697 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558636+0000", 2024-04-26T10:44:47.697 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012153789999999999 2024-04-26T10:44:47.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.697 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.697 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558668+0000", 2024-04-26T10:44:47.697 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1452999999999999e-05 2024-04-26T10:44:47.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.697 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:47.697 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558694+0000", 2024-04-26T10:44:47.698 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6288999999999999e-05 2024-04-26T10:44:47.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.698 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:47.698 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558712+0000", 2024-04-26T10:44:47.698 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8459000000000001e-05 2024-04-26T10:44:47.698 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.698 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:47.698 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.698 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:138 3.1a 3:5e41ab69:::200.00000005:head [write 3575103~4205 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:47.698 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:47.699 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 26.095827749000001, 2024-04-26T10:44:47.699 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032665567999999999, 2024-04-26T10:44:47.699 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:47.699 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.699 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:47.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.699 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:47.699 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:47.699 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.699 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:47.699 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:47.699 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.700 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:47.700 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:47.700 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:47.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.700 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:47.700 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526495+0000", 2024-04-26T10:44:47.700 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7580000000000003e-06 2024-04-26T10:44:47.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.700 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:47.700 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526501+0000", 2024-04-26T10:44:47.700 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1680000000000001e-06 2024-04-26T10:44:47.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.701 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.701 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526505+0000", 2024-04-26T10:44:47.701 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.673e-06 2024-04-26T10:44:47.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.701 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:47.702 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557781+0000", 2024-04-26T10:44:47.702 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031275718000000001 2024-04-26T10:44:47.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.702 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:47.702 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557825+0000", 2024-04-26T10:44:47.702 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4048000000000002e-05 2024-04-26T10:44:47.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.703 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:47.703 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557888+0000", 2024-04-26T10:44:47.703 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2562000000000002e-05 2024-04-26T10:44:47.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.703 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.703 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559073+0000", 2024-04-26T10:44:47.703 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011852239999999999 2024-04-26T10:44:47.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.704 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:47.704 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559112+0000", 2024-04-26T10:44:47.704 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9226e-05 2024-04-26T10:44:47.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.704 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:47.705 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559136+0000", 2024-04-26T10:44:47.705 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3966000000000001e-05 2024-04-26T10:44:47.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.705 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:47.705 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559154+0000", 2024-04-26T10:44:47.705 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7575e-05 2024-04-26T10:44:47.705 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.705 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:47.706 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.706 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:139 3.1a 3:5e41ab69:::200.00000005:head [write 3579308~2255 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:47.706 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:47.706 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 26.095806131, 2024-04-26T10:44:47.706 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033424720999999998, 2024-04-26T10:44:47.706 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:47.707 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.707 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:47.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.707 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:47.707 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:47.707 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.708 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:47.708 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:47.708 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.708 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:47.708 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526509+0000", 2024-04-26T10:44:47.708 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:47.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.709 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:47.709 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526516+0000", 2024-04-26T10:44:47.709 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5209999999999999e-06 2024-04-26T10:44:47.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.709 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:47.709 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526522+0000", 2024-04-26T10:44:47.710 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1229999999999997e-06 2024-04-26T10:44:47.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.710 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.710 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526527+0000", 2024-04-26T10:44:47.710 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7849999999999999e-06 2024-04-26T10:44:47.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.710 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:47.711 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558194+0000", 2024-04-26T10:44:47.711 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031667419000000002 2024-04-26T10:44:47.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.711 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:47.711 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558234+0000", 2024-04-26T10:44:47.711 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9774999999999998e-05 2024-04-26T10:44:47.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.712 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:47.712 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558294+0000", 2024-04-26T10:44:47.712 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0242999999999999e-05 2024-04-26T10:44:47.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.712 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.713 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559106+0000", 2024-04-26T10:44:47.713 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00081148099999999996 2024-04-26T10:44:47.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.713 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:47.713 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559890+0000", 2024-04-26T10:44:47.713 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00078439999999999998 2024-04-26T10:44:47.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.714 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:47.714 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559917+0000", 2024-04-26T10:44:47.714 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7044000000000001e-05 2024-04-26T10:44:47.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.714 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:47.714 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559935+0000", 2024-04-26T10:44:47.714 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7448e-05 2024-04-26T10:44:47.715 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.715 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:47.715 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.715 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:140 3.1a 3:5e41ab69:::200.00000005:head [write 3581563~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:47.715 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:47.715 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 26.09578471, 2024-04-26T10:44:47.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033867728, 2024-04-26T10:44:47.716 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:47.716 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.716 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:47.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:47.716 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:47.716 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.717 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:47.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:47.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.717 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:47.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:47.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:47.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.718 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:47.718 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526538+0000", 2024-04-26T10:44:47.718 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.905e-06 2024-04-26T10:44:47.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.718 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:47.718 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526542+0000", 2024-04-26T10:44:47.719 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9550000000000002e-06 2024-04-26T10:44:47.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.719 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.719 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526545+0000", 2024-04-26T10:44:47.719 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8499999999999998e-06 2024-04-26T10:44:47.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.720 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:47.720 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558744+0000", 2024-04-26T10:44:47.720 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032198986999999998 2024-04-26T10:44:47.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.720 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:47.720 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558788+0000", 2024-04-26T10:44:47.720 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4365e-05 2024-04-26T10:44:47.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.721 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:47.721 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558854+0000", 2024-04-26T10:44:47.721 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5952999999999997e-05 2024-04-26T10:44:47.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559971+0000", 2024-04-26T10:44:47.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011172770000000001 2024-04-26T10:44:47.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:47.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560354+0000", 2024-04-26T10:44:47.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038267599999999998 2024-04-26T10:44:47.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:47.723 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560380+0000", 2024-04-26T10:44:47.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6140999999999999e-05 2024-04-26T10:44:47.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.723 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:47.723 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560399+0000", 2024-04-26T10:44:47.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9032999999999999e-05 2024-04-26T10:44:47.723 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.723 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:47.723 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.723 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:141 3.1a 3:5e41ab69:::200.00000005:head [write 3583482~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:47.724 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:47.724 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 26.095769051000001, 2024-04-26T10:44:47.724 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034316301, 2024-04-26T10:44:47.724 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:47.724 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.724 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:47.724 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.724 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:47.724 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:47.724 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.724 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.724 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:47.725 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:47.725 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.725 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:47.725 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:47.725 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:47.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.725 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:47.725 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526548+0000", 2024-04-26T10:44:47.725 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.739e-06 2024-04-26T10:44:47.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.726 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:47.726 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526551+0000", 2024-04-26T10:44:47.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.044e-06 2024-04-26T10:44:47.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.726 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.726 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526562+0000", 2024-04-26T10:44:47.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0370000000000001e-05 2024-04-26T10:44:47.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:47.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559179+0000", 2024-04-26T10:44:47.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032617444000000002 2024-04-26T10:44:47.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:47.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559220+0000", 2024-04-26T10:44:47.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0364999999999997e-05 2024-04-26T10:44:47.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:47.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559280+0000", 2024-04-26T10:44:47.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0569000000000002e-05 2024-04-26T10:44:47.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560814+0000", 2024-04-26T10:44:47.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015337580000000001 2024-04-26T10:44:47.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.729 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:47.729 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560820+0000", 2024-04-26T10:44:47.729 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.455e-06 2024-04-26T10:44:47.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.729 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:47.729 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560846+0000", 2024-04-26T10:44:47.729 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5228999999999998e-05 2024-04-26T10:44:47.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.729 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:47.730 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560863+0000", 2024-04-26T10:44:47.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7555e-05 2024-04-26T10:44:47.730 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.730 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:47.730 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.730 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:142 3.1a 3:5e41ab69:::200.00000005:head [write 3585931~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:47.730 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:47.730 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 26.095748654000001, 2024-04-26T10:44:47.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034372373999999997, 2024-04-26T10:44:47.730 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:47.730 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.730 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:47.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:47.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:47.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:47.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:47.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:47.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:47.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:47.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.732 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:47.732 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526573+0000", 2024-04-26T10:44:47.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0800000000000002e-06 2024-04-26T10:44:47.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.732 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:47.732 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526580+0000", 2024-04-26T10:44:47.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5799999999999997e-06 2024-04-26T10:44:47.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.732 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.732 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526585+0000", 2024-04-26T10:44:47.733 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2270000000000001e-06 2024-04-26T10:44:47.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.733 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:47.733 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559601+0000", 2024-04-26T10:44:47.733 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033016684999999997 2024-04-26T10:44:47.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.733 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:47.733 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559642+0000", 2024-04-26T10:44:47.734 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0321000000000002e-05 2024-04-26T10:44:47.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.734 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:47.734 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559706+0000", 2024-04-26T10:44:47.734 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4228999999999998e-05 2024-04-26T10:44:47.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.734 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:47.735 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560871+0000", 2024-04-26T10:44:47.735 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001164893 2024-04-26T10:44:47.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.735 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.735 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560899+0000", 2024-04-26T10:44:47.735 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:47.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.735 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:47.735 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560922+0000", 2024-04-26T10:44:47.735 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3337999999999999e-05 2024-04-26T10:44:47.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.735 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:47.736 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560940+0000", 2024-04-26T10:44:47.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7289999999999999e-05 2024-04-26T10:44:47.736 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.736 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:47.736 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.736 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:143 3.1a 3:5e41ab69:::200.00000005:head [write 3587331~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:47.736 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:47.736 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 26.095726756000001, 2024-04-26T10:44:47.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035256000000000003, 2024-04-26T10:44:47.736 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:47.736 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.736 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:47.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.737 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:47.737 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:47.737 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.737 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:47.737 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:47.737 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.737 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:47.737 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:47.737 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:47.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.738 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:47.738 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526592+0000", 2024-04-26T10:44:47.738 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2449999999999998e-06 2024-04-26T10:44:47.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.738 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:47.738 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526596+0000", 2024-04-26T10:44:47.738 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7000000000000002e-06 2024-04-26T10:44:47.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.738 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.738 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526599+0000", 2024-04-26T10:44:47.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6160000000000002e-06 2024-04-26T10:44:47.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.739 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:47.739 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559997+0000", 2024-04-26T10:44:47.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033397835000000001 2024-04-26T10:44:47.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.739 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:47.739 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560051+0000", 2024-04-26T10:44:47.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3742000000000001e-05 2024-04-26T10:44:47.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.739 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:47.739 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560112+0000", 2024-04-26T10:44:47.740 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0851999999999999e-05 2024-04-26T10:44:47.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.740 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:47.740 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561404+0000", 2024-04-26T10:44:47.740 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001291869 2024-04-26T10:44:47.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.741 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.741 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561797+0000", 2024-04-26T10:44:47.741 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039383000000000002 2024-04-26T10:44:47.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.741 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:47.741 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561827+0000", 2024-04-26T10:44:47.741 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9247e-05 2024-04-26T10:44:47.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.741 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:47.741 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561845+0000", 2024-04-26T10:44:47.742 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8462999999999999e-05 2024-04-26T10:44:47.742 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.742 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:47.742 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.742 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:144 3.1a 3:5e41ab69:::200.00000005:head [write 3588736~4987 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:47.742 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:47.742 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 26.095604464000001, 2024-04-26T10:44:47.742 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035224283000000002, 2024-04-26T10:44:47.743 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:47.743 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.743 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:47.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.743 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:47.743 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:47.743 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.743 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:47.743 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:47.743 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.744 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:47.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:47.744 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:47.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.744 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:47.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526718+0000", 2024-04-26T10:44:47.744 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.43e-06 2024-04-26T10:44:47.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.744 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:47.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526726+0000", 2024-04-26T10:44:47.745 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:44:47.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.745 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.745 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526729+0000", 2024-04-26T10:44:47.745 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6480000000000001e-06 2024-04-26T10:44:47.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.745 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:47.745 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560427+0000", 2024-04-26T10:44:47.745 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033697280000000003 2024-04-26T10:44:47.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.745 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:47.745 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560466+0000", 2024-04-26T10:44:47.746 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9606e-05 2024-04-26T10:44:47.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.746 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:47.746 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560525+0000", 2024-04-26T10:44:47.746 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9218000000000001e-05 2024-04-26T10:44:47.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.746 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:47.746 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561854+0000", 2024-04-26T10:44:47.746 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001328421 2024-04-26T10:44:47.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.747 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.747 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561887+0000", 2024-04-26T10:44:47.747 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2746000000000001e-05 2024-04-26T10:44:47.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.747 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:47.747 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561912+0000", 2024-04-26T10:44:47.747 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5126999999999998e-05 2024-04-26T10:44:47.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.747 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:47.747 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561936+0000", 2024-04-26T10:44:47.747 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4032999999999998e-05 2024-04-26T10:44:47.747 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.747 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:47.748 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.748 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:145 3.1a 3:5e41ab69:::200.00000005:head [write 3593723~2939 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:47.748 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:47.748 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 26.092685418999999, 2024-04-26T10:44:47.748 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033294394999999997, 2024-04-26T10:44:47.748 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:47.748 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.748 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:47.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.749 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:47.749 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:47.749 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.749 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:47.749 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:47.749 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.749 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:47.749 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529630+0000", 2024-04-26T10:44:47.749 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:47.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.750 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:47.750 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529635+0000", 2024-04-26T10:44:47.750 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7960000000000003e-06 2024-04-26T10:44:47.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.750 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:47.750 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529643+0000", 2024-04-26T10:44:47.750 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0390000000000005e-06 2024-04-26T10:44:47.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.750 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.750 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529648+0000", 2024-04-26T10:44:47.750 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9599999999999999e-06 2024-04-26T10:44:47.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.751 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:47.751 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560969+0000", 2024-04-26T10:44:47.751 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031321767 2024-04-26T10:44:47.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.752 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:47.752 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561009+0000", 2024-04-26T10:44:47.752 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9904999999999998e-05 2024-04-26T10:44:47.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.752 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:47.752 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561070+0000", 2024-04-26T10:44:47.752 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0708999999999998e-05 2024-04-26T10:44:47.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.752 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:47.752 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562352+0000", 2024-04-26T10:44:47.752 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012818440000000001 2024-04-26T10:44:47.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.753 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.753 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562867+0000", 2024-04-26T10:44:47.753 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000515665 2024-04-26T10:44:47.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.753 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:47.753 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562893+0000", 2024-04-26T10:44:47.753 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5469999999999998e-05 2024-04-26T10:44:47.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.753 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:47.753 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562925+0000", 2024-04-26T10:44:47.753 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1974999999999998e-05 2024-04-26T10:44:47.753 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.754 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:47.754 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.754 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:146 3.1a 3:5e41ab69:::200.00000005:head [write 3596662~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:47.754 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:47.754 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 26.092457204999999, 2024-04-26T10:44:47.754 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033178429000000002, 2024-04-26T10:44:47.754 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:47.754 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.754 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:47.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.754 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:47.755 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:47.755 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.755 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:47.755 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:47.755 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.755 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:47.755 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529858+0000", 2024-04-26T10:44:47.755 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:47.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.755 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:47.756 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529863+0000", 2024-04-26T10:44:47.756 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4500000000000003e-06 2024-04-26T10:44:47.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.756 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:47.756 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529874+0000", 2024-04-26T10:44:47.756 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0552e-05 2024-04-26T10:44:47.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.756 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.756 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529882+0000", 2024-04-26T10:44:47.756 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4449999999999996e-06 2024-04-26T10:44:47.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.756 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:47.757 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561452+0000", 2024-04-26T10:44:47.757 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031569680000000003 2024-04-26T10:44:47.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.757 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:47.757 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561511+0000", 2024-04-26T10:44:47.757 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9332e-05 2024-04-26T10:44:47.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.757 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:47.757 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561583+0000", 2024-04-26T10:44:47.757 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1730000000000006e-05 2024-04-26T10:44:47.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.757 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:47.758 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562933+0000", 2024-04-26T10:44:47.758 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013500059999999999 2024-04-26T10:44:47.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.758 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.758 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562976+0000", 2024-04-26T10:44:47.758 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2987e-05 2024-04-26T10:44:47.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.758 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:47.758 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563015+0000", 2024-04-26T10:44:47.758 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9453999999999999e-05 2024-04-26T10:44:47.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.759 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:47.759 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563037+0000", 2024-04-26T10:44:47.759 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1679e-05 2024-04-26T10:44:47.759 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.759 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:47.759 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.759 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:277 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:47.759 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:47.759 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.107446501999998, 2024-04-26T10:44:47.759 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030430563000000001, 2024-04-26T10:44:47.759 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:47.760 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:47.760 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:47.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.760 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:47.760 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:47.760 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.760 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:47.760 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:47.760 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:47.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.760 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:47.760 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514867+0000", 2024-04-26T10:44:47.761 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:47.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.761 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:47.761 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515460+0000", 2024-04-26T10:44:47.761 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00059285800000000004 2024-04-26T10:44:47.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.761 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:47.761 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515474+0000", 2024-04-26T10:44:47.761 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3933e-05 2024-04-26T10:44:47.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.762 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.762 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:47.762 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515481+0000", 2024-04-26T10:44:47.762 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:47.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.762 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.763 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:47.763 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515522+0000", 2024-04-26T10:44:47.763 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1369000000000003e-05 2024-04-26T10:44:47.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.764 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:47.764 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515591+0000", 2024-04-26T10:44:47.764 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9377999999999999e-05 2024-04-26T10:44:47.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.764 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.764 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:47.765 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.526440+0000", 2024-04-26T10:44:47.765 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010848837 2024-04-26T10:44:47.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.765 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:47.765 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.543866+0000", 2024-04-26T10:44:47.766 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017426288000000002 2024-04-26T10:44:47.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.766 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:47.766 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545193+0000", 2024-04-26T10:44:47.767 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001326111 2024-04-26T10:44:47.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.767 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:47.767 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545229+0000", 2024-04-26T10:44:47.767 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6390999999999998e-05 2024-04-26T10:44:47.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:47.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:47.768 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:47.768 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545300+0000", 2024-04-26T10:44:47.768 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1073000000000002e-05 2024-04-26T10:44:47.768 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.769 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:47.769 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.769 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:47.769 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:47.769 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:47.772 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:47.773 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:47.769+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:47.839 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 8 2024-04-26T10:44:47.852 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T10:44:47.872 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:47.871+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:47.885 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:47.885 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:47.885 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:44:47.885 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:47.894 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:47.973 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:47.972+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:47.996 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:47.997 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:47.997 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:47.997 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:47.997 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:48.005 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:48.089 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:48.088+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:48.146 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-04-26T10:44:48.147 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:48.148 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:48.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:48.148 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:48.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.148 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:330 3.13 3:ceffbd45:::200.0000000a:head [write 1316140~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:48.148 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:48.148 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.632632679, 2024-04-26T10:44:48.148 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022245654, 2024-04-26T10:44:48.148 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:48.148 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:48.148 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:48.148 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.148 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:48.148 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:48.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.149 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.149 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:48.149 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:48.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.149 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.149 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:48.149 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513139+0000", 2024-04-26T10:44:48.149 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:48.149 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.149 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.149 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:48.149 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513149+0000", 2024-04-26T10:44:48.150 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7550000000000006e-06 2024-04-26T10:44:48.150 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.150 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.150 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:48.150 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513157+0000", 2024-04-26T10:44:48.150 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1089999999999998e-06 2024-04-26T10:44:48.150 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.150 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.150 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:48.150 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513167+0000", 2024-04-26T10:44:48.150 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0539e-05 2024-04-26T10:44:48.150 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.150 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.150 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:48.151 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533830+0000", 2024-04-26T10:44:48.151 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020662852999999998 2024-04-26T10:44:48.151 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.151 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.151 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:48.151 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533875+0000", 2024-04-26T10:44:48.151 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.5071999999999998e-05 2024-04-26T10:44:48.151 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.151 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.151 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:48.151 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535319+0000", 2024-04-26T10:44:48.152 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001443578 2024-04-26T10:44:48.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.152 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.152 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:48.152 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535346+0000", 2024-04-26T10:44:48.152 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7415000000000001e-05 2024-04-26T10:44:48.152 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.152 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.152 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:48.152 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535385+0000", 2024-04-26T10:44:48.152 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8912999999999998e-05 2024-04-26T10:44:48.153 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.153 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:48.153 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.153 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.153 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:331 3.13 3:ceffbd45:::200.0000000a:head [write 1318049~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:48.153 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:48.153 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.632593351000001, 2024-04-26T10:44:48.153 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023524521, 2024-04-26T10:44:48.153 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:48.153 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:48.153 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:48.153 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.153 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:48.153 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:48.154 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.154 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.154 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.154 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:48.154 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:48.154 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.154 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.154 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.154 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:48.154 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513178+0000", 2024-04-26T10:44:48.154 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:48.154 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.154 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.154 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:48.155 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513183+0000", 2024-04-26T10:44:48.155 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2549999999999999e-06 2024-04-26T10:44:48.155 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.155 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.155 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:48.155 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513190+0000", 2024-04-26T10:44:48.155 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8460000000000002e-06 2024-04-26T10:44:48.155 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.155 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.155 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:48.155 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513195+0000", 2024-04-26T10:44:48.155 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3630000000000002e-06 2024-04-26T10:44:48.155 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.155 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.155 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:48.155 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534463+0000", 2024-04-26T10:44:48.156 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021267823000000002 2024-04-26T10:44:48.156 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.156 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.156 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:48.156 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534520+0000", 2024-04-26T10:44:48.156 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7510000000000003e-05 2024-04-26T10:44:48.156 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.156 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.156 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:48.156 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536634+0000", 2024-04-26T10:44:48.156 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0021138900000000002 2024-04-26T10:44:48.156 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.156 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.156 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:48.157 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536663+0000", 2024-04-26T10:44:48.157 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8884e-05 2024-04-26T10:44:48.157 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.157 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.157 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:48.157 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536703+0000", 2024-04-26T10:44:48.157 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0479000000000003e-05 2024-04-26T10:44:48.157 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.157 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:48.157 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.157 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.157 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.158 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:332 3.13 3:ceffbd45:::200.0000000a:head [write 1319462~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:48.158 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:48.158 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.632558518, 2024-04-26T10:44:48.158 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024543230999999999, 2024-04-26T10:44:48.158 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:48.158 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:48.158 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:48.158 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.158 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:48.158 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:48.158 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.158 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.158 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.158 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:48.159 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:48.159 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.159 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.159 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.159 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:48.159 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513213+0000", 2024-04-26T10:44:48.159 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:48.159 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.159 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.159 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:48.159 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513217+0000", 2024-04-26T10:44:48.159 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:44:48.159 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.160 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.160 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:48.160 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513229+0000", 2024-04-26T10:44:48.160 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2051e-05 2024-04-26T10:44:48.160 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.160 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.160 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:48.161 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513236+0000", 2024-04-26T10:44:48.161 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4470000000000003e-06 2024-04-26T10:44:48.161 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.161 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.161 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:48.161 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534891+0000", 2024-04-26T10:44:48.161 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021655863000000001 2024-04-26T10:44:48.161 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.161 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.162 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:48.163 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534933+0000", 2024-04-26T10:44:48.163 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1596e-05 2024-04-26T10:44:48.163 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.163 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.163 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:48.163 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537677+0000", 2024-04-26T10:44:48.163 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027440989999999998 2024-04-26T10:44:48.163 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.163 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.163 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:48.163 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537721+0000", 2024-04-26T10:44:48.163 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3813999999999998e-05 2024-04-26T10:44:48.163 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.163 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.164 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:48.164 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537757+0000", 2024-04-26T10:44:48.164 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6022999999999997e-05 2024-04-26T10:44:48.164 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.164 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:48.164 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.164 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.164 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.164 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:333 3.13 3:ceffbd45:::200.0000000a:head [write 1320870~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:48.164 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:48.164 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.632515599000001, 2024-04-26T10:44:48.164 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024557151999999999, 2024-04-26T10:44:48.164 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:48.164 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:48.164 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:48.165 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.165 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:48.165 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:48.165 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.165 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.165 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.165 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:48.165 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:48.165 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.165 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.165 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.165 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:48.165 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513256+0000", 2024-04-26T10:44:48.165 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:48.166 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.166 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.166 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:48.166 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513260+0000", 2024-04-26T10:44:48.166 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6550000000000002e-06 2024-04-26T10:44:48.166 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.166 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.166 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:48.166 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513273+0000", 2024-04-26T10:44:48.166 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2965e-05 2024-04-26T10:44:48.166 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.166 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.166 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:48.166 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513279+0000", 2024-04-26T10:44:48.166 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:44:48.167 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.167 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.167 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:48.167 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535411+0000", 2024-04-26T10:44:48.167 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022132233000000001 2024-04-26T10:44:48.167 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.167 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.167 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:48.167 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535479+0000", 2024-04-26T10:44:48.167 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7554999999999999e-05 2024-04-26T10:44:48.167 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.167 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.167 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:48.167 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537762+0000", 2024-04-26T10:44:48.167 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022836499999999999 2024-04-26T10:44:48.168 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.168 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.168 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:48.168 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537783+0000", 2024-04-26T10:44:48.168 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0364e-05 2024-04-26T10:44:48.168 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.168 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.168 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:48.168 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537814+0000", 2024-04-26T10:44:48.168 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1170000000000001e-05 2024-04-26T10:44:48.168 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.168 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:48.168 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.168 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.168 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.169 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:334 3.13 3:ceffbd45:::200.0000000a:head [write 1322273~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:48.169 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:48.169 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.630678840000002, 2024-04-26T10:44:48.169 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022778731999999999, 2024-04-26T10:44:48.169 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:48.169 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:48.169 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:48.169 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.169 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:48.169 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:48.169 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.169 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.169 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.169 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:48.169 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:48.170 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.170 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.170 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.170 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:48.170 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:48.170 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:48.170 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.170 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.170 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:48.170 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515099+0000", 2024-04-26T10:44:48.170 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6599999999999998e-06 2024-04-26T10:44:48.170 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.170 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.170 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:48.170 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515112+0000", 2024-04-26T10:44:48.171 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2707e-05 2024-04-26T10:44:48.171 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.171 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.171 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:48.171 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515120+0000", 2024-04-26T10:44:48.171 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8509999999999999e-06 2024-04-26T10:44:48.171 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.171 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.171 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:48.171 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535792+0000", 2024-04-26T10:44:48.171 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020672209 2024-04-26T10:44:48.171 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.171 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.171 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:48.171 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535833+0000", 2024-04-26T10:44:48.172 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1415000000000002e-05 2024-04-26T10:44:48.172 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.172 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.172 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:48.172 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537818+0000", 2024-04-26T10:44:48.172 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0019850900000000001 2024-04-26T10:44:48.172 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.172 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.172 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:48.172 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537839+0000", 2024-04-26T10:44:48.172 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0068000000000002e-05 2024-04-26T10:44:48.172 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.172 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.172 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:48.172 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537872+0000", 2024-04-26T10:44:48.173 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3680999999999998e-05 2024-04-26T10:44:48.173 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.173 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:48.173 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.173 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.173 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.173 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:335 3.13 3:ceffbd45:::200.0000000a:head [write 1325230~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:48.173 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:48.173 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.630639741, 2024-04-26T10:44:48.173 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023487081, 2024-04-26T10:44:48.173 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:48.173 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:48.173 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:48.173 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.173 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:48.174 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:48.174 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.174 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.174 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.174 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:48.174 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:48.174 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.174 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.174 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.174 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:48.174 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515132+0000", 2024-04-26T10:44:48.174 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:48.174 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.174 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.175 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:48.175 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515136+0000", 2024-04-26T10:44:48.175 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0860000000000004e-06 2024-04-26T10:44:48.175 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.175 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.175 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:48.175 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515143+0000", 2024-04-26T10:44:48.175 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.0400000000000004e-06 2024-04-26T10:44:48.175 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.175 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.175 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:48.175 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515149+0000", 2024-04-26T10:44:48.175 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0789999999999997e-06 2024-04-26T10:44:48.175 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.175 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.176 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:48.176 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536200+0000", 2024-04-26T10:44:48.176 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021050993 2024-04-26T10:44:48.176 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.176 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.176 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:48.176 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536253+0000", 2024-04-26T10:44:48.176 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.2643999999999999e-05 2024-04-26T10:44:48.176 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.176 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.176 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:48.176 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538560+0000", 2024-04-26T10:44:48.176 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0023073389999999998 2024-04-26T10:44:48.176 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.177 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.177 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:48.177 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538584+0000", 2024-04-26T10:44:48.177 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3893999999999999e-05 2024-04-26T10:44:48.177 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.177 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.177 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:48.177 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538620+0000", 2024-04-26T10:44:48.177 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5611000000000002e-05 2024-04-26T10:44:48.177 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.177 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:48.177 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.177 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.177 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.177 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:336 3.13 3:ceffbd45:::200.0000000a:head [write 1327147~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:48.178 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:48.178 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.629307286, 2024-04-26T10:44:48.178 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027687066, 2024-04-26T10:44:48.178 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:48.178 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:48.178 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:48.178 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.178 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:48.178 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:48.178 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.178 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.178 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.178 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:48.178 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:48.178 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.179 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.179 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.179 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:48.179 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516464+0000", 2024-04-26T10:44:48.179 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:48.179 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.179 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.179 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:48.179 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516491+0000", 2024-04-26T10:44:48.179 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6539000000000001e-05 2024-04-26T10:44:48.179 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.179 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.179 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:48.179 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516500+0000", 2024-04-26T10:44:48.179 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5480000000000007e-06 2024-04-26T10:44:48.180 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.180 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.180 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:48.180 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516511+0000", 2024-04-26T10:44:48.180 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0719e-05 2024-04-26T10:44:48.180 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.180 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.180 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:48.180 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536737+0000", 2024-04-26T10:44:48.180 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020225770000000001 2024-04-26T10:44:48.180 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.180 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.180 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:48.180 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536783+0000", 2024-04-26T10:44:48.181 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6168999999999998e-05 2024-04-26T10:44:48.181 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.181 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.181 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:48.181 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544080+0000", 2024-04-26T10:44:48.181 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0072966799999999998 2024-04-26T10:44:48.181 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.181 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.181 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:48.181 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544111+0000", 2024-04-26T10:44:48.181 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1056999999999998e-05 2024-04-26T10:44:48.181 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.181 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.181 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:48.182 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544152+0000", 2024-04-26T10:44:48.182 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1452000000000002e-05 2024-04-26T10:44:48.182 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.182 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:48.182 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.182 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.182 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.182 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:337 3.13 3:ceffbd45:::200.0000000a:head [write 1342136~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:48.182 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:48.182 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.629254348, 2024-04-26T10:44:48.182 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027711237, 2024-04-26T10:44:48.182 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:48.182 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:48.182 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:48.183 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.183 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:48.183 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:48.183 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.183 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.183 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.183 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:48.183 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:48.183 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.183 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.183 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.183 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:48.183 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516517+0000", 2024-04-26T10:44:48.183 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:48.183 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.184 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.184 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:48.184 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516521+0000", 2024-04-26T10:44:48.184 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6200000000000001e-06 2024-04-26T10:44:48.184 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.184 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.184 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:48.184 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516528+0000", 2024-04-26T10:44:48.184 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8639999999999998e-06 2024-04-26T10:44:48.184 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.184 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.184 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:48.184 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516533+0000", 2024-04-26T10:44:48.184 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6310000000000002e-06 2024-04-26T10:44:48.185 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.185 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.185 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:48.185 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537231+0000", 2024-04-26T10:44:48.185 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020698613000000001 2024-04-26T10:44:48.185 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.185 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.185 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:48.185 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537273+0000", 2024-04-26T10:44:48.185 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1529000000000002e-05 2024-04-26T10:44:48.185 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.185 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.185 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:48.185 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544157+0000", 2024-04-26T10:44:48.185 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068847090000000001 2024-04-26T10:44:48.185 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.186 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.186 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:48.186 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544180+0000", 2024-04-26T10:44:48.186 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.2532e-05 2024-04-26T10:44:48.186 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.186 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.186 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:48.186 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544229+0000", 2024-04-26T10:44:48.186 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9190000000000002e-05 2024-04-26T10:44:48.186 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.186 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:48.186 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.186 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.186 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.187 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:338 3.13 3:ceffbd45:::200.0000000a:head [write 1344569~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:48.187 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:48.187 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.628588095000001, 2024-04-26T10:44:48.187 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027105598000000002, 2024-04-26T10:44:48.187 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:48.187 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:48.187 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:48.187 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.187 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:48.187 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:48.187 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.187 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.187 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.187 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:48.187 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:48.188 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.188 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.188 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.188 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:48.188 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517183+0000", 2024-04-26T10:44:48.188 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:48.188 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.188 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.188 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:48.188 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517188+0000", 2024-04-26T10:44:48.188 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7389999999999999e-06 2024-04-26T10:44:48.188 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.188 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.188 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:48.189 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517199+0000", 2024-04-26T10:44:48.189 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0652000000000001e-05 2024-04-26T10:44:48.189 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.189 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.189 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:48.189 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517206+0000", 2024-04-26T10:44:48.189 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6610000000000003e-06 2024-04-26T10:44:48.189 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.189 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.189 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:48.189 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537905+0000", 2024-04-26T10:44:48.189 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020699662000000001 2024-04-26T10:44:48.189 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.189 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.190 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:48.190 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537956+0000", 2024-04-26T10:44:48.190 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0954e-05 2024-04-26T10:44:48.190 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.190 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.190 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:48.190 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544233+0000", 2024-04-26T10:44:48.190 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062773009999999999 2024-04-26T10:44:48.190 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.190 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.190 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:48.190 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544258+0000", 2024-04-26T10:44:48.190 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4434999999999999e-05 2024-04-26T10:44:48.190 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.191 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.191 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:48.191 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544290+0000", 2024-04-26T10:44:48.191 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1918000000000002e-05 2024-04-26T10:44:48.191 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.191 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:48.191 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.191 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.191 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.191 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:339 3.13 3:ceffbd45:::200.0000000a:head [write 1346485~4322 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:48.191 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:48.191 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.627649601999998, 2024-04-26T10:44:48.191 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026221617999999999, 2024-04-26T10:44:48.191 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:48.192 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:48.192 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:48.192 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.192 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:48.192 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:48.192 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.192 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.192 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.192 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:48.192 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:48.192 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.192 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.192 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.192 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:48.193 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518122+0000", 2024-04-26T10:44:48.193 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:48.193 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.193 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.193 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:48.193 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518129+0000", 2024-04-26T10:44:48.193 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.43e-06 2024-04-26T10:44:48.193 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.193 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.193 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:48.193 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518138+0000", 2024-04-26T10:44:48.193 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9129999999999992e-06 2024-04-26T10:44:48.193 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.193 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.193 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:48.194 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518144+0000", 2024-04-26T10:44:48.194 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.1419999999999998e-06 2024-04-26T10:44:48.194 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.194 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.194 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:48.194 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538232+0000", 2024-04-26T10:44:48.194 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020087383 2024-04-26T10:44:48.194 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.194 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.194 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:48.194 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538274+0000", 2024-04-26T10:44:48.194 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2602999999999999e-05 2024-04-26T10:44:48.194 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.194 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.195 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:48.195 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544294+0000", 2024-04-26T10:44:48.195 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060194059999999997 2024-04-26T10:44:48.195 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.195 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.195 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:48.195 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544314+0000", 2024-04-26T10:44:48.195 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0091000000000001e-05 2024-04-26T10:44:48.195 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.195 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.195 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:48.195 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544344+0000", 2024-04-26T10:44:48.195 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0446e-05 2024-04-26T10:44:48.195 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.195 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:48.196 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.196 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.196 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.196 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:340 3.13 3:ceffbd45:::200.0000000a:head [write 1350807~2768 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:48.196 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:48.196 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.625165366000001, 2024-04-26T10:44:48.196 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023795594, 2024-04-26T10:44:48.196 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:48.196 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:48.196 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:48.196 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.196 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:48.196 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:48.196 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.196 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.197 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.197 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:48.197 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:48.197 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.197 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.197 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.197 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:48.197 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520606+0000", 2024-04-26T10:44:48.197 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:48.197 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.197 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.197 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:48.197 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520612+0000", 2024-04-26T10:44:48.197 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.835e-06 2024-04-26T10:44:48.198 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.198 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.198 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:48.198 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520622+0000", 2024-04-26T10:44:48.198 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0173999999999999e-05 2024-04-26T10:44:48.198 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.198 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.198 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:48.198 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520629+0000", 2024-04-26T10:44:48.198 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7460000000000003e-06 2024-04-26T10:44:48.198 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.198 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.198 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:48.198 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538651+0000", 2024-04-26T10:44:48.198 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018022474 2024-04-26T10:44:48.199 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.199 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.199 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:48.199 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538697+0000", 2024-04-26T10:44:48.199 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6183999999999997e-05 2024-04-26T10:44:48.199 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.199 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.199 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:48.199 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544348+0000", 2024-04-26T10:44:48.199 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0056503509999999996 2024-04-26T10:44:48.199 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.199 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.199 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:48.199 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544369+0000", 2024-04-26T10:44:48.199 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1064999999999999e-05 2024-04-26T10:44:48.200 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.200 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.200 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:48.200 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544403+0000", 2024-04-26T10:44:48.200 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3695000000000002e-05 2024-04-26T10:44:48.200 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.200 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:48.200 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.200 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.200 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.200 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:341 3.13 3:ceffbd45:::200.0000000a:head [write 1353575~3816 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:48.200 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:48.200 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.624430110999999, 2024-04-26T10:44:48.200 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023114967, 2024-04-26T10:44:48.200 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:48.201 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:48.201 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:48.201 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.201 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:48.201 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:48.201 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.201 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.201 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.201 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:48.201 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:48.201 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.201 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.201 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.201 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:48.201 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521341+0000", 2024-04-26T10:44:48.201 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:48.202 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.202 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.202 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:48.202 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521349+0000", 2024-04-26T10:44:48.202 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1550000000000001e-06 2024-04-26T10:44:48.202 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.202 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.202 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:48.202 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521358+0000", 2024-04-26T10:44:48.202 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.1500000000000005e-06 2024-04-26T10:44:48.202 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.202 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.202 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:48.203 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521364+0000", 2024-04-26T10:44:48.203 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3289999999999999e-06 2024-04-26T10:44:48.203 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.203 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.203 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:48.203 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539010+0000", 2024-04-26T10:44:48.203 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.017645965999999999 2024-04-26T10:44:48.203 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.203 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.203 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:48.203 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539051+0000", 2024-04-26T10:44:48.203 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.053e-05 2024-04-26T10:44:48.203 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.203 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.204 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:48.204 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544407+0000", 2024-04-26T10:44:48.204 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053560209999999999 2024-04-26T10:44:48.204 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.204 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.204 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:48.204 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544427+0000", 2024-04-26T10:44:48.204 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0228e-05 2024-04-26T10:44:48.204 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.204 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.204 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:48.204 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544457+0000", 2024-04-26T10:44:48.204 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0375e-05 2024-04-26T10:44:48.204 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.204 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:48.205 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.205 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.205 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.205 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11582 4.2f 4:f76ba295:::10000003252.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:48.205 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:48.205 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 19.150814566000001, 2024-04-26T10:44:48.205 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024553994999999999, 2024-04-26T10:44:48.205 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:48.205 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:48.205 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:48.205 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:48.206 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:48.206 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11582 2024-04-26T10:44:48.206 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.206 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:48.206 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.206 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:48.206 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:48.206 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.206 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.206 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.206 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:48.206 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:48.206 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.206 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.206 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.207 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:48.207 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994957+0000", 2024-04-26T10:44:48.207 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:48.207 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.207 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.207 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:48.207 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002755+0000", 2024-04-26T10:44:48.207 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0077984719999999999 2024-04-26T10:44:48.207 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.207 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.207 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:48.207 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002770+0000", 2024-04-26T10:44:48.207 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4956e-05 2024-04-26T10:44:48.207 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.208 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.208 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:48.208 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002777+0000", 2024-04-26T10:44:48.208 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1899999999999998e-06 2024-04-26T10:44:48.208 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.208 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.208 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:48.208 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002833+0000", 2024-04-26T10:44:48.208 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5189999999999998e-05 2024-04-26T10:44:48.208 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.208 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.208 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:48.208 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002977+0000", 2024-04-26T10:44:48.208 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014444100000000001 2024-04-26T10:44:48.208 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.209 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.209 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:48.209 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.003108+0000", 2024-04-26T10:44:48.209 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000131068 2024-04-26T10:44:48.210 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.210 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.210 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:48.210 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.009040+0000", 2024-04-26T10:44:48.210 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059314149999999998 2024-04-26T10:44:48.211 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.211 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.211 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:48.211 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019462+0000", 2024-04-26T10:44:48.211 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010422803 2024-04-26T10:44:48.211 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.211 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.211 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:48.211 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019490+0000", 2024-04-26T10:44:48.211 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7773999999999999e-05 2024-04-26T10:44:48.211 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.211 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.211 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:48.211 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019512+0000", 2024-04-26T10:44:48.211 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1611999999999999e-05 2024-04-26T10:44:48.212 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.212 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:48.212 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.212 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.212 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.212 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11911 4.37 4:ec04ab04:::100000031ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:48.212 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:48.212 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 18.809094358999999, 2024-04-26T10:44:48.212 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026810273999999999, 2024-04-26T10:44:48.212 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:48.212 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:48.212 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:48.213 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:48.213 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:48.213 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11911 2024-04-26T10:44:48.213 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.213 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:48.213 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.213 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:48.213 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:48.213 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.213 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.214 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.214 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:48.214 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:48.214 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.214 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.214 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.214 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:48.214 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336676+0000", 2024-04-26T10:44:48.214 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:48.214 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.214 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.215 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:48.215 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343119+0000", 2024-04-26T10:44:48.215 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0064424850000000004 2024-04-26T10:44:48.215 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.215 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.215 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:48.215 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343131+0000", 2024-04-26T10:44:48.215 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1708e-05 2024-04-26T10:44:48.215 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.215 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.215 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:48.215 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343137+0000", 2024-04-26T10:44:48.215 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9880000000000001e-06 2024-04-26T10:44:48.216 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.216 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.216 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:48.216 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343175+0000", 2024-04-26T10:44:48.216 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7913000000000001e-05 2024-04-26T10:44:48.216 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.216 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.216 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:48.216 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343269+0000", 2024-04-26T10:44:48.216 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4931000000000003e-05 2024-04-26T10:44:48.216 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.216 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.216 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:48.216 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343392+0000", 2024-04-26T10:44:48.217 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000122435 2024-04-26T10:44:48.217 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.217 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.217 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:48.217 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.347520+0000", 2024-04-26T10:44:48.217 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004128418 2024-04-26T10:44:48.217 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.217 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.217 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:48.217 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363410+0000", 2024-04-26T10:44:48.217 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.015889309000000001 2024-04-26T10:44:48.218 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.218 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.218 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:48.218 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363453+0000", 2024-04-26T10:44:48.218 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3244000000000001e-05 2024-04-26T10:44:48.218 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.218 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.218 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:48.218 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363488+0000", 2024-04-26T10:44:48.218 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5318000000000003e-05 2024-04-26T10:44:48.218 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.218 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:48.218 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.219 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.219 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.219 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12000 4.3c 4:3c2be35d:::100000030f7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:48.219 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:48.219 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 18.726472847, 2024-04-26T10:44:48.219 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022808264000000002, 2024-04-26T10:44:48.219 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:48.219 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:48.219 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:48.219 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:48.219 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:48.219 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12000 2024-04-26T10:44:48.219 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.220 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:48.220 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.220 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:48.220 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:48.220 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.220 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.220 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.220 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:48.220 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:48.221 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.221 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.221 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.221 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:48.221 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:48.221 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:48.221 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.221 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.221 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:48.221 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430937+0000", 2024-04-26T10:44:48.221 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.011638097 2024-04-26T10:44:48.221 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.221 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.221 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:48.222 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430948+0000", 2024-04-26T10:44:48.222 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0824e-05 2024-04-26T10:44:48.222 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.222 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.222 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:48.222 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430953+0000", 2024-04-26T10:44:48.222 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5219999999999998e-06 2024-04-26T10:44:48.222 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.222 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.222 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:48.222 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430990+0000", 2024-04-26T10:44:48.222 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6458999999999998e-05 2024-04-26T10:44:48.222 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.222 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.223 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:48.223 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.431052+0000", 2024-04-26T10:44:48.223 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2687000000000005e-05 2024-04-26T10:44:48.223 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.223 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.223 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:48.223 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442027+0000", 2024-04-26T10:44:48.223 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010974513 2024-04-26T10:44:48.223 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.223 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.223 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:48.223 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442060+0000", 2024-04-26T10:44:48.223 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2849999999999999e-05 2024-04-26T10:44:48.223 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.223 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.224 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:48.224 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442108+0000", 2024-04-26T10:44:48.224 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8031999999999997e-05 2024-04-26T10:44:48.224 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.224 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:48.224 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.224 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.224 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.224 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12042 4.2f 4:f741970f:::10000003414.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:48.224 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:48.224 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 18.687219370000001, 2024-04-26T10:44:48.224 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.029390757, 2024-04-26T10:44:48.224 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:48.224 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:48.225 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:48.225 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:48.225 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:48.225 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12042 2024-04-26T10:44:48.225 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.225 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:48.225 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.225 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:48.225 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:48.225 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.225 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.225 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.225 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:48.225 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:48.225 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.225 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.226 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.226 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:48.226 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458552+0000", 2024-04-26T10:44:48.226 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:48.226 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.226 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.226 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:48.226 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464335+0000", 2024-04-26T10:44:48.226 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.005783168 2024-04-26T10:44:48.226 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.226 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.226 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:48.226 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464347+0000", 2024-04-26T10:44:48.226 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1578e-05 2024-04-26T10:44:48.227 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.227 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.227 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:48.227 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464353+0000", 2024-04-26T10:44:48.227 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3709999999999996e-06 2024-04-26T10:44:48.227 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.227 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.227 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:48.227 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464407+0000", 2024-04-26T10:44:48.227 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3717000000000001e-05 2024-04-26T10:44:48.227 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.228 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.228 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:48.228 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464556+0000", 2024-04-26T10:44:48.228 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014899100000000001 2024-04-26T10:44:48.228 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.228 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.228 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:48.228 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464688+0000", 2024-04-26T10:44:48.228 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013238599999999999 2024-04-26T10:44:48.229 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.229 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.229 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:48.229 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.469725+0000", 2024-04-26T10:44:48.229 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0050369229999999996 2024-04-26T10:44:48.229 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.229 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.229 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:48.229 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487892+0000", 2024-04-26T10:44:48.230 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018167184999999999 2024-04-26T10:44:48.230 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.230 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.230 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:48.230 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487922+0000", 2024-04-26T10:44:48.230 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.9495000000000001e-05 2024-04-26T10:44:48.230 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.230 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.230 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:48.230 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487944+0000", 2024-04-26T10:44:48.231 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1823000000000001e-05 2024-04-26T10:44:48.231 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.231 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:48.231 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.231 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.231 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.231 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12050 4.2c 4:36b72e58:::100000031ba.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:48.231 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:48.231 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 18.678678761, 2024-04-26T10:44:48.231 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022722497000000001, 2024-04-26T10:44:48.231 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:48.231 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:48.231 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:48.231 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:48.232 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:48.232 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12050 2024-04-26T10:44:48.232 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.232 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:48.232 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.232 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:48.232 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:48.232 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.232 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.232 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.232 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:48.232 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:48.232 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.232 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.232 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.233 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:48.233 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467093+0000", 2024-04-26T10:44:48.233 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:48.233 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.233 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.233 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:48.233 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476305+0000", 2024-04-26T10:44:48.233 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092125850000000006 2024-04-26T10:44:48.234 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.234 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.234 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:48.234 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476322+0000", 2024-04-26T10:44:48.234 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6860000000000001e-05 2024-04-26T10:44:48.234 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.234 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.234 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:48.234 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476328+0000", 2024-04-26T10:44:48.234 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.587e-06 2024-04-26T10:44:48.234 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.234 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.234 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:48.234 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476378+0000", 2024-04-26T10:44:48.235 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0519999999999997e-05 2024-04-26T10:44:48.235 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.235 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.235 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:48.235 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476474+0000", 2024-04-26T10:44:48.235 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5556000000000005e-05 2024-04-26T10:44:48.235 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.235 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.235 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:48.235 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489677+0000", 2024-04-26T10:44:48.235 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013203048 2024-04-26T10:44:48.235 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.235 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.236 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:48.236 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489722+0000", 2024-04-26T10:44:48.236 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4650000000000001e-05 2024-04-26T10:44:48.236 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.236 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.236 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:48.236 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489816+0000", 2024-04-26T10:44:48.237 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4402999999999997e-05 2024-04-26T10:44:48.237 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.237 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:48.237 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.237 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.237 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.237 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12516 4.37 4:ed0cb515:::10000003324.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:48.237 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:48.237 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 18.158597195999999, 2024-04-26T10:44:48.237 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.030139677, 2024-04-26T10:44:48.237 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:48.237 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:48.237 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:48.237 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:48.238 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:48.238 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12516 2024-04-26T10:44:48.238 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.238 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:48.238 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.238 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:48.238 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:48.238 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.238 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.238 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.238 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:48.238 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:48.238 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.238 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.239 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.239 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:48.239 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987173+0000", 2024-04-26T10:44:48.239 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:48.239 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.239 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.239 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:48.239 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991339+0000", 2024-04-26T10:44:48.239 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0041663760000000003 2024-04-26T10:44:48.239 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.239 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.239 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:48.239 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991351+0000", 2024-04-26T10:44:48.239 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1333e-05 2024-04-26T10:44:48.240 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.240 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.240 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:48.240 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991357+0000", 2024-04-26T10:44:48.240 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3350000000000003e-06 2024-04-26T10:44:48.240 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.240 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.240 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:48.240 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991394+0000", 2024-04-26T10:44:48.240 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7054000000000001e-05 2024-04-26T10:44:48.240 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.240 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.240 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:48.240 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991495+0000", 2024-04-26T10:44:48.241 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000100386 2024-04-26T10:44:48.241 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.241 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.241 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:48.241 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991579+0000", 2024-04-26T10:44:48.241 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4295000000000005e-05 2024-04-26T10:44:48.241 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.241 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.241 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:48.241 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.996238+0000", 2024-04-26T10:44:48.241 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0046589309999999998 2024-04-26T10:44:48.241 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.241 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.241 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:48.241 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017237+0000", 2024-04-26T10:44:48.241 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020998993000000001 2024-04-26T10:44:48.242 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.242 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.242 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:48.242 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017280+0000", 2024-04-26T10:44:48.242 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3600000000000003e-05 2024-04-26T10:44:48.242 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.242 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.242 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:48.242 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017315+0000", 2024-04-26T10:44:48.242 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4381999999999997e-05 2024-04-26T10:44:48.242 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.242 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:48.242 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.242 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.242 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.243 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12644 4.37 4:ec5044d7:::100000032d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:48.243 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:48.243 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 17.984924368000001, 2024-04-26T10:44:48.243 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.037018677, 2024-04-26T10:44:48.243 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:48.243 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:48.243 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:48.243 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:48.243 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:48.243 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12644 2024-04-26T10:44:48.243 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.243 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:48.243 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.243 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:48.244 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:48.244 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.244 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.244 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.244 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:48.244 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:48.244 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.244 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.244 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.244 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:48.244 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160847+0000", 2024-04-26T10:44:48.244 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:48.244 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.244 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.245 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:48.245 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170089+0000", 2024-04-26T10:44:48.245 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092424289999999999 2024-04-26T10:44:48.245 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.245 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.245 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:48.245 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170111+0000", 2024-04-26T10:44:48.245 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1733e-05 2024-04-26T10:44:48.245 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.245 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.245 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:48.245 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170124+0000", 2024-04-26T10:44:48.245 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.272e-05 2024-04-26T10:44:48.245 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.245 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.246 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:48.246 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170177+0000", 2024-04-26T10:44:48.246 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3745000000000001e-05 2024-04-26T10:44:48.246 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.246 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.246 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:48.246 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170350+0000", 2024-04-26T10:44:48.246 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017297699999999999 2024-04-26T10:44:48.246 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.246 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.246 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:48.246 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170458+0000", 2024-04-26T10:44:48.246 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000107583 2024-04-26T10:44:48.246 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.246 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.247 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:48.247 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.176693+0000", 2024-04-26T10:44:48.247 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062351799999999999 2024-04-26T10:44:48.247 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.247 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.247 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:48.247 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197774+0000", 2024-04-26T10:44:48.247 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021080471999999999 2024-04-26T10:44:48.247 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.247 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.247 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:48.247 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197824+0000", 2024-04-26T10:44:48.247 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0096000000000003e-05 2024-04-26T10:44:48.247 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.247 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.248 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:48.248 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197867+0000", 2024-04-26T10:44:48.248 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2882e-05 2024-04-26T10:44:48.248 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.248 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:48.248 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.248 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.248 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.248 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:13242 4.2f 4:f5e54bb5:::100000033c8.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:48.248 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:48.248 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 17.30669323, 2024-04-26T10:44:48.248 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023873062, 2024-04-26T10:44:48.249 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:48.249 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:48.249 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:48.249 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:48.249 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:48.249 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 13242 2024-04-26T10:44:48.249 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.249 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:48.249 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.249 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:48.249 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:48.249 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.249 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.249 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.249 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:48.250 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:48.250 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:48.250 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.250 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.250 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:48.250 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839078+0000", 2024-04-26T10:44:48.250 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:48.250 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.250 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.250 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:48.250 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848098+0000", 2024-04-26T10:44:48.251 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090200750000000007 2024-04-26T10:44:48.251 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.251 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.251 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:48.251 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848108+0000", 2024-04-26T10:44:48.251 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.062e-05 2024-04-26T10:44:48.251 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.251 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.252 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:48.252 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848115+0000", 2024-04-26T10:44:48.252 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3040000000000001e-06 2024-04-26T10:44:48.252 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.252 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.252 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:48.252 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848157+0000", 2024-04-26T10:44:48.252 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2533000000000001e-05 2024-04-26T10:44:48.252 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.252 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.252 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:48.252 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848252+0000", 2024-04-26T10:44:48.252 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4480000000000003e-05 2024-04-26T10:44:48.252 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.252 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.253 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:48.253 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848393+0000", 2024-04-26T10:44:48.253 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000140863 2024-04-26T10:44:48.253 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.253 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.253 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:48.253 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.854434+0000", 2024-04-26T10:44:48.253 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060415590000000002 2024-04-26T10:44:48.253 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.253 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.253 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:48.253 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862894+0000", 2024-04-26T10:44:48.253 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0084598869999999993 2024-04-26T10:44:48.253 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.254 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.254 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:48.254 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862926+0000", 2024-04-26T10:44:48.254 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1473999999999997e-05 2024-04-26T10:44:48.254 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:48.254 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:48.254 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:48.254 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862952+0000", 2024-04-26T10:44:48.254 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6545000000000001e-05 2024-04-26T10:44:48.254 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.254 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:48.254 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.254 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:48.255 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:48.255 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:48.257 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T10:44:48.257 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:48.255+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:48.257 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:48.357 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:48.355+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:48.376 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:48.376 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:48.377 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:44:48.377 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:48.386 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:48.400 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:44:48.470 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:48.468+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:48.525 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:48.526 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:48.526 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:48.536 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:48.536 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:48.543 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:48.544 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:48.546 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:48.547 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:48.547 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:48.554 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-04-26T10:44:48.568 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T10:44:48.587 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:48.585+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:48.660 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:48.659+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:48.693 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:48.693 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:48.702 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:48.761 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:48.759+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:48.805 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:44:48.806 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:48.806 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:48.814 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:48.862 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:48.860+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:48.921 INFO:teuthology.orchestra.run.smithi049.stderr:listed 0 entries 2024-04-26T10:44:48.935 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-04-26T10:44:48.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T10:44:48.936 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-26T10:44:48.957 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:48.957 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:48.961 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[31578]: fuse finished with error 0 and tester_r 0 2024-04-26T10:44:48.962 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:44:48.964 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:48.962+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:48.967 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:49.064 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:49.062+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:49.077 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:49.078 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:49.086 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:49.165 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:49.163+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:49.202 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:49.202 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:49.211 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:49.266 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:49.264+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:49.317 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:49.318 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:49.326 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:49.367 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:49.366+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:49.469 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:49.467+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:49.473 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:49.473 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:49.482 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:49.570 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:49.568+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:49.585 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:49.585 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:49.593 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:49.670 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:49.669+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:49.695 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:49.695 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:49.704 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:49.706 INFO:teuthology.orchestra.run.smithi049.stderr:nodeep-scrub is set 2024-04-26T10:44:49.772 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:49.770+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:49.805 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:49.806 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:49.814 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:49.873 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:49.871+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:49.934 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:49.934 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:49.943 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:49.984 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:49.982+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:50.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~94s 2024-04-26T10:44:50.077 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:50.073+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:50.091 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:50.091 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:50.100 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:50.185 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:50.183+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:50.247 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:50.247 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:50.256 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:50.300 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:50.299+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:50.361 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:50.361 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:50.369 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:50.411 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:50.409+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:50.478 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:50.477+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:50.510 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:50.510 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:50.519 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:50.548 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:44:50.579 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:50.578+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:50.660 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:50.660 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:50.668 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:50.685 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:50.685 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:50.685 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:50.704 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:50.704 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:50.707 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:50.708 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:50.714 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:50.712+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:50.780 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:50.779+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:50.786 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:50.786 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:50.786 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:44:50.786 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:50.796 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:50.881 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:50.880+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:50.942 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:50.942 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:50.943 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:50.943 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:50.943 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:50.951 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:50.992 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:50.990+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:51.084 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:51.083+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:51.099 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:51.099 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:51.099 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:51.099 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:51.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.100 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:80 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:51.100 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:51.100 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.574610694, 2024-04-26T10:44:51.100 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029259192, 2024-04-26T10:44:51.100 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:51.100 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.100 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:51.100 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.100 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:51.100 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:51.100 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.101 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:51.101 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:51.101 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.101 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:51.101 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522252+0000", 2024-04-26T10:44:51.101 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:51.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.101 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:51.101 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523121+0000", 2024-04-26T10:44:51.101 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00086885100000000002 2024-04-26T10:44:51.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.102 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.102 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:51.102 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523133+0000", 2024-04-26T10:44:51.102 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2109999999999999e-05 2024-04-26T10:44:51.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.102 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.102 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.102 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523139+0000", 2024-04-26T10:44:51.102 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.541e-06 2024-04-26T10:44:51.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.103 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.103 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:51.103 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523176+0000", 2024-04-26T10:44:51.103 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6847999999999997e-05 2024-04-26T10:44:51.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.103 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.103 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:51.103 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523240+0000", 2024-04-26T10:44:51.103 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3941000000000003e-05 2024-04-26T10:44:51.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.103 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.103 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:51.103 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.536390+0000", 2024-04-26T10:44:51.103 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013150811 2024-04-26T10:44:51.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.104 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.104 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551071+0000", 2024-04-26T10:44:51.104 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014680021 2024-04-26T10:44:51.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.104 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:51.104 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551428+0000", 2024-04-26T10:44:51.104 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00035703900000000002 2024-04-26T10:44:51.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.104 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:51.104 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551462+0000", 2024-04-26T10:44:51.104 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4337e-05 2024-04-26T10:44:51.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.105 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:51.105 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551513+0000", 2024-04-26T10:44:51.105 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0875000000000003e-05 2024-04-26T10:44:51.105 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.105 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:51.105 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.105 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:129 3.1a 3:5e41ab69:::200.00000005:head [write 3557843~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:51.105 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:51.105 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.570552624000001, 2024-04-26T10:44:51.105 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029108253000000001, 2024-04-26T10:44:51.105 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:51.106 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.106 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:51.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.106 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:51.106 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:51.106 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.106 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:51.106 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:51.106 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.106 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:51.107 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526311+0000", 2024-04-26T10:44:51.107 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:51.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.107 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:51.107 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526315+0000", 2024-04-26T10:44:51.107 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4809999999999998e-06 2024-04-26T10:44:51.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.107 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:51.107 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526319+0000", 2024-04-26T10:44:51.107 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0690000000000003e-06 2024-04-26T10:44:51.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.109 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.109 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526321+0000", 2024-04-26T10:44:51.109 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4880000000000001e-06 2024-04-26T10:44:51.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.109 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:51.109 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553856+0000", 2024-04-26T10:44:51.109 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027534916 2024-04-26T10:44:51.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.110 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:51.110 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553900+0000", 2024-04-26T10:44:51.110 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3954e-05 2024-04-26T10:44:51.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.110 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:51.110 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553962+0000", 2024-04-26T10:44:51.110 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1519000000000005e-05 2024-04-26T10:44:51.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.110 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:51.110 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555348+0000", 2024-04-26T10:44:51.110 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013864579999999999 2024-04-26T10:44:51.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.111 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.111 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555378+0000", 2024-04-26T10:44:51.111 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9441000000000002e-05 2024-04-26T10:44:51.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.111 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:51.111 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555401+0000", 2024-04-26T10:44:51.111 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2815000000000001e-05 2024-04-26T10:44:51.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.111 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:51.111 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555420+0000", 2024-04-26T10:44:51.111 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9341e-05 2024-04-26T10:44:51.111 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.112 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:51.112 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.112 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:130 3.1a 3:5e41ab69:::200.00000005:head [write 3559243~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:51.112 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:51.112 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.570540788999999, 2024-04-26T10:44:51.112 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029188316999999998, 2024-04-26T10:44:51.112 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:51.112 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.112 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:51.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.112 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:51.112 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:51.113 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.113 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:51.113 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:51.113 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.113 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:51.113 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:51.113 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:51.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.113 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:51.113 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526325+0000", 2024-04-26T10:44:51.114 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4899999999999999e-06 2024-04-26T10:44:51.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.114 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:51.114 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526327+0000", 2024-04-26T10:44:51.114 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.745e-06 2024-04-26T10:44:51.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.114 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.114 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526330+0000", 2024-04-26T10:44:51.114 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5620000000000002e-06 2024-04-26T10:44:51.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.115 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:51.115 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554200+0000", 2024-04-26T10:44:51.115 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027869541000000001 2024-04-26T10:44:51.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.115 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:51.115 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554244+0000", 2024-04-26T10:44:51.115 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4464e-05 2024-04-26T10:44:51.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.115 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:51.115 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554304+0000", 2024-04-26T10:44:51.115 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9457999999999999e-05 2024-04-26T10:44:51.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.116 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.116 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555453+0000", 2024-04-26T10:44:51.116 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011494000000000001 2024-04-26T10:44:51.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.116 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:51.116 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555457+0000", 2024-04-26T10:44:51.116 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1779999999999996e-06 2024-04-26T10:44:51.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.116 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:51.116 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555480+0000", 2024-04-26T10:44:51.116 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2802e-05 2024-04-26T10:44:51.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.117 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:51.117 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555512+0000", 2024-04-26T10:44:51.117 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1885999999999999e-05 2024-04-26T10:44:51.117 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.117 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:51.117 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.117 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:131 3.1a 3:5e41ab69:::200.00000005:head [write 3560642~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:51.117 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:51.117 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.570532209, 2024-04-26T10:44:51.117 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029683102999999999, 2024-04-26T10:44:51.117 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:51.117 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.118 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:51.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.118 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:51.118 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:51.118 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.118 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:51.118 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:51.118 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.118 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:51.118 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:51.119 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:51.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.119 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:51.119 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526336+0000", 2024-04-26T10:44:51.119 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.681e-06 2024-04-26T10:44:51.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.119 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:51.119 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526338+0000", 2024-04-26T10:44:51.119 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8430000000000001e-06 2024-04-26T10:44:51.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.119 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.120 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526341+0000", 2024-04-26T10:44:51.120 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6180000000000002e-06 2024-04-26T10:44:51.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.120 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:51.120 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554745+0000", 2024-04-26T10:44:51.120 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028404088000000001 2024-04-26T10:44:51.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.120 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:51.120 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554788+0000", 2024-04-26T10:44:51.120 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2738999999999999e-05 2024-04-26T10:44:51.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.120 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:51.121 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554849+0000", 2024-04-26T10:44:51.121 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1362e-05 2024-04-26T10:44:51.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.121 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.121 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555963+0000", 2024-04-26T10:44:51.121 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001113597 2024-04-26T10:44:51.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.121 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:51.121 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555969+0000", 2024-04-26T10:44:51.121 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6900000000000003e-06 2024-04-26T10:44:51.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.121 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:51.122 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555995+0000", 2024-04-26T10:44:51.122 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5165999999999999e-05 2024-04-26T10:44:51.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.122 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:51.122 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556015+0000", 2024-04-26T10:44:51.122 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0522000000000001e-05 2024-04-26T10:44:51.122 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.122 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:51.122 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.122 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:132 3.1a 3:5e41ab69:::200.00000005:head [write 3562043~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:51.122 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:51.123 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.570511944, 2024-04-26T10:44:51.123 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030129895, 2024-04-26T10:44:51.123 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:51.123 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.123 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:51.123 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.123 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:51.123 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:51.123 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.123 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.123 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:51.123 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:51.123 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.124 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.124 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:51.124 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:51.124 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:51.124 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.124 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:51.124 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526354+0000", 2024-04-26T10:44:51.124 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8560000000000001e-06 2024-04-26T10:44:51.124 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.124 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:51.124 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526359+0000", 2024-04-26T10:44:51.125 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4700000000000001e-06 2024-04-26T10:44:51.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.125 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.125 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526365+0000", 2024-04-26T10:44:51.125 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2120000000000002e-06 2024-04-26T10:44:51.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.125 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:51.125 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555050+0000", 2024-04-26T10:44:51.125 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028685458 2024-04-26T10:44:51.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.125 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:51.126 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555093+0000", 2024-04-26T10:44:51.126 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3307999999999999e-05 2024-04-26T10:44:51.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.126 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.126 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:51.126 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555156+0000", 2024-04-26T10:44:51.126 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2396000000000004e-05 2024-04-26T10:44:51.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.126 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.126 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.126 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556052+0000", 2024-04-26T10:44:51.126 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00089650299999999999 2024-04-26T10:44:51.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.127 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.127 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:51.127 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556439+0000", 2024-04-26T10:44:51.127 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038647900000000001 2024-04-26T10:44:51.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.127 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.127 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:51.127 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556463+0000", 2024-04-26T10:44:51.127 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4071e-05 2024-04-26T10:44:51.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.127 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.127 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:51.127 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556482+0000", 2024-04-26T10:44:51.127 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9378999999999999e-05 2024-04-26T10:44:51.127 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.127 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:51.128 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.128 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.128 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.128 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 3563440~3660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:51.128 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:51.128 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.57049555, 2024-04-26T10:44:51.128 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030550738000000001, 2024-04-26T10:44:51.128 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:51.128 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.128 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:51.128 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.128 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:51.128 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:51.128 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.129 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.129 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.129 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:51.129 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:51.129 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.129 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.129 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.129 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:51.129 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526368+0000", 2024-04-26T10:44:51.129 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:51.129 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.129 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.129 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:51.129 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526375+0000", 2024-04-26T10:44:51.129 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7510000000000002e-06 2024-04-26T10:44:51.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.130 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:51.130 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526381+0000", 2024-04-26T10:44:51.130 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3929999999999996e-06 2024-04-26T10:44:51.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.130 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.130 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526387+0000", 2024-04-26T10:44:51.130 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.215e-06 2024-04-26T10:44:51.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.130 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:51.130 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555542+0000", 2024-04-26T10:44:51.131 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029154992000000001 2024-04-26T10:44:51.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.131 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.131 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:51.131 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555610+0000", 2024-04-26T10:44:51.131 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8610999999999998e-05 2024-04-26T10:44:51.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.131 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.131 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:51.131 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555681+0000", 2024-04-26T10:44:51.131 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1072e-05 2024-04-26T10:44:51.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.131 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.131 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.131 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556866+0000", 2024-04-26T10:44:51.132 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001184598 2024-04-26T10:44:51.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.132 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:51.132 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556872+0000", 2024-04-26T10:44:51.132 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.55e-06 2024-04-26T10:44:51.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.132 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:51.132 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556897+0000", 2024-04-26T10:44:51.132 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.516e-05 2024-04-26T10:44:51.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.132 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:51.133 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556919+0000", 2024-04-26T10:44:51.133 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1951e-05 2024-04-26T10:44:51.133 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.133 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:51.133 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.133 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:134 3.1a 3:5e41ab69:::200.00000005:head [write 3567100~2427 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:51.133 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:51.133 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.570462485, 2024-04-26T10:44:51.133 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031267445999999997, 2024-04-26T10:44:51.133 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:51.133 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.133 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:51.133 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.134 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:51.134 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:51.134 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.134 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:51.134 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:51.134 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.134 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:51.134 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526401+0000", 2024-04-26T10:44:51.134 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:51.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.135 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:51.135 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526408+0000", 2024-04-26T10:44:51.135 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7769999999999997e-06 2024-04-26T10:44:51.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.135 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:51.135 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526415+0000", 2024-04-26T10:44:51.135 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0720000000000002e-06 2024-04-26T10:44:51.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.135 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.135 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526421+0000", 2024-04-26T10:44:51.135 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9699999999999996e-06 2024-04-26T10:44:51.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.136 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:51.136 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556084+0000", 2024-04-26T10:44:51.136 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029662351999999999 2024-04-26T10:44:51.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.136 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:51.136 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556126+0000", 2024-04-26T10:44:51.136 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2385000000000002e-05 2024-04-26T10:44:51.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.136 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:51.136 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556186+0000", 2024-04-26T10:44:51.136 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9945999999999998e-05 2024-04-26T10:44:51.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.137 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.137 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:51.137 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557598+0000", 2024-04-26T10:44:51.137 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0014121559999999999 2024-04-26T10:44:51.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.137 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.137 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.137 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557626+0000", 2024-04-26T10:44:51.137 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7960999999999999e-05 2024-04-26T10:44:51.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.137 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.137 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:51.137 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557650+0000", 2024-04-26T10:44:51.137 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3969999999999999e-05 2024-04-26T10:44:51.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.138 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:51.138 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557669+0000", 2024-04-26T10:44:51.138 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9262e-05 2024-04-26T10:44:51.138 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.138 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:51.138 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.138 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:135 3.1a 3:5e41ab69:::200.00000005:head [write 3569527~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:51.138 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:51.138 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.570438219, 2024-04-26T10:44:51.138 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031322516000000002, 2024-04-26T10:44:51.139 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:51.139 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.139 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:51.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.139 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:51.139 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:51.139 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.139 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:51.139 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:51.139 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.140 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.140 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:51.140 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:51.140 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:51.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.140 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.140 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:51.140 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526429+0000", 2024-04-26T10:44:51.140 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0750000000000002e-06 2024-04-26T10:44:51.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.140 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.140 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:51.140 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526435+0000", 2024-04-26T10:44:51.140 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.263e-06 2024-04-26T10:44:51.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.141 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.141 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526442+0000", 2024-04-26T10:44:51.141 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1219999999999997e-06 2024-04-26T10:44:51.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.141 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:51.141 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556515+0000", 2024-04-26T10:44:51.141 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030073132999999998 2024-04-26T10:44:51.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.141 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:51.141 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556564+0000", 2024-04-26T10:44:51.142 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8871e-05 2024-04-26T10:44:51.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.142 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:51.142 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556625+0000", 2024-04-26T10:44:51.142 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1307000000000001e-05 2024-04-26T10:44:51.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.142 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:51.142 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557678+0000", 2024-04-26T10:44:51.142 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010523100000000001 2024-04-26T10:44:51.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.142 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.143 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557709+0000", 2024-04-26T10:44:51.143 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1748000000000002e-05 2024-04-26T10:44:51.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.143 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.143 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:51.143 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557732+0000", 2024-04-26T10:44:51.143 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2415000000000001e-05 2024-04-26T10:44:51.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.143 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.143 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:51.143 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557749+0000", 2024-04-26T10:44:51.143 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6736999999999999e-05 2024-04-26T10:44:51.143 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.144 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:51.144 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.144 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.144 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.145 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:136 3.1a 3:5e41ab69:::200.00000005:head [write 3571449~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:51.145 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:51.145 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.570417029000001, 2024-04-26T10:44:51.145 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032180937, 2024-04-26T10:44:51.145 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:51.145 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.145 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:51.145 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.145 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:51.145 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:51.145 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.145 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.145 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:51.146 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:51.146 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.146 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.146 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.146 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:51.146 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:51.146 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:51.146 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.146 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.146 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:51.147 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526455+0000", 2024-04-26T10:44:51.147 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6429999999999995e-06 2024-04-26T10:44:51.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.147 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:51.147 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526461+0000", 2024-04-26T10:44:51.147 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:51.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.147 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.147 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526467+0000", 2024-04-26T10:44:51.147 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4389999999999999e-06 2024-04-26T10:44:51.147 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.147 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.148 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:51.148 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556950+0000", 2024-04-26T10:44:51.148 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030483854000000001 2024-04-26T10:44:51.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.148 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:51.148 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556989+0000", 2024-04-26T10:44:51.148 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8415999999999999e-05 2024-04-26T10:44:51.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.148 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:51.148 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557051+0000", 2024-04-26T10:44:51.148 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2088999999999995e-05 2024-04-26T10:44:51.148 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.148 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.149 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:51.149 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558166+0000", 2024-04-26T10:44:51.149 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001114622 2024-04-26T10:44:51.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.149 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.149 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558584+0000", 2024-04-26T10:44:51.149 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000418033 2024-04-26T10:44:51.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.149 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:51.149 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558609+0000", 2024-04-26T10:44:51.149 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5344999999999999e-05 2024-04-26T10:44:51.149 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.149 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.150 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:51.150 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558628+0000", 2024-04-26T10:44:51.150 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9273999999999999e-05 2024-04-26T10:44:51.150 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.150 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:51.150 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.150 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.150 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.150 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:137 3.1a 3:5e41ab69:::200.00000005:head [write 3573699~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:51.150 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:51.150 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.570393379999999, 2024-04-26T10:44:51.150 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032241530999999997, 2024-04-26T10:44:51.150 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:51.150 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.151 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:51.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.151 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:51.151 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:51.151 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.151 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.151 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:51.151 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:51.151 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.151 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.152 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:51.152 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526470+0000", 2024-04-26T10:44:51.152 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:51.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.152 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:51.152 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526473+0000", 2024-04-26T10:44:51.152 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.818e-06 2024-04-26T10:44:51.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.152 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.152 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:51.152 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526480+0000", 2024-04-26T10:44:51.152 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4119999999999998e-06 2024-04-26T10:44:51.152 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.153 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.153 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526484+0000", 2024-04-26T10:44:51.153 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6840000000000004e-06 2024-04-26T10:44:51.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.153 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:51.153 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557323+0000", 2024-04-26T10:44:51.153 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030838956000000001 2024-04-26T10:44:51.153 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.153 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.153 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:51.153 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557362+0000", 2024-04-26T10:44:51.153 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8343999999999997e-05 2024-04-26T10:44:51.154 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.154 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:51.154 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557421+0000", 2024-04-26T10:44:51.154 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9176999999999999e-05 2024-04-26T10:44:51.154 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.154 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:51.154 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558636+0000", 2024-04-26T10:44:51.154 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012153789999999999 2024-04-26T10:44:51.154 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.154 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.154 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.154 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558668+0000", 2024-04-26T10:44:51.155 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1452999999999999e-05 2024-04-26T10:44:51.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.155 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:51.155 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558694+0000", 2024-04-26T10:44:51.155 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6288999999999999e-05 2024-04-26T10:44:51.155 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.155 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.155 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:51.155 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558712+0000", 2024-04-26T10:44:51.155 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8459000000000001e-05 2024-04-26T10:44:51.155 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.155 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:51.155 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.156 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.156 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.156 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:138 3.1a 3:5e41ab69:::200.00000005:head [write 3575103~4205 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:51.156 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:51.156 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.570376061000001, 2024-04-26T10:44:51.156 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032665567999999999, 2024-04-26T10:44:51.156 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:51.156 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.156 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:51.156 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.156 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:51.157 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:51.157 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.157 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:51.157 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:51.157 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.157 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:51.157 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:51.157 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:51.157 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.157 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.157 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:51.158 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526495+0000", 2024-04-26T10:44:51.158 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7580000000000003e-06 2024-04-26T10:44:51.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.158 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:51.158 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526501+0000", 2024-04-26T10:44:51.158 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1680000000000001e-06 2024-04-26T10:44:51.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.158 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.158 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.158 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526505+0000", 2024-04-26T10:44:51.158 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.673e-06 2024-04-26T10:44:51.158 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.159 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:51.159 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557781+0000", 2024-04-26T10:44:51.159 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031275718000000001 2024-04-26T10:44:51.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.159 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:51.159 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557825+0000", 2024-04-26T10:44:51.159 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4048000000000002e-05 2024-04-26T10:44:51.159 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.159 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.159 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:51.159 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557888+0000", 2024-04-26T10:44:51.159 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2562000000000002e-05 2024-04-26T10:44:51.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.160 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.160 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559073+0000", 2024-04-26T10:44:51.160 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011852239999999999 2024-04-26T10:44:51.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.160 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:51.160 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559112+0000", 2024-04-26T10:44:51.160 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9226e-05 2024-04-26T10:44:51.160 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.160 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.160 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:51.160 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559136+0000", 2024-04-26T10:44:51.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3966000000000001e-05 2024-04-26T10:44:51.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.161 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:51.161 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559154+0000", 2024-04-26T10:44:51.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7575e-05 2024-04-26T10:44:51.161 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.161 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:51.161 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.161 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.161 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.161 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:139 3.1a 3:5e41ab69:::200.00000005:head [write 3579308~2255 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:51.161 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:51.161 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.570354442999999, 2024-04-26T10:44:51.161 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033424720999999998, 2024-04-26T10:44:51.162 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:51.162 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.162 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:51.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.162 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:51.162 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:51.162 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.162 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:51.162 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:51.162 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.162 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.162 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.163 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:51.163 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526509+0000", 2024-04-26T10:44:51.163 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:51.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.163 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:51.163 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526516+0000", 2024-04-26T10:44:51.163 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5209999999999999e-06 2024-04-26T10:44:51.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.163 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:51.163 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526522+0000", 2024-04-26T10:44:51.163 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1229999999999997e-06 2024-04-26T10:44:51.163 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.163 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.164 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.164 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526527+0000", 2024-04-26T10:44:51.164 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7849999999999999e-06 2024-04-26T10:44:51.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.164 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:51.164 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558194+0000", 2024-04-26T10:44:51.164 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031667419000000002 2024-04-26T10:44:51.164 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.164 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.164 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:51.164 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558234+0000", 2024-04-26T10:44:51.164 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9774999999999998e-05 2024-04-26T10:44:51.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.165 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:51.165 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558294+0000", 2024-04-26T10:44:51.165 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0242999999999999e-05 2024-04-26T10:44:51.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.165 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.165 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559106+0000", 2024-04-26T10:44:51.165 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00081148099999999996 2024-04-26T10:44:51.165 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.165 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.165 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:51.165 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559890+0000", 2024-04-26T10:44:51.165 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00078439999999999998 2024-04-26T10:44:51.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.166 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:51.166 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559917+0000", 2024-04-26T10:44:51.166 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7044000000000001e-05 2024-04-26T10:44:51.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.166 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.166 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:51.166 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559935+0000", 2024-04-26T10:44:51.166 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7448e-05 2024-04-26T10:44:51.166 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.166 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:51.166 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.166 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.167 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:140 3.1a 3:5e41ab69:::200.00000005:head [write 3581563~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:51.167 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:51.167 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.570333022, 2024-04-26T10:44:51.167 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033867728, 2024-04-26T10:44:51.167 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:51.167 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.167 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:51.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.167 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:51.167 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:51.167 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.167 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.167 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.168 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:51.168 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:51.168 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.168 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:51.168 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:51.168 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:51.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.168 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:51.168 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526538+0000", 2024-04-26T10:44:51.168 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.905e-06 2024-04-26T10:44:51.168 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.168 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.169 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:51.169 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526542+0000", 2024-04-26T10:44:51.169 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9550000000000002e-06 2024-04-26T10:44:51.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.169 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.169 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.169 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526545+0000", 2024-04-26T10:44:51.169 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8499999999999998e-06 2024-04-26T10:44:51.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.169 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.169 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:51.169 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558744+0000", 2024-04-26T10:44:51.169 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032198986999999998 2024-04-26T10:44:51.169 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.170 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.170 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:51.170 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558788+0000", 2024-04-26T10:44:51.170 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4365e-05 2024-04-26T10:44:51.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.170 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.170 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:51.170 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558854+0000", 2024-04-26T10:44:51.170 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5952999999999997e-05 2024-04-26T10:44:51.170 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.170 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.170 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.170 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559971+0000", 2024-04-26T10:44:51.170 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011172770000000001 2024-04-26T10:44:51.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.171 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:51.171 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560354+0000", 2024-04-26T10:44:51.171 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038267599999999998 2024-04-26T10:44:51.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.171 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:51.171 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560380+0000", 2024-04-26T10:44:51.171 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6140999999999999e-05 2024-04-26T10:44:51.171 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.171 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.171 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:51.171 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560399+0000", 2024-04-26T10:44:51.171 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9032999999999999e-05 2024-04-26T10:44:51.172 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.172 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:51.172 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.172 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.172 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.172 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:141 3.1a 3:5e41ab69:::200.00000005:head [write 3583482~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:51.172 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:51.172 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.570317363000001, 2024-04-26T10:44:51.172 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034316301, 2024-04-26T10:44:51.172 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:51.172 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.172 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:51.172 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.173 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:51.173 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:51.173 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.173 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:51.173 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:51.173 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.173 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.173 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:51.173 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:51.173 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:51.173 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526548+0000", 2024-04-26T10:44:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.739e-06 2024-04-26T10:44:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526551+0000", 2024-04-26T10:44:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.044e-06 2024-04-26T10:44:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526562+0000", 2024-04-26T10:44:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0370000000000001e-05 2024-04-26T10:44:51.174 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559179+0000", 2024-04-26T10:44:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032617444000000002 2024-04-26T10:44:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559220+0000", 2024-04-26T10:44:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0364999999999997e-05 2024-04-26T10:44:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559280+0000", 2024-04-26T10:44:51.175 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0569000000000002e-05 2024-04-26T10:44:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560814+0000", 2024-04-26T10:44:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015337580000000001 2024-04-26T10:44:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560820+0000", 2024-04-26T10:44:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.455e-06 2024-04-26T10:44:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:51.176 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560846+0000", 2024-04-26T10:44:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5228999999999998e-05 2024-04-26T10:44:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560863+0000", 2024-04-26T10:44:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7555e-05 2024-04-26T10:44:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:142 3.1a 3:5e41ab69:::200.00000005:head [write 3585931~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.570296966000001, 2024-04-26T10:44:51.177 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034372373999999997, 2024-04-26T10:44:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.178 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526573+0000", 2024-04-26T10:44:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0800000000000002e-06 2024-04-26T10:44:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526580+0000", 2024-04-26T10:44:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5799999999999997e-06 2024-04-26T10:44:51.179 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526585+0000", 2024-04-26T10:44:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2270000000000001e-06 2024-04-26T10:44:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559601+0000", 2024-04-26T10:44:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033016684999999997 2024-04-26T10:44:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559642+0000", 2024-04-26T10:44:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0321000000000002e-05 2024-04-26T10:44:51.180 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559706+0000", 2024-04-26T10:44:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4228999999999998e-05 2024-04-26T10:44:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560871+0000", 2024-04-26T10:44:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001164893 2024-04-26T10:44:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560899+0000", 2024-04-26T10:44:51.181 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560922+0000", 2024-04-26T10:44:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3337999999999999e-05 2024-04-26T10:44:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560940+0000", 2024-04-26T10:44:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7289999999999999e-05 2024-04-26T10:44:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:51.182 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:143 3.1a 3:5e41ab69:::200.00000005:head [write 3587331~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.570275068000001, 2024-04-26T10:44:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035256000000000003, 2024-04-26T10:44:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.183 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526592+0000", 2024-04-26T10:44:51.184 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2449999999999998e-06 2024-04-26T10:44:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526596+0000", 2024-04-26T10:44:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7000000000000002e-06 2024-04-26T10:44:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526599+0000", 2024-04-26T10:44:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6160000000000002e-06 2024-04-26T10:44:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:51.185 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559997+0000", 2024-04-26T10:44:51.186 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033397835000000001 2024-04-26T10:44:51.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:51.186 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560051+0000", 2024-04-26T10:44:51.186 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3742000000000001e-05 2024-04-26T10:44:51.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:51.186 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560112+0000", 2024-04-26T10:44:51.186 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0851999999999999e-05 2024-04-26T10:44:51.186 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.186 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.186 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:51.187 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561404+0000", 2024-04-26T10:44:51.187 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001291869 2024-04-26T10:44:51.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.187 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.187 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561797+0000", 2024-04-26T10:44:51.187 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039383000000000002 2024-04-26T10:44:51.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.187 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:51.187 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561827+0000", 2024-04-26T10:44:51.187 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9247e-05 2024-04-26T10:44:51.187 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.187 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.188 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:51.188 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561845+0000", 2024-04-26T10:44:51.188 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8462999999999999e-05 2024-04-26T10:44:51.188 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.188 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:51.188 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.188 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.188 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.188 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:144 3.1a 3:5e41ab69:::200.00000005:head [write 3588736~4987 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:51.188 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:51.188 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.570152776, 2024-04-26T10:44:51.188 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035224283000000002, 2024-04-26T10:44:51.188 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:51.189 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.189 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:51.189 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.189 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:51.189 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:51.189 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.189 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.189 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:51.189 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:51.189 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.189 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.189 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.189 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:51.189 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:51.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:51.190 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.190 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:51.190 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526718+0000", 2024-04-26T10:44:51.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.43e-06 2024-04-26T10:44:51.190 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.190 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:51.190 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526726+0000", 2024-04-26T10:44:51.190 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:44:51.190 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.190 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.190 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526729+0000", 2024-04-26T10:44:51.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6480000000000001e-06 2024-04-26T10:44:51.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:51.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560427+0000", 2024-04-26T10:44:51.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033697280000000003 2024-04-26T10:44:51.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.191 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:51.191 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560466+0000", 2024-04-26T10:44:51.191 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9606e-05 2024-04-26T10:44:51.191 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.191 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.192 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:51.192 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560525+0000", 2024-04-26T10:44:51.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9218000000000001e-05 2024-04-26T10:44:51.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.192 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:51.192 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561854+0000", 2024-04-26T10:44:51.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001328421 2024-04-26T10:44:51.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.192 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.192 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561887+0000", 2024-04-26T10:44:51.192 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2746000000000001e-05 2024-04-26T10:44:51.192 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.192 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.193 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:51.193 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561912+0000", 2024-04-26T10:44:51.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5126999999999998e-05 2024-04-26T10:44:51.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.193 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:51.193 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561936+0000", 2024-04-26T10:44:51.193 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4032999999999998e-05 2024-04-26T10:44:51.193 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.193 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:51.193 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.193 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.193 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.193 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:145 3.1a 3:5e41ab69:::200.00000005:head [write 3593723~2939 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:51.193 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:51.194 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.567233731000002, 2024-04-26T10:44:51.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033294394999999997, 2024-04-26T10:44:51.194 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:51.194 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.194 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:51.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.194 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:51.194 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:51.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.194 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.194 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:51.194 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:51.194 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.194 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.195 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:51.195 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529630+0000", 2024-04-26T10:44:51.195 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:51.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.195 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:51.195 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529635+0000", 2024-04-26T10:44:51.195 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7960000000000003e-06 2024-04-26T10:44:51.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.195 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.195 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:51.195 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529643+0000", 2024-04-26T10:44:51.195 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0390000000000005e-06 2024-04-26T10:44:51.195 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529648+0000", 2024-04-26T10:44:51.196 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9599999999999999e-06 2024-04-26T10:44:51.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:51.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560969+0000", 2024-04-26T10:44:51.196 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031321767 2024-04-26T10:44:51.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:51.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561009+0000", 2024-04-26T10:44:51.196 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9904999999999998e-05 2024-04-26T10:44:51.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.197 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:51.197 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561070+0000", 2024-04-26T10:44:51.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0708999999999998e-05 2024-04-26T10:44:51.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.197 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:51.197 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562352+0000", 2024-04-26T10:44:51.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012818440000000001 2024-04-26T10:44:51.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.197 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.197 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562867+0000", 2024-04-26T10:44:51.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000515665 2024-04-26T10:44:51.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.198 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:51.198 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562893+0000", 2024-04-26T10:44:51.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5469999999999998e-05 2024-04-26T10:44:51.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.198 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:51.198 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562925+0000", 2024-04-26T10:44:51.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1974999999999998e-05 2024-04-26T10:44:51.198 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.198 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:51.198 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.199 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:146 3.1a 3:5e41ab69:::200.00000005:head [write 3596662~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:51.199 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:51.199 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.567005516999998, 2024-04-26T10:44:51.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033178429000000002, 2024-04-26T10:44:51.199 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:51.199 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.199 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:51.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:51.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:51.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:51.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:51.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:51.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529858+0000", 2024-04-26T10:44:51.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:51.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:51.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529863+0000", 2024-04-26T10:44:51.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4500000000000003e-06 2024-04-26T10:44:51.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:51.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529874+0000", 2024-04-26T10:44:51.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0552e-05 2024-04-26T10:44:51.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529882+0000", 2024-04-26T10:44:51.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4449999999999996e-06 2024-04-26T10:44:51.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:51.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561452+0000", 2024-04-26T10:44:51.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031569680000000003 2024-04-26T10:44:51.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.202 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:51.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561511+0000", 2024-04-26T10:44:51.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9332e-05 2024-04-26T10:44:51.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.202 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:51.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561583+0000", 2024-04-26T10:44:51.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1730000000000006e-05 2024-04-26T10:44:51.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.202 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:51.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562933+0000", 2024-04-26T10:44:51.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013500059999999999 2024-04-26T10:44:51.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562976+0000", 2024-04-26T10:44:51.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2987e-05 2024-04-26T10:44:51.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:51.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563015+0000", 2024-04-26T10:44:51.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9453999999999999e-05 2024-04-26T10:44:51.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:51.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563037+0000", 2024-04-26T10:44:51.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1679e-05 2024-04-26T10:44:51.204 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.204 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:51.204 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.204 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:277 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:51.204 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:51.204 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.581994814000002, 2024-04-26T10:44:51.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030430563000000001, 2024-04-26T10:44:51.204 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:51.204 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.204 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:51.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:51.204 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:51.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.205 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:51.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:51.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:51.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.205 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:51.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514867+0000", 2024-04-26T10:44:51.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:51.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.205 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:51.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515460+0000", 2024-04-26T10:44:51.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00059285800000000004 2024-04-26T10:44:51.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:51.206 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515474+0000", 2024-04-26T10:44:51.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3933e-05 2024-04-26T10:44:51.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.206 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515481+0000", 2024-04-26T10:44:51.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:51.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:51.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515522+0000", 2024-04-26T10:44:51.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1369000000000003e-05 2024-04-26T10:44:51.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:51.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515591+0000", 2024-04-26T10:44:51.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9377999999999999e-05 2024-04-26T10:44:51.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:51.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.526440+0000", 2024-04-26T10:44:51.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010848837 2024-04-26T10:44:51.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.543866+0000", 2024-04-26T10:44:51.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017426288000000002 2024-04-26T10:44:51.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:51.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545193+0000", 2024-04-26T10:44:51.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001326111 2024-04-26T10:44:51.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:51.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545229+0000", 2024-04-26T10:44:51.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6390999999999998e-05 2024-04-26T10:44:51.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:51.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:51.209 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:51.209 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545300+0000", 2024-04-26T10:44:51.209 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1073000000000002e-05 2024-04-26T10:44:51.209 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.209 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:51.209 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.209 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:51.209 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:51.209 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:51.211 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:51.211 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:51.209+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:51.312 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:51.311+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:51.317 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:51.317 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:51.317 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:44:51.317 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:51.326 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:51.412 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:51.411+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:51.427 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:51.428 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:51.428 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:51.428 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:51.428 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:51.436 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:51.513 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:51.512+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:51.540 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:51.540 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:51.540 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:51.540 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:51.540 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.541 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:330 3.13 3:ceffbd45:::200.0000000a:head [write 1316140~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:51.541 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:51.541 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.024748276, 2024-04-26T10:44:51.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022245654, 2024-04-26T10:44:51.541 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:51.541 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.541 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:51.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.541 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:51.541 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:51.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.542 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.542 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:51.542 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:51.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.542 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.542 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:51.542 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513139+0000", 2024-04-26T10:44:51.543 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:51.543 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.543 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.543 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:51.543 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513149+0000", 2024-04-26T10:44:51.543 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7550000000000006e-06 2024-04-26T10:44:51.543 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.543 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.543 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:51.543 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513157+0000", 2024-04-26T10:44:51.543 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1089999999999998e-06 2024-04-26T10:44:51.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513167+0000", 2024-04-26T10:44:51.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0539e-05 2024-04-26T10:44:51.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:51.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533830+0000", 2024-04-26T10:44:51.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020662852999999998 2024-04-26T10:44:51.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.545 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.545 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:51.545 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533875+0000", 2024-04-26T10:44:51.545 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.5071999999999998e-05 2024-04-26T10:44:51.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.545 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.545 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:51.545 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535319+0000", 2024-04-26T10:44:51.545 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001443578 2024-04-26T10:44:51.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.545 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.545 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:51.546 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535346+0000", 2024-04-26T10:44:51.546 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7415000000000001e-05 2024-04-26T10:44:51.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.546 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:51.546 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535385+0000", 2024-04-26T10:44:51.546 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8912999999999998e-05 2024-04-26T10:44:51.546 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.546 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:51.546 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.547 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:331 3.13 3:ceffbd45:::200.0000000a:head [write 1318049~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:51.547 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:51.547 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.024708948000001, 2024-04-26T10:44:51.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023524521, 2024-04-26T10:44:51.547 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:51.547 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.547 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:51.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:51.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:51.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.548 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.548 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:51.548 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:51.548 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.548 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.548 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:51.548 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513178+0000", 2024-04-26T10:44:51.548 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:51.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.549 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:51.549 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513183+0000", 2024-04-26T10:44:51.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2549999999999999e-06 2024-04-26T10:44:51.549 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.549 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:51.549 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513190+0000", 2024-04-26T10:44:51.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8460000000000002e-06 2024-04-26T10:44:51.549 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.549 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.549 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513195+0000", 2024-04-26T10:44:51.550 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3630000000000002e-06 2024-04-26T10:44:51.550 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:51.550 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534463+0000", 2024-04-26T10:44:51.550 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021267823000000002 2024-04-26T10:44:51.550 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:51.550 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534520+0000", 2024-04-26T10:44:51.551 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7510000000000003e-05 2024-04-26T10:44:51.551 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.551 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.551 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:51.551 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536634+0000", 2024-04-26T10:44:51.551 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0021138900000000002 2024-04-26T10:44:51.551 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.551 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.551 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:51.551 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536663+0000", 2024-04-26T10:44:51.551 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8884e-05 2024-04-26T10:44:51.552 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.552 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.552 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:51.552 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536703+0000", 2024-04-26T10:44:51.552 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0479000000000003e-05 2024-04-26T10:44:51.552 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.552 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:51.552 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.552 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.552 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.552 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:332 3.13 3:ceffbd45:::200.0000000a:head [write 1319462~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:51.553 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:51.553 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.024674115, 2024-04-26T10:44:51.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024543230999999999, 2024-04-26T10:44:51.553 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:51.553 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.553 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:51.553 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.553 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:51.553 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:51.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.553 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.553 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.554 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:51.554 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:51.554 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.554 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.554 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.554 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:51.554 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513213+0000", 2024-04-26T10:44:51.554 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:51.554 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.554 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.554 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:51.554 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513217+0000", 2024-04-26T10:44:51.554 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:44:51.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.555 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:51.555 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513229+0000", 2024-04-26T10:44:51.555 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2051e-05 2024-04-26T10:44:51.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.555 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.555 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513236+0000", 2024-04-26T10:44:51.555 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4470000000000003e-06 2024-04-26T10:44:51.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:51.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534891+0000", 2024-04-26T10:44:51.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021655863000000001 2024-04-26T10:44:51.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.556 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:51.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534933+0000", 2024-04-26T10:44:51.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1596e-05 2024-04-26T10:44:51.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.556 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:51.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537677+0000", 2024-04-26T10:44:51.557 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027440989999999998 2024-04-26T10:44:51.557 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.557 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.557 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:51.557 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537721+0000", 2024-04-26T10:44:51.557 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3813999999999998e-05 2024-04-26T10:44:51.557 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.557 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.557 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:51.557 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537757+0000", 2024-04-26T10:44:51.557 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6022999999999997e-05 2024-04-26T10:44:51.557 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.558 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:51.558 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.558 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.558 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:333 3.13 3:ceffbd45:::200.0000000a:head [write 1320870~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:51.558 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:51.558 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.024631196000001, 2024-04-26T10:44:51.558 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024557151999999999, 2024-04-26T10:44:51.558 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:51.558 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.558 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:51.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.559 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:51.559 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:51.559 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.559 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.559 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.559 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:51.559 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:51.559 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.559 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.559 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.559 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:51.560 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513256+0000", 2024-04-26T10:44:51.560 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:51.560 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.560 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.560 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:51.560 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513260+0000", 2024-04-26T10:44:51.560 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6550000000000002e-06 2024-04-26T10:44:51.560 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.560 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.560 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:51.560 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513273+0000", 2024-04-26T10:44:51.560 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2965e-05 2024-04-26T10:44:51.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.561 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.561 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.561 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513279+0000", 2024-04-26T10:44:51.561 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:44:51.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.561 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.561 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:51.561 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535411+0000", 2024-04-26T10:44:51.561 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022132233000000001 2024-04-26T10:44:51.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.561 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.562 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:51.562 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535479+0000", 2024-04-26T10:44:51.562 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7554999999999999e-05 2024-04-26T10:44:51.562 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.562 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.562 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:51.562 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537762+0000", 2024-04-26T10:44:51.562 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022836499999999999 2024-04-26T10:44:51.562 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.562 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.562 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:51.562 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537783+0000", 2024-04-26T10:44:51.563 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0364e-05 2024-04-26T10:44:51.563 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.563 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.563 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:51.563 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537814+0000", 2024-04-26T10:44:51.563 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1170000000000001e-05 2024-04-26T10:44:51.563 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.563 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:51.563 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.563 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.563 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.563 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:334 3.13 3:ceffbd45:::200.0000000a:head [write 1322273~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:51.564 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:51.564 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.022794437000002, 2024-04-26T10:44:51.564 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022778731999999999, 2024-04-26T10:44:51.564 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:51.564 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.564 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:51.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.564 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:51.564 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:51.564 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.564 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.565 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:51.565 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:51.565 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.565 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.565 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.565 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:51.565 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:51.565 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:51.565 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.565 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.565 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:51.565 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515099+0000", 2024-04-26T10:44:51.566 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6599999999999998e-06 2024-04-26T10:44:51.566 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.566 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.566 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:51.566 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515112+0000", 2024-04-26T10:44:51.566 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2707e-05 2024-04-26T10:44:51.566 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.566 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.566 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.566 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515120+0000", 2024-04-26T10:44:51.566 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8509999999999999e-06 2024-04-26T10:44:51.566 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.567 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.567 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:51.567 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535792+0000", 2024-04-26T10:44:51.567 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020672209 2024-04-26T10:44:51.567 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.567 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.567 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:51.567 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535833+0000", 2024-04-26T10:44:51.567 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1415000000000002e-05 2024-04-26T10:44:51.567 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.567 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.567 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:51.567 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537818+0000", 2024-04-26T10:44:51.568 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0019850900000000001 2024-04-26T10:44:51.568 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.568 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.568 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:51.568 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537839+0000", 2024-04-26T10:44:51.568 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0068000000000002e-05 2024-04-26T10:44:51.568 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.568 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.568 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:51.568 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537872+0000", 2024-04-26T10:44:51.568 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3680999999999998e-05 2024-04-26T10:44:51.568 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.569 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:51.569 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.569 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.569 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.569 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:335 3.13 3:ceffbd45:::200.0000000a:head [write 1325230~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:51.569 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:51.569 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.022755338, 2024-04-26T10:44:51.569 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023487081, 2024-04-26T10:44:51.569 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:51.569 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.569 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:51.569 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.570 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:51.570 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:51.570 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.570 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.570 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.570 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:51.570 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:51.570 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.570 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.570 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.570 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:51.570 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515132+0000", 2024-04-26T10:44:51.571 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:51.571 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.571 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.571 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:51.571 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515136+0000", 2024-04-26T10:44:51.571 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0860000000000004e-06 2024-04-26T10:44:51.571 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.571 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.571 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:51.571 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515143+0000", 2024-04-26T10:44:51.571 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.0400000000000004e-06 2024-04-26T10:44:51.571 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.572 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.572 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.572 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515149+0000", 2024-04-26T10:44:51.572 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0789999999999997e-06 2024-04-26T10:44:51.572 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.572 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.572 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:51.572 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536200+0000", 2024-04-26T10:44:51.572 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021050993 2024-04-26T10:44:51.572 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.572 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.572 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:51.572 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536253+0000", 2024-04-26T10:44:51.573 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.2643999999999999e-05 2024-04-26T10:44:51.573 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.573 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.573 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:51.573 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538560+0000", 2024-04-26T10:44:51.573 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0023073389999999998 2024-04-26T10:44:51.573 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.573 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.573 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:51.573 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538584+0000", 2024-04-26T10:44:51.573 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3893999999999999e-05 2024-04-26T10:44:51.574 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.574 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.574 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:51.574 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538620+0000", 2024-04-26T10:44:51.574 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5611000000000002e-05 2024-04-26T10:44:51.574 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.574 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:51.574 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.574 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.574 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.574 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:336 3.13 3:ceffbd45:::200.0000000a:head [write 1327147~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:51.574 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:51.575 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.021422883, 2024-04-26T10:44:51.575 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027687066, 2024-04-26T10:44:51.575 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:51.575 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.575 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:51.575 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.575 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:51.575 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:51.575 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.575 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.575 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.576 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:51.576 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:51.576 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.576 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.576 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.576 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:51.576 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516464+0000", 2024-04-26T10:44:51.576 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:51.576 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.576 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.576 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:51.577 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516491+0000", 2024-04-26T10:44:51.577 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6539000000000001e-05 2024-04-26T10:44:51.577 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.577 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.577 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:51.577 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516500+0000", 2024-04-26T10:44:51.577 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5480000000000007e-06 2024-04-26T10:44:51.577 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.577 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.577 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.577 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516511+0000", 2024-04-26T10:44:51.577 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0719e-05 2024-04-26T10:44:51.577 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.578 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.578 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:51.578 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536737+0000", 2024-04-26T10:44:51.578 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020225770000000001 2024-04-26T10:44:51.578 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.578 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.578 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:51.578 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536783+0000", 2024-04-26T10:44:51.578 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6168999999999998e-05 2024-04-26T10:44:51.578 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.578 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.579 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:51.579 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544080+0000", 2024-04-26T10:44:51.579 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0072966799999999998 2024-04-26T10:44:51.579 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.579 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.579 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:51.579 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544111+0000", 2024-04-26T10:44:51.579 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1056999999999998e-05 2024-04-26T10:44:51.579 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.579 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.579 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:51.579 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544152+0000", 2024-04-26T10:44:51.580 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1452000000000002e-05 2024-04-26T10:44:51.580 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.580 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:51.580 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.580 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.580 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.580 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:337 3.13 3:ceffbd45:::200.0000000a:head [write 1342136~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:51.580 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:51.580 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.021369945, 2024-04-26T10:44:51.580 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027711237, 2024-04-26T10:44:51.580 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:51.581 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.581 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:51.581 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.581 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:51.581 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:51.581 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.581 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.581 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.581 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:51.581 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:51.581 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.582 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.582 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.582 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:51.582 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516517+0000", 2024-04-26T10:44:51.582 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:51.582 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.582 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.582 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:51.582 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516521+0000", 2024-04-26T10:44:51.582 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6200000000000001e-06 2024-04-26T10:44:51.582 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.582 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.583 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:51.583 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516528+0000", 2024-04-26T10:44:51.583 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8639999999999998e-06 2024-04-26T10:44:51.583 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.583 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.583 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.583 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516533+0000", 2024-04-26T10:44:51.583 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6310000000000002e-06 2024-04-26T10:44:51.583 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.583 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.583 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:51.583 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537231+0000", 2024-04-26T10:44:51.584 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020698613000000001 2024-04-26T10:44:51.584 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.584 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.584 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:51.584 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537273+0000", 2024-04-26T10:44:51.584 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1529000000000002e-05 2024-04-26T10:44:51.584 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.584 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.584 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:51.584 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544157+0000", 2024-04-26T10:44:51.584 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068847090000000001 2024-04-26T10:44:51.585 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.585 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.585 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:51.585 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544180+0000", 2024-04-26T10:44:51.585 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.2532e-05 2024-04-26T10:44:51.585 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.585 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.585 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:51.585 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544229+0000", 2024-04-26T10:44:51.585 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9190000000000002e-05 2024-04-26T10:44:51.586 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.586 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:51.586 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.586 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.586 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.586 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:338 3.13 3:ceffbd45:::200.0000000a:head [write 1344569~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:51.586 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:51.586 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.020703692000001, 2024-04-26T10:44:51.586 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027105598000000002, 2024-04-26T10:44:51.586 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:51.586 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.587 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:51.587 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.587 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:51.587 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:51.587 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.587 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.587 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.587 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:51.587 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:51.587 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.587 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.587 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.588 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:51.588 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517183+0000", 2024-04-26T10:44:51.588 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:51.588 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.588 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.588 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:51.588 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517188+0000", 2024-04-26T10:44:51.588 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7389999999999999e-06 2024-04-26T10:44:51.588 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.588 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.588 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:51.588 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517199+0000", 2024-04-26T10:44:51.589 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0652000000000001e-05 2024-04-26T10:44:51.589 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.589 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.589 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.589 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517206+0000", 2024-04-26T10:44:51.589 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6610000000000003e-06 2024-04-26T10:44:51.589 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.589 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.589 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:51.589 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537905+0000", 2024-04-26T10:44:51.589 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020699662000000001 2024-04-26T10:44:51.589 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.590 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.590 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:51.590 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537956+0000", 2024-04-26T10:44:51.590 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0954e-05 2024-04-26T10:44:51.590 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.590 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.590 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:51.590 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544233+0000", 2024-04-26T10:44:51.590 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062773009999999999 2024-04-26T10:44:51.590 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.590 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.591 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:51.591 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544258+0000", 2024-04-26T10:44:51.591 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4434999999999999e-05 2024-04-26T10:44:51.591 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.591 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.591 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:51.591 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544290+0000", 2024-04-26T10:44:51.591 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1918000000000002e-05 2024-04-26T10:44:51.591 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.591 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:51.591 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.591 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.591 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.592 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:339 3.13 3:ceffbd45:::200.0000000a:head [write 1346485~4322 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:51.592 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:51.592 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.019765198999998, 2024-04-26T10:44:51.592 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026221617999999999, 2024-04-26T10:44:51.592 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:51.592 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.592 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:51.592 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.592 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:51.592 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:51.592 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.592 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.593 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.593 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:51.593 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:51.593 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.593 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.593 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.593 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:51.593 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518122+0000", 2024-04-26T10:44:51.593 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:51.593 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.593 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.593 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:51.594 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518129+0000", 2024-04-26T10:44:51.594 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.43e-06 2024-04-26T10:44:51.594 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.594 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.594 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:51.594 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518138+0000", 2024-04-26T10:44:51.594 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9129999999999992e-06 2024-04-26T10:44:51.594 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.594 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.594 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.594 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518144+0000", 2024-04-26T10:44:51.594 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.1419999999999998e-06 2024-04-26T10:44:51.595 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.595 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.595 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:51.595 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538232+0000", 2024-04-26T10:44:51.595 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020087383 2024-04-26T10:44:51.595 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.595 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.595 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:51.595 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538274+0000", 2024-04-26T10:44:51.595 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2602999999999999e-05 2024-04-26T10:44:51.595 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.595 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.595 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:51.596 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544294+0000", 2024-04-26T10:44:51.596 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060194059999999997 2024-04-26T10:44:51.596 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.596 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.596 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:51.596 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544314+0000", 2024-04-26T10:44:51.596 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0091000000000001e-05 2024-04-26T10:44:51.596 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.596 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.596 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:51.596 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544344+0000", 2024-04-26T10:44:51.596 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0446e-05 2024-04-26T10:44:51.597 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.597 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:51.597 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.597 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.597 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.597 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:340 3.13 3:ceffbd45:::200.0000000a:head [write 1350807~2768 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:51.597 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:51.597 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.017280963000001, 2024-04-26T10:44:51.597 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023795594, 2024-04-26T10:44:51.597 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:51.597 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.597 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:51.598 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.598 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:51.598 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:51.598 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.598 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.598 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.598 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:51.598 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:51.598 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.598 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.598 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.598 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:51.599 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520606+0000", 2024-04-26T10:44:51.599 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:51.599 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.599 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.599 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:51.599 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520612+0000", 2024-04-26T10:44:51.599 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.835e-06 2024-04-26T10:44:51.599 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.599 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.599 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:51.599 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520622+0000", 2024-04-26T10:44:51.600 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0173999999999999e-05 2024-04-26T10:44:51.600 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.600 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.600 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.600 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520629+0000", 2024-04-26T10:44:51.600 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7460000000000003e-06 2024-04-26T10:44:51.600 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.600 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.600 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:51.600 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538651+0000", 2024-04-26T10:44:51.600 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018022474 2024-04-26T10:44:51.600 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.600 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.601 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:51.601 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538697+0000", 2024-04-26T10:44:51.601 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6183999999999997e-05 2024-04-26T10:44:51.601 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.601 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.601 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:51.601 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544348+0000", 2024-04-26T10:44:51.601 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0056503509999999996 2024-04-26T10:44:51.601 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.601 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.601 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:51.601 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544369+0000", 2024-04-26T10:44:51.601 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1064999999999999e-05 2024-04-26T10:44:51.602 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.602 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.602 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:51.602 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544403+0000", 2024-04-26T10:44:51.602 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3695000000000002e-05 2024-04-26T10:44:51.602 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.602 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:51.602 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.602 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.602 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.602 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:341 3.13 3:ceffbd45:::200.0000000a:head [write 1353575~3816 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:51.603 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:51.603 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.016545707999999, 2024-04-26T10:44:51.603 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023114967, 2024-04-26T10:44:51.603 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:51.603 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.603 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:51.603 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.603 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:51.603 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:51.603 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.603 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.603 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.604 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:51.604 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:51.604 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.604 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.604 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.604 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:51.604 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521341+0000", 2024-04-26T10:44:51.604 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:51.604 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.604 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.604 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:51.604 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521349+0000", 2024-04-26T10:44:51.605 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1550000000000001e-06 2024-04-26T10:44:51.605 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.605 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.605 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:51.605 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521358+0000", 2024-04-26T10:44:51.605 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.1500000000000005e-06 2024-04-26T10:44:51.605 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.605 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.605 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.605 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521364+0000", 2024-04-26T10:44:51.605 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3289999999999999e-06 2024-04-26T10:44:51.606 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.606 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.606 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:51.606 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539010+0000", 2024-04-26T10:44:51.606 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.017645965999999999 2024-04-26T10:44:51.606 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.606 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.606 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:51.606 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539051+0000", 2024-04-26T10:44:51.606 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.053e-05 2024-04-26T10:44:51.606 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544407+0000", 2024-04-26T10:44:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053560209999999999 2024-04-26T10:44:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544427+0000", 2024-04-26T10:44:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0228e-05 2024-04-26T10:44:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.607 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:51.608 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544457+0000", 2024-04-26T10:44:51.608 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0375e-05 2024-04-26T10:44:51.608 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.608 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:51.608 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.608 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.608 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.608 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11582 4.2f 4:f76ba295:::10000003252.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:51.608 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:51.608 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 22.542930163000001, 2024-04-26T10:44:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024553994999999999, 2024-04-26T10:44:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11582 2024-04-26T10:44:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:51.609 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994957+0000", 2024-04-26T10:44:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:51.610 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.611 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.611 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:51.611 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002755+0000", 2024-04-26T10:44:51.611 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0077984719999999999 2024-04-26T10:44:51.611 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.611 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.611 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:51.611 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002770+0000", 2024-04-26T10:44:51.611 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4956e-05 2024-04-26T10:44:51.611 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.611 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.612 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.612 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002777+0000", 2024-04-26T10:44:51.612 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1899999999999998e-06 2024-04-26T10:44:51.612 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.612 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.612 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:51.612 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002833+0000", 2024-04-26T10:44:51.612 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5189999999999998e-05 2024-04-26T10:44:51.612 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.612 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.612 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:51.612 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002977+0000", 2024-04-26T10:44:51.613 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014444100000000001 2024-04-26T10:44:51.613 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.613 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.613 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:51.613 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.003108+0000", 2024-04-26T10:44:51.613 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000131068 2024-04-26T10:44:51.613 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.613 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.613 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:51.613 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.009040+0000", 2024-04-26T10:44:51.613 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059314149999999998 2024-04-26T10:44:51.613 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.614 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.614 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.614 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019462+0000", 2024-04-26T10:44:51.614 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010422803 2024-04-26T10:44:51.614 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.614 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.614 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:51.614 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019490+0000", 2024-04-26T10:44:51.614 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7773999999999999e-05 2024-04-26T10:44:51.614 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.614 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.615 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:51.615 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019512+0000", 2024-04-26T10:44:51.615 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1611999999999999e-05 2024-04-26T10:44:51.615 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.615 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:51.615 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.615 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.615 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.615 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11911 4.37 4:ec04ab04:::100000031ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:51.615 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:51.615 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 22.201209956, 2024-04-26T10:44:51.616 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026810273999999999, 2024-04-26T10:44:51.616 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:51.616 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.616 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:51.616 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:51.616 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:51.616 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11911 2024-04-26T10:44:51.616 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.616 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:51.616 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.616 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:51.616 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:51.617 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.617 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.617 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.617 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:51.617 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:51.617 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.617 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.617 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.617 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:51.617 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336676+0000", 2024-04-26T10:44:51.617 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:51.617 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.618 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.618 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:51.618 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343119+0000", 2024-04-26T10:44:51.618 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0064424850000000004 2024-04-26T10:44:51.618 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.618 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.618 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:51.618 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343131+0000", 2024-04-26T10:44:51.618 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1708e-05 2024-04-26T10:44:51.618 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.618 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.619 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.619 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343137+0000", 2024-04-26T10:44:51.619 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9880000000000001e-06 2024-04-26T10:44:51.619 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.619 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.619 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:51.619 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343175+0000", 2024-04-26T10:44:51.619 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7913000000000001e-05 2024-04-26T10:44:51.619 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.619 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.619 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:51.619 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343269+0000", 2024-04-26T10:44:51.620 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4931000000000003e-05 2024-04-26T10:44:51.620 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.620 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.620 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:51.620 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343392+0000", 2024-04-26T10:44:51.620 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000122435 2024-04-26T10:44:51.620 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.620 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.620 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:51.620 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.347520+0000", 2024-04-26T10:44:51.620 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004128418 2024-04-26T10:44:51.620 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.621 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.621 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.621 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363410+0000", 2024-04-26T10:44:51.621 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.015889309000000001 2024-04-26T10:44:51.621 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.621 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.621 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:51.621 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363453+0000", 2024-04-26T10:44:51.621 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3244000000000001e-05 2024-04-26T10:44:51.621 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.621 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.622 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:51.622 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363488+0000", 2024-04-26T10:44:51.622 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5318000000000003e-05 2024-04-26T10:44:51.622 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.622 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:51.622 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.622 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.622 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.622 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12000 4.3c 4:3c2be35d:::100000030f7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:51.622 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:51.622 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 22.118588444, 2024-04-26T10:44:51.623 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022808264000000002, 2024-04-26T10:44:51.623 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:51.623 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.623 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:51.623 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:51.623 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:51.623 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12000 2024-04-26T10:44:51.623 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.623 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:51.623 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.623 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:51.623 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:51.624 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.624 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.624 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.624 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:51.624 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:51.624 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.624 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.624 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.624 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:51.624 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:51.624 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:51.624 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.625 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.625 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:51.625 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430937+0000", 2024-04-26T10:44:51.625 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.011638097 2024-04-26T10:44:51.625 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.625 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.625 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:51.625 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430948+0000", 2024-04-26T10:44:51.625 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0824e-05 2024-04-26T10:44:51.625 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.625 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.626 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.626 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430953+0000", 2024-04-26T10:44:51.626 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5219999999999998e-06 2024-04-26T10:44:51.626 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.626 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.626 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:51.626 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430990+0000", 2024-04-26T10:44:51.626 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6458999999999998e-05 2024-04-26T10:44:51.626 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.626 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.626 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:51.626 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.431052+0000", 2024-04-26T10:44:51.627 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2687000000000005e-05 2024-04-26T10:44:51.627 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.627 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.627 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:51.627 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442027+0000", 2024-04-26T10:44:51.627 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010974513 2024-04-26T10:44:51.627 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.627 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.627 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:51.627 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442060+0000", 2024-04-26T10:44:51.627 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2849999999999999e-05 2024-04-26T10:44:51.627 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.628 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.628 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:51.628 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442108+0000", 2024-04-26T10:44:51.628 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8031999999999997e-05 2024-04-26T10:44:51.628 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.628 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:51.628 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.628 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.628 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.628 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12042 4.2f 4:f741970f:::10000003414.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:51.628 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:51.628 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 22.079334967000001, 2024-04-26T10:44:51.629 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.029390757, 2024-04-26T10:44:51.629 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:51.629 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.629 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:51.629 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:51.629 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:51.629 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12042 2024-04-26T10:44:51.629 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.629 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:51.629 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.629 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:51.629 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:51.630 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.630 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.630 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.630 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:51.630 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:51.630 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.630 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.630 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.630 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:51.630 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458552+0000", 2024-04-26T10:44:51.630 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:51.631 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.631 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.631 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:51.631 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464335+0000", 2024-04-26T10:44:51.631 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.005783168 2024-04-26T10:44:51.631 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.631 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.631 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:51.631 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464347+0000", 2024-04-26T10:44:51.631 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1578e-05 2024-04-26T10:44:51.631 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.631 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.632 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.632 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464353+0000", 2024-04-26T10:44:51.632 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3709999999999996e-06 2024-04-26T10:44:51.632 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.632 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.632 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:51.632 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464407+0000", 2024-04-26T10:44:51.632 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3717000000000001e-05 2024-04-26T10:44:51.632 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.632 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.632 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:51.632 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464556+0000", 2024-04-26T10:44:51.633 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014899100000000001 2024-04-26T10:44:51.633 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.633 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.633 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:51.633 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464688+0000", 2024-04-26T10:44:51.633 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013238599999999999 2024-04-26T10:44:51.633 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.633 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.633 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:51.633 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.469725+0000", 2024-04-26T10:44:51.633 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0050369229999999996 2024-04-26T10:44:51.633 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.634 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.634 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.634 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487892+0000", 2024-04-26T10:44:51.634 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018167184999999999 2024-04-26T10:44:51.634 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.634 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.634 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:51.634 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487922+0000", 2024-04-26T10:44:51.634 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.9495000000000001e-05 2024-04-26T10:44:51.634 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.634 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.634 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:51.635 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487944+0000", 2024-04-26T10:44:51.635 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1823000000000001e-05 2024-04-26T10:44:51.635 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.635 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:51.635 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.635 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.635 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.635 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12050 4.2c 4:36b72e58:::100000031ba.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:51.636 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:51.636 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 22.070794358000001, 2024-04-26T10:44:51.636 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022722497000000001, 2024-04-26T10:44:51.636 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:51.636 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.636 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:51.636 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:51.636 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:51.636 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12050 2024-04-26T10:44:51.636 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.636 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:51.636 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.637 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:51.637 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:51.637 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.637 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.637 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.637 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:51.637 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:51.637 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.637 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.637 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.637 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:51.637 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467093+0000", 2024-04-26T10:44:51.638 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:51.638 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.638 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.638 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:51.638 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476305+0000", 2024-04-26T10:44:51.638 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092125850000000006 2024-04-26T10:44:51.638 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.638 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.638 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:51.638 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476322+0000", 2024-04-26T10:44:51.638 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6860000000000001e-05 2024-04-26T10:44:51.639 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.639 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.639 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.639 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476328+0000", 2024-04-26T10:44:51.639 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.587e-06 2024-04-26T10:44:51.639 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.639 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.639 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:51.639 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476378+0000", 2024-04-26T10:44:51.639 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0519999999999997e-05 2024-04-26T10:44:51.639 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.640 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.640 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:51.640 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476474+0000", 2024-04-26T10:44:51.640 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5556000000000005e-05 2024-04-26T10:44:51.640 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.640 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.640 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:51.640 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489677+0000", 2024-04-26T10:44:51.640 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013203048 2024-04-26T10:44:51.640 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.640 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.640 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:51.640 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489722+0000", 2024-04-26T10:44:51.641 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4650000000000001e-05 2024-04-26T10:44:51.641 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.641 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.641 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:51.641 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489816+0000", 2024-04-26T10:44:51.641 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4402999999999997e-05 2024-04-26T10:44:51.641 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.641 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:51.641 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.641 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.641 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.641 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12516 4.37 4:ed0cb515:::10000003324.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:51.642 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:51.642 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.550712792999999, 2024-04-26T10:44:51.642 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.030139677, 2024-04-26T10:44:51.642 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:51.642 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.642 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:51.642 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:51.642 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:51.642 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12516 2024-04-26T10:44:51.642 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.642 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:51.642 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.643 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:51.643 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:51.643 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.643 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.643 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.643 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:51.643 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:51.643 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.643 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.643 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.643 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:51.644 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987173+0000", 2024-04-26T10:44:51.644 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:51.644 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.644 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.644 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:51.644 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991339+0000", 2024-04-26T10:44:51.644 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0041663760000000003 2024-04-26T10:44:51.644 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.644 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.644 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:51.644 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991351+0000", 2024-04-26T10:44:51.644 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1333e-05 2024-04-26T10:44:51.645 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.645 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.645 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.645 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991357+0000", 2024-04-26T10:44:51.645 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3350000000000003e-06 2024-04-26T10:44:51.645 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.645 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.645 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:51.645 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991394+0000", 2024-04-26T10:44:51.645 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7054000000000001e-05 2024-04-26T10:44:51.645 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.645 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.646 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:51.646 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991495+0000", 2024-04-26T10:44:51.646 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000100386 2024-04-26T10:44:51.646 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.646 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.646 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:51.646 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991579+0000", 2024-04-26T10:44:51.646 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4295000000000005e-05 2024-04-26T10:44:51.646 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.646 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.646 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:51.646 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.996238+0000", 2024-04-26T10:44:51.647 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0046589309999999998 2024-04-26T10:44:51.647 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.647 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.647 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.647 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017237+0000", 2024-04-26T10:44:51.647 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020998993000000001 2024-04-26T10:44:51.647 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.647 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.647 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:51.647 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017280+0000", 2024-04-26T10:44:51.647 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3600000000000003e-05 2024-04-26T10:44:51.647 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.648 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.648 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:51.648 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017315+0000", 2024-04-26T10:44:51.648 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4381999999999997e-05 2024-04-26T10:44:51.648 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.648 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:51.648 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.648 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.648 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.648 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12644 4.37 4:ec5044d7:::100000032d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:51.648 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:51.648 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.377039965000002, 2024-04-26T10:44:51.649 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.037018677, 2024-04-26T10:44:51.649 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:51.649 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.649 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:51.649 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:51.649 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:51.649 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12644 2024-04-26T10:44:51.649 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.649 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:51.649 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.649 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:51.649 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:51.650 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.650 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.650 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.650 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:51.650 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:51.650 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.650 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.650 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.650 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:51.650 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160847+0000", 2024-04-26T10:44:51.650 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:51.651 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.651 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.651 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:51.651 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170089+0000", 2024-04-26T10:44:51.651 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092424289999999999 2024-04-26T10:44:51.651 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.651 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.651 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:51.651 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170111+0000", 2024-04-26T10:44:51.651 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1733e-05 2024-04-26T10:44:51.651 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.651 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.652 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.652 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170124+0000", 2024-04-26T10:44:51.652 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.272e-05 2024-04-26T10:44:51.652 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.652 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.652 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:51.652 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170177+0000", 2024-04-26T10:44:51.652 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3745000000000001e-05 2024-04-26T10:44:51.652 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.652 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.652 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:51.652 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170350+0000", 2024-04-26T10:44:51.653 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017297699999999999 2024-04-26T10:44:51.653 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.653 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.653 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:51.653 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170458+0000", 2024-04-26T10:44:51.653 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000107583 2024-04-26T10:44:51.653 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.653 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.653 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:51.653 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.176693+0000", 2024-04-26T10:44:51.653 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062351799999999999 2024-04-26T10:44:51.653 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.654 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.654 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.654 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197774+0000", 2024-04-26T10:44:51.654 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021080471999999999 2024-04-26T10:44:51.654 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.654 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.654 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:51.654 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197824+0000", 2024-04-26T10:44:51.654 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0096000000000003e-05 2024-04-26T10:44:51.654 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.654 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.654 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:51.655 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197867+0000", 2024-04-26T10:44:51.655 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2882e-05 2024-04-26T10:44:51.655 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.655 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:51.655 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.655 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.655 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.655 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:13242 4.2f 4:f5e54bb5:::100000033c8.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:51.655 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:51.655 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 20.698808827000001, 2024-04-26T10:44:51.655 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023873062, 2024-04-26T10:44:51.656 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:51.656 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:51.656 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:51.656 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:51.656 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:51.656 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 13242 2024-04-26T10:44:51.656 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.656 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:51.656 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.656 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:51.656 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:51.656 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.657 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.657 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.657 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:51.657 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:51.657 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:51.657 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.657 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.657 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:51.657 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839078+0000", 2024-04-26T10:44:51.657 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:51.657 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.657 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.658 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:51.658 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848098+0000", 2024-04-26T10:44:51.658 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090200750000000007 2024-04-26T10:44:51.658 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.658 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.658 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:51.658 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848108+0000", 2024-04-26T10:44:51.658 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.062e-05 2024-04-26T10:44:51.658 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.658 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.658 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:51.658 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848115+0000", 2024-04-26T10:44:51.659 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3040000000000001e-06 2024-04-26T10:44:51.659 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.659 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.659 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:51.659 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848157+0000", 2024-04-26T10:44:51.659 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2533000000000001e-05 2024-04-26T10:44:51.659 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.659 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.659 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:51.659 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848252+0000", 2024-04-26T10:44:51.659 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4480000000000003e-05 2024-04-26T10:44:51.659 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.659 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.660 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:51.660 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848393+0000", 2024-04-26T10:44:51.660 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000140863 2024-04-26T10:44:51.660 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.660 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.660 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:51.660 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.854434+0000", 2024-04-26T10:44:51.660 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060415590000000002 2024-04-26T10:44:51.660 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.660 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.660 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:51.660 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862894+0000", 2024-04-26T10:44:51.660 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0084598869999999993 2024-04-26T10:44:51.661 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.661 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.661 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:51.661 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862926+0000", 2024-04-26T10:44:51.661 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1473999999999997e-05 2024-04-26T10:44:51.661 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:51.661 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:51.661 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:51.661 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862952+0000", 2024-04-26T10:44:51.661 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6545000000000001e-05 2024-04-26T10:44:51.661 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.661 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:51.661 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.662 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:51.662 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:51.662 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:51.663 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:51.662+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:51.664 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:51.723 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:44:51.764 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:51.763+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:51.780 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:51.781 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:51.781 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:44:51.781 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:51.790 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:51.865 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:51.864+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:51.897 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:51.897 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:51.897 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:51.897 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:51.897 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:51.905 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:51.966 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:51.964+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:52.014 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:52.014 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:52.014 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:52.014 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:52.014 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.014 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:80 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:52.014 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:52.014 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.488787379000001, 2024-04-26T10:44:52.014 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029259192, 2024-04-26T10:44:52.014 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:52.014 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.015 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:52.015 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.015 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:52.015 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:52.015 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.015 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.015 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.015 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:52.015 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:52.015 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.015 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.015 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.015 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:52.015 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522252+0000", 2024-04-26T10:44:52.016 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:52.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.016 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:52.016 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523121+0000", 2024-04-26T10:44:52.016 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00086885100000000002 2024-04-26T10:44:52.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.016 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:52.016 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523133+0000", 2024-04-26T10:44:52.016 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2109999999999999e-05 2024-04-26T10:44:52.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.017 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.017 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523139+0000", 2024-04-26T10:44:52.017 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.541e-06 2024-04-26T10:44:52.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.017 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:52.017 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523176+0000", 2024-04-26T10:44:52.017 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6847999999999997e-05 2024-04-26T10:44:52.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.017 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:52.017 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523240+0000", 2024-04-26T10:44:52.017 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3941000000000003e-05 2024-04-26T10:44:52.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:52.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.536390+0000", 2024-04-26T10:44:52.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013150811 2024-04-26T10:44:52.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551071+0000", 2024-04-26T10:44:52.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014680021 2024-04-26T10:44:52.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:52.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551428+0000", 2024-04-26T10:44:52.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00035703900000000002 2024-04-26T10:44:52.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.019 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:52.019 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551462+0000", 2024-04-26T10:44:52.019 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4337e-05 2024-04-26T10:44:52.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.019 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:52.019 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551513+0000", 2024-04-26T10:44:52.019 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0875000000000003e-05 2024-04-26T10:44:52.019 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.019 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:52.019 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.020 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:129 3.1a 3:5e41ab69:::200.00000005:head [write 3557843~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:52.020 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:52.020 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.484729308999999, 2024-04-26T10:44:52.020 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029108253000000001, 2024-04-26T10:44:52.020 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:52.020 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.020 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:52.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.020 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:52.020 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:52.020 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.020 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:52.021 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:52.021 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.021 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:52.021 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526311+0000", 2024-04-26T10:44:52.021 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:52.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.021 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:52.021 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526315+0000", 2024-04-26T10:44:52.021 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4809999999999998e-06 2024-04-26T10:44:52.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.021 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:52.022 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526319+0000", 2024-04-26T10:44:52.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0690000000000003e-06 2024-04-26T10:44:52.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.022 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.022 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526321+0000", 2024-04-26T10:44:52.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4880000000000001e-06 2024-04-26T10:44:52.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.022 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:52.022 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553856+0000", 2024-04-26T10:44:52.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027534916 2024-04-26T10:44:52.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:52.023 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553900+0000", 2024-04-26T10:44:52.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3954e-05 2024-04-26T10:44:52.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:52.023 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553962+0000", 2024-04-26T10:44:52.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1519000000000005e-05 2024-04-26T10:44:52.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:52.023 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555348+0000", 2024-04-26T10:44:52.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013864579999999999 2024-04-26T10:44:52.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.024 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.024 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555378+0000", 2024-04-26T10:44:52.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9441000000000002e-05 2024-04-26T10:44:52.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.024 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:52.024 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555401+0000", 2024-04-26T10:44:52.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2815000000000001e-05 2024-04-26T10:44:52.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.024 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:52.024 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555420+0000", 2024-04-26T10:44:52.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9341e-05 2024-04-26T10:44:52.025 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.025 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:52.025 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.025 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:130 3.1a 3:5e41ab69:::200.00000005:head [write 3559243~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:52.025 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:52.025 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.484717474, 2024-04-26T10:44:52.025 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029188316999999998, 2024-04-26T10:44:52.025 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:52.025 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.025 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:52.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.025 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:52.025 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:52.026 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.026 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:52.026 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:52.026 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.026 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:52.026 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:52.026 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:52.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:52.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526325+0000", 2024-04-26T10:44:52.027 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4899999999999999e-06 2024-04-26T10:44:52.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:52.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526327+0000", 2024-04-26T10:44:52.027 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.745e-06 2024-04-26T10:44:52.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526330+0000", 2024-04-26T10:44:52.027 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5620000000000002e-06 2024-04-26T10:44:52.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.028 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:52.028 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554200+0000", 2024-04-26T10:44:52.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027869541000000001 2024-04-26T10:44:52.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.028 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:52.028 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554244+0000", 2024-04-26T10:44:52.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4464e-05 2024-04-26T10:44:52.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.028 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:52.028 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554304+0000", 2024-04-26T10:44:52.029 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9457999999999999e-05 2024-04-26T10:44:52.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.029 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.029 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555453+0000", 2024-04-26T10:44:52.029 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011494000000000001 2024-04-26T10:44:52.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.029 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:52.029 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555457+0000", 2024-04-26T10:44:52.029 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1779999999999996e-06 2024-04-26T10:44:52.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.030 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:52.030 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555480+0000", 2024-04-26T10:44:52.030 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2802e-05 2024-04-26T10:44:52.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.030 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:52.030 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555512+0000", 2024-04-26T10:44:52.030 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1885999999999999e-05 2024-04-26T10:44:52.030 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.030 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:52.030 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.031 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:131 3.1a 3:5e41ab69:::200.00000005:head [write 3560642~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:52.031 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:52.031 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.484708894000001, 2024-04-26T10:44:52.031 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029683102999999999, 2024-04-26T10:44:52.031 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:52.031 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.031 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:52.031 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.031 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:52.031 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:52.031 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.031 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.031 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:52.032 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:52.032 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.032 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:52.032 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:52.032 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:52.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.032 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:52.032 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526336+0000", 2024-04-26T10:44:52.032 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.681e-06 2024-04-26T10:44:52.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.033 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:52.033 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526338+0000", 2024-04-26T10:44:52.033 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8430000000000001e-06 2024-04-26T10:44:52.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.033 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.033 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526341+0000", 2024-04-26T10:44:52.033 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6180000000000002e-06 2024-04-26T10:44:52.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.033 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:52.033 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554745+0000", 2024-04-26T10:44:52.033 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028404088000000001 2024-04-26T10:44:52.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.034 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:52.034 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554788+0000", 2024-04-26T10:44:52.034 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2738999999999999e-05 2024-04-26T10:44:52.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.034 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:52.034 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554849+0000", 2024-04-26T10:44:52.034 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1362e-05 2024-04-26T10:44:52.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.034 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.034 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555963+0000", 2024-04-26T10:44:52.034 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001113597 2024-04-26T10:44:52.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.035 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:52.035 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555969+0000", 2024-04-26T10:44:52.035 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6900000000000003e-06 2024-04-26T10:44:52.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.035 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:52.035 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555995+0000", 2024-04-26T10:44:52.035 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5165999999999999e-05 2024-04-26T10:44:52.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.035 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:52.035 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556015+0000", 2024-04-26T10:44:52.035 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0522000000000001e-05 2024-04-26T10:44:52.036 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.036 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:52.036 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.036 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.036 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:132 3.1a 3:5e41ab69:::200.00000005:head [write 3562043~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:52.036 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:52.036 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.484688629000001, 2024-04-26T10:44:52.036 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030129895, 2024-04-26T10:44:52.036 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:52.036 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.036 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:52.036 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.036 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:52.037 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:52.037 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.037 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:52.037 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:52.037 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.037 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:52.037 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:52.037 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:52.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.038 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:52.038 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526354+0000", 2024-04-26T10:44:52.038 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8560000000000001e-06 2024-04-26T10:44:52.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.038 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:52.038 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526359+0000", 2024-04-26T10:44:52.038 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4700000000000001e-06 2024-04-26T10:44:52.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.038 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.038 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526365+0000", 2024-04-26T10:44:52.038 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2120000000000002e-06 2024-04-26T10:44:52.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.039 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:52.039 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555050+0000", 2024-04-26T10:44:52.039 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028685458 2024-04-26T10:44:52.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.039 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:52.039 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555093+0000", 2024-04-26T10:44:52.039 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3307999999999999e-05 2024-04-26T10:44:52.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.039 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:52.039 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555156+0000", 2024-04-26T10:44:52.039 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2396000000000004e-05 2024-04-26T10:44:52.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.040 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.040 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556052+0000", 2024-04-26T10:44:52.040 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00089650299999999999 2024-04-26T10:44:52.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.040 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:52.040 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556439+0000", 2024-04-26T10:44:52.040 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038647900000000001 2024-04-26T10:44:52.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.040 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:52.040 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556463+0000", 2024-04-26T10:44:52.041 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4071e-05 2024-04-26T10:44:52.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.041 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:52.041 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556482+0000", 2024-04-26T10:44:52.041 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9378999999999999e-05 2024-04-26T10:44:52.041 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.041 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:52.041 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.041 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 3563440~3660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:52.041 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:52.042 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.484672235000001, 2024-04-26T10:44:52.042 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030550738000000001, 2024-04-26T10:44:52.042 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:52.042 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.042 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:52.042 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.042 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:52.042 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:52.042 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.042 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.042 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.042 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:52.042 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:52.042 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.043 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.043 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:52.043 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526368+0000", 2024-04-26T10:44:52.043 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:52.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.043 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.043 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:52.043 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526375+0000", 2024-04-26T10:44:52.043 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7510000000000002e-06 2024-04-26T10:44:52.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.043 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.043 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:52.043 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526381+0000", 2024-04-26T10:44:52.044 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3929999999999996e-06 2024-04-26T10:44:52.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.044 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.044 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526387+0000", 2024-04-26T10:44:52.044 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.215e-06 2024-04-26T10:44:52.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.044 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:52.044 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555542+0000", 2024-04-26T10:44:52.044 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029154992000000001 2024-04-26T10:44:52.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.044 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:52.044 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555610+0000", 2024-04-26T10:44:52.045 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8610999999999998e-05 2024-04-26T10:44:52.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.045 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.045 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:52.045 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555681+0000", 2024-04-26T10:44:52.045 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1072e-05 2024-04-26T10:44:52.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.045 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.045 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.045 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556866+0000", 2024-04-26T10:44:52.045 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001184598 2024-04-26T10:44:52.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.045 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.046 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:52.046 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556872+0000", 2024-04-26T10:44:52.046 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.55e-06 2024-04-26T10:44:52.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.046 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.046 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:52.046 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556897+0000", 2024-04-26T10:44:52.046 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.516e-05 2024-04-26T10:44:52.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.046 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.046 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:52.046 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556919+0000", 2024-04-26T10:44:52.046 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1951e-05 2024-04-26T10:44:52.046 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.047 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:52.047 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.047 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.047 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.047 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:134 3.1a 3:5e41ab69:::200.00000005:head [write 3567100~2427 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:52.047 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:52.047 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.484639170000001, 2024-04-26T10:44:52.047 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031267445999999997, 2024-04-26T10:44:52.047 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:52.047 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.047 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:52.047 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.047 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:52.047 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:52.048 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.048 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:52.048 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:52.048 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.048 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:52.048 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526401+0000", 2024-04-26T10:44:52.048 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:52.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.048 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:52.048 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526408+0000", 2024-04-26T10:44:52.049 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7769999999999997e-06 2024-04-26T10:44:52.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.049 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:52.049 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526415+0000", 2024-04-26T10:44:52.049 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0720000000000002e-06 2024-04-26T10:44:52.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.049 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.049 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526421+0000", 2024-04-26T10:44:52.049 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9699999999999996e-06 2024-04-26T10:44:52.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.049 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:52.050 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556084+0000", 2024-04-26T10:44:52.050 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029662351999999999 2024-04-26T10:44:52.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.050 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:52.050 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556126+0000", 2024-04-26T10:44:52.050 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2385000000000002e-05 2024-04-26T10:44:52.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.050 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:52.050 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556186+0000", 2024-04-26T10:44:52.050 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9945999999999998e-05 2024-04-26T10:44:52.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.051 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:52.051 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557598+0000", 2024-04-26T10:44:52.051 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0014121559999999999 2024-04-26T10:44:52.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.051 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.051 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557626+0000", 2024-04-26T10:44:52.051 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7960999999999999e-05 2024-04-26T10:44:52.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.051 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:52.051 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557650+0000", 2024-04-26T10:44:52.051 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3969999999999999e-05 2024-04-26T10:44:52.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.052 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:52.052 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557669+0000", 2024-04-26T10:44:52.052 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9262e-05 2024-04-26T10:44:52.052 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.052 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:52.052 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.052 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.052 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.052 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:135 3.1a 3:5e41ab69:::200.00000005:head [write 3569527~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:52.052 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:52.052 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.484614904000001, 2024-04-26T10:44:52.052 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031322516000000002, 2024-04-26T10:44:52.052 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:52.052 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.053 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:52.053 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.053 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:52.053 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:52.053 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.053 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.053 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:52.053 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:52.053 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.053 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.053 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:52.053 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:52.054 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:52.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.054 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.054 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:52.054 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526429+0000", 2024-04-26T10:44:52.054 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0750000000000002e-06 2024-04-26T10:44:52.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.054 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.054 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:52.054 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526435+0000", 2024-04-26T10:44:52.054 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.263e-06 2024-04-26T10:44:52.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.054 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.054 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.055 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526442+0000", 2024-04-26T10:44:52.055 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1219999999999997e-06 2024-04-26T10:44:52.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.055 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.055 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:52.055 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556515+0000", 2024-04-26T10:44:52.055 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030073132999999998 2024-04-26T10:44:52.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.055 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.055 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:52.055 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556564+0000", 2024-04-26T10:44:52.055 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8871e-05 2024-04-26T10:44:52.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.056 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.056 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:52.056 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556625+0000", 2024-04-26T10:44:52.056 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1307000000000001e-05 2024-04-26T10:44:52.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.056 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.056 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:52.056 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557678+0000", 2024-04-26T10:44:52.056 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010523100000000001 2024-04-26T10:44:52.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.056 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.056 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.056 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557709+0000", 2024-04-26T10:44:52.056 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1748000000000002e-05 2024-04-26T10:44:52.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.057 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.057 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:52.057 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557732+0000", 2024-04-26T10:44:52.057 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2415000000000001e-05 2024-04-26T10:44:52.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.057 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.057 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:52.057 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557749+0000", 2024-04-26T10:44:52.057 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6736999999999999e-05 2024-04-26T10:44:52.057 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.057 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:52.057 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.057 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.058 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:136 3.1a 3:5e41ab69:::200.00000005:head [write 3571449~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:52.058 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:52.058 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.484593713999999, 2024-04-26T10:44:52.058 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032180937, 2024-04-26T10:44:52.058 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:52.058 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.058 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:52.058 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.058 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:52.058 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:52.058 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.058 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.058 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.058 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:52.059 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:52.059 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.059 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.059 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:52.059 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:52.059 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:52.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.059 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.059 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:52.059 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526455+0000", 2024-04-26T10:44:52.059 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6429999999999995e-06 2024-04-26T10:44:52.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.059 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.059 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:52.060 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526461+0000", 2024-04-26T10:44:52.060 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:52.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.060 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.060 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.060 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526467+0000", 2024-04-26T10:44:52.060 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4389999999999999e-06 2024-04-26T10:44:52.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.060 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.060 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:52.060 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556950+0000", 2024-04-26T10:44:52.060 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030483854000000001 2024-04-26T10:44:52.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.060 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556989+0000", 2024-04-26T10:44:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8415999999999999e-05 2024-04-26T10:44:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557051+0000", 2024-04-26T10:44:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2088999999999995e-05 2024-04-26T10:44:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558166+0000", 2024-04-26T10:44:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001114622 2024-04-26T10:44:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.062 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.062 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558584+0000", 2024-04-26T10:44:52.062 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000418033 2024-04-26T10:44:52.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.062 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.062 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:52.062 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558609+0000", 2024-04-26T10:44:52.062 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5344999999999999e-05 2024-04-26T10:44:52.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.062 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.062 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:52.062 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558628+0000", 2024-04-26T10:44:52.062 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9273999999999999e-05 2024-04-26T10:44:52.062 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.063 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:52.063 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.063 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.063 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:137 3.1a 3:5e41ab69:::200.00000005:head [write 3573699~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:52.063 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:52.063 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.484570065, 2024-04-26T10:44:52.063 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032241530999999997, 2024-04-26T10:44:52.063 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:52.063 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.063 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:52.063 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.063 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:52.063 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:52.064 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.064 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.064 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.064 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:52.064 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:52.064 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.064 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.064 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.064 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:52.064 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526470+0000", 2024-04-26T10:44:52.064 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:52.064 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.064 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.064 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:52.065 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526473+0000", 2024-04-26T10:44:52.065 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.818e-06 2024-04-26T10:44:52.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.065 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.065 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:52.065 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526480+0000", 2024-04-26T10:44:52.065 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4119999999999998e-06 2024-04-26T10:44:52.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.065 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.065 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.065 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526484+0000", 2024-04-26T10:44:52.066 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6840000000000004e-06 2024-04-26T10:44:52.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.066 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.066 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:52.066 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557323+0000", 2024-04-26T10:44:52.067 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030838956000000001 2024-04-26T10:44:52.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.067 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:52.067 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557362+0000", 2024-04-26T10:44:52.067 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8343999999999997e-05 2024-04-26T10:44:52.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.067 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:52.067 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557421+0000", 2024-04-26T10:44:52.067 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9176999999999999e-05 2024-04-26T10:44:52.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.068 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:52.068 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558636+0000", 2024-04-26T10:44:52.068 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012153789999999999 2024-04-26T10:44:52.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.068 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.068 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558668+0000", 2024-04-26T10:44:52.068 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1452999999999999e-05 2024-04-26T10:44:52.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.068 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:52.069 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558694+0000", 2024-04-26T10:44:52.069 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6288999999999999e-05 2024-04-26T10:44:52.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.069 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.069 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:52.069 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558712+0000", 2024-04-26T10:44:52.069 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8459000000000001e-05 2024-04-26T10:44:52.069 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.069 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:52.069 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.070 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:138 3.1a 3:5e41ab69:::200.00000005:head [write 3575103~4205 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:52.070 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:52.070 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.484552745999999, 2024-04-26T10:44:52.070 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032665567999999999, 2024-04-26T10:44:52.070 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:52.070 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.070 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:52.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.070 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:52.070 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:52.070 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.070 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.071 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.071 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:52.071 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:52.071 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.071 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.071 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:52.071 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:52.071 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:52.071 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.072 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:52.072 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526495+0000", 2024-04-26T10:44:52.072 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7580000000000003e-06 2024-04-26T10:44:52.072 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.072 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:52.072 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526501+0000", 2024-04-26T10:44:52.072 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1680000000000001e-06 2024-04-26T10:44:52.072 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.073 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.073 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526505+0000", 2024-04-26T10:44:52.073 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.673e-06 2024-04-26T10:44:52.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.073 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.073 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:52.073 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557781+0000", 2024-04-26T10:44:52.073 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031275718000000001 2024-04-26T10:44:52.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.073 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.073 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:52.073 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557825+0000", 2024-04-26T10:44:52.073 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4048000000000002e-05 2024-04-26T10:44:52.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.074 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.074 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:52.074 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557888+0000", 2024-04-26T10:44:52.074 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2562000000000002e-05 2024-04-26T10:44:52.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.074 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.074 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.074 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559073+0000", 2024-04-26T10:44:52.074 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011852239999999999 2024-04-26T10:44:52.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.074 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.074 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:52.074 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559112+0000", 2024-04-26T10:44:52.075 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9226e-05 2024-04-26T10:44:52.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.075 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:52.075 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559136+0000", 2024-04-26T10:44:52.075 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3966000000000001e-05 2024-04-26T10:44:52.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.075 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:52.075 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559154+0000", 2024-04-26T10:44:52.075 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7575e-05 2024-04-26T10:44:52.075 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.075 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:52.075 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.076 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.076 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:139 3.1a 3:5e41ab69:::200.00000005:head [write 3579308~2255 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:52.076 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:52.076 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.484531128, 2024-04-26T10:44:52.076 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033424720999999998, 2024-04-26T10:44:52.076 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:52.076 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.076 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:52.076 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.076 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:52.076 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:52.076 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.077 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.077 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:52.077 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:52.077 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.077 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.077 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:52.077 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526509+0000", 2024-04-26T10:44:52.077 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:52.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.077 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.077 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:52.077 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526516+0000", 2024-04-26T10:44:52.077 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5209999999999999e-06 2024-04-26T10:44:52.078 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.078 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:52.078 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526522+0000", 2024-04-26T10:44:52.078 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1229999999999997e-06 2024-04-26T10:44:52.078 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.078 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.078 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526527+0000", 2024-04-26T10:44:52.078 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7849999999999999e-06 2024-04-26T10:44:52.078 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.078 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:52.078 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558194+0000", 2024-04-26T10:44:52.079 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031667419000000002 2024-04-26T10:44:52.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.079 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:52.079 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558234+0000", 2024-04-26T10:44:52.079 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9774999999999998e-05 2024-04-26T10:44:52.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.079 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:52.079 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558294+0000", 2024-04-26T10:44:52.079 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0242999999999999e-05 2024-04-26T10:44:52.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.079 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.080 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559106+0000", 2024-04-26T10:44:52.080 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00081148099999999996 2024-04-26T10:44:52.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.080 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.080 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:52.080 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559890+0000", 2024-04-26T10:44:52.080 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00078439999999999998 2024-04-26T10:44:52.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.080 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.080 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:52.080 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559917+0000", 2024-04-26T10:44:52.080 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7044000000000001e-05 2024-04-26T10:44:52.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.080 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.080 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:52.081 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559935+0000", 2024-04-26T10:44:52.081 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7448e-05 2024-04-26T10:44:52.081 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.081 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:52.081 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.081 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.081 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.081 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:140 3.1a 3:5e41ab69:::200.00000005:head [write 3581563~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:52.081 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:52.081 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.484509707000001, 2024-04-26T10:44:52.081 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033867728, 2024-04-26T10:44:52.081 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:52.081 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.081 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:52.081 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.082 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:52.082 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:52.082 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.082 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.082 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:52.082 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:52.082 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.082 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.082 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:52.082 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:52.082 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:52.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.083 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.083 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:52.083 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526538+0000", 2024-04-26T10:44:52.083 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.905e-06 2024-04-26T10:44:52.083 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.083 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.083 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:52.083 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526542+0000", 2024-04-26T10:44:52.083 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9550000000000002e-06 2024-04-26T10:44:52.083 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.083 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.083 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.083 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526545+0000", 2024-04-26T10:44:52.083 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8499999999999998e-06 2024-04-26T10:44:52.084 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.084 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.084 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:52.084 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558744+0000", 2024-04-26T10:44:52.084 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032198986999999998 2024-04-26T10:44:52.084 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.084 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.084 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:52.084 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558788+0000", 2024-04-26T10:44:52.084 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4365e-05 2024-04-26T10:44:52.084 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.084 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.084 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:52.084 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558854+0000", 2024-04-26T10:44:52.085 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5952999999999997e-05 2024-04-26T10:44:52.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.085 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.085 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.085 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559971+0000", 2024-04-26T10:44:52.085 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011172770000000001 2024-04-26T10:44:52.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.085 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.085 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:52.086 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560354+0000", 2024-04-26T10:44:52.086 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038267599999999998 2024-04-26T10:44:52.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.086 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:52.086 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560380+0000", 2024-04-26T10:44:52.086 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6140999999999999e-05 2024-04-26T10:44:52.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.086 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:52.086 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560399+0000", 2024-04-26T10:44:52.086 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9032999999999999e-05 2024-04-26T10:44:52.086 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.086 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:52.087 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.087 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.087 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:141 3.1a 3:5e41ab69:::200.00000005:head [write 3583482~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:52.087 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:52.087 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.484494047999998, 2024-04-26T10:44:52.087 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034316301, 2024-04-26T10:44:52.087 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:52.087 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.087 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:52.087 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.087 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:52.087 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:52.087 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.088 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.088 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.088 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:52.088 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:52.088 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.088 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.088 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.088 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:52.088 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:52.088 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:52.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.089 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.089 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:52.089 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526548+0000", 2024-04-26T10:44:52.089 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.739e-06 2024-04-26T10:44:52.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.089 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.089 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:52.089 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526551+0000", 2024-04-26T10:44:52.089 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.044e-06 2024-04-26T10:44:52.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.089 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.089 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.089 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526562+0000", 2024-04-26T10:44:52.089 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0370000000000001e-05 2024-04-26T10:44:52.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.090 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:52.090 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559179+0000", 2024-04-26T10:44:52.090 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032617444000000002 2024-04-26T10:44:52.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.090 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:52.090 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559220+0000", 2024-04-26T10:44:52.090 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0364999999999997e-05 2024-04-26T10:44:52.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.090 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:52.090 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559280+0000", 2024-04-26T10:44:52.091 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0569000000000002e-05 2024-04-26T10:44:52.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.091 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.091 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560814+0000", 2024-04-26T10:44:52.091 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015337580000000001 2024-04-26T10:44:52.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.091 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:52.091 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560820+0000", 2024-04-26T10:44:52.091 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.455e-06 2024-04-26T10:44:52.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.091 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:52.091 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560846+0000", 2024-04-26T10:44:52.092 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5228999999999998e-05 2024-04-26T10:44:52.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.092 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:52.092 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560863+0000", 2024-04-26T10:44:52.092 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7555e-05 2024-04-26T10:44:52.092 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.092 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:52.092 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.092 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:142 3.1a 3:5e41ab69:::200.00000005:head [write 3585931~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:52.092 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:52.092 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.484473650999998, 2024-04-26T10:44:52.093 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034372373999999997, 2024-04-26T10:44:52.093 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:52.093 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.093 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:52.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.093 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:52.093 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:52.093 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.093 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:52.093 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:52.093 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.094 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:52.094 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:52.094 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:52.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.094 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:52.094 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526573+0000", 2024-04-26T10:44:52.094 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0800000000000002e-06 2024-04-26T10:44:52.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.094 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:52.094 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526580+0000", 2024-04-26T10:44:52.094 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5799999999999997e-06 2024-04-26T10:44:52.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.095 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.095 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526585+0000", 2024-04-26T10:44:52.095 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2270000000000001e-06 2024-04-26T10:44:52.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.095 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:52.095 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559601+0000", 2024-04-26T10:44:52.095 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033016684999999997 2024-04-26T10:44:52.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.095 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:52.095 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559642+0000", 2024-04-26T10:44:52.095 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0321000000000002e-05 2024-04-26T10:44:52.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.096 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:52.096 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559706+0000", 2024-04-26T10:44:52.096 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4228999999999998e-05 2024-04-26T10:44:52.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.096 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:52.096 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560871+0000", 2024-04-26T10:44:52.096 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001164893 2024-04-26T10:44:52.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.096 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.096 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560899+0000", 2024-04-26T10:44:52.096 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:52.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.097 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:52.097 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560922+0000", 2024-04-26T10:44:52.097 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3337999999999999e-05 2024-04-26T10:44:52.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.097 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:52.097 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560940+0000", 2024-04-26T10:44:52.097 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7289999999999999e-05 2024-04-26T10:44:52.097 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.097 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:52.097 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.098 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.098 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:143 3.1a 3:5e41ab69:::200.00000005:head [write 3587331~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:52.098 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:52.098 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.484451752999998, 2024-04-26T10:44:52.098 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035256000000000003, 2024-04-26T10:44:52.098 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:52.098 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.098 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:52.098 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.098 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:52.098 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:52.098 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.098 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.099 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:52.099 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:52.099 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.099 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:52.099 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:52.099 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:52.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.099 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:52.099 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526592+0000", 2024-04-26T10:44:52.099 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2449999999999998e-06 2024-04-26T10:44:52.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.100 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.100 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:52.100 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526596+0000", 2024-04-26T10:44:52.100 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7000000000000002e-06 2024-04-26T10:44:52.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.100 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.100 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.100 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526599+0000", 2024-04-26T10:44:52.100 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6160000000000002e-06 2024-04-26T10:44:52.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.100 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.100 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:52.100 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559997+0000", 2024-04-26T10:44:52.100 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033397835000000001 2024-04-26T10:44:52.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.101 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:52.101 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560051+0000", 2024-04-26T10:44:52.101 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3742000000000001e-05 2024-04-26T10:44:52.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.101 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:52.101 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560112+0000", 2024-04-26T10:44:52.101 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0851999999999999e-05 2024-04-26T10:44:52.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.101 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:52.101 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561404+0000", 2024-04-26T10:44:52.102 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001291869 2024-04-26T10:44:52.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.102 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.102 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.102 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561797+0000", 2024-04-26T10:44:52.102 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039383000000000002 2024-04-26T10:44:52.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.102 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.102 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:52.102 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561827+0000", 2024-04-26T10:44:52.102 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9247e-05 2024-04-26T10:44:52.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.102 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.102 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:52.102 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561845+0000", 2024-04-26T10:44:52.103 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8462999999999999e-05 2024-04-26T10:44:52.103 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.103 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:52.103 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.103 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.103 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:144 3.1a 3:5e41ab69:::200.00000005:head [write 3588736~4987 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:52.103 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:52.103 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.484329461000002, 2024-04-26T10:44:52.103 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035224283000000002, 2024-04-26T10:44:52.103 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:52.103 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.103 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:52.103 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.104 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:52.104 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:52.104 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.104 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:52.104 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:52.104 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.104 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:52.104 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:52.104 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:52.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.105 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:52.105 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526718+0000", 2024-04-26T10:44:52.105 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.43e-06 2024-04-26T10:44:52.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.105 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:52.105 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526726+0000", 2024-04-26T10:44:52.105 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:44:52.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.105 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.105 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526729+0000", 2024-04-26T10:44:52.106 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6480000000000001e-06 2024-04-26T10:44:52.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.106 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:52.106 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560427+0000", 2024-04-26T10:44:52.106 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033697280000000003 2024-04-26T10:44:52.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.106 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:52.106 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560466+0000", 2024-04-26T10:44:52.106 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9606e-05 2024-04-26T10:44:52.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.106 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:52.107 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560525+0000", 2024-04-26T10:44:52.107 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9218000000000001e-05 2024-04-26T10:44:52.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.107 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:52.107 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561854+0000", 2024-04-26T10:44:52.107 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001328421 2024-04-26T10:44:52.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.107 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.107 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561887+0000", 2024-04-26T10:44:52.107 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2746000000000001e-05 2024-04-26T10:44:52.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.108 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:52.108 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561912+0000", 2024-04-26T10:44:52.108 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5126999999999998e-05 2024-04-26T10:44:52.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.108 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:52.108 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561936+0000", 2024-04-26T10:44:52.108 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4032999999999998e-05 2024-04-26T10:44:52.108 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.108 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:52.108 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.108 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:145 3.1a 3:5e41ab69:::200.00000005:head [write 3593723~2939 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:52.108 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:52.109 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.481410415999999, 2024-04-26T10:44:52.109 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033294394999999997, 2024-04-26T10:44:52.109 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:52.109 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.109 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:52.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.109 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:52.109 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:52.109 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.109 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:52.109 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:52.109 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.110 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:52.110 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529630+0000", 2024-04-26T10:44:52.110 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:52.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.110 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:52.110 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529635+0000", 2024-04-26T10:44:52.110 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7960000000000003e-06 2024-04-26T10:44:52.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.111 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:52.111 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529643+0000", 2024-04-26T10:44:52.111 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0390000000000005e-06 2024-04-26T10:44:52.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.111 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.111 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529648+0000", 2024-04-26T10:44:52.111 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9599999999999999e-06 2024-04-26T10:44:52.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.111 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:52.111 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560969+0000", 2024-04-26T10:44:52.111 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031321767 2024-04-26T10:44:52.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.112 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:52.112 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561009+0000", 2024-04-26T10:44:52.112 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9904999999999998e-05 2024-04-26T10:44:52.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.112 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:52.112 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561070+0000", 2024-04-26T10:44:52.112 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0708999999999998e-05 2024-04-26T10:44:52.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.112 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:52.112 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562352+0000", 2024-04-26T10:44:52.112 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012818440000000001 2024-04-26T10:44:52.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.113 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.113 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562867+0000", 2024-04-26T10:44:52.113 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000515665 2024-04-26T10:44:52.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.113 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:52.113 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562893+0000", 2024-04-26T10:44:52.113 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5469999999999998e-05 2024-04-26T10:44:52.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.113 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:52.113 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562925+0000", 2024-04-26T10:44:52.114 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1974999999999998e-05 2024-04-26T10:44:52.114 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.114 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:52.114 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.114 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:146 3.1a 3:5e41ab69:::200.00000005:head [write 3596662~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:52.114 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:52.114 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.481182201999999, 2024-04-26T10:44:52.114 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033178429000000002, 2024-04-26T10:44:52.114 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:52.114 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.114 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:52.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.115 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:52.115 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:52.115 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.115 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:52.115 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:52.115 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.115 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:52.115 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529858+0000", 2024-04-26T10:44:52.115 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:52.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.116 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:52.116 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529863+0000", 2024-04-26T10:44:52.116 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4500000000000003e-06 2024-04-26T10:44:52.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.116 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:52.116 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529874+0000", 2024-04-26T10:44:52.116 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0552e-05 2024-04-26T10:44:52.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.116 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.116 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529882+0000", 2024-04-26T10:44:52.116 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4449999999999996e-06 2024-04-26T10:44:52.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.117 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:52.117 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561452+0000", 2024-04-26T10:44:52.117 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031569680000000003 2024-04-26T10:44:52.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.117 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:52.117 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561511+0000", 2024-04-26T10:44:52.117 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9332e-05 2024-04-26T10:44:52.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.117 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:52.117 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561583+0000", 2024-04-26T10:44:52.117 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1730000000000006e-05 2024-04-26T10:44:52.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.118 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:52.118 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562933+0000", 2024-04-26T10:44:52.118 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013500059999999999 2024-04-26T10:44:52.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.118 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.118 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562976+0000", 2024-04-26T10:44:52.118 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2987e-05 2024-04-26T10:44:52.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.118 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:52.118 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563015+0000", 2024-04-26T10:44:52.119 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9453999999999999e-05 2024-04-26T10:44:52.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.119 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:52.119 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563037+0000", 2024-04-26T10:44:52.119 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1679e-05 2024-04-26T10:44:52.119 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.119 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:52.119 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.119 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.119 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.119 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:277 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:52.119 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:52.119 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.496171498999999, 2024-04-26T10:44:52.119 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030430563000000001, 2024-04-26T10:44:52.120 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:52.120 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.120 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:52.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.120 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:52.120 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:52.120 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.120 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:52.120 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:52.120 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:52.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.120 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:52.121 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514867+0000", 2024-04-26T10:44:52.121 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:52.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.121 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:52.121 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515460+0000", 2024-04-26T10:44:52.121 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00059285800000000004 2024-04-26T10:44:52.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.121 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:52.121 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515474+0000", 2024-04-26T10:44:52.121 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3933e-05 2024-04-26T10:44:52.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.121 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.122 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515481+0000", 2024-04-26T10:44:52.122 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:52.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.122 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:52.122 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515522+0000", 2024-04-26T10:44:52.122 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1369000000000003e-05 2024-04-26T10:44:52.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.122 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:52.122 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515591+0000", 2024-04-26T10:44:52.122 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9377999999999999e-05 2024-04-26T10:44:52.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.123 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.123 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:52.123 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.526440+0000", 2024-04-26T10:44:52.123 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010848837 2024-04-26T10:44:52.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.123 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.123 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.123 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.543866+0000", 2024-04-26T10:44:52.123 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017426288000000002 2024-04-26T10:44:52.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.123 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.123 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:52.123 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545193+0000", 2024-04-26T10:44:52.123 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001326111 2024-04-26T10:44:52.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.124 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:52.124 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545229+0000", 2024-04-26T10:44:52.124 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6390999999999998e-05 2024-04-26T10:44:52.124 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:52.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:52.124 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:52.124 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545300+0000", 2024-04-26T10:44:52.124 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1073000000000002e-05 2024-04-26T10:44:52.124 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.124 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:52.124 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.124 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:52.124 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:52.125 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:52.126 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:52.127 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:52.125+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:52.226 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:52.225+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:52.239 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:52.239 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:52.239 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:44:52.239 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:52.249 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:52.327 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:52.326+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:52.350 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:52.350 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:52.350 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:52.350 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:52.350 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:52.359 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:52.429 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:52.427+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:52.462 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:52.462 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:52.462 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:52.462 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:52.462 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.462 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:330 3.13 3:ceffbd45:::200.0000000a:head [write 1316140~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:52.462 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:52.462 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.946712904999998, 2024-04-26T10:44:52.462 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022245654, 2024-04-26T10:44:52.463 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:52.463 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.463 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:52.463 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.463 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:52.463 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:52.463 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.463 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.463 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.463 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:52.463 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:52.463 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.463 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.463 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.463 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:52.464 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513139+0000", 2024-04-26T10:44:52.464 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:52.464 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.464 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.464 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:52.464 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513149+0000", 2024-04-26T10:44:52.464 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7550000000000006e-06 2024-04-26T10:44:52.464 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.464 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.464 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:52.464 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513157+0000", 2024-04-26T10:44:52.464 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1089999999999998e-06 2024-04-26T10:44:52.465 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.465 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.465 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.465 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513167+0000", 2024-04-26T10:44:52.465 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0539e-05 2024-04-26T10:44:52.465 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.465 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.465 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:52.465 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533830+0000", 2024-04-26T10:44:52.465 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020662852999999998 2024-04-26T10:44:52.465 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.465 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.465 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:52.465 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533875+0000", 2024-04-26T10:44:52.466 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.5071999999999998e-05 2024-04-26T10:44:52.466 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.466 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.466 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:52.466 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535319+0000", 2024-04-26T10:44:52.466 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001443578 2024-04-26T10:44:52.466 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.466 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.466 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:52.466 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535346+0000", 2024-04-26T10:44:52.466 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7415000000000001e-05 2024-04-26T10:44:52.466 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.466 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.467 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:52.467 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535385+0000", 2024-04-26T10:44:52.467 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8912999999999998e-05 2024-04-26T10:44:52.467 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.467 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:52.467 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.467 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.467 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.467 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:331 3.13 3:ceffbd45:::200.0000000a:head [write 1318049~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:52.467 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:52.467 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.946673576999999, 2024-04-26T10:44:52.467 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023524521, 2024-04-26T10:44:52.467 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:52.468 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.468 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:52.468 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.468 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:52.468 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:52.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.468 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.468 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.468 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:52.468 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:52.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.468 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.468 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.468 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:52.468 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513178+0000", 2024-04-26T10:44:52.469 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:52.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.469 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:52.469 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513183+0000", 2024-04-26T10:44:52.469 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2549999999999999e-06 2024-04-26T10:44:52.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.469 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:52.469 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513190+0000", 2024-04-26T10:44:52.469 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8460000000000002e-06 2024-04-26T10:44:52.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.469 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.470 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513195+0000", 2024-04-26T10:44:52.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3630000000000002e-06 2024-04-26T10:44:52.470 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.470 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.470 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:52.470 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534463+0000", 2024-04-26T10:44:52.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021267823000000002 2024-04-26T10:44:52.470 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.470 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.470 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:52.470 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534520+0000", 2024-04-26T10:44:52.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7510000000000003e-05 2024-04-26T10:44:52.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:52.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536634+0000", 2024-04-26T10:44:52.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0021138900000000002 2024-04-26T10:44:52.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:52.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536663+0000", 2024-04-26T10:44:52.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8884e-05 2024-04-26T10:44:52.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:52.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536703+0000", 2024-04-26T10:44:52.472 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0479000000000003e-05 2024-04-26T10:44:52.472 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.472 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:52.472 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.472 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.472 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.472 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:332 3.13 3:ceffbd45:::200.0000000a:head [write 1319462~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:52.472 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:52.472 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.946638744000001, 2024-04-26T10:44:52.472 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024543230999999999, 2024-04-26T10:44:52.472 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:52.472 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.472 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:52.472 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.473 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:52.473 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:52.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.473 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.473 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.473 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:52.473 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:52.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.473 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.473 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.473 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:52.473 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513213+0000", 2024-04-26T10:44:52.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:52.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:52.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513217+0000", 2024-04-26T10:44:52.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:44:52.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:52.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513229+0000", 2024-04-26T10:44:52.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2051e-05 2024-04-26T10:44:52.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513236+0000", 2024-04-26T10:44:52.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4470000000000003e-06 2024-04-26T10:44:52.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.475 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:52.475 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534891+0000", 2024-04-26T10:44:52.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021655863000000001 2024-04-26T10:44:52.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.475 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:52.475 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534933+0000", 2024-04-26T10:44:52.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1596e-05 2024-04-26T10:44:52.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.476 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:52.476 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537677+0000", 2024-04-26T10:44:52.476 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027440989999999998 2024-04-26T10:44:52.476 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.476 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.476 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:52.476 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537721+0000", 2024-04-26T10:44:52.476 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3813999999999998e-05 2024-04-26T10:44:52.476 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.476 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.476 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:52.476 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537757+0000", 2024-04-26T10:44:52.476 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6022999999999997e-05 2024-04-26T10:44:52.477 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.477 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:52.477 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.477 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.477 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.477 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:333 3.13 3:ceffbd45:::200.0000000a:head [write 1320870~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:52.477 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:52.477 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.946595824999999, 2024-04-26T10:44:52.477 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024557151999999999, 2024-04-26T10:44:52.477 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:52.477 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.477 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:52.477 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.478 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:52.478 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:52.478 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.478 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.478 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.478 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:52.478 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:52.478 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.478 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.478 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.478 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:52.478 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513256+0000", 2024-04-26T10:44:52.479 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:52.479 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.479 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.479 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:52.479 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513260+0000", 2024-04-26T10:44:52.479 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6550000000000002e-06 2024-04-26T10:44:52.479 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.479 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.479 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:52.479 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513273+0000", 2024-04-26T10:44:52.479 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2965e-05 2024-04-26T10:44:52.479 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.479 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.479 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.480 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513279+0000", 2024-04-26T10:44:52.480 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:44:52.480 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.480 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.480 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:52.480 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535411+0000", 2024-04-26T10:44:52.480 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022132233000000001 2024-04-26T10:44:52.480 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.480 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.480 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:52.480 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535479+0000", 2024-04-26T10:44:52.480 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7554999999999999e-05 2024-04-26T10:44:52.480 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.480 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.481 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:52.481 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537762+0000", 2024-04-26T10:44:52.481 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022836499999999999 2024-04-26T10:44:52.481 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.481 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.481 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:52.481 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537783+0000", 2024-04-26T10:44:52.481 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0364e-05 2024-04-26T10:44:52.481 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.481 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.481 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:52.481 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537814+0000", 2024-04-26T10:44:52.481 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1170000000000001e-05 2024-04-26T10:44:52.481 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.482 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:52.482 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.482 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.482 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.482 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:334 3.13 3:ceffbd45:::200.0000000a:head [write 1322273~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:52.482 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:52.482 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.944759066, 2024-04-26T10:44:52.482 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022778731999999999, 2024-04-26T10:44:52.482 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:52.482 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.482 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:52.482 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.482 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:52.482 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:52.483 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.483 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.483 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.483 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:52.483 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:52.483 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.483 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.483 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.483 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:52.483 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:52.483 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:52.483 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.483 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.483 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:52.484 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515099+0000", 2024-04-26T10:44:52.484 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6599999999999998e-06 2024-04-26T10:44:52.484 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.484 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.484 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:52.484 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515112+0000", 2024-04-26T10:44:52.484 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2707e-05 2024-04-26T10:44:52.484 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.484 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.484 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.484 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515120+0000", 2024-04-26T10:44:52.484 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8509999999999999e-06 2024-04-26T10:44:52.484 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.484 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.484 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:52.485 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535792+0000", 2024-04-26T10:44:52.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020672209 2024-04-26T10:44:52.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.485 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.485 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:52.485 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535833+0000", 2024-04-26T10:44:52.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1415000000000002e-05 2024-04-26T10:44:52.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.485 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.485 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:52.485 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537818+0000", 2024-04-26T10:44:52.485 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0019850900000000001 2024-04-26T10:44:52.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.485 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.486 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:52.486 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537839+0000", 2024-04-26T10:44:52.486 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0068000000000002e-05 2024-04-26T10:44:52.486 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.486 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.486 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:52.486 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537872+0000", 2024-04-26T10:44:52.486 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3680999999999998e-05 2024-04-26T10:44:52.486 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.486 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:52.486 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.486 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.486 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.486 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:335 3.13 3:ceffbd45:::200.0000000a:head [write 1325230~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:52.487 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:52.487 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.944719967000001, 2024-04-26T10:44:52.487 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023487081, 2024-04-26T10:44:52.487 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:52.487 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.487 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:52.487 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.487 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:52.487 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:52.487 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.487 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.487 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.487 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:52.487 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:52.487 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.488 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.488 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.488 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:52.488 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515132+0000", 2024-04-26T10:44:52.488 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:52.488 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.488 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.488 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:52.488 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515136+0000", 2024-04-26T10:44:52.488 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0860000000000004e-06 2024-04-26T10:44:52.488 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.488 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.488 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:52.488 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515143+0000", 2024-04-26T10:44:52.489 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.0400000000000004e-06 2024-04-26T10:44:52.489 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.489 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.489 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.489 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515149+0000", 2024-04-26T10:44:52.489 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0789999999999997e-06 2024-04-26T10:44:52.489 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.489 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.489 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:52.489 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536200+0000", 2024-04-26T10:44:52.489 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021050993 2024-04-26T10:44:52.489 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.489 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.489 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:52.490 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536253+0000", 2024-04-26T10:44:52.490 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.2643999999999999e-05 2024-04-26T10:44:52.490 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.490 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.490 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:52.490 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538560+0000", 2024-04-26T10:44:52.490 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0023073389999999998 2024-04-26T10:44:52.490 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.490 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.490 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:52.490 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538584+0000", 2024-04-26T10:44:52.490 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3893999999999999e-05 2024-04-26T10:44:52.490 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.490 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.491 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:52.491 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538620+0000", 2024-04-26T10:44:52.491 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5611000000000002e-05 2024-04-26T10:44:52.491 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.491 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:52.491 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.491 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.491 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.491 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:336 3.13 3:ceffbd45:::200.0000000a:head [write 1327147~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:52.491 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:52.491 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.943387512000001, 2024-04-26T10:44:52.491 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027687066, 2024-04-26T10:44:52.491 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:52.491 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.492 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:52.492 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.492 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:52.492 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:52.492 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.492 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.492 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.492 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:52.492 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:52.492 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.492 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.492 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.492 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:52.492 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516464+0000", 2024-04-26T10:44:52.492 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:52.493 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.493 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.493 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:52.493 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516491+0000", 2024-04-26T10:44:52.493 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6539000000000001e-05 2024-04-26T10:44:52.494 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.494 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.494 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:52.494 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516500+0000", 2024-04-26T10:44:52.494 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5480000000000007e-06 2024-04-26T10:44:52.494 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.494 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.494 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.494 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516511+0000", 2024-04-26T10:44:52.494 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0719e-05 2024-04-26T10:44:52.494 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.495 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.495 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:52.495 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536737+0000", 2024-04-26T10:44:52.495 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020225770000000001 2024-04-26T10:44:52.495 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.495 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.495 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:52.495 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536783+0000", 2024-04-26T10:44:52.495 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6168999999999998e-05 2024-04-26T10:44:52.495 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.495 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.495 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:52.495 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544080+0000", 2024-04-26T10:44:52.495 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0072966799999999998 2024-04-26T10:44:52.496 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.496 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.496 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:52.496 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544111+0000", 2024-04-26T10:44:52.496 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1056999999999998e-05 2024-04-26T10:44:52.496 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.496 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.496 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:52.496 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544152+0000", 2024-04-26T10:44:52.496 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1452000000000002e-05 2024-04-26T10:44:52.496 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.496 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:52.496 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.496 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.496 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.497 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:337 3.13 3:ceffbd45:::200.0000000a:head [write 1342136~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:52.497 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:52.497 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.943334574000001, 2024-04-26T10:44:52.497 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027711237, 2024-04-26T10:44:52.497 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:52.497 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.497 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:52.497 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.497 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:52.497 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:52.497 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.497 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.497 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.497 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:52.498 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:52.498 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.498 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.498 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.498 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:52.498 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516517+0000", 2024-04-26T10:44:52.498 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:52.498 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.498 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.498 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:52.498 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516521+0000", 2024-04-26T10:44:52.498 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6200000000000001e-06 2024-04-26T10:44:52.498 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.498 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.499 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:52.499 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516528+0000", 2024-04-26T10:44:52.499 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8639999999999998e-06 2024-04-26T10:44:52.499 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.499 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.499 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.499 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516533+0000", 2024-04-26T10:44:52.499 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6310000000000002e-06 2024-04-26T10:44:52.499 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.499 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.499 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:52.499 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537231+0000", 2024-04-26T10:44:52.499 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020698613000000001 2024-04-26T10:44:52.499 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.500 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.500 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:52.500 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537273+0000", 2024-04-26T10:44:52.500 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1529000000000002e-05 2024-04-26T10:44:52.500 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.500 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.500 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:52.500 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544157+0000", 2024-04-26T10:44:52.500 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068847090000000001 2024-04-26T10:44:52.500 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.500 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.500 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:52.500 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544180+0000", 2024-04-26T10:44:52.500 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.2532e-05 2024-04-26T10:44:52.501 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.501 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.501 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:52.501 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544229+0000", 2024-04-26T10:44:52.501 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9190000000000002e-05 2024-04-26T10:44:52.501 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.501 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:52.501 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.501 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.501 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.501 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:338 3.13 3:ceffbd45:::200.0000000a:head [write 1344569~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:52.501 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:52.501 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.942668320999999, 2024-04-26T10:44:52.501 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027105598000000002, 2024-04-26T10:44:52.502 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:52.502 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.502 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:52.502 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.502 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:52.502 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:52.502 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.502 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.502 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.502 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:52.502 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:52.502 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.502 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.502 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.503 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:52.503 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517183+0000", 2024-04-26T10:44:52.503 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:52.503 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.503 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.503 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:52.503 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517188+0000", 2024-04-26T10:44:52.503 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7389999999999999e-06 2024-04-26T10:44:52.503 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.503 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.503 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:52.503 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517199+0000", 2024-04-26T10:44:52.503 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0652000000000001e-05 2024-04-26T10:44:52.504 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.504 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.504 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.504 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517206+0000", 2024-04-26T10:44:52.504 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6610000000000003e-06 2024-04-26T10:44:52.504 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.504 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.504 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:52.504 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537905+0000", 2024-04-26T10:44:52.504 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020699662000000001 2024-04-26T10:44:52.504 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.504 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.504 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:52.505 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537956+0000", 2024-04-26T10:44:52.505 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0954e-05 2024-04-26T10:44:52.505 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.505 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.505 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:52.505 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544233+0000", 2024-04-26T10:44:52.505 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062773009999999999 2024-04-26T10:44:52.505 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.505 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.505 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:52.505 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544258+0000", 2024-04-26T10:44:52.505 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4434999999999999e-05 2024-04-26T10:44:52.505 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.505 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.506 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:52.506 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544290+0000", 2024-04-26T10:44:52.506 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1918000000000002e-05 2024-04-26T10:44:52.506 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.506 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:52.506 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.506 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.506 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.506 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:339 3.13 3:ceffbd45:::200.0000000a:head [write 1346485~4322 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:52.506 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:52.506 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.941729828, 2024-04-26T10:44:52.506 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026221617999999999, 2024-04-26T10:44:52.506 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:52.507 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.507 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:52.507 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.507 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:52.507 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:52.507 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.507 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.507 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.507 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:52.507 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:52.507 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.507 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.507 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.507 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:52.508 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518122+0000", 2024-04-26T10:44:52.508 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:52.508 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.508 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.508 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:52.508 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518129+0000", 2024-04-26T10:44:52.508 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.43e-06 2024-04-26T10:44:52.508 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.508 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.508 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:52.508 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518138+0000", 2024-04-26T10:44:52.508 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9129999999999992e-06 2024-04-26T10:44:52.508 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.508 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.509 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.509 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518144+0000", 2024-04-26T10:44:52.509 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.1419999999999998e-06 2024-04-26T10:44:52.509 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.509 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.509 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:52.509 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538232+0000", 2024-04-26T10:44:52.509 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020087383 2024-04-26T10:44:52.509 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.509 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.509 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:52.509 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538274+0000", 2024-04-26T10:44:52.509 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2602999999999999e-05 2024-04-26T10:44:52.509 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.510 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.510 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:52.510 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544294+0000", 2024-04-26T10:44:52.510 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060194059999999997 2024-04-26T10:44:52.510 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.510 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.510 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:52.510 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544314+0000", 2024-04-26T10:44:52.510 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0091000000000001e-05 2024-04-26T10:44:52.510 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.510 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.510 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:52.510 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544344+0000", 2024-04-26T10:44:52.510 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0446e-05 2024-04-26T10:44:52.511 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.511 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:52.511 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.511 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.511 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.511 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:340 3.13 3:ceffbd45:::200.0000000a:head [write 1350807~2768 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:52.511 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:52.511 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.939245591999999, 2024-04-26T10:44:52.511 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023795594, 2024-04-26T10:44:52.511 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:52.511 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.511 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:52.511 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.511 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:52.511 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:52.512 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.512 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.512 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:52.512 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:52.512 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.512 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.512 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:52.512 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520606+0000", 2024-04-26T10:44:52.512 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:52.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.512 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.512 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:52.513 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520612+0000", 2024-04-26T10:44:52.513 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.835e-06 2024-04-26T10:44:52.513 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.513 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.513 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:52.513 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520622+0000", 2024-04-26T10:44:52.513 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0173999999999999e-05 2024-04-26T10:44:52.513 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.513 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.513 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.513 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520629+0000", 2024-04-26T10:44:52.513 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7460000000000003e-06 2024-04-26T10:44:52.513 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.513 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.514 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:52.514 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538651+0000", 2024-04-26T10:44:52.514 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018022474 2024-04-26T10:44:52.514 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.514 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.514 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:52.514 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538697+0000", 2024-04-26T10:44:52.514 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6183999999999997e-05 2024-04-26T10:44:52.514 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.514 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.514 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:52.514 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544348+0000", 2024-04-26T10:44:52.514 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0056503509999999996 2024-04-26T10:44:52.514 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.515 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.515 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:52.515 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544369+0000", 2024-04-26T10:44:52.515 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1064999999999999e-05 2024-04-26T10:44:52.515 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.515 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.515 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:52.515 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544403+0000", 2024-04-26T10:44:52.515 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3695000000000002e-05 2024-04-26T10:44:52.515 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.515 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:52.515 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.515 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.515 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.515 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:341 3.13 3:ceffbd45:::200.0000000a:head [write 1353575~3816 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:52.516 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:52.516 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.938510337, 2024-04-26T10:44:52.516 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023114967, 2024-04-26T10:44:52.516 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:52.516 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.516 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:52.516 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.516 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:52.516 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:52.516 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.516 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.516 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.516 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:52.516 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:52.517 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.517 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.517 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.517 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:52.517 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521341+0000", 2024-04-26T10:44:52.517 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:52.517 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.517 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.517 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:52.517 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521349+0000", 2024-04-26T10:44:52.517 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1550000000000001e-06 2024-04-26T10:44:52.517 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.517 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.517 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:52.518 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521358+0000", 2024-04-26T10:44:52.518 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.1500000000000005e-06 2024-04-26T10:44:52.518 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.518 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.518 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.518 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521364+0000", 2024-04-26T10:44:52.518 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3289999999999999e-06 2024-04-26T10:44:52.518 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.518 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.518 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:52.518 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539010+0000", 2024-04-26T10:44:52.518 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.017645965999999999 2024-04-26T10:44:52.518 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.518 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.519 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:52.519 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539051+0000", 2024-04-26T10:44:52.519 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.053e-05 2024-04-26T10:44:52.519 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.519 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.519 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:52.519 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544407+0000", 2024-04-26T10:44:52.519 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053560209999999999 2024-04-26T10:44:52.519 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.519 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.519 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:52.519 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544427+0000", 2024-04-26T10:44:52.519 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0228e-05 2024-04-26T10:44:52.519 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.519 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.520 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:52.520 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544457+0000", 2024-04-26T10:44:52.520 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0375e-05 2024-04-26T10:44:52.520 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.520 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:52.520 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.520 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.520 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.520 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11582 4.2f 4:f76ba295:::10000003252.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:52.520 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:52.520 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.464894791999999, 2024-04-26T10:44:52.520 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024553994999999999, 2024-04-26T10:44:52.520 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:52.520 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.521 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:52.521 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:52.521 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:52.521 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11582 2024-04-26T10:44:52.521 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.521 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:52.521 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.521 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:52.521 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:52.521 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.521 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.521 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.521 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:52.521 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:52.522 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.522 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.522 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.522 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:52.522 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994957+0000", 2024-04-26T10:44:52.522 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:52.522 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.522 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.522 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:52.522 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002755+0000", 2024-04-26T10:44:52.522 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0077984719999999999 2024-04-26T10:44:52.522 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.522 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.522 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:52.523 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002770+0000", 2024-04-26T10:44:52.523 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4956e-05 2024-04-26T10:44:52.523 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.523 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.523 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.523 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002777+0000", 2024-04-26T10:44:52.523 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1899999999999998e-06 2024-04-26T10:44:52.523 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.523 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.523 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:52.523 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002833+0000", 2024-04-26T10:44:52.523 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5189999999999998e-05 2024-04-26T10:44:52.523 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.523 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.523 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:52.524 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002977+0000", 2024-04-26T10:44:52.524 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014444100000000001 2024-04-26T10:44:52.524 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.524 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.524 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:52.524 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.003108+0000", 2024-04-26T10:44:52.524 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000131068 2024-04-26T10:44:52.524 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.524 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.524 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:52.524 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.009040+0000", 2024-04-26T10:44:52.524 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059314149999999998 2024-04-26T10:44:52.524 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.524 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.525 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.525 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019462+0000", 2024-04-26T10:44:52.525 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010422803 2024-04-26T10:44:52.525 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.525 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.525 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:52.525 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019490+0000", 2024-04-26T10:44:52.525 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7773999999999999e-05 2024-04-26T10:44:52.525 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.525 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.525 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:52.525 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019512+0000", 2024-04-26T10:44:52.525 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1611999999999999e-05 2024-04-26T10:44:52.525 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.526 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:52.526 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.526 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.526 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.526 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11911 4.37 4:ec04ab04:::100000031ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:52.526 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:52.526 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.123174585000001, 2024-04-26T10:44:52.526 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026810273999999999, 2024-04-26T10:44:52.526 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:52.526 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.526 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:52.526 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:52.526 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:52.527 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11911 2024-04-26T10:44:52.527 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.527 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:52.527 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.527 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:52.527 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:52.527 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.527 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.527 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.527 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:52.527 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:52.527 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.527 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.527 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.527 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:52.528 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336676+0000", 2024-04-26T10:44:52.528 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:52.528 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.528 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.528 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:52.528 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343119+0000", 2024-04-26T10:44:52.528 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0064424850000000004 2024-04-26T10:44:52.528 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.528 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.528 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:52.528 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343131+0000", 2024-04-26T10:44:52.528 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1708e-05 2024-04-26T10:44:52.528 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.528 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.529 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.529 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343137+0000", 2024-04-26T10:44:52.529 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9880000000000001e-06 2024-04-26T10:44:52.529 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.529 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.529 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:52.529 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343175+0000", 2024-04-26T10:44:52.529 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7913000000000001e-05 2024-04-26T10:44:52.529 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.529 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.529 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:52.529 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343269+0000", 2024-04-26T10:44:52.529 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4931000000000003e-05 2024-04-26T10:44:52.529 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.529 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.530 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:52.530 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343392+0000", 2024-04-26T10:44:52.530 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000122435 2024-04-26T10:44:52.530 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.530 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.530 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:52.530 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.347520+0000", 2024-04-26T10:44:52.530 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004128418 2024-04-26T10:44:52.530 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.530 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.530 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.530 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363410+0000", 2024-04-26T10:44:52.530 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.015889309000000001 2024-04-26T10:44:52.530 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.531 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.531 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:52.531 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363453+0000", 2024-04-26T10:44:52.531 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3244000000000001e-05 2024-04-26T10:44:52.531 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.531 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.531 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:52.531 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363488+0000", 2024-04-26T10:44:52.531 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5318000000000003e-05 2024-04-26T10:44:52.531 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.531 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:52.531 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.531 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.531 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.532 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12000 4.3c 4:3c2be35d:::100000030f7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:52.532 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:52.532 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.040553073000002, 2024-04-26T10:44:52.532 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022808264000000002, 2024-04-26T10:44:52.532 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:52.532 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.532 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:52.532 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:52.532 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:52.532 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12000 2024-04-26T10:44:52.532 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.532 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:52.532 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.532 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:52.533 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:52.533 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.533 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.533 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.533 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:52.533 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:52.533 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.533 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.533 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.533 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:52.533 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:52.534 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:52.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.534 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.534 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:52.534 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430937+0000", 2024-04-26T10:44:52.534 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.011638097 2024-04-26T10:44:52.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.534 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.534 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:52.534 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430948+0000", 2024-04-26T10:44:52.534 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0824e-05 2024-04-26T10:44:52.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.535 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.535 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.535 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430953+0000", 2024-04-26T10:44:52.535 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5219999999999998e-06 2024-04-26T10:44:52.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.535 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.535 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:52.535 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430990+0000", 2024-04-26T10:44:52.535 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6458999999999998e-05 2024-04-26T10:44:52.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.535 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.535 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:52.536 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.431052+0000", 2024-04-26T10:44:52.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2687000000000005e-05 2024-04-26T10:44:52.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.536 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.536 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:52.536 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442027+0000", 2024-04-26T10:44:52.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010974513 2024-04-26T10:44:52.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.536 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.536 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:52.536 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442060+0000", 2024-04-26T10:44:52.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2849999999999999e-05 2024-04-26T10:44:52.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.536 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.537 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:52.537 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442108+0000", 2024-04-26T10:44:52.537 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8031999999999997e-05 2024-04-26T10:44:52.537 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.537 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:52.537 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.537 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.537 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.537 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12042 4.2f 4:f741970f:::10000003414.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:52.537 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:52.537 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.001299595999999, 2024-04-26T10:44:52.537 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.029390757, 2024-04-26T10:44:52.537 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:52.537 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.538 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:52.538 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:52.538 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:52.538 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12042 2024-04-26T10:44:52.538 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.538 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:52.538 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.538 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:52.538 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:52.538 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.538 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.538 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.538 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:52.538 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:52.539 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.539 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.539 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.539 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:52.539 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458552+0000", 2024-04-26T10:44:52.539 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:52.539 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.539 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.539 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:52.539 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464335+0000", 2024-04-26T10:44:52.539 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.005783168 2024-04-26T10:44:52.539 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.539 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.539 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:52.540 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464347+0000", 2024-04-26T10:44:52.540 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1578e-05 2024-04-26T10:44:52.540 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.540 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.540 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.540 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464353+0000", 2024-04-26T10:44:52.540 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3709999999999996e-06 2024-04-26T10:44:52.540 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.540 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.540 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:52.540 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464407+0000", 2024-04-26T10:44:52.540 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3717000000000001e-05 2024-04-26T10:44:52.540 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.540 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.540 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:52.541 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464556+0000", 2024-04-26T10:44:52.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014899100000000001 2024-04-26T10:44:52.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.541 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:52.541 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464688+0000", 2024-04-26T10:44:52.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013238599999999999 2024-04-26T10:44:52.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.541 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:52.541 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.469725+0000", 2024-04-26T10:44:52.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0050369229999999996 2024-04-26T10:44:52.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.542 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.542 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487892+0000", 2024-04-26T10:44:52.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018167184999999999 2024-04-26T10:44:52.542 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.542 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:52.542 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487922+0000", 2024-04-26T10:44:52.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.9495000000000001e-05 2024-04-26T10:44:52.542 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.542 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:52.542 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487944+0000", 2024-04-26T10:44:52.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1823000000000001e-05 2024-04-26T10:44:52.542 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.543 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:52.543 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.543 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.543 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.543 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12050 4.2c 4:36b72e58:::100000031ba.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:52.543 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:52.543 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 22.992758986999998, 2024-04-26T10:44:52.543 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022722497000000001, 2024-04-26T10:44:52.543 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:52.543 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.543 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:52.543 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:52.543 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:52.543 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12050 2024-04-26T10:44:52.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.544 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:52.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:52.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:52.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:52.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:52.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:52.545 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467093+0000", 2024-04-26T10:44:52.545 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:52.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.545 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.545 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:52.545 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476305+0000", 2024-04-26T10:44:52.545 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092125850000000006 2024-04-26T10:44:52.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.545 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.545 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:52.545 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476322+0000", 2024-04-26T10:44:52.545 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6860000000000001e-05 2024-04-26T10:44:52.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.545 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.546 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.546 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476328+0000", 2024-04-26T10:44:52.546 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.587e-06 2024-04-26T10:44:52.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.546 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:52.546 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476378+0000", 2024-04-26T10:44:52.546 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0519999999999997e-05 2024-04-26T10:44:52.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.546 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:52.546 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476474+0000", 2024-04-26T10:44:52.546 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5556000000000005e-05 2024-04-26T10:44:52.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:52.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489677+0000", 2024-04-26T10:44:52.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013203048 2024-04-26T10:44:52.547 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:52.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489722+0000", 2024-04-26T10:44:52.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4650000000000001e-05 2024-04-26T10:44:52.547 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:52.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489816+0000", 2024-04-26T10:44:52.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4402999999999997e-05 2024-04-26T10:44:52.548 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.548 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:52.548 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.548 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.548 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12516 4.37 4:ed0cb515:::10000003324.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:52.548 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:52.548 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 22.472677422, 2024-04-26T10:44:52.548 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.030139677, 2024-04-26T10:44:52.548 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:52.548 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.548 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:52.548 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:52.548 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:52.549 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12516 2024-04-26T10:44:52.549 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.549 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:52.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.549 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:52.549 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:52.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.549 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.549 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:52.549 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:52.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.550 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:52.550 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987173+0000", 2024-04-26T10:44:52.550 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:52.550 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:52.550 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991339+0000", 2024-04-26T10:44:52.550 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0041663760000000003 2024-04-26T10:44:52.550 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:52.550 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991351+0000", 2024-04-26T10:44:52.551 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1333e-05 2024-04-26T10:44:52.551 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.551 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.551 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.551 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991357+0000", 2024-04-26T10:44:52.551 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3350000000000003e-06 2024-04-26T10:44:52.551 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.551 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.551 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:52.551 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991394+0000", 2024-04-26T10:44:52.551 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7054000000000001e-05 2024-04-26T10:44:52.551 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.551 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.551 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:52.551 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991495+0000", 2024-04-26T10:44:52.552 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000100386 2024-04-26T10:44:52.552 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.552 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.552 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:52.552 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991579+0000", 2024-04-26T10:44:52.552 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4295000000000005e-05 2024-04-26T10:44:52.552 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.552 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.552 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:52.552 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.996238+0000", 2024-04-26T10:44:52.552 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0046589309999999998 2024-04-26T10:44:52.552 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.552 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.553 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.553 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017237+0000", 2024-04-26T10:44:52.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020998993000000001 2024-04-26T10:44:52.553 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.553 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.553 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:52.553 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017280+0000", 2024-04-26T10:44:52.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3600000000000003e-05 2024-04-26T10:44:52.553 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.553 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.553 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:52.553 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017315+0000", 2024-04-26T10:44:52.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4381999999999997e-05 2024-04-26T10:44:52.553 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.553 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:52.554 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.554 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.554 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.554 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12644 4.37 4:ec5044d7:::100000032d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:52.554 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:52.554 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 22.299004593999999, 2024-04-26T10:44:52.554 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.037018677, 2024-04-26T10:44:52.554 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:52.554 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.554 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:52.554 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:52.554 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:52.554 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12644 2024-04-26T10:44:52.554 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.555 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:52.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.555 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:52.555 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:52.555 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.555 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:52.555 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:52.555 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.555 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:52.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160847+0000", 2024-04-26T10:44:52.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:52.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.556 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:52.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170089+0000", 2024-04-26T10:44:52.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092424289999999999 2024-04-26T10:44:52.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.556 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:52.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170111+0000", 2024-04-26T10:44:52.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1733e-05 2024-04-26T10:44:52.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.556 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.557 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.557 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170124+0000", 2024-04-26T10:44:52.557 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.272e-05 2024-04-26T10:44:52.557 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.557 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.557 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:52.557 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170177+0000", 2024-04-26T10:44:52.557 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3745000000000001e-05 2024-04-26T10:44:52.557 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.557 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.557 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:52.557 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170350+0000", 2024-04-26T10:44:52.557 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017297699999999999 2024-04-26T10:44:52.557 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.558 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:52.558 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170458+0000", 2024-04-26T10:44:52.558 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000107583 2024-04-26T10:44:52.558 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.558 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:52.558 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.176693+0000", 2024-04-26T10:44:52.558 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062351799999999999 2024-04-26T10:44:52.558 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.558 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.558 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197774+0000", 2024-04-26T10:44:52.559 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021080471999999999 2024-04-26T10:44:52.559 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.559 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.559 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:52.559 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197824+0000", 2024-04-26T10:44:52.559 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0096000000000003e-05 2024-04-26T10:44:52.559 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.559 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.559 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:52.559 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197867+0000", 2024-04-26T10:44:52.559 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2882e-05 2024-04-26T10:44:52.559 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.559 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:52.559 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.559 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.560 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.560 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:13242 4.2f 4:f5e54bb5:::100000033c8.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:52.560 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:52.560 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.620773455999998, 2024-04-26T10:44:52.560 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023873062, 2024-04-26T10:44:52.560 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:52.560 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:52.560 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:52.560 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:52.560 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:52.560 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 13242 2024-04-26T10:44:52.560 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.560 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:52.560 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.561 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:52.561 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:52.561 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.561 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.561 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:52.561 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:52.561 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:52.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.561 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.561 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:52.561 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839078+0000", 2024-04-26T10:44:52.561 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:52.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.562 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.562 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:52.562 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848098+0000", 2024-04-26T10:44:52.562 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090200750000000007 2024-04-26T10:44:52.562 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.562 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.562 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:52.562 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848108+0000", 2024-04-26T10:44:52.562 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.062e-05 2024-04-26T10:44:52.562 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.562 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.562 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:52.562 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848115+0000", 2024-04-26T10:44:52.563 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3040000000000001e-06 2024-04-26T10:44:52.563 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.563 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.563 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:52.563 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848157+0000", 2024-04-26T10:44:52.563 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2533000000000001e-05 2024-04-26T10:44:52.563 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.563 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.563 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:52.563 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848252+0000", 2024-04-26T10:44:52.563 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4480000000000003e-05 2024-04-26T10:44:52.563 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.563 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.563 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:52.564 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848393+0000", 2024-04-26T10:44:52.564 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000140863 2024-04-26T10:44:52.564 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.564 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:52.564 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.854434+0000", 2024-04-26T10:44:52.564 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060415590000000002 2024-04-26T10:44:52.564 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.564 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:52.564 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862894+0000", 2024-04-26T10:44:52.564 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0084598869999999993 2024-04-26T10:44:52.564 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.565 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:52.565 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862926+0000", 2024-04-26T10:44:52.565 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1473999999999997e-05 2024-04-26T10:44:52.565 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:52.565 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:52.565 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:52.565 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862952+0000", 2024-04-26T10:44:52.565 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6545000000000001e-05 2024-04-26T10:44:52.565 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.565 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:52.565 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.565 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:52.565 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:52.565 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:52.567 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:52.565+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:52.567 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:52.667 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:52.665+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:52.682 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:52.682 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:52.682 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:44:52.682 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:52.691 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:52.709 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:44:52.763 INFO:teuthology.orchestra.run.smithi049.stderr:noscrub is unset 2024-04-26T10:44:52.769 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:52.768+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:52.839 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:52.839 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:52.839 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:52.840 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:52.840 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:52.846 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:52.847 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:52.847 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:52.848 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:52.864 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:52.865 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:52.868 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:52.868 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:52.869 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:52.868+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:52.954 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:52.954 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:52.963 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:53.006 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:53.005+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:53.067 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:53.067 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:53.070 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:53.069+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:53.076 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:53.171 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:53.169+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:53.219 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:53.219 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:53.228 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:53.272 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:53.271+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:53.371 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:53.371 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:53.372 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:53.370+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:53.379 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:53.473 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:53.472+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:53.491 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:53.491 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:53.500 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:53.574 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:53.573+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:53.606 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:53.606 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:53.615 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:53.675 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:53.673+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:53.720 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:53.721 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:53.729 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:53.776 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:53.775+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:53.842 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:53.843 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:53.851 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:53.893 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:53.891+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:53.978 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:53.976+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:53.995 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:53.996 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:54.004 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:54.079 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:54.078+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:54.145 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:54.145 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:54.153 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:54.180 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:54.178+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:54.266 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:54.266 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:54.275 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:54.319 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:54.317+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:54.381 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:54.381 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:54.381 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:54.379+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:54.389 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:54.482 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:54.480+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:54.535 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:54.535 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:54.544 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:54.588 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:54.587+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:54.646 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:54.647 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:54.655 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:54.697 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:54.695+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:54.780 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:44:54.785 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:54.783+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:54.796 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:54.796 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:54.805 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:54.868 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:44:54.886 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:54.884+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:54.948 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-26T10:44:54.948 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:44:54.956 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:44:54.997 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0: {} 2024-04-26T10:44:54.998 INFO:teuthology.orchestra.run.smithi049.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:44:54.998 INFO:teuthology.orchestra.run.smithi049.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-04-26T10:44:55.001 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:54.999+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:55.015 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2: {} 2024-04-26T10:44:55.016 INFO:teuthology.orchestra.run.smithi049.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:44:55.018 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:44:55.019 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:44:55.065 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-04-26T10:44:55.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T10:44:55.065 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T10:44:55.069 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:55.069 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:55.070 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-04-26T10:44:55.070 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:55.078 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:44:55.087 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-26T10:44:55.086+0000 7f9aad3a6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28731) UID: 0 2024-04-26T10:44:55.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T10:44:55.089 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-04-26T10:44:55.144 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T10:44:55.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T10:44:55.144 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T10:44:55.188 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:55.186+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:55.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T10:44:55.209 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2024-04-26T10:44:55.225 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:55.225 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-04-26T10:44:55.225 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-04-26T10:44:55.225 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-04-26T10:44:55.225 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:55.233 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:44:55.304 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-26T10:44:55.314 INFO:tasks.thrashosds:joining thrashosds 2024-04-26T10:44:55.318 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-04-26T10:44:55.316+0000 7f53ceeab640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28837) UID: 0 2024-04-26T10:44:55.382 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-04-26T10:44:55.382 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-04-26T10:44:55.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-04-26T10:44:55.382 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-04-26T10:44:55.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.382 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:80 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:55.382 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:55.382 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 33.857236978000003, 2024-04-26T10:44:55.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029259192, 2024-04-26T10:44:55.382 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522254+0000", 2024-04-26T10:44:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:55.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.522252+0000", 2024-04-26T10:44:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523121+0000", 2024-04-26T10:44:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00086885100000000002 2024-04-26T10:44:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523133+0000", 2024-04-26T10:44:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2109999999999999e-05 2024-04-26T10:44:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523139+0000", 2024-04-26T10:44:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.541e-06 2024-04-26T10:44:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523176+0000", 2024-04-26T10:44:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6847999999999997e-05 2024-04-26T10:44:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.523240+0000", 2024-04-26T10:44:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3941000000000003e-05 2024-04-26T10:44:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.386 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:55.386 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.536390+0000", 2024-04-26T10:44:55.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013150811 2024-04-26T10:44:55.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.386 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.386 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551071+0000", 2024-04-26T10:44:55.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014680021 2024-04-26T10:44:55.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551428+0000", 2024-04-26T10:44:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00035703900000000002 2024-04-26T10:44:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551462+0000", 2024-04-26T10:44:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4337e-05 2024-04-26T10:44:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.551513+0000", 2024-04-26T10:44:55.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0875000000000003e-05 2024-04-26T10:44:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:129 3.1a 3:5e41ab69:::200.00000005:head [write 3557843~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 33.853178907999997, 2024-04-26T10:44:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029108253000000001, 2024-04-26T10:44:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:55.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:55.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:55.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526312+0000", 2024-04-26T10:44:55.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:55.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526311+0000", 2024-04-26T10:44:55.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:55.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526315+0000", 2024-04-26T10:44:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4809999999999998e-06 2024-04-26T10:44:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526319+0000", 2024-04-26T10:44:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0690000000000003e-06 2024-04-26T10:44:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526321+0000", 2024-04-26T10:44:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4880000000000001e-06 2024-04-26T10:44:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553856+0000", 2024-04-26T10:44:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027534916 2024-04-26T10:44:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553900+0000", 2024-04-26T10:44:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3954e-05 2024-04-26T10:44:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.553962+0000", 2024-04-26T10:44:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1519000000000005e-05 2024-04-26T10:44:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555348+0000", 2024-04-26T10:44:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013864579999999999 2024-04-26T10:44:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555378+0000", 2024-04-26T10:44:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9441000000000002e-05 2024-04-26T10:44:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555401+0000", 2024-04-26T10:44:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2815000000000001e-05 2024-04-26T10:44:55.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555420+0000", 2024-04-26T10:44:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9341e-05 2024-04-26T10:44:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:130 3.1a 3:5e41ab69:::200.00000005:head [write 3559243~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 33.853167073000002, 2024-04-26T10:44:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029188316999999998, 2024-04-26T10:44:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:55.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526323+0000", 2024-04-26T10:44:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526325+0000", 2024-04-26T10:44:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4899999999999999e-06 2024-04-26T10:44:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526327+0000", 2024-04-26T10:44:55.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.745e-06 2024-04-26T10:44:55.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.397 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526330+0000", 2024-04-26T10:44:55.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5620000000000002e-06 2024-04-26T10:44:55.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.397 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:55.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554200+0000", 2024-04-26T10:44:55.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027869541000000001 2024-04-26T10:44:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554244+0000", 2024-04-26T10:44:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4464e-05 2024-04-26T10:44:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554304+0000", 2024-04-26T10:44:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9457999999999999e-05 2024-04-26T10:44:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555453+0000", 2024-04-26T10:44:55.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011494000000000001 2024-04-26T10:44:55.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:55.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555457+0000", 2024-04-26T10:44:55.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1779999999999996e-06 2024-04-26T10:44:55.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:55.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555480+0000", 2024-04-26T10:44:55.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2802e-05 2024-04-26T10:44:55.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:55.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555512+0000", 2024-04-26T10:44:55.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1885999999999999e-05 2024-04-26T10:44:55.400 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.400 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:55.400 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:131 3.1a 3:5e41ab69:::200.00000005:head [write 3560642~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 33.853158493000002, 2024-04-26T10:44:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029683102999999999, 2024-04-26T10:44:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526332+0000", 2024-04-26T10:44:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526336+0000", 2024-04-26T10:44:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.681e-06 2024-04-26T10:44:55.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526338+0000", 2024-04-26T10:44:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8430000000000001e-06 2024-04-26T10:44:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526341+0000", 2024-04-26T10:44:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6180000000000002e-06 2024-04-26T10:44:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554745+0000", 2024-04-26T10:44:55.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028404088000000001 2024-04-26T10:44:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554788+0000", 2024-04-26T10:44:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2738999999999999e-05 2024-04-26T10:44:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.554849+0000", 2024-04-26T10:44:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1362e-05 2024-04-26T10:44:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555963+0000", 2024-04-26T10:44:55.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001113597 2024-04-26T10:44:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555969+0000", 2024-04-26T10:44:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6900000000000003e-06 2024-04-26T10:44:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555995+0000", 2024-04-26T10:44:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5165999999999999e-05 2024-04-26T10:44:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:55.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556015+0000", 2024-04-26T10:44:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0522000000000001e-05 2024-04-26T10:44:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:132 3.1a 3:5e41ab69:::200.00000005:head [write 3562043~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 33.853138227999999, 2024-04-26T10:44:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030129895, 2024-04-26T10:44:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:55.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:55.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526352+0000", 2024-04-26T10:44:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526354+0000", 2024-04-26T10:44:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8560000000000001e-06 2024-04-26T10:44:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526359+0000", 2024-04-26T10:44:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4700000000000001e-06 2024-04-26T10:44:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526365+0000", 2024-04-26T10:44:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2120000000000002e-06 2024-04-26T10:44:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555050+0000", 2024-04-26T10:44:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028685458 2024-04-26T10:44:55.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.410 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:55.410 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555093+0000", 2024-04-26T10:44:55.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3307999999999999e-05 2024-04-26T10:44:55.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555156+0000", 2024-04-26T10:44:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2396000000000004e-05 2024-04-26T10:44:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556052+0000", 2024-04-26T10:44:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00089650299999999999 2024-04-26T10:44:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556439+0000", 2024-04-26T10:44:55.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038647900000000001 2024-04-26T10:44:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556463+0000", 2024-04-26T10:44:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4071e-05 2024-04-26T10:44:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556482+0000", 2024-04-26T10:44:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9378999999999999e-05 2024-04-26T10:44:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 3563440~3660 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 33.853121834, 2024-04-26T10:44:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030550738000000001, 2024-04-26T10:44:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526369+0000", 2024-04-26T10:44:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526368+0000", 2024-04-26T10:44:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526375+0000", 2024-04-26T10:44:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7510000000000002e-06 2024-04-26T10:44:55.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526381+0000", 2024-04-26T10:44:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3929999999999996e-06 2024-04-26T10:44:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526387+0000", 2024-04-26T10:44:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.215e-06 2024-04-26T10:44:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555542+0000", 2024-04-26T10:44:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029154992000000001 2024-04-26T10:44:55.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555610+0000", 2024-04-26T10:44:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8610999999999998e-05 2024-04-26T10:44:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.555681+0000", 2024-04-26T10:44:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1072e-05 2024-04-26T10:44:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556866+0000", 2024-04-26T10:44:55.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001184598 2024-04-26T10:44:55.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:55.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556872+0000", 2024-04-26T10:44:55.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.55e-06 2024-04-26T10:44:55.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:55.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556897+0000", 2024-04-26T10:44:55.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.516e-05 2024-04-26T10:44:55.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.418 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:55.418 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556919+0000", 2024-04-26T10:44:55.418 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1951e-05 2024-04-26T10:44:55.418 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.418 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:55.418 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.418 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:134 3.1a 3:5e41ab69:::200.00000005:head [write 3567100~2427 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:55.418 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 33.853088769000003, 2024-04-26T10:44:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031267445999999997, 2024-04-26T10:44:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526402+0000", 2024-04-26T10:44:55.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526401+0000", 2024-04-26T10:44:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526408+0000", 2024-04-26T10:44:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7769999999999997e-06 2024-04-26T10:44:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526415+0000", 2024-04-26T10:44:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0720000000000002e-06 2024-04-26T10:44:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526421+0000", 2024-04-26T10:44:55.421 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9699999999999996e-06 2024-04-26T10:44:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556084+0000", 2024-04-26T10:44:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029662351999999999 2024-04-26T10:44:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556126+0000", 2024-04-26T10:44:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2385000000000002e-05 2024-04-26T10:44:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:55.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556186+0000", 2024-04-26T10:44:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9945999999999998e-05 2024-04-26T10:44:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557598+0000", 2024-04-26T10:44:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0014121559999999999 2024-04-26T10:44:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557626+0000", 2024-04-26T10:44:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7960999999999999e-05 2024-04-26T10:44:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.423 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557650+0000", 2024-04-26T10:44:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3969999999999999e-05 2024-04-26T10:44:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557669+0000", 2024-04-26T10:44:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9262e-05 2024-04-26T10:44:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:135 3.1a 3:5e41ab69:::200.00000005:head [write 3569527~1922 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:55.424 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 33.853064502999999, 2024-04-26T10:44:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031322516000000002, 2024-04-26T10:44:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526426+0000", 2024-04-26T10:44:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526429+0000", 2024-04-26T10:44:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0750000000000002e-06 2024-04-26T10:44:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526435+0000", 2024-04-26T10:44:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.263e-06 2024-04-26T10:44:55.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526442+0000", 2024-04-26T10:44:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1219999999999997e-06 2024-04-26T10:44:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556515+0000", 2024-04-26T10:44:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030073132999999998 2024-04-26T10:44:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:55.427 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556564+0000", 2024-04-26T10:44:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8871e-05 2024-04-26T10:44:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556625+0000", 2024-04-26T10:44:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1307000000000001e-05 2024-04-26T10:44:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557678+0000", 2024-04-26T10:44:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010523100000000001 2024-04-26T10:44:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557709+0000", 2024-04-26T10:44:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1748000000000002e-05 2024-04-26T10:44:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557732+0000", 2024-04-26T10:44:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2415000000000001e-05 2024-04-26T10:44:55.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557749+0000", 2024-04-26T10:44:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6736999999999999e-05 2024-04-26T10:44:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:136 3.1a 3:5e41ab69:::200.00000005:head [write 3571449~2250 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 33.853043313000001, 2024-04-26T10:44:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032180937, 2024-04-26T10:44:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:55.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526447+0000", 2024-04-26T10:44:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526455+0000", 2024-04-26T10:44:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6429999999999995e-06 2024-04-26T10:44:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526461+0000", 2024-04-26T10:44:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526467+0000", 2024-04-26T10:44:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4389999999999999e-06 2024-04-26T10:44:55.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556950+0000", 2024-04-26T10:44:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030483854000000001 2024-04-26T10:44:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.556989+0000", 2024-04-26T10:44:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8415999999999999e-05 2024-04-26T10:44:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:55.434 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557051+0000", 2024-04-26T10:44:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2088999999999995e-05 2024-04-26T10:44:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558166+0000", 2024-04-26T10:44:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001114622 2024-04-26T10:44:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558584+0000", 2024-04-26T10:44:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000418033 2024-04-26T10:44:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.438 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:55.438 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558609+0000", 2024-04-26T10:44:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5344999999999999e-05 2024-04-26T10:44:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558628+0000", 2024-04-26T10:44:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9273999999999999e-05 2024-04-26T10:44:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:137 3.1a 3:5e41ab69:::200.00000005:head [write 3573699~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 33.853019664000001, 2024-04-26T10:44:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032241530999999997, 2024-04-26T10:44:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526471+0000", 2024-04-26T10:44:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526470+0000", 2024-04-26T10:44:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526473+0000", 2024-04-26T10:44:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.818e-06 2024-04-26T10:44:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526480+0000", 2024-04-26T10:44:55.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4119999999999998e-06 2024-04-26T10:44:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526484+0000", 2024-04-26T10:44:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6840000000000004e-06 2024-04-26T10:44:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557323+0000", 2024-04-26T10:44:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030838956000000001 2024-04-26T10:44:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:55.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557362+0000", 2024-04-26T10:44:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8343999999999997e-05 2024-04-26T10:44:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557421+0000", 2024-04-26T10:44:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9176999999999999e-05 2024-04-26T10:44:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558636+0000", 2024-04-26T10:44:55.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012153789999999999 2024-04-26T10:44:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558668+0000", 2024-04-26T10:44:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1452999999999999e-05 2024-04-26T10:44:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558694+0000", 2024-04-26T10:44:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6288999999999999e-05 2024-04-26T10:44:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:55.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558712+0000", 2024-04-26T10:44:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8459000000000001e-05 2024-04-26T10:44:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:138 3.1a 3:5e41ab69:::200.00000005:head [write 3575103~4205 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 33.853002345, 2024-04-26T10:44:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032665567999999999, 2024-04-26T10:44:55.445 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526488+0000", 2024-04-26T10:44:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526495+0000", 2024-04-26T10:44:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7580000000000003e-06 2024-04-26T10:44:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526501+0000", 2024-04-26T10:44:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1680000000000001e-06 2024-04-26T10:44:55.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526505+0000", 2024-04-26T10:44:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.673e-06 2024-04-26T10:44:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557781+0000", 2024-04-26T10:44:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031275718000000001 2024-04-26T10:44:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557825+0000", 2024-04-26T10:44:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4048000000000002e-05 2024-04-26T10:44:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.557888+0000", 2024-04-26T10:44:55.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2562000000000002e-05 2024-04-26T10:44:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559073+0000", 2024-04-26T10:44:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011852239999999999 2024-04-26T10:44:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559112+0000", 2024-04-26T10:44:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9226e-05 2024-04-26T10:44:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559136+0000", 2024-04-26T10:44:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3966000000000001e-05 2024-04-26T10:44:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559154+0000", 2024-04-26T10:44:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7575e-05 2024-04-26T10:44:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:139 3.1a 3:5e41ab69:::200.00000005:head [write 3579308~2255 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:55.451 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 33.852980727000002, 2024-04-26T10:44:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033424720999999998, 2024-04-26T10:44:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:55.452 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526510+0000", 2024-04-26T10:44:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526509+0000", 2024-04-26T10:44:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526516+0000", 2024-04-26T10:44:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5209999999999999e-06 2024-04-26T10:44:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.453 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526522+0000", 2024-04-26T10:44:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1229999999999997e-06 2024-04-26T10:44:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526527+0000", 2024-04-26T10:44:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7849999999999999e-06 2024-04-26T10:44:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558194+0000", 2024-04-26T10:44:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031667419000000002 2024-04-26T10:44:55.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558234+0000", 2024-04-26T10:44:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9774999999999998e-05 2024-04-26T10:44:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558294+0000", 2024-04-26T10:44:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0242999999999999e-05 2024-04-26T10:44:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559106+0000", 2024-04-26T10:44:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00081148099999999996 2024-04-26T10:44:55.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559890+0000", 2024-04-26T10:44:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00078439999999999998 2024-04-26T10:44:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559917+0000", 2024-04-26T10:44:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7044000000000001e-05 2024-04-26T10:44:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:55.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559935+0000", 2024-04-26T10:44:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7448e-05 2024-04-26T10:44:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:140 3.1a 3:5e41ab69:::200.00000005:head [write 3581563~1919 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 33.852959306000002, 2024-04-26T10:44:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033867728, 2024-04-26T10:44:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:55.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:55.458 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526531+0000", 2024-04-26T10:44:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526538+0000", 2024-04-26T10:44:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.905e-06 2024-04-26T10:44:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526542+0000", 2024-04-26T10:44:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9550000000000002e-06 2024-04-26T10:44:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526545+0000", 2024-04-26T10:44:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8499999999999998e-06 2024-04-26T10:44:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558744+0000", 2024-04-26T10:44:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032198986999999998 2024-04-26T10:44:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558788+0000", 2024-04-26T10:44:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4365e-05 2024-04-26T10:44:55.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.558854+0000", 2024-04-26T10:44:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5952999999999997e-05 2024-04-26T10:44:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559971+0000", 2024-04-26T10:44:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011172770000000001 2024-04-26T10:44:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560354+0000", 2024-04-26T10:44:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038267599999999998 2024-04-26T10:44:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560380+0000", 2024-04-26T10:44:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6140999999999999e-05 2024-04-26T10:44:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560399+0000", 2024-04-26T10:44:55.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9032999999999999e-05 2024-04-26T10:44:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:141 3.1a 3:5e41ab69:::200.00000005:head [write 3583482~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 33.852943647000004, 2024-04-26T10:44:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034316301, 2024-04-26T10:44:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526547+0000", 2024-04-26T10:44:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967296 2024-04-26T10:44:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.464 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526548+0000", 2024-04-26T10:44:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.739e-06 2024-04-26T10:44:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526551+0000", 2024-04-26T10:44:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.044e-06 2024-04-26T10:44:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526562+0000", 2024-04-26T10:44:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0370000000000001e-05 2024-04-26T10:44:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559179+0000", 2024-04-26T10:44:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032617444000000002 2024-04-26T10:44:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559220+0000", 2024-04-26T10:44:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0364999999999997e-05 2024-04-26T10:44:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559280+0000", 2024-04-26T10:44:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0569000000000002e-05 2024-04-26T10:44:55.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560814+0000", 2024-04-26T10:44:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015337580000000001 2024-04-26T10:44:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560820+0000", 2024-04-26T10:44:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.455e-06 2024-04-26T10:44:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560846+0000", 2024-04-26T10:44:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5228999999999998e-05 2024-04-26T10:44:55.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560863+0000", 2024-04-26T10:44:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7555e-05 2024-04-26T10:44:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:142 3.1a 3:5e41ab69:::200.00000005:head [write 3585931~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 33.852923250000003, 2024-04-26T10:44:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034372373999999997, 2024-04-26T10:44:55.468 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.469 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526567+0000", 2024-04-26T10:44:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526573+0000", 2024-04-26T10:44:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0800000000000002e-06 2024-04-26T10:44:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526580+0000", 2024-04-26T10:44:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5799999999999997e-06 2024-04-26T10:44:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526585+0000", 2024-04-26T10:44:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2270000000000001e-06 2024-04-26T10:44:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559601+0000", 2024-04-26T10:44:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033016684999999997 2024-04-26T10:44:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559642+0000", 2024-04-26T10:44:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0321000000000002e-05 2024-04-26T10:44:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559706+0000", 2024-04-26T10:44:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4228999999999998e-05 2024-04-26T10:44:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560871+0000", 2024-04-26T10:44:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001164893 2024-04-26T10:44:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560899+0000", 2024-04-26T10:44:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:44:55.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560922+0000", 2024-04-26T10:44:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3337999999999999e-05 2024-04-26T10:44:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560940+0000", 2024-04-26T10:44:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7289999999999999e-05 2024-04-26T10:44:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:143 3.1a 3:5e41ab69:::200.00000005:head [write 3587331~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 33.852901352000003, 2024-04-26T10:44:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035256000000000003, 2024-04-26T10:44:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.474 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526589+0000", 2024-04-26T10:44:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526592+0000", 2024-04-26T10:44:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2449999999999998e-06 2024-04-26T10:44:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526596+0000", 2024-04-26T10:44:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7000000000000002e-06 2024-04-26T10:44:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526599+0000", 2024-04-26T10:44:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6160000000000002e-06 2024-04-26T10:44:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.559997+0000", 2024-04-26T10:44:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033397835000000001 2024-04-26T10:44:55.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560051+0000", 2024-04-26T10:44:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3742000000000001e-05 2024-04-26T10:44:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560112+0000", 2024-04-26T10:44:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0851999999999999e-05 2024-04-26T10:44:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561404+0000", 2024-04-26T10:44:55.477 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001291869 2024-04-26T10:44:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561797+0000", 2024-04-26T10:44:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039383000000000002 2024-04-26T10:44:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561827+0000", 2024-04-26T10:44:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9247e-05 2024-04-26T10:44:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:55.478 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561845+0000", 2024-04-26T10:44:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8462999999999999e-05 2024-04-26T10:44:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:144 3.1a 3:5e41ab69:::200.00000005:head [write 3588736~4987 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 33.852779060000003, 2024-04-26T10:44:55.479 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.035224283000000002, 2024-04-26T10:44:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526711+0000", 2024-04-26T10:44:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526718+0000", 2024-04-26T10:44:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.43e-06 2024-04-26T10:44:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526726+0000", 2024-04-26T10:44:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:44:55.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.526729+0000", 2024-04-26T10:44:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6480000000000001e-06 2024-04-26T10:44:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560427+0000", 2024-04-26T10:44:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033697280000000003 2024-04-26T10:44:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560466+0000", 2024-04-26T10:44:55.482 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9606e-05 2024-04-26T10:44:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560525+0000", 2024-04-26T10:44:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9218000000000001e-05 2024-04-26T10:44:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561854+0000", 2024-04-26T10:44:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001328421 2024-04-26T10:44:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561887+0000", 2024-04-26T10:44:55.483 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2746000000000001e-05 2024-04-26T10:44:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561912+0000", 2024-04-26T10:44:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5126999999999998e-05 2024-04-26T10:44:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561936+0000", 2024-04-26T10:44:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4032999999999998e-05 2024-04-26T10:44:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:145 3.1a 3:5e41ab69:::200.00000005:head [write 3593723~2939 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 33.849860014999997, 2024-04-26T10:44:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033294394999999997, 2024-04-26T10:44:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529631+0000", 2024-04-26T10:44:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529630+0000", 2024-04-26T10:44:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529635+0000", 2024-04-26T10:44:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7960000000000003e-06 2024-04-26T10:44:55.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529643+0000", 2024-04-26T10:44:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0390000000000005e-06 2024-04-26T10:44:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529648+0000", 2024-04-26T10:44:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9599999999999999e-06 2024-04-26T10:44:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.560969+0000", 2024-04-26T10:44:55.487 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031321767 2024-04-26T10:44:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561009+0000", 2024-04-26T10:44:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9904999999999998e-05 2024-04-26T10:44:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561070+0000", 2024-04-26T10:44:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0708999999999998e-05 2024-04-26T10:44:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:55.488 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562352+0000", 2024-04-26T10:44:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012818440000000001 2024-04-26T10:44:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562867+0000", 2024-04-26T10:44:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000515665 2024-04-26T10:44:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562893+0000", 2024-04-26T10:44:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5469999999999998e-05 2024-04-26T10:44:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562925+0000", 2024-04-26T10:44:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1974999999999998e-05 2024-04-26T10:44:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:146 3.1a 3:5e41ab69:::200.00000005:head [write 3596662~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T10:44:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 33.849631801000001, 2024-04-26T10:44:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.033178429000000002, 2024-04-26T10:44:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:55.490 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529859+0000", 2024-04-26T10:44:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:55.491 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529858+0000", 2024-04-26T10:44:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.999999 2024-04-26T10:44:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529863+0000", 2024-04-26T10:44:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4500000000000003e-06 2024-04-26T10:44:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529874+0000", 2024-04-26T10:44:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0552e-05 2024-04-26T10:44:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.492 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.529882+0000", 2024-04-26T10:44:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4449999999999996e-06 2024-04-26T10:44:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561452+0000", 2024-04-26T10:44:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031569680000000003 2024-04-26T10:44:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561511+0000", 2024-04-26T10:44:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9332e-05 2024-04-26T10:44:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.493 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.561583+0000", 2024-04-26T10:44:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1730000000000006e-05 2024-04-26T10:44:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562933+0000", 2024-04-26T10:44:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013500059999999999 2024-04-26T10:44:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.562976+0000", 2024-04-26T10:44:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2987e-05 2024-04-26T10:44:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.494 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563015+0000", 2024-04-26T10:44:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9453999999999999e-05 2024-04-26T10:44:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:21.563037+0000", 2024-04-26T10:44:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1679e-05 2024-04-26T10:44:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.495 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(mds.0.3:277 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 28.864621098000001, 2024-04-26T10:44:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030430563000000001, 2024-04-26T10:44:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-04-26T10:44:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-04-26T10:44:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-04-26T10:44:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-04-26T10:44:55.496 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514869+0000", 2024-04-26T10:44:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-04-26T10:44:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-04-26T10:44:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.514867+0000", 2024-04-26T10:44:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4294967295.9999976 2024-04-26T10:44:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-04-26T10:44:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515460+0000", 2024-04-26T10:44:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00059285800000000004 2024-04-26T10:44:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-04-26T10:44:55.497 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515474+0000", 2024-04-26T10:44:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3933e-05 2024-04-26T10:44:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515481+0000", 2024-04-26T10:44:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:44:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-04-26T10:44:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515522+0000", 2024-04-26T10:44:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1369000000000003e-05 2024-04-26T10:44:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.498 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-04-26T10:44:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.515591+0000", 2024-04-26T10:44:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9377999999999999e-05 2024-04-26T10:44:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for subops from 2", 2024-04-26T10:44:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.526440+0000", 2024-04-26T10:44:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010848837 2024-04-26T10:44:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.543866+0000", 2024-04-26T10:44:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017426288000000002 2024-04-26T10:44:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op_commit", 2024-04-26T10:44:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545193+0000", 2024-04-26T10:44:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001326111 2024-04-26T10:44:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-04-26T10:44:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545229+0000", 2024-04-26T10:44:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6390999999999998e-05 2024-04-26T10:44:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-04-26T10:44:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-04-26T10:44:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-04-26T10:44:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-04-26T10:44:26.545300+0000", 2024-04-26T10:44:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1073000000000002e-05 2024-04-26T10:44:55.500 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-04-26T10:44:55.501 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-04-26T10:44:55.501 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-04-26T10:44:55.502 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:44:55.606 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:55.606 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:55.606 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-26T10:44:55.606 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:55.615 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:44:55.715 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:55.773 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-26T10:44:55.773 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-26T10:44:55.773 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-26T10:44:55.773 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:55.774 INFO:teuthology.orchestra.run.smithi049.stderr:nodeep-scrub is unset 2024-04-26T10:44:55.775 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:44:55.878 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-26T10:44:55.878 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-26T10:44:55.878 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-26T10:44:55.878 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-26T10:44:55.878 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.878 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:330 3.13 3:ceffbd45:::200.0000000a:head [write 1316140~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:55.878 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:55.878 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.362436426999999, 2024-04-26T10:44:55.878 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022245654, 2024-04-26T10:44:55.879 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:55.879 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.879 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:55.879 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.879 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:55.879 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:55.879 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.879 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.879 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.879 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:55.879 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513140+0000", 2024-04-26T10:44:55.879 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.879 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.879 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.880 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:55.880 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513139+0000", 2024-04-26T10:44:55.880 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:55.880 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.880 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.880 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:55.880 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513149+0000", 2024-04-26T10:44:55.880 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.7550000000000006e-06 2024-04-26T10:44:55.880 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.880 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.880 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:55.880 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513157+0000", 2024-04-26T10:44:55.880 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1089999999999998e-06 2024-04-26T10:44:55.880 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.881 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.881 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.881 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513167+0000", 2024-04-26T10:44:55.881 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0539e-05 2024-04-26T10:44:55.881 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.881 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.881 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:55.881 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533830+0000", 2024-04-26T10:44:55.881 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020662852999999998 2024-04-26T10:44:55.881 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.881 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.881 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:55.881 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.533875+0000", 2024-04-26T10:44:55.881 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.5071999999999998e-05 2024-04-26T10:44:55.882 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.882 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.882 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:55.882 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535319+0000", 2024-04-26T10:44:55.882 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001443578 2024-04-26T10:44:55.882 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.882 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.882 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:55.882 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535346+0000", 2024-04-26T10:44:55.882 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7415000000000001e-05 2024-04-26T10:44:55.882 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.882 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.882 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:55.882 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535385+0000", 2024-04-26T10:44:55.883 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8912999999999998e-05 2024-04-26T10:44:55.883 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.883 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:55.883 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.883 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.883 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.883 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:331 3.13 3:ceffbd45:::200.0000000a:head [write 1318049~1413 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:55.883 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:55.883 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.362397098999999, 2024-04-26T10:44:55.883 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023524521, 2024-04-26T10:44:55.883 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:55.883 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.883 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:55.883 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.884 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:55.884 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:55.884 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.884 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.884 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.884 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:55.884 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513179+0000", 2024-04-26T10:44:55.884 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.884 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.884 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.884 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:55.884 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513178+0000", 2024-04-26T10:44:55.884 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:55.884 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.884 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.885 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:55.885 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513183+0000", 2024-04-26T10:44:55.885 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2549999999999999e-06 2024-04-26T10:44:55.885 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.885 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.885 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:55.885 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513190+0000", 2024-04-26T10:44:55.885 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8460000000000002e-06 2024-04-26T10:44:55.885 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.885 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.885 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.885 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513195+0000", 2024-04-26T10:44:55.885 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3630000000000002e-06 2024-04-26T10:44:55.885 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.886 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.886 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:55.886 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534463+0000", 2024-04-26T10:44:55.886 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021267823000000002 2024-04-26T10:44:55.886 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.886 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.886 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:55.886 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534520+0000", 2024-04-26T10:44:55.886 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7510000000000003e-05 2024-04-26T10:44:55.886 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.886 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.886 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:55.886 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536634+0000", 2024-04-26T10:44:55.886 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0021138900000000002 2024-04-26T10:44:55.887 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.887 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.887 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:55.887 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536663+0000", 2024-04-26T10:44:55.887 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.8884e-05 2024-04-26T10:44:55.887 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.887 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.887 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:55.887 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536703+0000", 2024-04-26T10:44:55.887 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0479000000000003e-05 2024-04-26T10:44:55.887 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.887 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:55.887 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.887 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.887 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.888 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:332 3.13 3:ceffbd45:::200.0000000a:head [write 1319462~1408 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:55.888 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:55.888 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.362362266000002, 2024-04-26T10:44:55.888 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024543230999999999, 2024-04-26T10:44:55.888 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:55.888 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.888 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:55.888 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.888 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:55.890 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:55.890 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.890 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.890 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.890 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:55.890 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513214+0000", 2024-04-26T10:44:55.890 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.890 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.890 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.890 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:55.890 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513213+0000", 2024-04-26T10:44:55.891 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:55.891 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.891 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.891 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:55.891 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513217+0000", 2024-04-26T10:44:55.891 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:44:55.891 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.891 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.891 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:55.891 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513229+0000", 2024-04-26T10:44:55.891 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2051e-05 2024-04-26T10:44:55.891 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.891 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.891 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.892 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513236+0000", 2024-04-26T10:44:55.892 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4470000000000003e-06 2024-04-26T10:44:55.892 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.892 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.892 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:55.892 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534891+0000", 2024-04-26T10:44:55.892 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021655863000000001 2024-04-26T10:44:55.892 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.892 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.892 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:55.892 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.534933+0000", 2024-04-26T10:44:55.892 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1596e-05 2024-04-26T10:44:55.892 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.893 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.893 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:55.893 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537677+0000", 2024-04-26T10:44:55.893 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027440989999999998 2024-04-26T10:44:55.893 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.893 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.893 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:55.893 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537721+0000", 2024-04-26T10:44:55.893 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3813999999999998e-05 2024-04-26T10:44:55.893 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.893 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.893 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:55.893 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537757+0000", 2024-04-26T10:44:55.893 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6022999999999997e-05 2024-04-26T10:44:55.894 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.894 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:55.894 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.894 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.894 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.894 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:333 3.13 3:ceffbd45:::200.0000000a:head [write 1320870~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:55.894 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:55.894 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.362319347, 2024-04-26T10:44:55.894 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024557151999999999, 2024-04-26T10:44:55.894 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:55.894 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.894 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:55.894 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.895 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:55.895 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:55.895 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.895 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.895 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.895 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:55.895 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513257+0000", 2024-04-26T10:44:55.895 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.895 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.895 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.895 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:55.895 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513256+0000", 2024-04-26T10:44:55.895 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:55.895 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.896 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.896 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:55.896 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513260+0000", 2024-04-26T10:44:55.896 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6550000000000002e-06 2024-04-26T10:44:55.896 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.896 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.896 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:55.896 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513273+0000", 2024-04-26T10:44:55.896 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2965e-05 2024-04-26T10:44:55.896 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.896 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.896 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.896 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.513279+0000", 2024-04-26T10:44:55.896 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:44:55.896 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.897 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.897 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:55.897 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535411+0000", 2024-04-26T10:44:55.897 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022132233000000001 2024-04-26T10:44:55.897 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.897 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.897 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:55.897 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535479+0000", 2024-04-26T10:44:55.897 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7554999999999999e-05 2024-04-26T10:44:55.897 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.897 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.897 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:55.897 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537762+0000", 2024-04-26T10:44:55.898 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0022836499999999999 2024-04-26T10:44:55.898 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.898 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.898 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:55.898 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537783+0000", 2024-04-26T10:44:55.898 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0364e-05 2024-04-26T10:44:55.898 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.898 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.898 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:55.898 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537814+0000", 2024-04-26T10:44:55.898 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1170000000000001e-05 2024-04-26T10:44:55.898 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.898 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:55.898 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.899 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.899 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.899 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:334 3.13 3:ceffbd45:::200.0000000a:head [write 1322273~2957 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:55.899 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:55.899 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.360482588, 2024-04-26T10:44:55.899 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022778731999999999, 2024-04-26T10:44:55.899 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:55.899 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.899 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:55.899 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.899 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:55.899 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:55.899 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.899 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.900 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.900 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:55.900 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:55.900 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.900 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.900 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.901 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:55.901 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515093+0000", 2024-04-26T10:44:55.901 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:55.901 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.901 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.901 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:55.901 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515099+0000", 2024-04-26T10:44:55.901 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6599999999999998e-06 2024-04-26T10:44:55.901 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.901 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.901 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:55.901 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515112+0000", 2024-04-26T10:44:55.901 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2707e-05 2024-04-26T10:44:55.901 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.902 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.902 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.902 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515120+0000", 2024-04-26T10:44:55.902 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8509999999999999e-06 2024-04-26T10:44:55.902 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.902 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.902 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:55.902 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535792+0000", 2024-04-26T10:44:55.902 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020672209 2024-04-26T10:44:55.902 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.902 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.902 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:55.902 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.535833+0000", 2024-04-26T10:44:55.902 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1415000000000002e-05 2024-04-26T10:44:55.903 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.903 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.903 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:55.903 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537818+0000", 2024-04-26T10:44:55.903 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0019850900000000001 2024-04-26T10:44:55.903 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.903 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.903 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:55.903 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537839+0000", 2024-04-26T10:44:55.903 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0068000000000002e-05 2024-04-26T10:44:55.903 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.903 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.903 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:55.903 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537872+0000", 2024-04-26T10:44:55.903 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3680999999999998e-05 2024-04-26T10:44:55.904 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.904 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:55.904 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.904 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.904 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.904 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:335 3.13 3:ceffbd45:::200.0000000a:head [write 1325230~1917 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:55.904 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:55.904 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.360443489000001, 2024-04-26T10:44:55.904 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023487081, 2024-04-26T10:44:55.904 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:55.904 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.904 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:55.904 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.904 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:55.905 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:55.905 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.905 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.905 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.905 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:55.905 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515133+0000", 2024-04-26T10:44:55.905 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.905 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.905 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.905 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:55.905 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515132+0000", 2024-04-26T10:44:55.905 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:55.905 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.905 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.905 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:55.906 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515136+0000", 2024-04-26T10:44:55.906 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.0860000000000004e-06 2024-04-26T10:44:55.906 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.906 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.906 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:55.906 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515143+0000", 2024-04-26T10:44:55.906 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.0400000000000004e-06 2024-04-26T10:44:55.906 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.906 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.906 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.906 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.515149+0000", 2024-04-26T10:44:55.906 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0789999999999997e-06 2024-04-26T10:44:55.906 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.906 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.907 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:55.907 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536200+0000", 2024-04-26T10:44:55.907 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021050993 2024-04-26T10:44:55.907 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.907 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.907 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:55.907 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536253+0000", 2024-04-26T10:44:55.907 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.2643999999999999e-05 2024-04-26T10:44:55.907 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.907 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.907 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:55.907 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538560+0000", 2024-04-26T10:44:55.907 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0023073389999999998 2024-04-26T10:44:55.907 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.908 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.908 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:55.908 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538584+0000", 2024-04-26T10:44:55.908 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.3893999999999999e-05 2024-04-26T10:44:55.908 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.908 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.908 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:55.908 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538620+0000", 2024-04-26T10:44:55.908 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5611000000000002e-05 2024-04-26T10:44:55.908 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.908 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:55.908 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.908 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.908 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:336 3.13 3:ceffbd45:::200.0000000a:head [write 1327147~14989 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.359111034000001, 2024-04-26T10:44:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027687066, 2024-04-26T10:44:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:55.909 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516465+0000", 2024-04-26T10:44:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516464+0000", 2024-04-26T10:44:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516491+0000", 2024-04-26T10:44:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6539000000000001e-05 2024-04-26T10:44:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.910 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516500+0000", 2024-04-26T10:44:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5480000000000007e-06 2024-04-26T10:44:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516511+0000", 2024-04-26T10:44:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0719e-05 2024-04-26T10:44:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536737+0000", 2024-04-26T10:44:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020225770000000001 2024-04-26T10:44:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.911 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.536783+0000", 2024-04-26T10:44:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6168999999999998e-05 2024-04-26T10:44:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544080+0000", 2024-04-26T10:44:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0072966799999999998 2024-04-26T10:44:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544111+0000", 2024-04-26T10:44:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1056999999999998e-05 2024-04-26T10:44:55.912 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544152+0000", 2024-04-26T10:44:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1452000000000002e-05 2024-04-26T10:44:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:337 3.13 3:ceffbd45:::200.0000000a:head [write 1342136~2433 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.359058095999998, 2024-04-26T10:44:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027711237, 2024-04-26T10:44:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:55.913 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516518+0000", 2024-04-26T10:44:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:55.914 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516517+0000", 2024-04-26T10:44:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516521+0000", 2024-04-26T10:44:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6200000000000001e-06 2024-04-26T10:44:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516528+0000", 2024-04-26T10:44:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8639999999999998e-06 2024-04-26T10:44:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.915 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.516533+0000", 2024-04-26T10:44:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6310000000000002e-06 2024-04-26T10:44:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537231+0000", 2024-04-26T10:44:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020698613000000001 2024-04-26T10:44:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537273+0000", 2024-04-26T10:44:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1529000000000002e-05 2024-04-26T10:44:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.916 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544157+0000", 2024-04-26T10:44:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0068847090000000001 2024-04-26T10:44:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544180+0000", 2024-04-26T10:44:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.2532e-05 2024-04-26T10:44:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544229+0000", 2024-04-26T10:44:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9190000000000002e-05 2024-04-26T10:44:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.917 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:338 3.13 3:ceffbd45:::200.0000000a:head [write 1344569~1916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.358391843, 2024-04-26T10:44:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.027105598000000002, 2024-04-26T10:44:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:55.918 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517184+0000", 2024-04-26T10:44:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517183+0000", 2024-04-26T10:44:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.919 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517188+0000", 2024-04-26T10:44:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7389999999999999e-06 2024-04-26T10:44:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517199+0000", 2024-04-26T10:44:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0652000000000001e-05 2024-04-26T10:44:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.517206+0000", 2024-04-26T10:44:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.6610000000000003e-06 2024-04-26T10:44:55.920 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537905+0000", 2024-04-26T10:44:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020699662000000001 2024-04-26T10:44:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.537956+0000", 2024-04-26T10:44:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0954e-05 2024-04-26T10:44:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:55.921 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544233+0000", 2024-04-26T10:44:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062773009999999999 2024-04-26T10:44:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544258+0000", 2024-04-26T10:44:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4434999999999999e-05 2024-04-26T10:44:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544290+0000", 2024-04-26T10:44:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1918000000000002e-05 2024-04-26T10:44:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:55.922 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:339 3.13 3:ceffbd45:::200.0000000a:head [write 1346485~4322 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.35745335, 2024-04-26T10:44:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026221617999999999, 2024-04-26T10:44:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.923 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518123+0000", 2024-04-26T10:44:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518122+0000", 2024-04-26T10:44:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518129+0000", 2024-04-26T10:44:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.43e-06 2024-04-26T10:44:55.924 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518138+0000", 2024-04-26T10:44:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9129999999999992e-06 2024-04-26T10:44:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.518144+0000", 2024-04-26T10:44:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.1419999999999998e-06 2024-04-26T10:44:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.925 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538232+0000", 2024-04-26T10:44:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020087383 2024-04-26T10:44:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538274+0000", 2024-04-26T10:44:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2602999999999999e-05 2024-04-26T10:44:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544294+0000", 2024-04-26T10:44:55.926 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060194059999999997 2024-04-26T10:44:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544314+0000", 2024-04-26T10:44:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0091000000000001e-05 2024-04-26T10:44:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544344+0000", 2024-04-26T10:44:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0446e-05 2024-04-26T10:44:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.927 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:340 3.13 3:ceffbd45:::200.0000000a:head [write 1350807~2768 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.354969113999999, 2024-04-26T10:44:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023795594, 2024-04-26T10:44:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:55.928 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520607+0000", 2024-04-26T10:44:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520606+0000", 2024-04-26T10:44:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520612+0000", 2024-04-26T10:44:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.835e-06 2024-04-26T10:44:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.929 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520622+0000", 2024-04-26T10:44:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0173999999999999e-05 2024-04-26T10:44:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.520629+0000", 2024-04-26T10:44:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7460000000000003e-06 2024-04-26T10:44:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538651+0000", 2024-04-26T10:44:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018022474 2024-04-26T10:44:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.930 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.538697+0000", 2024-04-26T10:44:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6183999999999997e-05 2024-04-26T10:44:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544348+0000", 2024-04-26T10:44:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0056503509999999996 2024-04-26T10:44:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544369+0000", 2024-04-26T10:44:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1064999999999999e-05 2024-04-26T10:44:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.931 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544403+0000", 2024-04-26T10:44:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.3695000000000002e-05 2024-04-26T10:44:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:341 3.13 3:ceffbd45:::200.0000000a:head [write 1353575~3816 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e56)", 2024-04-26T10:44:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.354233859000001, 2024-04-26T10:44:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023114967, 2024-04-26T10:44:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.932 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521342+0000", 2024-04-26T10:44:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521341+0000", 2024-04-26T10:44:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:55.933 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521349+0000", 2024-04-26T10:44:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1550000000000001e-06 2024-04-26T10:44:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521358+0000", 2024-04-26T10:44:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.1500000000000005e-06 2024-04-26T10:44:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.521364+0000", 2024-04-26T10:44:55.934 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3289999999999999e-06 2024-04-26T10:44:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539010+0000", 2024-04-26T10:44:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.017645965999999999 2024-04-26T10:44:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.539051+0000", 2024-04-26T10:44:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.053e-05 2024-04-26T10:44:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.935 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544407+0000", 2024-04-26T10:44:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0053560209999999999 2024-04-26T10:44:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544427+0000", 2024-04-26T10:44:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.0228e-05 2024-04-26T10:44:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:26.544457+0000", 2024-04-26T10:44:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0375e-05 2024-04-26T10:44:55.936 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11582 4.2f 4:f76ba295:::10000003252.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.880618313999999, 2024-04-26T10:44:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.024553994999999999, 2024-04-26T10:44:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11582 2024-04-26T10:44:55.937 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994958+0000", 2024-04-26T10:44:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:55.938 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:28.994957+0000", 2024-04-26T10:44:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002755+0000", 2024-04-26T10:44:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0077984719999999999 2024-04-26T10:44:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002770+0000", 2024-04-26T10:44:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.4956e-05 2024-04-26T10:44:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.939 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002777+0000", 2024-04-26T10:44:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1899999999999998e-06 2024-04-26T10:44:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002833+0000", 2024-04-26T10:44:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5189999999999998e-05 2024-04-26T10:44:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.002977+0000", 2024-04-26T10:44:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014444100000000001 2024-04-26T10:44:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.940 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.003108+0000", 2024-04-26T10:44:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000131068 2024-04-26T10:44:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.009040+0000", 2024-04-26T10:44:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0059314149999999998 2024-04-26T10:44:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019462+0000", 2024-04-26T10:44:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010422803 2024-04-26T10:44:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.941 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019490+0000", 2024-04-26T10:44:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7773999999999999e-05 2024-04-26T10:44:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.019512+0000", 2024-04-26T10:44:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1611999999999999e-05 2024-04-26T10:44:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.942 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:11911 4.37 4:ec04ab04:::100000031ec.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.538898107000001, 2024-04-26T10:44:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.026810273999999999, 2024-04-26T10:44:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 11911 2024-04-26T10:44:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:55.943 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336678+0000", 2024-04-26T10:44:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.336676+0000", 2024-04-26T10:44:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:55.944 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343119+0000", 2024-04-26T10:44:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0064424850000000004 2024-04-26T10:44:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343131+0000", 2024-04-26T10:44:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1708e-05 2024-04-26T10:44:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343137+0000", 2024-04-26T10:44:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.9880000000000001e-06 2024-04-26T10:44:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.945 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343175+0000", 2024-04-26T10:44:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7913000000000001e-05 2024-04-26T10:44:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343269+0000", 2024-04-26T10:44:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4931000000000003e-05 2024-04-26T10:44:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.343392+0000", 2024-04-26T10:44:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000122435 2024-04-26T10:44:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.946 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.347520+0000", 2024-04-26T10:44:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004128418 2024-04-26T10:44:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363410+0000", 2024-04-26T10:44:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.015889309000000001 2024-04-26T10:44:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363453+0000", 2024-04-26T10:44:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3244000000000001e-05 2024-04-26T10:44:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.947 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.363488+0000", 2024-04-26T10:44:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.5318000000000003e-05 2024-04-26T10:44:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12000 4.3c 4:3c2be35d:::100000030f7.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.456276594999999, 2024-04-26T10:44:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022808264000000002, 2024-04-26T10:44:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:55.948 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12000 2024-04-26T10:44:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:55.949 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.419299+0000", 2024-04-26T10:44:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430937+0000", 2024-04-26T10:44:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.011638097 2024-04-26T10:44:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.950 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430948+0000", 2024-04-26T10:44:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0824e-05 2024-04-26T10:44:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430953+0000", 2024-04-26T10:44:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5219999999999998e-06 2024-04-26T10:44:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.430990+0000", 2024-04-26T10:44:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6458999999999998e-05 2024-04-26T10:44:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.951 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.431052+0000", 2024-04-26T10:44:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2687000000000005e-05 2024-04-26T10:44:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442027+0000", 2024-04-26T10:44:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.010974513 2024-04-26T10:44:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442060+0000", 2024-04-26T10:44:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2849999999999999e-05 2024-04-26T10:44:55.952 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.442108+0000", 2024-04-26T10:44:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.8031999999999997e-05 2024-04-26T10:44:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12042 4.2f 4:f741970f:::10000003414.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:55.953 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.417023117999999, 2024-04-26T10:44:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.029390757, 2024-04-26T10:44:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12042 2024-04-26T10:44:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.954 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458553+0000", 2024-04-26T10:44:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.458552+0000", 2024-04-26T10:44:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464335+0000", 2024-04-26T10:44:55.955 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.005783168 2024-04-26T10:44:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464347+0000", 2024-04-26T10:44:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1578e-05 2024-04-26T10:44:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464353+0000", 2024-04-26T10:44:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3709999999999996e-06 2024-04-26T10:44:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464407+0000", 2024-04-26T10:44:55.956 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3717000000000001e-05 2024-04-26T10:44:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464556+0000", 2024-04-26T10:44:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014899100000000001 2024-04-26T10:44:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.464688+0000", 2024-04-26T10:44:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013238599999999999 2024-04-26T10:44:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:55.957 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.469725+0000", 2024-04-26T10:44:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0050369229999999996 2024-04-26T10:44:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487892+0000", 2024-04-26T10:44:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.018167184999999999 2024-04-26T10:44:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487922+0000", 2024-04-26T10:44:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.9495000000000001e-05 2024-04-26T10:44:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.958 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.487944+0000", 2024-04-26T10:44:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1823000000000001e-05 2024-04-26T10:44:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12050 4.2c 4:36b72e58:::100000031ba.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 26.408482508999999, 2024-04-26T10:44:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.022722497000000001, 2024-04-26T10:44:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:55.959 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12050 2024-04-26T10:44:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467094+0000", 2024-04-26T10:44:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.960 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.467093+0000", 2024-04-26T10:44:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999995 2024-04-26T10:44:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476305+0000", 2024-04-26T10:44:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092125850000000006 2024-04-26T10:44:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476322+0000", 2024-04-26T10:44:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6860000000000001e-05 2024-04-26T10:44:55.961 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476328+0000", 2024-04-26T10:44:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.587e-06 2024-04-26T10:44:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476378+0000", 2024-04-26T10:44:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0519999999999997e-05 2024-04-26T10:44:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.476474+0000", 2024-04-26T10:44:55.962 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5556000000000005e-05 2024-04-26T10:44:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489677+0000", 2024-04-26T10:44:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013203048 2024-04-26T10:44:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489722+0000", 2024-04-26T10:44:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4650000000000001e-05 2024-04-26T10:44:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:55.963 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.489816+0000", 2024-04-26T10:44:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4402999999999997e-05 2024-04-26T10:44:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12516 4.37 4:ed0cb515:::10000003324.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.888400944000001, 2024-04-26T10:44:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.030139677, 2024-04-26T10:44:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:55.964 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12516 2024-04-26T10:44:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987175+0000", 2024-04-26T10:44:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.965 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.987173+0000", 2024-04-26T10:44:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999981 2024-04-26T10:44:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991339+0000", 2024-04-26T10:44:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0041663760000000003 2024-04-26T10:44:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991351+0000", 2024-04-26T10:44:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1333e-05 2024-04-26T10:44:55.966 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991357+0000", 2024-04-26T10:44:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3350000000000003e-06 2024-04-26T10:44:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991394+0000", 2024-04-26T10:44:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7054000000000001e-05 2024-04-26T10:44:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991495+0000", 2024-04-26T10:44:55.967 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000100386 2024-04-26T10:44:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.991579+0000", 2024-04-26T10:44:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4295000000000005e-05 2024-04-26T10:44:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:29.996238+0000", 2024-04-26T10:44:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0046589309999999998 2024-04-26T10:44:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.968 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017237+0000", 2024-04-26T10:44:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.020998993000000001 2024-04-26T10:44:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017280+0000", 2024-04-26T10:44:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3600000000000003e-05 2024-04-26T10:44:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.017315+0000", 2024-04-26T10:44:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4381999999999997e-05 2024-04-26T10:44:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.969 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:12644 4.37 4:ec5044d7:::100000032d1.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.714728116, 2024-04-26T10:44:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.037018677, 2024-04-26T10:44:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:55.970 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 12644 2024-04-26T10:44:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160848+0000", 2024-04-26T10:44:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:55.971 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.160847+0000", 2024-04-26T10:44:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.999999 2024-04-26T10:44:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170089+0000", 2024-04-26T10:44:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0092424289999999999 2024-04-26T10:44:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170111+0000", 2024-04-26T10:44:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.1733e-05 2024-04-26T10:44:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.972 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170124+0000", 2024-04-26T10:44:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.272e-05 2024-04-26T10:44:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170177+0000", 2024-04-26T10:44:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.3745000000000001e-05 2024-04-26T10:44:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170350+0000", 2024-04-26T10:44:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017297699999999999 2024-04-26T10:44:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:55.973 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.170458+0000", 2024-04-26T10:44:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000107583 2024-04-26T10:44:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.176693+0000", 2024-04-26T10:44:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0062351799999999999 2024-04-26T10:44:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197774+0000", 2024-04-26T10:44:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.021080471999999999 2024-04-26T10:44:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.974 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197824+0000", 2024-04-26T10:44:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.0096000000000003e-05 2024-04-26T10:44:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.197867+0000", 2024-04-26T10:44:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2882e-05 2024-04-26T10:44:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(client.4532.0:13242 4.2f 4:f5e54bb5:::100000033c8.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:44:55.975 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.036496977999999, 2024-04-26T10:44:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.023873062, 2024-04-26T10:44:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-26T10:44:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:44:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: "client_info": { 2024-04-26T10:44:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: "client": "client.4532", 2024-04-26T10:44:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: "client_addr": "192.168.0.1:0/1339716484", 2024-04-26T10:44:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: "tid": 13242 2024-04-26T10:44:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-26T10:44:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-26T10:44:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.976 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-26T10:44:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839079+0000", 2024-04-26T10:44:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-26T10:44:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-26T10:44:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.839078+0000", 2024-04-26T10:44:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4294967295.9999986 2024-04-26T10:44:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-26T10:44:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848098+0000", 2024-04-26T10:44:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0090200750000000007 2024-04-26T10:44:55.977 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-26T10:44:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848108+0000", 2024-04-26T10:44:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.062e-05 2024-04-26T10:44:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-26T10:44:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848115+0000", 2024-04-26T10:44:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3040000000000001e-06 2024-04-26T10:44:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-26T10:44:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848157+0000", 2024-04-26T10:44:55.978 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2533000000000001e-05 2024-04-26T10:44:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-26T10:44:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848252+0000", 2024-04-26T10:44:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.4480000000000003e-05 2024-04-26T10:44:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-26T10:44:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.848393+0000", 2024-04-26T10:44:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000140863 2024-04-26T10:44:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-26T10:44:55.979 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.854434+0000", 2024-04-26T10:44:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0060415590000000002 2024-04-26T10:44:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:44:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862894+0000", 2024-04-26T10:44:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0084598869999999993 2024-04-26T10:44:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-26T10:44:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862926+0000", 2024-04-26T10:44:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1473999999999997e-05 2024-04-26T10:44:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-26T10:44:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-26T10:44:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-26T10:44:55.980 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-26T10:44:30.862952+0000", 2024-04-26T10:44:55.981 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.6545000000000001e-05 2024-04-26T10:44:55.981 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.981 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:55.981 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.981 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-26T10:44:55.981 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-26T10:44:55.981 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-26T10:44:55.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~100s 2024-04-26T10:44:57.787 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:44:58.777 INFO:teuthology.orchestra.run.smithi049.stderr:noscrub is unset 2024-04-26T10:44:58.793 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:44:59.783 INFO:teuthology.orchestra.run.smithi049.stderr:nodeep-scrub is unset 2024-04-26T10:45:01.789 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~106s 2024-04-26T10:45:07.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~111s 2024-04-26T10:45:13.400 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~117s 2024-04-26T10:45:19.207 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~123s 2024-04-26T10:45:25.012 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~129s 2024-04-26T10:45:30.819 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~135s 2024-04-26T10:45:36.261 DEBUG:teuthology.orchestra.console.smithi087:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el( t XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F D5 F5 GUID: 00000000 0000 0000 0000 0CC47AD8DAFC DHCP.-                    DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- CLIENT IP: 172.21.15.87 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:d5:f5)... Configuring (net0 0c:c4:7a:8f:d5:f5).... Configuring (net0 0c:c4:7a:8f:d5:f5)..... Configuring (net0 0c:c4:7a:8f:d5:f5)...... ok [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-437.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9               The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-437.el9.x86_64) 9   CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9            The selected entry will be started automatically in 4s.   Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h      [ 0.000000] Linux version 5.14.0-437.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.4.1 20231218 (Red Hat 11.4.1-3), GNU ld version 2.35.2-43.el9) #1 SMP PREEMPT_DYNAMIC Tue Apr 9 12:57:02 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820000000000-0x000e [ 0.000000 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ea3fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f56000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.655 MHz processor [ 0.000407] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000411] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000413] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000743] last_pfn = 0x78ea4 max_arch_pfn = 0x400000000 [ 0.006539] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.006548] Using GB pages for direct mapping [ 0.006696] RAMDISK: [mem 0x33f38000-0x35f93fff] [ 0.006699] ACPI: Early table checksum verification disabled [ 0.006701] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.006704] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.006709] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006713] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006716] ACPI: FACS 0x0000000079D49F80 000040 [ 0.006718] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006720] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006722] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006725] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006727] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006729] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006732] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006734] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006736] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006738] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006741] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006743] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006745] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006748] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006750] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006752] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006754] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006756] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.006757] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.006758] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.006759] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.006759] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.006760] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.006761] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.006761] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.006762] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.006762] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.006763] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.006764] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.006764] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.006765] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.006765] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.006766] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.006767] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.006767] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.006768] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.006768] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.006813] No NUMA configuration found [ 0.006814] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006822] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.007017] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.007052] Zone ranges: [ 0.007052] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.007054] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.007055] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.007056] Device empty [ 0.007057] Movable zone start for each node [ 0.007059] Early memory node ranges [ 0.007059] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.007060] node 0: [mem 0x0000000000100000-0x0000000078ea3fff] [ 0.007061] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.007065] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.007069] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.007105] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.011905] On node 0, zone Normal: 29020 pages in unavailable ranges [ 0.012016] ACPI: PM-Timer IO Port: 0x408 [ 0.012023] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.012025] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.012025] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.012026] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.012026] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.012027] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.012027] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.012028] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.012037] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.012041] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.012043] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.012044] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.012048] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.012049] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.012052] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.012053] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.012063] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.012064] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.012065] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.012066] PM: hibernation: Registered nosave memory: [mem 0x78ea4000-0x78f55fff] [ 0.012066] PM: hibernation: Registered nosave memory: [mem 0x78f56000-0x798adfff] [ 0.012067] PM: hibernation: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.012068] PM: hibernation: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.012068] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.012069] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.012069] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.012070] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.012071] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.012072] Booting paravirtualized kernel on bare hardware [ 0.012074] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016403] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016621] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.016646] Fallback order for Node 0: 0 [ 0.016648] Built 1 zonelists, mobility grouping on. Total pages: 8228713 [ 0.016649] Policy zone: Normal [ 0.016650] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016706] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64", will be passed to user space. [ 0.016722] random: crng init done [ 0.018887] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.020017] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020260] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020267] software IO TLB: area num 8. [ 0.047416] Memory: 1750044K/33437880K available (16384K kernel code, 5628K rwdata, 11788K rodata, 3928K init, 5908K bss, 989180K reserved, 0K cma-reserved) [ 0.047516] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.047524] Kernel/User page tables isolation: enabled [ 0.047546] ftrace: allocating 46993 entries in 184 pages [ 0.065773] ftrace: allocated 184 pages with 4 groups [ 0.066279] Dynamic Preempt: voluntary [ 0.066308] rcu: Preemptible hierarchical RCU implementation. [ 0.066308] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.066310] Trampoline variant of Tasks RCU enabled. [ 0.066310] Rude variant of Tasks RCU enabled. [ 0.066310] Tracing variant of Tasks RCU enabled. [ 0.066311] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.066311] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.069533] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.069695] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.069801] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.075029] Console: colour VGA+ 80x25 [ 1.096493] printk: console [ttyS1] enabled [ 1.100683] ACPI: Core revision 20230331 [ 1.104777] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.113907] APIC: Switch to symmetric I/O mode setup [ 1.118877] DMAR: Host address width 46 [ 1.122720] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.128037] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.136040] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.142308] DMAR: ATSR flags: 0x0 [ 1.145627] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.151894] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.158247] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.164601] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.170002] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.170003] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.185020] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.190330] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.196552] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.206916] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32720b4660d, max_idle_ns: 440795375244 ns [ 1.217427] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.31 BogoMIPS (lpj=3499655) [ 1.218445] CPU0: Thermal monitoring enabled (TM1) [ 1.219480] process: using mwait in idle threads [ 1.220428] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.221427] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.222428] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.223427] Spectre V2 : Mitigation: Retpolines [ 1.224427] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.225427] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.226427] Speculative Store Bypass: Vulnerable [ 1.227432] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.228427] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.229427] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.230429] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.231427] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.232427] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.233427] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.234427] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.246849] Freeing SMP alternatives memory: 36K [ 1.247427] pid_max: default: 32768 minimum: 301 [ 1.248445] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.249431] Yama: becoming mindful. [ 1.250430] SELinux: Initializing. [ 1.251442] LSM support for eBPF active [ 1.252484] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.253465] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.357256] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.358523] cblist_init_generic: Setting adjustable number of callback queues. [ 1.359427] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.360438] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.361436] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.362435] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.363427] ... version: 3 [ 1.364426] ... bit width: 48 [ 1.365426] ... generic registers: 4 [ 1.366426] ... value mask: 0000ffffffffffff [ 1.367426] ... max period: 00007fffffffffff [ 1.368426] ... fixed-purpose events: 3 [ 1.369427] ... event mask: 000000070000000f [ 1.370510] signal: max sigframe size: 1776 [ 1.371437] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.372452] rcu: Hierarchical SRCU implementation. [ 1.372452] rcu: Max phase no-delay instances is 400. [ 1.372460] printk: console [ttyS1] printing thread started [ 1.377038] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.377104] smp: Bringing up secondary CPUs ... [ 1.377171] smpboot: x86: Booting SMP configuration: [ 1.377171] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.383683] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.383683] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.383683] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.383683] smp: Brought up 1 node, 8 CPUs [ 1.383683] smpboot: Max logical packages: 1 [ 1.383683] smpboot: Total of 8 processors activated (55994.48 BogoMIPS) [ 1.424719] node 0 deferred pages initialised in 36ms [ 1.425601] devtmpfs: initialized [ 1.425601] x86/mm: Memory block size: 128MB [ 1.426374] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 1.426374] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.426374] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.426374] pinctrl core: initialized pinctrl subsystem [ 1.429426] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.429426] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.429426] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.429426] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.429426] audit: initializing netlink subsys (disabled) [ 1.429436] audit: type=2000 audit(1714128306.232:1): state=initialized audit_enabled=0 res=1 [ 1.429495] thermal_sys: Registered thermal governor 'fair_share' [ 1.429496] thermal_sys: Registered thermal governor 'step_wise' [ 1.429497] thermal_sys: Registered thermal governor 'user_space' [ 1.430429] cpuidle: using governor menu [ 1.431445] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.431446] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.431491] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.431494] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.431502] PCI: Using configuration type 1 for base access [ 1.434455] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.434458] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.434458] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.434458] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.434458] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.435454] cryptd: max_cpu_qlen set to 1000 [ 1.453426] ACPI: Added _OSI(Module Device) [ 1.453426] ACPI: Added _OSI(Processor Device) [ 1.453426] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.453426] ACPI: Added _OSI(Processor Aggregator Device) [ 1.453426] ACPI: Added _OSI(Linux-Dell-Video) [ 1.453426] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.453426] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.458426] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.459426] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.459426] ACPI: Dynamic OEM Table Load: [ 1.461426] ACPI: _OSC evaluated successfully for all CPUs [ 1.461426] ACPI: Interpreter enabled [ 1.461426] ACPI: PM: (supports S0 S4 S5) [ 1.461426] ACPI: Using IOAPIC for interrupt routing [ 1.462425] HEST: Enabling Firmware First mode for corrected errors. [ 1.468426] HEST: Table parsing has been initialized. [ 1.468426] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.468426] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.468426] PCI: Using E820 reservations for host bridge windows [ 1.468821] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.489119] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.489124] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.490229] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.490761] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.490762] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.490789] PCI host bridge to bus 0000:ff [ 1.490790] pci_bus 0000:ff: root bus resource [bus ff] [ 1.490801] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.490842] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.490873] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.490901] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.490931] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.490960] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.490987] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.491015] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.491044] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.491071] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.491100] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.491127] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.491155] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.491183] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.491211] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.491239] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.491269] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.491296] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.491324] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.491343] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.491379] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.491435] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.491476] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.491516] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.491556] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.491597] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.491636] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.491666] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.491698] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.491738] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.491781] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.491821] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.491859] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.491889] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.491919] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.491948] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.491980] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.492021] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.492061] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.492101] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.492143] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.492177] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.492206] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.492239] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.492273] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.492303] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.492333] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.492363] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.492395] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.492424] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.492456] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.492485] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.492] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.492536] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.492565] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.494778] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.494780] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.494911] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.495151] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.495152] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.495561] PCI host bridge to bus 0000:00 [ 1.495562] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.495564] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.495565] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.495566] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.495567] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.495568] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.495568] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.495588] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.495688] pci 0000:00:01.0: [8086:6f02] type 01 cass 0x060400 PCIe Root Port [ 1.495699] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.495734] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.495823] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.495835] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.495837] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.495870] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.495956] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.495967] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.495969] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.495971] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.495975] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.496004] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.496085] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496093] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.496168] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496176] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.496250] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496257] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.496329] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496336] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.496410] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496417] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.496491] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496498] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.496570] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496577] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.496651] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496658] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.496729] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496790] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496871] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496926] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.496932] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.497012] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.497250] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 conventional PCI endpoint [ 1.497270] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.497281] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.497293] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.497304] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.497315] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.497326] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.497386] pci 0000:00:11.4: PME# supported from D3hot [ 1.497466] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.497489] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.497576] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.497662] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.497686] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.497774] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.497840] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.497864] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.497951] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.498036] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 conventional PCI endpoint [ 1.498058] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.498172] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.498253] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.498289] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.498380] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.498482] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.498520] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.498526] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.498529] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.498617] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.498715] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.498755] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.498760] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.498indow [mem 0xfb1pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.498955] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.498975] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.499090] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.499170] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.499376] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.499394] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.499404] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.499415] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.499427] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.499436] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.499447] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.499499] pci 0000:00:1f.2: P 1.499560] pci 00 class 0x0c05 1.499583] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.499613] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.499774] acpiphp: Slot [1] registered [ 1.499786] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.499889] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.499898] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.499914] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.499918] pci 0000:02:00.0: enabling Extended Tags [ 1.500019] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.500125] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.500135] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.500140] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.500150] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.500154] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.500190] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.AR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.500207] pci 0000:03:00.0: VFem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.500216] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.500217] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.500369] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.500379] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.500384] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.500394] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.500398] pci 0000:03:em 0xfb200000-0xfb27ffff pref] [ 1.500435] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.500449] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.500450] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.500459] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.500460] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.500596] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.500640] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.500733] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.500804] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.500817] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.500823] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.500876] pci 0000:05:00.0: enabling Extended Tags [ 1.500998] pci 0000:05:00.0: supports D1 D2 [ 1.500998] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.501132] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.501220] pci_bus 0000:06: extended config space not accessible [ 1.501253] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.501289] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.501309] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.501329] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.501427] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.501498] pci 0000:06:00.0: supports D1 D2 [ 1.501498] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.501650] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.501796] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.501829] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.501866] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.501884] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.502109] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.502169] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.502170] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.502203] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.502204] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.502537] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.502570] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.502606] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.502625] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.502839] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.502898] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.502899] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.502934] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.502935] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.503227] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.503239] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.503920] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.503950] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.503978] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.504006] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.504034] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.504035] ACPI: PCI: Interrupt link LNKE disabled [ 1.504063] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.504063] ACPI: PCI: Interrupt link LNKF disabled [ 1.504093] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.504093] ACPI: PCI: Interrupt link LNKG disabled [ 1.504123] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.504123] ACPI: PCI: Interrupt link LNKH disabled [ 1.504443] iommu: Default domain type: Translated [ 1.504443] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.504496] SCSI subsystem initialized [ 1.504510] ACPI: bus type USB registered [ 1.504522] usbcore: registered new interface driver usbfs [ 1.504527] usbcore: registered new interface driver hub [ 1.504532] usbcore: registered new device driver usb [ 1.504549] pps_core: LinuxPPS API ver. 1 registered [ 1.504549] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.504549] PTP clock support registered [ 1.504549] EDAC MC: Ver: 3.0.0 [ 1.504586] NetLabel: Initializing [ 1.504586] NetLabel: domain hash size = 128 [ 1.504587] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.504599] NetLabel: unlabeled traffic allowed by default [ 1.504600] PCI: Using ACPI for IRQ routing [ 1.515489] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.515489] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.515489] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.515489] vgaarb: loaded [ 1.515489] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.515489] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.520283] clocksource: Switched to clocksource tsc-early [ 1.528214] VFS: Disk quotas dquot_6.6.0 [ 1.528224] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.528272] pnp: PnP ACPI init [ 1.528598] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.528602] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.528604] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.528606] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.528608] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.528608] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.528610] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.528611] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.528612] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.528613] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.528614] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.528614] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.528615] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.528759] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.528761] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.528763] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.528764] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.528764] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.529437] pnp: PnP ACPI: found 5 devices [ 1.534811] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.534850] NET: Registered PF_INET protocol family [ 1.535018] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.537280] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.537309] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.537320] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.537535] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.537645] TCP: Hash tables configured (established 262144 bind 65536) [ 1.537760] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.537844] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.537898] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.537977] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.537981] NET: Registered PF_XDP protocol family [ 1.538001] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.538010] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.538012] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.538017] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.538019] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.538025] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.538026] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.538027] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.538028] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.538029] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.538030] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.538031] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.538032] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.538034] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.538034] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.538036] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.538036] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.538037] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.538038] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.538039] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.538040] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.538041] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.538042] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.538044] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.538046] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.538049] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.538062] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.538065] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.538073] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.538089] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.538090] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.538096] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.538105] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.538111] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.538119] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.538124] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.538131] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.538133] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.538138] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.538141] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.538147] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.538148] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.538149] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.538150] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.538151] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.538152] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.538152] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.538153] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.538154] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.538155] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.538156] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.538157] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.538157] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.538158] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.538159] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.538160] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.538160] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.538161] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.538319] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.555471] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 16590 usecs [ 1.567485] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 11715 usecs [ 1.567497] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.567530] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.567531] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.567536] ACPI: bus type thunderbolt registered [ 1.567538] Trying to unpack rootfs image as initramfs... [ 1.646904] Initialise system trusted keyrings [ 1.646913] Key type blacklist registered [ 1.646963] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.648291] zbud: loaded [ 1.722023] integrity: Platform Keyring initialized [ 1.722027] integrity: Machine keyring initialized [ 1.730000] NET: Registered PF_ALG protocol family [ 1.730003] xor: automatically using best checksumming function avx [ 1.730004] Key type asymmetric registered [ 1.730005] Asymmetric key parser 'x509' registered [ 1.730005] Running certificate verification selftests [ 1.732313] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.732787] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.732816] io scheduler mq-deadline registered [ 1.732817] io scheduler kyber registered [ 1.732843] io scheduler bfq registered [ 1.768635] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.768977] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.769138] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.769279] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.769408] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.769570] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.769714] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.769870] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.769946] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 1.785483] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.785504] ACPI: button: Power Button [PWRB] [ 1.785526] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.785561] ACPI: button: Power Button [PWRF] [ 1.822663] ERST: Error Record Serialization Table (ERST) support is initialized. [ 1.822666] pstore: Registered erst as persistent store backend [ 1.822792] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 1.822875] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 1.830593] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 1.839197] Non-volatile memory driver v1.3 [ 1.847210] rdac: device handler registered [ 1.847244] hp_sw: device handler registered [ 1.847245] emc: device handler registered [ 1.847269] alua: device handler registered [ 1.847626] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 1.847675] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 1.847691] ehci-pci 0000:00:1a.0: debug port 2 [ 1.851613] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 1.858460] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 1.858490] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.858492] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.858493] usb usb1: Product: EHCI Host Controller [ 1.858494] usb usb1: Manufacturer: Linux 5.14.0-437.el9.x86_64 ehci_hcd [ 1.858494] usb usb1: SerialNumber: 0000:00:1a.0 [ 1.858576] hub 1-0:1.0: USB hub found [ 1.858580] hub 1-0:1.0: 2 ports detected [ 1.858684] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.858716] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 1.859804] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 1.859999] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 1.860022] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.860038] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 3 [ 1.860046] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 1.860050] ehci-pci 0000:00:1d.0: debug port 2 [ 1.860051] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 1.860092] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.860094] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.860095] usb usb2: Product: xHCI Host Controller [ 1.860096] usb usb2: Manufacturer: Linux 5.14.0-437.el9.x86_64 xhci-hcd [ 1.860097] usb usb2: SerialNumber: 0000:00:14.0 [ 1.860211] hub 2-0:1.0: USB hub found [ 1.860245] hub 2-0:1.0: 15 ports detected [ 1.863494] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 1.863496] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.863497] usb usb4: Product: xHCI Host Controller [ 1.863498] usb usb4: Manufacturer: Linux 5.14.0-437.el9.x86_64 xhci-hcd [ 1.863499] usb usb4: SerialNumber: 0000:00:14.0 [ 1.863611] hub 4-0:1.0: USB hub found [ 1.863632] hub 4-0:1.0: 6 ports detected [ 1.863959] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 1.865786] usbcore: registered new interface driver usbserial_generic [ 1.865792] usbserial: USB Serial support registered for generic [ 1.865827] i8042: PNP: No PS/2 controller found. [ 1.865881] mousedev: PS/2 mouse device common for all mice [ 1.865961] rtc_cmos 00:00: RTC can wake from S4 [ 1.866274] rtc_cmos 00:00: registered as rtc0 [ 1.866321] rtc_cmos 00:00: setting system clock to 2024-04-26T10:45:08 UTC (1714128308) [ 1.866350] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 1.870459] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 1.870505] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.870507] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.870508] usb usb3: Product: EHCI Host Controller [ 1.870509] usb usb3: Manufacturer: Linux 5.14.0-437.el9.x86_64 ehci_hcd [ 1.870509] usb usb3: SerialNumber: 0000:00:1d.0 [ 1.870590] hub 3-0:1.0: USB hub found [ 1.870593] hub 3-0:1.0: 2 ports detected [ 1.883300] intel_pstate: Intel P-state driver initializing [ 1.887227] Freeing initrd memory: 33136K [ 1.959484] hid: raw HID events driver (C) Jiri Kosina [ 1.959523] usbcore: registered new interface driver usbhid [ 1.959524] usbhid: USB HID core driver [ 1.959569] drop_monitor: Initializing network drop monitor service [ 1.968401] Initializing XFRM netlink socket [ 1.968496] NET: Registered PF_INET6 protocol family [ 1.972926] Segment Routing with IPv6 [ 1.972942] NET: Registered PF_PACKET protocol family [ 1.972964] mpls_gso: MPLS GSO support [ 1.983539] microcode: Current revision: 0x0b000010 [ 2.000137] resctrl: L3 allocation detected [ 2.000138] resctrl: L3 monitoring detected [ 2.000152] IPI shorthand broadcast: enabled [ 2.000156] AVX2 version of gcm_enc/dec engaged. [ 2.055950] AES CTR mode by8 optimization enabled [ 2.056018] sched_clock: Marking stable (928272416, 1127703324)->(2639835370, -583859630) [ 2.066952] registered taskstats version 1 [ 2.081257] Loading compiled-in X.509 certificates [ 2.081812] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: ac928bd9444a4e48f0eddf90defda693df54cc67' [ 2.082077] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.082336] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.082493] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.082503] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.082665] zswap: loaded using pool lzo/zbud [ 2.096136] page_owner is disabled [ 2.096307] pstore: Using crash dump compression: deflate [ 2.096317] Key type big_key registered [ 2.097460] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.107462] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.110461] usb 3-1: new high-speed USB device number 2 using ehci-pci [ 2.169368] Key type encrypted registered [ 2.169374] ima: No TPM chip found, activating TPM-bypass! [ 2.169376] Loading compiled-in module X.509 certificates [ 2.169666] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: ac928bd9444a4e48f0eddf90defda693df54cc67' [ 2.169668] ima: Allocated hash algorithm: sha256 [ 2.169676] ima: No architecture policies found [ 2.169683] evm: Initialising EVM extended attributes: [ 2.169684] evm: security.selinux [ 2.169684] evm: security.SMACK64 (disabled) [ 2.169685] evm: security.SMACK64EXEC (disabled) [ 2.169685] evm: security.SMACK64TRANSMUTE (disabled) [ 2.169686] evm: security.SMACK64MMAP (disabled) [ 2.169686] evm: security.apparmor (disabled) [ 2.169686] evm: security.ima [ 2.169687] evm: security.capability [ 2.169687] evm: HMAC attrs: 0x1 [ 2.238817] usb 3-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.238819] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.238974] hub 3-1:1.0: USB hub found [ 2.239065] hub 3-1:1.0: 8 ports detected [ 2.262172] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.262174] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.271535] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.271537] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.278019] hub 1-1:1.0: USB hub found [ 2.287324] hub 1-1:1.0: 6 ports detected [ 2.334704] hub 2-12:1.0: USB hub found [ 2.344099] hub 2-12:1.0: 4 ports detected [ 2.572452] tsc: Refined TSC clocksource calibration: 3499.993 MHz [ 2.572456] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734a05315, max_idle_ns: 440795202126 ns [ 2.573856] clocksource: Switched to clocksource tsc [ 2.657450] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 2.761822] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 2.761825] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.766764] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 2.818535] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 2.821192] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 2.821237] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.037562] Freeing unused decrypted memory: 2028K [ 5.038054] Freeing unused kernel image (initmem) memory: 3928K [ 5.038091] Write protecting the kernel read-only data: 28672k [ 5.038263] Freeing unused kernel image (rodata/data gap) memory: 500K [ 5.078016] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.078017] x86/mm: Checking user space page tables [ 5.116198] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.116209] Run /init as init process Welcome to [0[ 5.127180] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.127276] systemd[1]: Detected architecture x86-64. [ 5.127278] systemd[1]: Running in initrd. ;31mCentOS Stream 9 dracut-057-53.git20240104.el9 (Initramfs)! [ 5.178532] systemd[1]: Hostname set to . [ 5.234301] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.234407] systemd[1]: Reached target Initrd /usr File System. [ OK ] Reached target Initrd /usr File System. [ OK [[ 5.256599] systemd[1]: Reached target Local File Systems. 0m] Reached target Local File Systems. [ OK [[ 5.270549] systemd[1]: Reached target Slice Units. 0m] Reached target Slice Units. [ OK [[ 5.282540] systemd[1]: Reached target Swaps. 0m] Reached target Swaps. [ OK [[ 5.293494] systemd[1]: Reached target Timer Units. 0m] Reached target Timer Units. [ OK [[ 5.305571] systemd[1]: Listening on D-Bus System Message Bus Socket. 0m] Listening on D-Bus System Message Bus Socket. [ OK [[ 5.320572] systemd[1]: Listening on Journal Socket (/dev/log). 0m] Listening on Journal Socket (/dev/log). [ OK [[ 5.334660] systemd[1]: Listening on Journal Socket. 0m] Listening on Journal Socket. [ OK [[ 5.346588] systemd[1]: Listening on udev Control Socket. 0m] Listening on udev Control Socket. [ OK [[ 5.360630] systemd[1]: Listening on udev Kernel Socket. 0m] Listening on udev Kernel Socket. [ OK [[ 5.374559] systemd[1]: Reached target Socket Units. 0m] Reached target Socket Units. Startin[ 5.393236] systemd[1]: Starting Create List of Static Device Nodes... g Create List of Static Device Nodes... Startin[ 5.408701] systemd[1]: Starting Journal Service... g Journal Service... Startin[ 5.420607] systemd[1]: Load Kernel Modules was skipped because no trigger condition checks were met. [ 5.421323] systemd[1]: Starting Apply Kernel Variables... g Apply Kernel Variables... Startin[ 5.443189] systemd[1]: Starting Create System Users... g Create System Users... Startin[ 5.456070] systemd[1]: Starting Setup Virtual Console... g Setup Virtual Console... [ OK [[ 5.469326] systemd[1]: Started Journal Service. 0m] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut cmdline hook... [ OK ] Finished dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. [ 5.864078] dca service started, version 1.12.1 Starting dracut initqueue hook... Starting Show Plymouth Boot Screen... [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password R…s to Plymouth Directory Watch. [ OK ] Reached target Path Units.[ 5.916418] igb: Intel(R) Gigabit Ethernet Network Driver [ OK [ 5.916420] igb: Copyright (c) 2007-2014 Intel Corporation. ] Reached t[ 5.916541] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver arget B[ 5.916543] ixgbe: Copyright (c) 1999-2016 Intel Corporation. asic System. [ 5.966922] nvme nvme0: pci function 0000:02:00.0 [ 5.967125] ACPI: bus type drm_connector registered [ 5.969097] nvme nvme0: 8/0/0 default/read/poll queues [ 5.982483] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 5.982485] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.991046] igb 0000:07:00.0: added PHC on eth0 [ 5.991073] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.991074] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:fc [ 5.991150] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.991151] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.994658] scsi host0: ahci [ 5.994772] scsi host1: ahci [ 5.994894] scsi host2: ahci [ 5.995010] scsi host3: ahci [ 5.995042] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 53 lpm-pol 0 [ 5.995046] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 53 lpm-pol 0 [ 5.995048] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 53 lpm-pol 0 [ 5.995050] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 53 lpm-pol 0 [ 5.995323] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.995326] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.010767] scsi host4: ahci [ 6.010860] scsi host5: ahci [ 6.010984] scsi host6: ahci [ 6.011100] scsi host7: ahci [ 6.011194] scsi host8: ahci [ 6.011305] scsi host9: ahci [ 6.011351] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 63 lpm-pol 0 [ 6.011355] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 63 lpm-pol 0 [ 6.011358] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 63 lpm-pol 0 [ 6.011360] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 63 lpm-pol 0 [ 6.011361] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 63 lpm-pol 0 [ 6.011364] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 63 lpm-pol 0 [ 6.013135] ast 0000:06:00.0: vgaarb: deactivate onsole: switching to colour dummy device 80x25 [ 6.025898] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 6.025899] ast 0000:06:00.0: [drm] AST 2400 detected [ 6.025909] ast 0000:06:00.0: [drm] Using analog VGA [ 6.025914] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.026085] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.038534] fbcon: astdrmfb (fb0) is primary device [ 6.053321] igb 0000:07:00.1: added PHC on eth1 [ 6.053524] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.053525] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:fd [ 6.053668] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.053670] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.056951] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.063349] Console: switching to colour frame buffer device 128x48 [ 6.064982] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.081584] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 6.305896] ata1: SATA link down (SStatus 0 SControl 300) [ 6.305956] ata3: SATA link down (SStatus 0 SControl 300) [ 6.306847] ata4: SATA link down (SStatus 0 SControl 300) [ 6.310557] ata2: SATA link down (SStatus 0 [ 6.321850] 0 Gbps (SStatus [ 6.321874] ata6: SATA link down (SStatus 0 SControl 300) [ 6.321896] ata9: SATA link down (SStatus 0 SControl 300) [ 6.321919] ata7: SATA link down (SStatus 0 SControl 300) [ 6.323101] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.323594] ata5.00: NCQ Send/Recv Log not supported [ 6.323595] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.324962] ata5.00: NCQ Send/Recv Log not supported [ 6.324966] ata5.00: configured for UDMA/133 [ 6.325078] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.325625] ata10: SATA link down (SStatus 0 SControl 300) [ 6.326549] ata8: SATA link down (SStatus 0 SControl 300) [ 6.400446] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.463166] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.463177] sd 4:0:0:0: [sda] Write Protect is off [ 6.463192] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.463209] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.475871] sda: sda1 [ 6.475954] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.049736] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.050024] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.050107] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.050108] ixgbe 0000:03:00.0: 0c:c4:7a:8f:d5:f4 [ 7.053154] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.201658] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.201945] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.202026] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.202028] ixgbe 0000:03:00.1: 0c:c4:7a:8f:d5:f5 [ 7.205010] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.221750] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 7.246388] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check…6d2c-4093-809e-dd42758f0c27... [ OK ] Finished File System Check…5-6d2c-4093-809e-dd42758f0c27. Mounting /sysroot... [ 7.492099] EXT4-fs (sda1): mounted filesystem a494b625-6d2c-4093-809e-dd42758f0c27 ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manage…for Device Events and Files... [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. Starting Switch Root... [ 7.839810] systemd-journald[280]: Received SIGTERM from PID 1 (systemd). [ 8.367303] SELinux: policy capability network_peer_controls=1 [ 8.367306] SELinux: policy capability open_perms=1 [ 8.367306] SELinux: policy capability extended_socket_class=1 [ 8.367307] SELinux: policy capability always_check_network=0 [ 8.367307] SELinux: policy capability cgroup_seclabel=1 [ 8.367308] SELinux: policy capability nnp_nosuid_transition=1 [ 8.367308] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.409558] audit: type=1403 audit(1714128315.042:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.412289] systemd[1]: Successfully loaded SELinux policy in 114.993ms. [ 8.480694] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 25.676ms. [ 8.489241] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.489347] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 8.529101] systemd[1]: Hostname set to . [ OK [[ 9.441473] systemd[1]: initrd-switch-root.service: Deactivated successfully. 0m] Stopped [0;[ 9.441572] systemd[1]: Stopped Switch Root. [ 9.441980] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.442277] systemd[1]: Created slice Slice /system/getty. [ 9.442597] systemd[1]: Created slice Slice /system/modprobe. [ 9.450658] systemd[1]: Created slice Slice /system/serial-getty. 1;39mSwitch Root[ 9.482508] systemd[1]: Created slice Slice /system/sshd-keygen. [ 9.482763] systemd[1]: Created slice User and Session Slice. . [[ 9.482792] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.482892] systemd[1]: Started Forward Password Requests to Wall Directory Watch. OK ] Crea[ 9.483244] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ 9.483308] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.483332] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.483348] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ 9.483363] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.483378] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.483393] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.483411] systemd[1]: Reached target Local Encrypted Volumes. [ 9.483443] systemd[1]: Stopped target Switch Root. [ 9.495450] systemd[1]: Stopped target Initrd File Systems. ted slice [0;1;[ 9.511726] systemd[1]: Stopped target Initrd Root File System. [ 9.609382] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.609433] systemd[1]: Reached target Path Units. [ 9.616646] systemd[1]: Reached target Slice Units. [ 9.623420] systemd[1]: Reached target Swaps. [ 9.628201] systemd[1]: Reached target Local Verity Protected Volumes. 39mSlice /system[ 9.644295] systemd[1]: Listening on Device-mapper event daemon FIFOs. /getty. [[ 9.652115] systemd[1]: Listening on LVM2 poll daemon socket. [0;32m OK ] Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/[ 9.668845] systemd[1]: Listening on RPCbind Server Activation Socket. [ 9.668903] systemd[1]: Reached target RPC Port Mapper. [ 9.670182] systemd[1]: Listening on Process Core Dump Socket. serial-getty[ 9.687749] systemd[1]: Listening on initctl Compatibility Named Pipe. [ 9.688178] systemd[1]: Listening on udev Control Socket. [ 9.688413] systemd[1]: Listening on udev Kernel Socket. [ 9.689211] systemd[1]: Mounting Huge Pages File System... [ 9.696278] systemd[1]: Mounting POSIX Message Queue File System... . [ OK ] Created [ 9.718831] systemd[1]: Mounting Kernel Debug File System... [ 9.719624] systemd[1]: Mounting Kernel Trace File System... slice S[ 9.726555] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). lice /system/sshd-keygen. [ OK ] Created slice User and Session Slice. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ OK ] Set [ 9.764702] systemd[1]: Starting Create List of Static Device Nodes... [ 9.765511] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 9.773446] systemd[1]: Starting Load Kernel Module configfs... up automount Arbitrary\xe2[ 9.789555] systemd[1]: Starting Load Kernel Module drm... [ 9.790304] systemd[1]: Starting Load Kernel Module fuse... [ 9.792938] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... [ 9.797117] systemd[1]: plymouth-switch-root.service: Deactivated successfully. [ 9.797161] systemd[1]: Stopped Plymouth switch root service. \x80\xa6s File System [ 9.824153] systemd[1]: Stopped Journal Service. Automount Point. [ [ 9.830618] systemd[1]: Starting Journal Service... [ 9.833216] systemd[1]: Starting Load Kernel Modules... OK ] Reached target [0;1;[ 9.843650] systemd[1]: Starting Generate network units from Kernel command line... 39mceph target\xe2\x80[ 9.843695] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). \xa6on@.service ins[ 9.844467] systemd[1]: Starting Remount Root and Kernel File Systems... tances at once[[ 9.853379] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. 0m. [ [ 9.854382] systemd[1]: Starting Coldplug All udev Devices... [ 9.874564] systemd[1]: Mounted Huge Pages File System. [ 9.881454] systemd[1]: Mounted POSIX Message Queue File System. OK ] Reache[ 9.892225] systemd[1]: Mounted Kernel Debug File System. [ 9.897842] EXT4-fs (sda1): re-mounted a494b625-6d2c-4093-809e-dd42758f0c27 r/w. Quota mode: none. d target [0;1;3[ 9.911095] systemd[1]: Mounted Kernel Trace File System. 9mceph target…ds@.service inst[ 9.933591] systemd[1]: Finished Create List of Static Device Nodes. [ 9.934004] systemd[1]: modprobe@configfs.service: Deactivated successfully. ances at once[0[ 9.934139] systemd[1]: Finished Load Kernel Module configfs. [ 9.934453] systemd[1]: modprobe@drm.service: Deactivated successfully. m. [ O[ 9.934589] systemd[1]: Finished Load Kernel Module drm. [ 9.949302] systemd[1]: Started Journal Service. K ] Reached target [0;1;39[ 9.975839] fuse: init (API version 7.36) mceph target…gr@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ OK ] Reached t[ 9.995028] systemd-journald[575]: Received client request to flush runtime journal. arget ceph target…gw@.service instances at once. [ OK ] Reached target ceph target…or@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ 10.053597] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.053625] device-mapper: uevent: version 1.0.3 [ 10.053745] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM…meventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS …from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network …ts from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Started Journal Service. [ OK ] Finished Read and set NIS …e from /etc/sysconfig/network. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Reached target Preparation for Network. Mounting Kernel Configuration File System... Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Create Static Device Nodes in /dev... [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Modules. [ OK ] Mounted Kernel Configuration File System. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Automatic Boot Loader Update. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ 12.646357] IPMI message handler: version 39.2 [ 12.655941] ipmi device interface [ 12.661791] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 12.662344] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 12.663337] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 12.663340] i2c i2c-3: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 12.692625] power_meter ACPI000D:00: Found ACPI power meter. [ 12.692650] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 12.692655] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ 12.719115] ipmi_si: IPMI System Interface driver [ 12.719132] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 12.719134] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 12.719136] ipmi_si: Adding SMBIOS-specified kcs state machine [ 12.719183] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 12.719253] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 12.719938] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 12.719940] ipmi_si: Adding ACPI-specified kcs state machine [ 12.720148] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 12.784118] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 12.789437] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 12.800973] igb 0000:07:00.0: DCA enabled [ 12.800990] igb 0000:07:00.1: DCA enabled [ 12.811414] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 12.828184] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 12.828187] RAPL PMU: hw unit of domain package 2^-14 Joules [ 12.828188] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 12.835459] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ OK ] Started /usr/sbin/lvm vgch…-autoactivation event vg_nvme. [ 12.888077] iTCO_vendor_support: vendor-support=0 [ OK ] Finished Create Volatile Files and Directories. [ 12.905772] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) Mountin[ 12.906032] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) g RPC Pipe File System... Starting Security Auditing Service... Starting RPC Bind... [ OK ] Found device /dev/v[ 12.983033] ipmi_si IPI0001:00: IPMI kcs interface initialized g_nvme/lv_5. Mounting /var/lib/ceph... [ 13.010454] ipmi_ssif: IPMI SSIF Interface driver [ 13.078896] RPC: Registered named UNIX socket transport module. [ 13.078898] RPC: Registered udp transport module. [ 13.078899] RPC: Registered tcp transport module. [ 13.078899] RPC: Registered tcp-with-tls transport module. [ 13.078900] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 13.347678] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 13.356771] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported after September 2030. [ OK [[ 13.356854] XFS (dm-4): Mounting V4 Filesystem f941b536-76b7-4f0d-a37c-bcf80f3a6728 0m] Mounted [0;[ 13.361158] XFS (dm-4): Ending clean mount [ 13.361196] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) 1;39m/var/lib/ce[ 13.390319] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) ph. [ 13.390320] EDAC sbridge: Ver: 1.1.2 [ 13.425582] intel_rapl_common: Found RAPL domain package [ 13.425588] intel_rapl_common: Found RAPL domain dram [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activit…ounting tool every 10 minutes. [ OK ] Started Generate summary o…esterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos…ache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring a…g Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Started User Login Management. [ OK ] Finished Resets System Activity Logs. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started NTP client/server. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 15.156988] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 15.306624] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... [ 15.536593] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [ 15.725516] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 15.725623] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [* ] A start job is running for Network Manager Wait Online (8s / no limit) M [** ] A start job is running for Network Manager Wait Online (9s / no limit) M [*** ] A start job is running for Network Manager Wait Online (9s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ ***] A start job is running for Network …nager Wait Online (11s / no limit) M [ **] A start job is running for Network …nager Wait Online (12s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.87 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. [ 22.825583] block sda: the capability attribute has been deprecated. + '[' 172.21.15.87 '!=' '' ']' + set -e + '[' -n 172.21.15.87 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.87 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.87 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' Starting SETroubleshoot da…ing new SELinux denial logs... + newhostname=smithi087.front.sepia.ceph.com + '[' -n smithi087.front.sepia.ceph.com ']' + hostname smithi087.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi087 + echo smithi087 + grep -q front.sepia.ceph.com /etc/hosts + sed -i '1i172.21.15.87 smithi087.front.sepia.ceph.com smithi087\' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-437.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T10:45:36.262 DEBUG:teuthology.orchestra.console.smithi087:expect after: smithi087 login: 2024-04-26T10:45:36.315 DEBUG:teuthology.orchestra.console.smithi087:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el( t XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F D5 F5 GUID: 00000000 0000 0000 0000 0CC47AD8DAFC DHCP.-                    DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- CLIENT IP: 172.21.15.87 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:d5:f5)... Configuring (net0 0c:c4:7a:8f:d5:f5).... Configuring (net0 0c:c4:7a:8f:d5:f5)..... Configuring (net0 0c:c4:7a:8f:d5:f5)...... ok [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-437.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9               The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-437.el9.x86_64) 9   CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-7fc8828e06d0482694bcf4a447d13cb6) 9            The selected entry will be started automatically in 4s.   Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h      [ 0.000000] Linux version 5.14.0-437.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.4.1 20231218 (Red Hat 11.4.1-3), GNU ld version 2.35.2-43.el9) #1 SMP PREEMPT_DYNAMIC Tue Apr 9 12:57:02 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820000000000-0x000e [ 0.000000 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ea3fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f56000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.655 MHz processor [ 0.000407] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000411] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000413] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000743] last_pfn = 0x78ea4 max_arch_pfn = 0x400000000 [ 0.006539] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.006548] Using GB pages for direct mapping [ 0.006696] RAMDISK: [mem 0x33f38000-0x35f93fff] [ 0.006699] ACPI: Early table checksum verification disabled [ 0.006701] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.006704] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.006709] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006713] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006716] ACPI: FACS 0x0000000079D49F80 000040 [ 0.006718] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006720] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006722] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006725] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006727] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006729] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006732] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006734] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006736] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006738] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006741] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006743] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006745] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006748] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006750] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006752] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006754] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006756] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.006757] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.006758] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.006759] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.006759] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.006760] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.006761] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.006761] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.006762] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.006762] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.006763] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.006764] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.006764] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.006765] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.006765] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.006766] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.006767] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.006767] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.006768] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.006768] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.006813] No NUMA configuration found [ 0.006814] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006822] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.007017] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.007052] Zone ranges: [ 0.007052] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.007054] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.007055] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.007056] Device empty [ 0.007057] Movable zone start for each node [ 0.007059] Early memory node ranges [ 0.007059] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.007060] node 0: [mem 0x0000000000100000-0x0000000078ea3fff] [ 0.007061] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.007065] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.007069] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.007105] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.011905] On node 0, zone Normal: 29020 pages in unavailable ranges [ 0.012016] ACPI: PM-Timer IO Port: 0x408 [ 0.012023] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.012025] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.012025] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.012026] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.012026] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.012027] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.012027] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.012028] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.012037] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.012041] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.012043] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.012044] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.012048] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.012049] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.012052] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.012053] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.012063] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.012064] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.012065] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.012066] PM: hibernation: Registered nosave memory: [mem 0x78ea4000-0x78f55fff] [ 0.012066] PM: hibernation: Registered nosave memory: [mem 0x78f56000-0x798adfff] [ 0.012067] PM: hibernation: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.012068] PM: hibernation: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.012068] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.012069] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.012069] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.012070] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.012071] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.012072] Booting paravirtualized kernel on bare hardware [ 0.012074] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016403] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016621] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.016646] Fallback order for Node 0: 0 [ 0.016648] Built 1 zonelists, mobility grouping on. Total pages: 8228713 [ 0.016649] Policy zone: Normal [ 0.016650] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64 root=UUID=a494b625-6d2c-4093-809e-dd42758f0c27 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016706] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-437.el9.x86_64", will be passed to user space. [ 0.016722] random: crng init done [ 0.018887] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.020017] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020260] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020267] software IO TLB: area num 8. [ 0.047416] Memory: 1750044K/33437880K available (16384K kernel code, 5628K rwdata, 11788K rodata, 3928K init, 5908K bss, 989180K reserved, 0K cma-reserved) [ 0.047516] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.047524] Kernel/User page tables isolation: enabled [ 0.047546] ftrace: allocating 46993 entries in 184 pages [ 0.065773] ftrace: allocated 184 pages with 4 groups [ 0.066279] Dynamic Preempt: voluntary [ 0.066308] rcu: Preemptible hierarchical RCU implementation. [ 0.066308] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.066310] Trampoline variant of Tasks RCU enabled. [ 0.066310] Rude variant of Tasks RCU enabled. [ 0.066310] Tracing variant of Tasks RCU enabled. [ 0.066311] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.066311] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.069533] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.069695] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.069801] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.075029] Console: colour VGA+ 80x25 [ 1.096493] printk: console [ttyS1] enabled [ 1.100683] ACPI: Core revision 20230331 [ 1.104777] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.113907] APIC: Switch to symmetric I/O mode setup [ 1.118877] DMAR: Host address width 46 [ 1.122720] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.128037] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.136040] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.142308] DMAR: ATSR flags: 0x0 [ 1.145627] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.151894] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.158247] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.164601] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.170002] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.170003] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.185020] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.190330] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.196552] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.206916] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32720b4660d, max_idle_ns: 440795375244 ns [ 1.217427] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.31 BogoMIPS (lpj=3499655) [ 1.218445] CPU0: Thermal monitoring enabled (TM1) [ 1.219480] process: using mwait in idle threads [ 1.220428] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.221427] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.222428] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.223427] Spectre V2 : Mitigation: Retpolines [ 1.224427] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.225427] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.226427] Speculative Store Bypass: Vulnerable [ 1.227432] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.228427] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.229427] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.230429] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.231427] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.232427] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.233427] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.234427] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.246849] Freeing SMP alternatives memory: 36K [ 1.247427] pid_max: default: 32768 minimum: 301 [ 1.248445] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.249431] Yama: becoming mindful. [ 1.250430] SELinux: Initializing. [ 1.251442] LSM support for eBPF active [ 1.252484] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.253465] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.357256] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.358523] cblist_init_generic: Setting adjustable number of callback queues. [ 1.359427] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.360438] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.361436] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.362435] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.363427] ... version: 3 [ 1.364426] ... bit width: 48 [ 1.365426] ... generic registers: 4 [ 1.366426] ... value mask: 0000ffffffffffff [ 1.367426] ... max period: 00007fffffffffff [ 1.368426] ... fixed-purpose events: 3 [ 1.369427] ... event mask: 000000070000000f [ 1.370510] signal: max sigframe size: 1776 [ 1.371437] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.372452] rcu: Hierarchical SRCU implementation. [ 1.372452] rcu: Max phase no-delay instances is 400. [ 1.372460] printk: console [ttyS1] printing thread started [ 1.377038] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.377104] smp: Bringing up secondary CPUs ... [ 1.377171] smpboot: x86: Booting SMP configuration: [ 1.377171] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.383683] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.383683] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.383683] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.383683] smp: Brought up 1 node, 8 CPUs [ 1.383683] smpboot: Max logical packages: 1 [ 1.383683] smpboot: Total of 8 processors activated (55994.48 BogoMIPS) [ 1.424719] node 0 deferred pages initialised in 36ms [ 1.425601] devtmpfs: initialized [ 1.425601] x86/mm: Memory block size: 128MB [ 1.426374] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 1.426374] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.426374] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.426374] pinctrl core: initialized pinctrl subsystem [ 1.429426] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.429426] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.429426] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.429426] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.429426] audit: initializing netlink subsys (disabled) [ 1.429436] audit: type=2000 audit(1714128306.232:1): state=initialized audit_enabled=0 res=1 [ 1.429495] thermal_sys: Registered thermal governor 'fair_share' [ 1.429496] thermal_sys: Registered thermal governor 'step_wise' [ 1.429497] thermal_sys: Registered thermal governor 'user_space' [ 1.430429] cpuidle: using governor menu [ 1.431445] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.431446] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.431491] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.431494] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.431502] PCI: Using configuration type 1 for base access [ 1.434455] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.434458] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.434458] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.434458] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.434458] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.435454] cryptd: max_cpu_qlen set to 1000 [ 1.453426] ACPI: Added _OSI(Module Device) [ 1.453426] ACPI: Added _OSI(Processor Device) [ 1.453426] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.453426] ACPI: Added _OSI(Processor Aggregator Device) [ 1.453426] ACPI: Added _OSI(Linux-Dell-Video) [ 1.453426] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.453426] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.458426] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.459426] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.459426] ACPI: Dynamic OEM Table Load: [ 1.461426] ACPI: _OSC evaluated successfully for all CPUs [ 1.461426] ACPI: Interpreter enabled [ 1.461426] ACPI: PM: (supports S0 S4 S5) [ 1.461426] ACPI: Using IOAPIC for interrupt routing [ 1.462425] HEST: Enabling Firmware First mode for corrected errors. [ 1.468426] HEST: Table parsing has been initialized. [ 1.468426] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.468426] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.468426] PCI: Using E820 reservations for host bridge windows [ 1.468821] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.489119] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.489124] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.490229] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.490761] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.490762] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.490789] PCI host bridge to bus 0000:ff [ 1.490790] pci_bus 0000:ff: root bus resource [bus ff] [ 1.490801] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.490842] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.490873] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.490901] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.490931] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.490960] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.490987] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.491015] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.491044] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.491071] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.491100] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.491127] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.491155] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.491183] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.491211] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.491239] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.491269] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.491296] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.491324] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.491343] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.491379] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.491435] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.491476] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.491516] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.491556] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.491597] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.491636] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.491666] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.491698] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.491738] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.491781] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.491821] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.491859] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.491889] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.491919] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.491948] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.491980] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.492021] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.492061] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.492101] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.492143] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.492177] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.492206] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.492239] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.492273] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.492303] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.492333] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.492363] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.492395] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.492424] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.492456] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.492485] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.492] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.492536] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.492565] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.494778] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.494780] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.494911] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.495151] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.495152] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.495561] PCI host bridge to bus 0000:00 [ 1.495562] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.495564] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.495565] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.495566] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.495567] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.495568] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.495568] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.495588] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.495688] pci 0000:00:01.0: [8086:6f02] type 01 cass 0x060400 PCIe Root Port [ 1.495699] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.495734] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.495823] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.495835] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.495837] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.495870] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.495956] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.495967] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.495969] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.495971] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.495975] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.496004] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.496085] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496093] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.496168] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496176] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.496250] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496257] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.496329] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496336] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.496410] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496417] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.496491] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496498] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.496570] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496577] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.496651] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496658] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.496729] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496790] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496871] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.496926] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.496932] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.497012] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.497250] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 conventional PCI endpoint [ 1.497270] pci 0000:00:11.4: BAR 0 [io 0xf110-0xf117] [ 1.497281] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.497293] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.497304] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.497315] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.497326] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.497386] pci 0000:00:11.4: PME# supported from D3hot [ 1.497466] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.497489] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.497576] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.497662] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.497686] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.497774] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.497840] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.497864] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.497951] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.498036] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 conventional PCI endpoint [ 1.498058] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.498172] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.498253] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.498289] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.498380] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.498482] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.498520] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.498526] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.498529] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.498617] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.498715] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.498755] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.498760] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.498indow [mem 0xfb1pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.498955] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.498975] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.499090] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.499170] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.499376] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.499394] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.499404] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.499415] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.499427] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.499436] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.499447] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.499499] pci 0000:00:1f.2: P 1.499560] pci 00 class 0x0c05 1.499583] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.499613] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.499774] acpiphp: Slot [1] registered [ 1.499786] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.499889] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.499898] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.499914] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.499918] pci 0000:02:00.0: enabling Extended Tags [ 1.500019] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.500125] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.500135] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.500140] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.500150] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.500154] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.500190] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.AR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.500207] pci 0000:03:00.0: VFem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.500216] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.500217] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.500369] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.500379] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.500384] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.500394] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.500398] pci 0000:03:em 0xfb200000-0xfb27ffff pref] [ 1.500435] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.500449] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.500450] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.500459] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.500460] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.500596] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.500640] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.500733] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.500804] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.500817] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.500823] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.500876] pci 0000:05:00.0: enabling Extended Tags [ 1.500998] pci 0000:05:00.0: supports D1 D2 [ 1.500998] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.501132] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.501220] pci_bus 0000:06: extended config space not accessible [ 1.501253] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.501289] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.501309] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.501329] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.501427] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.501498] pci 0000:06:00.0: supports D1 D2 [ 1.501498] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.501650] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.501796] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.501829] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.501866] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.501884] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.502109] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.502169] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.502170] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.502203] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.502204] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.502537] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.502570] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.502606] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.502625] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.502839] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.502898] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.502899] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.502934] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.502935] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.503227] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.503239] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.503920] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.503950] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.503978] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.504006] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.504034] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.504035] ACPI: PCI: Interrupt link LNKE disabled [ 1.504063] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.504063] ACPI: PCI: Interrupt link LNKF disabled [ 1.504093] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.504093] ACPI: PCI: Interrupt link LNKG disabled [ 1.504123] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.504123] ACPI: PCI: Interrupt link LNKH disabled [ 1.504443] iommu: Default domain type: Translated [ 1.504443] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.504496] SCSI subsystem initialized [ 1.504510] ACPI: bus type USB registered [ 1.504522] usbcore: registered new interface driver usbfs [ 1.504527] usbcore: registered new interface driver hub [ 1.504532] usbcore: registered new device driver usb [ 1.504549] pps_core: LinuxPPS API ver. 1 registered [ 1.504549] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.504549] PTP clock support registered [ 1.504549] EDAC MC: Ver: 3.0.0 [ 1.504586] NetLabel: Initializing [ 1.504586] NetLabel: domain hash size = 128 [ 1.504587] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.504599] NetLabel: unlabeled traffic allowed by default [ 1.504600] PCI: Using ACPI for IRQ routing [ 1.515489] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.515489] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.515489] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.515489] vgaarb: loaded [ 1.515489] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.515489] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.520283] clocksource: Switched to clocksource tsc-early [ 1.528214] VFS: Disk quotas dquot_6.6.0 [ 1.528224] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.528272] pnp: PnP ACPI init [ 1.528598] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.528602] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.528604] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.528606] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.528608] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.528608] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.528610] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.528611] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.528612] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.528613] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.528614] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.528614] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.528615] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.528759] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.528761] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.528763] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.528764] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.528764] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.529437] pnp: PnP ACPI: found 5 devices [ 1.534811] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.534850] NET: Registered PF_INET protocol family [ 1.535018] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.537280] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.537309] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.537320] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.537535] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.537645] TCP: Hash tables configured (established 262144 bind 65536) [ 1.537760] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.537844] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.537898] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.537977] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.537981] NET: Registered PF_XDP protocol family [ 1.538001] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.538010] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.538012] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.538017] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.538019] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.538025] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.538026] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.538027] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.538028] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.538029] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.538030] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.538031] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.538032] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.538034] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.538034] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.538036] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.538036] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.538037] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.538038] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.538039] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.538040] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.538041] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.538042] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.538044] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.538046] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.538049] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.538062] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.538065] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.538073] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.538089] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.538090] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.538096] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.538105] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.538111] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.538119] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.538124] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.538131] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.538133] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.538138] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.538141] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.538147] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.538148] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.538149] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.538150] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.538151] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.538152] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.538152] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.538153] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.538154] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.538155] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.538156] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.538157] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.538157] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.538158] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.538159] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.538160] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.538160] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.538161] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.538319] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.555471] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 16590 usecs [ 1.567485] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 11715 usecs [ 1.567497] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.567530] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.567531] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.567536] ACPI: bus type thunderbolt registered [ 1.567538] Trying to unpack rootfs image as initramfs... [ 1.646904] Initialise system trusted keyrings [ 1.646913] Key type blacklist registered [ 1.646963] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.648291] zbud: loaded [ 1.722023] integrity: Platform Keyring initialized [ 1.722027] integrity: Machine keyring initialized [ 1.730000] NET: Registered PF_ALG protocol family [ 1.730003] xor: automatically using best checksumming function avx [ 1.730004] Key type asymmetric registered [ 1.730005] Asymmetric key parser 'x509' registered [ 1.730005] Running certificate verification selftests [ 1.732313] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.732787] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.732816] io scheduler mq-deadline registered [ 1.732817] io scheduler kyber registered [ 1.732843] io scheduler bfq registered [ 1.768635] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.768977] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.769138] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.769279] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.769408] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.769570] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.769714] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.769870] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.769946] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 1.785483] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.785504] ACPI: button: Power Button [PWRB] [ 1.785526] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.785561] ACPI: button: Power Button [PWRF] [ 1.822663] ERST: Error Record Serialization Table (ERST) support is initialized. [ 1.822666] pstore: Registered erst as persistent store backend [ 1.822792] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 1.822875] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 1.830593] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 1.839197] Non-volatile memory driver v1.3 [ 1.847210] rdac: device handler registered [ 1.847244] hp_sw: device handler registered [ 1.847245] emc: device handler registered [ 1.847269] alua: device handler registered [ 1.847626] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 1.847675] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 1.847691] ehci-pci 0000:00:1a.0: debug port 2 [ 1.851613] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 1.858460] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 1.858490] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.858492] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.858493] usb usb1: Product: EHCI Host Controller [ 1.858494] usb usb1: Manufacturer: Linux 5.14.0-437.el9.x86_64 ehci_hcd [ 1.858494] usb usb1: SerialNumber: 0000:00:1a.0 [ 1.858576] hub 1-0:1.0: USB hub found [ 1.858580] hub 1-0:1.0: 2 ports detected [ 1.858684] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.858716] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 1.859804] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 1.859999] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 1.860022] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.860038] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 3 [ 1.860046] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 1.860050] ehci-pci 0000:00:1d.0: debug port 2 [ 1.860051] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 1.860092] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.860094] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.860095] usb usb2: Product: xHCI Host Controller [ 1.860096] usb usb2: Manufacturer: Linux 5.14.0-437.el9.x86_64 xhci-hcd [ 1.860097] usb usb2: SerialNumber: 0000:00:14.0 [ 1.860211] hub 2-0:1.0: USB hub found [ 1.860245] hub 2-0:1.0: 15 ports detected [ 1.863494] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 1.863496] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.863497] usb usb4: Product: xHCI Host Controller [ 1.863498] usb usb4: Manufacturer: Linux 5.14.0-437.el9.x86_64 xhci-hcd [ 1.863499] usb usb4: SerialNumber: 0000:00:14.0 [ 1.863611] hub 4-0:1.0: USB hub found [ 1.863632] hub 4-0:1.0: 6 ports detected [ 1.863959] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 1.865786] usbcore: registered new interface driver usbserial_generic [ 1.865792] usbserial: USB Serial support registered for generic [ 1.865827] i8042: PNP: No PS/2 controller found. [ 1.865881] mousedev: PS/2 mouse device common for all mice [ 1.865961] rtc_cmos 00:00: RTC can wake from S4 [ 1.866274] rtc_cmos 00:00: registered as rtc0 [ 1.866321] rtc_cmos 00:00: setting system clock to 2024-04-26T10:45:08 UTC (1714128308) [ 1.866350] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 1.870459] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 1.870505] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.870507] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.870508] usb usb3: Product: EHCI Host Controller [ 1.870509] usb usb3: Manufacturer: Linux 5.14.0-437.el9.x86_64 ehci_hcd [ 1.870509] usb usb3: SerialNumber: 0000:00:1d.0 [ 1.870590] hub 3-0:1.0: USB hub found [ 1.870593] hub 3-0:1.0: 2 ports detected [ 1.883300] intel_pstate: Intel P-state driver initializing [ 1.887227] Freeing initrd memory: 33136K [ 1.959484] hid: raw HID events driver (C) Jiri Kosina [ 1.959523] usbcore: registered new interface driver usbhid [ 1.959524] usbhid: USB HID core driver [ 1.959569] drop_monitor: Initializing network drop monitor service [ 1.968401] Initializing XFRM netlink socket [ 1.968496] NET: Registered PF_INET6 protocol family [ 1.972926] Segment Routing with IPv6 [ 1.972942] NET: Registered PF_PACKET protocol family [ 1.972964] mpls_gso: MPLS GSO support [ 1.983539] microcode: Current revision: 0x0b000010 [ 2.000137] resctrl: L3 allocation detected [ 2.000138] resctrl: L3 monitoring detected [ 2.000152] IPI shorthand broadcast: enabled [ 2.000156] AVX2 version of gcm_enc/dec engaged. [ 2.055950] AES CTR mode by8 optimization enabled [ 2.056018] sched_clock: Marking stable (928272416, 1127703324)->(2639835370, -583859630) [ 2.066952] registered taskstats version 1 [ 2.081257] Loading compiled-in X.509 certificates [ 2.081812] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: ac928bd9444a4e48f0eddf90defda693df54cc67' [ 2.082077] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.082336] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.082493] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.082503] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.082665] zswap: loaded using pool lzo/zbud [ 2.096136] page_owner is disabled [ 2.096307] pstore: Using crash dump compression: deflate [ 2.096317] Key type big_key registered [ 2.097460] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.107462] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.110461] usb 3-1: new high-speed USB device number 2 using ehci-pci [ 2.169368] Key type encrypted registered [ 2.169374] ima: No TPM chip found, activating TPM-bypass! [ 2.169376] Loading compiled-in module X.509 certificates [ 2.169666] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: ac928bd9444a4e48f0eddf90defda693df54cc67' [ 2.169668] ima: Allocated hash algorithm: sha256 [ 2.169676] ima: No architecture policies found [ 2.169683] evm: Initialising EVM extended attributes: [ 2.169684] evm: security.selinux [ 2.169684] evm: security.SMACK64 (disabled) [ 2.169685] evm: security.SMACK64EXEC (disabled) [ 2.169685] evm: security.SMACK64TRANSMUTE (disabled) [ 2.169686] evm: security.SMACK64MMAP (disabled) [ 2.169686] evm: security.apparmor (disabled) [ 2.169686] evm: security.ima [ 2.169687] evm: security.capability [ 2.169687] evm: HMAC attrs: 0x1 [ 2.238817] usb 3-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.238819] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.238974] hub 3-1:1.0: USB hub found [ 2.239065] hub 3-1:1.0: 8 ports detected [ 2.262172] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.262174] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.271535] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.271537] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.278019] hub 1-1:1.0: USB hub found [ 2.287324] hub 1-1:1.0: 6 ports detected [ 2.334704] hub 2-12:1.0: USB hub found [ 2.344099] hub 2-12:1.0: 4 ports detected [ 2.572452] tsc: Refined TSC clocksource calibration: 3499.993 MHz [ 2.572456] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734a05315, max_idle_ns: 440795202126 ns [ 2.573856] clocksource: Switched to clocksource tsc [ 2.657450] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 2.761822] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 2.761825] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.766764] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 2.818535] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 2.821192] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 2.821237] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.037562] Freeing unused decrypted memory: 2028K [ 5.038054] Freeing unused kernel image (initmem) memory: 3928K [ 5.038091] Write protecting the kernel read-only data: 28672k [ 5.038263] Freeing unused kernel image (rodata/data gap) memory: 500K [ 5.078016] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.078017] x86/mm: Checking user space page tables [ 5.116198] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.116209] Run /init as init process Welcome to [0[ 5.127180] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.127276] systemd[1]: Detected architecture x86-64. [ 5.127278] systemd[1]: Running in initrd. ;31mCentOS Stream 9 dracut-057-53.git20240104.el9 (Initramfs)! [ 5.178532] systemd[1]: Hostname set to . [ 5.234301] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.234407] systemd[1]: Reached target Initrd /usr File System. [ OK ] Reached target Initrd /usr File System. [ OK [[ 5.256599] systemd[1]: Reached target Local File Systems. 0m] Reached target Local File Systems. [ OK [[ 5.270549] systemd[1]: Reached target Slice Units. 0m] Reached target Slice Units. [ OK [[ 5.282540] systemd[1]: Reached target Swaps. 0m] Reached target Swaps. [ OK [[ 5.293494] systemd[1]: Reached target Timer Units. 0m] Reached target Timer Units. [ OK [[ 5.305571] systemd[1]: Listening on D-Bus System Message Bus Socket. 0m] Listening on D-Bus System Message Bus Socket. [ OK [[ 5.320572] systemd[1]: Listening on Journal Socket (/dev/log). 0m] Listening on Journal Socket (/dev/log). [ OK [[ 5.334660] systemd[1]: Listening on Journal Socket. 0m] Listening on Journal Socket. [ OK [[ 5.346588] systemd[1]: Listening on udev Control Socket. 0m] Listening on udev Control Socket. [ OK [[ 5.360630] systemd[1]: Listening on udev Kernel Socket. 0m] Listening on udev Kernel Socket. [ OK [[ 5.374559] systemd[1]: Reached target Socket Units. 0m] Reached target Socket Units. Startin[ 5.393236] systemd[1]: Starting Create List of Static Device Nodes... g Create List of Static Device Nodes... Startin[ 5.408701] systemd[1]: Starting Journal Service... g Journal Service... Startin[ 5.420607] systemd[1]: Load Kernel Modules was skipped because no trigger condition checks were met. [ 5.421323] systemd[1]: Starting Apply Kernel Variables... g Apply Kernel Variables... Startin[ 5.443189] systemd[1]: Starting Create System Users... g Create System Users... Startin[ 5.456070] systemd[1]: Starting Setup Virtual Console... g Setup Virtual Console... [ OK [[ 5.469326] systemd[1]: Started Journal Service. 0m] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut cmdline hook... [ OK ] Finished dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. [ 5.864078] dca service started, version 1.12.1 Starting dracut initqueue hook... Starting Show Plymouth Boot Screen... [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password R…s to Plymouth Directory Watch. [ OK ] Reached target Path Units.[ 5.916418] igb: Intel(R) Gigabit Ethernet Network Driver [ OK [ 5.916420] igb: Copyright (c) 2007-2014 Intel Corporation. ] Reached t[ 5.916541] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver arget B[ 5.916543] ixgbe: Copyright (c) 1999-2016 Intel Corporation. asic System. [ 5.966922] nvme nvme0: pci function 0000:02:00.0 [ 5.967125] ACPI: bus type drm_connector registered [ 5.969097] nvme nvme0: 8/0/0 default/read/poll queues [ 5.982483] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 5.982485] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.991046] igb 0000:07:00.0: added PHC on eth0 [ 5.991073] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.991074] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:fc [ 5.991150] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.991151] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.994658] scsi host0: ahci [ 5.994772] scsi host1: ahci [ 5.994894] scsi host2: ahci [ 5.995010] scsi host3: ahci [ 5.995042] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 53 lpm-pol 0 [ 5.995046] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 53 lpm-pol 0 [ 5.995048] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 53 lpm-pol 0 [ 5.995050] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 53 lpm-pol 0 [ 5.995323] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.995326] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.010767] scsi host4: ahci [ 6.010860] scsi host5: ahci [ 6.010984] scsi host6: ahci [ 6.011100] scsi host7: ahci [ 6.011194] scsi host8: ahci [ 6.011305] scsi host9: ahci [ 6.011351] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 63 lpm-pol 0 [ 6.011355] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 63 lpm-pol 0 [ 6.011358] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 63 lpm-pol 0 [ 6.011360] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 63 lpm-pol 0 [ 6.011361] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 63 lpm-pol 0 [ 6.011364] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 63 lpm-pol 0 [ 6.013135] ast 0000:06:00.0: vgaarb: deactivate onsole: switching to colour dummy device 80x25 [ 6.025898] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 6.025899] ast 0000:06:00.0: [drm] AST 2400 detected [ 6.025909] ast 0000:06:00.0: [drm] Using analog VGA [ 6.025914] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.026085] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.038534] fbcon: astdrmfb (fb0) is primary device [ 6.053321] igb 0000:07:00.1: added PHC on eth1 [ 6.053524] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.053525] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:fd [ 6.053668] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.053670] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.056951] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.063349] Console: switching to colour frame buffer device 128x48 [ 6.064982] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.081584] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 6.305896] ata1: SATA link down (SStatus 0 SControl 300) [ 6.305956] ata3: SATA link down (SStatus 0 SControl 300) [ 6.306847] ata4: SATA link down (SStatus 0 SControl 300) [ 6.310557] ata2: SATA link down (SStatus 0 [ 6.321850] 0 Gbps (SStatus [ 6.321874] ata6: SATA link down (SStatus 0 SControl 300) [ 6.321896] ata9: SATA link down (SStatus 0 SControl 300) [ 6.321919] ata7: SATA link down (SStatus 0 SControl 300) [ 6.323101] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.323594] ata5.00: NCQ Send/Recv Log not supported [ 6.323595] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.324962] ata5.00: NCQ Send/Recv Log not supported [ 6.324966] ata5.00: configured for UDMA/133 [ 6.325078] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.325625] ata10: SATA link down (SStatus 0 SControl 300) [ 6.326549] ata8: SATA link down (SStatus 0 SControl 300) [ 6.400446] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.463166] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.463177] sd 4:0:0:0: [sda] Write Protect is off [ 6.463192] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.463209] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.475871] sda: sda1 [ 6.475954] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.049736] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.050024] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.050107] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.050108] ixgbe 0000:03:00.0: 0c:c4:7a:8f:d5:f4 [ 7.053154] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.201658] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.201945] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.202026] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.202028] ixgbe 0000:03:00.1: 0c:c4:7a:8f:d5:f5 [ 7.205010] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.221750] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 7.246388] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check…6d2c-4093-809e-dd42758f0c27... [ OK ] Finished File System Check…5-6d2c-4093-809e-dd42758f0c27. Mounting /sysroot... [ 7.492099] EXT4-fs (sda1): mounted filesystem a494b625-6d2c-4093-809e-dd42758f0c27 ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manage…for Device Events and Files... [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. Starting Switch Root... [ 7.839810] systemd-journald[280]: Received SIGTERM from PID 1 (systemd). [ 8.367303] SELinux: policy capability network_peer_controls=1 [ 8.367306] SELinux: policy capability open_perms=1 [ 8.367306] SELinux: policy capability extended_socket_class=1 [ 8.367307] SELinux: policy capability always_check_network=0 [ 8.367307] SELinux: policy capability cgroup_seclabel=1 [ 8.367308] SELinux: policy capability nnp_nosuid_transition=1 [ 8.367308] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.409558] audit: type=1403 audit(1714128315.042:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.412289] systemd[1]: Successfully loaded SELinux policy in 114.993ms. [ 8.480694] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 25.676ms. [ 8.489241] systemd[1]: systemd 252-32.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.489347] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ 8.529101] systemd[1]: Hostname set to . [ OK [[ 9.441473] systemd[1]: initrd-switch-root.service: Deactivated successfully. 0m] Stopped [0;[ 9.441572] systemd[1]: Stopped Switch Root. [ 9.441980] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.442277] systemd[1]: Created slice Slice /system/getty. [ 9.442597] systemd[1]: Created slice Slice /system/modprobe. [ 9.450658] systemd[1]: Created slice Slice /system/serial-getty. 1;39mSwitch Root[ 9.482508] systemd[1]: Created slice Slice /system/sshd-keygen. [ 9.482763] systemd[1]: Created slice User and Session Slice. . [[ 9.482792] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.482892] systemd[1]: Started Forward Password Requests to Wall Directory Watch. OK ] Crea[ 9.483244] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ 9.483308] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.483332] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.483348] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ 9.483363] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.483378] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.483393] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.483411] systemd[1]: Reached target Local Encrypted Volumes. [ 9.483443] systemd[1]: Stopped target Switch Root. [ 9.495450] systemd[1]: Stopped target Initrd File Systems. ted slice [0;1;[ 9.511726] systemd[1]: Stopped target Initrd Root File System. [ 9.609382] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.609433] systemd[1]: Reached target Path Units. [ 9.616646] systemd[1]: Reached target Slice Units. [ 9.623420] systemd[1]: Reached target Swaps. [ 9.628201] systemd[1]: Reached target Local Verity Protected Volumes. 39mSlice /system[ 9.644295] systemd[1]: Listening on Device-mapper event daemon FIFOs. /getty. [[ 9.652115] systemd[1]: Listening on LVM2 poll daemon socket. [0;32m OK ] Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/[ 9.668845] systemd[1]: Listening on RPCbind Server Activation Socket. [ 9.668903] systemd[1]: Reached target RPC Port Mapper. [ 9.670182] systemd[1]: Listening on Process Core Dump Socket. serial-getty[ 9.687749] systemd[1]: Listening on initctl Compatibility Named Pipe. [ 9.688178] systemd[1]: Listening on udev Control Socket. [ 9.688413] systemd[1]: Listening on udev Kernel Socket. [ 9.689211] systemd[1]: Mounting Huge Pages File System... [ 9.696278] systemd[1]: Mounting POSIX Message Queue File System... . [ OK ] Created [ 9.718831] systemd[1]: Mounting Kernel Debug File System... [ 9.719624] systemd[1]: Mounting Kernel Trace File System... slice S[ 9.726555] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). lice /system/sshd-keygen. [ OK ] Created slice User and Session Slice. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ OK ] Set [ 9.764702] systemd[1]: Starting Create List of Static Device Nodes... [ 9.765511] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 9.773446] systemd[1]: Starting Load Kernel Module configfs... up automount Arbitrary\xe2[ 9.789555] systemd[1]: Starting Load Kernel Module drm... [ 9.790304] systemd[1]: Starting Load Kernel Module fuse... [ 9.792938] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... [ 9.797117] systemd[1]: plymouth-switch-root.service: Deactivated successfully. [ 9.797161] systemd[1]: Stopped Plymouth switch root service. \x80\xa6s File System [ 9.824153] systemd[1]: Stopped Journal Service. Automount Point. [ [ 9.830618] systemd[1]: Starting Journal Service... [ 9.833216] systemd[1]: Starting Load Kernel Modules... OK ] Reached target [0;1;[ 9.843650] systemd[1]: Starting Generate network units from Kernel command line... 39mceph target\xe2\x80[ 9.843695] systemd[1]: TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f). \xa6on@.service ins[ 9.844467] systemd[1]: Starting Remount Root and Kernel File Systems... tances at once[[ 9.853379] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. 0m. [ [ 9.854382] systemd[1]: Starting Coldplug All udev Devices... [ 9.874564] systemd[1]: Mounted Huge Pages File System. [ 9.881454] systemd[1]: Mounted POSIX Message Queue File System. OK ] Reache[ 9.892225] systemd[1]: Mounted Kernel Debug File System. [ 9.897842] EXT4-fs (sda1): re-mounted a494b625-6d2c-4093-809e-dd42758f0c27 r/w. Quota mode: none. d target [0;1;3[ 9.911095] systemd[1]: Mounted Kernel Trace File System. 9mceph target…ds@.service inst[ 9.933591] systemd[1]: Finished Create List of Static Device Nodes. [ 9.934004] systemd[1]: modprobe@configfs.service: Deactivated successfully. ances at once[0[ 9.934139] systemd[1]: Finished Load Kernel Module configfs. [ 9.934453] systemd[1]: modprobe@drm.service: Deactivated successfully. m. [ O[ 9.934589] systemd[1]: Finished Load Kernel Module drm. [ 9.949302] systemd[1]: Started Journal Service. K ] Reached target [0;1;39[ 9.975839] fuse: init (API version 7.36) mceph target…gr@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ OK ] Reached t[ 9.995028] systemd-journald[575]: Received client request to flush runtime journal. arget ceph target…gw@.service instances at once. [ OK ] Reached target ceph target…or@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ 10.053597] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 10.053625] device-mapper: uevent: version 1.0.3 [ 10.053745] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM…meventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS …from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network …ts from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Started Journal Service. [ OK ] Finished Read and set NIS …e from /etc/sysconfig/network. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Reached target Preparation for Network. Mounting Kernel Configuration File System... Starting Flush Journal to Persistent Storage... Starting Load/Save OS Random Seed... Starting Create Static Device Nodes in /dev... [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Modules. [ OK ] Mounted Kernel Configuration File System. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Load/Save OS Random Seed. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Automatic Boot Loader Update. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ 12.646357] IPMI message handler: version 39.2 [ 12.655941] ipmi device interface [ 12.661791] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 12.662344] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 12.663337] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 12.663340] i2c i2c-3: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 12.692625] power_meter ACPI000D:00: Found ACPI power meter. [ 12.692650] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 12.692655] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ 12.719115] ipmi_si: IPMI System Interface driver [ 12.719132] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 12.719134] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 12.719136] ipmi_si: Adding SMBIOS-specified kcs state machine [ 12.719183] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 12.719253] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 12.719938] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 12.719940] ipmi_si: Adding ACPI-specified kcs state machine [ 12.720148] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 12.784118] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 12.789437] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 12.800973] igb 0000:07:00.0: DCA enabled [ 12.800990] igb 0000:07:00.1: DCA enabled [ 12.811414] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 12.828184] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 12.828187] RAPL PMU: hw unit of domain package 2^-14 Joules [ 12.828188] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 12.835459] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ OK ] Started /usr/sbin/lvm vgch…-autoactivation event vg_nvme. [ 12.888077] iTCO_vendor_support: vendor-support=0 [ OK ] Finished Create Volatile Files and Directories. [ 12.905772] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) Mountin[ 12.906032] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) g RPC Pipe File System... Starting Security Auditing Service... Starting RPC Bind... [ OK ] Found device /dev/v[ 12.983033] ipmi_si IPI0001:00: IPMI kcs interface initialized g_nvme/lv_5. Mounting /var/lib/ceph... [ 13.010454] ipmi_ssif: IPMI SSIF Interface driver [ 13.078896] RPC: Registered named UNIX socket transport module. [ 13.078898] RPC: Registered udp transport module. [ 13.078899] RPC: Registered tcp transport module. [ 13.078899] RPC: Registered tcp-with-tls transport module. [ 13.078900] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 13.347678] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 13.356771] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported after September 2030. [ OK [[ 13.356854] XFS (dm-4): Mounting V4 Filesystem f941b536-76b7-4f0d-a37c-bcf80f3a6728 0m] Mounted [0;[ 13.361158] XFS (dm-4): Ending clean mount [ 13.361196] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) 1;39m/var/lib/ce[ 13.390319] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) ph. [ 13.390320] EDAC sbridge: Ver: 1.1.2 [ 13.425582] intel_rapl_common: Found RAPL domain package [ 13.425588] intel_rapl_common: Found RAPL domain dram [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activit…ounting tool every 10 minutes. [ OK ] Started Generate summary o…esterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos…ache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Self Monitoring a…g Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Started User Login Management. [ OK ] Finished Resets System Activity Logs. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started NTP client/server. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 15.156988] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 15.306624] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... [ 15.536593] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [ 15.725516] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 15.725623] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [* ] A start job is running for Network Manager Wait Online (8s / no limit) M [** ] A start job is running for Network Manager Wait Online (9s / no limit) M [*** ] A start job is running for Network Manager Wait Online (9s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ ***] A start job is running for Network …nager Wait Online (11s / no limit) M [ **] A start job is running for Network …nager Wait Online (12s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.87 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. [ 22.825583] block sda: the capability attribute has been deprecated. + '[' 172.21.15.87 '!=' '' ']' + set -e + '[' -n 172.21.15.87 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.87 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.87 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' Starting SETroubleshoot da…ing new SELinux denial logs... + newhostname=smithi087.front.sepia.ceph.com + '[' -n smithi087.front.sepia.ceph.com ']' + hostname smithi087.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi087 + echo smithi087 + grep -q front.sepia.ceph.com /etc/hosts + sed -i '1i172.21.15.87 smithi087.front.sepia.ceph.com smithi087\' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 9 Kernel 5.14.0-437.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi087 login: [disconnect] 2024-04-26T10:45:36.417 INFO:teuthology.misc:Re-opening connections... 2024-04-26T10:45:36.417 INFO:teuthology.misc:trying to connect to ubuntu@smithi087.front.sepia.ceph.com 2024-04-26T10:45:36.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-04-26T10:45:36.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:45:36.625 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~140s 2024-04-26T10:45:36.894 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-04-26T10:45:37.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-04-26T10:45:37.492 DEBUG:teuthology.misc:waited 1.0744030475616455 2024-04-26T10:45:38.493 DEBUG:tasks.ceph_manager:Mounting data for osd.1 on ubuntu@smithi087.front.sepia.ceph.com 2024-04-26T10:45:38.493 INFO:tasks.ceph_manager:Mounting osd.1: dev: ubuntu@smithi087.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-1, type: xfs, options: ['noatime'] 2024-04-26T10:45:38.493 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-26T10:45:38.665 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T10:45:38.803 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T10:45:38.803 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T10:45:38.805 INFO:tasks.ceph.osd.1:Started 2024-04-26T10:45:38.806 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:45:38.907 INFO:teuthology.orchestra.run.smithi087.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-26T10:45:38.910 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T10:45:38.910 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-04-26T10:45:39.754 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:45:39.752+0000 7f01999c4640 -1 Falling back to public interface 2024-04-26T10:45:42.534 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-26T10:45:43.389 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:45:43.388+0000 7f01999c4640 -1 osd.1 25 log_to_monitors true 2024-04-26T10:45:43.912 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:45:43.916 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-04-26T10:45:43.913+0000 7f018d761640 -1 osd.1 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T10:45:44.012 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-04-26T10:45:44.013 INFO:teuthology.orchestra.run.smithi087.stdout: "ops": [], 2024-04-26T10:45:44.013 INFO:teuthology.orchestra.run.smithi087.stdout: "num_ops": 0 2024-04-26T10:45:44.013 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-04-26T10:45:49.022 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-26T10:45:49.150 INFO:teuthology.orchestra.run.smithi049.stdout:mon.a: {} 2024-04-26T10:45:49.151 INFO:teuthology.orchestra.run.smithi049.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T10:45:49.159 INFO:teuthology.orchestra.run.smithi049.stdout:mon.b: {} 2024-04-26T10:45:49.160 INFO:teuthology.orchestra.run.smithi049.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T10:45:49.169 INFO:teuthology.orchestra.run.smithi049.stdout:mon.c: {} 2024-04-26T10:45:49.169 INFO:teuthology.orchestra.run.smithi049.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T10:45:49.180 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T10:45:49.861 INFO:teuthology.orchestra.run.smithi049.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T10:45:49.877 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-26T10:45:50.867 INFO:teuthology.orchestra.run.smithi049.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-26T10:45:50.883 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T10:45:52.162 INFO:teuthology.orchestra.run.smithi049.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T10:45:52.179 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-26T10:45:53.168 INFO:teuthology.orchestra.run.smithi049.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-26T10:45:53.184 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T10:45:54.172 INFO:teuthology.orchestra.run.smithi049.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T10:45:54.188 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-26T10:45:55.174 INFO:teuthology.orchestra.run.smithi049.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-26T10:45:55.191 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-26T10:45:55.191 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-26T10:45:55.191 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-26T10:45:55.191 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-26T10:45:55.192 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T10:45:55.192 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:45:55.488 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:45:55.488 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":81,"fsid":"9837de44-a9e8-4979-adc4-611f3ddc44ce","created":"2024-04-26T10:42:11.337159+0000","modified":"2024-04-26T10:45:55.169196+0000","last_up_change":"2024-04-26T10:45:44.834285+0000","last_in_change":"2024-04-26T10:42:12.136647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:42:19.632084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:42:19.779089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:42:24.266614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:42:25.014684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.4500000476837158,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.4500000476837158,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eabed31c-c043-43de-a756-e217d5287116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":28839},{"type":"v1","addr":"172.21.15.60:6801","nonce":28839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":28839},{"type":"v1","addr":"172.21.15.60:6803","nonce":28839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":28839},{"type":"v1","addr":"172.21.15.60:6807","nonce":28839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":28839},{"type":"v1","addr":"172.21.15.60:6805","nonce":28839}]},"public_addr":"172.21.15.60:6801/28839","cluster_addr":"172.21.15.60:6803/28839","heartbeat_back_addr":"172.21.15.60:6807/28839","heartbeat_front_addr":"172.21.15.60:6805/28839","state":["exists","up"]},{"osd":1,"uuid":"7013621f-db09-4096-bc24-428bb170edd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":25,"up_from":70,"up_thru":80,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":5359},{"type":"v1","addr":"172.21.15.87:6801","nonce":5359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":5359},{"type":"v1","addr":"172.21.15.87:6803","nonce":5359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":5359},{"type":"v1","addr":"172.21.15.87:6807","nonce":5359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":5359},{"type":"v1","addr":"172.21.15.87:6805","nonce":5359}]},"public_addr":"172.21.15.87:6801/5359","cluster_addr":"172.21.15.87:6803/5359","heartbeat_back_addr":"172.21.15.87:6807/5359","heartbeat_front_addr":"172.21.15.87:6805/5359","state":["exists","up"]},{"osd":2,"uuid":"a1efeadd-cf55-4ed5-9918-36607fd62229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":28733},{"type":"v1","addr":"172.21.15.195:6801","nonce":28733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":28733},{"type":"v1","addr":"172.21.15.195:6803","nonce":28733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":28733},{"type":"v1","addr":"172.21.15.195:6807","nonce":28733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":28733},{"type":"v1","addr":"172.21.15.195:6805","nonce":28733}]},"public_addr":"172.21.15.195:6801/28733","cluster_addr":"172.21.15.195:6803/28733","heartbeat_back_addr":"172.21.15.195:6807/28733","heartbeat_front_addr":"172.21.15.195:6805/28733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.152046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.177399+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.123066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":0,"to":1}]},{"pgid":"4.6","mappings":[{"from":0,"to":1}]},{"pgid":"4.12","mappings":[{"from":2,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.6","osds":[0,2]},{"pgid":"4.7","osds":[0]},{"pgid":"4.8","osds":[0]},{"pgid":"4.a","osds":[0,2]},{"pgid":"4.b","osds":[0,1]},{"pgid":"4.c","osds":[0,2]},{"pgid":"4.f","osds":[0]},{"pgid":"4.23","osds":[0]},{"pgid":"4.24","osds":[0]},{"pgid":"4.29","osds":[2]},{"pgid":"4.34","osds":[0]},{"pgid":"4.38","osds":[0,2]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:45:55.501 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T10:45:55.502 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:45:55.800 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:45:55.801 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":81,"fsid":"9837de44-a9e8-4979-adc4-611f3ddc44ce","created":"2024-04-26T10:42:11.337159+0000","modified":"2024-04-26T10:45:55.169196+0000","last_up_change":"2024-04-26T10:45:44.834285+0000","last_in_change":"2024-04-26T10:42:12.136647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:42:19.632084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:42:19.779089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:42:24.266614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:42:25.014684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.4500000476837158,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.4500000476837158,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eabed31c-c043-43de-a756-e217d5287116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":28839},{"type":"v1","addr":"172.21.15.60:6801","nonce":28839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":28839},{"type":"v1","addr":"172.21.15.60:6803","nonce":28839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":28839},{"type":"v1","addr":"172.21.15.60:6807","nonce":28839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":28839},{"type":"v1","addr":"172.21.15.60:6805","nonce":28839}]},"public_addr":"172.21.15.60:6801/28839","cluster_addr":"172.21.15.60:6803/28839","heartbeat_back_addr":"172.21.15.60:6807/28839","heartbeat_front_addr":"172.21.15.60:6805/28839","state":["exists","up"]},{"osd":1,"uuid":"7013621f-db09-4096-bc24-428bb170edd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":25,"up_from":70,"up_thru":80,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":5359},{"type":"v1","addr":"172.21.15.87:6801","nonce":5359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":5359},{"type":"v1","addr":"172.21.15.87:6803","nonce":5359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":5359},{"type":"v1","addr":"172.21.15.87:6807","nonce":5359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":5359},{"type":"v1","addr":"172.21.15.87:6805","nonce":5359}]},"public_addr":"172.21.15.87:6801/5359","cluster_addr":"172.21.15.87:6803/5359","heartbeat_back_addr":"172.21.15.87:6807/5359","heartbeat_front_addr":"172.21.15.87:6805/5359","state":["exists","up"]},{"osd":2,"uuid":"a1efeadd-cf55-4ed5-9918-36607fd62229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":28733},{"type":"v1","addr":"172.21.15.195:6801","nonce":28733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":28733},{"type":"v1","addr":"172.21.15.195:6803","nonce":28733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":28733},{"type":"v1","addr":"172.21.15.195:6807","nonce":28733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":28733},{"type":"v1","addr":"172.21.15.195:6805","nonce":28733}]},"public_addr":"172.21.15.195:6801/28733","cluster_addr":"172.21.15.195:6803/28733","heartbeat_back_addr":"172.21.15.195:6807/28733","heartbeat_front_addr":"172.21.15.195:6805/28733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.152046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.177399+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.123066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":0,"to":1}]},{"pgid":"4.6","mappings":[{"from":0,"to":1}]},{"pgid":"4.12","mappings":[{"from":2,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.6","osds":[0,2]},{"pgid":"4.7","osds":[0]},{"pgid":"4.8","osds":[0]},{"pgid":"4.a","osds":[0,2]},{"pgid":"4.b","osds":[0,1]},{"pgid":"4.c","osds":[0,2]},{"pgid":"4.f","osds":[0]},{"pgid":"4.23","osds":[0]},{"pgid":"4.24","osds":[0]},{"pgid":"4.29","osds":[2]},{"pgid":"4.34","osds":[0]},{"pgid":"4.38","osds":[0,2]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:45:55.814 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T10:45:55.814 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T10:45:55.815 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T10:45:55.956 INFO:teuthology.orchestra.run.smithi049.stdout:34359738416 2024-04-26T10:45:55.956 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T10:45:55.978 INFO:teuthology.orchestra.run.smithi049.stdout:34359738415 2024-04-26T10:45:55.978 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T10:45:55.979 INFO:teuthology.orchestra.run.smithi049.stdout:300647710724 2024-04-26T10:45:55.979 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T10:45:56.264 INFO:teuthology.orchestra.run.smithi049.stdout:34359738415 2024-04-26T10:45:56.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738416 got 34359738415 for osd.0 2024-04-26T10:45:56.328 INFO:teuthology.orchestra.run.smithi049.stdout:34359738414 2024-04-26T10:45:56.329 INFO:teuthology.orchestra.run.smithi049.stdout:300647710723 2024-04-26T10:45:56.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738415 got 34359738414 for osd.2 2024-04-26T10:45:56.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 300647710724 got 300647710723 for osd.1 2024-04-26T10:45:57.278 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T10:45:57.343 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T10:45:57.344 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T10:45:57.611 INFO:teuthology.orchestra.run.smithi049.stdout:34359738415 2024-04-26T10:45:57.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738416 got 34359738415 for osd.0 2024-04-26T10:45:57.655 INFO:teuthology.orchestra.run.smithi049.stdout:300647710723 2024-04-26T10:45:57.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 300647710724 got 300647710723 for osd.1 2024-04-26T10:45:57.669 INFO:teuthology.orchestra.run.smithi049.stdout:34359738414 2024-04-26T10:45:57.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738415 got 34359738414 for osd.2 2024-04-26T10:45:58.625 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T10:45:58.669 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T10:45:58.683 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T10:45:58.949 INFO:teuthology.orchestra.run.smithi049.stdout:34359738416 2024-04-26T10:45:58.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738416 got 34359738416 for osd.0 2024-04-26T10:45:58.963 DEBUG:teuthology.parallel:result is None 2024-04-26T10:45:58.992 INFO:teuthology.orchestra.run.smithi049.stdout:300647710724 2024-04-26T10:45:59.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 300647710724 got 300647710724 for osd.1 2024-04-26T10:45:59.005 DEBUG:teuthology.parallel:result is None 2024-04-26T10:45:59.034 INFO:teuthology.orchestra.run.smithi049.stdout:34359738415 2024-04-26T10:45:59.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738415 got 34359738415 for osd.2 2024-04-26T10:45:59.047 DEBUG:teuthology.parallel:result is None 2024-04-26T10:45:59.047 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T10:45:59.047 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:45:59.388 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:45:59.390 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:45:59.399 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-04-26T10:45:58.157812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129401919,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":494,"num_objects_misplaced":354,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2852,"num_read_kb":1456290,"num_write":30511,"num_write_kb":4323451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7921,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34423,"ondisk_log_size":34423,"up":210,"acting":203,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":222,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":567936,"kb_used_data":285528,"kb_used_omap":10,"kb_used_meta":282357,"kb_avail":282547584,"statfs":{"total":289910292480,"available":289328726016,"internally_reserved":0,"allocated":292380672,"data_stored":290810273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10369,"internal_metadata":289134463},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-5802,"num_objects_misplaced":354,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4661,"num_bytes_recovered":30828341,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.988313"},"pg_stats":[{"pgid":"4.3f","version":"63'415","reported_seq":538,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.179264+0000","last_change":"2024-04-26T10:42:26.045527+0000","last_active":"2024-04-26T10:45:54.179264+0000","last_peered":"2024-04-26T10:45:54.179264+0000","last_clean":"2024-04-26T10:45:54.179264+0000","last_became_active":"2024-04-26T10:42:26.044597+0000","last_became_peered":"2024-04-26T10:42:26.044597+0000","last_unstale":"2024-04-26T10:45:54.179264+0000","last_undegraded":"2024-04-26T10:45:54.179264+0000","last_fullsized":"2024-04-26T10:45:54.179264+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22963,"num_write":385,"num_write_kb":71406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"63'396","reported_seq":518,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.195053+0000","last_change":"2024-04-26T10:45:54.194523+0000","last_active":"2024-04-26T10:45:54.195053+0000","last_peered":"2024-04-26T10:45:54.195053+0000","last_clean":"2024-04-26T10:45:54.195053+0000","last_became_active":"2024-04-26T10:45:54.192613+0000","last_became_peered":"2024-04-26T10:45:54.192613+0000","last_unstale":"2024-04-26T10:45:54.195053+0000","last_undegraded":"2024-04-26T10:45:54.195053+0000","last_fullsized":"2024-04-26T10:45:54.195053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:22.723004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9499,"num_write":371,"num_write_kb":38601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"63'366","reported_seq":446,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:45:55.183758+0000","last_change":"2024-04-26T10:45:55.183758+0000","last_active":"2024-04-26T10:45:55.183758+0000","last_peered":"2024-04-26T10:45:55.183758+0000","last_clean":"2024-04-26T10:45:55.183758+0000","last_became_active":"2024-04-26T10:45:55.180991+0000","last_became_peered":"2024-04-26T10:45:55.180991+0000","last_unstale":"2024-04-26T10:45:55.183758+0000","last_undegraded":"2024-04-26T10:45:55.183758+0000","last_fullsized":"2024-04-26T10:45:55.183758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:29.645448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6211,"num_write":338,"num_write_kb":38844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"63'394","reported_seq":542,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171880+0000","last_change":"2024-04-26T10:45:51.162341+0000","last_active":"2024-04-26T10:45:54.171880+0000","last_peered":"2024-04-26T10:45:54.171880+0000","last_clean":"2024-04-26T10:45:54.171880+0000","last_became_active":"2024-04-26T10:45:51.159099+0000","last_became_peered":"2024-04-26T10:45:51.159099+0000","last_unstale":"2024-04-26T10:45:54.171880+0000","last_undegraded":"2024-04-26T10:45:54.171880+0000","last_fullsized":"2024-04-26T10:45:54.171880+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:18.605866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":52323,"num_write":357,"num_write_kb":63323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"63'409","reported_seq":504,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.182764+0000","last_change":"2024-04-26T10:42:26.041191+0000","last_active":"2024-04-26T10:45:54.182764+0000","last_peered":"2024-04-26T10:45:54.182764+0000","last_clean":"2024-04-26T10:45:54.182764+0000","last_became_active":"2024-04-26T10:42:26.040487+0000","last_became_peered":"2024-04-26T10:42:26.040487+0000","last_unstale":"2024-04-26T10:45:54.182764+0000","last_undegraded":"2024-04-26T10:45:54.182764+0000","last_fullsized":"2024-04-26T10:45:54.182764+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":372,"num_write_kb":42764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'385","reported_seq":461,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.172969+0000","last_change":"2024-04-26T10:45:49.864662+0000","last_active":"2024-04-26T10:45:54.172969+0000","last_peered":"2024-04-26T10:45:54.172969+0000","last_clean":"2024-04-26T10:45:54.172969+0000","last_became_active":"2024-04-26T10:45:49.861811+0000","last_became_peered":"2024-04-26T10:45:49.861811+0000","last_unstale":"2024-04-26T10:45:54.172969+0000","last_undegraded":"2024-04-26T10:45:54.172969+0000","last_fullsized":"2024-04-26T10:45:54.172969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:25.549464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4124,"num_write":356,"num_write_kb":69857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"63'425","reported_seq":531,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171943+0000","last_change":"2024-04-26T10:45:50.869572+0000","last_active":"2024-04-26T10:45:54.171943+0000","last_peered":"2024-04-26T10:45:54.171943+0000","last_clean":"2024-04-26T10:45:54.171943+0000","last_became_active":"2024-04-26T10:45:50.866996+0000","last_became_peered":"2024-04-26T10:45:50.866996+0000","last_unstale":"2024-04-26T10:45:54.171943+0000","last_undegraded":"2024-04-26T10:45:54.171943+0000","last_fullsized":"2024-04-26T10:45:54.171943+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:17.631869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13036,"num_write":390,"num_write_kb":67193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"63'399","reported_seq":520,"reported_epoch":80,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T10:45:54.201546+0000","last_change":"2024-04-26T10:45:54.201546+0000","last_active":"2024-04-26T10:45:54.201546+0000","last_peered":"2024-04-26T10:45:54.201546+0000","last_clean":"2024-04-26T10:45:43.837004+0000","last_became_active":"2024-04-26T10:45:54.200170+0000","last_became_peered":"2024-04-26T10:45:54.200170+0000","last_unstale":"2024-04-26T10:45:54.201546+0000","last_undegraded":"2024-04-26T10:45:54.201546+0000","last_fullsized":"2024-04-26T10:45:54.201546+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:05.867149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":160,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25678,"num_write":356,"num_write_kb":116549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"63'442","reported_seq":586,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.172828+0000","last_change":"2024-04-26T10:42:26.045893+0000","last_active":"2024-04-26T10:45:54.172828+0000","last_peered":"2024-04-26T10:45:54.172828+0000","last_clean":"2024-04-26T10:45:54.172828+0000","last_became_active":"2024-04-26T10:42:26.045177+0000","last_became_peered":"2024-04-26T10:42:26.045177+0000","last_unstale":"2024-04-26T10:45:54.172828+0000","last_undegraded":"2024-04-26T10:45:54.172828+0000","last_fullsized":"2024-04-26T10:45:54.172828+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35111,"num_write":413,"num_write_kb":60306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'393","reported_seq":512,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.194713+0000","last_change":"2024-04-26T10:45:54.192984+0000","last_active":"2024-04-26T10:45:54.194713+0000","last_peered":"2024-04-26T10:45:54.194713+0000","last_clean":"2024-04-26T10:45:54.194713+0000","last_became_active":"2024-04-26T10:45:54.191514+0000","last_became_peered":"2024-04-26T10:45:54.191514+0000","last_unstale":"2024-04-26T10:45:54.194713+0000","last_undegraded":"2024-04-26T10:45:54.194713+0000","last_fullsized":"2024-04-26T10:45:54.194713+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:33.809143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5355,"num_write":351,"num_write_kb":38901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"63'377","reported_seq":479,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.174686+0000","last_change":"2024-04-26T10:45:49.865172+0000","last_active":"2024-04-26T10:45:54.174686+0000","last_peered":"2024-04-26T10:45:54.174686+0000","last_clean":"2024-04-26T10:45:54.174686+0000","last_became_active":"2024-04-26T10:45:49.862718+0000","last_became_peered":"2024-04-26T10:45:49.862718+0000","last_unstale":"2024-04-26T10:45:54.174686+0000","last_undegraded":"2024-04-26T10:45:54.174686+0000","last_fullsized":"2024-04-26T10:45:54.174686+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:43.129958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18030,"num_write":355,"num_write_kb":67044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"63'365","reported_seq":797,"reported_epoch":81,"state":"active+undersized+remapped","last_fresh":"2024-04-26T10:45:55.371444+0000","last_change":"2024-04-26T10:45:55.371588+0000","last_active":"2024-04-26T10:45:55.371444+0000","last_peered":"2024-04-26T10:45:55.371444+0000","last_clean":"2024-04-26T10:43:07.780827+0000","last_became_active":"2024-04-26T10:45:46.969351+0000","last_became_peered":"2024-04-26T10:45:46.969351+0000","last_unstale":"2024-04-26T10:45:55.371444+0000","last_undegraded":"2024-04-26T10:45:55.371444+0000","last_fullsized":"2024-04-26T10:45:46.876204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:42.659561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14866,"num_write":337,"num_write_kb":71188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'397","reported_seq":487,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.182235+0000","last_change":"2024-04-26T10:42:26.042607+0000","last_active":"2024-04-26T10:45:54.182235+0000","last_peered":"2024-04-26T10:45:54.182235+0000","last_clean":"2024-04-26T10:45:54.182235+0000","last_became_active":"2024-04-26T10:42:26.041617+0000","last_became_peered":"2024-04-26T10:42:26.041617+0000","last_unstale":"2024-04-26T10:45:54.182235+0000","last_undegraded":"2024-04-26T10:45:54.182235+0000","last_fullsized":"2024-04-26T10:45:54.182235+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8192,"num_write":362,"num_write_kb":54822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"63'408","reported_seq":484,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.172609+0000","last_change":"2024-04-26T10:45:53.181618+0000","last_active":"2024-04-26T10:45:54.172609+0000","last_peered":"2024-04-26T10:45:54.172609+0000","last_clean":"2024-04-26T10:45:54.172609+0000","last_became_active":"2024-04-26T10:45:53.177677+0000","last_became_peered":"2024-04-26T10:45:53.177677+0000","last_unstale":"2024-04-26T10:45:54.172609+0000","last_undegraded":"2024-04-26T10:45:54.172609+0000","last_fullsized":"2024-04-26T10:45:54.172609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:06.719053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4688,"num_write":374,"num_write_kb":21766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"63'409","reported_seq":519,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.189331+0000","last_change":"2024-04-26T10:45:54.188625+0000","last_active":"2024-04-26T10:45:54.189331+0000","last_peered":"2024-04-26T10:45:54.189331+0000","last_clean":"2024-04-26T10:45:54.189331+0000","last_became_active":"2024-04-26T10:45:54.185826+0000","last_became_peered":"2024-04-26T10:45:54.185826+0000","last_unstale":"2024-04-26T10:45:54.189331+0000","last_undegraded":"2024-04-26T10:45:54.189331+0000","last_fullsized":"2024-04-26T10:45:54.189331+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:48.401265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25968,"num_write":366,"num_write_kb":75698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"63'460","reported_seq":559,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171571+0000","last_change":"2024-04-26T10:45:53.176893+0000","last_active":"2024-04-26T10:45:54.171571+0000","last_peered":"2024-04-26T10:45:54.171571+0000","last_clean":"2024-04-26T10:45:54.171571+0000","last_became_active":"2024-04-26T10:45:53.174699+0000","last_became_peered":"2024-04-26T10:45:53.174699+0000","last_unstale":"2024-04-26T10:45:54.171571+0000","last_undegraded":"2024-04-26T10:45:54.171571+0000","last_fullsized":"2024-04-26T10:45:54.171571+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:41.919177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16269,"num_write":426,"num_write_kb":67839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"63'393","reported_seq":509,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.173426+0000","last_change":"2024-04-26T10:42:26.049338+0000","last_active":"2024-04-26T10:45:54.173426+0000","last_peered":"2024-04-26T10:45:54.173426+0000","last_clean":"2024-04-26T10:45:54.173426+0000","last_became_active":"2024-04-26T10:42:26.049014+0000","last_became_peered":"2024-04-26T10:42:26.049014+0000","last_unstale":"2024-04-26T10:45:54.173426+0000","last_undegraded":"2024-04-26T10:45:54.173426+0000","last_fullsized":"2024-04-26T10:45:54.173426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":25712,"num_write":362,"num_write_kb":42020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'428","reported_seq":551,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.194661+0000","last_change":"2024-04-26T10:45:54.192786+0000","last_active":"2024-04-26T10:45:54.194661+0000","last_peered":"2024-04-26T10:45:54.194661+0000","last_clean":"2024-04-26T10:45:54.194661+0000","last_became_active":"2024-04-26T10:45:54.189852+0000","last_became_peered":"2024-04-26T10:45:54.189852+0000","last_unstale":"2024-04-26T10:45:54.194661+0000","last_undegraded":"2024-04-26T10:45:54.194661+0000","last_fullsized":"2024-04-26T10:45:54.194661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:29.968564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12316,"num_write":384,"num_write_kb":87656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"63'446","reported_seq":584,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681052+0000","last_change":"2024-04-26T10:45:54.186962+0000","last_active":"2024-04-26T10:45:54.681052+0000","last_peered":"2024-04-26T10:45:54.681052+0000","last_clean":"2024-04-26T10:45:54.681052+0000","last_became_active":"2024-04-26T10:45:54.184063+0000","last_became_peered":"2024-04-26T10:45:54.184063+0000","last_unstale":"2024-04-26T10:45:54.681052+0000","last_undegraded":"2024-04-26T10:45:54.681052+0000","last_fullsized":"2024-04-26T10:45:54.681052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:59.349649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":53414,"num_write":401,"num_write_kb":80048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":547,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.172876+0000","last_change":"2024-04-26T10:45:50.869971+0000","last_active":"2024-04-26T10:45:54.172876+0000","last_peered":"2024-04-26T10:45:54.172876+0000","last_clean":"2024-04-26T10:45:54.172876+0000","last_became_active":"2024-04-26T10:45:50.867680+0000","last_became_peered":"2024-04-26T10:45:50.867680+0000","last_unstale":"2024-04-26T10:45:54.172876+0000","last_undegraded":"2024-04-26T10:45:54.172876+0000","last_fullsized":"2024-04-26T10:45:54.172876+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:17.680371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19859,"num_write":405,"num_write_kb":51119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"63'408","reported_seq":852,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:55.174682+0000","last_change":"2024-04-26T10:45:55.174828+0000","last_active":"2024-04-26T10:45:55.174682+0000","last_peered":"2024-04-26T10:45:54.453992+0000","last_clean":"2024-04-26T10:45:51.158728+0000","last_became_active":"2024-04-26T10:45:54.201496+0000","last_became_peered":"2024-04-26T10:45:54.201496+0000","last_unstale":"2024-04-26T10:45:55.174682+0000","last_undegraded":"2024-04-26T10:45:55.174682+0000","last_fullsized":"2024-04-26T10:45:55.174682+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:15.365315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":15372,"num_write":366,"num_write_kb":75855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"63'452","reported_seq":1014,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.176394+0000","last_change":"2024-04-26T10:45:52.175372+0000","last_active":"2024-04-26T10:45:54.176394+0000","last_peered":"2024-04-26T10:45:54.176394+0000","last_clean":"2024-04-26T10:45:54.176394+0000","last_became_active":"2024-04-26T10:45:52.173702+0000","last_became_peered":"2024-04-26T10:45:52.173702+0000","last_unstale":"2024-04-26T10:45:54.176394+0000","last_undegraded":"2024-04-26T10:45:54.176394+0000","last_fullsized":"2024-04-26T10:45:54.176394+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:55.459452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43729,"num_write":421,"num_write_kb":79804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"63'408","reported_seq":871,"reported_epoch":81,"state":"active+undersized+remapped","last_fresh":"2024-04-26T10:45:55.188981+0000","last_change":"2024-04-26T10:45:55.189125+0000","last_active":"2024-04-26T10:45:55.188981+0000","last_peered":"2024-04-26T10:45:55.188981+0000","last_clean":"2024-04-26T10:45:43.837106+0000","last_became_active":"2024-04-26T10:45:54.176860+0000","last_became_peered":"2024-04-26T10:45:54.176860+0000","last_unstale":"2024-04-26T10:45:55.188981+0000","last_undegraded":"2024-04-26T10:45:55.188981+0000","last_fullsized":"2024-04-26T10:45:54.171433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:06.438350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":30320,"num_write":372,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'453","reported_seq":612,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.184897+0000","last_change":"2024-04-26T10:45:54.184330+0000","last_active":"2024-04-26T10:45:54.184897+0000","last_peered":"2024-04-26T10:45:54.184897+0000","last_clean":"2024-04-26T10:45:54.184897+0000","last_became_active":"2024-04-26T10:45:54.181881+0000","last_became_peered":"2024-04-26T10:45:54.181881+0000","last_unstale":"2024-04-26T10:45:54.184897+0000","last_undegraded":"2024-04-26T10:45:54.184897+0000","last_fullsized":"2024-04-26T10:45:54.184897+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:02.066091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":19864,"num_write":422,"num_write_kb":51638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"63'439","reported_seq":951,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.179267+0000","last_change":"2024-04-26T10:45:48.867766+0000","last_active":"2024-04-26T10:45:54.179267+0000","last_peered":"2024-04-26T10:45:54.179267+0000","last_clean":"2024-04-26T10:45:54.179267+0000","last_became_active":"2024-04-26T10:45:48.866159+0000","last_became_peered":"2024-04-26T10:45:48.866159+0000","last_unstale":"2024-04-26T10:45:54.179267+0000","last_undegraded":"2024-04-26T10:45:54.179267+0000","last_fullsized":"2024-04-26T10:45:54.179267+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:39.736649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8912,"num_write":417,"num_write_kb":46575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"63'513","reported_seq":1155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.172380+0000","last_change":"2024-04-26T10:45:51.160003+0000","last_active":"2024-04-26T10:45:54.172380+0000","last_peered":"2024-04-26T10:45:54.172380+0000","last_clean":"2024-04-26T10:45:54.172380+0000","last_became_active":"2024-04-26T10:45:51.158698+0000","last_became_peered":"2024-04-26T10:45:51.158698+0000","last_unstale":"2024-04-26T10:45:54.172380+0000","last_undegraded":"2024-04-26T10:45:54.172380+0000","last_fullsized":"2024-04-26T10:45:54.172380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:36.990095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":70751,"num_write":473,"num_write_kb":88902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'406","reported_seq":523,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:55.176377+0000","last_change":"2024-04-26T10:45:55.176377+0000","last_active":"2024-04-26T10:45:45.862497+0000","last_peered":"2024-04-26T10:45:43.839512+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"2024-04-26T10:43:11.793483+0000","last_became_peered":"2024-04-26T10:43:11.793483+0000","last_unstale":"2024-04-26T10:45:55.176377+0000","last_undegraded":"2024-04-26T10:45:55.176377+0000","last_fullsized":"2024-04-26T10:45:55.176377+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:54:18.801877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":32121,"num_write":372,"num_write_kb":60163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"63'402","reported_seq":856,"reported_epoch":81,"state":"active+undersized+remapped","last_fresh":"2024-04-26T10:45:55.217948+0000","last_change":"2024-04-26T10:45:55.218106+0000","last_active":"2024-04-26T10:45:55.217948+0000","last_peered":"2024-04-26T10:45:55.217948+0000","last_clean":"2024-04-26T10:43:07.781070+0000","last_became_active":"2024-04-26T10:45:46.966258+0000","last_became_peered":"2024-04-26T10:45:46.966258+0000","last_unstale":"2024-04-26T10:45:55.217948+0000","last_undegraded":"2024-04-26T10:45:55.217948+0000","last_fullsized":"2024-04-26T10:45:46.872941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:13.642161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":6824,"num_write":378,"num_write_kb":72156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"63'407","reported_seq":883,"reported_epoch":80,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T10:45:54.203582+0000","last_change":"2024-04-26T10:45:54.203582+0000","last_active":"2024-04-26T10:45:54.203582+0000","last_peered":"2024-04-26T10:45:54.203582+0000","last_clean":"2024-04-26T10:45:51.160753+0000","last_became_active":"2024-04-26T10:45:54.201674+0000","last_became_peered":"2024-04-26T10:45:54.201674+0000","last_unstale":"2024-04-26T10:45:54.203582+0000","last_undegraded":"2024-04-26T10:45:54.177921+0000","last_fullsized":"2024-04-26T10:45:54.172633+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:13.200402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":173,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25898,"num_write":372,"num_write_kb":59274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"63'490","reported_seq":1055,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:45:55.179785+0000","last_change":"2024-04-26T10:45:55.179785+0000","last_active":"2024-04-26T10:45:55.179785+0000","last_peered":"2024-04-26T10:45:55.179785+0000","last_clean":"2024-04-26T10:45:55.179785+0000","last_became_active":"2024-04-26T10:45:55.178083+0000","last_became_peered":"2024-04-26T10:45:55.178083+0000","last_unstale":"2024-04-26T10:45:55.179785+0000","last_undegraded":"2024-04-26T10:45:55.179785+0000","last_fullsized":"2024-04-26T10:45:55.179785+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:23.269957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33597,"num_write":449,"num_write_kb":87981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"63'474","reported_seq":560,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.680966+0000","last_change":"2024-04-26T10:45:54.189228+0000","last_active":"2024-04-26T10:45:54.680966+0000","last_peered":"2024-04-26T10:45:54.680966+0000","last_clean":"2024-04-26T10:45:54.680966+0000","last_became_active":"2024-04-26T10:45:54.186011+0000","last_became_peered":"2024-04-26T10:45:54.186011+0000","last_unstale":"2024-04-26T10:45:54.680966+0000","last_undegraded":"2024-04-26T10:45:54.680966+0000","last_fullsized":"2024-04-26T10:45:54.680966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.355145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30886,"num_write":441,"num_write_kb":118807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'443","reported_seq":544,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171176+0000","last_change":"2024-04-26T10:45:48.864423+0000","last_active":"2024-04-26T10:45:54.171176+0000","last_peered":"2024-04-26T10:45:54.171176+0000","last_clean":"2024-04-26T10:45:54.171176+0000","last_became_active":"2024-04-26T10:45:48.861918+0000","last_became_peered":"2024-04-26T10:45:48.861918+0000","last_unstale":"2024-04-26T10:45:54.171176+0000","last_undegraded":"2024-04-26T10:45:54.171176+0000","last_fullsized":"2024-04-26T10:45:54.171176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:11.356135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20556,"num_write":413,"num_write_kb":91647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"63'376","reported_seq":475,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.179848+0000","last_change":"2024-04-26T10:42:26.041757+0000","last_active":"2024-04-26T10:45:54.179848+0000","last_peered":"2024-04-26T10:45:54.179848+0000","last_clean":"2024-04-26T10:45:54.179848+0000","last_became_active":"2024-04-26T10:42:26.040920+0000","last_became_peered":"2024-04-26T10:42:26.040920+0000","last_unstale":"2024-04-26T10:45:54.179848+0000","last_undegraded":"2024-04-26T10:45:54.179848+0000","last_fullsized":"2024-04-26T10:45:54.179848+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10124,"num_write":344,"num_write_kb":66899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"62'453","reported_seq":530,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171308+0000","last_change":"2024-04-26T10:45:48.862782+0000","last_active":"2024-04-26T10:45:54.171308+0000","last_peered":"2024-04-26T10:45:54.171308+0000","last_clean":"2024-04-26T10:45:54.171308+0000","last_became_active":"2024-04-26T10:45:48.862424+0000","last_became_peered":"2024-04-26T10:45:48.862424+0000","last_unstale":"2024-04-26T10:45:54.171308+0000","last_undegraded":"2024-04-26T10:45:54.171308+0000","last_fullsized":"2024-04-26T10:45:54.171308+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:16.548893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"63'403","reported_seq":517,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.176947+0000","last_change":"2024-04-26T10:42:26.041850+0000","last_active":"2024-04-26T10:45:54.176947+0000","last_peered":"2024-04-26T10:45:54.176947+0000","last_clean":"2024-04-26T10:45:54.176947+0000","last_became_active":"2024-04-26T10:42:26.040464+0000","last_became_peered":"2024-04-26T10:42:26.040464+0000","last_unstale":"2024-04-26T10:45:54.176947+0000","last_undegraded":"2024-04-26T10:45:54.176947+0000","last_fullsized":"2024-04-26T10:45:54.176947+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24588,"num_write":363,"num_write_kb":51190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"62'49","reported_seq":140,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171816+0000","last_change":"2024-04-26T10:45:45.862317+0000","last_active":"2024-04-26T10:45:54.171816+0000","last_peered":"2024-04-26T10:45:54.171816+0000","last_clean":"2024-04-26T10:45:54.171816+0000","last_became_active":"2024-04-26T10:45:45.862029+0000","last_became_peered":"2024-04-26T10:45:45.862029+0000","last_unstale":"2024-04-26T10:45:54.171816+0000","last_undegraded":"2024-04-26T10:45:54.171816+0000","last_fullsized":"2024-04-26T10:45:54.171816+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:02.521534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'407","reported_seq":884,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.174973+0000","last_change":"2024-04-26T10:45:52.170710+0000","last_active":"2024-04-26T10:45:54.174973+0000","last_peered":"2024-04-26T10:45:54.174973+0000","last_clean":"2024-04-26T10:45:54.174973+0000","last_became_active":"2024-04-26T10:45:52.169295+0000","last_became_peered":"2024-04-26T10:45:52.169295+0000","last_unstale":"2024-04-26T10:45:54.174973+0000","last_undegraded":"2024-04-26T10:45:54.174973+0000","last_fullsized":"2024-04-26T10:45:54.174973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:10.995530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":7077,"num_write":367,"num_write_kb":42434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"62'66","reported_seq":157,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.180683+0000","last_change":"2024-04-26T10:45:45.874440+0000","last_active":"2024-04-26T10:45:54.180683+0000","last_peered":"2024-04-26T10:45:54.180683+0000","last_clean":"2024-04-26T10:45:54.180683+0000","last_became_active":"2024-04-26T10:45:45.874030+0000","last_became_peered":"2024-04-26T10:45:45.874030+0000","last_unstale":"2024-04-26T10:45:54.180683+0000","last_undegraded":"2024-04-26T10:45:54.180683+0000","last_fullsized":"2024-04-26T10:45:54.180683+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:22.711644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"63'406","reported_seq":895,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.173118+0000","last_change":"2024-04-26T10:45:49.863376+0000","last_active":"2024-04-26T10:45:54.173118+0000","last_peered":"2024-04-26T10:45:54.173118+0000","last_clean":"2024-04-26T10:45:54.173118+0000","last_became_active":"2024-04-26T10:45:49.861979+0000","last_became_peered":"2024-04-26T10:45:49.861979+0000","last_unstale":"2024-04-26T10:45:54.173118+0000","last_undegraded":"2024-04-26T10:45:54.173118+0000","last_fullsized":"2024-04-26T10:45:54.173118+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:16.553043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":25977,"num_write":374,"num_write_kb":104172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'66","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171194+0000","last_change":"2024-04-26T10:45:45.871507+0000","last_active":"2024-04-26T10:45:54.171194+0000","last_peered":"2024-04-26T10:45:54.171194+0000","last_clean":"2024-04-26T10:45:54.171194+0000","last_became_active":"2024-04-26T10:45:45.871120+0000","last_became_peered":"2024-04-26T10:45:45.871120+0000","last_unstale":"2024-04-26T10:45:54.171194+0000","last_undegraded":"2024-04-26T10:45:54.171194+0000","last_fullsized":"2024-04-26T10:45:54.171194+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:56.162347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"62'200","reported_seq":278,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171780+0000","last_change":"2024-04-26T10:45:48.866225+0000","last_active":"2024-04-26T10:45:54.171780+0000","last_peered":"2024-04-26T10:45:54.171780+0000","last_clean":"2024-04-26T10:45:54.171780+0000","last_became_active":"2024-04-26T10:45:48.865878+0000","last_became_peered":"2024-04-26T10:45:48.865878+0000","last_unstale":"2024-04-26T10:45:54.171780+0000","last_undegraded":"2024-04-26T10:45:54.171780+0000","last_fullsized":"2024-04-26T10:45:54.171780+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:42:39.518391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"63'415","reported_seq":897,"reported_epoch":81,"state":"active+undersized+remapped","last_fresh":"2024-04-26T10:45:55.697821+0000","last_change":"2024-04-26T10:45:55.697970+0000","last_active":"2024-04-26T10:45:55.697821+0000","last_peered":"2024-04-26T10:45:55.697821+0000","last_clean":"2024-04-26T10:43:07.780428+0000","last_became_active":"2024-04-26T10:45:46.974406+0000","last_became_peered":"2024-04-26T10:45:46.974406+0000","last_unstale":"2024-04-26T10:45:55.697821+0000","last_undegraded":"2024-04-26T10:45:55.697821+0000","last_fullsized":"2024-04-26T10:45:46.851421+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:01.679410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15757,"num_write":380,"num_write_kb":54727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"62'342","reported_seq":445,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.178620+0000","last_change":"2024-04-26T10:45:48.866915+0000","last_active":"2024-04-26T10:45:54.178620+0000","last_peered":"2024-04-26T10:45:54.178620+0000","last_clean":"2024-04-26T10:45:54.178620+0000","last_became_active":"2024-04-26T10:45:48.866497+0000","last_became_peered":"2024-04-26T10:45:48.866497+0000","last_unstale":"2024-04-26T10:45:54.178620+0000","last_undegraded":"2024-04-26T10:45:54.178620+0000","last_fullsized":"2024-04-26T10:45:54.178620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:04.796882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"63'481","reported_seq":667,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.185085+0000","last_change":"2024-04-26T10:45:54.184646+0000","last_active":"2024-04-26T10:45:54.185085+0000","last_peered":"2024-04-26T10:45:54.185085+0000","last_clean":"2024-04-26T10:45:54.185085+0000","last_became_active":"2024-04-26T10:45:54.181993+0000","last_became_peered":"2024-04-26T10:45:54.181993+0000","last_unstale":"2024-04-26T10:45:54.185085+0000","last_undegraded":"2024-04-26T10:45:54.185085+0000","last_fullsized":"2024-04-26T10:45:54.185085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:34.664600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":45251,"num_write":451,"num_write_kb":105365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"62'460","reported_seq":538,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.172875+0000","last_change":"2024-04-26T10:45:48.865887+0000","last_active":"2024-04-26T10:45:54.172875+0000","last_peered":"2024-04-26T10:45:54.172875+0000","last_clean":"2024-04-26T10:45:54.172875+0000","last_became_active":"2024-04-26T10:45:48.865520+0000","last_became_peered":"2024-04-26T10:45:48.865520+0000","last_unstale":"2024-04-26T10:45:54.172875+0000","last_undegraded":"2024-04-26T10:45:54.172875+0000","last_fullsized":"2024-04-26T10:45:54.172875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:34.308634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":407,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'420","reported_seq":887,"reported_epoch":81,"state":"active+remapped","last_fresh":"2024-04-26T10:45:55.555819+0000","last_change":"2024-04-26T10:45:55.555979+0000","last_active":"2024-04-26T10:45:55.555819+0000","last_peered":"2024-04-26T10:45:55.555819+0000","last_clean":"2024-04-26T10:45:44.691172+0000","last_became_active":"2024-04-26T10:45:54.185482+0000","last_became_peered":"2024-04-26T10:45:54.185482+0000","last_unstale":"2024-04-26T10:45:55.555819+0000","last_undegraded":"2024-04-26T10:45:55.555819+0000","last_fullsized":"2024-04-26T10:45:55.555819+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:46.333109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13025,"num_write":385,"num_write_kb":38595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[0,2],"avail_no_missing":["0","1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"62'67","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171969+0000","last_change":"2024-04-26T10:45:45.860717+0000","last_active":"2024-04-26T10:45:54.171969+0000","last_peered":"2024-04-26T10:45:54.171969+0000","last_clean":"2024-04-26T10:45:54.171969+0000","last_became_active":"2024-04-26T10:45:45.860175+0000","last_became_peered":"2024-04-26T10:45:45.860175+0000","last_unstale":"2024-04-26T10:45:54.171969+0000","last_undegraded":"2024-04-26T10:45:54.171969+0000","last_fullsized":"2024-04-26T10:45:54.171969+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:30.736518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"63'452","reported_seq":961,"reported_epoch":80,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T10:45:54.204641+0000","last_change":"2024-04-26T10:45:54.204641+0000","last_active":"2024-04-26T10:45:54.204641+0000","last_peered":"2024-04-26T10:45:54.204641+0000","last_clean":"2024-04-26T10:45:43.837618+0000","last_became_active":"2024-04-26T10:45:54.203315+0000","last_became_peered":"2024-04-26T10:45:54.203315+0000","last_unstale":"2024-04-26T10:45:54.204641+0000","last_undegraded":"2024-04-26T10:45:54.204641+0000","last_fullsized":"2024-04-26T10:45:54.204641+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:52:49.647563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":194,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23217,"num_write":416,"num_write_kb":71418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"62'200","reported_seq":267,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:54.693188+0000","last_change":"2024-04-26T10:45:55.960626+0000","last_active":"2024-04-26T10:45:55.960626+0000","last_peered":"2024-04-26T10:45:54.693188+0000","last_clean":"2024-04-26T10:45:43.837381+0000","last_became_active":"2024-04-26T10:45:54.201777+0000","last_became_peered":"2024-04-26T10:45:54.201777+0000","last_unstale":"2024-04-26T10:45:54.693188+0000","last_undegraded":"2024-04-26T10:45:54.693188+0000","last_fullsized":"2024-04-26T10:45:54.693188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:48.896541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'430","reported_seq":913,"reported_epoch":81,"state":"active+remapped","last_fresh":"2024-04-26T10:45:55.898472+0000","last_change":"2024-04-26T10:45:55.898653+0000","last_active":"2024-04-26T10:45:55.898472+0000","last_peered":"2024-04-26T10:45:55.898472+0000","last_clean":"2024-04-26T10:45:43.838420+0000","last_became_active":"2024-04-26T10:45:54.189678+0000","last_became_peered":"2024-04-26T10:45:54.189678+0000","last_unstale":"2024-04-26T10:45:55.898472+0000","last_undegraded":"2024-04-26T10:45:55.898472+0000","last_fullsized":"2024-04-26T10:45:55.898472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:24.123727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":24352,"num_write":392,"num_write_kb":21976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[0,2],"avail_no_missing":["0","1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"62'233","reported_seq":303,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171407+0000","last_change":"2024-04-26T10:45:48.862856+0000","last_active":"2024-04-26T10:45:54.171407+0000","last_peered":"2024-04-26T10:45:54.171407+0000","last_clean":"2024-04-26T10:45:54.171407+0000","last_became_active":"2024-04-26T10:45:48.862517+0000","last_became_peered":"2024-04-26T10:45:48.862517+0000","last_unstale":"2024-04-26T10:45:54.171407+0000","last_undegraded":"2024-04-26T10:45:54.171407+0000","last_fullsized":"2024-04-26T10:45:54.171407+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:43.799960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"63'393","reported_seq":475,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:45:55.180960+0000","last_change":"2024-04-26T10:45:55.180960+0000","last_active":"2024-04-26T10:45:55.180960+0000","last_peered":"2024-04-26T10:45:55.180960+0000","last_clean":"2024-04-26T10:45:55.180960+0000","last_became_active":"2024-04-26T10:45:55.177758+0000","last_became_peered":"2024-04-26T10:45:55.177758+0000","last_unstale":"2024-04-26T10:45:55.180960+0000","last_undegraded":"2024-04-26T10:45:55.180960+0000","last_fullsized":"2024-04-26T10:45:55.180960+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:47.889251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8671,"num_write":368,"num_write_kb":38542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"62'49","reported_seq":140,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.180800+0000","last_change":"2024-04-26T10:45:45.874789+0000","last_active":"2024-04-26T10:45:54.180800+0000","last_peered":"2024-04-26T10:45:54.180800+0000","last_clean":"2024-04-26T10:45:54.180800+0000","last_became_active":"2024-04-26T10:45:45.874328+0000","last_became_peered":"2024-04-26T10:45:45.874328+0000","last_unstale":"2024-04-26T10:45:54.180800+0000","last_undegraded":"2024-04-26T10:45:54.180800+0000","last_fullsized":"2024-04-26T10:45:54.180800+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:27.431661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"63'368","reported_seq":453,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:55.177356+0000","last_change":"2024-04-26T10:45:55.177356+0000","last_active":"2024-04-26T10:45:45.854419+0000","last_peered":"2024-04-26T10:45:43.838770+0000","last_clean":"2024-04-26T10:42:25.668802+0000","last_became_active":"2024-04-26T10:43:11.791331+0000","last_became_peered":"2024-04-26T10:43:11.791331+0000","last_unstale":"2024-04-26T10:45:55.177356+0000","last_undegraded":"2024-04-26T10:45:55.177356+0000","last_fullsized":"2024-04-26T10:45:55.177356+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:23.322928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":19222,"num_write":336,"num_write_kb":58903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"62'619","reported_seq":737,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:55.173549+0000","last_change":"2024-04-26T10:45:55.174640+0000","last_active":"2024-04-26T10:45:55.173549+0000","last_peered":"2024-04-26T10:45:54.265645+0000","last_clean":"2024-04-26T10:45:51.156152+0000","last_became_active":"2024-04-26T10:45:54.200111+0000","last_became_peered":"2024-04-26T10:45:54.200111+0000","last_unstale":"2024-04-26T10:45:55.173549+0000","last_undegraded":"2024-04-26T10:45:55.173549+0000","last_fullsized":"2024-04-26T10:45:55.173549+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:45.842505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":558,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"63'383","reported_seq":817,"reported_epoch":80,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T10:45:54.196892+0000","last_change":"2024-04-26T10:45:54.196892+0000","last_active":"2024-04-26T10:45:54.196892+0000","last_peered":"2024-04-26T10:45:54.196892+0000","last_clean":"2024-04-26T10:45:51.156554+0000","last_became_active":"2024-04-26T10:45:54.195746+0000","last_became_peered":"2024-04-26T10:45:54.195746+0000","last_unstale":"2024-04-26T10:45:54.196892+0000","last_undegraded":"2024-04-26T10:45:54.177564+0000","last_fullsized":"2024-04-26T10:45:54.173407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:34.841726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":14260,"num_write":349,"num_write_kb":50367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":226,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.170990+0000","last_change":"2024-04-26T10:45:45.871511+0000","last_active":"2024-04-26T10:45:54.170990+0000","last_peered":"2024-04-26T10:45:54.170990+0000","last_clean":"2024-04-26T10:45:54.170990+0000","last_became_active":"2024-04-26T10:45:45.871155+0000","last_became_peered":"2024-04-26T10:45:45.871155+0000","last_unstale":"2024-04-26T10:45:54.170990+0000","last_undegraded":"2024-04-26T10:45:54.170990+0000","last_fullsized":"2024-04-26T10:45:54.170990+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:53.015361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171104+0000","last_change":"2024-04-26T10:45:45.861068+0000","last_active":"2024-04-26T10:45:54.171104+0000","last_peered":"2024-04-26T10:45:54.171104+0000","last_clean":"2024-04-26T10:45:54.171104+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:54.171104+0000","last_undegraded":"2024-04-26T10:45:54.171104+0000","last_fullsized":"2024-04-26T10:45:54.171104+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:16.348009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"62'743","reported_seq":821,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171968+0000","last_change":"2024-04-26T10:42:25.686765+0000","last_active":"2024-04-26T10:45:54.171968+0000","last_peered":"2024-04-26T10:45:54.171968+0000","last_clean":"2024-04-26T10:45:54.171968+0000","last_became_active":"2024-04-26T10:42:25.686009+0000","last_became_peered":"2024-04-26T10:42:25.686009+0000","last_unstale":"2024-04-26T10:45:54.171968+0000","last_undegraded":"2024-04-26T10:45:54.171968+0000","last_fullsized":"2024-04-26T10:45:54.171968+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:54.627815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'442","reported_seq":564,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:45:55.181074+0000","last_change":"2024-04-26T10:45:55.181074+0000","last_active":"2024-04-26T10:45:55.181074+0000","last_peered":"2024-04-26T10:45:55.181074+0000","last_clean":"2024-04-26T10:45:55.181074+0000","last_became_active":"2024-04-26T10:45:55.177751+0000","last_became_peered":"2024-04-26T10:45:55.177751+0000","last_unstale":"2024-04-26T10:45:55.181074+0000","last_undegraded":"2024-04-26T10:45:55.181074+0000","last_fullsized":"2024-04-26T10:45:55.181074+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:01.323521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":34346,"num_write":406,"num_write_kb":96298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171394+0000","last_change":"2024-04-26T10:45:45.872099+0000","last_active":"2024-04-26T10:45:54.171394+0000","last_peered":"2024-04-26T10:45:54.171394+0000","last_clean":"2024-04-26T10:45:54.171394+0000","last_became_active":"2024-04-26T10:45:45.871741+0000","last_became_peered":"2024-04-26T10:45:45.871741+0000","last_unstale":"2024-04-26T10:45:54.171394+0000","last_undegraded":"2024-04-26T10:45:54.171394+0000","last_fullsized":"2024-04-26T10:45:54.171394+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:53.226378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"63'102","reported_seq":209,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:54.219118+0000","last_change":"2024-04-26T10:45:55.960530+0000","last_active":"2024-04-26T10:45:55.960530+0000","last_peered":"2024-04-26T10:45:54.219118+0000","last_clean":"2024-04-26T10:45:43.837073+0000","last_became_active":"2024-04-26T10:45:54.189849+0000","last_became_peered":"2024-04-26T10:45:54.189849+0000","last_unstale":"2024-04-26T10:45:54.219118+0000","last_undegraded":"2024-04-26T10:45:54.219118+0000","last_fullsized":"2024-04-26T10:45:54.219118+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:47.864335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467631,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":44,"num_write_kb":1460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2935262,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'485","reported_seq":708,"reported_epoch":81,"state":"active+recovering+remapped","last_fresh":"2024-04-26T10:45:55.943974+0000","last_change":"2024-04-26T10:45:55.899260+0000","last_active":"2024-04-26T10:45:55.943974+0000","last_peered":"2024-04-26T10:45:55.943974+0000","last_clean":"2024-04-26T10:45:43.839082+0000","last_became_active":"2024-04-26T10:45:54.190438+0000","last_became_peered":"2024-04-26T10:45:54.190438+0000","last_unstale":"2024-04-26T10:45:55.943974+0000","last_undegraded":"2024-04-26T10:45:55.943974+0000","last_fullsized":"2024-04-26T10:45:55.943974+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:53.580696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27703,"num_write":454,"num_write_kb":121509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":38,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681001+0000","last_change":"2024-04-26T10:45:53.180892+0000","last_active":"2024-04-26T10:45:54.681001+0000","last_peered":"2024-04-26T10:45:54.681001+0000","last_clean":"2024-04-26T10:45:54.681001+0000","last_became_active":"2024-04-26T10:45:53.180675+0000","last_became_peered":"2024-04-26T10:45:53.180675+0000","last_unstale":"2024-04-26T10:45:54.681001+0000","last_undegraded":"2024-04-26T10:45:54.681001+0000","last_fullsized":"2024-04-26T10:45:54.681001+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:45.758505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"62'306","reported_seq":410,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.179256+0000","last_change":"2024-04-26T10:45:48.865095+0000","last_active":"2024-04-26T10:45:54.179256+0000","last_peered":"2024-04-26T10:45:54.179256+0000","last_clean":"2024-04-26T10:45:54.179256+0000","last_became_active":"2024-04-26T10:45:48.864763+0000","last_became_peered":"2024-04-26T10:45:48.864763+0000","last_unstale":"2024-04-26T10:45:54.179256+0000","last_undegraded":"2024-04-26T10:45:54.179256+0000","last_fullsized":"2024-04-26T10:45:54.179256+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:12.665388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"63'336","reported_seq":743,"reported_epoch":80,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T10:45:54.196130+0000","last_change":"2024-04-26T10:45:54.196130+0000","last_active":"2024-04-26T10:45:54.196130+0000","last_peered":"2024-04-26T10:45:54.196130+0000","last_clean":"2024-04-26T10:45:51.156451+0000","last_became_active":"2024-04-26T10:45:54.195199+0000","last_became_peered":"2024-04-26T10:45:54.195199+0000","last_unstale":"2024-04-26T10:45:54.196130+0000","last_undegraded":"2024-04-26T10:45:54.176438+0000","last_fullsized":"2024-04-26T10:45:54.173233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:00:49.770197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":153,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12035,"num_write":314,"num_write_kb":29928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171029+0000","last_change":"2024-04-26T10:45:45.861233+0000","last_active":"2024-04-26T10:45:54.171029+0000","last_peered":"2024-04-26T10:45:54.171029+0000","last_clean":"2024-04-26T10:45:54.171029+0000","last_became_active":"2024-04-26T10:45:45.860924+0000","last_became_peered":"2024-04-26T10:45:45.860924+0000","last_unstale":"2024-04-26T10:45:54.171029+0000","last_undegraded":"2024-04-26T10:45:54.171029+0000","last_fullsized":"2024-04-26T10:45:54.171029+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:11.746110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"62'64","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171254+0000","last_change":"2024-04-26T10:45:45.861230+0000","last_active":"2024-04-26T10:45:54.171254+0000","last_peered":"2024-04-26T10:45:54.171254+0000","last_clean":"2024-04-26T10:45:54.171254+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:54.171254+0000","last_undegraded":"2024-04-26T10:45:54.171254+0000","last_fullsized":"2024-04-26T10:45:54.171254+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:53.564033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"63'421","reported_seq":510,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681036+0000","last_change":"2024-04-26T10:45:54.188138+0000","last_active":"2024-04-26T10:45:54.681036+0000","last_peered":"2024-04-26T10:45:54.681036+0000","last_clean":"2024-04-26T10:45:54.681036+0000","last_became_active":"2024-04-26T10:45:54.185053+0000","last_became_peered":"2024-04-26T10:45:54.185053+0000","last_unstale":"2024-04-26T10:45:54.681036+0000","last_undegraded":"2024-04-26T10:45:54.681036+0000","last_fullsized":"2024-04-26T10:45:54.681036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:55:26.158040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28557,"num_write":385,"num_write_kb":93083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"62'480","reported_seq":550,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171717+0000","last_change":"2024-04-26T10:45:48.862894+0000","last_active":"2024-04-26T10:45:54.171717+0000","last_peered":"2024-04-26T10:45:54.171717+0000","last_clean":"2024-04-26T10:45:54.171717+0000","last_became_active":"2024-04-26T10:45:48.862564+0000","last_became_peered":"2024-04-26T10:45:48.862564+0000","last_unstale":"2024-04-26T10:45:54.171717+0000","last_undegraded":"2024-04-26T10:45:54.171717+0000","last_fullsized":"2024-04-26T10:45:54.171717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:38.835403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":81,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.172444+0000","last_change":"2024-04-26T10:42:21.405754+0000","last_active":"2024-04-26T10:45:54.172444+0000","last_peered":"2024-04-26T10:45:54.172444+0000","last_clean":"2024-04-26T10:45:54.172444+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:45:54.172444+0000","last_undegraded":"2024-04-26T10:45:54.172444+0000","last_fullsized":"2024-04-26T10:45:54.172444+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:47.123256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'352","reported_seq":773,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.175671+0000","last_change":"2024-04-26T10:45:53.183401+0000","last_active":"2024-04-26T10:45:54.175671+0000","last_peered":"2024-04-26T10:45:54.175671+0000","last_clean":"2024-04-26T10:45:54.175671+0000","last_became_active":"2024-04-26T10:45:53.182454+0000","last_became_peered":"2024-04-26T10:45:53.182454+0000","last_unstale":"2024-04-26T10:45:54.175671+0000","last_undegraded":"2024-04-26T10:45:54.175671+0000","last_fullsized":"2024-04-26T10:45:54.175671+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:38.569626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":1905,"num_write":313,"num_write_kb":25573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"62'59","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681025+0000","last_change":"2024-04-26T10:45:53.177446+0000","last_active":"2024-04-26T10:45:54.681025+0000","last_peered":"2024-04-26T10:45:54.681025+0000","last_clean":"2024-04-26T10:45:54.681025+0000","last_became_active":"2024-04-26T10:45:53.176996+0000","last_became_peered":"2024-04-26T10:45:53.176996+0000","last_unstale":"2024-04-26T10:45:54.681025+0000","last_undegraded":"2024-04-26T10:45:54.681025+0000","last_fullsized":"2024-04-26T10:45:54.681025+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:23.679423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.174521+0000","last_change":"2024-04-26T10:45:53.175046+0000","last_active":"2024-04-26T10:45:54.174521+0000","last_peered":"2024-04-26T10:45:54.174521+0000","last_clean":"2024-04-26T10:45:54.174521+0000","last_became_active":"2024-04-26T10:45:53.174781+0000","last_became_peered":"2024-04-26T10:45:53.174781+0000","last_unstale":"2024-04-26T10:45:54.174521+0000","last_undegraded":"2024-04-26T10:45:54.174521+0000","last_fullsized":"2024-04-26T10:45:54.174521+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:22.742084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'408","reported_seq":904,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.186926+0000","last_change":"2024-04-26T10:45:54.186637+0000","last_active":"2024-04-26T10:45:54.186926+0000","last_peered":"2024-04-26T10:45:54.186926+0000","last_clean":"2024-04-26T10:45:54.186926+0000","last_became_active":"2024-04-26T10:45:54.185238+0000","last_became_peered":"2024-04-26T10:45:54.185238+0000","last_unstale":"2024-04-26T10:45:54.186926+0000","last_undegraded":"2024-04-26T10:45:54.186926+0000","last_fullsized":"2024-04-26T10:45:54.186926+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:54.735683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19939,"num_write":382,"num_write_kb":63433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"62'55","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681180+0000","last_change":"2024-04-26T10:45:53.205131+0000","last_active":"2024-04-26T10:45:54.681180+0000","last_peered":"2024-04-26T10:45:54.681180+0000","last_clean":"2024-04-26T10:45:54.681180+0000","last_became_active":"2024-04-26T10:45:53.177305+0000","last_became_peered":"2024-04-26T10:45:53.177305+0000","last_unstale":"2024-04-26T10:45:54.681180+0000","last_undegraded":"2024-04-26T10:45:54.681180+0000","last_fullsized":"2024-04-26T10:45:54.681180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:30.829530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681063+0000","last_change":"2024-04-26T10:45:53.177593+0000","last_active":"2024-04-26T10:45:54.681063+0000","last_peered":"2024-04-26T10:45:54.681063+0000","last_clean":"2024-04-26T10:45:54.681063+0000","last_became_active":"2024-04-26T10:45:53.177249+0000","last_became_peered":"2024-04-26T10:45:53.177249+0000","last_unstale":"2024-04-26T10:45:54.681063+0000","last_undegraded":"2024-04-26T10:45:54.681063+0000","last_fullsized":"2024-04-26T10:45:54.681063+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:41.564852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'418","reported_seq":867,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:55.173634+0000","last_change":"2024-04-26T10:45:55.174039+0000","last_active":"2024-04-26T10:45:55.173634+0000","last_peered":"2024-04-26T10:45:54.680875+0000","last_clean":"2024-04-26T10:45:43.837000+0000","last_became_active":"2024-04-26T10:45:54.178289+0000","last_became_peered":"2024-04-26T10:45:54.178289+0000","last_unstale":"2024-04-26T10:45:55.173634+0000","last_undegraded":"2024-04-26T10:45:55.173634+0000","last_fullsized":"2024-04-26T10:45:55.173634+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:21.326365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20110,"num_write":390,"num_write_kb":75171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"64'66","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681129+0000","last_change":"2024-04-26T10:45:53.203538+0000","last_active":"2024-04-26T10:45:54.681129+0000","last_peered":"2024-04-26T10:45:54.681129+0000","last_clean":"2024-04-26T10:45:54.681129+0000","last_became_active":"2024-04-26T10:45:53.175946+0000","last_became_peered":"2024-04-26T10:45:53.175946+0000","last_unstale":"2024-04-26T10:45:54.681129+0000","last_undegraded":"2024-04-26T10:45:54.681129+0000","last_fullsized":"2024-04-26T10:45:54.681129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:15.016761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171642+0000","last_change":"2024-04-26T10:45:45.872224+0000","last_active":"2024-04-26T10:45:54.171642+0000","last_peered":"2024-04-26T10:45:54.171642+0000","last_clean":"2024-04-26T10:45:54.171642+0000","last_became_active":"2024-04-26T10:45:45.871923+0000","last_became_peered":"2024-04-26T10:45:45.871923+0000","last_unstale":"2024-04-26T10:45:54.171642+0000","last_undegraded":"2024-04-26T10:45:54.171642+0000","last_fullsized":"2024-04-26T10:45:54.171642+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:00.334874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"63'404","reported_seq":918,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.184887+0000","last_change":"2024-04-26T10:45:54.184386+0000","last_active":"2024-04-26T10:45:54.184887+0000","last_peered":"2024-04-26T10:45:54.184887+0000","last_clean":"2024-04-26T10:45:54.184887+0000","last_became_active":"2024-04-26T10:45:54.181795+0000","last_became_peered":"2024-04-26T10:45:54.181795+0000","last_unstale":"2024-04-26T10:45:54.184887+0000","last_undegraded":"2024-04-26T10:45:54.184887+0000","last_fullsized":"2024-04-26T10:45:54.184887+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:10.290362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41262,"num_write":371,"num_write_kb":75820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"63'441","reported_seq":561,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.188931+0000","last_change":"2024-04-26T10:45:54.188488+0000","last_active":"2024-04-26T10:45:54.188931+0000","last_peered":"2024-04-26T10:45:54.188931+0000","last_clean":"2024-04-26T10:45:54.188931+0000","last_became_active":"2024-04-26T10:45:54.185862+0000","last_became_peered":"2024-04-26T10:45:54.185862+0000","last_unstale":"2024-04-26T10:45:54.188931+0000","last_undegraded":"2024-04-26T10:45:54.188931+0000","last_fullsized":"2024-04-26T10:45:54.188931+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:07.585438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31514,"num_write":408,"num_write_kb":107129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"64'431","reported_seq":517,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171793+0000","last_change":"2024-04-26T10:45:48.865579+0000","last_active":"2024-04-26T10:45:54.171793+0000","last_peered":"2024-04-26T10:45:54.171793+0000","last_clean":"2024-04-26T10:45:54.171793+0000","last_became_active":"2024-04-26T10:45:48.865212+0000","last_became_peered":"2024-04-26T10:45:48.865212+0000","last_unstale":"2024-04-26T10:45:54.171793+0000","last_undegraded":"2024-04-26T10:45:54.171793+0000","last_fullsized":"2024-04-26T10:45:54.171793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:53.808562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9902610,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":9913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9896193,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"63'410","reported_seq":512,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.185024+0000","last_change":"2024-04-26T10:45:54.184713+0000","last_active":"2024-04-26T10:45:54.185024+0000","last_peered":"2024-04-26T10:45:54.185024+0000","last_clean":"2024-04-26T10:45:54.185024+0000","last_became_active":"2024-04-26T10:45:54.182167+0000","last_became_peered":"2024-04-26T10:45:54.182167+0000","last_unstale":"2024-04-26T10:45:54.185024+0000","last_undegraded":"2024-04-26T10:45:54.185024+0000","last_fullsized":"2024-04-26T10:45:54.185024+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:41:50.625629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12734,"num_write":373,"num_write_kb":34864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"63'84","reported_seq":180,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.177612+0000","last_change":"2024-04-26T10:45:45.896842+0000","last_active":"2024-04-26T10:45:54.177612+0000","last_peered":"2024-04-26T10:45:54.177612+0000","last_clean":"2024-04-26T10:45:54.177612+0000","last_became_active":"2024-04-26T10:45:45.874746+0000","last_became_peered":"2024-04-26T10:45:45.874746+0000","last_unstale":"2024-04-26T10:45:54.177612+0000","last_undegraded":"2024-04-26T10:45:54.177612+0000","last_fullsized":"2024-04-26T10:45:54.177612+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:22.649667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"62'332","reported_seq":409,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:55.176118+0000","last_change":"2024-04-26T10:45:55.176257+0000","last_active":"2024-04-26T10:45:55.176118+0000","last_peered":"2024-04-26T10:45:54.234750+0000","last_clean":"2024-04-26T10:45:51.159828+0000","last_became_active":"2024-04-26T10:45:54.192100+0000","last_became_peered":"2024-04-26T10:45:54.192100+0000","last_unstale":"2024-04-26T10:45:55.176118+0000","last_undegraded":"2024-04-26T10:45:55.176118+0000","last_fullsized":"2024-04-26T10:45:55.176118+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:48:28.024916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"63'487","reported_seq":1093,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.172709+0000","last_change":"2024-04-26T10:45:51.160586+0000","last_active":"2024-04-26T10:45:54.172709+0000","last_peered":"2024-04-26T10:45:54.172709+0000","last_clean":"2024-04-26T10:45:54.172709+0000","last_became_active":"2024-04-26T10:45:51.159235+0000","last_became_peered":"2024-04-26T10:45:51.159235+0000","last_unstale":"2024-04-26T10:45:54.172709+0000","last_undegraded":"2024-04-26T10:45:54.172709+0000","last_fullsized":"2024-04-26T10:45:54.172709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:54.234867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":43316,"num_write":468,"num_write_kb":77062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"62'61","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681170+0000","last_change":"2024-04-26T10:45:53.174204+0000","last_active":"2024-04-26T10:45:54.681170+0000","last_peered":"2024-04-26T10:45:54.681170+0000","last_clean":"2024-04-26T10:45:54.681170+0000","last_became_active":"2024-04-26T10:45:53.173851+0000","last_became_peered":"2024-04-26T10:45:53.173851+0000","last_unstale":"2024-04-26T10:45:54.681170+0000","last_undegraded":"2024-04-26T10:45:54.681170+0000","last_fullsized":"2024-04-26T10:45:54.681170+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:50.698470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'457","reported_seq":533,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.680854+0000","last_change":"2024-04-26T10:45:54.199966+0000","last_active":"2024-04-26T10:45:54.680854+0000","last_peered":"2024-04-26T10:45:54.680854+0000","last_clean":"2024-04-26T10:45:54.680854+0000","last_became_active":"2024-04-26T10:45:54.189622+0000","last_became_peered":"2024-04-26T10:45:54.189622+0000","last_unstale":"2024-04-26T10:45:54.680854+0000","last_undegraded":"2024-04-26T10:45:54.680854+0000","last_fullsized":"2024-04-26T10:45:54.680854+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:53.540098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14848,"num_write":427,"num_write_kb":71903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'377","reported_seq":835,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.180067+0000","last_change":"2024-04-26T10:45:49.867665+0000","last_active":"2024-04-26T10:45:54.180067+0000","last_peered":"2024-04-26T10:45:54.180067+0000","last_clean":"2024-04-26T10:45:54.180067+0000","last_became_active":"2024-04-26T10:45:49.866707+0000","last_became_peered":"2024-04-26T10:45:49.866707+0000","last_unstale":"2024-04-26T10:45:54.180067+0000","last_undegraded":"2024-04-26T10:45:54.180067+0000","last_fullsized":"2024-04-26T10:45:54.180067+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:23.401341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26932,"num_write":349,"num_write_kb":55611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"62'562","reported_seq":640,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.172762+0000","last_change":"2024-04-26T10:42:25.683890+0000","last_active":"2024-04-26T10:45:54.172762+0000","last_peered":"2024-04-26T10:45:54.172762+0000","last_clean":"2024-04-26T10:45:54.172762+0000","last_became_active":"2024-04-26T10:42:25.683467+0000","last_became_peered":"2024-04-26T10:42:25.683467+0000","last_unstale":"2024-04-26T10:45:54.172762+0000","last_undegraded":"2024-04-26T10:45:54.172762+0000","last_fullsized":"2024-04-26T10:45:54.172762+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":8440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'425","reported_seq":868,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:55.174733+0000","last_change":"2024-04-26T10:45:55.174882+0000","last_active":"2024-04-26T10:45:55.174733+0000","last_peered":"2024-04-26T10:45:54.829980+0000","last_clean":"2024-04-26T10:45:43.839496+0000","last_became_active":"2024-04-26T10:45:54.179182+0000","last_became_peered":"2024-04-26T10:45:54.179182+0000","last_unstale":"2024-04-26T10:45:55.174733+0000","last_undegraded":"2024-04-26T10:45:55.174733+0000","last_fullsized":"2024-04-26T10:45:55.174733+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:00.918761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":19004,"num_write":390,"num_write_kb":75524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"62'259","reported_seq":321,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:54.249667+0000","last_change":"2024-04-26T10:45:55.960570+0000","last_active":"2024-04-26T10:45:55.960570+0000","last_peered":"2024-04-26T10:45:54.249667+0000","last_clean":"2024-04-26T10:45:43.837444+0000","last_became_active":"2024-04-26T10:45:54.194244+0000","last_became_peered":"2024-04-26T10:45:54.194244+0000","last_unstale":"2024-04-26T10:45:54.249667+0000","last_undegraded":"2024-04-26T10:45:54.249667+0000","last_fullsized":"2024-04-26T10:45:54.249667+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:50.232753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'418","reported_seq":926,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:45:55.179671+0000","last_change":"2024-04-26T10:45:55.179671+0000","last_active":"2024-04-26T10:45:55.179671+0000","last_peered":"2024-04-26T10:45:55.179671+0000","last_clean":"2024-04-26T10:45:55.179671+0000","last_became_active":"2024-04-26T10:45:55.178079+0000","last_became_peered":"2024-04-26T10:45:55.178079+0000","last_unstale":"2024-04-26T10:45:55.179671+0000","last_undegraded":"2024-04-26T10:45:55.179671+0000","last_fullsized":"2024-04-26T10:45:55.179671+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:36.749926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":34476,"num_write":379,"num_write_kb":101645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"62'494","reported_seq":572,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.175864+0000","last_change":"2024-04-26T10:42:25.688221+0000","last_active":"2024-04-26T10:45:54.175864+0000","last_peered":"2024-04-26T10:45:54.175864+0000","last_clean":"2024-04-26T10:45:54.175864+0000","last_became_active":"2024-04-26T10:42:25.687829+0000","last_became_peered":"2024-04-26T10:42:25.687829+0000","last_unstale":"2024-04-26T10:45:54.175864+0000","last_undegraded":"2024-04-26T10:45:54.175864+0000","last_fullsized":"2024-04-26T10:45:54.175864+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:05.939715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":12543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"63'406","reported_seq":583,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.192518+0000","last_change":"2024-04-26T10:45:54.192178+0000","last_active":"2024-04-26T10:45:54.192518+0000","last_peered":"2024-04-26T10:45:54.192518+0000","last_clean":"2024-04-26T10:45:54.192518+0000","last_became_active":"2024-04-26T10:45:54.189591+0000","last_became_peered":"2024-04-26T10:45:54.189591+0000","last_unstale":"2024-04-26T10:45:54.192518+0000","last_undegraded":"2024-04-26T10:45:54.192518+0000","last_fullsized":"2024-04-26T10:45:54.192518+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:31.509288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":45941,"num_write":372,"num_write_kb":80011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"62'61","reported_seq":157,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.182850+0000","last_change":"2024-04-26T10:45:45.895125+0000","last_active":"2024-04-26T10:45:54.182850+0000","last_peered":"2024-04-26T10:45:54.182850+0000","last_clean":"2024-04-26T10:45:54.182850+0000","last_became_active":"2024-04-26T10:45:45.874300+0000","last_became_peered":"2024-04-26T10:45:45.874300+0000","last_unstale":"2024-04-26T10:45:54.182850+0000","last_undegraded":"2024-04-26T10:45:54.182850+0000","last_fullsized":"2024-04-26T10:45:54.182850+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:26.528893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"63'375","reported_seq":813,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:55.175417+0000","last_change":"2024-04-26T10:45:55.175576+0000","last_active":"2024-04-26T10:45:55.175417+0000","last_peered":"2024-04-26T10:45:54.609438+0000","last_clean":"2024-04-26T10:45:51.158641+0000","last_became_active":"2024-04-26T10:45:54.201498+0000","last_became_peered":"2024-04-26T10:45:54.201498+0000","last_unstale":"2024-04-26T10:45:55.175417+0000","last_undegraded":"2024-04-26T10:45:55.175417+0000","last_fullsized":"2024-04-26T10:45:55.175417+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:07:05.872684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16213,"num_write":354,"num_write_kb":54493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":332,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"62'276","reported_seq":358,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:55.174759+0000","last_change":"2024-04-26T10:45:55.174990+0000","last_active":"2024-04-26T10:45:55.174759+0000","last_peered":"2024-04-26T10:45:54.213038+0000","last_clean":"2024-04-26T10:45:51.158694+0000","last_became_active":"2024-04-26T10:45:54.188211+0000","last_became_peered":"2024-04-26T10:45:54.188211+0000","last_unstale":"2024-04-26T10:45:55.174759+0000","last_undegraded":"2024-04-26T10:45:55.174759+0000","last_fullsized":"2024-04-26T10:45:55.174759+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:25.225758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"63'379","reported_seq":472,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171548+0000","last_change":"2024-04-26T10:45:53.177365+0000","last_active":"2024-04-26T10:45:54.171548+0000","last_peered":"2024-04-26T10:45:54.171548+0000","last_clean":"2024-04-26T10:45:54.171548+0000","last_became_active":"2024-04-26T10:45:53.173645+0000","last_became_peered":"2024-04-26T10:45:53.173645+0000","last_unstale":"2024-04-26T10:45:54.171548+0000","last_undegraded":"2024-04-26T10:45:54.171548+0000","last_fullsized":"2024-04-26T10:45:54.171548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:32.390075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20480,"num_write":343,"num_write_kb":25788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"62'237","reported_seq":344,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.177488+0000","last_change":"2024-04-26T10:45:48.867081+0000","last_active":"2024-04-26T10:45:54.177488+0000","last_peered":"2024-04-26T10:45:54.177488+0000","last_clean":"2024-04-26T10:45:54.177488+0000","last_became_active":"2024-04-26T10:45:48.866716+0000","last_became_peered":"2024-04-26T10:45:48.866716+0000","last_unstale":"2024-04-26T10:45:54.177488+0000","last_undegraded":"2024-04-26T10:45:54.177488+0000","last_fullsized":"2024-04-26T10:45:54.177488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:16.712392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":12393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"63'419","reported_seq":567,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.180904+0000","last_change":"2024-04-26T10:42:26.041729+0000","last_active":"2024-04-26T10:45:54.180904+0000","last_peered":"2024-04-26T10:45:54.180904+0000","last_clean":"2024-04-26T10:45:54.180904+0000","last_became_active":"2024-04-26T10:42:26.040504+0000","last_became_peered":"2024-04-26T10:42:26.040504+0000","last_unstale":"2024-04-26T10:45:54.180904+0000","last_undegraded":"2024-04-26T10:45:54.180904+0000","last_fullsized":"2024-04-26T10:45:54.180904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39582,"num_write":378,"num_write_kb":54867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"62'61","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681119+0000","last_change":"2024-04-26T10:45:53.227750+0000","last_active":"2024-04-26T10:45:54.681119+0000","last_peered":"2024-04-26T10:45:54.681119+0000","last_clean":"2024-04-26T10:45:54.681119+0000","last_became_active":"2024-04-26T10:45:53.178804+0000","last_became_peered":"2024-04-26T10:45:53.178804+0000","last_unstale":"2024-04-26T10:45:54.681119+0000","last_undegraded":"2024-04-26T10:45:54.681119+0000","last_fullsized":"2024-04-26T10:45:54.681119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:56.795614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'437","reported_seq":520,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171483+0000","last_change":"2024-04-26T10:45:53.181155+0000","last_active":"2024-04-26T10:45:54.171483+0000","last_peered":"2024-04-26T10:45:54.171483+0000","last_clean":"2024-04-26T10:45:54.171483+0000","last_became_active":"2024-04-26T10:45:53.177071+0000","last_became_peered":"2024-04-26T10:45:53.177071+0000","last_unstale":"2024-04-26T10:45:54.171483+0000","last_undegraded":"2024-04-26T10:45:54.171483+0000","last_fullsized":"2024-04-26T10:45:54.171483+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:34.219319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":7562,"num_write":400,"num_write_kb":26121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"62'58","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681149+0000","last_change":"2024-04-26T10:45:53.197669+0000","last_active":"2024-04-26T10:45:54.681149+0000","last_peered":"2024-04-26T10:45:54.681149+0000","last_clean":"2024-04-26T10:45:54.681149+0000","last_became_active":"2024-04-26T10:45:53.173542+0000","last_became_peered":"2024-04-26T10:45:53.173542+0000","last_unstale":"2024-04-26T10:45:54.681149+0000","last_undegraded":"2024-04-26T10:45:54.681149+0000","last_fullsized":"2024-04-26T10:45:54.681149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:34.409430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":494,"num_objects_misplaced":354,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2672,"num_read_kb":1454712,"num_write":24538,"num_write_kb":4190103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7874,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26671,"ondisk_log_size":26671,"up":128,"acting":121,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128811551,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":5770,"num_write_kb":129888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":288526336,"data_stored":288451443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},"log_size":7595,"ondisk_log_size":7595,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738415,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":179292,"kb_used_data":80136,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94192548,"statfs":{"total":96636764160,"available":96453169152,"internally_reserved":0,"allocated":82059264,"data_stored":81552721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:45:25 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.20300000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42599999999999999,"15min":0.436},"min":{"1min":0.26000000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]}]},{"osd":1,"up_from":70,"seq":300647710724,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148276,"kb_used_data":94508,"kb_used_omap":7,"kb_used_meta":53752,"kb_avail":94223564,"statfs":{"total":96636764160,"available":96484929536,"internally_reserved":0,"allocated":96776192,"data_stored":96240185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7181,"internal_metadata":55043059},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738416,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":240368,"kb_used_data":110884,"kb_used_omap":1,"kb_used_meta":129470,"kb_avail":94131472,"statfs":{"total":96636764160,"available":96390627328,"internally_reserved":0,"allocated":113545216,"data_stored":113017367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132577734},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":2,"last update":"Fri Apr 26 10:45:26 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.43099999999999999,"15min":0.44900000000000001},"min":{"1min":0.21199999999999999,"5min":0.183,"15min":0.183},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.253},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.442,"15min":0.46500000000000002},"min":{"1min":0.23499999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57199999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.23999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":112062464,"data_stored":112034301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":95293440,"data_stored":95257119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81170432,"data_stored":81160023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:45:59.404 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:45:59.737 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:45:59.738 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:45:59.748 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-04-26T10:45:59.649887+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129401919,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":494,"num_objects_misplaced":194,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2852,"num_read_kb":1456290,"num_write":30511,"num_write_kb":4323451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8565,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34423,"ondisk_log_size":34423,"up":210,"acting":203,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":222,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":555688,"kb_used_data":281460,"kb_used_omap":10,"kb_used_meta":274165,"kb_avail":282559832,"statfs":{"total":289910292480,"available":289341267968,"internally_reserved":0,"allocated":288215040,"data_stored":286629351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10369,"internal_metadata":280745855},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1174,"num_objects_misplaced":-733,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2732,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.478881"},"pg_stats":[{"pgid":"4.3f","version":"63'415","reported_seq":538,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.179264+0000","last_change":"2024-04-26T10:42:26.045527+0000","last_active":"2024-04-26T10:45:54.179264+0000","last_peered":"2024-04-26T10:45:54.179264+0000","last_clean":"2024-04-26T10:45:54.179264+0000","last_became_active":"2024-04-26T10:42:26.044597+0000","last_became_peered":"2024-04-26T10:42:26.044597+0000","last_unstale":"2024-04-26T10:45:54.179264+0000","last_undegraded":"2024-04-26T10:45:54.179264+0000","last_fullsized":"2024-04-26T10:45:54.179264+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22963,"num_write":385,"num_write_kb":71406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"63'396","reported_seq":518,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.195053+0000","last_change":"2024-04-26T10:45:54.194523+0000","last_active":"2024-04-26T10:45:54.195053+0000","last_peered":"2024-04-26T10:45:54.195053+0000","last_clean":"2024-04-26T10:45:54.195053+0000","last_became_active":"2024-04-26T10:45:54.192613+0000","last_became_peered":"2024-04-26T10:45:54.192613+0000","last_unstale":"2024-04-26T10:45:54.195053+0000","last_undegraded":"2024-04-26T10:45:54.195053+0000","last_fullsized":"2024-04-26T10:45:54.195053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:22.723004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9499,"num_write":371,"num_write_kb":38601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"63'366","reported_seq":449,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161698+0000","last_change":"2024-04-26T10:45:55.183758+0000","last_active":"2024-04-26T10:45:57.161698+0000","last_peered":"2024-04-26T10:45:57.161698+0000","last_clean":"2024-04-26T10:45:57.161698+0000","last_became_active":"2024-04-26T10:45:55.180991+0000","last_became_peered":"2024-04-26T10:45:55.180991+0000","last_unstale":"2024-04-26T10:45:57.161698+0000","last_undegraded":"2024-04-26T10:45:57.161698+0000","last_fullsized":"2024-04-26T10:45:57.161698+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:29.645448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6211,"num_write":338,"num_write_kb":38844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"63'394","reported_seq":545,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160935+0000","last_change":"2024-04-26T10:45:51.162341+0000","last_active":"2024-04-26T10:45:57.160935+0000","last_peered":"2024-04-26T10:45:57.160935+0000","last_clean":"2024-04-26T10:45:57.160935+0000","last_became_active":"2024-04-26T10:45:51.159099+0000","last_became_peered":"2024-04-26T10:45:51.159099+0000","last_unstale":"2024-04-26T10:45:57.160935+0000","last_undegraded":"2024-04-26T10:45:57.160935+0000","last_fullsized":"2024-04-26T10:45:57.160935+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:18.605866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":52323,"num_write":357,"num_write_kb":63323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"63'409","reported_seq":504,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.182764+0000","last_change":"2024-04-26T10:42:26.041191+0000","last_active":"2024-04-26T10:45:54.182764+0000","last_peered":"2024-04-26T10:45:54.182764+0000","last_clean":"2024-04-26T10:45:54.182764+0000","last_became_active":"2024-04-26T10:42:26.040487+0000","last_became_peered":"2024-04-26T10:42:26.040487+0000","last_unstale":"2024-04-26T10:45:54.182764+0000","last_undegraded":"2024-04-26T10:45:54.182764+0000","last_fullsized":"2024-04-26T10:45:54.182764+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":372,"num_write_kb":42764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'385","reported_seq":464,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161234+0000","last_change":"2024-04-26T10:45:49.864662+0000","last_active":"2024-04-26T10:45:57.161234+0000","last_peered":"2024-04-26T10:45:57.161234+0000","last_clean":"2024-04-26T10:45:57.161234+0000","last_became_active":"2024-04-26T10:45:49.861811+0000","last_became_peered":"2024-04-26T10:45:49.861811+0000","last_unstale":"2024-04-26T10:45:57.161234+0000","last_undegraded":"2024-04-26T10:45:57.161234+0000","last_fullsized":"2024-04-26T10:45:57.161234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:25.549464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4124,"num_write":356,"num_write_kb":69857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"63'425","reported_seq":534,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160809+0000","last_change":"2024-04-26T10:45:50.869572+0000","last_active":"2024-04-26T10:45:57.160809+0000","last_peered":"2024-04-26T10:45:57.160809+0000","last_clean":"2024-04-26T10:45:57.160809+0000","last_became_active":"2024-04-26T10:45:50.866996+0000","last_became_peered":"2024-04-26T10:45:50.866996+0000","last_unstale":"2024-04-26T10:45:57.160809+0000","last_undegraded":"2024-04-26T10:45:57.160809+0000","last_fullsized":"2024-04-26T10:45:57.160809+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:17.631869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13036,"num_write":390,"num_write_kb":67193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"63'399","reported_seq":507,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.164304+0000","last_change":"2024-04-26T10:45:58.164304+0000","last_active":"2024-04-26T10:45:58.164304+0000","last_peered":"2024-04-26T10:45:58.164304+0000","last_clean":"2024-04-26T10:45:58.164304+0000","last_became_active":"2024-04-26T10:45:58.162532+0000","last_became_peered":"2024-04-26T10:45:58.162532+0000","last_unstale":"2024-04-26T10:45:58.164304+0000","last_undegraded":"2024-04-26T10:45:58.164304+0000","last_fullsized":"2024-04-26T10:45:58.164304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:50.164416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25678,"num_write":356,"num_write_kb":116549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"63'442","reported_seq":586,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.172828+0000","last_change":"2024-04-26T10:42:26.045893+0000","last_active":"2024-04-26T10:45:54.172828+0000","last_peered":"2024-04-26T10:45:54.172828+0000","last_clean":"2024-04-26T10:45:54.172828+0000","last_became_active":"2024-04-26T10:42:26.045177+0000","last_became_peered":"2024-04-26T10:42:26.045177+0000","last_unstale":"2024-04-26T10:45:54.172828+0000","last_undegraded":"2024-04-26T10:45:54.172828+0000","last_fullsized":"2024-04-26T10:45:54.172828+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35111,"num_write":413,"num_write_kb":60306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'393","reported_seq":512,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.194713+0000","last_change":"2024-04-26T10:45:54.192984+0000","last_active":"2024-04-26T10:45:54.194713+0000","last_peered":"2024-04-26T10:45:54.194713+0000","last_clean":"2024-04-26T10:45:54.194713+0000","last_became_active":"2024-04-26T10:45:54.191514+0000","last_became_peered":"2024-04-26T10:45:54.191514+0000","last_unstale":"2024-04-26T10:45:54.194713+0000","last_undegraded":"2024-04-26T10:45:54.194713+0000","last_fullsized":"2024-04-26T10:45:54.194713+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:33.809143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5355,"num_write":351,"num_write_kb":38901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"63'377","reported_seq":482,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161319+0000","last_change":"2024-04-26T10:45:49.865172+0000","last_active":"2024-04-26T10:45:57.161319+0000","last_peered":"2024-04-26T10:45:57.161319+0000","last_clean":"2024-04-26T10:45:57.161319+0000","last_became_active":"2024-04-26T10:45:49.862718+0000","last_became_peered":"2024-04-26T10:45:49.862718+0000","last_unstale":"2024-04-26T10:45:57.161319+0000","last_undegraded":"2024-04-26T10:45:57.161319+0000","last_fullsized":"2024-04-26T10:45:57.161319+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:43.129958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18030,"num_write":355,"num_write_kb":67044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"63'365","reported_seq":797,"reported_epoch":81,"state":"active+undersized+remapped","last_fresh":"2024-04-26T10:45:55.371444+0000","last_change":"2024-04-26T10:45:55.371588+0000","last_active":"2024-04-26T10:45:55.371444+0000","last_peered":"2024-04-26T10:45:55.371444+0000","last_clean":"2024-04-26T10:43:07.780827+0000","last_became_active":"2024-04-26T10:45:46.969351+0000","last_became_peered":"2024-04-26T10:45:46.969351+0000","last_unstale":"2024-04-26T10:45:55.371444+0000","last_undegraded":"2024-04-26T10:45:55.371444+0000","last_fullsized":"2024-04-26T10:45:46.876204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:42.659561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14866,"num_write":337,"num_write_kb":71188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'397","reported_seq":487,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.182235+0000","last_change":"2024-04-26T10:42:26.042607+0000","last_active":"2024-04-26T10:45:54.182235+0000","last_peered":"2024-04-26T10:45:54.182235+0000","last_clean":"2024-04-26T10:45:54.182235+0000","last_became_active":"2024-04-26T10:42:26.041617+0000","last_became_peered":"2024-04-26T10:42:26.041617+0000","last_unstale":"2024-04-26T10:45:54.182235+0000","last_undegraded":"2024-04-26T10:45:54.182235+0000","last_fullsized":"2024-04-26T10:45:54.182235+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8192,"num_write":362,"num_write_kb":54822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"63'408","reported_seq":487,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161186+0000","last_change":"2024-04-26T10:45:53.181618+0000","last_active":"2024-04-26T10:45:57.161186+0000","last_peered":"2024-04-26T10:45:57.161186+0000","last_clean":"2024-04-26T10:45:57.161186+0000","last_became_active":"2024-04-26T10:45:53.177677+0000","last_became_peered":"2024-04-26T10:45:53.177677+0000","last_unstale":"2024-04-26T10:45:57.161186+0000","last_undegraded":"2024-04-26T10:45:57.161186+0000","last_fullsized":"2024-04-26T10:45:57.161186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:06.719053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4688,"num_write":374,"num_write_kb":21766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"63'409","reported_seq":522,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160533+0000","last_change":"2024-04-26T10:45:54.188625+0000","last_active":"2024-04-26T10:45:57.160533+0000","last_peered":"2024-04-26T10:45:57.160533+0000","last_clean":"2024-04-26T10:45:57.160533+0000","last_became_active":"2024-04-26T10:45:54.185826+0000","last_became_peered":"2024-04-26T10:45:54.185826+0000","last_unstale":"2024-04-26T10:45:57.160533+0000","last_undegraded":"2024-04-26T10:45:57.160533+0000","last_fullsized":"2024-04-26T10:45:57.160533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:48.401265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25968,"num_write":366,"num_write_kb":75698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"63'460","reported_seq":562,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162279+0000","last_change":"2024-04-26T10:45:53.176893+0000","last_active":"2024-04-26T10:45:57.162279+0000","last_peered":"2024-04-26T10:45:57.162279+0000","last_clean":"2024-04-26T10:45:57.162279+0000","last_became_active":"2024-04-26T10:45:53.174699+0000","last_became_peered":"2024-04-26T10:45:53.174699+0000","last_unstale":"2024-04-26T10:45:57.162279+0000","last_undegraded":"2024-04-26T10:45:57.162279+0000","last_fullsized":"2024-04-26T10:45:57.162279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:41.919177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16269,"num_write":426,"num_write_kb":67839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"63'393","reported_seq":509,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.173426+0000","last_change":"2024-04-26T10:42:26.049338+0000","last_active":"2024-04-26T10:45:54.173426+0000","last_peered":"2024-04-26T10:45:54.173426+0000","last_clean":"2024-04-26T10:45:54.173426+0000","last_became_active":"2024-04-26T10:42:26.049014+0000","last_became_peered":"2024-04-26T10:42:26.049014+0000","last_unstale":"2024-04-26T10:45:54.173426+0000","last_undegraded":"2024-04-26T10:45:54.173426+0000","last_fullsized":"2024-04-26T10:45:54.173426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":25712,"num_write":362,"num_write_kb":42020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'428","reported_seq":551,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.194661+0000","last_change":"2024-04-26T10:45:54.192786+0000","last_active":"2024-04-26T10:45:54.194661+0000","last_peered":"2024-04-26T10:45:54.194661+0000","last_clean":"2024-04-26T10:45:54.194661+0000","last_became_active":"2024-04-26T10:45:54.189852+0000","last_became_peered":"2024-04-26T10:45:54.189852+0000","last_unstale":"2024-04-26T10:45:54.194661+0000","last_undegraded":"2024-04-26T10:45:54.194661+0000","last_fullsized":"2024-04-26T10:45:54.194661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:29.968564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12316,"num_write":384,"num_write_kb":87656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"63'446","reported_seq":584,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681052+0000","last_change":"2024-04-26T10:45:54.186962+0000","last_active":"2024-04-26T10:45:54.681052+0000","last_peered":"2024-04-26T10:45:54.681052+0000","last_clean":"2024-04-26T10:45:54.681052+0000","last_became_active":"2024-04-26T10:45:54.184063+0000","last_became_peered":"2024-04-26T10:45:54.184063+0000","last_unstale":"2024-04-26T10:45:54.681052+0000","last_undegraded":"2024-04-26T10:45:54.681052+0000","last_fullsized":"2024-04-26T10:45:54.681052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:59.349649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":53414,"num_write":401,"num_write_kb":80048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":550,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161291+0000","last_change":"2024-04-26T10:45:50.869971+0000","last_active":"2024-04-26T10:45:57.161291+0000","last_peered":"2024-04-26T10:45:57.161291+0000","last_clean":"2024-04-26T10:45:57.161291+0000","last_became_active":"2024-04-26T10:45:50.867680+0000","last_became_peered":"2024-04-26T10:45:50.867680+0000","last_unstale":"2024-04-26T10:45:57.161291+0000","last_undegraded":"2024-04-26T10:45:57.161291+0000","last_fullsized":"2024-04-26T10:45:57.161291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:17.680371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19859,"num_write":405,"num_write_kb":51119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"63'408","reported_seq":862,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161853+0000","last_change":"2024-04-26T10:45:56.163683+0000","last_active":"2024-04-26T10:45:57.161853+0000","last_peered":"2024-04-26T10:45:57.161853+0000","last_clean":"2024-04-26T10:45:57.161853+0000","last_became_active":"2024-04-26T10:45:56.160360+0000","last_became_peered":"2024-04-26T10:45:56.160360+0000","last_unstale":"2024-04-26T10:45:57.161853+0000","last_undegraded":"2024-04-26T10:45:57.161853+0000","last_fullsized":"2024-04-26T10:45:57.161853+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:44.845909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":15372,"num_write":366,"num_write_kb":75855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"63'452","reported_seq":1014,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.176394+0000","last_change":"2024-04-26T10:45:52.175372+0000","last_active":"2024-04-26T10:45:54.176394+0000","last_peered":"2024-04-26T10:45:54.176394+0000","last_clean":"2024-04-26T10:45:54.176394+0000","last_became_active":"2024-04-26T10:45:52.173702+0000","last_became_peered":"2024-04-26T10:45:52.173702+0000","last_unstale":"2024-04-26T10:45:54.176394+0000","last_undegraded":"2024-04-26T10:45:54.176394+0000","last_fullsized":"2024-04-26T10:45:54.176394+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:55.459452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43729,"num_write":421,"num_write_kb":79804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"63'408","reported_seq":871,"reported_epoch":81,"state":"active+undersized+remapped","last_fresh":"2024-04-26T10:45:55.188981+0000","last_change":"2024-04-26T10:45:55.189125+0000","last_active":"2024-04-26T10:45:55.188981+0000","last_peered":"2024-04-26T10:45:55.188981+0000","last_clean":"2024-04-26T10:45:43.837106+0000","last_became_active":"2024-04-26T10:45:54.176860+0000","last_became_peered":"2024-04-26T10:45:54.176860+0000","last_unstale":"2024-04-26T10:45:55.188981+0000","last_undegraded":"2024-04-26T10:45:55.188981+0000","last_fullsized":"2024-04-26T10:45:54.171433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:06.438350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":30320,"num_write":372,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'453","reported_seq":612,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.184897+0000","last_change":"2024-04-26T10:45:54.184330+0000","last_active":"2024-04-26T10:45:54.184897+0000","last_peered":"2024-04-26T10:45:54.184897+0000","last_clean":"2024-04-26T10:45:54.184897+0000","last_became_active":"2024-04-26T10:45:54.181881+0000","last_became_peered":"2024-04-26T10:45:54.181881+0000","last_unstale":"2024-04-26T10:45:54.184897+0000","last_undegraded":"2024-04-26T10:45:54.184897+0000","last_fullsized":"2024-04-26T10:45:54.184897+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:02.066091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":19864,"num_write":422,"num_write_kb":51638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"63'439","reported_seq":951,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.179267+0000","last_change":"2024-04-26T10:45:48.867766+0000","last_active":"2024-04-26T10:45:54.179267+0000","last_peered":"2024-04-26T10:45:54.179267+0000","last_clean":"2024-04-26T10:45:54.179267+0000","last_became_active":"2024-04-26T10:45:48.866159+0000","last_became_peered":"2024-04-26T10:45:48.866159+0000","last_unstale":"2024-04-26T10:45:54.179267+0000","last_undegraded":"2024-04-26T10:45:54.179267+0000","last_fullsized":"2024-04-26T10:45:54.179267+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:39.736649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8912,"num_write":417,"num_write_kb":46575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"63'513","reported_seq":1155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.172380+0000","last_change":"2024-04-26T10:45:51.160003+0000","last_active":"2024-04-26T10:45:54.172380+0000","last_peered":"2024-04-26T10:45:54.172380+0000","last_clean":"2024-04-26T10:45:54.172380+0000","last_became_active":"2024-04-26T10:45:51.158698+0000","last_became_peered":"2024-04-26T10:45:51.158698+0000","last_unstale":"2024-04-26T10:45:54.172380+0000","last_undegraded":"2024-04-26T10:45:54.172380+0000","last_fullsized":"2024-04-26T10:45:54.172380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:36.990095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":70751,"num_write":473,"num_write_kb":88902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'406","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161212+0000","last_change":"2024-04-26T10:45:56.164805+0000","last_active":"2024-04-26T10:45:57.161212+0000","last_peered":"2024-04-26T10:45:57.161212+0000","last_clean":"2024-04-26T10:45:57.161212+0000","last_became_active":"2024-04-26T10:45:56.162419+0000","last_became_peered":"2024-04-26T10:45:56.162419+0000","last_unstale":"2024-04-26T10:45:57.161212+0000","last_undegraded":"2024-04-26T10:45:57.161212+0000","last_fullsized":"2024-04-26T10:45:57.161212+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:53.474847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":32121,"num_write":372,"num_write_kb":60163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"63'402","reported_seq":856,"reported_epoch":81,"state":"active+undersized+remapped","last_fresh":"2024-04-26T10:45:55.217948+0000","last_change":"2024-04-26T10:45:55.218106+0000","last_active":"2024-04-26T10:45:55.217948+0000","last_peered":"2024-04-26T10:45:55.217948+0000","last_clean":"2024-04-26T10:43:07.781070+0000","last_became_active":"2024-04-26T10:45:46.966258+0000","last_became_peered":"2024-04-26T10:45:46.966258+0000","last_unstale":"2024-04-26T10:45:55.217948+0000","last_undegraded":"2024-04-26T10:45:55.217948+0000","last_fullsized":"2024-04-26T10:45:46.872941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:13.642161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":6824,"num_write":378,"num_write_kb":72156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"63'407","reported_seq":883,"reported_epoch":80,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T10:45:54.203582+0000","last_change":"2024-04-26T10:45:54.203582+0000","last_active":"2024-04-26T10:45:54.203582+0000","last_peered":"2024-04-26T10:45:54.203582+0000","last_clean":"2024-04-26T10:45:51.160753+0000","last_became_active":"2024-04-26T10:45:54.201674+0000","last_became_peered":"2024-04-26T10:45:54.201674+0000","last_unstale":"2024-04-26T10:45:54.203582+0000","last_undegraded":"2024-04-26T10:45:54.177921+0000","last_fullsized":"2024-04-26T10:45:54.172633+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:13.200402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":173,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25898,"num_write":372,"num_write_kb":59274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"63'490","reported_seq":1055,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:45:55.179785+0000","last_change":"2024-04-26T10:45:55.179785+0000","last_active":"2024-04-26T10:45:55.179785+0000","last_peered":"2024-04-26T10:45:55.179785+0000","last_clean":"2024-04-26T10:45:55.179785+0000","last_became_active":"2024-04-26T10:45:55.178083+0000","last_became_peered":"2024-04-26T10:45:55.178083+0000","last_unstale":"2024-04-26T10:45:55.179785+0000","last_undegraded":"2024-04-26T10:45:55.179785+0000","last_fullsized":"2024-04-26T10:45:55.179785+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:23.269957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33597,"num_write":449,"num_write_kb":87981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"63'474","reported_seq":560,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.680966+0000","last_change":"2024-04-26T10:45:54.189228+0000","last_active":"2024-04-26T10:45:54.680966+0000","last_peered":"2024-04-26T10:45:54.680966+0000","last_clean":"2024-04-26T10:45:54.680966+0000","last_became_active":"2024-04-26T10:45:54.186011+0000","last_became_peered":"2024-04-26T10:45:54.186011+0000","last_unstale":"2024-04-26T10:45:54.680966+0000","last_undegraded":"2024-04-26T10:45:54.680966+0000","last_fullsized":"2024-04-26T10:45:54.680966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.355145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30886,"num_write":441,"num_write_kb":118807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'443","reported_seq":547,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162005+0000","last_change":"2024-04-26T10:45:48.864423+0000","last_active":"2024-04-26T10:45:57.162005+0000","last_peered":"2024-04-26T10:45:57.162005+0000","last_clean":"2024-04-26T10:45:57.162005+0000","last_became_active":"2024-04-26T10:45:48.861918+0000","last_became_peered":"2024-04-26T10:45:48.861918+0000","last_unstale":"2024-04-26T10:45:57.162005+0000","last_undegraded":"2024-04-26T10:45:57.162005+0000","last_fullsized":"2024-04-26T10:45:57.162005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:11.356135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20556,"num_write":413,"num_write_kb":91647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"63'376","reported_seq":475,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.179848+0000","last_change":"2024-04-26T10:42:26.041757+0000","last_active":"2024-04-26T10:45:54.179848+0000","last_peered":"2024-04-26T10:45:54.179848+0000","last_clean":"2024-04-26T10:45:54.179848+0000","last_became_active":"2024-04-26T10:42:26.040920+0000","last_became_peered":"2024-04-26T10:42:26.040920+0000","last_unstale":"2024-04-26T10:45:54.179848+0000","last_undegraded":"2024-04-26T10:45:54.179848+0000","last_fullsized":"2024-04-26T10:45:54.179848+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10124,"num_write":344,"num_write_kb":66899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"62'453","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161061+0000","last_change":"2024-04-26T10:45:48.862782+0000","last_active":"2024-04-26T10:45:57.161061+0000","last_peered":"2024-04-26T10:45:57.161061+0000","last_clean":"2024-04-26T10:45:57.161061+0000","last_became_active":"2024-04-26T10:45:48.862424+0000","last_became_peered":"2024-04-26T10:45:48.862424+0000","last_unstale":"2024-04-26T10:45:57.161061+0000","last_undegraded":"2024-04-26T10:45:57.161061+0000","last_fullsized":"2024-04-26T10:45:57.161061+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:16.548893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"63'403","reported_seq":517,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.176947+0000","last_change":"2024-04-26T10:42:26.041850+0000","last_active":"2024-04-26T10:45:54.176947+0000","last_peered":"2024-04-26T10:45:54.176947+0000","last_clean":"2024-04-26T10:45:54.176947+0000","last_became_active":"2024-04-26T10:42:26.040464+0000","last_became_peered":"2024-04-26T10:42:26.040464+0000","last_unstale":"2024-04-26T10:45:54.176947+0000","last_undegraded":"2024-04-26T10:45:54.176947+0000","last_fullsized":"2024-04-26T10:45:54.176947+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24588,"num_write":363,"num_write_kb":51190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"62'49","reported_seq":140,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171816+0000","last_change":"2024-04-26T10:45:45.862317+0000","last_active":"2024-04-26T10:45:54.171816+0000","last_peered":"2024-04-26T10:45:54.171816+0000","last_clean":"2024-04-26T10:45:54.171816+0000","last_became_active":"2024-04-26T10:45:45.862029+0000","last_became_peered":"2024-04-26T10:45:45.862029+0000","last_unstale":"2024-04-26T10:45:54.171816+0000","last_undegraded":"2024-04-26T10:45:54.171816+0000","last_fullsized":"2024-04-26T10:45:54.171816+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:02.521534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'407","reported_seq":884,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.174973+0000","last_change":"2024-04-26T10:45:52.170710+0000","last_active":"2024-04-26T10:45:54.174973+0000","last_peered":"2024-04-26T10:45:54.174973+0000","last_clean":"2024-04-26T10:45:54.174973+0000","last_became_active":"2024-04-26T10:45:52.169295+0000","last_became_peered":"2024-04-26T10:45:52.169295+0000","last_unstale":"2024-04-26T10:45:54.174973+0000","last_undegraded":"2024-04-26T10:45:54.174973+0000","last_fullsized":"2024-04-26T10:45:54.174973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:10.995530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":7077,"num_write":367,"num_write_kb":42434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"62'66","reported_seq":157,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.180683+0000","last_change":"2024-04-26T10:45:45.874440+0000","last_active":"2024-04-26T10:45:54.180683+0000","last_peered":"2024-04-26T10:45:54.180683+0000","last_clean":"2024-04-26T10:45:54.180683+0000","last_became_active":"2024-04-26T10:45:45.874030+0000","last_became_peered":"2024-04-26T10:45:45.874030+0000","last_unstale":"2024-04-26T10:45:54.180683+0000","last_undegraded":"2024-04-26T10:45:54.180683+0000","last_fullsized":"2024-04-26T10:45:54.180683+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:22.711644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"63'406","reported_seq":895,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.173118+0000","last_change":"2024-04-26T10:45:49.863376+0000","last_active":"2024-04-26T10:45:54.173118+0000","last_peered":"2024-04-26T10:45:54.173118+0000","last_clean":"2024-04-26T10:45:54.173118+0000","last_became_active":"2024-04-26T10:45:49.861979+0000","last_became_peered":"2024-04-26T10:45:49.861979+0000","last_unstale":"2024-04-26T10:45:54.173118+0000","last_undegraded":"2024-04-26T10:45:54.173118+0000","last_fullsized":"2024-04-26T10:45:54.173118+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:16.553043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":25977,"num_write":374,"num_write_kb":104172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'66","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161876+0000","last_change":"2024-04-26T10:45:45.871507+0000","last_active":"2024-04-26T10:45:57.161876+0000","last_peered":"2024-04-26T10:45:57.161876+0000","last_clean":"2024-04-26T10:45:57.161876+0000","last_became_active":"2024-04-26T10:45:45.871120+0000","last_became_peered":"2024-04-26T10:45:45.871120+0000","last_unstale":"2024-04-26T10:45:57.161876+0000","last_undegraded":"2024-04-26T10:45:57.161876+0000","last_fullsized":"2024-04-26T10:45:57.161876+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:56.162347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"62'200","reported_seq":281,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161233+0000","last_change":"2024-04-26T10:45:48.866225+0000","last_active":"2024-04-26T10:45:57.161233+0000","last_peered":"2024-04-26T10:45:57.161233+0000","last_clean":"2024-04-26T10:45:57.161233+0000","last_became_active":"2024-04-26T10:45:48.865878+0000","last_became_peered":"2024-04-26T10:45:48.865878+0000","last_unstale":"2024-04-26T10:45:57.161233+0000","last_undegraded":"2024-04-26T10:45:57.161233+0000","last_fullsized":"2024-04-26T10:45:57.161233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:42:39.518391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"63'415","reported_seq":897,"reported_epoch":81,"state":"active+undersized+remapped","last_fresh":"2024-04-26T10:45:55.697821+0000","last_change":"2024-04-26T10:45:55.697970+0000","last_active":"2024-04-26T10:45:55.697821+0000","last_peered":"2024-04-26T10:45:55.697821+0000","last_clean":"2024-04-26T10:43:07.780428+0000","last_became_active":"2024-04-26T10:45:46.974406+0000","last_became_peered":"2024-04-26T10:45:46.974406+0000","last_unstale":"2024-04-26T10:45:55.697821+0000","last_undegraded":"2024-04-26T10:45:55.697821+0000","last_fullsized":"2024-04-26T10:45:46.851421+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:01.679410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15757,"num_write":380,"num_write_kb":54727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"62'342","reported_seq":445,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.178620+0000","last_change":"2024-04-26T10:45:48.866915+0000","last_active":"2024-04-26T10:45:54.178620+0000","last_peered":"2024-04-26T10:45:54.178620+0000","last_clean":"2024-04-26T10:45:54.178620+0000","last_became_active":"2024-04-26T10:45:48.866497+0000","last_became_peered":"2024-04-26T10:45:48.866497+0000","last_unstale":"2024-04-26T10:45:54.178620+0000","last_undegraded":"2024-04-26T10:45:54.178620+0000","last_fullsized":"2024-04-26T10:45:54.178620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:04.796882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"63'481","reported_seq":667,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.185085+0000","last_change":"2024-04-26T10:45:54.184646+0000","last_active":"2024-04-26T10:45:54.185085+0000","last_peered":"2024-04-26T10:45:54.185085+0000","last_clean":"2024-04-26T10:45:54.185085+0000","last_became_active":"2024-04-26T10:45:54.181993+0000","last_became_peered":"2024-04-26T10:45:54.181993+0000","last_unstale":"2024-04-26T10:45:54.185085+0000","last_undegraded":"2024-04-26T10:45:54.185085+0000","last_fullsized":"2024-04-26T10:45:54.185085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:34.664600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":45251,"num_write":451,"num_write_kb":105365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"62'460","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160768+0000","last_change":"2024-04-26T10:45:48.865887+0000","last_active":"2024-04-26T10:45:57.160768+0000","last_peered":"2024-04-26T10:45:57.160768+0000","last_clean":"2024-04-26T10:45:57.160768+0000","last_became_active":"2024-04-26T10:45:48.865520+0000","last_became_peered":"2024-04-26T10:45:48.865520+0000","last_unstale":"2024-04-26T10:45:57.160768+0000","last_undegraded":"2024-04-26T10:45:57.160768+0000","last_fullsized":"2024-04-26T10:45:57.160768+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:34.308634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":407,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'420","reported_seq":503,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.165736+0000","last_change":"2024-04-26T10:45:57.165390+0000","last_active":"2024-04-26T10:45:57.165736+0000","last_peered":"2024-04-26T10:45:57.165736+0000","last_clean":"2024-04-26T10:45:57.165736+0000","last_became_active":"2024-04-26T10:45:57.162014+0000","last_became_peered":"2024-04-26T10:45:57.162014+0000","last_unstale":"2024-04-26T10:45:57.165736+0000","last_undegraded":"2024-04-26T10:45:57.165736+0000","last_fullsized":"2024-04-26T10:45:57.165736+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:19.491785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13025,"num_write":385,"num_write_kb":38595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"62'67","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161113+0000","last_change":"2024-04-26T10:45:45.860717+0000","last_active":"2024-04-26T10:45:57.161113+0000","last_peered":"2024-04-26T10:45:57.161113+0000","last_clean":"2024-04-26T10:45:57.161113+0000","last_became_active":"2024-04-26T10:45:45.860175+0000","last_became_peered":"2024-04-26T10:45:45.860175+0000","last_unstale":"2024-04-26T10:45:57.161113+0000","last_undegraded":"2024-04-26T10:45:57.161113+0000","last_fullsized":"2024-04-26T10:45:57.161113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:30.736518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"63'452","reported_seq":961,"reported_epoch":80,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T10:45:54.204641+0000","last_change":"2024-04-26T10:45:54.204641+0000","last_active":"2024-04-26T10:45:54.204641+0000","last_peered":"2024-04-26T10:45:54.204641+0000","last_clean":"2024-04-26T10:45:43.837618+0000","last_became_active":"2024-04-26T10:45:54.203315+0000","last_became_peered":"2024-04-26T10:45:54.203315+0000","last_unstale":"2024-04-26T10:45:54.204641+0000","last_undegraded":"2024-04-26T10:45:54.204641+0000","last_fullsized":"2024-04-26T10:45:54.204641+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:52:49.647563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":194,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23217,"num_write":416,"num_write_kb":71418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"62'200","reported_seq":267,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:54.693188+0000","last_change":"2024-04-26T10:45:55.960626+0000","last_active":"2024-04-26T10:45:55.960626+0000","last_peered":"2024-04-26T10:45:54.693188+0000","last_clean":"2024-04-26T10:45:43.837381+0000","last_became_active":"2024-04-26T10:45:54.201777+0000","last_became_peered":"2024-04-26T10:45:54.201777+0000","last_unstale":"2024-04-26T10:45:54.693188+0000","last_undegraded":"2024-04-26T10:45:54.693188+0000","last_fullsized":"2024-04-26T10:45:54.693188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:48.896541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'430","reported_seq":512,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.165078+0000","last_change":"2024-04-26T10:45:57.164742+0000","last_active":"2024-04-26T10:45:57.165078+0000","last_peered":"2024-04-26T10:45:57.165078+0000","last_clean":"2024-04-26T10:45:57.165078+0000","last_became_active":"2024-04-26T10:45:57.162070+0000","last_became_peered":"2024-04-26T10:45:57.162070+0000","last_unstale":"2024-04-26T10:45:57.165078+0000","last_undegraded":"2024-04-26T10:45:57.165078+0000","last_fullsized":"2024-04-26T10:45:57.165078+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:14.872176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":24352,"num_write":392,"num_write_kb":21976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"62'233","reported_seq":306,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160855+0000","last_change":"2024-04-26T10:45:48.862856+0000","last_active":"2024-04-26T10:45:57.160855+0000","last_peered":"2024-04-26T10:45:57.160855+0000","last_clean":"2024-04-26T10:45:57.160855+0000","last_became_active":"2024-04-26T10:45:48.862517+0000","last_became_peered":"2024-04-26T10:45:48.862517+0000","last_unstale":"2024-04-26T10:45:57.160855+0000","last_undegraded":"2024-04-26T10:45:57.160855+0000","last_fullsized":"2024-04-26T10:45:57.160855+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:43.799960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"63'393","reported_seq":478,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160672+0000","last_change":"2024-04-26T10:45:55.180960+0000","last_active":"2024-04-26T10:45:57.160672+0000","last_peered":"2024-04-26T10:45:57.160672+0000","last_clean":"2024-04-26T10:45:57.160672+0000","last_became_active":"2024-04-26T10:45:55.177758+0000","last_became_peered":"2024-04-26T10:45:55.177758+0000","last_unstale":"2024-04-26T10:45:57.160672+0000","last_undegraded":"2024-04-26T10:45:57.160672+0000","last_fullsized":"2024-04-26T10:45:57.160672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:47.889251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8671,"num_write":368,"num_write_kb":38542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"62'49","reported_seq":140,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.180800+0000","last_change":"2024-04-26T10:45:45.874789+0000","last_active":"2024-04-26T10:45:54.180800+0000","last_peered":"2024-04-26T10:45:54.180800+0000","last_clean":"2024-04-26T10:45:54.180800+0000","last_became_active":"2024-04-26T10:45:45.874328+0000","last_became_peered":"2024-04-26T10:45:45.874328+0000","last_unstale":"2024-04-26T10:45:54.180800+0000","last_undegraded":"2024-04-26T10:45:54.180800+0000","last_fullsized":"2024-04-26T10:45:54.180800+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:27.431661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"63'368","reported_seq":463,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162061+0000","last_change":"2024-04-26T10:45:56.165615+0000","last_active":"2024-04-26T10:45:57.162061+0000","last_peered":"2024-04-26T10:45:57.162061+0000","last_clean":"2024-04-26T10:45:57.162061+0000","last_became_active":"2024-04-26T10:45:56.163456+0000","last_became_peered":"2024-04-26T10:45:56.163456+0000","last_unstale":"2024-04-26T10:45:57.162061+0000","last_undegraded":"2024-04-26T10:45:57.162061+0000","last_fullsized":"2024-04-26T10:45:57.162061+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:14.480860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":19222,"num_write":336,"num_write_kb":58903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"62'619","reported_seq":737,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:55.173549+0000","last_change":"2024-04-26T10:45:55.174640+0000","last_active":"2024-04-26T10:45:55.173549+0000","last_peered":"2024-04-26T10:45:54.265645+0000","last_clean":"2024-04-26T10:45:51.156152+0000","last_became_active":"2024-04-26T10:45:54.200111+0000","last_became_peered":"2024-04-26T10:45:54.200111+0000","last_unstale":"2024-04-26T10:45:55.173549+0000","last_undegraded":"2024-04-26T10:45:55.173549+0000","last_fullsized":"2024-04-26T10:45:55.173549+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:45.842505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":558,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"63'383","reported_seq":817,"reported_epoch":80,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T10:45:54.196892+0000","last_change":"2024-04-26T10:45:54.196892+0000","last_active":"2024-04-26T10:45:54.196892+0000","last_peered":"2024-04-26T10:45:54.196892+0000","last_clean":"2024-04-26T10:45:51.156554+0000","last_became_active":"2024-04-26T10:45:54.195746+0000","last_became_peered":"2024-04-26T10:45:54.195746+0000","last_unstale":"2024-04-26T10:45:54.196892+0000","last_undegraded":"2024-04-26T10:45:54.177564+0000","last_fullsized":"2024-04-26T10:45:54.173407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:34.841726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":14260,"num_write":349,"num_write_kb":50367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":229,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161708+0000","last_change":"2024-04-26T10:45:45.871511+0000","last_active":"2024-04-26T10:45:57.161708+0000","last_peered":"2024-04-26T10:45:57.161708+0000","last_clean":"2024-04-26T10:45:57.161708+0000","last_became_active":"2024-04-26T10:45:45.871155+0000","last_became_peered":"2024-04-26T10:45:45.871155+0000","last_unstale":"2024-04-26T10:45:57.161708+0000","last_undegraded":"2024-04-26T10:45:57.161708+0000","last_fullsized":"2024-04-26T10:45:57.161708+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:53.015361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160932+0000","last_change":"2024-04-26T10:45:45.861068+0000","last_active":"2024-04-26T10:45:57.160932+0000","last_peered":"2024-04-26T10:45:57.160932+0000","last_clean":"2024-04-26T10:45:57.160932+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:57.160932+0000","last_undegraded":"2024-04-26T10:45:57.160932+0000","last_fullsized":"2024-04-26T10:45:57.160932+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:16.348009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"62'743","reported_seq":821,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171968+0000","last_change":"2024-04-26T10:42:25.686765+0000","last_active":"2024-04-26T10:45:54.171968+0000","last_peered":"2024-04-26T10:45:54.171968+0000","last_clean":"2024-04-26T10:45:54.171968+0000","last_became_active":"2024-04-26T10:42:25.686009+0000","last_became_peered":"2024-04-26T10:42:25.686009+0000","last_unstale":"2024-04-26T10:45:54.171968+0000","last_undegraded":"2024-04-26T10:45:54.171968+0000","last_fullsized":"2024-04-26T10:45:54.171968+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:54.627815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'442","reported_seq":567,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160853+0000","last_change":"2024-04-26T10:45:55.181074+0000","last_active":"2024-04-26T10:45:57.160853+0000","last_peered":"2024-04-26T10:45:57.160853+0000","last_clean":"2024-04-26T10:45:57.160853+0000","last_became_active":"2024-04-26T10:45:55.177751+0000","last_became_peered":"2024-04-26T10:45:55.177751+0000","last_unstale":"2024-04-26T10:45:57.160853+0000","last_undegraded":"2024-04-26T10:45:57.160853+0000","last_fullsized":"2024-04-26T10:45:57.160853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:01.323521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":34346,"num_write":406,"num_write_kb":96298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162129+0000","last_change":"2024-04-26T10:45:45.872099+0000","last_active":"2024-04-26T10:45:57.162129+0000","last_peered":"2024-04-26T10:45:57.162129+0000","last_clean":"2024-04-26T10:45:57.162129+0000","last_became_active":"2024-04-26T10:45:45.871741+0000","last_became_peered":"2024-04-26T10:45:45.871741+0000","last_unstale":"2024-04-26T10:45:57.162129+0000","last_undegraded":"2024-04-26T10:45:57.162129+0000","last_fullsized":"2024-04-26T10:45:57.162129+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:53.226378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"63'102","reported_seq":209,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:54.219118+0000","last_change":"2024-04-26T10:45:55.960530+0000","last_active":"2024-04-26T10:45:55.960530+0000","last_peered":"2024-04-26T10:45:54.219118+0000","last_clean":"2024-04-26T10:45:43.837073+0000","last_became_active":"2024-04-26T10:45:54.189849+0000","last_became_peered":"2024-04-26T10:45:54.189849+0000","last_unstale":"2024-04-26T10:45:54.219118+0000","last_undegraded":"2024-04-26T10:45:54.219118+0000","last_fullsized":"2024-04-26T10:45:54.219118+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:47.864335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467631,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":44,"num_write_kb":1460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2935262,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'485","reported_seq":620,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162426+0000","last_change":"2024-04-26T10:45:57.165815+0000","last_active":"2024-04-26T10:45:58.162426+0000","last_peered":"2024-04-26T10:45:58.162426+0000","last_clean":"2024-04-26T10:45:58.162426+0000","last_became_active":"2024-04-26T10:45:57.162752+0000","last_became_peered":"2024-04-26T10:45:57.162752+0000","last_unstale":"2024-04-26T10:45:58.162426+0000","last_undegraded":"2024-04-26T10:45:58.162426+0000","last_fullsized":"2024-04-26T10:45:58.162426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:10.743149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27703,"num_write":454,"num_write_kb":121509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681001+0000","last_change":"2024-04-26T10:45:53.180892+0000","last_active":"2024-04-26T10:45:54.681001+0000","last_peered":"2024-04-26T10:45:54.681001+0000","last_clean":"2024-04-26T10:45:54.681001+0000","last_became_active":"2024-04-26T10:45:53.180675+0000","last_became_peered":"2024-04-26T10:45:53.180675+0000","last_unstale":"2024-04-26T10:45:54.681001+0000","last_undegraded":"2024-04-26T10:45:54.681001+0000","last_fullsized":"2024-04-26T10:45:54.681001+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:45.758505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"62'306","reported_seq":410,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.179256+0000","last_change":"2024-04-26T10:45:48.865095+0000","last_active":"2024-04-26T10:45:54.179256+0000","last_peered":"2024-04-26T10:45:54.179256+0000","last_clean":"2024-04-26T10:45:54.179256+0000","last_became_active":"2024-04-26T10:45:48.864763+0000","last_became_peered":"2024-04-26T10:45:48.864763+0000","last_unstale":"2024-04-26T10:45:54.179256+0000","last_undegraded":"2024-04-26T10:45:54.179256+0000","last_fullsized":"2024-04-26T10:45:54.179256+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:12.665388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"63'336","reported_seq":743,"reported_epoch":80,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T10:45:54.196130+0000","last_change":"2024-04-26T10:45:54.196130+0000","last_active":"2024-04-26T10:45:54.196130+0000","last_peered":"2024-04-26T10:45:54.196130+0000","last_clean":"2024-04-26T10:45:51.156451+0000","last_became_active":"2024-04-26T10:45:54.195199+0000","last_became_peered":"2024-04-26T10:45:54.195199+0000","last_unstale":"2024-04-26T10:45:54.196130+0000","last_undegraded":"2024-04-26T10:45:54.176438+0000","last_fullsized":"2024-04-26T10:45:54.173233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:00:49.770197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":153,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12035,"num_write":314,"num_write_kb":29928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160636+0000","last_change":"2024-04-26T10:45:45.861233+0000","last_active":"2024-04-26T10:45:57.160636+0000","last_peered":"2024-04-26T10:45:57.160636+0000","last_clean":"2024-04-26T10:45:57.160636+0000","last_became_active":"2024-04-26T10:45:45.860924+0000","last_became_peered":"2024-04-26T10:45:45.860924+0000","last_unstale":"2024-04-26T10:45:57.160636+0000","last_undegraded":"2024-04-26T10:45:57.160636+0000","last_fullsized":"2024-04-26T10:45:57.160636+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:11.746110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"62'64","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160997+0000","last_change":"2024-04-26T10:45:45.861230+0000","last_active":"2024-04-26T10:45:57.160997+0000","last_peered":"2024-04-26T10:45:57.160997+0000","last_clean":"2024-04-26T10:45:57.160997+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:57.160997+0000","last_undegraded":"2024-04-26T10:45:57.160997+0000","last_fullsized":"2024-04-26T10:45:57.160997+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:53.564033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"63'421","reported_seq":510,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681036+0000","last_change":"2024-04-26T10:45:54.188138+0000","last_active":"2024-04-26T10:45:54.681036+0000","last_peered":"2024-04-26T10:45:54.681036+0000","last_clean":"2024-04-26T10:45:54.681036+0000","last_became_active":"2024-04-26T10:45:54.185053+0000","last_became_peered":"2024-04-26T10:45:54.185053+0000","last_unstale":"2024-04-26T10:45:54.681036+0000","last_undegraded":"2024-04-26T10:45:54.681036+0000","last_fullsized":"2024-04-26T10:45:54.681036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:55:26.158040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28557,"num_write":385,"num_write_kb":93083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"62'480","reported_seq":553,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160417+0000","last_change":"2024-04-26T10:45:48.862894+0000","last_active":"2024-04-26T10:45:57.160417+0000","last_peered":"2024-04-26T10:45:57.160417+0000","last_clean":"2024-04-26T10:45:57.160417+0000","last_became_active":"2024-04-26T10:45:48.862564+0000","last_became_peered":"2024-04-26T10:45:48.862564+0000","last_unstale":"2024-04-26T10:45:57.160417+0000","last_undegraded":"2024-04-26T10:45:57.160417+0000","last_fullsized":"2024-04-26T10:45:57.160417+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:38.835403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":81,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.172444+0000","last_change":"2024-04-26T10:42:21.405754+0000","last_active":"2024-04-26T10:45:54.172444+0000","last_peered":"2024-04-26T10:45:54.172444+0000","last_clean":"2024-04-26T10:45:54.172444+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:45:54.172444+0000","last_undegraded":"2024-04-26T10:45:54.172444+0000","last_fullsized":"2024-04-26T10:45:54.172444+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:47.123256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'352","reported_seq":773,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.175671+0000","last_change":"2024-04-26T10:45:53.183401+0000","last_active":"2024-04-26T10:45:54.175671+0000","last_peered":"2024-04-26T10:45:54.175671+0000","last_clean":"2024-04-26T10:45:54.175671+0000","last_became_active":"2024-04-26T10:45:53.182454+0000","last_became_peered":"2024-04-26T10:45:53.182454+0000","last_unstale":"2024-04-26T10:45:54.175671+0000","last_undegraded":"2024-04-26T10:45:54.175671+0000","last_fullsized":"2024-04-26T10:45:54.175671+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:38.569626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":1905,"num_write":313,"num_write_kb":25573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"62'59","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681025+0000","last_change":"2024-04-26T10:45:53.177446+0000","last_active":"2024-04-26T10:45:54.681025+0000","last_peered":"2024-04-26T10:45:54.681025+0000","last_clean":"2024-04-26T10:45:54.681025+0000","last_became_active":"2024-04-26T10:45:53.176996+0000","last_became_peered":"2024-04-26T10:45:53.176996+0000","last_unstale":"2024-04-26T10:45:54.681025+0000","last_undegraded":"2024-04-26T10:45:54.681025+0000","last_fullsized":"2024-04-26T10:45:54.681025+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:23.679423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":88,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161096+0000","last_change":"2024-04-26T10:45:53.175046+0000","last_active":"2024-04-26T10:45:57.161096+0000","last_peered":"2024-04-26T10:45:57.161096+0000","last_clean":"2024-04-26T10:45:57.161096+0000","last_became_active":"2024-04-26T10:45:53.174781+0000","last_became_peered":"2024-04-26T10:45:53.174781+0000","last_unstale":"2024-04-26T10:45:57.161096+0000","last_undegraded":"2024-04-26T10:45:57.161096+0000","last_fullsized":"2024-04-26T10:45:57.161096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:22.742084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'408","reported_seq":904,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.186926+0000","last_change":"2024-04-26T10:45:54.186637+0000","last_active":"2024-04-26T10:45:54.186926+0000","last_peered":"2024-04-26T10:45:54.186926+0000","last_clean":"2024-04-26T10:45:54.186926+0000","last_became_active":"2024-04-26T10:45:54.185238+0000","last_became_peered":"2024-04-26T10:45:54.185238+0000","last_unstale":"2024-04-26T10:45:54.186926+0000","last_undegraded":"2024-04-26T10:45:54.186926+0000","last_fullsized":"2024-04-26T10:45:54.186926+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:54.735683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19939,"num_write":382,"num_write_kb":63433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"62'55","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681180+0000","last_change":"2024-04-26T10:45:53.205131+0000","last_active":"2024-04-26T10:45:54.681180+0000","last_peered":"2024-04-26T10:45:54.681180+0000","last_clean":"2024-04-26T10:45:54.681180+0000","last_became_active":"2024-04-26T10:45:53.177305+0000","last_became_peered":"2024-04-26T10:45:53.177305+0000","last_unstale":"2024-04-26T10:45:54.681180+0000","last_undegraded":"2024-04-26T10:45:54.681180+0000","last_fullsized":"2024-04-26T10:45:54.681180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:30.829530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681063+0000","last_change":"2024-04-26T10:45:53.177593+0000","last_active":"2024-04-26T10:45:54.681063+0000","last_peered":"2024-04-26T10:45:54.681063+0000","last_clean":"2024-04-26T10:45:54.681063+0000","last_became_active":"2024-04-26T10:45:53.177249+0000","last_became_peered":"2024-04-26T10:45:53.177249+0000","last_unstale":"2024-04-26T10:45:54.681063+0000","last_undegraded":"2024-04-26T10:45:54.681063+0000","last_fullsized":"2024-04-26T10:45:54.681063+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:41.564852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'418","reported_seq":867,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:55.173634+0000","last_change":"2024-04-26T10:45:55.174039+0000","last_active":"2024-04-26T10:45:55.173634+0000","last_peered":"2024-04-26T10:45:54.680875+0000","last_clean":"2024-04-26T10:45:43.837000+0000","last_became_active":"2024-04-26T10:45:54.178289+0000","last_became_peered":"2024-04-26T10:45:54.178289+0000","last_unstale":"2024-04-26T10:45:55.173634+0000","last_undegraded":"2024-04-26T10:45:55.173634+0000","last_fullsized":"2024-04-26T10:45:55.173634+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:21.326365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20110,"num_write":390,"num_write_kb":75171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"64'66","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681129+0000","last_change":"2024-04-26T10:45:53.203538+0000","last_active":"2024-04-26T10:45:54.681129+0000","last_peered":"2024-04-26T10:45:54.681129+0000","last_clean":"2024-04-26T10:45:54.681129+0000","last_became_active":"2024-04-26T10:45:53.175946+0000","last_became_peered":"2024-04-26T10:45:53.175946+0000","last_unstale":"2024-04-26T10:45:54.681129+0000","last_undegraded":"2024-04-26T10:45:54.681129+0000","last_fullsized":"2024-04-26T10:45:54.681129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:15.016761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161004+0000","last_change":"2024-04-26T10:45:45.872224+0000","last_active":"2024-04-26T10:45:57.161004+0000","last_peered":"2024-04-26T10:45:57.161004+0000","last_clean":"2024-04-26T10:45:57.161004+0000","last_became_active":"2024-04-26T10:45:45.871923+0000","last_became_peered":"2024-04-26T10:45:45.871923+0000","last_unstale":"2024-04-26T10:45:57.161004+0000","last_undegraded":"2024-04-26T10:45:57.161004+0000","last_fullsized":"2024-04-26T10:45:57.161004+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:00.334874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"63'404","reported_seq":918,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.184887+0000","last_change":"2024-04-26T10:45:54.184386+0000","last_active":"2024-04-26T10:45:54.184887+0000","last_peered":"2024-04-26T10:45:54.184887+0000","last_clean":"2024-04-26T10:45:54.184887+0000","last_became_active":"2024-04-26T10:45:54.181795+0000","last_became_peered":"2024-04-26T10:45:54.181795+0000","last_unstale":"2024-04-26T10:45:54.184887+0000","last_undegraded":"2024-04-26T10:45:54.184887+0000","last_fullsized":"2024-04-26T10:45:54.184887+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:10.290362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41262,"num_write":371,"num_write_kb":75820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"63'441","reported_seq":564,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161829+0000","last_change":"2024-04-26T10:45:54.188488+0000","last_active":"2024-04-26T10:45:57.161829+0000","last_peered":"2024-04-26T10:45:57.161829+0000","last_clean":"2024-04-26T10:45:57.161829+0000","last_became_active":"2024-04-26T10:45:54.185862+0000","last_became_peered":"2024-04-26T10:45:54.185862+0000","last_unstale":"2024-04-26T10:45:57.161829+0000","last_undegraded":"2024-04-26T10:45:57.161829+0000","last_fullsized":"2024-04-26T10:45:57.161829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:07.585438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31514,"num_write":408,"num_write_kb":107129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"64'431","reported_seq":520,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161320+0000","last_change":"2024-04-26T10:45:48.865579+0000","last_active":"2024-04-26T10:45:57.161320+0000","last_peered":"2024-04-26T10:45:57.161320+0000","last_clean":"2024-04-26T10:45:57.161320+0000","last_became_active":"2024-04-26T10:45:48.865212+0000","last_became_peered":"2024-04-26T10:45:48.865212+0000","last_unstale":"2024-04-26T10:45:57.161320+0000","last_undegraded":"2024-04-26T10:45:57.161320+0000","last_fullsized":"2024-04-26T10:45:57.161320+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:53.808562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9902610,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":9913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9896193,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"63'410","reported_seq":515,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160782+0000","last_change":"2024-04-26T10:45:54.184713+0000","last_active":"2024-04-26T10:45:57.160782+0000","last_peered":"2024-04-26T10:45:57.160782+0000","last_clean":"2024-04-26T10:45:57.160782+0000","last_became_active":"2024-04-26T10:45:54.182167+0000","last_became_peered":"2024-04-26T10:45:54.182167+0000","last_unstale":"2024-04-26T10:45:57.160782+0000","last_undegraded":"2024-04-26T10:45:57.160782+0000","last_fullsized":"2024-04-26T10:45:57.160782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:41:50.625629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12734,"num_write":373,"num_write_kb":34864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"63'84","reported_seq":180,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.177612+0000","last_change":"2024-04-26T10:45:45.896842+0000","last_active":"2024-04-26T10:45:54.177612+0000","last_peered":"2024-04-26T10:45:54.177612+0000","last_clean":"2024-04-26T10:45:54.177612+0000","last_became_active":"2024-04-26T10:45:45.874746+0000","last_became_peered":"2024-04-26T10:45:45.874746+0000","last_unstale":"2024-04-26T10:45:54.177612+0000","last_undegraded":"2024-04-26T10:45:54.177612+0000","last_fullsized":"2024-04-26T10:45:54.177612+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:22.649667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"62'332","reported_seq":419,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161969+0000","last_change":"2024-04-26T10:45:56.161772+0000","last_active":"2024-04-26T10:45:57.161969+0000","last_peered":"2024-04-26T10:45:57.161969+0000","last_clean":"2024-04-26T10:45:57.161969+0000","last_became_active":"2024-04-26T10:45:56.161449+0000","last_became_peered":"2024-04-26T10:45:56.161449+0000","last_unstale":"2024-04-26T10:45:57.161969+0000","last_undegraded":"2024-04-26T10:45:57.161969+0000","last_fullsized":"2024-04-26T10:45:57.161969+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:09.499829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"63'487","reported_seq":1093,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.172709+0000","last_change":"2024-04-26T10:45:51.160586+0000","last_active":"2024-04-26T10:45:54.172709+0000","last_peered":"2024-04-26T10:45:54.172709+0000","last_clean":"2024-04-26T10:45:54.172709+0000","last_became_active":"2024-04-26T10:45:51.159235+0000","last_became_peered":"2024-04-26T10:45:51.159235+0000","last_unstale":"2024-04-26T10:45:54.172709+0000","last_undegraded":"2024-04-26T10:45:54.172709+0000","last_fullsized":"2024-04-26T10:45:54.172709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:54.234867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":43316,"num_write":468,"num_write_kb":77062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"62'61","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681170+0000","last_change":"2024-04-26T10:45:53.174204+0000","last_active":"2024-04-26T10:45:54.681170+0000","last_peered":"2024-04-26T10:45:54.681170+0000","last_clean":"2024-04-26T10:45:54.681170+0000","last_became_active":"2024-04-26T10:45:53.173851+0000","last_became_peered":"2024-04-26T10:45:53.173851+0000","last_unstale":"2024-04-26T10:45:54.681170+0000","last_undegraded":"2024-04-26T10:45:54.681170+0000","last_fullsized":"2024-04-26T10:45:54.681170+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:50.698470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'457","reported_seq":533,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.680854+0000","last_change":"2024-04-26T10:45:54.199966+0000","last_active":"2024-04-26T10:45:54.680854+0000","last_peered":"2024-04-26T10:45:54.680854+0000","last_clean":"2024-04-26T10:45:54.680854+0000","last_became_active":"2024-04-26T10:45:54.189622+0000","last_became_peered":"2024-04-26T10:45:54.189622+0000","last_unstale":"2024-04-26T10:45:54.680854+0000","last_undegraded":"2024-04-26T10:45:54.680854+0000","last_fullsized":"2024-04-26T10:45:54.680854+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:53.540098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14848,"num_write":427,"num_write_kb":71903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'377","reported_seq":835,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.180067+0000","last_change":"2024-04-26T10:45:49.867665+0000","last_active":"2024-04-26T10:45:54.180067+0000","last_peered":"2024-04-26T10:45:54.180067+0000","last_clean":"2024-04-26T10:45:54.180067+0000","last_became_active":"2024-04-26T10:45:49.866707+0000","last_became_peered":"2024-04-26T10:45:49.866707+0000","last_unstale":"2024-04-26T10:45:54.180067+0000","last_undegraded":"2024-04-26T10:45:54.180067+0000","last_fullsized":"2024-04-26T10:45:54.180067+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:23.401341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26932,"num_write":349,"num_write_kb":55611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"62'562","reported_seq":640,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.172762+0000","last_change":"2024-04-26T10:42:25.683890+0000","last_active":"2024-04-26T10:45:54.172762+0000","last_peered":"2024-04-26T10:45:54.172762+0000","last_clean":"2024-04-26T10:45:54.172762+0000","last_became_active":"2024-04-26T10:42:25.683467+0000","last_became_peered":"2024-04-26T10:42:25.683467+0000","last_unstale":"2024-04-26T10:45:54.172762+0000","last_undegraded":"2024-04-26T10:45:54.172762+0000","last_fullsized":"2024-04-26T10:45:54.172762+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":8440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'425","reported_seq":868,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:55.174733+0000","last_change":"2024-04-26T10:45:55.174882+0000","last_active":"2024-04-26T10:45:55.174733+0000","last_peered":"2024-04-26T10:45:54.829980+0000","last_clean":"2024-04-26T10:45:43.839496+0000","last_became_active":"2024-04-26T10:45:54.179182+0000","last_became_peered":"2024-04-26T10:45:54.179182+0000","last_unstale":"2024-04-26T10:45:55.174733+0000","last_undegraded":"2024-04-26T10:45:55.174733+0000","last_fullsized":"2024-04-26T10:45:55.174733+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:00.918761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":19004,"num_write":390,"num_write_kb":75524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"62'259","reported_seq":321,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:54.249667+0000","last_change":"2024-04-26T10:45:55.960570+0000","last_active":"2024-04-26T10:45:55.960570+0000","last_peered":"2024-04-26T10:45:54.249667+0000","last_clean":"2024-04-26T10:45:43.837444+0000","last_became_active":"2024-04-26T10:45:54.194244+0000","last_became_peered":"2024-04-26T10:45:54.194244+0000","last_unstale":"2024-04-26T10:45:54.249667+0000","last_undegraded":"2024-04-26T10:45:54.249667+0000","last_fullsized":"2024-04-26T10:45:54.249667+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:50.232753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'418","reported_seq":926,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:45:55.179671+0000","last_change":"2024-04-26T10:45:55.179671+0000","last_active":"2024-04-26T10:45:55.179671+0000","last_peered":"2024-04-26T10:45:55.179671+0000","last_clean":"2024-04-26T10:45:55.179671+0000","last_became_active":"2024-04-26T10:45:55.178079+0000","last_became_peered":"2024-04-26T10:45:55.178079+0000","last_unstale":"2024-04-26T10:45:55.179671+0000","last_undegraded":"2024-04-26T10:45:55.179671+0000","last_fullsized":"2024-04-26T10:45:55.179671+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:36.749926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":34476,"num_write":379,"num_write_kb":101645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"62'494","reported_seq":572,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.175864+0000","last_change":"2024-04-26T10:42:25.688221+0000","last_active":"2024-04-26T10:45:54.175864+0000","last_peered":"2024-04-26T10:45:54.175864+0000","last_clean":"2024-04-26T10:45:54.175864+0000","last_became_active":"2024-04-26T10:42:25.687829+0000","last_became_peered":"2024-04-26T10:42:25.687829+0000","last_unstale":"2024-04-26T10:45:54.175864+0000","last_undegraded":"2024-04-26T10:45:54.175864+0000","last_fullsized":"2024-04-26T10:45:54.175864+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:05.939715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":12543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"63'406","reported_seq":583,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.192518+0000","last_change":"2024-04-26T10:45:54.192178+0000","last_active":"2024-04-26T10:45:54.192518+0000","last_peered":"2024-04-26T10:45:54.192518+0000","last_clean":"2024-04-26T10:45:54.192518+0000","last_became_active":"2024-04-26T10:45:54.189591+0000","last_became_peered":"2024-04-26T10:45:54.189591+0000","last_unstale":"2024-04-26T10:45:54.192518+0000","last_undegraded":"2024-04-26T10:45:54.192518+0000","last_fullsized":"2024-04-26T10:45:54.192518+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:31.509288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":45941,"num_write":372,"num_write_kb":80011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"62'61","reported_seq":157,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.182850+0000","last_change":"2024-04-26T10:45:45.895125+0000","last_active":"2024-04-26T10:45:54.182850+0000","last_peered":"2024-04-26T10:45:54.182850+0000","last_clean":"2024-04-26T10:45:54.182850+0000","last_became_active":"2024-04-26T10:45:45.874300+0000","last_became_peered":"2024-04-26T10:45:45.874300+0000","last_unstale":"2024-04-26T10:45:54.182850+0000","last_undegraded":"2024-04-26T10:45:54.182850+0000","last_fullsized":"2024-04-26T10:45:54.182850+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:26.528893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"63'375","reported_seq":823,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161710+0000","last_change":"2024-04-26T10:45:56.163670+0000","last_active":"2024-04-26T10:45:57.161710+0000","last_peered":"2024-04-26T10:45:57.161710+0000","last_clean":"2024-04-26T10:45:57.161710+0000","last_became_active":"2024-04-26T10:45:56.160416+0000","last_became_peered":"2024-04-26T10:45:56.160416+0000","last_unstale":"2024-04-26T10:45:57.161710+0000","last_undegraded":"2024-04-26T10:45:57.161710+0000","last_fullsized":"2024-04-26T10:45:57.161710+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:43.147179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16213,"num_write":354,"num_write_kb":54493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":332,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"62'276","reported_seq":368,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160846+0000","last_change":"2024-04-26T10:45:56.160817+0000","last_active":"2024-04-26T10:45:57.160846+0000","last_peered":"2024-04-26T10:45:57.160846+0000","last_clean":"2024-04-26T10:45:57.160846+0000","last_became_active":"2024-04-26T10:45:56.160414+0000","last_became_peered":"2024-04-26T10:45:56.160414+0000","last_unstale":"2024-04-26T10:45:57.160846+0000","last_undegraded":"2024-04-26T10:45:57.160846+0000","last_fullsized":"2024-04-26T10:45:57.160846+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:40.374381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"63'379","reported_seq":475,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161030+0000","last_change":"2024-04-26T10:45:53.177365+0000","last_active":"2024-04-26T10:45:57.161030+0000","last_peered":"2024-04-26T10:45:57.161030+0000","last_clean":"2024-04-26T10:45:57.161030+0000","last_became_active":"2024-04-26T10:45:53.173645+0000","last_became_peered":"2024-04-26T10:45:53.173645+0000","last_unstale":"2024-04-26T10:45:57.161030+0000","last_undegraded":"2024-04-26T10:45:57.161030+0000","last_fullsized":"2024-04-26T10:45:57.161030+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:32.390075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20480,"num_write":343,"num_write_kb":25788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"62'237","reported_seq":344,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.177488+0000","last_change":"2024-04-26T10:45:48.867081+0000","last_active":"2024-04-26T10:45:54.177488+0000","last_peered":"2024-04-26T10:45:54.177488+0000","last_clean":"2024-04-26T10:45:54.177488+0000","last_became_active":"2024-04-26T10:45:48.866716+0000","last_became_peered":"2024-04-26T10:45:48.866716+0000","last_unstale":"2024-04-26T10:45:54.177488+0000","last_undegraded":"2024-04-26T10:45:54.177488+0000","last_fullsized":"2024-04-26T10:45:54.177488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:16.712392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":12393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"63'419","reported_seq":567,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.180904+0000","last_change":"2024-04-26T10:42:26.041729+0000","last_active":"2024-04-26T10:45:54.180904+0000","last_peered":"2024-04-26T10:45:54.180904+0000","last_clean":"2024-04-26T10:45:54.180904+0000","last_became_active":"2024-04-26T10:42:26.040504+0000","last_became_peered":"2024-04-26T10:42:26.040504+0000","last_unstale":"2024-04-26T10:45:54.180904+0000","last_undegraded":"2024-04-26T10:45:54.180904+0000","last_fullsized":"2024-04-26T10:45:54.180904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39582,"num_write":378,"num_write_kb":54867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"62'61","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681119+0000","last_change":"2024-04-26T10:45:53.227750+0000","last_active":"2024-04-26T10:45:54.681119+0000","last_peered":"2024-04-26T10:45:54.681119+0000","last_clean":"2024-04-26T10:45:54.681119+0000","last_became_active":"2024-04-26T10:45:53.178804+0000","last_became_peered":"2024-04-26T10:45:53.178804+0000","last_unstale":"2024-04-26T10:45:54.681119+0000","last_undegraded":"2024-04-26T10:45:54.681119+0000","last_fullsized":"2024-04-26T10:45:54.681119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:56.795614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'437","reported_seq":523,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162221+0000","last_change":"2024-04-26T10:45:53.181155+0000","last_active":"2024-04-26T10:45:57.162221+0000","last_peered":"2024-04-26T10:45:57.162221+0000","last_clean":"2024-04-26T10:45:57.162221+0000","last_became_active":"2024-04-26T10:45:53.177071+0000","last_became_peered":"2024-04-26T10:45:53.177071+0000","last_unstale":"2024-04-26T10:45:57.162221+0000","last_undegraded":"2024-04-26T10:45:57.162221+0000","last_fullsized":"2024-04-26T10:45:57.162221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:34.219319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":7562,"num_write":400,"num_write_kb":26121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"62'58","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681149+0000","last_change":"2024-04-26T10:45:53.197669+0000","last_active":"2024-04-26T10:45:54.681149+0000","last_peered":"2024-04-26T10:45:54.681149+0000","last_clean":"2024-04-26T10:45:54.681149+0000","last_became_active":"2024-04-26T10:45:53.173542+0000","last_became_peered":"2024-04-26T10:45:53.173542+0000","last_unstale":"2024-04-26T10:45:54.681149+0000","last_undegraded":"2024-04-26T10:45:54.681149+0000","last_fullsized":"2024-04-26T10:45:54.681149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:34.409430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":494,"num_objects_misplaced":194,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2672,"num_read_kb":1454712,"num_write":24538,"num_write_kb":4190103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8518,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26671,"ondisk_log_size":26671,"up":128,"acting":121,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128811551,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":5770,"num_write_kb":129888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":284332032,"data_stored":284257139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},"log_size":7595,"ondisk_log_size":7595,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738415,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":179292,"kb_used_data":80136,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94192548,"statfs":{"total":96636764160,"available":96453169152,"internally_reserved":0,"allocated":82059264,"data_stored":81552721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:45:25 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.20300000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42599999999999999,"15min":0.436},"min":{"1min":0.26000000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]}]},{"osd":1,"up_from":70,"seq":300647710725,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136028,"kb_used_data":90440,"kb_used_omap":7,"kb_used_meta":45560,"kb_avail":94235812,"statfs":{"total":96636764160,"available":96497471488,"internally_reserved":0,"allocated":92610560,"data_stored":92059263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7181,"internal_metadata":46654451},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738416,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":240368,"kb_used_data":110884,"kb_used_omap":1,"kb_used_meta":129470,"kb_avail":94131472,"statfs":{"total":96636764160,"available":96390627328,"internally_reserved":0,"allocated":113545216,"data_stored":113017367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132577734},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":2,"last update":"Fri Apr 26 10:45:26 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.43099999999999999,"15min":0.44900000000000001},"min":{"1min":0.21199999999999999,"5min":0.183,"15min":0.183},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.253},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.442,"15min":0.46500000000000002},"min":{"1min":0.23499999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57199999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.23999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":112062464,"data_stored":112034301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":91099136,"data_stored":91062815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81170432,"data_stored":81160023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:45:59.752 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T10:46:00.160 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:46:00.160 INFO:teuthology.orchestra.run.smithi049.stdout:{"fsid":"9837de44-a9e8-4979-adc4-611f3ddc44ce","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 494/110 objects degraded (449.091%), 3 pgs degraded","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":228,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":84,"num_osds":3,"num_up_osds":3,"osd_up_since":1714128344,"num_in_osds":3,"osd_in_since":1714128132,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":81},{"state_name":"peering","count":12},{"state_name":"active+undersized+remapped","count":4},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":3},{"state_name":"active+remapped","count":2},{"state_name":"active+recovery_wait+remapped","count":2},{"state_name":"active+recovering+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":129401919,"bytes_used":581566464,"bytes_avail":289328726016,"bytes_total":289910292480,"inactive_pgs_ratio":0.11428571492433548,"degraded_objects":494,"degraded_total":110,"degraded_ratio":4.4909090909090912,"misplaced_objects":354,"misplaced_total":110,"misplaced_ratio":3.2181818181818183,"recovering_objects_per_sec":1518,"recovering_bytes_per_sec":7705559,"recovering_keys_per_sec":0,"num_objects_recovered":6074,"num_bytes_recovered":30828341,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4218}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-26T10:43:31.605768+0000","services":{}},"progress_events":{}} 2024-04-26T10:46:00.173 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-26T10:46:00.174 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:46:00.472 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:46:00.473 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:46:00.483 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-04-26T10:45:59.649887+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129401919,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":494,"num_objects_misplaced":194,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2852,"num_read_kb":1456290,"num_write":30511,"num_write_kb":4323451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8565,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34423,"ondisk_log_size":34423,"up":210,"acting":203,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":222,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":555688,"kb_used_data":281460,"kb_used_omap":10,"kb_used_meta":274165,"kb_avail":282559832,"statfs":{"total":289910292480,"available":289341267968,"internally_reserved":0,"allocated":288215040,"data_stored":286629351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10369,"internal_metadata":280745855},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1174,"num_objects_misplaced":-733,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2732,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.478881"},"pg_stats":[{"pgid":"4.3f","version":"63'415","reported_seq":538,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.179264+0000","last_change":"2024-04-26T10:42:26.045527+0000","last_active":"2024-04-26T10:45:54.179264+0000","last_peered":"2024-04-26T10:45:54.179264+0000","last_clean":"2024-04-26T10:45:54.179264+0000","last_became_active":"2024-04-26T10:42:26.044597+0000","last_became_peered":"2024-04-26T10:42:26.044597+0000","last_unstale":"2024-04-26T10:45:54.179264+0000","last_undegraded":"2024-04-26T10:45:54.179264+0000","last_fullsized":"2024-04-26T10:45:54.179264+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22963,"num_write":385,"num_write_kb":71406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"63'396","reported_seq":518,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.195053+0000","last_change":"2024-04-26T10:45:54.194523+0000","last_active":"2024-04-26T10:45:54.195053+0000","last_peered":"2024-04-26T10:45:54.195053+0000","last_clean":"2024-04-26T10:45:54.195053+0000","last_became_active":"2024-04-26T10:45:54.192613+0000","last_became_peered":"2024-04-26T10:45:54.192613+0000","last_unstale":"2024-04-26T10:45:54.195053+0000","last_undegraded":"2024-04-26T10:45:54.195053+0000","last_fullsized":"2024-04-26T10:45:54.195053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:22.723004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9499,"num_write":371,"num_write_kb":38601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"63'366","reported_seq":449,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161698+0000","last_change":"2024-04-26T10:45:55.183758+0000","last_active":"2024-04-26T10:45:57.161698+0000","last_peered":"2024-04-26T10:45:57.161698+0000","last_clean":"2024-04-26T10:45:57.161698+0000","last_became_active":"2024-04-26T10:45:55.180991+0000","last_became_peered":"2024-04-26T10:45:55.180991+0000","last_unstale":"2024-04-26T10:45:57.161698+0000","last_undegraded":"2024-04-26T10:45:57.161698+0000","last_fullsized":"2024-04-26T10:45:57.161698+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:29.645448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6211,"num_write":338,"num_write_kb":38844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"63'394","reported_seq":545,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160935+0000","last_change":"2024-04-26T10:45:51.162341+0000","last_active":"2024-04-26T10:45:57.160935+0000","last_peered":"2024-04-26T10:45:57.160935+0000","last_clean":"2024-04-26T10:45:57.160935+0000","last_became_active":"2024-04-26T10:45:51.159099+0000","last_became_peered":"2024-04-26T10:45:51.159099+0000","last_unstale":"2024-04-26T10:45:57.160935+0000","last_undegraded":"2024-04-26T10:45:57.160935+0000","last_fullsized":"2024-04-26T10:45:57.160935+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:18.605866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":52323,"num_write":357,"num_write_kb":63323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"63'409","reported_seq":504,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.182764+0000","last_change":"2024-04-26T10:42:26.041191+0000","last_active":"2024-04-26T10:45:54.182764+0000","last_peered":"2024-04-26T10:45:54.182764+0000","last_clean":"2024-04-26T10:45:54.182764+0000","last_became_active":"2024-04-26T10:42:26.040487+0000","last_became_peered":"2024-04-26T10:42:26.040487+0000","last_unstale":"2024-04-26T10:45:54.182764+0000","last_undegraded":"2024-04-26T10:45:54.182764+0000","last_fullsized":"2024-04-26T10:45:54.182764+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":372,"num_write_kb":42764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'385","reported_seq":464,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161234+0000","last_change":"2024-04-26T10:45:49.864662+0000","last_active":"2024-04-26T10:45:57.161234+0000","last_peered":"2024-04-26T10:45:57.161234+0000","last_clean":"2024-04-26T10:45:57.161234+0000","last_became_active":"2024-04-26T10:45:49.861811+0000","last_became_peered":"2024-04-26T10:45:49.861811+0000","last_unstale":"2024-04-26T10:45:57.161234+0000","last_undegraded":"2024-04-26T10:45:57.161234+0000","last_fullsized":"2024-04-26T10:45:57.161234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:25.549464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4124,"num_write":356,"num_write_kb":69857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"63'425","reported_seq":534,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160809+0000","last_change":"2024-04-26T10:45:50.869572+0000","last_active":"2024-04-26T10:45:57.160809+0000","last_peered":"2024-04-26T10:45:57.160809+0000","last_clean":"2024-04-26T10:45:57.160809+0000","last_became_active":"2024-04-26T10:45:50.866996+0000","last_became_peered":"2024-04-26T10:45:50.866996+0000","last_unstale":"2024-04-26T10:45:57.160809+0000","last_undegraded":"2024-04-26T10:45:57.160809+0000","last_fullsized":"2024-04-26T10:45:57.160809+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:17.631869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13036,"num_write":390,"num_write_kb":67193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"63'399","reported_seq":507,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.164304+0000","last_change":"2024-04-26T10:45:58.164304+0000","last_active":"2024-04-26T10:45:58.164304+0000","last_peered":"2024-04-26T10:45:58.164304+0000","last_clean":"2024-04-26T10:45:58.164304+0000","last_became_active":"2024-04-26T10:45:58.162532+0000","last_became_peered":"2024-04-26T10:45:58.162532+0000","last_unstale":"2024-04-26T10:45:58.164304+0000","last_undegraded":"2024-04-26T10:45:58.164304+0000","last_fullsized":"2024-04-26T10:45:58.164304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:50.164416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25678,"num_write":356,"num_write_kb":116549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"63'442","reported_seq":586,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.172828+0000","last_change":"2024-04-26T10:42:26.045893+0000","last_active":"2024-04-26T10:45:54.172828+0000","last_peered":"2024-04-26T10:45:54.172828+0000","last_clean":"2024-04-26T10:45:54.172828+0000","last_became_active":"2024-04-26T10:42:26.045177+0000","last_became_peered":"2024-04-26T10:42:26.045177+0000","last_unstale":"2024-04-26T10:45:54.172828+0000","last_undegraded":"2024-04-26T10:45:54.172828+0000","last_fullsized":"2024-04-26T10:45:54.172828+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35111,"num_write":413,"num_write_kb":60306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'393","reported_seq":512,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.194713+0000","last_change":"2024-04-26T10:45:54.192984+0000","last_active":"2024-04-26T10:45:54.194713+0000","last_peered":"2024-04-26T10:45:54.194713+0000","last_clean":"2024-04-26T10:45:54.194713+0000","last_became_active":"2024-04-26T10:45:54.191514+0000","last_became_peered":"2024-04-26T10:45:54.191514+0000","last_unstale":"2024-04-26T10:45:54.194713+0000","last_undegraded":"2024-04-26T10:45:54.194713+0000","last_fullsized":"2024-04-26T10:45:54.194713+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:33.809143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5355,"num_write":351,"num_write_kb":38901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"63'377","reported_seq":482,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161319+0000","last_change":"2024-04-26T10:45:49.865172+0000","last_active":"2024-04-26T10:45:57.161319+0000","last_peered":"2024-04-26T10:45:57.161319+0000","last_clean":"2024-04-26T10:45:57.161319+0000","last_became_active":"2024-04-26T10:45:49.862718+0000","last_became_peered":"2024-04-26T10:45:49.862718+0000","last_unstale":"2024-04-26T10:45:57.161319+0000","last_undegraded":"2024-04-26T10:45:57.161319+0000","last_fullsized":"2024-04-26T10:45:57.161319+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:43.129958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18030,"num_write":355,"num_write_kb":67044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"63'365","reported_seq":797,"reported_epoch":81,"state":"active+undersized+remapped","last_fresh":"2024-04-26T10:45:55.371444+0000","last_change":"2024-04-26T10:45:55.371588+0000","last_active":"2024-04-26T10:45:55.371444+0000","last_peered":"2024-04-26T10:45:55.371444+0000","last_clean":"2024-04-26T10:43:07.780827+0000","last_became_active":"2024-04-26T10:45:46.969351+0000","last_became_peered":"2024-04-26T10:45:46.969351+0000","last_unstale":"2024-04-26T10:45:55.371444+0000","last_undegraded":"2024-04-26T10:45:55.371444+0000","last_fullsized":"2024-04-26T10:45:46.876204+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:42.659561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14866,"num_write":337,"num_write_kb":71188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'397","reported_seq":487,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.182235+0000","last_change":"2024-04-26T10:42:26.042607+0000","last_active":"2024-04-26T10:45:54.182235+0000","last_peered":"2024-04-26T10:45:54.182235+0000","last_clean":"2024-04-26T10:45:54.182235+0000","last_became_active":"2024-04-26T10:42:26.041617+0000","last_became_peered":"2024-04-26T10:42:26.041617+0000","last_unstale":"2024-04-26T10:45:54.182235+0000","last_undegraded":"2024-04-26T10:45:54.182235+0000","last_fullsized":"2024-04-26T10:45:54.182235+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8192,"num_write":362,"num_write_kb":54822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"63'408","reported_seq":487,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161186+0000","last_change":"2024-04-26T10:45:53.181618+0000","last_active":"2024-04-26T10:45:57.161186+0000","last_peered":"2024-04-26T10:45:57.161186+0000","last_clean":"2024-04-26T10:45:57.161186+0000","last_became_active":"2024-04-26T10:45:53.177677+0000","last_became_peered":"2024-04-26T10:45:53.177677+0000","last_unstale":"2024-04-26T10:45:57.161186+0000","last_undegraded":"2024-04-26T10:45:57.161186+0000","last_fullsized":"2024-04-26T10:45:57.161186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:06.719053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4688,"num_write":374,"num_write_kb":21766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"63'409","reported_seq":522,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160533+0000","last_change":"2024-04-26T10:45:54.188625+0000","last_active":"2024-04-26T10:45:57.160533+0000","last_peered":"2024-04-26T10:45:57.160533+0000","last_clean":"2024-04-26T10:45:57.160533+0000","last_became_active":"2024-04-26T10:45:54.185826+0000","last_became_peered":"2024-04-26T10:45:54.185826+0000","last_unstale":"2024-04-26T10:45:57.160533+0000","last_undegraded":"2024-04-26T10:45:57.160533+0000","last_fullsized":"2024-04-26T10:45:57.160533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:48.401265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25968,"num_write":366,"num_write_kb":75698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"63'460","reported_seq":562,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162279+0000","last_change":"2024-04-26T10:45:53.176893+0000","last_active":"2024-04-26T10:45:57.162279+0000","last_peered":"2024-04-26T10:45:57.162279+0000","last_clean":"2024-04-26T10:45:57.162279+0000","last_became_active":"2024-04-26T10:45:53.174699+0000","last_became_peered":"2024-04-26T10:45:53.174699+0000","last_unstale":"2024-04-26T10:45:57.162279+0000","last_undegraded":"2024-04-26T10:45:57.162279+0000","last_fullsized":"2024-04-26T10:45:57.162279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:41.919177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16269,"num_write":426,"num_write_kb":67839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"63'393","reported_seq":509,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.173426+0000","last_change":"2024-04-26T10:42:26.049338+0000","last_active":"2024-04-26T10:45:54.173426+0000","last_peered":"2024-04-26T10:45:54.173426+0000","last_clean":"2024-04-26T10:45:54.173426+0000","last_became_active":"2024-04-26T10:42:26.049014+0000","last_became_peered":"2024-04-26T10:42:26.049014+0000","last_unstale":"2024-04-26T10:45:54.173426+0000","last_undegraded":"2024-04-26T10:45:54.173426+0000","last_fullsized":"2024-04-26T10:45:54.173426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":25712,"num_write":362,"num_write_kb":42020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'428","reported_seq":551,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.194661+0000","last_change":"2024-04-26T10:45:54.192786+0000","last_active":"2024-04-26T10:45:54.194661+0000","last_peered":"2024-04-26T10:45:54.194661+0000","last_clean":"2024-04-26T10:45:54.194661+0000","last_became_active":"2024-04-26T10:45:54.189852+0000","last_became_peered":"2024-04-26T10:45:54.189852+0000","last_unstale":"2024-04-26T10:45:54.194661+0000","last_undegraded":"2024-04-26T10:45:54.194661+0000","last_fullsized":"2024-04-26T10:45:54.194661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:29.968564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12316,"num_write":384,"num_write_kb":87656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"63'446","reported_seq":584,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681052+0000","last_change":"2024-04-26T10:45:54.186962+0000","last_active":"2024-04-26T10:45:54.681052+0000","last_peered":"2024-04-26T10:45:54.681052+0000","last_clean":"2024-04-26T10:45:54.681052+0000","last_became_active":"2024-04-26T10:45:54.184063+0000","last_became_peered":"2024-04-26T10:45:54.184063+0000","last_unstale":"2024-04-26T10:45:54.681052+0000","last_undegraded":"2024-04-26T10:45:54.681052+0000","last_fullsized":"2024-04-26T10:45:54.681052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:59.349649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":53414,"num_write":401,"num_write_kb":80048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":550,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161291+0000","last_change":"2024-04-26T10:45:50.869971+0000","last_active":"2024-04-26T10:45:57.161291+0000","last_peered":"2024-04-26T10:45:57.161291+0000","last_clean":"2024-04-26T10:45:57.161291+0000","last_became_active":"2024-04-26T10:45:50.867680+0000","last_became_peered":"2024-04-26T10:45:50.867680+0000","last_unstale":"2024-04-26T10:45:57.161291+0000","last_undegraded":"2024-04-26T10:45:57.161291+0000","last_fullsized":"2024-04-26T10:45:57.161291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:17.680371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19859,"num_write":405,"num_write_kb":51119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"63'408","reported_seq":862,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161853+0000","last_change":"2024-04-26T10:45:56.163683+0000","last_active":"2024-04-26T10:45:57.161853+0000","last_peered":"2024-04-26T10:45:57.161853+0000","last_clean":"2024-04-26T10:45:57.161853+0000","last_became_active":"2024-04-26T10:45:56.160360+0000","last_became_peered":"2024-04-26T10:45:56.160360+0000","last_unstale":"2024-04-26T10:45:57.161853+0000","last_undegraded":"2024-04-26T10:45:57.161853+0000","last_fullsized":"2024-04-26T10:45:57.161853+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:44.845909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":15372,"num_write":366,"num_write_kb":75855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"63'452","reported_seq":1014,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.176394+0000","last_change":"2024-04-26T10:45:52.175372+0000","last_active":"2024-04-26T10:45:54.176394+0000","last_peered":"2024-04-26T10:45:54.176394+0000","last_clean":"2024-04-26T10:45:54.176394+0000","last_became_active":"2024-04-26T10:45:52.173702+0000","last_became_peered":"2024-04-26T10:45:52.173702+0000","last_unstale":"2024-04-26T10:45:54.176394+0000","last_undegraded":"2024-04-26T10:45:54.176394+0000","last_fullsized":"2024-04-26T10:45:54.176394+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:55.459452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43729,"num_write":421,"num_write_kb":79804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"63'408","reported_seq":871,"reported_epoch":81,"state":"active+undersized+remapped","last_fresh":"2024-04-26T10:45:55.188981+0000","last_change":"2024-04-26T10:45:55.189125+0000","last_active":"2024-04-26T10:45:55.188981+0000","last_peered":"2024-04-26T10:45:55.188981+0000","last_clean":"2024-04-26T10:45:43.837106+0000","last_became_active":"2024-04-26T10:45:54.176860+0000","last_became_peered":"2024-04-26T10:45:54.176860+0000","last_unstale":"2024-04-26T10:45:55.188981+0000","last_undegraded":"2024-04-26T10:45:55.188981+0000","last_fullsized":"2024-04-26T10:45:54.171433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:06.438350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":30320,"num_write":372,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2],"avail_no_missing":["2","0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'453","reported_seq":612,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.184897+0000","last_change":"2024-04-26T10:45:54.184330+0000","last_active":"2024-04-26T10:45:54.184897+0000","last_peered":"2024-04-26T10:45:54.184897+0000","last_clean":"2024-04-26T10:45:54.184897+0000","last_became_active":"2024-04-26T10:45:54.181881+0000","last_became_peered":"2024-04-26T10:45:54.181881+0000","last_unstale":"2024-04-26T10:45:54.184897+0000","last_undegraded":"2024-04-26T10:45:54.184897+0000","last_fullsized":"2024-04-26T10:45:54.184897+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:02.066091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":19864,"num_write":422,"num_write_kb":51638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"63'439","reported_seq":951,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.179267+0000","last_change":"2024-04-26T10:45:48.867766+0000","last_active":"2024-04-26T10:45:54.179267+0000","last_peered":"2024-04-26T10:45:54.179267+0000","last_clean":"2024-04-26T10:45:54.179267+0000","last_became_active":"2024-04-26T10:45:48.866159+0000","last_became_peered":"2024-04-26T10:45:48.866159+0000","last_unstale":"2024-04-26T10:45:54.179267+0000","last_undegraded":"2024-04-26T10:45:54.179267+0000","last_fullsized":"2024-04-26T10:45:54.179267+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:39.736649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8912,"num_write":417,"num_write_kb":46575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"63'513","reported_seq":1155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.172380+0000","last_change":"2024-04-26T10:45:51.160003+0000","last_active":"2024-04-26T10:45:54.172380+0000","last_peered":"2024-04-26T10:45:54.172380+0000","last_clean":"2024-04-26T10:45:54.172380+0000","last_became_active":"2024-04-26T10:45:51.158698+0000","last_became_peered":"2024-04-26T10:45:51.158698+0000","last_unstale":"2024-04-26T10:45:54.172380+0000","last_undegraded":"2024-04-26T10:45:54.172380+0000","last_fullsized":"2024-04-26T10:45:54.172380+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:36.990095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":70751,"num_write":473,"num_write_kb":88902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'406","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161212+0000","last_change":"2024-04-26T10:45:56.164805+0000","last_active":"2024-04-26T10:45:57.161212+0000","last_peered":"2024-04-26T10:45:57.161212+0000","last_clean":"2024-04-26T10:45:57.161212+0000","last_became_active":"2024-04-26T10:45:56.162419+0000","last_became_peered":"2024-04-26T10:45:56.162419+0000","last_unstale":"2024-04-26T10:45:57.161212+0000","last_undegraded":"2024-04-26T10:45:57.161212+0000","last_fullsized":"2024-04-26T10:45:57.161212+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:53.474847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":32121,"num_write":372,"num_write_kb":60163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"63'402","reported_seq":856,"reported_epoch":81,"state":"active+undersized+remapped","last_fresh":"2024-04-26T10:45:55.217948+0000","last_change":"2024-04-26T10:45:55.218106+0000","last_active":"2024-04-26T10:45:55.217948+0000","last_peered":"2024-04-26T10:45:55.217948+0000","last_clean":"2024-04-26T10:43:07.781070+0000","last_became_active":"2024-04-26T10:45:46.966258+0000","last_became_peered":"2024-04-26T10:45:46.966258+0000","last_unstale":"2024-04-26T10:45:55.217948+0000","last_undegraded":"2024-04-26T10:45:55.217948+0000","last_fullsized":"2024-04-26T10:45:46.872941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:13.642161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":6824,"num_write":378,"num_write_kb":72156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"63'407","reported_seq":883,"reported_epoch":80,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T10:45:54.203582+0000","last_change":"2024-04-26T10:45:54.203582+0000","last_active":"2024-04-26T10:45:54.203582+0000","last_peered":"2024-04-26T10:45:54.203582+0000","last_clean":"2024-04-26T10:45:51.160753+0000","last_became_active":"2024-04-26T10:45:54.201674+0000","last_became_peered":"2024-04-26T10:45:54.201674+0000","last_unstale":"2024-04-26T10:45:54.203582+0000","last_undegraded":"2024-04-26T10:45:54.177921+0000","last_fullsized":"2024-04-26T10:45:54.172633+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:39:13.200402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":173,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25898,"num_write":372,"num_write_kb":59274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"63'490","reported_seq":1055,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:45:55.179785+0000","last_change":"2024-04-26T10:45:55.179785+0000","last_active":"2024-04-26T10:45:55.179785+0000","last_peered":"2024-04-26T10:45:55.179785+0000","last_clean":"2024-04-26T10:45:55.179785+0000","last_became_active":"2024-04-26T10:45:55.178083+0000","last_became_peered":"2024-04-26T10:45:55.178083+0000","last_unstale":"2024-04-26T10:45:55.179785+0000","last_undegraded":"2024-04-26T10:45:55.179785+0000","last_fullsized":"2024-04-26T10:45:55.179785+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:23.269957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33597,"num_write":449,"num_write_kb":87981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"63'474","reported_seq":560,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.680966+0000","last_change":"2024-04-26T10:45:54.189228+0000","last_active":"2024-04-26T10:45:54.680966+0000","last_peered":"2024-04-26T10:45:54.680966+0000","last_clean":"2024-04-26T10:45:54.680966+0000","last_became_active":"2024-04-26T10:45:54.186011+0000","last_became_peered":"2024-04-26T10:45:54.186011+0000","last_unstale":"2024-04-26T10:45:54.680966+0000","last_undegraded":"2024-04-26T10:45:54.680966+0000","last_fullsized":"2024-04-26T10:45:54.680966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.355145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30886,"num_write":441,"num_write_kb":118807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'443","reported_seq":547,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162005+0000","last_change":"2024-04-26T10:45:48.864423+0000","last_active":"2024-04-26T10:45:57.162005+0000","last_peered":"2024-04-26T10:45:57.162005+0000","last_clean":"2024-04-26T10:45:57.162005+0000","last_became_active":"2024-04-26T10:45:48.861918+0000","last_became_peered":"2024-04-26T10:45:48.861918+0000","last_unstale":"2024-04-26T10:45:57.162005+0000","last_undegraded":"2024-04-26T10:45:57.162005+0000","last_fullsized":"2024-04-26T10:45:57.162005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:11.356135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20556,"num_write":413,"num_write_kb":91647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"63'376","reported_seq":475,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.179848+0000","last_change":"2024-04-26T10:42:26.041757+0000","last_active":"2024-04-26T10:45:54.179848+0000","last_peered":"2024-04-26T10:45:54.179848+0000","last_clean":"2024-04-26T10:45:54.179848+0000","last_became_active":"2024-04-26T10:42:26.040920+0000","last_became_peered":"2024-04-26T10:42:26.040920+0000","last_unstale":"2024-04-26T10:45:54.179848+0000","last_undegraded":"2024-04-26T10:45:54.179848+0000","last_fullsized":"2024-04-26T10:45:54.179848+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10124,"num_write":344,"num_write_kb":66899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"62'453","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161061+0000","last_change":"2024-04-26T10:45:48.862782+0000","last_active":"2024-04-26T10:45:57.161061+0000","last_peered":"2024-04-26T10:45:57.161061+0000","last_clean":"2024-04-26T10:45:57.161061+0000","last_became_active":"2024-04-26T10:45:48.862424+0000","last_became_peered":"2024-04-26T10:45:48.862424+0000","last_unstale":"2024-04-26T10:45:57.161061+0000","last_undegraded":"2024-04-26T10:45:57.161061+0000","last_fullsized":"2024-04-26T10:45:57.161061+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:16.548893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"63'403","reported_seq":517,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.176947+0000","last_change":"2024-04-26T10:42:26.041850+0000","last_active":"2024-04-26T10:45:54.176947+0000","last_peered":"2024-04-26T10:45:54.176947+0000","last_clean":"2024-04-26T10:45:54.176947+0000","last_became_active":"2024-04-26T10:42:26.040464+0000","last_became_peered":"2024-04-26T10:42:26.040464+0000","last_unstale":"2024-04-26T10:45:54.176947+0000","last_undegraded":"2024-04-26T10:45:54.176947+0000","last_fullsized":"2024-04-26T10:45:54.176947+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24588,"num_write":363,"num_write_kb":51190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"62'49","reported_seq":140,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171816+0000","last_change":"2024-04-26T10:45:45.862317+0000","last_active":"2024-04-26T10:45:54.171816+0000","last_peered":"2024-04-26T10:45:54.171816+0000","last_clean":"2024-04-26T10:45:54.171816+0000","last_became_active":"2024-04-26T10:45:45.862029+0000","last_became_peered":"2024-04-26T10:45:45.862029+0000","last_unstale":"2024-04-26T10:45:54.171816+0000","last_undegraded":"2024-04-26T10:45:54.171816+0000","last_fullsized":"2024-04-26T10:45:54.171816+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:02.521534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'407","reported_seq":884,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.174973+0000","last_change":"2024-04-26T10:45:52.170710+0000","last_active":"2024-04-26T10:45:54.174973+0000","last_peered":"2024-04-26T10:45:54.174973+0000","last_clean":"2024-04-26T10:45:54.174973+0000","last_became_active":"2024-04-26T10:45:52.169295+0000","last_became_peered":"2024-04-26T10:45:52.169295+0000","last_unstale":"2024-04-26T10:45:54.174973+0000","last_undegraded":"2024-04-26T10:45:54.174973+0000","last_fullsized":"2024-04-26T10:45:54.174973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:10.995530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":7077,"num_write":367,"num_write_kb":42434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"62'66","reported_seq":157,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.180683+0000","last_change":"2024-04-26T10:45:45.874440+0000","last_active":"2024-04-26T10:45:54.180683+0000","last_peered":"2024-04-26T10:45:54.180683+0000","last_clean":"2024-04-26T10:45:54.180683+0000","last_became_active":"2024-04-26T10:45:45.874030+0000","last_became_peered":"2024-04-26T10:45:45.874030+0000","last_unstale":"2024-04-26T10:45:54.180683+0000","last_undegraded":"2024-04-26T10:45:54.180683+0000","last_fullsized":"2024-04-26T10:45:54.180683+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:22.711644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"63'406","reported_seq":895,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.173118+0000","last_change":"2024-04-26T10:45:49.863376+0000","last_active":"2024-04-26T10:45:54.173118+0000","last_peered":"2024-04-26T10:45:54.173118+0000","last_clean":"2024-04-26T10:45:54.173118+0000","last_became_active":"2024-04-26T10:45:49.861979+0000","last_became_peered":"2024-04-26T10:45:49.861979+0000","last_unstale":"2024-04-26T10:45:54.173118+0000","last_undegraded":"2024-04-26T10:45:54.173118+0000","last_fullsized":"2024-04-26T10:45:54.173118+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:16.553043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":25977,"num_write":374,"num_write_kb":104172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'66","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161876+0000","last_change":"2024-04-26T10:45:45.871507+0000","last_active":"2024-04-26T10:45:57.161876+0000","last_peered":"2024-04-26T10:45:57.161876+0000","last_clean":"2024-04-26T10:45:57.161876+0000","last_became_active":"2024-04-26T10:45:45.871120+0000","last_became_peered":"2024-04-26T10:45:45.871120+0000","last_unstale":"2024-04-26T10:45:57.161876+0000","last_undegraded":"2024-04-26T10:45:57.161876+0000","last_fullsized":"2024-04-26T10:45:57.161876+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:56.162347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"62'200","reported_seq":281,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161233+0000","last_change":"2024-04-26T10:45:48.866225+0000","last_active":"2024-04-26T10:45:57.161233+0000","last_peered":"2024-04-26T10:45:57.161233+0000","last_clean":"2024-04-26T10:45:57.161233+0000","last_became_active":"2024-04-26T10:45:48.865878+0000","last_became_peered":"2024-04-26T10:45:48.865878+0000","last_unstale":"2024-04-26T10:45:57.161233+0000","last_undegraded":"2024-04-26T10:45:57.161233+0000","last_fullsized":"2024-04-26T10:45:57.161233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:42:39.518391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"63'415","reported_seq":897,"reported_epoch":81,"state":"active+undersized+remapped","last_fresh":"2024-04-26T10:45:55.697821+0000","last_change":"2024-04-26T10:45:55.697970+0000","last_active":"2024-04-26T10:45:55.697821+0000","last_peered":"2024-04-26T10:45:55.697821+0000","last_clean":"2024-04-26T10:43:07.780428+0000","last_became_active":"2024-04-26T10:45:46.974406+0000","last_became_peered":"2024-04-26T10:45:46.974406+0000","last_unstale":"2024-04-26T10:45:55.697821+0000","last_undegraded":"2024-04-26T10:45:55.697821+0000","last_fullsized":"2024-04-26T10:45:46.851421+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:01.679410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15757,"num_write":380,"num_write_kb":54727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"62'342","reported_seq":445,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.178620+0000","last_change":"2024-04-26T10:45:48.866915+0000","last_active":"2024-04-26T10:45:54.178620+0000","last_peered":"2024-04-26T10:45:54.178620+0000","last_clean":"2024-04-26T10:45:54.178620+0000","last_became_active":"2024-04-26T10:45:48.866497+0000","last_became_peered":"2024-04-26T10:45:48.866497+0000","last_unstale":"2024-04-26T10:45:54.178620+0000","last_undegraded":"2024-04-26T10:45:54.178620+0000","last_fullsized":"2024-04-26T10:45:54.178620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:04.796882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"63'481","reported_seq":667,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.185085+0000","last_change":"2024-04-26T10:45:54.184646+0000","last_active":"2024-04-26T10:45:54.185085+0000","last_peered":"2024-04-26T10:45:54.185085+0000","last_clean":"2024-04-26T10:45:54.185085+0000","last_became_active":"2024-04-26T10:45:54.181993+0000","last_became_peered":"2024-04-26T10:45:54.181993+0000","last_unstale":"2024-04-26T10:45:54.185085+0000","last_undegraded":"2024-04-26T10:45:54.185085+0000","last_fullsized":"2024-04-26T10:45:54.185085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:34.664600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":45251,"num_write":451,"num_write_kb":105365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"62'460","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160768+0000","last_change":"2024-04-26T10:45:48.865887+0000","last_active":"2024-04-26T10:45:57.160768+0000","last_peered":"2024-04-26T10:45:57.160768+0000","last_clean":"2024-04-26T10:45:57.160768+0000","last_became_active":"2024-04-26T10:45:48.865520+0000","last_became_peered":"2024-04-26T10:45:48.865520+0000","last_unstale":"2024-04-26T10:45:57.160768+0000","last_undegraded":"2024-04-26T10:45:57.160768+0000","last_fullsized":"2024-04-26T10:45:57.160768+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:34.308634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":407,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'420","reported_seq":503,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.165736+0000","last_change":"2024-04-26T10:45:57.165390+0000","last_active":"2024-04-26T10:45:57.165736+0000","last_peered":"2024-04-26T10:45:57.165736+0000","last_clean":"2024-04-26T10:45:57.165736+0000","last_became_active":"2024-04-26T10:45:57.162014+0000","last_became_peered":"2024-04-26T10:45:57.162014+0000","last_unstale":"2024-04-26T10:45:57.165736+0000","last_undegraded":"2024-04-26T10:45:57.165736+0000","last_fullsized":"2024-04-26T10:45:57.165736+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:19.491785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13025,"num_write":385,"num_write_kb":38595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"62'67","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161113+0000","last_change":"2024-04-26T10:45:45.860717+0000","last_active":"2024-04-26T10:45:57.161113+0000","last_peered":"2024-04-26T10:45:57.161113+0000","last_clean":"2024-04-26T10:45:57.161113+0000","last_became_active":"2024-04-26T10:45:45.860175+0000","last_became_peered":"2024-04-26T10:45:45.860175+0000","last_unstale":"2024-04-26T10:45:57.161113+0000","last_undegraded":"2024-04-26T10:45:57.161113+0000","last_fullsized":"2024-04-26T10:45:57.161113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:30.736518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"63'452","reported_seq":961,"reported_epoch":80,"state":"active+recovery_wait+remapped","last_fresh":"2024-04-26T10:45:54.204641+0000","last_change":"2024-04-26T10:45:54.204641+0000","last_active":"2024-04-26T10:45:54.204641+0000","last_peered":"2024-04-26T10:45:54.204641+0000","last_clean":"2024-04-26T10:45:43.837618+0000","last_became_active":"2024-04-26T10:45:54.203315+0000","last_became_peered":"2024-04-26T10:45:54.203315+0000","last_unstale":"2024-04-26T10:45:54.204641+0000","last_undegraded":"2024-04-26T10:45:54.204641+0000","last_fullsized":"2024-04-26T10:45:54.204641+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:52:49.647563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":194,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23217,"num_write":416,"num_write_kb":71418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"62'200","reported_seq":267,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:54.693188+0000","last_change":"2024-04-26T10:45:55.960626+0000","last_active":"2024-04-26T10:45:55.960626+0000","last_peered":"2024-04-26T10:45:54.693188+0000","last_clean":"2024-04-26T10:45:43.837381+0000","last_became_active":"2024-04-26T10:45:54.201777+0000","last_became_peered":"2024-04-26T10:45:54.201777+0000","last_unstale":"2024-04-26T10:45:54.693188+0000","last_undegraded":"2024-04-26T10:45:54.693188+0000","last_fullsized":"2024-04-26T10:45:54.693188+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:48.896541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'430","reported_seq":512,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.165078+0000","last_change":"2024-04-26T10:45:57.164742+0000","last_active":"2024-04-26T10:45:57.165078+0000","last_peered":"2024-04-26T10:45:57.165078+0000","last_clean":"2024-04-26T10:45:57.165078+0000","last_became_active":"2024-04-26T10:45:57.162070+0000","last_became_peered":"2024-04-26T10:45:57.162070+0000","last_unstale":"2024-04-26T10:45:57.165078+0000","last_undegraded":"2024-04-26T10:45:57.165078+0000","last_fullsized":"2024-04-26T10:45:57.165078+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:14.872176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":24352,"num_write":392,"num_write_kb":21976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"62'233","reported_seq":306,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160855+0000","last_change":"2024-04-26T10:45:48.862856+0000","last_active":"2024-04-26T10:45:57.160855+0000","last_peered":"2024-04-26T10:45:57.160855+0000","last_clean":"2024-04-26T10:45:57.160855+0000","last_became_active":"2024-04-26T10:45:48.862517+0000","last_became_peered":"2024-04-26T10:45:48.862517+0000","last_unstale":"2024-04-26T10:45:57.160855+0000","last_undegraded":"2024-04-26T10:45:57.160855+0000","last_fullsized":"2024-04-26T10:45:57.160855+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:43.799960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"63'393","reported_seq":478,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160672+0000","last_change":"2024-04-26T10:45:55.180960+0000","last_active":"2024-04-26T10:45:57.160672+0000","last_peered":"2024-04-26T10:45:57.160672+0000","last_clean":"2024-04-26T10:45:57.160672+0000","last_became_active":"2024-04-26T10:45:55.177758+0000","last_became_peered":"2024-04-26T10:45:55.177758+0000","last_unstale":"2024-04-26T10:45:57.160672+0000","last_undegraded":"2024-04-26T10:45:57.160672+0000","last_fullsized":"2024-04-26T10:45:57.160672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:47.889251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8671,"num_write":368,"num_write_kb":38542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"62'49","reported_seq":140,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.180800+0000","last_change":"2024-04-26T10:45:45.874789+0000","last_active":"2024-04-26T10:45:54.180800+0000","last_peered":"2024-04-26T10:45:54.180800+0000","last_clean":"2024-04-26T10:45:54.180800+0000","last_became_active":"2024-04-26T10:45:45.874328+0000","last_became_peered":"2024-04-26T10:45:45.874328+0000","last_unstale":"2024-04-26T10:45:54.180800+0000","last_undegraded":"2024-04-26T10:45:54.180800+0000","last_fullsized":"2024-04-26T10:45:54.180800+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:27.431661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"63'368","reported_seq":463,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162061+0000","last_change":"2024-04-26T10:45:56.165615+0000","last_active":"2024-04-26T10:45:57.162061+0000","last_peered":"2024-04-26T10:45:57.162061+0000","last_clean":"2024-04-26T10:45:57.162061+0000","last_became_active":"2024-04-26T10:45:56.163456+0000","last_became_peered":"2024-04-26T10:45:56.163456+0000","last_unstale":"2024-04-26T10:45:57.162061+0000","last_undegraded":"2024-04-26T10:45:57.162061+0000","last_fullsized":"2024-04-26T10:45:57.162061+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:14.480860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":19222,"num_write":336,"num_write_kb":58903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"62'619","reported_seq":737,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:55.173549+0000","last_change":"2024-04-26T10:45:55.174640+0000","last_active":"2024-04-26T10:45:55.173549+0000","last_peered":"2024-04-26T10:45:54.265645+0000","last_clean":"2024-04-26T10:45:51.156152+0000","last_became_active":"2024-04-26T10:45:54.200111+0000","last_became_peered":"2024-04-26T10:45:54.200111+0000","last_unstale":"2024-04-26T10:45:55.173549+0000","last_undegraded":"2024-04-26T10:45:55.173549+0000","last_fullsized":"2024-04-26T10:45:55.173549+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:32:45.842505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":558,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"63'383","reported_seq":817,"reported_epoch":80,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T10:45:54.196892+0000","last_change":"2024-04-26T10:45:54.196892+0000","last_active":"2024-04-26T10:45:54.196892+0000","last_peered":"2024-04-26T10:45:54.196892+0000","last_clean":"2024-04-26T10:45:51.156554+0000","last_became_active":"2024-04-26T10:45:54.195746+0000","last_became_peered":"2024-04-26T10:45:54.195746+0000","last_unstale":"2024-04-26T10:45:54.196892+0000","last_undegraded":"2024-04-26T10:45:54.177564+0000","last_fullsized":"2024-04-26T10:45:54.173407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:34.841726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":168,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":14260,"num_write":349,"num_write_kb":50367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":229,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161708+0000","last_change":"2024-04-26T10:45:45.871511+0000","last_active":"2024-04-26T10:45:57.161708+0000","last_peered":"2024-04-26T10:45:57.161708+0000","last_clean":"2024-04-26T10:45:57.161708+0000","last_became_active":"2024-04-26T10:45:45.871155+0000","last_became_peered":"2024-04-26T10:45:45.871155+0000","last_unstale":"2024-04-26T10:45:57.161708+0000","last_undegraded":"2024-04-26T10:45:57.161708+0000","last_fullsized":"2024-04-26T10:45:57.161708+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:53.015361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160932+0000","last_change":"2024-04-26T10:45:45.861068+0000","last_active":"2024-04-26T10:45:57.160932+0000","last_peered":"2024-04-26T10:45:57.160932+0000","last_clean":"2024-04-26T10:45:57.160932+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:57.160932+0000","last_undegraded":"2024-04-26T10:45:57.160932+0000","last_fullsized":"2024-04-26T10:45:57.160932+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:16.348009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"62'743","reported_seq":821,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.171968+0000","last_change":"2024-04-26T10:42:25.686765+0000","last_active":"2024-04-26T10:45:54.171968+0000","last_peered":"2024-04-26T10:45:54.171968+0000","last_clean":"2024-04-26T10:45:54.171968+0000","last_became_active":"2024-04-26T10:42:25.686009+0000","last_became_peered":"2024-04-26T10:42:25.686009+0000","last_unstale":"2024-04-26T10:45:54.171968+0000","last_undegraded":"2024-04-26T10:45:54.171968+0000","last_fullsized":"2024-04-26T10:45:54.171968+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:54.627815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'442","reported_seq":567,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160853+0000","last_change":"2024-04-26T10:45:55.181074+0000","last_active":"2024-04-26T10:45:57.160853+0000","last_peered":"2024-04-26T10:45:57.160853+0000","last_clean":"2024-04-26T10:45:57.160853+0000","last_became_active":"2024-04-26T10:45:55.177751+0000","last_became_peered":"2024-04-26T10:45:55.177751+0000","last_unstale":"2024-04-26T10:45:57.160853+0000","last_undegraded":"2024-04-26T10:45:57.160853+0000","last_fullsized":"2024-04-26T10:45:57.160853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:01.323521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":34346,"num_write":406,"num_write_kb":96298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162129+0000","last_change":"2024-04-26T10:45:45.872099+0000","last_active":"2024-04-26T10:45:57.162129+0000","last_peered":"2024-04-26T10:45:57.162129+0000","last_clean":"2024-04-26T10:45:57.162129+0000","last_became_active":"2024-04-26T10:45:45.871741+0000","last_became_peered":"2024-04-26T10:45:45.871741+0000","last_unstale":"2024-04-26T10:45:57.162129+0000","last_undegraded":"2024-04-26T10:45:57.162129+0000","last_fullsized":"2024-04-26T10:45:57.162129+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:53.226378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"63'102","reported_seq":209,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:54.219118+0000","last_change":"2024-04-26T10:45:55.960530+0000","last_active":"2024-04-26T10:45:55.960530+0000","last_peered":"2024-04-26T10:45:54.219118+0000","last_clean":"2024-04-26T10:45:43.837073+0000","last_became_active":"2024-04-26T10:45:54.189849+0000","last_became_peered":"2024-04-26T10:45:54.189849+0000","last_unstale":"2024-04-26T10:45:54.219118+0000","last_undegraded":"2024-04-26T10:45:54.219118+0000","last_fullsized":"2024-04-26T10:45:54.219118+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:47.864335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467631,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":44,"num_write_kb":1460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2935262,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'485","reported_seq":620,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162426+0000","last_change":"2024-04-26T10:45:57.165815+0000","last_active":"2024-04-26T10:45:58.162426+0000","last_peered":"2024-04-26T10:45:58.162426+0000","last_clean":"2024-04-26T10:45:58.162426+0000","last_became_active":"2024-04-26T10:45:57.162752+0000","last_became_peered":"2024-04-26T10:45:57.162752+0000","last_unstale":"2024-04-26T10:45:58.162426+0000","last_undegraded":"2024-04-26T10:45:58.162426+0000","last_fullsized":"2024-04-26T10:45:58.162426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:10.743149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27703,"num_write":454,"num_write_kb":121509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681001+0000","last_change":"2024-04-26T10:45:53.180892+0000","last_active":"2024-04-26T10:45:54.681001+0000","last_peered":"2024-04-26T10:45:54.681001+0000","last_clean":"2024-04-26T10:45:54.681001+0000","last_became_active":"2024-04-26T10:45:53.180675+0000","last_became_peered":"2024-04-26T10:45:53.180675+0000","last_unstale":"2024-04-26T10:45:54.681001+0000","last_undegraded":"2024-04-26T10:45:54.681001+0000","last_fullsized":"2024-04-26T10:45:54.681001+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:45.758505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"62'306","reported_seq":410,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.179256+0000","last_change":"2024-04-26T10:45:48.865095+0000","last_active":"2024-04-26T10:45:54.179256+0000","last_peered":"2024-04-26T10:45:54.179256+0000","last_clean":"2024-04-26T10:45:54.179256+0000","last_became_active":"2024-04-26T10:45:48.864763+0000","last_became_peered":"2024-04-26T10:45:48.864763+0000","last_unstale":"2024-04-26T10:45:54.179256+0000","last_undegraded":"2024-04-26T10:45:54.179256+0000","last_fullsized":"2024-04-26T10:45:54.179256+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:12.665388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"63'336","reported_seq":743,"reported_epoch":80,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T10:45:54.196130+0000","last_change":"2024-04-26T10:45:54.196130+0000","last_active":"2024-04-26T10:45:54.196130+0000","last_peered":"2024-04-26T10:45:54.196130+0000","last_clean":"2024-04-26T10:45:51.156451+0000","last_became_active":"2024-04-26T10:45:54.195199+0000","last_became_peered":"2024-04-26T10:45:54.195199+0000","last_unstale":"2024-04-26T10:45:54.196130+0000","last_undegraded":"2024-04-26T10:45:54.176438+0000","last_fullsized":"2024-04-26T10:45:54.173233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:00:49.770197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":153,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12035,"num_write":314,"num_write_kb":29928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160636+0000","last_change":"2024-04-26T10:45:45.861233+0000","last_active":"2024-04-26T10:45:57.160636+0000","last_peered":"2024-04-26T10:45:57.160636+0000","last_clean":"2024-04-26T10:45:57.160636+0000","last_became_active":"2024-04-26T10:45:45.860924+0000","last_became_peered":"2024-04-26T10:45:45.860924+0000","last_unstale":"2024-04-26T10:45:57.160636+0000","last_undegraded":"2024-04-26T10:45:57.160636+0000","last_fullsized":"2024-04-26T10:45:57.160636+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:11.746110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"62'64","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160997+0000","last_change":"2024-04-26T10:45:45.861230+0000","last_active":"2024-04-26T10:45:57.160997+0000","last_peered":"2024-04-26T10:45:57.160997+0000","last_clean":"2024-04-26T10:45:57.160997+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:57.160997+0000","last_undegraded":"2024-04-26T10:45:57.160997+0000","last_fullsized":"2024-04-26T10:45:57.160997+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:53.564033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"63'421","reported_seq":510,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681036+0000","last_change":"2024-04-26T10:45:54.188138+0000","last_active":"2024-04-26T10:45:54.681036+0000","last_peered":"2024-04-26T10:45:54.681036+0000","last_clean":"2024-04-26T10:45:54.681036+0000","last_became_active":"2024-04-26T10:45:54.185053+0000","last_became_peered":"2024-04-26T10:45:54.185053+0000","last_unstale":"2024-04-26T10:45:54.681036+0000","last_undegraded":"2024-04-26T10:45:54.681036+0000","last_fullsized":"2024-04-26T10:45:54.681036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:55:26.158040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28557,"num_write":385,"num_write_kb":93083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"62'480","reported_seq":553,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160417+0000","last_change":"2024-04-26T10:45:48.862894+0000","last_active":"2024-04-26T10:45:57.160417+0000","last_peered":"2024-04-26T10:45:57.160417+0000","last_clean":"2024-04-26T10:45:57.160417+0000","last_became_active":"2024-04-26T10:45:48.862564+0000","last_became_peered":"2024-04-26T10:45:48.862564+0000","last_unstale":"2024-04-26T10:45:57.160417+0000","last_undegraded":"2024-04-26T10:45:57.160417+0000","last_fullsized":"2024-04-26T10:45:57.160417+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:38.835403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":81,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.172444+0000","last_change":"2024-04-26T10:42:21.405754+0000","last_active":"2024-04-26T10:45:54.172444+0000","last_peered":"2024-04-26T10:45:54.172444+0000","last_clean":"2024-04-26T10:45:54.172444+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:45:54.172444+0000","last_undegraded":"2024-04-26T10:45:54.172444+0000","last_fullsized":"2024-04-26T10:45:54.172444+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:47.123256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'352","reported_seq":773,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.175671+0000","last_change":"2024-04-26T10:45:53.183401+0000","last_active":"2024-04-26T10:45:54.175671+0000","last_peered":"2024-04-26T10:45:54.175671+0000","last_clean":"2024-04-26T10:45:54.175671+0000","last_became_active":"2024-04-26T10:45:53.182454+0000","last_became_peered":"2024-04-26T10:45:53.182454+0000","last_unstale":"2024-04-26T10:45:54.175671+0000","last_undegraded":"2024-04-26T10:45:54.175671+0000","last_fullsized":"2024-04-26T10:45:54.175671+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:38.569626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":1905,"num_write":313,"num_write_kb":25573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"62'59","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681025+0000","last_change":"2024-04-26T10:45:53.177446+0000","last_active":"2024-04-26T10:45:54.681025+0000","last_peered":"2024-04-26T10:45:54.681025+0000","last_clean":"2024-04-26T10:45:54.681025+0000","last_became_active":"2024-04-26T10:45:53.176996+0000","last_became_peered":"2024-04-26T10:45:53.176996+0000","last_unstale":"2024-04-26T10:45:54.681025+0000","last_undegraded":"2024-04-26T10:45:54.681025+0000","last_fullsized":"2024-04-26T10:45:54.681025+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:23.679423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":88,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161096+0000","last_change":"2024-04-26T10:45:53.175046+0000","last_active":"2024-04-26T10:45:57.161096+0000","last_peered":"2024-04-26T10:45:57.161096+0000","last_clean":"2024-04-26T10:45:57.161096+0000","last_became_active":"2024-04-26T10:45:53.174781+0000","last_became_peered":"2024-04-26T10:45:53.174781+0000","last_unstale":"2024-04-26T10:45:57.161096+0000","last_undegraded":"2024-04-26T10:45:57.161096+0000","last_fullsized":"2024-04-26T10:45:57.161096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:22.742084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'408","reported_seq":904,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.186926+0000","last_change":"2024-04-26T10:45:54.186637+0000","last_active":"2024-04-26T10:45:54.186926+0000","last_peered":"2024-04-26T10:45:54.186926+0000","last_clean":"2024-04-26T10:45:54.186926+0000","last_became_active":"2024-04-26T10:45:54.185238+0000","last_became_peered":"2024-04-26T10:45:54.185238+0000","last_unstale":"2024-04-26T10:45:54.186926+0000","last_undegraded":"2024-04-26T10:45:54.186926+0000","last_fullsized":"2024-04-26T10:45:54.186926+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:54.735683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19939,"num_write":382,"num_write_kb":63433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"62'55","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681180+0000","last_change":"2024-04-26T10:45:53.205131+0000","last_active":"2024-04-26T10:45:54.681180+0000","last_peered":"2024-04-26T10:45:54.681180+0000","last_clean":"2024-04-26T10:45:54.681180+0000","last_became_active":"2024-04-26T10:45:53.177305+0000","last_became_peered":"2024-04-26T10:45:53.177305+0000","last_unstale":"2024-04-26T10:45:54.681180+0000","last_undegraded":"2024-04-26T10:45:54.681180+0000","last_fullsized":"2024-04-26T10:45:54.681180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:30.829530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681063+0000","last_change":"2024-04-26T10:45:53.177593+0000","last_active":"2024-04-26T10:45:54.681063+0000","last_peered":"2024-04-26T10:45:54.681063+0000","last_clean":"2024-04-26T10:45:54.681063+0000","last_became_active":"2024-04-26T10:45:53.177249+0000","last_became_peered":"2024-04-26T10:45:53.177249+0000","last_unstale":"2024-04-26T10:45:54.681063+0000","last_undegraded":"2024-04-26T10:45:54.681063+0000","last_fullsized":"2024-04-26T10:45:54.681063+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:41.564852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'418","reported_seq":867,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:55.173634+0000","last_change":"2024-04-26T10:45:55.174039+0000","last_active":"2024-04-26T10:45:55.173634+0000","last_peered":"2024-04-26T10:45:54.680875+0000","last_clean":"2024-04-26T10:45:43.837000+0000","last_became_active":"2024-04-26T10:45:54.178289+0000","last_became_peered":"2024-04-26T10:45:54.178289+0000","last_unstale":"2024-04-26T10:45:55.173634+0000","last_undegraded":"2024-04-26T10:45:55.173634+0000","last_fullsized":"2024-04-26T10:45:55.173634+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:21.326365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20110,"num_write":390,"num_write_kb":75171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"64'66","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681129+0000","last_change":"2024-04-26T10:45:53.203538+0000","last_active":"2024-04-26T10:45:54.681129+0000","last_peered":"2024-04-26T10:45:54.681129+0000","last_clean":"2024-04-26T10:45:54.681129+0000","last_became_active":"2024-04-26T10:45:53.175946+0000","last_became_peered":"2024-04-26T10:45:53.175946+0000","last_unstale":"2024-04-26T10:45:54.681129+0000","last_undegraded":"2024-04-26T10:45:54.681129+0000","last_fullsized":"2024-04-26T10:45:54.681129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:15.016761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161004+0000","last_change":"2024-04-26T10:45:45.872224+0000","last_active":"2024-04-26T10:45:57.161004+0000","last_peered":"2024-04-26T10:45:57.161004+0000","last_clean":"2024-04-26T10:45:57.161004+0000","last_became_active":"2024-04-26T10:45:45.871923+0000","last_became_peered":"2024-04-26T10:45:45.871923+0000","last_unstale":"2024-04-26T10:45:57.161004+0000","last_undegraded":"2024-04-26T10:45:57.161004+0000","last_fullsized":"2024-04-26T10:45:57.161004+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:00.334874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"63'404","reported_seq":918,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.184887+0000","last_change":"2024-04-26T10:45:54.184386+0000","last_active":"2024-04-26T10:45:54.184887+0000","last_peered":"2024-04-26T10:45:54.184887+0000","last_clean":"2024-04-26T10:45:54.184887+0000","last_became_active":"2024-04-26T10:45:54.181795+0000","last_became_peered":"2024-04-26T10:45:54.181795+0000","last_unstale":"2024-04-26T10:45:54.184887+0000","last_undegraded":"2024-04-26T10:45:54.184887+0000","last_fullsized":"2024-04-26T10:45:54.184887+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:10.290362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41262,"num_write":371,"num_write_kb":75820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"63'441","reported_seq":564,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161829+0000","last_change":"2024-04-26T10:45:54.188488+0000","last_active":"2024-04-26T10:45:57.161829+0000","last_peered":"2024-04-26T10:45:57.161829+0000","last_clean":"2024-04-26T10:45:57.161829+0000","last_became_active":"2024-04-26T10:45:54.185862+0000","last_became_peered":"2024-04-26T10:45:54.185862+0000","last_unstale":"2024-04-26T10:45:57.161829+0000","last_undegraded":"2024-04-26T10:45:57.161829+0000","last_fullsized":"2024-04-26T10:45:57.161829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:07.585438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31514,"num_write":408,"num_write_kb":107129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"64'431","reported_seq":520,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161320+0000","last_change":"2024-04-26T10:45:48.865579+0000","last_active":"2024-04-26T10:45:57.161320+0000","last_peered":"2024-04-26T10:45:57.161320+0000","last_clean":"2024-04-26T10:45:57.161320+0000","last_became_active":"2024-04-26T10:45:48.865212+0000","last_became_peered":"2024-04-26T10:45:48.865212+0000","last_unstale":"2024-04-26T10:45:57.161320+0000","last_undegraded":"2024-04-26T10:45:57.161320+0000","last_fullsized":"2024-04-26T10:45:57.161320+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:53.808562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9902610,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":9913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9896193,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"63'410","reported_seq":515,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160782+0000","last_change":"2024-04-26T10:45:54.184713+0000","last_active":"2024-04-26T10:45:57.160782+0000","last_peered":"2024-04-26T10:45:57.160782+0000","last_clean":"2024-04-26T10:45:57.160782+0000","last_became_active":"2024-04-26T10:45:54.182167+0000","last_became_peered":"2024-04-26T10:45:54.182167+0000","last_unstale":"2024-04-26T10:45:57.160782+0000","last_undegraded":"2024-04-26T10:45:57.160782+0000","last_fullsized":"2024-04-26T10:45:57.160782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:41:50.625629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12734,"num_write":373,"num_write_kb":34864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"63'84","reported_seq":180,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.177612+0000","last_change":"2024-04-26T10:45:45.896842+0000","last_active":"2024-04-26T10:45:54.177612+0000","last_peered":"2024-04-26T10:45:54.177612+0000","last_clean":"2024-04-26T10:45:54.177612+0000","last_became_active":"2024-04-26T10:45:45.874746+0000","last_became_peered":"2024-04-26T10:45:45.874746+0000","last_unstale":"2024-04-26T10:45:54.177612+0000","last_undegraded":"2024-04-26T10:45:54.177612+0000","last_fullsized":"2024-04-26T10:45:54.177612+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:22.649667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"62'332","reported_seq":419,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161969+0000","last_change":"2024-04-26T10:45:56.161772+0000","last_active":"2024-04-26T10:45:57.161969+0000","last_peered":"2024-04-26T10:45:57.161969+0000","last_clean":"2024-04-26T10:45:57.161969+0000","last_became_active":"2024-04-26T10:45:56.161449+0000","last_became_peered":"2024-04-26T10:45:56.161449+0000","last_unstale":"2024-04-26T10:45:57.161969+0000","last_undegraded":"2024-04-26T10:45:57.161969+0000","last_fullsized":"2024-04-26T10:45:57.161969+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:09.499829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"63'487","reported_seq":1093,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.172709+0000","last_change":"2024-04-26T10:45:51.160586+0000","last_active":"2024-04-26T10:45:54.172709+0000","last_peered":"2024-04-26T10:45:54.172709+0000","last_clean":"2024-04-26T10:45:54.172709+0000","last_became_active":"2024-04-26T10:45:51.159235+0000","last_became_peered":"2024-04-26T10:45:51.159235+0000","last_unstale":"2024-04-26T10:45:54.172709+0000","last_undegraded":"2024-04-26T10:45:54.172709+0000","last_fullsized":"2024-04-26T10:45:54.172709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:54.234867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":43316,"num_write":468,"num_write_kb":77062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"62'61","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681170+0000","last_change":"2024-04-26T10:45:53.174204+0000","last_active":"2024-04-26T10:45:54.681170+0000","last_peered":"2024-04-26T10:45:54.681170+0000","last_clean":"2024-04-26T10:45:54.681170+0000","last_became_active":"2024-04-26T10:45:53.173851+0000","last_became_peered":"2024-04-26T10:45:53.173851+0000","last_unstale":"2024-04-26T10:45:54.681170+0000","last_undegraded":"2024-04-26T10:45:54.681170+0000","last_fullsized":"2024-04-26T10:45:54.681170+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:50.698470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'457","reported_seq":533,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.680854+0000","last_change":"2024-04-26T10:45:54.199966+0000","last_active":"2024-04-26T10:45:54.680854+0000","last_peered":"2024-04-26T10:45:54.680854+0000","last_clean":"2024-04-26T10:45:54.680854+0000","last_became_active":"2024-04-26T10:45:54.189622+0000","last_became_peered":"2024-04-26T10:45:54.189622+0000","last_unstale":"2024-04-26T10:45:54.680854+0000","last_undegraded":"2024-04-26T10:45:54.680854+0000","last_fullsized":"2024-04-26T10:45:54.680854+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:53.540098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14848,"num_write":427,"num_write_kb":71903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'377","reported_seq":835,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.180067+0000","last_change":"2024-04-26T10:45:49.867665+0000","last_active":"2024-04-26T10:45:54.180067+0000","last_peered":"2024-04-26T10:45:54.180067+0000","last_clean":"2024-04-26T10:45:54.180067+0000","last_became_active":"2024-04-26T10:45:49.866707+0000","last_became_peered":"2024-04-26T10:45:49.866707+0000","last_unstale":"2024-04-26T10:45:54.180067+0000","last_undegraded":"2024-04-26T10:45:54.180067+0000","last_fullsized":"2024-04-26T10:45:54.180067+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:23.401341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26932,"num_write":349,"num_write_kb":55611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"62'562","reported_seq":640,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.172762+0000","last_change":"2024-04-26T10:42:25.683890+0000","last_active":"2024-04-26T10:45:54.172762+0000","last_peered":"2024-04-26T10:45:54.172762+0000","last_clean":"2024-04-26T10:45:54.172762+0000","last_became_active":"2024-04-26T10:42:25.683467+0000","last_became_peered":"2024-04-26T10:42:25.683467+0000","last_unstale":"2024-04-26T10:45:54.172762+0000","last_undegraded":"2024-04-26T10:45:54.172762+0000","last_fullsized":"2024-04-26T10:45:54.172762+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":8440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'425","reported_seq":868,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:55.174733+0000","last_change":"2024-04-26T10:45:55.174882+0000","last_active":"2024-04-26T10:45:55.174733+0000","last_peered":"2024-04-26T10:45:54.829980+0000","last_clean":"2024-04-26T10:45:43.839496+0000","last_became_active":"2024-04-26T10:45:54.179182+0000","last_became_peered":"2024-04-26T10:45:54.179182+0000","last_unstale":"2024-04-26T10:45:55.174733+0000","last_undegraded":"2024-04-26T10:45:55.174733+0000","last_fullsized":"2024-04-26T10:45:55.174733+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:00.918761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":19004,"num_write":390,"num_write_kb":75524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"62'259","reported_seq":321,"reported_epoch":81,"state":"peering","last_fresh":"2024-04-26T10:45:54.249667+0000","last_change":"2024-04-26T10:45:55.960570+0000","last_active":"2024-04-26T10:45:55.960570+0000","last_peered":"2024-04-26T10:45:54.249667+0000","last_clean":"2024-04-26T10:45:43.837444+0000","last_became_active":"2024-04-26T10:45:54.194244+0000","last_became_peered":"2024-04-26T10:45:54.194244+0000","last_unstale":"2024-04-26T10:45:54.249667+0000","last_undegraded":"2024-04-26T10:45:54.249667+0000","last_fullsized":"2024-04-26T10:45:54.249667+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:50.232753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'418","reported_seq":926,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:45:55.179671+0000","last_change":"2024-04-26T10:45:55.179671+0000","last_active":"2024-04-26T10:45:55.179671+0000","last_peered":"2024-04-26T10:45:55.179671+0000","last_clean":"2024-04-26T10:45:55.179671+0000","last_became_active":"2024-04-26T10:45:55.178079+0000","last_became_peered":"2024-04-26T10:45:55.178079+0000","last_unstale":"2024-04-26T10:45:55.179671+0000","last_undegraded":"2024-04-26T10:45:55.179671+0000","last_fullsized":"2024-04-26T10:45:55.179671+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:36.749926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":34476,"num_write":379,"num_write_kb":101645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"62'494","reported_seq":572,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.175864+0000","last_change":"2024-04-26T10:42:25.688221+0000","last_active":"2024-04-26T10:45:54.175864+0000","last_peered":"2024-04-26T10:45:54.175864+0000","last_clean":"2024-04-26T10:45:54.175864+0000","last_became_active":"2024-04-26T10:42:25.687829+0000","last_became_peered":"2024-04-26T10:42:25.687829+0000","last_unstale":"2024-04-26T10:45:54.175864+0000","last_undegraded":"2024-04-26T10:45:54.175864+0000","last_fullsized":"2024-04-26T10:45:54.175864+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:05.939715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":12543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"63'406","reported_seq":583,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.192518+0000","last_change":"2024-04-26T10:45:54.192178+0000","last_active":"2024-04-26T10:45:54.192518+0000","last_peered":"2024-04-26T10:45:54.192518+0000","last_clean":"2024-04-26T10:45:54.192518+0000","last_became_active":"2024-04-26T10:45:54.189591+0000","last_became_peered":"2024-04-26T10:45:54.189591+0000","last_unstale":"2024-04-26T10:45:54.192518+0000","last_undegraded":"2024-04-26T10:45:54.192518+0000","last_fullsized":"2024-04-26T10:45:54.192518+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:31.509288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":45941,"num_write":372,"num_write_kb":80011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"62'61","reported_seq":157,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.182850+0000","last_change":"2024-04-26T10:45:45.895125+0000","last_active":"2024-04-26T10:45:54.182850+0000","last_peered":"2024-04-26T10:45:54.182850+0000","last_clean":"2024-04-26T10:45:54.182850+0000","last_became_active":"2024-04-26T10:45:45.874300+0000","last_became_peered":"2024-04-26T10:45:45.874300+0000","last_unstale":"2024-04-26T10:45:54.182850+0000","last_undegraded":"2024-04-26T10:45:54.182850+0000","last_fullsized":"2024-04-26T10:45:54.182850+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:26.528893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"63'375","reported_seq":823,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161710+0000","last_change":"2024-04-26T10:45:56.163670+0000","last_active":"2024-04-26T10:45:57.161710+0000","last_peered":"2024-04-26T10:45:57.161710+0000","last_clean":"2024-04-26T10:45:57.161710+0000","last_became_active":"2024-04-26T10:45:56.160416+0000","last_became_peered":"2024-04-26T10:45:56.160416+0000","last_unstale":"2024-04-26T10:45:57.161710+0000","last_undegraded":"2024-04-26T10:45:57.161710+0000","last_fullsized":"2024-04-26T10:45:57.161710+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:43.147179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16213,"num_write":354,"num_write_kb":54493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":332,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"62'276","reported_seq":368,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160846+0000","last_change":"2024-04-26T10:45:56.160817+0000","last_active":"2024-04-26T10:45:57.160846+0000","last_peered":"2024-04-26T10:45:57.160846+0000","last_clean":"2024-04-26T10:45:57.160846+0000","last_became_active":"2024-04-26T10:45:56.160414+0000","last_became_peered":"2024-04-26T10:45:56.160414+0000","last_unstale":"2024-04-26T10:45:57.160846+0000","last_undegraded":"2024-04-26T10:45:57.160846+0000","last_fullsized":"2024-04-26T10:45:57.160846+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:40.374381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"63'379","reported_seq":475,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161030+0000","last_change":"2024-04-26T10:45:53.177365+0000","last_active":"2024-04-26T10:45:57.161030+0000","last_peered":"2024-04-26T10:45:57.161030+0000","last_clean":"2024-04-26T10:45:57.161030+0000","last_became_active":"2024-04-26T10:45:53.173645+0000","last_became_peered":"2024-04-26T10:45:53.173645+0000","last_unstale":"2024-04-26T10:45:57.161030+0000","last_undegraded":"2024-04-26T10:45:57.161030+0000","last_fullsized":"2024-04-26T10:45:57.161030+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:32.390075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20480,"num_write":343,"num_write_kb":25788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"62'237","reported_seq":344,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.177488+0000","last_change":"2024-04-26T10:45:48.867081+0000","last_active":"2024-04-26T10:45:54.177488+0000","last_peered":"2024-04-26T10:45:54.177488+0000","last_clean":"2024-04-26T10:45:54.177488+0000","last_became_active":"2024-04-26T10:45:48.866716+0000","last_became_peered":"2024-04-26T10:45:48.866716+0000","last_unstale":"2024-04-26T10:45:54.177488+0000","last_undegraded":"2024-04-26T10:45:54.177488+0000","last_fullsized":"2024-04-26T10:45:54.177488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:16.712392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":12393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"63'419","reported_seq":567,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.180904+0000","last_change":"2024-04-26T10:42:26.041729+0000","last_active":"2024-04-26T10:45:54.180904+0000","last_peered":"2024-04-26T10:45:54.180904+0000","last_clean":"2024-04-26T10:45:54.180904+0000","last_became_active":"2024-04-26T10:42:26.040504+0000","last_became_peered":"2024-04-26T10:42:26.040504+0000","last_unstale":"2024-04-26T10:45:54.180904+0000","last_undegraded":"2024-04-26T10:45:54.180904+0000","last_fullsized":"2024-04-26T10:45:54.180904+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39582,"num_write":378,"num_write_kb":54867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"62'61","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681119+0000","last_change":"2024-04-26T10:45:53.227750+0000","last_active":"2024-04-26T10:45:54.681119+0000","last_peered":"2024-04-26T10:45:54.681119+0000","last_clean":"2024-04-26T10:45:54.681119+0000","last_became_active":"2024-04-26T10:45:53.178804+0000","last_became_peered":"2024-04-26T10:45:53.178804+0000","last_unstale":"2024-04-26T10:45:54.681119+0000","last_undegraded":"2024-04-26T10:45:54.681119+0000","last_fullsized":"2024-04-26T10:45:54.681119+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:56.795614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'437","reported_seq":523,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162221+0000","last_change":"2024-04-26T10:45:53.181155+0000","last_active":"2024-04-26T10:45:57.162221+0000","last_peered":"2024-04-26T10:45:57.162221+0000","last_clean":"2024-04-26T10:45:57.162221+0000","last_became_active":"2024-04-26T10:45:53.177071+0000","last_became_peered":"2024-04-26T10:45:53.177071+0000","last_unstale":"2024-04-26T10:45:57.162221+0000","last_undegraded":"2024-04-26T10:45:57.162221+0000","last_fullsized":"2024-04-26T10:45:57.162221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:34.219319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":7562,"num_write":400,"num_write_kb":26121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"62'58","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:45:54.681149+0000","last_change":"2024-04-26T10:45:53.197669+0000","last_active":"2024-04-26T10:45:54.681149+0000","last_peered":"2024-04-26T10:45:54.681149+0000","last_clean":"2024-04-26T10:45:54.681149+0000","last_became_active":"2024-04-26T10:45:53.173542+0000","last_became_peered":"2024-04-26T10:45:53.173542+0000","last_unstale":"2024-04-26T10:45:54.681149+0000","last_undegraded":"2024-04-26T10:45:54.681149+0000","last_fullsized":"2024-04-26T10:45:54.681149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:34.409430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":494,"num_objects_misplaced":194,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2672,"num_read_kb":1454712,"num_write":24538,"num_write_kb":4190103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8518,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26671,"ondisk_log_size":26671,"up":128,"acting":121,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128811551,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":5770,"num_write_kb":129888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":284332032,"data_stored":284257139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},"log_size":7595,"ondisk_log_size":7595,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738415,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":179292,"kb_used_data":80136,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94192548,"statfs":{"total":96636764160,"available":96453169152,"internally_reserved":0,"allocated":82059264,"data_stored":81552721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:45:25 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.20300000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42599999999999999,"15min":0.436},"min":{"1min":0.26000000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]}]},{"osd":1,"up_from":70,"seq":300647710725,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136028,"kb_used_data":90440,"kb_used_omap":7,"kb_used_meta":45560,"kb_avail":94235812,"statfs":{"total":96636764160,"available":96497471488,"internally_reserved":0,"allocated":92610560,"data_stored":92059263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7181,"internal_metadata":46654451},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738416,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":240368,"kb_used_data":110884,"kb_used_omap":1,"kb_used_meta":129470,"kb_avail":94131472,"statfs":{"total":96636764160,"available":96390627328,"internally_reserved":0,"allocated":113545216,"data_stored":113017367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132577734},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":2,"last update":"Fri Apr 26 10:45:26 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.43099999999999999,"15min":0.44900000000000001},"min":{"1min":0.21199999999999999,"5min":0.183,"15min":0.183},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.253},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.442,"15min":0.46500000000000002},"min":{"1min":0.23499999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57199999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.23999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":112062464,"data_stored":112034301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":91099136,"data_stored":91062815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81170432,"data_stored":81160023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:46:03.489 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:46:03.807 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:46:03.808 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:46:03.818 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-04-26T10:46:03.650828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129401919,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2852,"num_read_kb":1456290,"num_write":30511,"num_write_kb":4323451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9253,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34423,"ondisk_log_size":34423,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":222,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":533824,"kb_used_data":255500,"kb_used_omap":10,"kb_used_meta":278261,"kb_avail":282581696,"statfs":{"total":289910292480,"available":289363656704,"internally_reserved":0,"allocated":261632000,"data_stored":260022078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10369,"internal_metadata":284940159},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-494,"num_objects_misplaced":-354,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1332,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.494930"},"pg_stats":[{"pgid":"4.3f","version":"63'415","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160204+0000","last_change":"2024-04-26T10:42:26.045527+0000","last_active":"2024-04-26T10:45:57.160204+0000","last_peered":"2024-04-26T10:45:57.160204+0000","last_clean":"2024-04-26T10:45:57.160204+0000","last_became_active":"2024-04-26T10:42:26.044597+0000","last_became_peered":"2024-04-26T10:42:26.044597+0000","last_unstale":"2024-04-26T10:45:57.160204+0000","last_undegraded":"2024-04-26T10:45:57.160204+0000","last_fullsized":"2024-04-26T10:45:57.160204+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22963,"num_write":385,"num_write_kb":71406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"63'396","reported_seq":521,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159219+0000","last_change":"2024-04-26T10:45:54.194523+0000","last_active":"2024-04-26T10:45:57.159219+0000","last_peered":"2024-04-26T10:45:57.159219+0000","last_clean":"2024-04-26T10:45:57.159219+0000","last_became_active":"2024-04-26T10:45:54.192613+0000","last_became_peered":"2024-04-26T10:45:54.192613+0000","last_unstale":"2024-04-26T10:45:57.159219+0000","last_undegraded":"2024-04-26T10:45:57.159219+0000","last_fullsized":"2024-04-26T10:45:57.159219+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:22.723004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9499,"num_write":371,"num_write_kb":38601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"63'366","reported_seq":449,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161698+0000","last_change":"2024-04-26T10:45:55.183758+0000","last_active":"2024-04-26T10:45:57.161698+0000","last_peered":"2024-04-26T10:45:57.161698+0000","last_clean":"2024-04-26T10:45:57.161698+0000","last_became_active":"2024-04-26T10:45:55.180991+0000","last_became_peered":"2024-04-26T10:45:55.180991+0000","last_unstale":"2024-04-26T10:45:57.161698+0000","last_undegraded":"2024-04-26T10:45:57.161698+0000","last_fullsized":"2024-04-26T10:45:57.161698+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:29.645448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6211,"num_write":338,"num_write_kb":38844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"63'394","reported_seq":545,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160935+0000","last_change":"2024-04-26T10:45:51.162341+0000","last_active":"2024-04-26T10:45:57.160935+0000","last_peered":"2024-04-26T10:45:57.160935+0000","last_clean":"2024-04-26T10:45:57.160935+0000","last_became_active":"2024-04-26T10:45:51.159099+0000","last_became_peered":"2024-04-26T10:45:51.159099+0000","last_unstale":"2024-04-26T10:45:57.160935+0000","last_undegraded":"2024-04-26T10:45:57.160935+0000","last_fullsized":"2024-04-26T10:45:57.160935+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:18.605866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":52323,"num_write":357,"num_write_kb":63323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"63'409","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160398+0000","last_change":"2024-04-26T10:42:26.041191+0000","last_active":"2024-04-26T10:45:57.160398+0000","last_peered":"2024-04-26T10:45:57.160398+0000","last_clean":"2024-04-26T10:45:57.160398+0000","last_became_active":"2024-04-26T10:42:26.040487+0000","last_became_peered":"2024-04-26T10:42:26.040487+0000","last_unstale":"2024-04-26T10:45:57.160398+0000","last_undegraded":"2024-04-26T10:45:57.160398+0000","last_fullsized":"2024-04-26T10:45:57.160398+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":372,"num_write_kb":42764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'385","reported_seq":464,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161234+0000","last_change":"2024-04-26T10:45:49.864662+0000","last_active":"2024-04-26T10:45:57.161234+0000","last_peered":"2024-04-26T10:45:57.161234+0000","last_clean":"2024-04-26T10:45:57.161234+0000","last_became_active":"2024-04-26T10:45:49.861811+0000","last_became_peered":"2024-04-26T10:45:49.861811+0000","last_unstale":"2024-04-26T10:45:57.161234+0000","last_undegraded":"2024-04-26T10:45:57.161234+0000","last_fullsized":"2024-04-26T10:45:57.161234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:25.549464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4124,"num_write":356,"num_write_kb":69857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"63'425","reported_seq":534,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160809+0000","last_change":"2024-04-26T10:45:50.869572+0000","last_active":"2024-04-26T10:45:57.160809+0000","last_peered":"2024-04-26T10:45:57.160809+0000","last_clean":"2024-04-26T10:45:57.160809+0000","last_became_active":"2024-04-26T10:45:50.866996+0000","last_became_peered":"2024-04-26T10:45:50.866996+0000","last_unstale":"2024-04-26T10:45:57.160809+0000","last_undegraded":"2024-04-26T10:45:57.160809+0000","last_fullsized":"2024-04-26T10:45:57.160809+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:17.631869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13036,"num_write":390,"num_write_kb":67193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"63'399","reported_seq":507,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.164304+0000","last_change":"2024-04-26T10:45:58.164304+0000","last_active":"2024-04-26T10:45:58.164304+0000","last_peered":"2024-04-26T10:45:58.164304+0000","last_clean":"2024-04-26T10:45:58.164304+0000","last_became_active":"2024-04-26T10:45:58.162532+0000","last_became_peered":"2024-04-26T10:45:58.162532+0000","last_unstale":"2024-04-26T10:45:58.164304+0000","last_undegraded":"2024-04-26T10:45:58.164304+0000","last_fullsized":"2024-04-26T10:45:58.164304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:50.164416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25678,"num_write":356,"num_write_kb":116549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"63'442","reported_seq":589,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159518+0000","last_change":"2024-04-26T10:42:26.045893+0000","last_active":"2024-04-26T10:45:57.159518+0000","last_peered":"2024-04-26T10:45:57.159518+0000","last_clean":"2024-04-26T10:45:57.159518+0000","last_became_active":"2024-04-26T10:42:26.045177+0000","last_became_peered":"2024-04-26T10:42:26.045177+0000","last_unstale":"2024-04-26T10:45:57.159518+0000","last_undegraded":"2024-04-26T10:45:57.159518+0000","last_fullsized":"2024-04-26T10:45:57.159518+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35111,"num_write":413,"num_write_kb":60306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'393","reported_seq":515,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159399+0000","last_change":"2024-04-26T10:45:54.192984+0000","last_active":"2024-04-26T10:45:57.159399+0000","last_peered":"2024-04-26T10:45:57.159399+0000","last_clean":"2024-04-26T10:45:57.159399+0000","last_became_active":"2024-04-26T10:45:54.191514+0000","last_became_peered":"2024-04-26T10:45:54.191514+0000","last_unstale":"2024-04-26T10:45:57.159399+0000","last_undegraded":"2024-04-26T10:45:57.159399+0000","last_fullsized":"2024-04-26T10:45:57.159399+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:33.809143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5355,"num_write":351,"num_write_kb":38901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"63'377","reported_seq":482,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161319+0000","last_change":"2024-04-26T10:45:49.865172+0000","last_active":"2024-04-26T10:45:57.161319+0000","last_peered":"2024-04-26T10:45:57.161319+0000","last_clean":"2024-04-26T10:45:57.161319+0000","last_became_active":"2024-04-26T10:45:49.862718+0000","last_became_peered":"2024-04-26T10:45:49.862718+0000","last_unstale":"2024-04-26T10:45:57.161319+0000","last_undegraded":"2024-04-26T10:45:57.161319+0000","last_fullsized":"2024-04-26T10:45:57.161319+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:43.129958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18030,"num_write":355,"num_write_kb":67044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"63'365","reported_seq":808,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.167133+0000","last_change":"2024-04-26T10:45:57.166219+0000","last_active":"2024-04-26T10:45:57.167133+0000","last_peered":"2024-04-26T10:45:57.167133+0000","last_clean":"2024-04-26T10:45:57.167133+0000","last_became_active":"2024-04-26T10:45:57.164964+0000","last_became_peered":"2024-04-26T10:45:57.164964+0000","last_unstale":"2024-04-26T10:45:57.167133+0000","last_undegraded":"2024-04-26T10:45:57.167133+0000","last_fullsized":"2024-04-26T10:45:57.167133+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:55.064831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14866,"num_write":337,"num_write_kb":71188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'397","reported_seq":490,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160289+0000","last_change":"2024-04-26T10:42:26.042607+0000","last_active":"2024-04-26T10:45:57.160289+0000","last_peered":"2024-04-26T10:45:57.160289+0000","last_clean":"2024-04-26T10:45:57.160289+0000","last_became_active":"2024-04-26T10:42:26.041617+0000","last_became_peered":"2024-04-26T10:42:26.041617+0000","last_unstale":"2024-04-26T10:45:57.160289+0000","last_undegraded":"2024-04-26T10:45:57.160289+0000","last_fullsized":"2024-04-26T10:45:57.160289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8192,"num_write":362,"num_write_kb":54822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"63'408","reported_seq":487,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161186+0000","last_change":"2024-04-26T10:45:53.181618+0000","last_active":"2024-04-26T10:45:57.161186+0000","last_peered":"2024-04-26T10:45:57.161186+0000","last_clean":"2024-04-26T10:45:57.161186+0000","last_became_active":"2024-04-26T10:45:53.177677+0000","last_became_peered":"2024-04-26T10:45:53.177677+0000","last_unstale":"2024-04-26T10:45:57.161186+0000","last_undegraded":"2024-04-26T10:45:57.161186+0000","last_fullsized":"2024-04-26T10:45:57.161186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:06.719053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4688,"num_write":374,"num_write_kb":21766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"63'409","reported_seq":522,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160533+0000","last_change":"2024-04-26T10:45:54.188625+0000","last_active":"2024-04-26T10:45:57.160533+0000","last_peered":"2024-04-26T10:45:57.160533+0000","last_clean":"2024-04-26T10:45:57.160533+0000","last_became_active":"2024-04-26T10:45:54.185826+0000","last_became_peered":"2024-04-26T10:45:54.185826+0000","last_unstale":"2024-04-26T10:45:57.160533+0000","last_undegraded":"2024-04-26T10:45:57.160533+0000","last_fullsized":"2024-04-26T10:45:57.160533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:48.401265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25968,"num_write":366,"num_write_kb":75698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"63'460","reported_seq":562,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162279+0000","last_change":"2024-04-26T10:45:53.176893+0000","last_active":"2024-04-26T10:45:57.162279+0000","last_peered":"2024-04-26T10:45:57.162279+0000","last_clean":"2024-04-26T10:45:57.162279+0000","last_became_active":"2024-04-26T10:45:53.174699+0000","last_became_peered":"2024-04-26T10:45:53.174699+0000","last_unstale":"2024-04-26T10:45:57.162279+0000","last_undegraded":"2024-04-26T10:45:57.162279+0000","last_fullsized":"2024-04-26T10:45:57.162279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:41.919177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16269,"num_write":426,"num_write_kb":67839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"63'393","reported_seq":512,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159625+0000","last_change":"2024-04-26T10:42:26.049338+0000","last_active":"2024-04-26T10:45:57.159625+0000","last_peered":"2024-04-26T10:45:57.159625+0000","last_clean":"2024-04-26T10:45:57.159625+0000","last_became_active":"2024-04-26T10:42:26.049014+0000","last_became_peered":"2024-04-26T10:42:26.049014+0000","last_unstale":"2024-04-26T10:45:57.159625+0000","last_undegraded":"2024-04-26T10:45:57.159625+0000","last_fullsized":"2024-04-26T10:45:57.159625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":25712,"num_write":362,"num_write_kb":42020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'428","reported_seq":554,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159673+0000","last_change":"2024-04-26T10:45:54.192786+0000","last_active":"2024-04-26T10:45:57.159673+0000","last_peered":"2024-04-26T10:45:57.159673+0000","last_clean":"2024-04-26T10:45:57.159673+0000","last_became_active":"2024-04-26T10:45:54.189852+0000","last_became_peered":"2024-04-26T10:45:54.189852+0000","last_unstale":"2024-04-26T10:45:57.159673+0000","last_undegraded":"2024-04-26T10:45:57.159673+0000","last_fullsized":"2024-04-26T10:45:57.159673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:29.968564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12316,"num_write":384,"num_write_kb":87656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"63'446","reported_seq":587,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158810+0000","last_change":"2024-04-26T10:45:54.186962+0000","last_active":"2024-04-26T10:45:57.158810+0000","last_peered":"2024-04-26T10:45:57.158810+0000","last_clean":"2024-04-26T10:45:57.158810+0000","last_became_active":"2024-04-26T10:45:54.184063+0000","last_became_peered":"2024-04-26T10:45:54.184063+0000","last_unstale":"2024-04-26T10:45:57.158810+0000","last_undegraded":"2024-04-26T10:45:57.158810+0000","last_fullsized":"2024-04-26T10:45:57.158810+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:59.349649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":53414,"num_write":401,"num_write_kb":80048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":550,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161291+0000","last_change":"2024-04-26T10:45:50.869971+0000","last_active":"2024-04-26T10:45:57.161291+0000","last_peered":"2024-04-26T10:45:57.161291+0000","last_clean":"2024-04-26T10:45:57.161291+0000","last_became_active":"2024-04-26T10:45:50.867680+0000","last_became_peered":"2024-04-26T10:45:50.867680+0000","last_unstale":"2024-04-26T10:45:57.161291+0000","last_undegraded":"2024-04-26T10:45:57.161291+0000","last_fullsized":"2024-04-26T10:45:57.161291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:17.680371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19859,"num_write":405,"num_write_kb":51119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"63'408","reported_seq":862,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161853+0000","last_change":"2024-04-26T10:45:56.163683+0000","last_active":"2024-04-26T10:45:57.161853+0000","last_peered":"2024-04-26T10:45:57.161853+0000","last_clean":"2024-04-26T10:45:57.161853+0000","last_became_active":"2024-04-26T10:45:56.160360+0000","last_became_peered":"2024-04-26T10:45:56.160360+0000","last_unstale":"2024-04-26T10:45:57.161853+0000","last_undegraded":"2024-04-26T10:45:57.161853+0000","last_fullsized":"2024-04-26T10:45:57.161853+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:44.845909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":15372,"num_write":366,"num_write_kb":75855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"63'452","reported_seq":1017,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158921+0000","last_change":"2024-04-26T10:45:52.175372+0000","last_active":"2024-04-26T10:45:57.158921+0000","last_peered":"2024-04-26T10:45:57.158921+0000","last_clean":"2024-04-26T10:45:57.158921+0000","last_became_active":"2024-04-26T10:45:52.173702+0000","last_became_peered":"2024-04-26T10:45:52.173702+0000","last_unstale":"2024-04-26T10:45:57.158921+0000","last_undegraded":"2024-04-26T10:45:57.158921+0000","last_fullsized":"2024-04-26T10:45:57.158921+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:55.459452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43729,"num_write":421,"num_write_kb":79804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"63'408","reported_seq":882,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.163833+0000","last_change":"2024-04-26T10:45:57.163475+0000","last_active":"2024-04-26T10:45:57.163833+0000","last_peered":"2024-04-26T10:45:57.163833+0000","last_clean":"2024-04-26T10:45:57.163833+0000","last_became_active":"2024-04-26T10:45:57.162147+0000","last_became_peered":"2024-04-26T10:45:57.162147+0000","last_unstale":"2024-04-26T10:45:57.163833+0000","last_undegraded":"2024-04-26T10:45:57.163833+0000","last_fullsized":"2024-04-26T10:45:57.163833+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:18.287163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":30320,"num_write":372,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'453","reported_seq":615,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158621+0000","last_change":"2024-04-26T10:45:54.184330+0000","last_active":"2024-04-26T10:45:57.158621+0000","last_peered":"2024-04-26T10:45:57.158621+0000","last_clean":"2024-04-26T10:45:57.158621+0000","last_became_active":"2024-04-26T10:45:54.181881+0000","last_became_peered":"2024-04-26T10:45:54.181881+0000","last_unstale":"2024-04-26T10:45:57.158621+0000","last_undegraded":"2024-04-26T10:45:57.158621+0000","last_fullsized":"2024-04-26T10:45:57.158621+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:02.066091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":19864,"num_write":422,"num_write_kb":51638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"63'439","reported_seq":954,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160299+0000","last_change":"2024-04-26T10:45:48.867766+0000","last_active":"2024-04-26T10:45:57.160299+0000","last_peered":"2024-04-26T10:45:57.160299+0000","last_clean":"2024-04-26T10:45:57.160299+0000","last_became_active":"2024-04-26T10:45:48.866159+0000","last_became_peered":"2024-04-26T10:45:48.866159+0000","last_unstale":"2024-04-26T10:45:57.160299+0000","last_undegraded":"2024-04-26T10:45:57.160299+0000","last_fullsized":"2024-04-26T10:45:57.160299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:39.736649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8912,"num_write":417,"num_write_kb":46575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"63'513","reported_seq":1158,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158983+0000","last_change":"2024-04-26T10:45:51.160003+0000","last_active":"2024-04-26T10:45:57.158983+0000","last_peered":"2024-04-26T10:45:57.158983+0000","last_clean":"2024-04-26T10:45:57.158983+0000","last_became_active":"2024-04-26T10:45:51.158698+0000","last_became_peered":"2024-04-26T10:45:51.158698+0000","last_unstale":"2024-04-26T10:45:57.158983+0000","last_undegraded":"2024-04-26T10:45:57.158983+0000","last_fullsized":"2024-04-26T10:45:57.158983+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:36.990095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":70751,"num_write":473,"num_write_kb":88902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'406","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161212+0000","last_change":"2024-04-26T10:45:56.164805+0000","last_active":"2024-04-26T10:45:57.161212+0000","last_peered":"2024-04-26T10:45:57.161212+0000","last_clean":"2024-04-26T10:45:57.161212+0000","last_became_active":"2024-04-26T10:45:56.162419+0000","last_became_peered":"2024-04-26T10:45:56.162419+0000","last_unstale":"2024-04-26T10:45:57.161212+0000","last_undegraded":"2024-04-26T10:45:57.161212+0000","last_fullsized":"2024-04-26T10:45:57.161212+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:53.474847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":32121,"num_write":372,"num_write_kb":60163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"63'402","reported_seq":867,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.167147+0000","last_change":"2024-04-26T10:45:57.166225+0000","last_active":"2024-04-26T10:45:57.167147+0000","last_peered":"2024-04-26T10:45:57.167147+0000","last_clean":"2024-04-26T10:45:57.167147+0000","last_became_active":"2024-04-26T10:45:57.165064+0000","last_became_peered":"2024-04-26T10:45:57.165064+0000","last_unstale":"2024-04-26T10:45:57.167147+0000","last_undegraded":"2024-04-26T10:45:57.167147+0000","last_fullsized":"2024-04-26T10:45:57.167147+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:52.273357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":6824,"num_write":378,"num_write_kb":72156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"63'407","reported_seq":888,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.166516+0000","last_change":"2024-04-26T10:45:58.163989+0000","last_active":"2024-04-26T10:45:58.166516+0000","last_peered":"2024-04-26T10:45:58.166516+0000","last_clean":"2024-04-26T10:45:58.166516+0000","last_became_active":"2024-04-26T10:45:58.161850+0000","last_became_peered":"2024-04-26T10:45:58.161850+0000","last_unstale":"2024-04-26T10:45:58.166516+0000","last_undegraded":"2024-04-26T10:45:58.166516+0000","last_fullsized":"2024-04-26T10:45:58.166516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:17:09.805958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25898,"num_write":372,"num_write_kb":59274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":346,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'490","reported_seq":1058,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159063+0000","last_change":"2024-04-26T10:45:55.179785+0000","last_active":"2024-04-26T10:45:57.159063+0000","last_peered":"2024-04-26T10:45:57.159063+0000","last_clean":"2024-04-26T10:45:57.159063+0000","last_became_active":"2024-04-26T10:45:55.178083+0000","last_became_peered":"2024-04-26T10:45:55.178083+0000","last_unstale":"2024-04-26T10:45:57.159063+0000","last_undegraded":"2024-04-26T10:45:57.159063+0000","last_fullsized":"2024-04-26T10:45:57.159063+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:23.269957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33597,"num_write":449,"num_write_kb":87981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"63'474","reported_seq":563,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158167+0000","last_change":"2024-04-26T10:45:54.189228+0000","last_active":"2024-04-26T10:45:57.158167+0000","last_peered":"2024-04-26T10:45:57.158167+0000","last_clean":"2024-04-26T10:45:57.158167+0000","last_became_active":"2024-04-26T10:45:54.186011+0000","last_became_peered":"2024-04-26T10:45:54.186011+0000","last_unstale":"2024-04-26T10:45:57.158167+0000","last_undegraded":"2024-04-26T10:45:57.158167+0000","last_fullsized":"2024-04-26T10:45:57.158167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.355145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30886,"num_write":441,"num_write_kb":118807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'443","reported_seq":547,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162005+0000","last_change":"2024-04-26T10:45:48.864423+0000","last_active":"2024-04-26T10:45:57.162005+0000","last_peered":"2024-04-26T10:45:57.162005+0000","last_clean":"2024-04-26T10:45:57.162005+0000","last_became_active":"2024-04-26T10:45:48.861918+0000","last_became_peered":"2024-04-26T10:45:48.861918+0000","last_unstale":"2024-04-26T10:45:57.162005+0000","last_undegraded":"2024-04-26T10:45:57.162005+0000","last_fullsized":"2024-04-26T10:45:57.162005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:11.356135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20556,"num_write":413,"num_write_kb":91647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"63'376","reported_seq":478,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159241+0000","last_change":"2024-04-26T10:42:26.041757+0000","last_active":"2024-04-26T10:45:57.159241+0000","last_peered":"2024-04-26T10:45:57.159241+0000","last_clean":"2024-04-26T10:45:57.159241+0000","last_became_active":"2024-04-26T10:42:26.040920+0000","last_became_peered":"2024-04-26T10:42:26.040920+0000","last_unstale":"2024-04-26T10:45:57.159241+0000","last_undegraded":"2024-04-26T10:45:57.159241+0000","last_fullsized":"2024-04-26T10:45:57.159241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10124,"num_write":344,"num_write_kb":66899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"62'453","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161061+0000","last_change":"2024-04-26T10:45:48.862782+0000","last_active":"2024-04-26T10:45:57.161061+0000","last_peered":"2024-04-26T10:45:57.161061+0000","last_clean":"2024-04-26T10:45:57.161061+0000","last_became_active":"2024-04-26T10:45:48.862424+0000","last_became_peered":"2024-04-26T10:45:48.862424+0000","last_unstale":"2024-04-26T10:45:57.161061+0000","last_undegraded":"2024-04-26T10:45:57.161061+0000","last_fullsized":"2024-04-26T10:45:57.161061+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:16.548893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"63'403","reported_seq":520,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159394+0000","last_change":"2024-04-26T10:42:26.041850+0000","last_active":"2024-04-26T10:45:57.159394+0000","last_peered":"2024-04-26T10:45:57.159394+0000","last_clean":"2024-04-26T10:45:57.159394+0000","last_became_active":"2024-04-26T10:42:26.040464+0000","last_became_peered":"2024-04-26T10:42:26.040464+0000","last_unstale":"2024-04-26T10:45:57.159394+0000","last_undegraded":"2024-04-26T10:45:57.159394+0000","last_fullsized":"2024-04-26T10:45:57.159394+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24588,"num_write":363,"num_write_kb":51190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"62'49","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158264+0000","last_change":"2024-04-26T10:45:45.862317+0000","last_active":"2024-04-26T10:45:57.158264+0000","last_peered":"2024-04-26T10:45:57.158264+0000","last_clean":"2024-04-26T10:45:57.158264+0000","last_became_active":"2024-04-26T10:45:45.862029+0000","last_became_peered":"2024-04-26T10:45:45.862029+0000","last_unstale":"2024-04-26T10:45:57.158264+0000","last_undegraded":"2024-04-26T10:45:57.158264+0000","last_fullsized":"2024-04-26T10:45:57.158264+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:02.521534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'407","reported_seq":887,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159309+0000","last_change":"2024-04-26T10:45:52.170710+0000","last_active":"2024-04-26T10:45:57.159309+0000","last_peered":"2024-04-26T10:45:57.159309+0000","last_clean":"2024-04-26T10:45:57.159309+0000","last_became_active":"2024-04-26T10:45:52.169295+0000","last_became_peered":"2024-04-26T10:45:52.169295+0000","last_unstale":"2024-04-26T10:45:57.159309+0000","last_undegraded":"2024-04-26T10:45:57.159309+0000","last_fullsized":"2024-04-26T10:45:57.159309+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:10.995530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":7077,"num_write":367,"num_write_kb":42434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"62'66","reported_seq":160,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159731+0000","last_change":"2024-04-26T10:45:45.874440+0000","last_active":"2024-04-26T10:45:57.159731+0000","last_peered":"2024-04-26T10:45:57.159731+0000","last_clean":"2024-04-26T10:45:57.159731+0000","last_became_active":"2024-04-26T10:45:45.874030+0000","last_became_peered":"2024-04-26T10:45:45.874030+0000","last_unstale":"2024-04-26T10:45:57.159731+0000","last_undegraded":"2024-04-26T10:45:57.159731+0000","last_fullsized":"2024-04-26T10:45:57.159731+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:22.711644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"63'406","reported_seq":898,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159545+0000","last_change":"2024-04-26T10:45:49.863376+0000","last_active":"2024-04-26T10:45:57.159545+0000","last_peered":"2024-04-26T10:45:57.159545+0000","last_clean":"2024-04-26T10:45:57.159545+0000","last_became_active":"2024-04-26T10:45:49.861979+0000","last_became_peered":"2024-04-26T10:45:49.861979+0000","last_unstale":"2024-04-26T10:45:57.159545+0000","last_undegraded":"2024-04-26T10:45:57.159545+0000","last_fullsized":"2024-04-26T10:45:57.159545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:16.553043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":25977,"num_write":374,"num_write_kb":104172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'66","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161876+0000","last_change":"2024-04-26T10:45:45.871507+0000","last_active":"2024-04-26T10:45:57.161876+0000","last_peered":"2024-04-26T10:45:57.161876+0000","last_clean":"2024-04-26T10:45:57.161876+0000","last_became_active":"2024-04-26T10:45:45.871120+0000","last_became_peered":"2024-04-26T10:45:45.871120+0000","last_unstale":"2024-04-26T10:45:57.161876+0000","last_undegraded":"2024-04-26T10:45:57.161876+0000","last_fullsized":"2024-04-26T10:45:57.161876+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:56.162347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"62'200","reported_seq":281,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161233+0000","last_change":"2024-04-26T10:45:48.866225+0000","last_active":"2024-04-26T10:45:57.161233+0000","last_peered":"2024-04-26T10:45:57.161233+0000","last_clean":"2024-04-26T10:45:57.161233+0000","last_became_active":"2024-04-26T10:45:48.865878+0000","last_became_peered":"2024-04-26T10:45:48.865878+0000","last_unstale":"2024-04-26T10:45:57.161233+0000","last_undegraded":"2024-04-26T10:45:57.161233+0000","last_fullsized":"2024-04-26T10:45:57.161233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:42:39.518391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"63'415","reported_seq":908,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.164897+0000","last_change":"2024-04-26T10:45:57.164421+0000","last_active":"2024-04-26T10:45:57.164897+0000","last_peered":"2024-04-26T10:45:57.164897+0000","last_clean":"2024-04-26T10:45:57.164897+0000","last_became_active":"2024-04-26T10:45:57.163263+0000","last_became_peered":"2024-04-26T10:45:57.163263+0000","last_unstale":"2024-04-26T10:45:57.164897+0000","last_undegraded":"2024-04-26T10:45:57.164897+0000","last_fullsized":"2024-04-26T10:45:57.164897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:16.262869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15757,"num_write":380,"num_write_kb":54727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"62'342","reported_seq":448,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159793+0000","last_change":"2024-04-26T10:45:48.866915+0000","last_active":"2024-04-26T10:45:57.159793+0000","last_peered":"2024-04-26T10:45:57.159793+0000","last_clean":"2024-04-26T10:45:57.159793+0000","last_became_active":"2024-04-26T10:45:48.866497+0000","last_became_peered":"2024-04-26T10:45:48.866497+0000","last_unstale":"2024-04-26T10:45:57.159793+0000","last_undegraded":"2024-04-26T10:45:57.159793+0000","last_fullsized":"2024-04-26T10:45:57.159793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:04.796882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"63'481","reported_seq":670,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158706+0000","last_change":"2024-04-26T10:45:54.184646+0000","last_active":"2024-04-26T10:45:57.158706+0000","last_peered":"2024-04-26T10:45:57.158706+0000","last_clean":"2024-04-26T10:45:57.158706+0000","last_became_active":"2024-04-26T10:45:54.181993+0000","last_became_peered":"2024-04-26T10:45:54.181993+0000","last_unstale":"2024-04-26T10:45:57.158706+0000","last_undegraded":"2024-04-26T10:45:57.158706+0000","last_fullsized":"2024-04-26T10:45:57.158706+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:34.664600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":45251,"num_write":451,"num_write_kb":105365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"62'460","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160768+0000","last_change":"2024-04-26T10:45:48.865887+0000","last_active":"2024-04-26T10:45:57.160768+0000","last_peered":"2024-04-26T10:45:57.160768+0000","last_clean":"2024-04-26T10:45:57.160768+0000","last_became_active":"2024-04-26T10:45:48.865520+0000","last_became_peered":"2024-04-26T10:45:48.865520+0000","last_unstale":"2024-04-26T10:45:57.160768+0000","last_undegraded":"2024-04-26T10:45:57.160768+0000","last_fullsized":"2024-04-26T10:45:57.160768+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:34.308634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":407,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'420","reported_seq":503,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.165736+0000","last_change":"2024-04-26T10:45:57.165390+0000","last_active":"2024-04-26T10:45:57.165736+0000","last_peered":"2024-04-26T10:45:57.165736+0000","last_clean":"2024-04-26T10:45:57.165736+0000","last_became_active":"2024-04-26T10:45:57.162014+0000","last_became_peered":"2024-04-26T10:45:57.162014+0000","last_unstale":"2024-04-26T10:45:57.165736+0000","last_undegraded":"2024-04-26T10:45:57.165736+0000","last_fullsized":"2024-04-26T10:45:57.165736+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:19.491785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13025,"num_write":385,"num_write_kb":38595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"62'67","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161113+0000","last_change":"2024-04-26T10:45:45.860717+0000","last_active":"2024-04-26T10:45:57.161113+0000","last_peered":"2024-04-26T10:45:57.161113+0000","last_clean":"2024-04-26T10:45:57.161113+0000","last_became_active":"2024-04-26T10:45:45.860175+0000","last_became_peered":"2024-04-26T10:45:45.860175+0000","last_unstale":"2024-04-26T10:45:57.161113+0000","last_undegraded":"2024-04-26T10:45:57.161113+0000","last_fullsized":"2024-04-26T10:45:57.161113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:30.736518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"63'452","reported_seq":965,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.166761+0000","last_change":"2024-04-26T10:45:58.166413+0000","last_active":"2024-04-26T10:45:58.166761+0000","last_peered":"2024-04-26T10:45:58.166761+0000","last_clean":"2024-04-26T10:45:58.166761+0000","last_became_active":"2024-04-26T10:45:58.164105+0000","last_became_peered":"2024-04-26T10:45:58.164105+0000","last_unstale":"2024-04-26T10:45:58.166761+0000","last_undegraded":"2024-04-26T10:45:58.166761+0000","last_fullsized":"2024-04-26T10:45:58.166761+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:05.536110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23217,"num_write":416,"num_write_kb":71418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":388,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"62'200","reported_seq":277,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158343+0000","last_change":"2024-04-26T10:45:56.160957+0000","last_active":"2024-04-26T10:45:57.158343+0000","last_peered":"2024-04-26T10:45:57.158343+0000","last_clean":"2024-04-26T10:45:57.158343+0000","last_became_active":"2024-04-26T10:45:56.160475+0000","last_became_peered":"2024-04-26T10:45:56.160475+0000","last_unstale":"2024-04-26T10:45:57.158343+0000","last_undegraded":"2024-04-26T10:45:57.158343+0000","last_fullsized":"2024-04-26T10:45:57.158343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:48.896541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'430","reported_seq":512,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.165078+0000","last_change":"2024-04-26T10:45:57.164742+0000","last_active":"2024-04-26T10:45:57.165078+0000","last_peered":"2024-04-26T10:45:57.165078+0000","last_clean":"2024-04-26T10:45:57.165078+0000","last_became_active":"2024-04-26T10:45:57.162070+0000","last_became_peered":"2024-04-26T10:45:57.162070+0000","last_unstale":"2024-04-26T10:45:57.165078+0000","last_undegraded":"2024-04-26T10:45:57.165078+0000","last_fullsized":"2024-04-26T10:45:57.165078+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:14.872176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":24352,"num_write":392,"num_write_kb":21976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"62'233","reported_seq":306,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160855+0000","last_change":"2024-04-26T10:45:48.862856+0000","last_active":"2024-04-26T10:45:57.160855+0000","last_peered":"2024-04-26T10:45:57.160855+0000","last_clean":"2024-04-26T10:45:57.160855+0000","last_became_active":"2024-04-26T10:45:48.862517+0000","last_became_peered":"2024-04-26T10:45:48.862517+0000","last_unstale":"2024-04-26T10:45:57.160855+0000","last_undegraded":"2024-04-26T10:45:57.160855+0000","last_fullsized":"2024-04-26T10:45:57.160855+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:43.799960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"63'393","reported_seq":478,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160672+0000","last_change":"2024-04-26T10:45:55.180960+0000","last_active":"2024-04-26T10:45:57.160672+0000","last_peered":"2024-04-26T10:45:57.160672+0000","last_clean":"2024-04-26T10:45:57.160672+0000","last_became_active":"2024-04-26T10:45:55.177758+0000","last_became_peered":"2024-04-26T10:45:55.177758+0000","last_unstale":"2024-04-26T10:45:57.160672+0000","last_undegraded":"2024-04-26T10:45:57.160672+0000","last_fullsized":"2024-04-26T10:45:57.160672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:47.889251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8671,"num_write":368,"num_write_kb":38542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"62'49","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158855+0000","last_change":"2024-04-26T10:45:45.874789+0000","last_active":"2024-04-26T10:45:57.158855+0000","last_peered":"2024-04-26T10:45:57.158855+0000","last_clean":"2024-04-26T10:45:57.158855+0000","last_became_active":"2024-04-26T10:45:45.874328+0000","last_became_peered":"2024-04-26T10:45:45.874328+0000","last_unstale":"2024-04-26T10:45:57.158855+0000","last_undegraded":"2024-04-26T10:45:57.158855+0000","last_fullsized":"2024-04-26T10:45:57.158855+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:27.431661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"63'368","reported_seq":463,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162061+0000","last_change":"2024-04-26T10:45:56.165615+0000","last_active":"2024-04-26T10:45:57.162061+0000","last_peered":"2024-04-26T10:45:57.162061+0000","last_clean":"2024-04-26T10:45:57.162061+0000","last_became_active":"2024-04-26T10:45:56.163456+0000","last_became_peered":"2024-04-26T10:45:56.163456+0000","last_unstale":"2024-04-26T10:45:57.162061+0000","last_undegraded":"2024-04-26T10:45:57.162061+0000","last_fullsized":"2024-04-26T10:45:57.162061+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:14.480860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":19222,"num_write":336,"num_write_kb":58903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"62'619","reported_seq":747,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159149+0000","last_change":"2024-04-26T10:45:56.162511+0000","last_active":"2024-04-26T10:45:57.159149+0000","last_peered":"2024-04-26T10:45:57.159149+0000","last_clean":"2024-04-26T10:45:57.159149+0000","last_became_active":"2024-04-26T10:45:56.161604+0000","last_became_peered":"2024-04-26T10:45:56.161604+0000","last_unstale":"2024-04-26T10:45:57.159149+0000","last_undegraded":"2024-04-26T10:45:57.159149+0000","last_fullsized":"2024-04-26T10:45:57.159149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:39.366865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":558,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"63'383","reported_seq":822,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.165607+0000","last_change":"2024-04-26T10:45:58.165237+0000","last_active":"2024-04-26T10:45:58.165607+0000","last_peered":"2024-04-26T10:45:58.165607+0000","last_clean":"2024-04-26T10:45:58.165607+0000","last_became_active":"2024-04-26T10:45:58.162264+0000","last_became_peered":"2024-04-26T10:45:58.162264+0000","last_unstale":"2024-04-26T10:45:58.165607+0000","last_undegraded":"2024-04-26T10:45:58.165607+0000","last_fullsized":"2024-04-26T10:45:58.165607+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:12.784168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":14260,"num_write":349,"num_write_kb":50367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":229,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161708+0000","last_change":"2024-04-26T10:45:45.871511+0000","last_active":"2024-04-26T10:45:57.161708+0000","last_peered":"2024-04-26T10:45:57.161708+0000","last_clean":"2024-04-26T10:45:57.161708+0000","last_became_active":"2024-04-26T10:45:45.871155+0000","last_became_peered":"2024-04-26T10:45:45.871155+0000","last_unstale":"2024-04-26T10:45:57.161708+0000","last_undegraded":"2024-04-26T10:45:57.161708+0000","last_fullsized":"2024-04-26T10:45:57.161708+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:53.015361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160932+0000","last_change":"2024-04-26T10:45:45.861068+0000","last_active":"2024-04-26T10:45:57.160932+0000","last_peered":"2024-04-26T10:45:57.160932+0000","last_clean":"2024-04-26T10:45:57.160932+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:57.160932+0000","last_undegraded":"2024-04-26T10:45:57.160932+0000","last_fullsized":"2024-04-26T10:45:57.160932+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:16.348009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"62'743","reported_seq":824,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158521+0000","last_change":"2024-04-26T10:42:25.686765+0000","last_active":"2024-04-26T10:45:57.158521+0000","last_peered":"2024-04-26T10:45:57.158521+0000","last_clean":"2024-04-26T10:45:57.158521+0000","last_became_active":"2024-04-26T10:42:25.686009+0000","last_became_peered":"2024-04-26T10:42:25.686009+0000","last_unstale":"2024-04-26T10:45:57.158521+0000","last_undegraded":"2024-04-26T10:45:57.158521+0000","last_fullsized":"2024-04-26T10:45:57.158521+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:54.627815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'442","reported_seq":567,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160853+0000","last_change":"2024-04-26T10:45:55.181074+0000","last_active":"2024-04-26T10:45:57.160853+0000","last_peered":"2024-04-26T10:45:57.160853+0000","last_clean":"2024-04-26T10:45:57.160853+0000","last_became_active":"2024-04-26T10:45:55.177751+0000","last_became_peered":"2024-04-26T10:45:55.177751+0000","last_unstale":"2024-04-26T10:45:57.160853+0000","last_undegraded":"2024-04-26T10:45:57.160853+0000","last_fullsized":"2024-04-26T10:45:57.160853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:01.323521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":34346,"num_write":406,"num_write_kb":96298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162129+0000","last_change":"2024-04-26T10:45:45.872099+0000","last_active":"2024-04-26T10:45:57.162129+0000","last_peered":"2024-04-26T10:45:57.162129+0000","last_clean":"2024-04-26T10:45:57.162129+0000","last_became_active":"2024-04-26T10:45:45.871741+0000","last_became_peered":"2024-04-26T10:45:45.871741+0000","last_unstale":"2024-04-26T10:45:57.162129+0000","last_undegraded":"2024-04-26T10:45:57.162129+0000","last_fullsized":"2024-04-26T10:45:57.162129+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:53.226378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"63'102","reported_seq":219,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158049+0000","last_change":"2024-04-26T10:45:56.160802+0000","last_active":"2024-04-26T10:45:57.158049+0000","last_peered":"2024-04-26T10:45:57.158049+0000","last_clean":"2024-04-26T10:45:57.158049+0000","last_became_active":"2024-04-26T10:45:56.160328+0000","last_became_peered":"2024-04-26T10:45:56.160328+0000","last_unstale":"2024-04-26T10:45:57.158049+0000","last_undegraded":"2024-04-26T10:45:57.158049+0000","last_fullsized":"2024-04-26T10:45:57.158049+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:47.864335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467631,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":44,"num_write_kb":1460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2935262,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'485","reported_seq":620,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162426+0000","last_change":"2024-04-26T10:45:57.165815+0000","last_active":"2024-04-26T10:45:58.162426+0000","last_peered":"2024-04-26T10:45:58.162426+0000","last_clean":"2024-04-26T10:45:58.162426+0000","last_became_active":"2024-04-26T10:45:57.162752+0000","last_became_peered":"2024-04-26T10:45:57.162752+0000","last_unstale":"2024-04-26T10:45:58.162426+0000","last_undegraded":"2024-04-26T10:45:58.162426+0000","last_fullsized":"2024-04-26T10:45:58.162426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:10.743149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27703,"num_write":454,"num_write_kb":121509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158512+0000","last_change":"2024-04-26T10:45:53.180892+0000","last_active":"2024-04-26T10:45:57.158512+0000","last_peered":"2024-04-26T10:45:57.158512+0000","last_clean":"2024-04-26T10:45:57.158512+0000","last_became_active":"2024-04-26T10:45:53.180675+0000","last_became_peered":"2024-04-26T10:45:53.180675+0000","last_unstale":"2024-04-26T10:45:57.158512+0000","last_undegraded":"2024-04-26T10:45:57.158512+0000","last_fullsized":"2024-04-26T10:45:57.158512+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:45.758505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"62'306","reported_seq":413,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159253+0000","last_change":"2024-04-26T10:45:48.865095+0000","last_active":"2024-04-26T10:45:57.159253+0000","last_peered":"2024-04-26T10:45:57.159253+0000","last_clean":"2024-04-26T10:45:57.159253+0000","last_became_active":"2024-04-26T10:45:48.864763+0000","last_became_peered":"2024-04-26T10:45:48.864763+0000","last_unstale":"2024-04-26T10:45:57.159253+0000","last_undegraded":"2024-04-26T10:45:57.159253+0000","last_fullsized":"2024-04-26T10:45:57.159253+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:12.665388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"63'336","reported_seq":748,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.165797+0000","last_change":"2024-04-26T10:45:58.165267+0000","last_active":"2024-04-26T10:45:58.165797+0000","last_peered":"2024-04-26T10:45:58.165797+0000","last_clean":"2024-04-26T10:45:58.165797+0000","last_became_active":"2024-04-26T10:45:58.162320+0000","last_became_peered":"2024-04-26T10:45:58.162320+0000","last_unstale":"2024-04-26T10:45:58.165797+0000","last_undegraded":"2024-04-26T10:45:58.165797+0000","last_fullsized":"2024-04-26T10:45:58.165797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:40.611364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12035,"num_write":314,"num_write_kb":29928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":306,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160636+0000","last_change":"2024-04-26T10:45:45.861233+0000","last_active":"2024-04-26T10:45:57.160636+0000","last_peered":"2024-04-26T10:45:57.160636+0000","last_clean":"2024-04-26T10:45:57.160636+0000","last_became_active":"2024-04-26T10:45:45.860924+0000","last_became_peered":"2024-04-26T10:45:45.860924+0000","last_unstale":"2024-04-26T10:45:57.160636+0000","last_undegraded":"2024-04-26T10:45:57.160636+0000","last_fullsized":"2024-04-26T10:45:57.160636+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:11.746110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"62'64","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160997+0000","last_change":"2024-04-26T10:45:45.861230+0000","last_active":"2024-04-26T10:45:57.160997+0000","last_peered":"2024-04-26T10:45:57.160997+0000","last_clean":"2024-04-26T10:45:57.160997+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:57.160997+0000","last_undegraded":"2024-04-26T10:45:57.160997+0000","last_fullsized":"2024-04-26T10:45:57.160997+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:53.564033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"63'421","reported_seq":513,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158851+0000","last_change":"2024-04-26T10:45:54.188138+0000","last_active":"2024-04-26T10:45:57.158851+0000","last_peered":"2024-04-26T10:45:57.158851+0000","last_clean":"2024-04-26T10:45:57.158851+0000","last_became_active":"2024-04-26T10:45:54.185053+0000","last_became_peered":"2024-04-26T10:45:54.185053+0000","last_unstale":"2024-04-26T10:45:57.158851+0000","last_undegraded":"2024-04-26T10:45:57.158851+0000","last_fullsized":"2024-04-26T10:45:57.158851+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:55:26.158040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28557,"num_write":385,"num_write_kb":93083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"62'480","reported_seq":553,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160417+0000","last_change":"2024-04-26T10:45:48.862894+0000","last_active":"2024-04-26T10:45:57.160417+0000","last_peered":"2024-04-26T10:45:57.160417+0000","last_clean":"2024-04-26T10:45:57.160417+0000","last_became_active":"2024-04-26T10:45:48.862564+0000","last_became_peered":"2024-04-26T10:45:48.862564+0000","last_unstale":"2024-04-26T10:45:57.160417+0000","last_undegraded":"2024-04-26T10:45:57.160417+0000","last_fullsized":"2024-04-26T10:45:57.160417+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:38.835403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":84,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158830+0000","last_change":"2024-04-26T10:42:21.405754+0000","last_active":"2024-04-26T10:45:57.158830+0000","last_peered":"2024-04-26T10:45:57.158830+0000","last_clean":"2024-04-26T10:45:57.158830+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:45:57.158830+0000","last_undegraded":"2024-04-26T10:45:57.158830+0000","last_fullsized":"2024-04-26T10:45:57.158830+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:47.123256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'352","reported_seq":776,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158735+0000","last_change":"2024-04-26T10:45:53.183401+0000","last_active":"2024-04-26T10:45:57.158735+0000","last_peered":"2024-04-26T10:45:57.158735+0000","last_clean":"2024-04-26T10:45:57.158735+0000","last_became_active":"2024-04-26T10:45:53.182454+0000","last_became_peered":"2024-04-26T10:45:53.182454+0000","last_unstale":"2024-04-26T10:45:57.158735+0000","last_undegraded":"2024-04-26T10:45:57.158735+0000","last_fullsized":"2024-04-26T10:45:57.158735+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:38.569626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":1905,"num_write":313,"num_write_kb":25573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"62'59","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158485+0000","last_change":"2024-04-26T10:45:53.177446+0000","last_active":"2024-04-26T10:45:57.158485+0000","last_peered":"2024-04-26T10:45:57.158485+0000","last_clean":"2024-04-26T10:45:57.158485+0000","last_became_active":"2024-04-26T10:45:53.176996+0000","last_became_peered":"2024-04-26T10:45:53.176996+0000","last_unstale":"2024-04-26T10:45:57.158485+0000","last_undegraded":"2024-04-26T10:45:57.158485+0000","last_fullsized":"2024-04-26T10:45:57.158485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:23.679423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":88,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161096+0000","last_change":"2024-04-26T10:45:53.175046+0000","last_active":"2024-04-26T10:45:57.161096+0000","last_peered":"2024-04-26T10:45:57.161096+0000","last_clean":"2024-04-26T10:45:57.161096+0000","last_became_active":"2024-04-26T10:45:53.174781+0000","last_became_peered":"2024-04-26T10:45:53.174781+0000","last_unstale":"2024-04-26T10:45:57.161096+0000","last_undegraded":"2024-04-26T10:45:57.161096+0000","last_fullsized":"2024-04-26T10:45:57.161096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:22.742084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'408","reported_seq":907,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160325+0000","last_change":"2024-04-26T10:45:54.186637+0000","last_active":"2024-04-26T10:45:57.160325+0000","last_peered":"2024-04-26T10:45:57.160325+0000","last_clean":"2024-04-26T10:45:57.160325+0000","last_became_active":"2024-04-26T10:45:54.185238+0000","last_became_peered":"2024-04-26T10:45:54.185238+0000","last_unstale":"2024-04-26T10:45:57.160325+0000","last_undegraded":"2024-04-26T10:45:57.160325+0000","last_fullsized":"2024-04-26T10:45:57.160325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:54.735683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19939,"num_write":382,"num_write_kb":63433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"62'55","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159609+0000","last_change":"2024-04-26T10:45:53.205131+0000","last_active":"2024-04-26T10:45:57.159609+0000","last_peered":"2024-04-26T10:45:57.159609+0000","last_clean":"2024-04-26T10:45:57.159609+0000","last_became_active":"2024-04-26T10:45:53.177305+0000","last_became_peered":"2024-04-26T10:45:53.177305+0000","last_unstale":"2024-04-26T10:45:57.159609+0000","last_undegraded":"2024-04-26T10:45:57.159609+0000","last_fullsized":"2024-04-26T10:45:57.159609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:30.829530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158557+0000","last_change":"2024-04-26T10:45:53.177593+0000","last_active":"2024-04-26T10:45:57.158557+0000","last_peered":"2024-04-26T10:45:57.158557+0000","last_clean":"2024-04-26T10:45:57.158557+0000","last_became_active":"2024-04-26T10:45:53.177249+0000","last_became_peered":"2024-04-26T10:45:53.177249+0000","last_unstale":"2024-04-26T10:45:57.158557+0000","last_undegraded":"2024-04-26T10:45:57.158557+0000","last_fullsized":"2024-04-26T10:45:57.158557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:41.564852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'418","reported_seq":877,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158405+0000","last_change":"2024-04-26T10:45:56.162729+0000","last_active":"2024-04-26T10:45:57.158405+0000","last_peered":"2024-04-26T10:45:57.158405+0000","last_clean":"2024-04-26T10:45:57.158405+0000","last_became_active":"2024-04-26T10:45:56.160440+0000","last_became_peered":"2024-04-26T10:45:56.160440+0000","last_unstale":"2024-04-26T10:45:57.158405+0000","last_undegraded":"2024-04-26T10:45:57.158405+0000","last_fullsized":"2024-04-26T10:45:57.158405+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:32.155653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20110,"num_write":390,"num_write_kb":75171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"64'66","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159242+0000","last_change":"2024-04-26T10:45:53.203538+0000","last_active":"2024-04-26T10:45:57.159242+0000","last_peered":"2024-04-26T10:45:57.159242+0000","last_clean":"2024-04-26T10:45:57.159242+0000","last_became_active":"2024-04-26T10:45:53.175946+0000","last_became_peered":"2024-04-26T10:45:53.175946+0000","last_unstale":"2024-04-26T10:45:57.159242+0000","last_undegraded":"2024-04-26T10:45:57.159242+0000","last_fullsized":"2024-04-26T10:45:57.159242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:15.016761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161004+0000","last_change":"2024-04-26T10:45:45.872224+0000","last_active":"2024-04-26T10:45:57.161004+0000","last_peered":"2024-04-26T10:45:57.161004+0000","last_clean":"2024-04-26T10:45:57.161004+0000","last_became_active":"2024-04-26T10:45:45.871923+0000","last_became_peered":"2024-04-26T10:45:45.871923+0000","last_unstale":"2024-04-26T10:45:57.161004+0000","last_undegraded":"2024-04-26T10:45:57.161004+0000","last_fullsized":"2024-04-26T10:45:57.161004+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:00.334874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"63'404","reported_seq":921,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158750+0000","last_change":"2024-04-26T10:45:54.184386+0000","last_active":"2024-04-26T10:45:57.158750+0000","last_peered":"2024-04-26T10:45:57.158750+0000","last_clean":"2024-04-26T10:45:57.158750+0000","last_became_active":"2024-04-26T10:45:54.181795+0000","last_became_peered":"2024-04-26T10:45:54.181795+0000","last_unstale":"2024-04-26T10:45:57.158750+0000","last_undegraded":"2024-04-26T10:45:57.158750+0000","last_fullsized":"2024-04-26T10:45:57.158750+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:10.290362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41262,"num_write":371,"num_write_kb":75820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"63'441","reported_seq":564,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161829+0000","last_change":"2024-04-26T10:45:54.188488+0000","last_active":"2024-04-26T10:45:57.161829+0000","last_peered":"2024-04-26T10:45:57.161829+0000","last_clean":"2024-04-26T10:45:57.161829+0000","last_became_active":"2024-04-26T10:45:54.185862+0000","last_became_peered":"2024-04-26T10:45:54.185862+0000","last_unstale":"2024-04-26T10:45:57.161829+0000","last_undegraded":"2024-04-26T10:45:57.161829+0000","last_fullsized":"2024-04-26T10:45:57.161829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:07.585438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31514,"num_write":408,"num_write_kb":107129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"64'431","reported_seq":520,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161320+0000","last_change":"2024-04-26T10:45:48.865579+0000","last_active":"2024-04-26T10:45:57.161320+0000","last_peered":"2024-04-26T10:45:57.161320+0000","last_clean":"2024-04-26T10:45:57.161320+0000","last_became_active":"2024-04-26T10:45:48.865212+0000","last_became_peered":"2024-04-26T10:45:48.865212+0000","last_unstale":"2024-04-26T10:45:57.161320+0000","last_undegraded":"2024-04-26T10:45:57.161320+0000","last_fullsized":"2024-04-26T10:45:57.161320+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:53.808562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9902610,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":9913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9896193,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"63'410","reported_seq":515,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160782+0000","last_change":"2024-04-26T10:45:54.184713+0000","last_active":"2024-04-26T10:45:57.160782+0000","last_peered":"2024-04-26T10:45:57.160782+0000","last_clean":"2024-04-26T10:45:57.160782+0000","last_became_active":"2024-04-26T10:45:54.182167+0000","last_became_peered":"2024-04-26T10:45:54.182167+0000","last_unstale":"2024-04-26T10:45:57.160782+0000","last_undegraded":"2024-04-26T10:45:57.160782+0000","last_fullsized":"2024-04-26T10:45:57.160782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:41:50.625629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12734,"num_write":373,"num_write_kb":34864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"63'84","reported_seq":183,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159590+0000","last_change":"2024-04-26T10:45:45.896842+0000","last_active":"2024-04-26T10:45:57.159590+0000","last_peered":"2024-04-26T10:45:57.159590+0000","last_clean":"2024-04-26T10:45:57.159590+0000","last_became_active":"2024-04-26T10:45:45.874746+0000","last_became_peered":"2024-04-26T10:45:45.874746+0000","last_unstale":"2024-04-26T10:45:57.159590+0000","last_undegraded":"2024-04-26T10:45:57.159590+0000","last_fullsized":"2024-04-26T10:45:57.159590+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:22.649667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"62'332","reported_seq":419,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161969+0000","last_change":"2024-04-26T10:45:56.161772+0000","last_active":"2024-04-26T10:45:57.161969+0000","last_peered":"2024-04-26T10:45:57.161969+0000","last_clean":"2024-04-26T10:45:57.161969+0000","last_became_active":"2024-04-26T10:45:56.161449+0000","last_became_peered":"2024-04-26T10:45:56.161449+0000","last_unstale":"2024-04-26T10:45:57.161969+0000","last_undegraded":"2024-04-26T10:45:57.161969+0000","last_fullsized":"2024-04-26T10:45:57.161969+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:09.499829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"63'487","reported_seq":1096,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158272+0000","last_change":"2024-04-26T10:45:51.160586+0000","last_active":"2024-04-26T10:45:57.158272+0000","last_peered":"2024-04-26T10:45:57.158272+0000","last_clean":"2024-04-26T10:45:57.158272+0000","last_became_active":"2024-04-26T10:45:51.159235+0000","last_became_peered":"2024-04-26T10:45:51.159235+0000","last_unstale":"2024-04-26T10:45:57.158272+0000","last_undegraded":"2024-04-26T10:45:57.158272+0000","last_fullsized":"2024-04-26T10:45:57.158272+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:54.234867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":43316,"num_write":468,"num_write_kb":77062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"62'61","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159565+0000","last_change":"2024-04-26T10:45:53.174204+0000","last_active":"2024-04-26T10:45:57.159565+0000","last_peered":"2024-04-26T10:45:57.159565+0000","last_clean":"2024-04-26T10:45:57.159565+0000","last_became_active":"2024-04-26T10:45:53.173851+0000","last_became_peered":"2024-04-26T10:45:53.173851+0000","last_unstale":"2024-04-26T10:45:57.159565+0000","last_undegraded":"2024-04-26T10:45:57.159565+0000","last_fullsized":"2024-04-26T10:45:57.159565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:50.698470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'457","reported_seq":536,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158314+0000","last_change":"2024-04-26T10:45:54.199966+0000","last_active":"2024-04-26T10:45:57.158314+0000","last_peered":"2024-04-26T10:45:57.158314+0000","last_clean":"2024-04-26T10:45:57.158314+0000","last_became_active":"2024-04-26T10:45:54.189622+0000","last_became_peered":"2024-04-26T10:45:54.189622+0000","last_unstale":"2024-04-26T10:45:57.158314+0000","last_undegraded":"2024-04-26T10:45:57.158314+0000","last_fullsized":"2024-04-26T10:45:57.158314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:53.540098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14848,"num_write":427,"num_write_kb":71903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'377","reported_seq":838,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160362+0000","last_change":"2024-04-26T10:45:49.867665+0000","last_active":"2024-04-26T10:45:57.160362+0000","last_peered":"2024-04-26T10:45:57.160362+0000","last_clean":"2024-04-26T10:45:57.160362+0000","last_became_active":"2024-04-26T10:45:49.866707+0000","last_became_peered":"2024-04-26T10:45:49.866707+0000","last_unstale":"2024-04-26T10:45:57.160362+0000","last_undegraded":"2024-04-26T10:45:57.160362+0000","last_fullsized":"2024-04-26T10:45:57.160362+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:23.401341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26932,"num_write":349,"num_write_kb":55611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"62'562","reported_seq":643,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158775+0000","last_change":"2024-04-26T10:42:25.683890+0000","last_active":"2024-04-26T10:45:57.158775+0000","last_peered":"2024-04-26T10:45:57.158775+0000","last_clean":"2024-04-26T10:45:57.158775+0000","last_became_active":"2024-04-26T10:42:25.683467+0000","last_became_peered":"2024-04-26T10:42:25.683467+0000","last_unstale":"2024-04-26T10:45:57.158775+0000","last_undegraded":"2024-04-26T10:45:57.158775+0000","last_fullsized":"2024-04-26T10:45:57.158775+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":8440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'425","reported_seq":878,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159122+0000","last_change":"2024-04-26T10:45:56.163245+0000","last_active":"2024-04-26T10:45:57.159122+0000","last_peered":"2024-04-26T10:45:57.159122+0000","last_clean":"2024-04-26T10:45:57.159122+0000","last_became_active":"2024-04-26T10:45:56.161315+0000","last_became_peered":"2024-04-26T10:45:56.161315+0000","last_unstale":"2024-04-26T10:45:57.159122+0000","last_undegraded":"2024-04-26T10:45:57.159122+0000","last_fullsized":"2024-04-26T10:45:57.159122+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:29.938631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":19004,"num_write":390,"num_write_kb":75524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"62'259","reported_seq":331,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158373+0000","last_change":"2024-04-26T10:45:56.160840+0000","last_active":"2024-04-26T10:45:57.158373+0000","last_peered":"2024-04-26T10:45:57.158373+0000","last_clean":"2024-04-26T10:45:57.158373+0000","last_became_active":"2024-04-26T10:45:56.160344+0000","last_became_peered":"2024-04-26T10:45:56.160344+0000","last_unstale":"2024-04-26T10:45:57.158373+0000","last_undegraded":"2024-04-26T10:45:57.158373+0000","last_fullsized":"2024-04-26T10:45:57.158373+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:50.232753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'418","reported_seq":929,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159365+0000","last_change":"2024-04-26T10:45:55.179671+0000","last_active":"2024-04-26T10:45:57.159365+0000","last_peered":"2024-04-26T10:45:57.159365+0000","last_clean":"2024-04-26T10:45:57.159365+0000","last_became_active":"2024-04-26T10:45:55.178079+0000","last_became_peered":"2024-04-26T10:45:55.178079+0000","last_unstale":"2024-04-26T10:45:57.159365+0000","last_undegraded":"2024-04-26T10:45:57.159365+0000","last_fullsized":"2024-04-26T10:45:57.159365+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:36.749926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":34476,"num_write":379,"num_write_kb":101645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"62'494","reported_seq":575,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159163+0000","last_change":"2024-04-26T10:42:25.688221+0000","last_active":"2024-04-26T10:45:57.159163+0000","last_peered":"2024-04-26T10:45:57.159163+0000","last_clean":"2024-04-26T10:45:57.159163+0000","last_became_active":"2024-04-26T10:42:25.687829+0000","last_became_peered":"2024-04-26T10:42:25.687829+0000","last_unstale":"2024-04-26T10:45:57.159163+0000","last_undegraded":"2024-04-26T10:45:57.159163+0000","last_fullsized":"2024-04-26T10:45:57.159163+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:05.939715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":12543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"63'406","reported_seq":586,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159122+0000","last_change":"2024-04-26T10:45:54.192178+0000","last_active":"2024-04-26T10:45:57.159122+0000","last_peered":"2024-04-26T10:45:57.159122+0000","last_clean":"2024-04-26T10:45:57.159122+0000","last_became_active":"2024-04-26T10:45:54.189591+0000","last_became_peered":"2024-04-26T10:45:54.189591+0000","last_unstale":"2024-04-26T10:45:57.159122+0000","last_undegraded":"2024-04-26T10:45:57.159122+0000","last_fullsized":"2024-04-26T10:45:57.159122+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:31.509288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":45941,"num_write":372,"num_write_kb":80011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"62'61","reported_seq":160,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160386+0000","last_change":"2024-04-26T10:45:45.895125+0000","last_active":"2024-04-26T10:45:57.160386+0000","last_peered":"2024-04-26T10:45:57.160386+0000","last_clean":"2024-04-26T10:45:57.160386+0000","last_became_active":"2024-04-26T10:45:45.874300+0000","last_became_peered":"2024-04-26T10:45:45.874300+0000","last_unstale":"2024-04-26T10:45:57.160386+0000","last_undegraded":"2024-04-26T10:45:57.160386+0000","last_fullsized":"2024-04-26T10:45:57.160386+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:26.528893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"63'375","reported_seq":823,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161710+0000","last_change":"2024-04-26T10:45:56.163670+0000","last_active":"2024-04-26T10:45:57.161710+0000","last_peered":"2024-04-26T10:45:57.161710+0000","last_clean":"2024-04-26T10:45:57.161710+0000","last_became_active":"2024-04-26T10:45:56.160416+0000","last_became_peered":"2024-04-26T10:45:56.160416+0000","last_unstale":"2024-04-26T10:45:57.161710+0000","last_undegraded":"2024-04-26T10:45:57.161710+0000","last_fullsized":"2024-04-26T10:45:57.161710+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:43.147179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16213,"num_write":354,"num_write_kb":54493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":332,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"62'276","reported_seq":368,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160846+0000","last_change":"2024-04-26T10:45:56.160817+0000","last_active":"2024-04-26T10:45:57.160846+0000","last_peered":"2024-04-26T10:45:57.160846+0000","last_clean":"2024-04-26T10:45:57.160846+0000","last_became_active":"2024-04-26T10:45:56.160414+0000","last_became_peered":"2024-04-26T10:45:56.160414+0000","last_unstale":"2024-04-26T10:45:57.160846+0000","last_undegraded":"2024-04-26T10:45:57.160846+0000","last_fullsized":"2024-04-26T10:45:57.160846+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:40.374381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"63'379","reported_seq":475,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161030+0000","last_change":"2024-04-26T10:45:53.177365+0000","last_active":"2024-04-26T10:45:57.161030+0000","last_peered":"2024-04-26T10:45:57.161030+0000","last_clean":"2024-04-26T10:45:57.161030+0000","last_became_active":"2024-04-26T10:45:53.173645+0000","last_became_peered":"2024-04-26T10:45:53.173645+0000","last_unstale":"2024-04-26T10:45:57.161030+0000","last_undegraded":"2024-04-26T10:45:57.161030+0000","last_fullsized":"2024-04-26T10:45:57.161030+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:32.390075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20480,"num_write":343,"num_write_kb":25788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"62'237","reported_seq":347,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159471+0000","last_change":"2024-04-26T10:45:48.867081+0000","last_active":"2024-04-26T10:45:57.159471+0000","last_peered":"2024-04-26T10:45:57.159471+0000","last_clean":"2024-04-26T10:45:57.159471+0000","last_became_active":"2024-04-26T10:45:48.866716+0000","last_became_peered":"2024-04-26T10:45:48.866716+0000","last_unstale":"2024-04-26T10:45:57.159471+0000","last_undegraded":"2024-04-26T10:45:57.159471+0000","last_fullsized":"2024-04-26T10:45:57.159471+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:16.712392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":12393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"63'419","reported_seq":570,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158951+0000","last_change":"2024-04-26T10:42:26.041729+0000","last_active":"2024-04-26T10:45:57.158951+0000","last_peered":"2024-04-26T10:45:57.158951+0000","last_clean":"2024-04-26T10:45:57.158951+0000","last_became_active":"2024-04-26T10:42:26.040504+0000","last_became_peered":"2024-04-26T10:42:26.040504+0000","last_unstale":"2024-04-26T10:45:57.158951+0000","last_undegraded":"2024-04-26T10:45:57.158951+0000","last_fullsized":"2024-04-26T10:45:57.158951+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39582,"num_write":378,"num_write_kb":54867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"62'61","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159083+0000","last_change":"2024-04-26T10:45:53.227750+0000","last_active":"2024-04-26T10:45:57.159083+0000","last_peered":"2024-04-26T10:45:57.159083+0000","last_clean":"2024-04-26T10:45:57.159083+0000","last_became_active":"2024-04-26T10:45:53.178804+0000","last_became_peered":"2024-04-26T10:45:53.178804+0000","last_unstale":"2024-04-26T10:45:57.159083+0000","last_undegraded":"2024-04-26T10:45:57.159083+0000","last_fullsized":"2024-04-26T10:45:57.159083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:56.795614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'437","reported_seq":523,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162221+0000","last_change":"2024-04-26T10:45:53.181155+0000","last_active":"2024-04-26T10:45:57.162221+0000","last_peered":"2024-04-26T10:45:57.162221+0000","last_clean":"2024-04-26T10:45:57.162221+0000","last_became_active":"2024-04-26T10:45:53.177071+0000","last_became_peered":"2024-04-26T10:45:53.177071+0000","last_unstale":"2024-04-26T10:45:57.162221+0000","last_undegraded":"2024-04-26T10:45:57.162221+0000","last_fullsized":"2024-04-26T10:45:57.162221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:34.219319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":7562,"num_write":400,"num_write_kb":26121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"62'58","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158941+0000","last_change":"2024-04-26T10:45:53.197669+0000","last_active":"2024-04-26T10:45:57.158941+0000","last_peered":"2024-04-26T10:45:57.158941+0000","last_clean":"2024-04-26T10:45:57.158941+0000","last_became_active":"2024-04-26T10:45:53.173542+0000","last_became_peered":"2024-04-26T10:45:53.173542+0000","last_unstale":"2024-04-26T10:45:57.158941+0000","last_undegraded":"2024-04-26T10:45:57.158941+0000","last_fullsized":"2024-04-26T10:45:57.158941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:34.409430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2672,"num_read_kb":1454712,"num_write":24538,"num_write_kb":4190103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26671,"ondisk_log_size":26671,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128811551,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":5770,"num_write_kb":129888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257691648,"data_stored":257623102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},"log_size":7595,"ondisk_log_size":7595,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738416,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":183416,"kb_used_data":80164,"kb_used_omap":1,"kb_used_meta":103230,"kb_avail":94188424,"statfs":{"total":96636764160,"available":96448946176,"internally_reserved":0,"allocated":82087936,"data_stored":81566103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105707974},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:45:25 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.20300000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42599999999999999,"15min":0.436},"min":{"1min":0.26000000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.22900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]}]},{"osd":1,"up_from":70,"seq":300647710725,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136028,"kb_used_data":90440,"kb_used_omap":7,"kb_used_meta":45560,"kb_avail":94235812,"statfs":{"total":96636764160,"available":96497471488,"internally_reserved":0,"allocated":92610560,"data_stored":92059263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7181,"internal_metadata":46654451},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738417,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214380,"kb_used_data":84896,"kb_used_omap":1,"kb_used_meta":129470,"kb_avail":94157460,"statfs":{"total":96636764160,"available":96417239040,"internally_reserved":0,"allocated":86933504,"data_stored":86396712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132577734},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Fri Apr 26 10:45:26 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.43099999999999999,"15min":0.44900000000000001},"min":{"1min":0.21199999999999999,"5min":0.183,"15min":0.183},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.442,"15min":0.46500000000000002},"min":{"1min":0.23499999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57199999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.65700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":85422080,"data_stored":85400264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":91099136,"data_stored":91062815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81170432,"data_stored":81160023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:46:03.825 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T10:46:03.825 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-26T10:46:04.168 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T10:46:04.178 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T10:46:04.178 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:46:04.476 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:46:04.477 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:46:04.487 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-04-26T10:46:03.650828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129401919,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2852,"num_read_kb":1456290,"num_write":30511,"num_write_kb":4323451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9253,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34423,"ondisk_log_size":34423,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":222,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":533824,"kb_used_data":255500,"kb_used_omap":10,"kb_used_meta":278261,"kb_avail":282581696,"statfs":{"total":289910292480,"available":289363656704,"internally_reserved":0,"allocated":261632000,"data_stored":260022078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10369,"internal_metadata":284940159},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-494,"num_objects_misplaced":-354,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1332,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.494930"},"pg_stats":[{"pgid":"4.3f","version":"63'415","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160204+0000","last_change":"2024-04-26T10:42:26.045527+0000","last_active":"2024-04-26T10:45:57.160204+0000","last_peered":"2024-04-26T10:45:57.160204+0000","last_clean":"2024-04-26T10:45:57.160204+0000","last_became_active":"2024-04-26T10:42:26.044597+0000","last_became_peered":"2024-04-26T10:42:26.044597+0000","last_unstale":"2024-04-26T10:45:57.160204+0000","last_undegraded":"2024-04-26T10:45:57.160204+0000","last_fullsized":"2024-04-26T10:45:57.160204+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22963,"num_write":385,"num_write_kb":71406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"63'396","reported_seq":521,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159219+0000","last_change":"2024-04-26T10:45:54.194523+0000","last_active":"2024-04-26T10:45:57.159219+0000","last_peered":"2024-04-26T10:45:57.159219+0000","last_clean":"2024-04-26T10:45:57.159219+0000","last_became_active":"2024-04-26T10:45:54.192613+0000","last_became_peered":"2024-04-26T10:45:54.192613+0000","last_unstale":"2024-04-26T10:45:57.159219+0000","last_undegraded":"2024-04-26T10:45:57.159219+0000","last_fullsized":"2024-04-26T10:45:57.159219+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:22.723004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9499,"num_write":371,"num_write_kb":38601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"63'366","reported_seq":449,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161698+0000","last_change":"2024-04-26T10:45:55.183758+0000","last_active":"2024-04-26T10:45:57.161698+0000","last_peered":"2024-04-26T10:45:57.161698+0000","last_clean":"2024-04-26T10:45:57.161698+0000","last_became_active":"2024-04-26T10:45:55.180991+0000","last_became_peered":"2024-04-26T10:45:55.180991+0000","last_unstale":"2024-04-26T10:45:57.161698+0000","last_undegraded":"2024-04-26T10:45:57.161698+0000","last_fullsized":"2024-04-26T10:45:57.161698+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:29.645448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6211,"num_write":338,"num_write_kb":38844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"63'394","reported_seq":545,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160935+0000","last_change":"2024-04-26T10:45:51.162341+0000","last_active":"2024-04-26T10:45:57.160935+0000","last_peered":"2024-04-26T10:45:57.160935+0000","last_clean":"2024-04-26T10:45:57.160935+0000","last_became_active":"2024-04-26T10:45:51.159099+0000","last_became_peered":"2024-04-26T10:45:51.159099+0000","last_unstale":"2024-04-26T10:45:57.160935+0000","last_undegraded":"2024-04-26T10:45:57.160935+0000","last_fullsized":"2024-04-26T10:45:57.160935+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:18.605866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":52323,"num_write":357,"num_write_kb":63323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"63'409","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160398+0000","last_change":"2024-04-26T10:42:26.041191+0000","last_active":"2024-04-26T10:45:57.160398+0000","last_peered":"2024-04-26T10:45:57.160398+0000","last_clean":"2024-04-26T10:45:57.160398+0000","last_became_active":"2024-04-26T10:42:26.040487+0000","last_became_peered":"2024-04-26T10:42:26.040487+0000","last_unstale":"2024-04-26T10:45:57.160398+0000","last_undegraded":"2024-04-26T10:45:57.160398+0000","last_fullsized":"2024-04-26T10:45:57.160398+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":372,"num_write_kb":42764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'385","reported_seq":464,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161234+0000","last_change":"2024-04-26T10:45:49.864662+0000","last_active":"2024-04-26T10:45:57.161234+0000","last_peered":"2024-04-26T10:45:57.161234+0000","last_clean":"2024-04-26T10:45:57.161234+0000","last_became_active":"2024-04-26T10:45:49.861811+0000","last_became_peered":"2024-04-26T10:45:49.861811+0000","last_unstale":"2024-04-26T10:45:57.161234+0000","last_undegraded":"2024-04-26T10:45:57.161234+0000","last_fullsized":"2024-04-26T10:45:57.161234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:25.549464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4124,"num_write":356,"num_write_kb":69857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"63'425","reported_seq":534,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160809+0000","last_change":"2024-04-26T10:45:50.869572+0000","last_active":"2024-04-26T10:45:57.160809+0000","last_peered":"2024-04-26T10:45:57.160809+0000","last_clean":"2024-04-26T10:45:57.160809+0000","last_became_active":"2024-04-26T10:45:50.866996+0000","last_became_peered":"2024-04-26T10:45:50.866996+0000","last_unstale":"2024-04-26T10:45:57.160809+0000","last_undegraded":"2024-04-26T10:45:57.160809+0000","last_fullsized":"2024-04-26T10:45:57.160809+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:17.631869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13036,"num_write":390,"num_write_kb":67193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"63'399","reported_seq":507,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.164304+0000","last_change":"2024-04-26T10:45:58.164304+0000","last_active":"2024-04-26T10:45:58.164304+0000","last_peered":"2024-04-26T10:45:58.164304+0000","last_clean":"2024-04-26T10:45:58.164304+0000","last_became_active":"2024-04-26T10:45:58.162532+0000","last_became_peered":"2024-04-26T10:45:58.162532+0000","last_unstale":"2024-04-26T10:45:58.164304+0000","last_undegraded":"2024-04-26T10:45:58.164304+0000","last_fullsized":"2024-04-26T10:45:58.164304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:50.164416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25678,"num_write":356,"num_write_kb":116549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"63'442","reported_seq":589,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159518+0000","last_change":"2024-04-26T10:42:26.045893+0000","last_active":"2024-04-26T10:45:57.159518+0000","last_peered":"2024-04-26T10:45:57.159518+0000","last_clean":"2024-04-26T10:45:57.159518+0000","last_became_active":"2024-04-26T10:42:26.045177+0000","last_became_peered":"2024-04-26T10:42:26.045177+0000","last_unstale":"2024-04-26T10:45:57.159518+0000","last_undegraded":"2024-04-26T10:45:57.159518+0000","last_fullsized":"2024-04-26T10:45:57.159518+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35111,"num_write":413,"num_write_kb":60306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'393","reported_seq":515,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159399+0000","last_change":"2024-04-26T10:45:54.192984+0000","last_active":"2024-04-26T10:45:57.159399+0000","last_peered":"2024-04-26T10:45:57.159399+0000","last_clean":"2024-04-26T10:45:57.159399+0000","last_became_active":"2024-04-26T10:45:54.191514+0000","last_became_peered":"2024-04-26T10:45:54.191514+0000","last_unstale":"2024-04-26T10:45:57.159399+0000","last_undegraded":"2024-04-26T10:45:57.159399+0000","last_fullsized":"2024-04-26T10:45:57.159399+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:33.809143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5355,"num_write":351,"num_write_kb":38901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"63'377","reported_seq":482,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161319+0000","last_change":"2024-04-26T10:45:49.865172+0000","last_active":"2024-04-26T10:45:57.161319+0000","last_peered":"2024-04-26T10:45:57.161319+0000","last_clean":"2024-04-26T10:45:57.161319+0000","last_became_active":"2024-04-26T10:45:49.862718+0000","last_became_peered":"2024-04-26T10:45:49.862718+0000","last_unstale":"2024-04-26T10:45:57.161319+0000","last_undegraded":"2024-04-26T10:45:57.161319+0000","last_fullsized":"2024-04-26T10:45:57.161319+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:43.129958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18030,"num_write":355,"num_write_kb":67044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"63'365","reported_seq":808,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.167133+0000","last_change":"2024-04-26T10:45:57.166219+0000","last_active":"2024-04-26T10:45:57.167133+0000","last_peered":"2024-04-26T10:45:57.167133+0000","last_clean":"2024-04-26T10:45:57.167133+0000","last_became_active":"2024-04-26T10:45:57.164964+0000","last_became_peered":"2024-04-26T10:45:57.164964+0000","last_unstale":"2024-04-26T10:45:57.167133+0000","last_undegraded":"2024-04-26T10:45:57.167133+0000","last_fullsized":"2024-04-26T10:45:57.167133+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:55.064831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14866,"num_write":337,"num_write_kb":71188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'397","reported_seq":490,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160289+0000","last_change":"2024-04-26T10:42:26.042607+0000","last_active":"2024-04-26T10:45:57.160289+0000","last_peered":"2024-04-26T10:45:57.160289+0000","last_clean":"2024-04-26T10:45:57.160289+0000","last_became_active":"2024-04-26T10:42:26.041617+0000","last_became_peered":"2024-04-26T10:42:26.041617+0000","last_unstale":"2024-04-26T10:45:57.160289+0000","last_undegraded":"2024-04-26T10:45:57.160289+0000","last_fullsized":"2024-04-26T10:45:57.160289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8192,"num_write":362,"num_write_kb":54822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"63'408","reported_seq":487,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161186+0000","last_change":"2024-04-26T10:45:53.181618+0000","last_active":"2024-04-26T10:45:57.161186+0000","last_peered":"2024-04-26T10:45:57.161186+0000","last_clean":"2024-04-26T10:45:57.161186+0000","last_became_active":"2024-04-26T10:45:53.177677+0000","last_became_peered":"2024-04-26T10:45:53.177677+0000","last_unstale":"2024-04-26T10:45:57.161186+0000","last_undegraded":"2024-04-26T10:45:57.161186+0000","last_fullsized":"2024-04-26T10:45:57.161186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:06.719053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4688,"num_write":374,"num_write_kb":21766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"63'409","reported_seq":522,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160533+0000","last_change":"2024-04-26T10:45:54.188625+0000","last_active":"2024-04-26T10:45:57.160533+0000","last_peered":"2024-04-26T10:45:57.160533+0000","last_clean":"2024-04-26T10:45:57.160533+0000","last_became_active":"2024-04-26T10:45:54.185826+0000","last_became_peered":"2024-04-26T10:45:54.185826+0000","last_unstale":"2024-04-26T10:45:57.160533+0000","last_undegraded":"2024-04-26T10:45:57.160533+0000","last_fullsized":"2024-04-26T10:45:57.160533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:48.401265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25968,"num_write":366,"num_write_kb":75698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"63'460","reported_seq":562,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162279+0000","last_change":"2024-04-26T10:45:53.176893+0000","last_active":"2024-04-26T10:45:57.162279+0000","last_peered":"2024-04-26T10:45:57.162279+0000","last_clean":"2024-04-26T10:45:57.162279+0000","last_became_active":"2024-04-26T10:45:53.174699+0000","last_became_peered":"2024-04-26T10:45:53.174699+0000","last_unstale":"2024-04-26T10:45:57.162279+0000","last_undegraded":"2024-04-26T10:45:57.162279+0000","last_fullsized":"2024-04-26T10:45:57.162279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:41.919177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16269,"num_write":426,"num_write_kb":67839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"63'393","reported_seq":512,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159625+0000","last_change":"2024-04-26T10:42:26.049338+0000","last_active":"2024-04-26T10:45:57.159625+0000","last_peered":"2024-04-26T10:45:57.159625+0000","last_clean":"2024-04-26T10:45:57.159625+0000","last_became_active":"2024-04-26T10:42:26.049014+0000","last_became_peered":"2024-04-26T10:42:26.049014+0000","last_unstale":"2024-04-26T10:45:57.159625+0000","last_undegraded":"2024-04-26T10:45:57.159625+0000","last_fullsized":"2024-04-26T10:45:57.159625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":25712,"num_write":362,"num_write_kb":42020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'428","reported_seq":554,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159673+0000","last_change":"2024-04-26T10:45:54.192786+0000","last_active":"2024-04-26T10:45:57.159673+0000","last_peered":"2024-04-26T10:45:57.159673+0000","last_clean":"2024-04-26T10:45:57.159673+0000","last_became_active":"2024-04-26T10:45:54.189852+0000","last_became_peered":"2024-04-26T10:45:54.189852+0000","last_unstale":"2024-04-26T10:45:57.159673+0000","last_undegraded":"2024-04-26T10:45:57.159673+0000","last_fullsized":"2024-04-26T10:45:57.159673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:29.968564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12316,"num_write":384,"num_write_kb":87656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"63'446","reported_seq":587,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158810+0000","last_change":"2024-04-26T10:45:54.186962+0000","last_active":"2024-04-26T10:45:57.158810+0000","last_peered":"2024-04-26T10:45:57.158810+0000","last_clean":"2024-04-26T10:45:57.158810+0000","last_became_active":"2024-04-26T10:45:54.184063+0000","last_became_peered":"2024-04-26T10:45:54.184063+0000","last_unstale":"2024-04-26T10:45:57.158810+0000","last_undegraded":"2024-04-26T10:45:57.158810+0000","last_fullsized":"2024-04-26T10:45:57.158810+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:59.349649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":53414,"num_write":401,"num_write_kb":80048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":550,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161291+0000","last_change":"2024-04-26T10:45:50.869971+0000","last_active":"2024-04-26T10:45:57.161291+0000","last_peered":"2024-04-26T10:45:57.161291+0000","last_clean":"2024-04-26T10:45:57.161291+0000","last_became_active":"2024-04-26T10:45:50.867680+0000","last_became_peered":"2024-04-26T10:45:50.867680+0000","last_unstale":"2024-04-26T10:45:57.161291+0000","last_undegraded":"2024-04-26T10:45:57.161291+0000","last_fullsized":"2024-04-26T10:45:57.161291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:17.680371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19859,"num_write":405,"num_write_kb":51119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"63'408","reported_seq":862,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161853+0000","last_change":"2024-04-26T10:45:56.163683+0000","last_active":"2024-04-26T10:45:57.161853+0000","last_peered":"2024-04-26T10:45:57.161853+0000","last_clean":"2024-04-26T10:45:57.161853+0000","last_became_active":"2024-04-26T10:45:56.160360+0000","last_became_peered":"2024-04-26T10:45:56.160360+0000","last_unstale":"2024-04-26T10:45:57.161853+0000","last_undegraded":"2024-04-26T10:45:57.161853+0000","last_fullsized":"2024-04-26T10:45:57.161853+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:44.845909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":15372,"num_write":366,"num_write_kb":75855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"63'452","reported_seq":1017,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158921+0000","last_change":"2024-04-26T10:45:52.175372+0000","last_active":"2024-04-26T10:45:57.158921+0000","last_peered":"2024-04-26T10:45:57.158921+0000","last_clean":"2024-04-26T10:45:57.158921+0000","last_became_active":"2024-04-26T10:45:52.173702+0000","last_became_peered":"2024-04-26T10:45:52.173702+0000","last_unstale":"2024-04-26T10:45:57.158921+0000","last_undegraded":"2024-04-26T10:45:57.158921+0000","last_fullsized":"2024-04-26T10:45:57.158921+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:55.459452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43729,"num_write":421,"num_write_kb":79804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"63'408","reported_seq":882,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.163833+0000","last_change":"2024-04-26T10:45:57.163475+0000","last_active":"2024-04-26T10:45:57.163833+0000","last_peered":"2024-04-26T10:45:57.163833+0000","last_clean":"2024-04-26T10:45:57.163833+0000","last_became_active":"2024-04-26T10:45:57.162147+0000","last_became_peered":"2024-04-26T10:45:57.162147+0000","last_unstale":"2024-04-26T10:45:57.163833+0000","last_undegraded":"2024-04-26T10:45:57.163833+0000","last_fullsized":"2024-04-26T10:45:57.163833+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:18.287163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":30320,"num_write":372,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'453","reported_seq":615,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158621+0000","last_change":"2024-04-26T10:45:54.184330+0000","last_active":"2024-04-26T10:45:57.158621+0000","last_peered":"2024-04-26T10:45:57.158621+0000","last_clean":"2024-04-26T10:45:57.158621+0000","last_became_active":"2024-04-26T10:45:54.181881+0000","last_became_peered":"2024-04-26T10:45:54.181881+0000","last_unstale":"2024-04-26T10:45:57.158621+0000","last_undegraded":"2024-04-26T10:45:57.158621+0000","last_fullsized":"2024-04-26T10:45:57.158621+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:02.066091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":19864,"num_write":422,"num_write_kb":51638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"63'439","reported_seq":954,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160299+0000","last_change":"2024-04-26T10:45:48.867766+0000","last_active":"2024-04-26T10:45:57.160299+0000","last_peered":"2024-04-26T10:45:57.160299+0000","last_clean":"2024-04-26T10:45:57.160299+0000","last_became_active":"2024-04-26T10:45:48.866159+0000","last_became_peered":"2024-04-26T10:45:48.866159+0000","last_unstale":"2024-04-26T10:45:57.160299+0000","last_undegraded":"2024-04-26T10:45:57.160299+0000","last_fullsized":"2024-04-26T10:45:57.160299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:39.736649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8912,"num_write":417,"num_write_kb":46575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"63'513","reported_seq":1158,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158983+0000","last_change":"2024-04-26T10:45:51.160003+0000","last_active":"2024-04-26T10:45:57.158983+0000","last_peered":"2024-04-26T10:45:57.158983+0000","last_clean":"2024-04-26T10:45:57.158983+0000","last_became_active":"2024-04-26T10:45:51.158698+0000","last_became_peered":"2024-04-26T10:45:51.158698+0000","last_unstale":"2024-04-26T10:45:57.158983+0000","last_undegraded":"2024-04-26T10:45:57.158983+0000","last_fullsized":"2024-04-26T10:45:57.158983+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:36.990095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":70751,"num_write":473,"num_write_kb":88902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'406","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161212+0000","last_change":"2024-04-26T10:45:56.164805+0000","last_active":"2024-04-26T10:45:57.161212+0000","last_peered":"2024-04-26T10:45:57.161212+0000","last_clean":"2024-04-26T10:45:57.161212+0000","last_became_active":"2024-04-26T10:45:56.162419+0000","last_became_peered":"2024-04-26T10:45:56.162419+0000","last_unstale":"2024-04-26T10:45:57.161212+0000","last_undegraded":"2024-04-26T10:45:57.161212+0000","last_fullsized":"2024-04-26T10:45:57.161212+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:53.474847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":32121,"num_write":372,"num_write_kb":60163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"63'402","reported_seq":867,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.167147+0000","last_change":"2024-04-26T10:45:57.166225+0000","last_active":"2024-04-26T10:45:57.167147+0000","last_peered":"2024-04-26T10:45:57.167147+0000","last_clean":"2024-04-26T10:45:57.167147+0000","last_became_active":"2024-04-26T10:45:57.165064+0000","last_became_peered":"2024-04-26T10:45:57.165064+0000","last_unstale":"2024-04-26T10:45:57.167147+0000","last_undegraded":"2024-04-26T10:45:57.167147+0000","last_fullsized":"2024-04-26T10:45:57.167147+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:52.273357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":6824,"num_write":378,"num_write_kb":72156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"63'407","reported_seq":888,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.166516+0000","last_change":"2024-04-26T10:45:58.163989+0000","last_active":"2024-04-26T10:45:58.166516+0000","last_peered":"2024-04-26T10:45:58.166516+0000","last_clean":"2024-04-26T10:45:58.166516+0000","last_became_active":"2024-04-26T10:45:58.161850+0000","last_became_peered":"2024-04-26T10:45:58.161850+0000","last_unstale":"2024-04-26T10:45:58.166516+0000","last_undegraded":"2024-04-26T10:45:58.166516+0000","last_fullsized":"2024-04-26T10:45:58.166516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:17:09.805958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25898,"num_write":372,"num_write_kb":59274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":346,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'490","reported_seq":1058,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159063+0000","last_change":"2024-04-26T10:45:55.179785+0000","last_active":"2024-04-26T10:45:57.159063+0000","last_peered":"2024-04-26T10:45:57.159063+0000","last_clean":"2024-04-26T10:45:57.159063+0000","last_became_active":"2024-04-26T10:45:55.178083+0000","last_became_peered":"2024-04-26T10:45:55.178083+0000","last_unstale":"2024-04-26T10:45:57.159063+0000","last_undegraded":"2024-04-26T10:45:57.159063+0000","last_fullsized":"2024-04-26T10:45:57.159063+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:23.269957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33597,"num_write":449,"num_write_kb":87981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"63'474","reported_seq":563,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158167+0000","last_change":"2024-04-26T10:45:54.189228+0000","last_active":"2024-04-26T10:45:57.158167+0000","last_peered":"2024-04-26T10:45:57.158167+0000","last_clean":"2024-04-26T10:45:57.158167+0000","last_became_active":"2024-04-26T10:45:54.186011+0000","last_became_peered":"2024-04-26T10:45:54.186011+0000","last_unstale":"2024-04-26T10:45:57.158167+0000","last_undegraded":"2024-04-26T10:45:57.158167+0000","last_fullsized":"2024-04-26T10:45:57.158167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.355145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30886,"num_write":441,"num_write_kb":118807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'443","reported_seq":547,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162005+0000","last_change":"2024-04-26T10:45:48.864423+0000","last_active":"2024-04-26T10:45:57.162005+0000","last_peered":"2024-04-26T10:45:57.162005+0000","last_clean":"2024-04-26T10:45:57.162005+0000","last_became_active":"2024-04-26T10:45:48.861918+0000","last_became_peered":"2024-04-26T10:45:48.861918+0000","last_unstale":"2024-04-26T10:45:57.162005+0000","last_undegraded":"2024-04-26T10:45:57.162005+0000","last_fullsized":"2024-04-26T10:45:57.162005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:11.356135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20556,"num_write":413,"num_write_kb":91647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"63'376","reported_seq":478,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159241+0000","last_change":"2024-04-26T10:42:26.041757+0000","last_active":"2024-04-26T10:45:57.159241+0000","last_peered":"2024-04-26T10:45:57.159241+0000","last_clean":"2024-04-26T10:45:57.159241+0000","last_became_active":"2024-04-26T10:42:26.040920+0000","last_became_peered":"2024-04-26T10:42:26.040920+0000","last_unstale":"2024-04-26T10:45:57.159241+0000","last_undegraded":"2024-04-26T10:45:57.159241+0000","last_fullsized":"2024-04-26T10:45:57.159241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10124,"num_write":344,"num_write_kb":66899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"62'453","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161061+0000","last_change":"2024-04-26T10:45:48.862782+0000","last_active":"2024-04-26T10:45:57.161061+0000","last_peered":"2024-04-26T10:45:57.161061+0000","last_clean":"2024-04-26T10:45:57.161061+0000","last_became_active":"2024-04-26T10:45:48.862424+0000","last_became_peered":"2024-04-26T10:45:48.862424+0000","last_unstale":"2024-04-26T10:45:57.161061+0000","last_undegraded":"2024-04-26T10:45:57.161061+0000","last_fullsized":"2024-04-26T10:45:57.161061+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:16.548893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"63'403","reported_seq":520,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159394+0000","last_change":"2024-04-26T10:42:26.041850+0000","last_active":"2024-04-26T10:45:57.159394+0000","last_peered":"2024-04-26T10:45:57.159394+0000","last_clean":"2024-04-26T10:45:57.159394+0000","last_became_active":"2024-04-26T10:42:26.040464+0000","last_became_peered":"2024-04-26T10:42:26.040464+0000","last_unstale":"2024-04-26T10:45:57.159394+0000","last_undegraded":"2024-04-26T10:45:57.159394+0000","last_fullsized":"2024-04-26T10:45:57.159394+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24588,"num_write":363,"num_write_kb":51190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"62'49","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158264+0000","last_change":"2024-04-26T10:45:45.862317+0000","last_active":"2024-04-26T10:45:57.158264+0000","last_peered":"2024-04-26T10:45:57.158264+0000","last_clean":"2024-04-26T10:45:57.158264+0000","last_became_active":"2024-04-26T10:45:45.862029+0000","last_became_peered":"2024-04-26T10:45:45.862029+0000","last_unstale":"2024-04-26T10:45:57.158264+0000","last_undegraded":"2024-04-26T10:45:57.158264+0000","last_fullsized":"2024-04-26T10:45:57.158264+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:02.521534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'407","reported_seq":887,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159309+0000","last_change":"2024-04-26T10:45:52.170710+0000","last_active":"2024-04-26T10:45:57.159309+0000","last_peered":"2024-04-26T10:45:57.159309+0000","last_clean":"2024-04-26T10:45:57.159309+0000","last_became_active":"2024-04-26T10:45:52.169295+0000","last_became_peered":"2024-04-26T10:45:52.169295+0000","last_unstale":"2024-04-26T10:45:57.159309+0000","last_undegraded":"2024-04-26T10:45:57.159309+0000","last_fullsized":"2024-04-26T10:45:57.159309+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:10.995530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":7077,"num_write":367,"num_write_kb":42434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"62'66","reported_seq":160,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159731+0000","last_change":"2024-04-26T10:45:45.874440+0000","last_active":"2024-04-26T10:45:57.159731+0000","last_peered":"2024-04-26T10:45:57.159731+0000","last_clean":"2024-04-26T10:45:57.159731+0000","last_became_active":"2024-04-26T10:45:45.874030+0000","last_became_peered":"2024-04-26T10:45:45.874030+0000","last_unstale":"2024-04-26T10:45:57.159731+0000","last_undegraded":"2024-04-26T10:45:57.159731+0000","last_fullsized":"2024-04-26T10:45:57.159731+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:22.711644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"63'406","reported_seq":898,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159545+0000","last_change":"2024-04-26T10:45:49.863376+0000","last_active":"2024-04-26T10:45:57.159545+0000","last_peered":"2024-04-26T10:45:57.159545+0000","last_clean":"2024-04-26T10:45:57.159545+0000","last_became_active":"2024-04-26T10:45:49.861979+0000","last_became_peered":"2024-04-26T10:45:49.861979+0000","last_unstale":"2024-04-26T10:45:57.159545+0000","last_undegraded":"2024-04-26T10:45:57.159545+0000","last_fullsized":"2024-04-26T10:45:57.159545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:16.553043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":25977,"num_write":374,"num_write_kb":104172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'66","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161876+0000","last_change":"2024-04-26T10:45:45.871507+0000","last_active":"2024-04-26T10:45:57.161876+0000","last_peered":"2024-04-26T10:45:57.161876+0000","last_clean":"2024-04-26T10:45:57.161876+0000","last_became_active":"2024-04-26T10:45:45.871120+0000","last_became_peered":"2024-04-26T10:45:45.871120+0000","last_unstale":"2024-04-26T10:45:57.161876+0000","last_undegraded":"2024-04-26T10:45:57.161876+0000","last_fullsized":"2024-04-26T10:45:57.161876+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:56.162347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"62'200","reported_seq":281,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161233+0000","last_change":"2024-04-26T10:45:48.866225+0000","last_active":"2024-04-26T10:45:57.161233+0000","last_peered":"2024-04-26T10:45:57.161233+0000","last_clean":"2024-04-26T10:45:57.161233+0000","last_became_active":"2024-04-26T10:45:48.865878+0000","last_became_peered":"2024-04-26T10:45:48.865878+0000","last_unstale":"2024-04-26T10:45:57.161233+0000","last_undegraded":"2024-04-26T10:45:57.161233+0000","last_fullsized":"2024-04-26T10:45:57.161233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:42:39.518391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"63'415","reported_seq":908,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.164897+0000","last_change":"2024-04-26T10:45:57.164421+0000","last_active":"2024-04-26T10:45:57.164897+0000","last_peered":"2024-04-26T10:45:57.164897+0000","last_clean":"2024-04-26T10:45:57.164897+0000","last_became_active":"2024-04-26T10:45:57.163263+0000","last_became_peered":"2024-04-26T10:45:57.163263+0000","last_unstale":"2024-04-26T10:45:57.164897+0000","last_undegraded":"2024-04-26T10:45:57.164897+0000","last_fullsized":"2024-04-26T10:45:57.164897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:16.262869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15757,"num_write":380,"num_write_kb":54727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"62'342","reported_seq":448,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159793+0000","last_change":"2024-04-26T10:45:48.866915+0000","last_active":"2024-04-26T10:45:57.159793+0000","last_peered":"2024-04-26T10:45:57.159793+0000","last_clean":"2024-04-26T10:45:57.159793+0000","last_became_active":"2024-04-26T10:45:48.866497+0000","last_became_peered":"2024-04-26T10:45:48.866497+0000","last_unstale":"2024-04-26T10:45:57.159793+0000","last_undegraded":"2024-04-26T10:45:57.159793+0000","last_fullsized":"2024-04-26T10:45:57.159793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:04.796882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"63'481","reported_seq":670,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158706+0000","last_change":"2024-04-26T10:45:54.184646+0000","last_active":"2024-04-26T10:45:57.158706+0000","last_peered":"2024-04-26T10:45:57.158706+0000","last_clean":"2024-04-26T10:45:57.158706+0000","last_became_active":"2024-04-26T10:45:54.181993+0000","last_became_peered":"2024-04-26T10:45:54.181993+0000","last_unstale":"2024-04-26T10:45:57.158706+0000","last_undegraded":"2024-04-26T10:45:57.158706+0000","last_fullsized":"2024-04-26T10:45:57.158706+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:34.664600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":45251,"num_write":451,"num_write_kb":105365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"62'460","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160768+0000","last_change":"2024-04-26T10:45:48.865887+0000","last_active":"2024-04-26T10:45:57.160768+0000","last_peered":"2024-04-26T10:45:57.160768+0000","last_clean":"2024-04-26T10:45:57.160768+0000","last_became_active":"2024-04-26T10:45:48.865520+0000","last_became_peered":"2024-04-26T10:45:48.865520+0000","last_unstale":"2024-04-26T10:45:57.160768+0000","last_undegraded":"2024-04-26T10:45:57.160768+0000","last_fullsized":"2024-04-26T10:45:57.160768+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:34.308634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":407,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'420","reported_seq":503,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.165736+0000","last_change":"2024-04-26T10:45:57.165390+0000","last_active":"2024-04-26T10:45:57.165736+0000","last_peered":"2024-04-26T10:45:57.165736+0000","last_clean":"2024-04-26T10:45:57.165736+0000","last_became_active":"2024-04-26T10:45:57.162014+0000","last_became_peered":"2024-04-26T10:45:57.162014+0000","last_unstale":"2024-04-26T10:45:57.165736+0000","last_undegraded":"2024-04-26T10:45:57.165736+0000","last_fullsized":"2024-04-26T10:45:57.165736+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:19.491785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13025,"num_write":385,"num_write_kb":38595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"62'67","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161113+0000","last_change":"2024-04-26T10:45:45.860717+0000","last_active":"2024-04-26T10:45:57.161113+0000","last_peered":"2024-04-26T10:45:57.161113+0000","last_clean":"2024-04-26T10:45:57.161113+0000","last_became_active":"2024-04-26T10:45:45.860175+0000","last_became_peered":"2024-04-26T10:45:45.860175+0000","last_unstale":"2024-04-26T10:45:57.161113+0000","last_undegraded":"2024-04-26T10:45:57.161113+0000","last_fullsized":"2024-04-26T10:45:57.161113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:30.736518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"63'452","reported_seq":965,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.166761+0000","last_change":"2024-04-26T10:45:58.166413+0000","last_active":"2024-04-26T10:45:58.166761+0000","last_peered":"2024-04-26T10:45:58.166761+0000","last_clean":"2024-04-26T10:45:58.166761+0000","last_became_active":"2024-04-26T10:45:58.164105+0000","last_became_peered":"2024-04-26T10:45:58.164105+0000","last_unstale":"2024-04-26T10:45:58.166761+0000","last_undegraded":"2024-04-26T10:45:58.166761+0000","last_fullsized":"2024-04-26T10:45:58.166761+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:05.536110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23217,"num_write":416,"num_write_kb":71418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":388,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"62'200","reported_seq":277,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158343+0000","last_change":"2024-04-26T10:45:56.160957+0000","last_active":"2024-04-26T10:45:57.158343+0000","last_peered":"2024-04-26T10:45:57.158343+0000","last_clean":"2024-04-26T10:45:57.158343+0000","last_became_active":"2024-04-26T10:45:56.160475+0000","last_became_peered":"2024-04-26T10:45:56.160475+0000","last_unstale":"2024-04-26T10:45:57.158343+0000","last_undegraded":"2024-04-26T10:45:57.158343+0000","last_fullsized":"2024-04-26T10:45:57.158343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:48.896541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'430","reported_seq":512,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.165078+0000","last_change":"2024-04-26T10:45:57.164742+0000","last_active":"2024-04-26T10:45:57.165078+0000","last_peered":"2024-04-26T10:45:57.165078+0000","last_clean":"2024-04-26T10:45:57.165078+0000","last_became_active":"2024-04-26T10:45:57.162070+0000","last_became_peered":"2024-04-26T10:45:57.162070+0000","last_unstale":"2024-04-26T10:45:57.165078+0000","last_undegraded":"2024-04-26T10:45:57.165078+0000","last_fullsized":"2024-04-26T10:45:57.165078+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:14.872176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":24352,"num_write":392,"num_write_kb":21976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"62'233","reported_seq":306,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160855+0000","last_change":"2024-04-26T10:45:48.862856+0000","last_active":"2024-04-26T10:45:57.160855+0000","last_peered":"2024-04-26T10:45:57.160855+0000","last_clean":"2024-04-26T10:45:57.160855+0000","last_became_active":"2024-04-26T10:45:48.862517+0000","last_became_peered":"2024-04-26T10:45:48.862517+0000","last_unstale":"2024-04-26T10:45:57.160855+0000","last_undegraded":"2024-04-26T10:45:57.160855+0000","last_fullsized":"2024-04-26T10:45:57.160855+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:43.799960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"63'393","reported_seq":478,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160672+0000","last_change":"2024-04-26T10:45:55.180960+0000","last_active":"2024-04-26T10:45:57.160672+0000","last_peered":"2024-04-26T10:45:57.160672+0000","last_clean":"2024-04-26T10:45:57.160672+0000","last_became_active":"2024-04-26T10:45:55.177758+0000","last_became_peered":"2024-04-26T10:45:55.177758+0000","last_unstale":"2024-04-26T10:45:57.160672+0000","last_undegraded":"2024-04-26T10:45:57.160672+0000","last_fullsized":"2024-04-26T10:45:57.160672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:47.889251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8671,"num_write":368,"num_write_kb":38542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"62'49","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158855+0000","last_change":"2024-04-26T10:45:45.874789+0000","last_active":"2024-04-26T10:45:57.158855+0000","last_peered":"2024-04-26T10:45:57.158855+0000","last_clean":"2024-04-26T10:45:57.158855+0000","last_became_active":"2024-04-26T10:45:45.874328+0000","last_became_peered":"2024-04-26T10:45:45.874328+0000","last_unstale":"2024-04-26T10:45:57.158855+0000","last_undegraded":"2024-04-26T10:45:57.158855+0000","last_fullsized":"2024-04-26T10:45:57.158855+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:27.431661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"63'368","reported_seq":463,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162061+0000","last_change":"2024-04-26T10:45:56.165615+0000","last_active":"2024-04-26T10:45:57.162061+0000","last_peered":"2024-04-26T10:45:57.162061+0000","last_clean":"2024-04-26T10:45:57.162061+0000","last_became_active":"2024-04-26T10:45:56.163456+0000","last_became_peered":"2024-04-26T10:45:56.163456+0000","last_unstale":"2024-04-26T10:45:57.162061+0000","last_undegraded":"2024-04-26T10:45:57.162061+0000","last_fullsized":"2024-04-26T10:45:57.162061+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:14.480860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":19222,"num_write":336,"num_write_kb":58903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"62'619","reported_seq":747,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159149+0000","last_change":"2024-04-26T10:45:56.162511+0000","last_active":"2024-04-26T10:45:57.159149+0000","last_peered":"2024-04-26T10:45:57.159149+0000","last_clean":"2024-04-26T10:45:57.159149+0000","last_became_active":"2024-04-26T10:45:56.161604+0000","last_became_peered":"2024-04-26T10:45:56.161604+0000","last_unstale":"2024-04-26T10:45:57.159149+0000","last_undegraded":"2024-04-26T10:45:57.159149+0000","last_fullsized":"2024-04-26T10:45:57.159149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:39.366865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":558,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"63'383","reported_seq":822,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.165607+0000","last_change":"2024-04-26T10:45:58.165237+0000","last_active":"2024-04-26T10:45:58.165607+0000","last_peered":"2024-04-26T10:45:58.165607+0000","last_clean":"2024-04-26T10:45:58.165607+0000","last_became_active":"2024-04-26T10:45:58.162264+0000","last_became_peered":"2024-04-26T10:45:58.162264+0000","last_unstale":"2024-04-26T10:45:58.165607+0000","last_undegraded":"2024-04-26T10:45:58.165607+0000","last_fullsized":"2024-04-26T10:45:58.165607+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:12.784168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":14260,"num_write":349,"num_write_kb":50367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":229,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161708+0000","last_change":"2024-04-26T10:45:45.871511+0000","last_active":"2024-04-26T10:45:57.161708+0000","last_peered":"2024-04-26T10:45:57.161708+0000","last_clean":"2024-04-26T10:45:57.161708+0000","last_became_active":"2024-04-26T10:45:45.871155+0000","last_became_peered":"2024-04-26T10:45:45.871155+0000","last_unstale":"2024-04-26T10:45:57.161708+0000","last_undegraded":"2024-04-26T10:45:57.161708+0000","last_fullsized":"2024-04-26T10:45:57.161708+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:53.015361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160932+0000","last_change":"2024-04-26T10:45:45.861068+0000","last_active":"2024-04-26T10:45:57.160932+0000","last_peered":"2024-04-26T10:45:57.160932+0000","last_clean":"2024-04-26T10:45:57.160932+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:57.160932+0000","last_undegraded":"2024-04-26T10:45:57.160932+0000","last_fullsized":"2024-04-26T10:45:57.160932+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:16.348009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"62'743","reported_seq":824,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158521+0000","last_change":"2024-04-26T10:42:25.686765+0000","last_active":"2024-04-26T10:45:57.158521+0000","last_peered":"2024-04-26T10:45:57.158521+0000","last_clean":"2024-04-26T10:45:57.158521+0000","last_became_active":"2024-04-26T10:42:25.686009+0000","last_became_peered":"2024-04-26T10:42:25.686009+0000","last_unstale":"2024-04-26T10:45:57.158521+0000","last_undegraded":"2024-04-26T10:45:57.158521+0000","last_fullsized":"2024-04-26T10:45:57.158521+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:54.627815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'442","reported_seq":567,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160853+0000","last_change":"2024-04-26T10:45:55.181074+0000","last_active":"2024-04-26T10:45:57.160853+0000","last_peered":"2024-04-26T10:45:57.160853+0000","last_clean":"2024-04-26T10:45:57.160853+0000","last_became_active":"2024-04-26T10:45:55.177751+0000","last_became_peered":"2024-04-26T10:45:55.177751+0000","last_unstale":"2024-04-26T10:45:57.160853+0000","last_undegraded":"2024-04-26T10:45:57.160853+0000","last_fullsized":"2024-04-26T10:45:57.160853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:01.323521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":34346,"num_write":406,"num_write_kb":96298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162129+0000","last_change":"2024-04-26T10:45:45.872099+0000","last_active":"2024-04-26T10:45:57.162129+0000","last_peered":"2024-04-26T10:45:57.162129+0000","last_clean":"2024-04-26T10:45:57.162129+0000","last_became_active":"2024-04-26T10:45:45.871741+0000","last_became_peered":"2024-04-26T10:45:45.871741+0000","last_unstale":"2024-04-26T10:45:57.162129+0000","last_undegraded":"2024-04-26T10:45:57.162129+0000","last_fullsized":"2024-04-26T10:45:57.162129+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:53.226378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"63'102","reported_seq":219,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158049+0000","last_change":"2024-04-26T10:45:56.160802+0000","last_active":"2024-04-26T10:45:57.158049+0000","last_peered":"2024-04-26T10:45:57.158049+0000","last_clean":"2024-04-26T10:45:57.158049+0000","last_became_active":"2024-04-26T10:45:56.160328+0000","last_became_peered":"2024-04-26T10:45:56.160328+0000","last_unstale":"2024-04-26T10:45:57.158049+0000","last_undegraded":"2024-04-26T10:45:57.158049+0000","last_fullsized":"2024-04-26T10:45:57.158049+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:47.864335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467631,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":44,"num_write_kb":1460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2935262,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'485","reported_seq":620,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162426+0000","last_change":"2024-04-26T10:45:57.165815+0000","last_active":"2024-04-26T10:45:58.162426+0000","last_peered":"2024-04-26T10:45:58.162426+0000","last_clean":"2024-04-26T10:45:58.162426+0000","last_became_active":"2024-04-26T10:45:57.162752+0000","last_became_peered":"2024-04-26T10:45:57.162752+0000","last_unstale":"2024-04-26T10:45:58.162426+0000","last_undegraded":"2024-04-26T10:45:58.162426+0000","last_fullsized":"2024-04-26T10:45:58.162426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:10.743149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27703,"num_write":454,"num_write_kb":121509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158512+0000","last_change":"2024-04-26T10:45:53.180892+0000","last_active":"2024-04-26T10:45:57.158512+0000","last_peered":"2024-04-26T10:45:57.158512+0000","last_clean":"2024-04-26T10:45:57.158512+0000","last_became_active":"2024-04-26T10:45:53.180675+0000","last_became_peered":"2024-04-26T10:45:53.180675+0000","last_unstale":"2024-04-26T10:45:57.158512+0000","last_undegraded":"2024-04-26T10:45:57.158512+0000","last_fullsized":"2024-04-26T10:45:57.158512+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:45.758505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"62'306","reported_seq":413,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159253+0000","last_change":"2024-04-26T10:45:48.865095+0000","last_active":"2024-04-26T10:45:57.159253+0000","last_peered":"2024-04-26T10:45:57.159253+0000","last_clean":"2024-04-26T10:45:57.159253+0000","last_became_active":"2024-04-26T10:45:48.864763+0000","last_became_peered":"2024-04-26T10:45:48.864763+0000","last_unstale":"2024-04-26T10:45:57.159253+0000","last_undegraded":"2024-04-26T10:45:57.159253+0000","last_fullsized":"2024-04-26T10:45:57.159253+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:12.665388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"63'336","reported_seq":748,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.165797+0000","last_change":"2024-04-26T10:45:58.165267+0000","last_active":"2024-04-26T10:45:58.165797+0000","last_peered":"2024-04-26T10:45:58.165797+0000","last_clean":"2024-04-26T10:45:58.165797+0000","last_became_active":"2024-04-26T10:45:58.162320+0000","last_became_peered":"2024-04-26T10:45:58.162320+0000","last_unstale":"2024-04-26T10:45:58.165797+0000","last_undegraded":"2024-04-26T10:45:58.165797+0000","last_fullsized":"2024-04-26T10:45:58.165797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:40.611364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12035,"num_write":314,"num_write_kb":29928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":306,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160636+0000","last_change":"2024-04-26T10:45:45.861233+0000","last_active":"2024-04-26T10:45:57.160636+0000","last_peered":"2024-04-26T10:45:57.160636+0000","last_clean":"2024-04-26T10:45:57.160636+0000","last_became_active":"2024-04-26T10:45:45.860924+0000","last_became_peered":"2024-04-26T10:45:45.860924+0000","last_unstale":"2024-04-26T10:45:57.160636+0000","last_undegraded":"2024-04-26T10:45:57.160636+0000","last_fullsized":"2024-04-26T10:45:57.160636+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:11.746110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"62'64","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160997+0000","last_change":"2024-04-26T10:45:45.861230+0000","last_active":"2024-04-26T10:45:57.160997+0000","last_peered":"2024-04-26T10:45:57.160997+0000","last_clean":"2024-04-26T10:45:57.160997+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:57.160997+0000","last_undegraded":"2024-04-26T10:45:57.160997+0000","last_fullsized":"2024-04-26T10:45:57.160997+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:53.564033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"63'421","reported_seq":513,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158851+0000","last_change":"2024-04-26T10:45:54.188138+0000","last_active":"2024-04-26T10:45:57.158851+0000","last_peered":"2024-04-26T10:45:57.158851+0000","last_clean":"2024-04-26T10:45:57.158851+0000","last_became_active":"2024-04-26T10:45:54.185053+0000","last_became_peered":"2024-04-26T10:45:54.185053+0000","last_unstale":"2024-04-26T10:45:57.158851+0000","last_undegraded":"2024-04-26T10:45:57.158851+0000","last_fullsized":"2024-04-26T10:45:57.158851+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:55:26.158040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28557,"num_write":385,"num_write_kb":93083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"62'480","reported_seq":553,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160417+0000","last_change":"2024-04-26T10:45:48.862894+0000","last_active":"2024-04-26T10:45:57.160417+0000","last_peered":"2024-04-26T10:45:57.160417+0000","last_clean":"2024-04-26T10:45:57.160417+0000","last_became_active":"2024-04-26T10:45:48.862564+0000","last_became_peered":"2024-04-26T10:45:48.862564+0000","last_unstale":"2024-04-26T10:45:57.160417+0000","last_undegraded":"2024-04-26T10:45:57.160417+0000","last_fullsized":"2024-04-26T10:45:57.160417+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:38.835403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":84,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158830+0000","last_change":"2024-04-26T10:42:21.405754+0000","last_active":"2024-04-26T10:45:57.158830+0000","last_peered":"2024-04-26T10:45:57.158830+0000","last_clean":"2024-04-26T10:45:57.158830+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:45:57.158830+0000","last_undegraded":"2024-04-26T10:45:57.158830+0000","last_fullsized":"2024-04-26T10:45:57.158830+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:47.123256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'352","reported_seq":776,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158735+0000","last_change":"2024-04-26T10:45:53.183401+0000","last_active":"2024-04-26T10:45:57.158735+0000","last_peered":"2024-04-26T10:45:57.158735+0000","last_clean":"2024-04-26T10:45:57.158735+0000","last_became_active":"2024-04-26T10:45:53.182454+0000","last_became_peered":"2024-04-26T10:45:53.182454+0000","last_unstale":"2024-04-26T10:45:57.158735+0000","last_undegraded":"2024-04-26T10:45:57.158735+0000","last_fullsized":"2024-04-26T10:45:57.158735+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:38.569626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":1905,"num_write":313,"num_write_kb":25573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"62'59","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158485+0000","last_change":"2024-04-26T10:45:53.177446+0000","last_active":"2024-04-26T10:45:57.158485+0000","last_peered":"2024-04-26T10:45:57.158485+0000","last_clean":"2024-04-26T10:45:57.158485+0000","last_became_active":"2024-04-26T10:45:53.176996+0000","last_became_peered":"2024-04-26T10:45:53.176996+0000","last_unstale":"2024-04-26T10:45:57.158485+0000","last_undegraded":"2024-04-26T10:45:57.158485+0000","last_fullsized":"2024-04-26T10:45:57.158485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:23.679423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":88,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161096+0000","last_change":"2024-04-26T10:45:53.175046+0000","last_active":"2024-04-26T10:45:57.161096+0000","last_peered":"2024-04-26T10:45:57.161096+0000","last_clean":"2024-04-26T10:45:57.161096+0000","last_became_active":"2024-04-26T10:45:53.174781+0000","last_became_peered":"2024-04-26T10:45:53.174781+0000","last_unstale":"2024-04-26T10:45:57.161096+0000","last_undegraded":"2024-04-26T10:45:57.161096+0000","last_fullsized":"2024-04-26T10:45:57.161096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:22.742084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'408","reported_seq":907,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160325+0000","last_change":"2024-04-26T10:45:54.186637+0000","last_active":"2024-04-26T10:45:57.160325+0000","last_peered":"2024-04-26T10:45:57.160325+0000","last_clean":"2024-04-26T10:45:57.160325+0000","last_became_active":"2024-04-26T10:45:54.185238+0000","last_became_peered":"2024-04-26T10:45:54.185238+0000","last_unstale":"2024-04-26T10:45:57.160325+0000","last_undegraded":"2024-04-26T10:45:57.160325+0000","last_fullsized":"2024-04-26T10:45:57.160325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:54.735683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19939,"num_write":382,"num_write_kb":63433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"62'55","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159609+0000","last_change":"2024-04-26T10:45:53.205131+0000","last_active":"2024-04-26T10:45:57.159609+0000","last_peered":"2024-04-26T10:45:57.159609+0000","last_clean":"2024-04-26T10:45:57.159609+0000","last_became_active":"2024-04-26T10:45:53.177305+0000","last_became_peered":"2024-04-26T10:45:53.177305+0000","last_unstale":"2024-04-26T10:45:57.159609+0000","last_undegraded":"2024-04-26T10:45:57.159609+0000","last_fullsized":"2024-04-26T10:45:57.159609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:30.829530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158557+0000","last_change":"2024-04-26T10:45:53.177593+0000","last_active":"2024-04-26T10:45:57.158557+0000","last_peered":"2024-04-26T10:45:57.158557+0000","last_clean":"2024-04-26T10:45:57.158557+0000","last_became_active":"2024-04-26T10:45:53.177249+0000","last_became_peered":"2024-04-26T10:45:53.177249+0000","last_unstale":"2024-04-26T10:45:57.158557+0000","last_undegraded":"2024-04-26T10:45:57.158557+0000","last_fullsized":"2024-04-26T10:45:57.158557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:41.564852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'418","reported_seq":877,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158405+0000","last_change":"2024-04-26T10:45:56.162729+0000","last_active":"2024-04-26T10:45:57.158405+0000","last_peered":"2024-04-26T10:45:57.158405+0000","last_clean":"2024-04-26T10:45:57.158405+0000","last_became_active":"2024-04-26T10:45:56.160440+0000","last_became_peered":"2024-04-26T10:45:56.160440+0000","last_unstale":"2024-04-26T10:45:57.158405+0000","last_undegraded":"2024-04-26T10:45:57.158405+0000","last_fullsized":"2024-04-26T10:45:57.158405+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:32.155653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20110,"num_write":390,"num_write_kb":75171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"64'66","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159242+0000","last_change":"2024-04-26T10:45:53.203538+0000","last_active":"2024-04-26T10:45:57.159242+0000","last_peered":"2024-04-26T10:45:57.159242+0000","last_clean":"2024-04-26T10:45:57.159242+0000","last_became_active":"2024-04-26T10:45:53.175946+0000","last_became_peered":"2024-04-26T10:45:53.175946+0000","last_unstale":"2024-04-26T10:45:57.159242+0000","last_undegraded":"2024-04-26T10:45:57.159242+0000","last_fullsized":"2024-04-26T10:45:57.159242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:15.016761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161004+0000","last_change":"2024-04-26T10:45:45.872224+0000","last_active":"2024-04-26T10:45:57.161004+0000","last_peered":"2024-04-26T10:45:57.161004+0000","last_clean":"2024-04-26T10:45:57.161004+0000","last_became_active":"2024-04-26T10:45:45.871923+0000","last_became_peered":"2024-04-26T10:45:45.871923+0000","last_unstale":"2024-04-26T10:45:57.161004+0000","last_undegraded":"2024-04-26T10:45:57.161004+0000","last_fullsized":"2024-04-26T10:45:57.161004+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:00.334874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"63'404","reported_seq":921,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158750+0000","last_change":"2024-04-26T10:45:54.184386+0000","last_active":"2024-04-26T10:45:57.158750+0000","last_peered":"2024-04-26T10:45:57.158750+0000","last_clean":"2024-04-26T10:45:57.158750+0000","last_became_active":"2024-04-26T10:45:54.181795+0000","last_became_peered":"2024-04-26T10:45:54.181795+0000","last_unstale":"2024-04-26T10:45:57.158750+0000","last_undegraded":"2024-04-26T10:45:57.158750+0000","last_fullsized":"2024-04-26T10:45:57.158750+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:10.290362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41262,"num_write":371,"num_write_kb":75820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"63'441","reported_seq":564,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161829+0000","last_change":"2024-04-26T10:45:54.188488+0000","last_active":"2024-04-26T10:45:57.161829+0000","last_peered":"2024-04-26T10:45:57.161829+0000","last_clean":"2024-04-26T10:45:57.161829+0000","last_became_active":"2024-04-26T10:45:54.185862+0000","last_became_peered":"2024-04-26T10:45:54.185862+0000","last_unstale":"2024-04-26T10:45:57.161829+0000","last_undegraded":"2024-04-26T10:45:57.161829+0000","last_fullsized":"2024-04-26T10:45:57.161829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:07.585438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31514,"num_write":408,"num_write_kb":107129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"64'431","reported_seq":520,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161320+0000","last_change":"2024-04-26T10:45:48.865579+0000","last_active":"2024-04-26T10:45:57.161320+0000","last_peered":"2024-04-26T10:45:57.161320+0000","last_clean":"2024-04-26T10:45:57.161320+0000","last_became_active":"2024-04-26T10:45:48.865212+0000","last_became_peered":"2024-04-26T10:45:48.865212+0000","last_unstale":"2024-04-26T10:45:57.161320+0000","last_undegraded":"2024-04-26T10:45:57.161320+0000","last_fullsized":"2024-04-26T10:45:57.161320+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:53.808562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9902610,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":9913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9896193,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"63'410","reported_seq":515,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160782+0000","last_change":"2024-04-26T10:45:54.184713+0000","last_active":"2024-04-26T10:45:57.160782+0000","last_peered":"2024-04-26T10:45:57.160782+0000","last_clean":"2024-04-26T10:45:57.160782+0000","last_became_active":"2024-04-26T10:45:54.182167+0000","last_became_peered":"2024-04-26T10:45:54.182167+0000","last_unstale":"2024-04-26T10:45:57.160782+0000","last_undegraded":"2024-04-26T10:45:57.160782+0000","last_fullsized":"2024-04-26T10:45:57.160782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:41:50.625629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12734,"num_write":373,"num_write_kb":34864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"63'84","reported_seq":183,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159590+0000","last_change":"2024-04-26T10:45:45.896842+0000","last_active":"2024-04-26T10:45:57.159590+0000","last_peered":"2024-04-26T10:45:57.159590+0000","last_clean":"2024-04-26T10:45:57.159590+0000","last_became_active":"2024-04-26T10:45:45.874746+0000","last_became_peered":"2024-04-26T10:45:45.874746+0000","last_unstale":"2024-04-26T10:45:57.159590+0000","last_undegraded":"2024-04-26T10:45:57.159590+0000","last_fullsized":"2024-04-26T10:45:57.159590+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:22.649667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"62'332","reported_seq":419,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161969+0000","last_change":"2024-04-26T10:45:56.161772+0000","last_active":"2024-04-26T10:45:57.161969+0000","last_peered":"2024-04-26T10:45:57.161969+0000","last_clean":"2024-04-26T10:45:57.161969+0000","last_became_active":"2024-04-26T10:45:56.161449+0000","last_became_peered":"2024-04-26T10:45:56.161449+0000","last_unstale":"2024-04-26T10:45:57.161969+0000","last_undegraded":"2024-04-26T10:45:57.161969+0000","last_fullsized":"2024-04-26T10:45:57.161969+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:09.499829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"63'487","reported_seq":1096,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158272+0000","last_change":"2024-04-26T10:45:51.160586+0000","last_active":"2024-04-26T10:45:57.158272+0000","last_peered":"2024-04-26T10:45:57.158272+0000","last_clean":"2024-04-26T10:45:57.158272+0000","last_became_active":"2024-04-26T10:45:51.159235+0000","last_became_peered":"2024-04-26T10:45:51.159235+0000","last_unstale":"2024-04-26T10:45:57.158272+0000","last_undegraded":"2024-04-26T10:45:57.158272+0000","last_fullsized":"2024-04-26T10:45:57.158272+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:54.234867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":43316,"num_write":468,"num_write_kb":77062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"62'61","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159565+0000","last_change":"2024-04-26T10:45:53.174204+0000","last_active":"2024-04-26T10:45:57.159565+0000","last_peered":"2024-04-26T10:45:57.159565+0000","last_clean":"2024-04-26T10:45:57.159565+0000","last_became_active":"2024-04-26T10:45:53.173851+0000","last_became_peered":"2024-04-26T10:45:53.173851+0000","last_unstale":"2024-04-26T10:45:57.159565+0000","last_undegraded":"2024-04-26T10:45:57.159565+0000","last_fullsized":"2024-04-26T10:45:57.159565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:50.698470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'457","reported_seq":536,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158314+0000","last_change":"2024-04-26T10:45:54.199966+0000","last_active":"2024-04-26T10:45:57.158314+0000","last_peered":"2024-04-26T10:45:57.158314+0000","last_clean":"2024-04-26T10:45:57.158314+0000","last_became_active":"2024-04-26T10:45:54.189622+0000","last_became_peered":"2024-04-26T10:45:54.189622+0000","last_unstale":"2024-04-26T10:45:57.158314+0000","last_undegraded":"2024-04-26T10:45:57.158314+0000","last_fullsized":"2024-04-26T10:45:57.158314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:53.540098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14848,"num_write":427,"num_write_kb":71903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'377","reported_seq":838,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160362+0000","last_change":"2024-04-26T10:45:49.867665+0000","last_active":"2024-04-26T10:45:57.160362+0000","last_peered":"2024-04-26T10:45:57.160362+0000","last_clean":"2024-04-26T10:45:57.160362+0000","last_became_active":"2024-04-26T10:45:49.866707+0000","last_became_peered":"2024-04-26T10:45:49.866707+0000","last_unstale":"2024-04-26T10:45:57.160362+0000","last_undegraded":"2024-04-26T10:45:57.160362+0000","last_fullsized":"2024-04-26T10:45:57.160362+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:23.401341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26932,"num_write":349,"num_write_kb":55611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"62'562","reported_seq":643,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158775+0000","last_change":"2024-04-26T10:42:25.683890+0000","last_active":"2024-04-26T10:45:57.158775+0000","last_peered":"2024-04-26T10:45:57.158775+0000","last_clean":"2024-04-26T10:45:57.158775+0000","last_became_active":"2024-04-26T10:42:25.683467+0000","last_became_peered":"2024-04-26T10:42:25.683467+0000","last_unstale":"2024-04-26T10:45:57.158775+0000","last_undegraded":"2024-04-26T10:45:57.158775+0000","last_fullsized":"2024-04-26T10:45:57.158775+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":8440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'425","reported_seq":878,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159122+0000","last_change":"2024-04-26T10:45:56.163245+0000","last_active":"2024-04-26T10:45:57.159122+0000","last_peered":"2024-04-26T10:45:57.159122+0000","last_clean":"2024-04-26T10:45:57.159122+0000","last_became_active":"2024-04-26T10:45:56.161315+0000","last_became_peered":"2024-04-26T10:45:56.161315+0000","last_unstale":"2024-04-26T10:45:57.159122+0000","last_undegraded":"2024-04-26T10:45:57.159122+0000","last_fullsized":"2024-04-26T10:45:57.159122+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:29.938631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":19004,"num_write":390,"num_write_kb":75524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"62'259","reported_seq":331,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158373+0000","last_change":"2024-04-26T10:45:56.160840+0000","last_active":"2024-04-26T10:45:57.158373+0000","last_peered":"2024-04-26T10:45:57.158373+0000","last_clean":"2024-04-26T10:45:57.158373+0000","last_became_active":"2024-04-26T10:45:56.160344+0000","last_became_peered":"2024-04-26T10:45:56.160344+0000","last_unstale":"2024-04-26T10:45:57.158373+0000","last_undegraded":"2024-04-26T10:45:57.158373+0000","last_fullsized":"2024-04-26T10:45:57.158373+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:50.232753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'418","reported_seq":929,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159365+0000","last_change":"2024-04-26T10:45:55.179671+0000","last_active":"2024-04-26T10:45:57.159365+0000","last_peered":"2024-04-26T10:45:57.159365+0000","last_clean":"2024-04-26T10:45:57.159365+0000","last_became_active":"2024-04-26T10:45:55.178079+0000","last_became_peered":"2024-04-26T10:45:55.178079+0000","last_unstale":"2024-04-26T10:45:57.159365+0000","last_undegraded":"2024-04-26T10:45:57.159365+0000","last_fullsized":"2024-04-26T10:45:57.159365+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:36.749926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":34476,"num_write":379,"num_write_kb":101645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"62'494","reported_seq":575,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159163+0000","last_change":"2024-04-26T10:42:25.688221+0000","last_active":"2024-04-26T10:45:57.159163+0000","last_peered":"2024-04-26T10:45:57.159163+0000","last_clean":"2024-04-26T10:45:57.159163+0000","last_became_active":"2024-04-26T10:42:25.687829+0000","last_became_peered":"2024-04-26T10:42:25.687829+0000","last_unstale":"2024-04-26T10:45:57.159163+0000","last_undegraded":"2024-04-26T10:45:57.159163+0000","last_fullsized":"2024-04-26T10:45:57.159163+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:05.939715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":12543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"63'406","reported_seq":586,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159122+0000","last_change":"2024-04-26T10:45:54.192178+0000","last_active":"2024-04-26T10:45:57.159122+0000","last_peered":"2024-04-26T10:45:57.159122+0000","last_clean":"2024-04-26T10:45:57.159122+0000","last_became_active":"2024-04-26T10:45:54.189591+0000","last_became_peered":"2024-04-26T10:45:54.189591+0000","last_unstale":"2024-04-26T10:45:57.159122+0000","last_undegraded":"2024-04-26T10:45:57.159122+0000","last_fullsized":"2024-04-26T10:45:57.159122+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:31.509288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":45941,"num_write":372,"num_write_kb":80011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"62'61","reported_seq":160,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160386+0000","last_change":"2024-04-26T10:45:45.895125+0000","last_active":"2024-04-26T10:45:57.160386+0000","last_peered":"2024-04-26T10:45:57.160386+0000","last_clean":"2024-04-26T10:45:57.160386+0000","last_became_active":"2024-04-26T10:45:45.874300+0000","last_became_peered":"2024-04-26T10:45:45.874300+0000","last_unstale":"2024-04-26T10:45:57.160386+0000","last_undegraded":"2024-04-26T10:45:57.160386+0000","last_fullsized":"2024-04-26T10:45:57.160386+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:26.528893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"63'375","reported_seq":823,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161710+0000","last_change":"2024-04-26T10:45:56.163670+0000","last_active":"2024-04-26T10:45:57.161710+0000","last_peered":"2024-04-26T10:45:57.161710+0000","last_clean":"2024-04-26T10:45:57.161710+0000","last_became_active":"2024-04-26T10:45:56.160416+0000","last_became_peered":"2024-04-26T10:45:56.160416+0000","last_unstale":"2024-04-26T10:45:57.161710+0000","last_undegraded":"2024-04-26T10:45:57.161710+0000","last_fullsized":"2024-04-26T10:45:57.161710+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:43.147179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16213,"num_write":354,"num_write_kb":54493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":332,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"62'276","reported_seq":368,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160846+0000","last_change":"2024-04-26T10:45:56.160817+0000","last_active":"2024-04-26T10:45:57.160846+0000","last_peered":"2024-04-26T10:45:57.160846+0000","last_clean":"2024-04-26T10:45:57.160846+0000","last_became_active":"2024-04-26T10:45:56.160414+0000","last_became_peered":"2024-04-26T10:45:56.160414+0000","last_unstale":"2024-04-26T10:45:57.160846+0000","last_undegraded":"2024-04-26T10:45:57.160846+0000","last_fullsized":"2024-04-26T10:45:57.160846+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:40.374381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"63'379","reported_seq":475,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161030+0000","last_change":"2024-04-26T10:45:53.177365+0000","last_active":"2024-04-26T10:45:57.161030+0000","last_peered":"2024-04-26T10:45:57.161030+0000","last_clean":"2024-04-26T10:45:57.161030+0000","last_became_active":"2024-04-26T10:45:53.173645+0000","last_became_peered":"2024-04-26T10:45:53.173645+0000","last_unstale":"2024-04-26T10:45:57.161030+0000","last_undegraded":"2024-04-26T10:45:57.161030+0000","last_fullsized":"2024-04-26T10:45:57.161030+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:32.390075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20480,"num_write":343,"num_write_kb":25788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"62'237","reported_seq":347,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159471+0000","last_change":"2024-04-26T10:45:48.867081+0000","last_active":"2024-04-26T10:45:57.159471+0000","last_peered":"2024-04-26T10:45:57.159471+0000","last_clean":"2024-04-26T10:45:57.159471+0000","last_became_active":"2024-04-26T10:45:48.866716+0000","last_became_peered":"2024-04-26T10:45:48.866716+0000","last_unstale":"2024-04-26T10:45:57.159471+0000","last_undegraded":"2024-04-26T10:45:57.159471+0000","last_fullsized":"2024-04-26T10:45:57.159471+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:16.712392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":12393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"63'419","reported_seq":570,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158951+0000","last_change":"2024-04-26T10:42:26.041729+0000","last_active":"2024-04-26T10:45:57.158951+0000","last_peered":"2024-04-26T10:45:57.158951+0000","last_clean":"2024-04-26T10:45:57.158951+0000","last_became_active":"2024-04-26T10:42:26.040504+0000","last_became_peered":"2024-04-26T10:42:26.040504+0000","last_unstale":"2024-04-26T10:45:57.158951+0000","last_undegraded":"2024-04-26T10:45:57.158951+0000","last_fullsized":"2024-04-26T10:45:57.158951+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39582,"num_write":378,"num_write_kb":54867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"62'61","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159083+0000","last_change":"2024-04-26T10:45:53.227750+0000","last_active":"2024-04-26T10:45:57.159083+0000","last_peered":"2024-04-26T10:45:57.159083+0000","last_clean":"2024-04-26T10:45:57.159083+0000","last_became_active":"2024-04-26T10:45:53.178804+0000","last_became_peered":"2024-04-26T10:45:53.178804+0000","last_unstale":"2024-04-26T10:45:57.159083+0000","last_undegraded":"2024-04-26T10:45:57.159083+0000","last_fullsized":"2024-04-26T10:45:57.159083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:56.795614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'437","reported_seq":523,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162221+0000","last_change":"2024-04-26T10:45:53.181155+0000","last_active":"2024-04-26T10:45:57.162221+0000","last_peered":"2024-04-26T10:45:57.162221+0000","last_clean":"2024-04-26T10:45:57.162221+0000","last_became_active":"2024-04-26T10:45:53.177071+0000","last_became_peered":"2024-04-26T10:45:53.177071+0000","last_unstale":"2024-04-26T10:45:57.162221+0000","last_undegraded":"2024-04-26T10:45:57.162221+0000","last_fullsized":"2024-04-26T10:45:57.162221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:34.219319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":7562,"num_write":400,"num_write_kb":26121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"62'58","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158941+0000","last_change":"2024-04-26T10:45:53.197669+0000","last_active":"2024-04-26T10:45:57.158941+0000","last_peered":"2024-04-26T10:45:57.158941+0000","last_clean":"2024-04-26T10:45:57.158941+0000","last_became_active":"2024-04-26T10:45:53.173542+0000","last_became_peered":"2024-04-26T10:45:53.173542+0000","last_unstale":"2024-04-26T10:45:57.158941+0000","last_undegraded":"2024-04-26T10:45:57.158941+0000","last_fullsized":"2024-04-26T10:45:57.158941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:34.409430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2672,"num_read_kb":1454712,"num_write":24538,"num_write_kb":4190103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26671,"ondisk_log_size":26671,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128811551,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":5770,"num_write_kb":129888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257691648,"data_stored":257623102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},"log_size":7595,"ondisk_log_size":7595,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738416,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":183416,"kb_used_data":80164,"kb_used_omap":1,"kb_used_meta":103230,"kb_avail":94188424,"statfs":{"total":96636764160,"available":96448946176,"internally_reserved":0,"allocated":82087936,"data_stored":81566103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105707974},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:45:25 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.20300000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42599999999999999,"15min":0.436},"min":{"1min":0.26000000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.22900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]}]},{"osd":1,"up_from":70,"seq":300647710725,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136028,"kb_used_data":90440,"kb_used_omap":7,"kb_used_meta":45560,"kb_avail":94235812,"statfs":{"total":96636764160,"available":96497471488,"internally_reserved":0,"allocated":92610560,"data_stored":92059263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7181,"internal_metadata":46654451},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738417,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214380,"kb_used_data":84896,"kb_used_omap":1,"kb_used_meta":129470,"kb_avail":94157460,"statfs":{"total":96636764160,"available":96417239040,"internally_reserved":0,"allocated":86933504,"data_stored":86396712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132577734},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Fri Apr 26 10:45:26 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.43099999999999999,"15min":0.44900000000000001},"min":{"1min":0.21199999999999999,"5min":0.183,"15min":0.183},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.442,"15min":0.46500000000000002},"min":{"1min":0.23499999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57199999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.65700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":85422080,"data_stored":85400264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":91099136,"data_stored":91062815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81170432,"data_stored":81160023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:46:04.492 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:46:04.824 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:46:04.826 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:46:04.835 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-04-26T10:46:03.650828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129401919,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2852,"num_read_kb":1456290,"num_write":30511,"num_write_kb":4323451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9253,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34423,"ondisk_log_size":34423,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":222,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":533824,"kb_used_data":255500,"kb_used_omap":10,"kb_used_meta":278261,"kb_avail":282581696,"statfs":{"total":289910292480,"available":289363656704,"internally_reserved":0,"allocated":261632000,"data_stored":260022078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10369,"internal_metadata":284940159},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-494,"num_objects_misplaced":-354,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1332,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.494930"},"pg_stats":[{"pgid":"4.3f","version":"63'415","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160204+0000","last_change":"2024-04-26T10:42:26.045527+0000","last_active":"2024-04-26T10:45:57.160204+0000","last_peered":"2024-04-26T10:45:57.160204+0000","last_clean":"2024-04-26T10:45:57.160204+0000","last_became_active":"2024-04-26T10:42:26.044597+0000","last_became_peered":"2024-04-26T10:42:26.044597+0000","last_unstale":"2024-04-26T10:45:57.160204+0000","last_undegraded":"2024-04-26T10:45:57.160204+0000","last_fullsized":"2024-04-26T10:45:57.160204+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22963,"num_write":385,"num_write_kb":71406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"63'396","reported_seq":521,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159219+0000","last_change":"2024-04-26T10:45:54.194523+0000","last_active":"2024-04-26T10:45:57.159219+0000","last_peered":"2024-04-26T10:45:57.159219+0000","last_clean":"2024-04-26T10:45:57.159219+0000","last_became_active":"2024-04-26T10:45:54.192613+0000","last_became_peered":"2024-04-26T10:45:54.192613+0000","last_unstale":"2024-04-26T10:45:57.159219+0000","last_undegraded":"2024-04-26T10:45:57.159219+0000","last_fullsized":"2024-04-26T10:45:57.159219+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:22.723004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9499,"num_write":371,"num_write_kb":38601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"63'366","reported_seq":449,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161698+0000","last_change":"2024-04-26T10:45:55.183758+0000","last_active":"2024-04-26T10:45:57.161698+0000","last_peered":"2024-04-26T10:45:57.161698+0000","last_clean":"2024-04-26T10:45:57.161698+0000","last_became_active":"2024-04-26T10:45:55.180991+0000","last_became_peered":"2024-04-26T10:45:55.180991+0000","last_unstale":"2024-04-26T10:45:57.161698+0000","last_undegraded":"2024-04-26T10:45:57.161698+0000","last_fullsized":"2024-04-26T10:45:57.161698+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:29.645448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6211,"num_write":338,"num_write_kb":38844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"63'394","reported_seq":545,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160935+0000","last_change":"2024-04-26T10:45:51.162341+0000","last_active":"2024-04-26T10:45:57.160935+0000","last_peered":"2024-04-26T10:45:57.160935+0000","last_clean":"2024-04-26T10:45:57.160935+0000","last_became_active":"2024-04-26T10:45:51.159099+0000","last_became_peered":"2024-04-26T10:45:51.159099+0000","last_unstale":"2024-04-26T10:45:57.160935+0000","last_undegraded":"2024-04-26T10:45:57.160935+0000","last_fullsized":"2024-04-26T10:45:57.160935+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:18.605866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":52323,"num_write":357,"num_write_kb":63323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"63'409","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160398+0000","last_change":"2024-04-26T10:42:26.041191+0000","last_active":"2024-04-26T10:45:57.160398+0000","last_peered":"2024-04-26T10:45:57.160398+0000","last_clean":"2024-04-26T10:45:57.160398+0000","last_became_active":"2024-04-26T10:42:26.040487+0000","last_became_peered":"2024-04-26T10:42:26.040487+0000","last_unstale":"2024-04-26T10:45:57.160398+0000","last_undegraded":"2024-04-26T10:45:57.160398+0000","last_fullsized":"2024-04-26T10:45:57.160398+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":372,"num_write_kb":42764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'385","reported_seq":464,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161234+0000","last_change":"2024-04-26T10:45:49.864662+0000","last_active":"2024-04-26T10:45:57.161234+0000","last_peered":"2024-04-26T10:45:57.161234+0000","last_clean":"2024-04-26T10:45:57.161234+0000","last_became_active":"2024-04-26T10:45:49.861811+0000","last_became_peered":"2024-04-26T10:45:49.861811+0000","last_unstale":"2024-04-26T10:45:57.161234+0000","last_undegraded":"2024-04-26T10:45:57.161234+0000","last_fullsized":"2024-04-26T10:45:57.161234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:25.549464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4124,"num_write":356,"num_write_kb":69857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"63'425","reported_seq":534,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160809+0000","last_change":"2024-04-26T10:45:50.869572+0000","last_active":"2024-04-26T10:45:57.160809+0000","last_peered":"2024-04-26T10:45:57.160809+0000","last_clean":"2024-04-26T10:45:57.160809+0000","last_became_active":"2024-04-26T10:45:50.866996+0000","last_became_peered":"2024-04-26T10:45:50.866996+0000","last_unstale":"2024-04-26T10:45:57.160809+0000","last_undegraded":"2024-04-26T10:45:57.160809+0000","last_fullsized":"2024-04-26T10:45:57.160809+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:17.631869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13036,"num_write":390,"num_write_kb":67193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"63'399","reported_seq":507,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.164304+0000","last_change":"2024-04-26T10:45:58.164304+0000","last_active":"2024-04-26T10:45:58.164304+0000","last_peered":"2024-04-26T10:45:58.164304+0000","last_clean":"2024-04-26T10:45:58.164304+0000","last_became_active":"2024-04-26T10:45:58.162532+0000","last_became_peered":"2024-04-26T10:45:58.162532+0000","last_unstale":"2024-04-26T10:45:58.164304+0000","last_undegraded":"2024-04-26T10:45:58.164304+0000","last_fullsized":"2024-04-26T10:45:58.164304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:50.164416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25678,"num_write":356,"num_write_kb":116549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"63'442","reported_seq":589,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159518+0000","last_change":"2024-04-26T10:42:26.045893+0000","last_active":"2024-04-26T10:45:57.159518+0000","last_peered":"2024-04-26T10:45:57.159518+0000","last_clean":"2024-04-26T10:45:57.159518+0000","last_became_active":"2024-04-26T10:42:26.045177+0000","last_became_peered":"2024-04-26T10:42:26.045177+0000","last_unstale":"2024-04-26T10:45:57.159518+0000","last_undegraded":"2024-04-26T10:45:57.159518+0000","last_fullsized":"2024-04-26T10:45:57.159518+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35111,"num_write":413,"num_write_kb":60306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'393","reported_seq":515,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159399+0000","last_change":"2024-04-26T10:45:54.192984+0000","last_active":"2024-04-26T10:45:57.159399+0000","last_peered":"2024-04-26T10:45:57.159399+0000","last_clean":"2024-04-26T10:45:57.159399+0000","last_became_active":"2024-04-26T10:45:54.191514+0000","last_became_peered":"2024-04-26T10:45:54.191514+0000","last_unstale":"2024-04-26T10:45:57.159399+0000","last_undegraded":"2024-04-26T10:45:57.159399+0000","last_fullsized":"2024-04-26T10:45:57.159399+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:33.809143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5355,"num_write":351,"num_write_kb":38901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"63'377","reported_seq":482,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161319+0000","last_change":"2024-04-26T10:45:49.865172+0000","last_active":"2024-04-26T10:45:57.161319+0000","last_peered":"2024-04-26T10:45:57.161319+0000","last_clean":"2024-04-26T10:45:57.161319+0000","last_became_active":"2024-04-26T10:45:49.862718+0000","last_became_peered":"2024-04-26T10:45:49.862718+0000","last_unstale":"2024-04-26T10:45:57.161319+0000","last_undegraded":"2024-04-26T10:45:57.161319+0000","last_fullsized":"2024-04-26T10:45:57.161319+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:43.129958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18030,"num_write":355,"num_write_kb":67044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"63'365","reported_seq":808,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.167133+0000","last_change":"2024-04-26T10:45:57.166219+0000","last_active":"2024-04-26T10:45:57.167133+0000","last_peered":"2024-04-26T10:45:57.167133+0000","last_clean":"2024-04-26T10:45:57.167133+0000","last_became_active":"2024-04-26T10:45:57.164964+0000","last_became_peered":"2024-04-26T10:45:57.164964+0000","last_unstale":"2024-04-26T10:45:57.167133+0000","last_undegraded":"2024-04-26T10:45:57.167133+0000","last_fullsized":"2024-04-26T10:45:57.167133+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:55.064831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14866,"num_write":337,"num_write_kb":71188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'397","reported_seq":490,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160289+0000","last_change":"2024-04-26T10:42:26.042607+0000","last_active":"2024-04-26T10:45:57.160289+0000","last_peered":"2024-04-26T10:45:57.160289+0000","last_clean":"2024-04-26T10:45:57.160289+0000","last_became_active":"2024-04-26T10:42:26.041617+0000","last_became_peered":"2024-04-26T10:42:26.041617+0000","last_unstale":"2024-04-26T10:45:57.160289+0000","last_undegraded":"2024-04-26T10:45:57.160289+0000","last_fullsized":"2024-04-26T10:45:57.160289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8192,"num_write":362,"num_write_kb":54822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"63'408","reported_seq":487,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161186+0000","last_change":"2024-04-26T10:45:53.181618+0000","last_active":"2024-04-26T10:45:57.161186+0000","last_peered":"2024-04-26T10:45:57.161186+0000","last_clean":"2024-04-26T10:45:57.161186+0000","last_became_active":"2024-04-26T10:45:53.177677+0000","last_became_peered":"2024-04-26T10:45:53.177677+0000","last_unstale":"2024-04-26T10:45:57.161186+0000","last_undegraded":"2024-04-26T10:45:57.161186+0000","last_fullsized":"2024-04-26T10:45:57.161186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:06.719053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4688,"num_write":374,"num_write_kb":21766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"63'409","reported_seq":522,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160533+0000","last_change":"2024-04-26T10:45:54.188625+0000","last_active":"2024-04-26T10:45:57.160533+0000","last_peered":"2024-04-26T10:45:57.160533+0000","last_clean":"2024-04-26T10:45:57.160533+0000","last_became_active":"2024-04-26T10:45:54.185826+0000","last_became_peered":"2024-04-26T10:45:54.185826+0000","last_unstale":"2024-04-26T10:45:57.160533+0000","last_undegraded":"2024-04-26T10:45:57.160533+0000","last_fullsized":"2024-04-26T10:45:57.160533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:48.401265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25968,"num_write":366,"num_write_kb":75698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"63'460","reported_seq":562,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162279+0000","last_change":"2024-04-26T10:45:53.176893+0000","last_active":"2024-04-26T10:45:57.162279+0000","last_peered":"2024-04-26T10:45:57.162279+0000","last_clean":"2024-04-26T10:45:57.162279+0000","last_became_active":"2024-04-26T10:45:53.174699+0000","last_became_peered":"2024-04-26T10:45:53.174699+0000","last_unstale":"2024-04-26T10:45:57.162279+0000","last_undegraded":"2024-04-26T10:45:57.162279+0000","last_fullsized":"2024-04-26T10:45:57.162279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:41.919177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16269,"num_write":426,"num_write_kb":67839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"63'393","reported_seq":512,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159625+0000","last_change":"2024-04-26T10:42:26.049338+0000","last_active":"2024-04-26T10:45:57.159625+0000","last_peered":"2024-04-26T10:45:57.159625+0000","last_clean":"2024-04-26T10:45:57.159625+0000","last_became_active":"2024-04-26T10:42:26.049014+0000","last_became_peered":"2024-04-26T10:42:26.049014+0000","last_unstale":"2024-04-26T10:45:57.159625+0000","last_undegraded":"2024-04-26T10:45:57.159625+0000","last_fullsized":"2024-04-26T10:45:57.159625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":25712,"num_write":362,"num_write_kb":42020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'428","reported_seq":554,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159673+0000","last_change":"2024-04-26T10:45:54.192786+0000","last_active":"2024-04-26T10:45:57.159673+0000","last_peered":"2024-04-26T10:45:57.159673+0000","last_clean":"2024-04-26T10:45:57.159673+0000","last_became_active":"2024-04-26T10:45:54.189852+0000","last_became_peered":"2024-04-26T10:45:54.189852+0000","last_unstale":"2024-04-26T10:45:57.159673+0000","last_undegraded":"2024-04-26T10:45:57.159673+0000","last_fullsized":"2024-04-26T10:45:57.159673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:29.968564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12316,"num_write":384,"num_write_kb":87656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"63'446","reported_seq":587,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158810+0000","last_change":"2024-04-26T10:45:54.186962+0000","last_active":"2024-04-26T10:45:57.158810+0000","last_peered":"2024-04-26T10:45:57.158810+0000","last_clean":"2024-04-26T10:45:57.158810+0000","last_became_active":"2024-04-26T10:45:54.184063+0000","last_became_peered":"2024-04-26T10:45:54.184063+0000","last_unstale":"2024-04-26T10:45:57.158810+0000","last_undegraded":"2024-04-26T10:45:57.158810+0000","last_fullsized":"2024-04-26T10:45:57.158810+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:59.349649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":53414,"num_write":401,"num_write_kb":80048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":550,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161291+0000","last_change":"2024-04-26T10:45:50.869971+0000","last_active":"2024-04-26T10:45:57.161291+0000","last_peered":"2024-04-26T10:45:57.161291+0000","last_clean":"2024-04-26T10:45:57.161291+0000","last_became_active":"2024-04-26T10:45:50.867680+0000","last_became_peered":"2024-04-26T10:45:50.867680+0000","last_unstale":"2024-04-26T10:45:57.161291+0000","last_undegraded":"2024-04-26T10:45:57.161291+0000","last_fullsized":"2024-04-26T10:45:57.161291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:17.680371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19859,"num_write":405,"num_write_kb":51119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"63'408","reported_seq":862,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161853+0000","last_change":"2024-04-26T10:45:56.163683+0000","last_active":"2024-04-26T10:45:57.161853+0000","last_peered":"2024-04-26T10:45:57.161853+0000","last_clean":"2024-04-26T10:45:57.161853+0000","last_became_active":"2024-04-26T10:45:56.160360+0000","last_became_peered":"2024-04-26T10:45:56.160360+0000","last_unstale":"2024-04-26T10:45:57.161853+0000","last_undegraded":"2024-04-26T10:45:57.161853+0000","last_fullsized":"2024-04-26T10:45:57.161853+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:44.845909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":15372,"num_write":366,"num_write_kb":75855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"63'452","reported_seq":1017,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158921+0000","last_change":"2024-04-26T10:45:52.175372+0000","last_active":"2024-04-26T10:45:57.158921+0000","last_peered":"2024-04-26T10:45:57.158921+0000","last_clean":"2024-04-26T10:45:57.158921+0000","last_became_active":"2024-04-26T10:45:52.173702+0000","last_became_peered":"2024-04-26T10:45:52.173702+0000","last_unstale":"2024-04-26T10:45:57.158921+0000","last_undegraded":"2024-04-26T10:45:57.158921+0000","last_fullsized":"2024-04-26T10:45:57.158921+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:55.459452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43729,"num_write":421,"num_write_kb":79804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"63'408","reported_seq":882,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.163833+0000","last_change":"2024-04-26T10:45:57.163475+0000","last_active":"2024-04-26T10:45:57.163833+0000","last_peered":"2024-04-26T10:45:57.163833+0000","last_clean":"2024-04-26T10:45:57.163833+0000","last_became_active":"2024-04-26T10:45:57.162147+0000","last_became_peered":"2024-04-26T10:45:57.162147+0000","last_unstale":"2024-04-26T10:45:57.163833+0000","last_undegraded":"2024-04-26T10:45:57.163833+0000","last_fullsized":"2024-04-26T10:45:57.163833+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:18.287163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":30320,"num_write":372,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'453","reported_seq":615,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158621+0000","last_change":"2024-04-26T10:45:54.184330+0000","last_active":"2024-04-26T10:45:57.158621+0000","last_peered":"2024-04-26T10:45:57.158621+0000","last_clean":"2024-04-26T10:45:57.158621+0000","last_became_active":"2024-04-26T10:45:54.181881+0000","last_became_peered":"2024-04-26T10:45:54.181881+0000","last_unstale":"2024-04-26T10:45:57.158621+0000","last_undegraded":"2024-04-26T10:45:57.158621+0000","last_fullsized":"2024-04-26T10:45:57.158621+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:02.066091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":19864,"num_write":422,"num_write_kb":51638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"63'439","reported_seq":954,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160299+0000","last_change":"2024-04-26T10:45:48.867766+0000","last_active":"2024-04-26T10:45:57.160299+0000","last_peered":"2024-04-26T10:45:57.160299+0000","last_clean":"2024-04-26T10:45:57.160299+0000","last_became_active":"2024-04-26T10:45:48.866159+0000","last_became_peered":"2024-04-26T10:45:48.866159+0000","last_unstale":"2024-04-26T10:45:57.160299+0000","last_undegraded":"2024-04-26T10:45:57.160299+0000","last_fullsized":"2024-04-26T10:45:57.160299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:39.736649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8912,"num_write":417,"num_write_kb":46575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"63'513","reported_seq":1158,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158983+0000","last_change":"2024-04-26T10:45:51.160003+0000","last_active":"2024-04-26T10:45:57.158983+0000","last_peered":"2024-04-26T10:45:57.158983+0000","last_clean":"2024-04-26T10:45:57.158983+0000","last_became_active":"2024-04-26T10:45:51.158698+0000","last_became_peered":"2024-04-26T10:45:51.158698+0000","last_unstale":"2024-04-26T10:45:57.158983+0000","last_undegraded":"2024-04-26T10:45:57.158983+0000","last_fullsized":"2024-04-26T10:45:57.158983+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:36.990095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":70751,"num_write":473,"num_write_kb":88902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'406","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161212+0000","last_change":"2024-04-26T10:45:56.164805+0000","last_active":"2024-04-26T10:45:57.161212+0000","last_peered":"2024-04-26T10:45:57.161212+0000","last_clean":"2024-04-26T10:45:57.161212+0000","last_became_active":"2024-04-26T10:45:56.162419+0000","last_became_peered":"2024-04-26T10:45:56.162419+0000","last_unstale":"2024-04-26T10:45:57.161212+0000","last_undegraded":"2024-04-26T10:45:57.161212+0000","last_fullsized":"2024-04-26T10:45:57.161212+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:53.474847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":32121,"num_write":372,"num_write_kb":60163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"63'402","reported_seq":867,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.167147+0000","last_change":"2024-04-26T10:45:57.166225+0000","last_active":"2024-04-26T10:45:57.167147+0000","last_peered":"2024-04-26T10:45:57.167147+0000","last_clean":"2024-04-26T10:45:57.167147+0000","last_became_active":"2024-04-26T10:45:57.165064+0000","last_became_peered":"2024-04-26T10:45:57.165064+0000","last_unstale":"2024-04-26T10:45:57.167147+0000","last_undegraded":"2024-04-26T10:45:57.167147+0000","last_fullsized":"2024-04-26T10:45:57.167147+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:52.273357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":6824,"num_write":378,"num_write_kb":72156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"63'407","reported_seq":888,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.166516+0000","last_change":"2024-04-26T10:45:58.163989+0000","last_active":"2024-04-26T10:45:58.166516+0000","last_peered":"2024-04-26T10:45:58.166516+0000","last_clean":"2024-04-26T10:45:58.166516+0000","last_became_active":"2024-04-26T10:45:58.161850+0000","last_became_peered":"2024-04-26T10:45:58.161850+0000","last_unstale":"2024-04-26T10:45:58.166516+0000","last_undegraded":"2024-04-26T10:45:58.166516+0000","last_fullsized":"2024-04-26T10:45:58.166516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:17:09.805958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25898,"num_write":372,"num_write_kb":59274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":346,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'490","reported_seq":1058,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159063+0000","last_change":"2024-04-26T10:45:55.179785+0000","last_active":"2024-04-26T10:45:57.159063+0000","last_peered":"2024-04-26T10:45:57.159063+0000","last_clean":"2024-04-26T10:45:57.159063+0000","last_became_active":"2024-04-26T10:45:55.178083+0000","last_became_peered":"2024-04-26T10:45:55.178083+0000","last_unstale":"2024-04-26T10:45:57.159063+0000","last_undegraded":"2024-04-26T10:45:57.159063+0000","last_fullsized":"2024-04-26T10:45:57.159063+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:23.269957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33597,"num_write":449,"num_write_kb":87981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"63'474","reported_seq":563,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158167+0000","last_change":"2024-04-26T10:45:54.189228+0000","last_active":"2024-04-26T10:45:57.158167+0000","last_peered":"2024-04-26T10:45:57.158167+0000","last_clean":"2024-04-26T10:45:57.158167+0000","last_became_active":"2024-04-26T10:45:54.186011+0000","last_became_peered":"2024-04-26T10:45:54.186011+0000","last_unstale":"2024-04-26T10:45:57.158167+0000","last_undegraded":"2024-04-26T10:45:57.158167+0000","last_fullsized":"2024-04-26T10:45:57.158167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.355145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30886,"num_write":441,"num_write_kb":118807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'443","reported_seq":547,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162005+0000","last_change":"2024-04-26T10:45:48.864423+0000","last_active":"2024-04-26T10:45:57.162005+0000","last_peered":"2024-04-26T10:45:57.162005+0000","last_clean":"2024-04-26T10:45:57.162005+0000","last_became_active":"2024-04-26T10:45:48.861918+0000","last_became_peered":"2024-04-26T10:45:48.861918+0000","last_unstale":"2024-04-26T10:45:57.162005+0000","last_undegraded":"2024-04-26T10:45:57.162005+0000","last_fullsized":"2024-04-26T10:45:57.162005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:11.356135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20556,"num_write":413,"num_write_kb":91647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"63'376","reported_seq":478,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159241+0000","last_change":"2024-04-26T10:42:26.041757+0000","last_active":"2024-04-26T10:45:57.159241+0000","last_peered":"2024-04-26T10:45:57.159241+0000","last_clean":"2024-04-26T10:45:57.159241+0000","last_became_active":"2024-04-26T10:42:26.040920+0000","last_became_peered":"2024-04-26T10:42:26.040920+0000","last_unstale":"2024-04-26T10:45:57.159241+0000","last_undegraded":"2024-04-26T10:45:57.159241+0000","last_fullsized":"2024-04-26T10:45:57.159241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10124,"num_write":344,"num_write_kb":66899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"62'453","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161061+0000","last_change":"2024-04-26T10:45:48.862782+0000","last_active":"2024-04-26T10:45:57.161061+0000","last_peered":"2024-04-26T10:45:57.161061+0000","last_clean":"2024-04-26T10:45:57.161061+0000","last_became_active":"2024-04-26T10:45:48.862424+0000","last_became_peered":"2024-04-26T10:45:48.862424+0000","last_unstale":"2024-04-26T10:45:57.161061+0000","last_undegraded":"2024-04-26T10:45:57.161061+0000","last_fullsized":"2024-04-26T10:45:57.161061+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:16.548893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"63'403","reported_seq":520,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159394+0000","last_change":"2024-04-26T10:42:26.041850+0000","last_active":"2024-04-26T10:45:57.159394+0000","last_peered":"2024-04-26T10:45:57.159394+0000","last_clean":"2024-04-26T10:45:57.159394+0000","last_became_active":"2024-04-26T10:42:26.040464+0000","last_became_peered":"2024-04-26T10:42:26.040464+0000","last_unstale":"2024-04-26T10:45:57.159394+0000","last_undegraded":"2024-04-26T10:45:57.159394+0000","last_fullsized":"2024-04-26T10:45:57.159394+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24588,"num_write":363,"num_write_kb":51190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"62'49","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158264+0000","last_change":"2024-04-26T10:45:45.862317+0000","last_active":"2024-04-26T10:45:57.158264+0000","last_peered":"2024-04-26T10:45:57.158264+0000","last_clean":"2024-04-26T10:45:57.158264+0000","last_became_active":"2024-04-26T10:45:45.862029+0000","last_became_peered":"2024-04-26T10:45:45.862029+0000","last_unstale":"2024-04-26T10:45:57.158264+0000","last_undegraded":"2024-04-26T10:45:57.158264+0000","last_fullsized":"2024-04-26T10:45:57.158264+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:02.521534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'407","reported_seq":887,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159309+0000","last_change":"2024-04-26T10:45:52.170710+0000","last_active":"2024-04-26T10:45:57.159309+0000","last_peered":"2024-04-26T10:45:57.159309+0000","last_clean":"2024-04-26T10:45:57.159309+0000","last_became_active":"2024-04-26T10:45:52.169295+0000","last_became_peered":"2024-04-26T10:45:52.169295+0000","last_unstale":"2024-04-26T10:45:57.159309+0000","last_undegraded":"2024-04-26T10:45:57.159309+0000","last_fullsized":"2024-04-26T10:45:57.159309+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:10.995530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":7077,"num_write":367,"num_write_kb":42434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"62'66","reported_seq":160,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159731+0000","last_change":"2024-04-26T10:45:45.874440+0000","last_active":"2024-04-26T10:45:57.159731+0000","last_peered":"2024-04-26T10:45:57.159731+0000","last_clean":"2024-04-26T10:45:57.159731+0000","last_became_active":"2024-04-26T10:45:45.874030+0000","last_became_peered":"2024-04-26T10:45:45.874030+0000","last_unstale":"2024-04-26T10:45:57.159731+0000","last_undegraded":"2024-04-26T10:45:57.159731+0000","last_fullsized":"2024-04-26T10:45:57.159731+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:22.711644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"63'406","reported_seq":898,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159545+0000","last_change":"2024-04-26T10:45:49.863376+0000","last_active":"2024-04-26T10:45:57.159545+0000","last_peered":"2024-04-26T10:45:57.159545+0000","last_clean":"2024-04-26T10:45:57.159545+0000","last_became_active":"2024-04-26T10:45:49.861979+0000","last_became_peered":"2024-04-26T10:45:49.861979+0000","last_unstale":"2024-04-26T10:45:57.159545+0000","last_undegraded":"2024-04-26T10:45:57.159545+0000","last_fullsized":"2024-04-26T10:45:57.159545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:16.553043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":25977,"num_write":374,"num_write_kb":104172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'66","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161876+0000","last_change":"2024-04-26T10:45:45.871507+0000","last_active":"2024-04-26T10:45:57.161876+0000","last_peered":"2024-04-26T10:45:57.161876+0000","last_clean":"2024-04-26T10:45:57.161876+0000","last_became_active":"2024-04-26T10:45:45.871120+0000","last_became_peered":"2024-04-26T10:45:45.871120+0000","last_unstale":"2024-04-26T10:45:57.161876+0000","last_undegraded":"2024-04-26T10:45:57.161876+0000","last_fullsized":"2024-04-26T10:45:57.161876+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:56.162347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"62'200","reported_seq":281,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161233+0000","last_change":"2024-04-26T10:45:48.866225+0000","last_active":"2024-04-26T10:45:57.161233+0000","last_peered":"2024-04-26T10:45:57.161233+0000","last_clean":"2024-04-26T10:45:57.161233+0000","last_became_active":"2024-04-26T10:45:48.865878+0000","last_became_peered":"2024-04-26T10:45:48.865878+0000","last_unstale":"2024-04-26T10:45:57.161233+0000","last_undegraded":"2024-04-26T10:45:57.161233+0000","last_fullsized":"2024-04-26T10:45:57.161233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:42:39.518391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"63'415","reported_seq":908,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.164897+0000","last_change":"2024-04-26T10:45:57.164421+0000","last_active":"2024-04-26T10:45:57.164897+0000","last_peered":"2024-04-26T10:45:57.164897+0000","last_clean":"2024-04-26T10:45:57.164897+0000","last_became_active":"2024-04-26T10:45:57.163263+0000","last_became_peered":"2024-04-26T10:45:57.163263+0000","last_unstale":"2024-04-26T10:45:57.164897+0000","last_undegraded":"2024-04-26T10:45:57.164897+0000","last_fullsized":"2024-04-26T10:45:57.164897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:16.262869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15757,"num_write":380,"num_write_kb":54727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"62'342","reported_seq":448,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159793+0000","last_change":"2024-04-26T10:45:48.866915+0000","last_active":"2024-04-26T10:45:57.159793+0000","last_peered":"2024-04-26T10:45:57.159793+0000","last_clean":"2024-04-26T10:45:57.159793+0000","last_became_active":"2024-04-26T10:45:48.866497+0000","last_became_peered":"2024-04-26T10:45:48.866497+0000","last_unstale":"2024-04-26T10:45:57.159793+0000","last_undegraded":"2024-04-26T10:45:57.159793+0000","last_fullsized":"2024-04-26T10:45:57.159793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:04.796882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"63'481","reported_seq":670,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158706+0000","last_change":"2024-04-26T10:45:54.184646+0000","last_active":"2024-04-26T10:45:57.158706+0000","last_peered":"2024-04-26T10:45:57.158706+0000","last_clean":"2024-04-26T10:45:57.158706+0000","last_became_active":"2024-04-26T10:45:54.181993+0000","last_became_peered":"2024-04-26T10:45:54.181993+0000","last_unstale":"2024-04-26T10:45:57.158706+0000","last_undegraded":"2024-04-26T10:45:57.158706+0000","last_fullsized":"2024-04-26T10:45:57.158706+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:34.664600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":45251,"num_write":451,"num_write_kb":105365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"62'460","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160768+0000","last_change":"2024-04-26T10:45:48.865887+0000","last_active":"2024-04-26T10:45:57.160768+0000","last_peered":"2024-04-26T10:45:57.160768+0000","last_clean":"2024-04-26T10:45:57.160768+0000","last_became_active":"2024-04-26T10:45:48.865520+0000","last_became_peered":"2024-04-26T10:45:48.865520+0000","last_unstale":"2024-04-26T10:45:57.160768+0000","last_undegraded":"2024-04-26T10:45:57.160768+0000","last_fullsized":"2024-04-26T10:45:57.160768+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:34.308634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":407,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'420","reported_seq":503,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.165736+0000","last_change":"2024-04-26T10:45:57.165390+0000","last_active":"2024-04-26T10:45:57.165736+0000","last_peered":"2024-04-26T10:45:57.165736+0000","last_clean":"2024-04-26T10:45:57.165736+0000","last_became_active":"2024-04-26T10:45:57.162014+0000","last_became_peered":"2024-04-26T10:45:57.162014+0000","last_unstale":"2024-04-26T10:45:57.165736+0000","last_undegraded":"2024-04-26T10:45:57.165736+0000","last_fullsized":"2024-04-26T10:45:57.165736+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:19.491785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13025,"num_write":385,"num_write_kb":38595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"62'67","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161113+0000","last_change":"2024-04-26T10:45:45.860717+0000","last_active":"2024-04-26T10:45:57.161113+0000","last_peered":"2024-04-26T10:45:57.161113+0000","last_clean":"2024-04-26T10:45:57.161113+0000","last_became_active":"2024-04-26T10:45:45.860175+0000","last_became_peered":"2024-04-26T10:45:45.860175+0000","last_unstale":"2024-04-26T10:45:57.161113+0000","last_undegraded":"2024-04-26T10:45:57.161113+0000","last_fullsized":"2024-04-26T10:45:57.161113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:30.736518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"63'452","reported_seq":965,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.166761+0000","last_change":"2024-04-26T10:45:58.166413+0000","last_active":"2024-04-26T10:45:58.166761+0000","last_peered":"2024-04-26T10:45:58.166761+0000","last_clean":"2024-04-26T10:45:58.166761+0000","last_became_active":"2024-04-26T10:45:58.164105+0000","last_became_peered":"2024-04-26T10:45:58.164105+0000","last_unstale":"2024-04-26T10:45:58.166761+0000","last_undegraded":"2024-04-26T10:45:58.166761+0000","last_fullsized":"2024-04-26T10:45:58.166761+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:05.536110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23217,"num_write":416,"num_write_kb":71418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":388,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"62'200","reported_seq":277,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158343+0000","last_change":"2024-04-26T10:45:56.160957+0000","last_active":"2024-04-26T10:45:57.158343+0000","last_peered":"2024-04-26T10:45:57.158343+0000","last_clean":"2024-04-26T10:45:57.158343+0000","last_became_active":"2024-04-26T10:45:56.160475+0000","last_became_peered":"2024-04-26T10:45:56.160475+0000","last_unstale":"2024-04-26T10:45:57.158343+0000","last_undegraded":"2024-04-26T10:45:57.158343+0000","last_fullsized":"2024-04-26T10:45:57.158343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:48.896541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'430","reported_seq":512,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.165078+0000","last_change":"2024-04-26T10:45:57.164742+0000","last_active":"2024-04-26T10:45:57.165078+0000","last_peered":"2024-04-26T10:45:57.165078+0000","last_clean":"2024-04-26T10:45:57.165078+0000","last_became_active":"2024-04-26T10:45:57.162070+0000","last_became_peered":"2024-04-26T10:45:57.162070+0000","last_unstale":"2024-04-26T10:45:57.165078+0000","last_undegraded":"2024-04-26T10:45:57.165078+0000","last_fullsized":"2024-04-26T10:45:57.165078+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:14.872176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":24352,"num_write":392,"num_write_kb":21976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"62'233","reported_seq":306,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160855+0000","last_change":"2024-04-26T10:45:48.862856+0000","last_active":"2024-04-26T10:45:57.160855+0000","last_peered":"2024-04-26T10:45:57.160855+0000","last_clean":"2024-04-26T10:45:57.160855+0000","last_became_active":"2024-04-26T10:45:48.862517+0000","last_became_peered":"2024-04-26T10:45:48.862517+0000","last_unstale":"2024-04-26T10:45:57.160855+0000","last_undegraded":"2024-04-26T10:45:57.160855+0000","last_fullsized":"2024-04-26T10:45:57.160855+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:43.799960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"63'393","reported_seq":478,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160672+0000","last_change":"2024-04-26T10:45:55.180960+0000","last_active":"2024-04-26T10:45:57.160672+0000","last_peered":"2024-04-26T10:45:57.160672+0000","last_clean":"2024-04-26T10:45:57.160672+0000","last_became_active":"2024-04-26T10:45:55.177758+0000","last_became_peered":"2024-04-26T10:45:55.177758+0000","last_unstale":"2024-04-26T10:45:57.160672+0000","last_undegraded":"2024-04-26T10:45:57.160672+0000","last_fullsized":"2024-04-26T10:45:57.160672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:47.889251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8671,"num_write":368,"num_write_kb":38542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"62'49","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158855+0000","last_change":"2024-04-26T10:45:45.874789+0000","last_active":"2024-04-26T10:45:57.158855+0000","last_peered":"2024-04-26T10:45:57.158855+0000","last_clean":"2024-04-26T10:45:57.158855+0000","last_became_active":"2024-04-26T10:45:45.874328+0000","last_became_peered":"2024-04-26T10:45:45.874328+0000","last_unstale":"2024-04-26T10:45:57.158855+0000","last_undegraded":"2024-04-26T10:45:57.158855+0000","last_fullsized":"2024-04-26T10:45:57.158855+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:27.431661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"63'368","reported_seq":463,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162061+0000","last_change":"2024-04-26T10:45:56.165615+0000","last_active":"2024-04-26T10:45:57.162061+0000","last_peered":"2024-04-26T10:45:57.162061+0000","last_clean":"2024-04-26T10:45:57.162061+0000","last_became_active":"2024-04-26T10:45:56.163456+0000","last_became_peered":"2024-04-26T10:45:56.163456+0000","last_unstale":"2024-04-26T10:45:57.162061+0000","last_undegraded":"2024-04-26T10:45:57.162061+0000","last_fullsized":"2024-04-26T10:45:57.162061+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:14.480860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":19222,"num_write":336,"num_write_kb":58903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"62'619","reported_seq":747,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159149+0000","last_change":"2024-04-26T10:45:56.162511+0000","last_active":"2024-04-26T10:45:57.159149+0000","last_peered":"2024-04-26T10:45:57.159149+0000","last_clean":"2024-04-26T10:45:57.159149+0000","last_became_active":"2024-04-26T10:45:56.161604+0000","last_became_peered":"2024-04-26T10:45:56.161604+0000","last_unstale":"2024-04-26T10:45:57.159149+0000","last_undegraded":"2024-04-26T10:45:57.159149+0000","last_fullsized":"2024-04-26T10:45:57.159149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:39.366865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":558,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"63'383","reported_seq":822,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.165607+0000","last_change":"2024-04-26T10:45:58.165237+0000","last_active":"2024-04-26T10:45:58.165607+0000","last_peered":"2024-04-26T10:45:58.165607+0000","last_clean":"2024-04-26T10:45:58.165607+0000","last_became_active":"2024-04-26T10:45:58.162264+0000","last_became_peered":"2024-04-26T10:45:58.162264+0000","last_unstale":"2024-04-26T10:45:58.165607+0000","last_undegraded":"2024-04-26T10:45:58.165607+0000","last_fullsized":"2024-04-26T10:45:58.165607+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:12.784168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":14260,"num_write":349,"num_write_kb":50367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":229,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161708+0000","last_change":"2024-04-26T10:45:45.871511+0000","last_active":"2024-04-26T10:45:57.161708+0000","last_peered":"2024-04-26T10:45:57.161708+0000","last_clean":"2024-04-26T10:45:57.161708+0000","last_became_active":"2024-04-26T10:45:45.871155+0000","last_became_peered":"2024-04-26T10:45:45.871155+0000","last_unstale":"2024-04-26T10:45:57.161708+0000","last_undegraded":"2024-04-26T10:45:57.161708+0000","last_fullsized":"2024-04-26T10:45:57.161708+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:53.015361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160932+0000","last_change":"2024-04-26T10:45:45.861068+0000","last_active":"2024-04-26T10:45:57.160932+0000","last_peered":"2024-04-26T10:45:57.160932+0000","last_clean":"2024-04-26T10:45:57.160932+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:57.160932+0000","last_undegraded":"2024-04-26T10:45:57.160932+0000","last_fullsized":"2024-04-26T10:45:57.160932+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:16.348009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"62'743","reported_seq":824,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158521+0000","last_change":"2024-04-26T10:42:25.686765+0000","last_active":"2024-04-26T10:45:57.158521+0000","last_peered":"2024-04-26T10:45:57.158521+0000","last_clean":"2024-04-26T10:45:57.158521+0000","last_became_active":"2024-04-26T10:42:25.686009+0000","last_became_peered":"2024-04-26T10:42:25.686009+0000","last_unstale":"2024-04-26T10:45:57.158521+0000","last_undegraded":"2024-04-26T10:45:57.158521+0000","last_fullsized":"2024-04-26T10:45:57.158521+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:54.627815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'442","reported_seq":567,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160853+0000","last_change":"2024-04-26T10:45:55.181074+0000","last_active":"2024-04-26T10:45:57.160853+0000","last_peered":"2024-04-26T10:45:57.160853+0000","last_clean":"2024-04-26T10:45:57.160853+0000","last_became_active":"2024-04-26T10:45:55.177751+0000","last_became_peered":"2024-04-26T10:45:55.177751+0000","last_unstale":"2024-04-26T10:45:57.160853+0000","last_undegraded":"2024-04-26T10:45:57.160853+0000","last_fullsized":"2024-04-26T10:45:57.160853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:01.323521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":34346,"num_write":406,"num_write_kb":96298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162129+0000","last_change":"2024-04-26T10:45:45.872099+0000","last_active":"2024-04-26T10:45:57.162129+0000","last_peered":"2024-04-26T10:45:57.162129+0000","last_clean":"2024-04-26T10:45:57.162129+0000","last_became_active":"2024-04-26T10:45:45.871741+0000","last_became_peered":"2024-04-26T10:45:45.871741+0000","last_unstale":"2024-04-26T10:45:57.162129+0000","last_undegraded":"2024-04-26T10:45:57.162129+0000","last_fullsized":"2024-04-26T10:45:57.162129+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:53.226378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"63'102","reported_seq":219,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158049+0000","last_change":"2024-04-26T10:45:56.160802+0000","last_active":"2024-04-26T10:45:57.158049+0000","last_peered":"2024-04-26T10:45:57.158049+0000","last_clean":"2024-04-26T10:45:57.158049+0000","last_became_active":"2024-04-26T10:45:56.160328+0000","last_became_peered":"2024-04-26T10:45:56.160328+0000","last_unstale":"2024-04-26T10:45:57.158049+0000","last_undegraded":"2024-04-26T10:45:57.158049+0000","last_fullsized":"2024-04-26T10:45:57.158049+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:47.864335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467631,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":44,"num_write_kb":1460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2935262,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'485","reported_seq":620,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162426+0000","last_change":"2024-04-26T10:45:57.165815+0000","last_active":"2024-04-26T10:45:58.162426+0000","last_peered":"2024-04-26T10:45:58.162426+0000","last_clean":"2024-04-26T10:45:58.162426+0000","last_became_active":"2024-04-26T10:45:57.162752+0000","last_became_peered":"2024-04-26T10:45:57.162752+0000","last_unstale":"2024-04-26T10:45:58.162426+0000","last_undegraded":"2024-04-26T10:45:58.162426+0000","last_fullsized":"2024-04-26T10:45:58.162426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:10.743149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27703,"num_write":454,"num_write_kb":121509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158512+0000","last_change":"2024-04-26T10:45:53.180892+0000","last_active":"2024-04-26T10:45:57.158512+0000","last_peered":"2024-04-26T10:45:57.158512+0000","last_clean":"2024-04-26T10:45:57.158512+0000","last_became_active":"2024-04-26T10:45:53.180675+0000","last_became_peered":"2024-04-26T10:45:53.180675+0000","last_unstale":"2024-04-26T10:45:57.158512+0000","last_undegraded":"2024-04-26T10:45:57.158512+0000","last_fullsized":"2024-04-26T10:45:57.158512+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:45.758505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"62'306","reported_seq":413,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159253+0000","last_change":"2024-04-26T10:45:48.865095+0000","last_active":"2024-04-26T10:45:57.159253+0000","last_peered":"2024-04-26T10:45:57.159253+0000","last_clean":"2024-04-26T10:45:57.159253+0000","last_became_active":"2024-04-26T10:45:48.864763+0000","last_became_peered":"2024-04-26T10:45:48.864763+0000","last_unstale":"2024-04-26T10:45:57.159253+0000","last_undegraded":"2024-04-26T10:45:57.159253+0000","last_fullsized":"2024-04-26T10:45:57.159253+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:12.665388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"63'336","reported_seq":748,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.165797+0000","last_change":"2024-04-26T10:45:58.165267+0000","last_active":"2024-04-26T10:45:58.165797+0000","last_peered":"2024-04-26T10:45:58.165797+0000","last_clean":"2024-04-26T10:45:58.165797+0000","last_became_active":"2024-04-26T10:45:58.162320+0000","last_became_peered":"2024-04-26T10:45:58.162320+0000","last_unstale":"2024-04-26T10:45:58.165797+0000","last_undegraded":"2024-04-26T10:45:58.165797+0000","last_fullsized":"2024-04-26T10:45:58.165797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:40.611364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12035,"num_write":314,"num_write_kb":29928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":306,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160636+0000","last_change":"2024-04-26T10:45:45.861233+0000","last_active":"2024-04-26T10:45:57.160636+0000","last_peered":"2024-04-26T10:45:57.160636+0000","last_clean":"2024-04-26T10:45:57.160636+0000","last_became_active":"2024-04-26T10:45:45.860924+0000","last_became_peered":"2024-04-26T10:45:45.860924+0000","last_unstale":"2024-04-26T10:45:57.160636+0000","last_undegraded":"2024-04-26T10:45:57.160636+0000","last_fullsized":"2024-04-26T10:45:57.160636+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:11.746110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"62'64","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160997+0000","last_change":"2024-04-26T10:45:45.861230+0000","last_active":"2024-04-26T10:45:57.160997+0000","last_peered":"2024-04-26T10:45:57.160997+0000","last_clean":"2024-04-26T10:45:57.160997+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:57.160997+0000","last_undegraded":"2024-04-26T10:45:57.160997+0000","last_fullsized":"2024-04-26T10:45:57.160997+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:53.564033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"63'421","reported_seq":513,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158851+0000","last_change":"2024-04-26T10:45:54.188138+0000","last_active":"2024-04-26T10:45:57.158851+0000","last_peered":"2024-04-26T10:45:57.158851+0000","last_clean":"2024-04-26T10:45:57.158851+0000","last_became_active":"2024-04-26T10:45:54.185053+0000","last_became_peered":"2024-04-26T10:45:54.185053+0000","last_unstale":"2024-04-26T10:45:57.158851+0000","last_undegraded":"2024-04-26T10:45:57.158851+0000","last_fullsized":"2024-04-26T10:45:57.158851+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:55:26.158040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28557,"num_write":385,"num_write_kb":93083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"62'480","reported_seq":553,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160417+0000","last_change":"2024-04-26T10:45:48.862894+0000","last_active":"2024-04-26T10:45:57.160417+0000","last_peered":"2024-04-26T10:45:57.160417+0000","last_clean":"2024-04-26T10:45:57.160417+0000","last_became_active":"2024-04-26T10:45:48.862564+0000","last_became_peered":"2024-04-26T10:45:48.862564+0000","last_unstale":"2024-04-26T10:45:57.160417+0000","last_undegraded":"2024-04-26T10:45:57.160417+0000","last_fullsized":"2024-04-26T10:45:57.160417+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:38.835403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":84,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158830+0000","last_change":"2024-04-26T10:42:21.405754+0000","last_active":"2024-04-26T10:45:57.158830+0000","last_peered":"2024-04-26T10:45:57.158830+0000","last_clean":"2024-04-26T10:45:57.158830+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:45:57.158830+0000","last_undegraded":"2024-04-26T10:45:57.158830+0000","last_fullsized":"2024-04-26T10:45:57.158830+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:47.123256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'352","reported_seq":776,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158735+0000","last_change":"2024-04-26T10:45:53.183401+0000","last_active":"2024-04-26T10:45:57.158735+0000","last_peered":"2024-04-26T10:45:57.158735+0000","last_clean":"2024-04-26T10:45:57.158735+0000","last_became_active":"2024-04-26T10:45:53.182454+0000","last_became_peered":"2024-04-26T10:45:53.182454+0000","last_unstale":"2024-04-26T10:45:57.158735+0000","last_undegraded":"2024-04-26T10:45:57.158735+0000","last_fullsized":"2024-04-26T10:45:57.158735+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:38.569626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":1905,"num_write":313,"num_write_kb":25573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"62'59","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158485+0000","last_change":"2024-04-26T10:45:53.177446+0000","last_active":"2024-04-26T10:45:57.158485+0000","last_peered":"2024-04-26T10:45:57.158485+0000","last_clean":"2024-04-26T10:45:57.158485+0000","last_became_active":"2024-04-26T10:45:53.176996+0000","last_became_peered":"2024-04-26T10:45:53.176996+0000","last_unstale":"2024-04-26T10:45:57.158485+0000","last_undegraded":"2024-04-26T10:45:57.158485+0000","last_fullsized":"2024-04-26T10:45:57.158485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:23.679423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":88,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161096+0000","last_change":"2024-04-26T10:45:53.175046+0000","last_active":"2024-04-26T10:45:57.161096+0000","last_peered":"2024-04-26T10:45:57.161096+0000","last_clean":"2024-04-26T10:45:57.161096+0000","last_became_active":"2024-04-26T10:45:53.174781+0000","last_became_peered":"2024-04-26T10:45:53.174781+0000","last_unstale":"2024-04-26T10:45:57.161096+0000","last_undegraded":"2024-04-26T10:45:57.161096+0000","last_fullsized":"2024-04-26T10:45:57.161096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:22.742084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'408","reported_seq":907,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160325+0000","last_change":"2024-04-26T10:45:54.186637+0000","last_active":"2024-04-26T10:45:57.160325+0000","last_peered":"2024-04-26T10:45:57.160325+0000","last_clean":"2024-04-26T10:45:57.160325+0000","last_became_active":"2024-04-26T10:45:54.185238+0000","last_became_peered":"2024-04-26T10:45:54.185238+0000","last_unstale":"2024-04-26T10:45:57.160325+0000","last_undegraded":"2024-04-26T10:45:57.160325+0000","last_fullsized":"2024-04-26T10:45:57.160325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:54.735683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19939,"num_write":382,"num_write_kb":63433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"62'55","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159609+0000","last_change":"2024-04-26T10:45:53.205131+0000","last_active":"2024-04-26T10:45:57.159609+0000","last_peered":"2024-04-26T10:45:57.159609+0000","last_clean":"2024-04-26T10:45:57.159609+0000","last_became_active":"2024-04-26T10:45:53.177305+0000","last_became_peered":"2024-04-26T10:45:53.177305+0000","last_unstale":"2024-04-26T10:45:57.159609+0000","last_undegraded":"2024-04-26T10:45:57.159609+0000","last_fullsized":"2024-04-26T10:45:57.159609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:30.829530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158557+0000","last_change":"2024-04-26T10:45:53.177593+0000","last_active":"2024-04-26T10:45:57.158557+0000","last_peered":"2024-04-26T10:45:57.158557+0000","last_clean":"2024-04-26T10:45:57.158557+0000","last_became_active":"2024-04-26T10:45:53.177249+0000","last_became_peered":"2024-04-26T10:45:53.177249+0000","last_unstale":"2024-04-26T10:45:57.158557+0000","last_undegraded":"2024-04-26T10:45:57.158557+0000","last_fullsized":"2024-04-26T10:45:57.158557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:41.564852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'418","reported_seq":877,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158405+0000","last_change":"2024-04-26T10:45:56.162729+0000","last_active":"2024-04-26T10:45:57.158405+0000","last_peered":"2024-04-26T10:45:57.158405+0000","last_clean":"2024-04-26T10:45:57.158405+0000","last_became_active":"2024-04-26T10:45:56.160440+0000","last_became_peered":"2024-04-26T10:45:56.160440+0000","last_unstale":"2024-04-26T10:45:57.158405+0000","last_undegraded":"2024-04-26T10:45:57.158405+0000","last_fullsized":"2024-04-26T10:45:57.158405+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:32.155653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20110,"num_write":390,"num_write_kb":75171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"64'66","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159242+0000","last_change":"2024-04-26T10:45:53.203538+0000","last_active":"2024-04-26T10:45:57.159242+0000","last_peered":"2024-04-26T10:45:57.159242+0000","last_clean":"2024-04-26T10:45:57.159242+0000","last_became_active":"2024-04-26T10:45:53.175946+0000","last_became_peered":"2024-04-26T10:45:53.175946+0000","last_unstale":"2024-04-26T10:45:57.159242+0000","last_undegraded":"2024-04-26T10:45:57.159242+0000","last_fullsized":"2024-04-26T10:45:57.159242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:15.016761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161004+0000","last_change":"2024-04-26T10:45:45.872224+0000","last_active":"2024-04-26T10:45:57.161004+0000","last_peered":"2024-04-26T10:45:57.161004+0000","last_clean":"2024-04-26T10:45:57.161004+0000","last_became_active":"2024-04-26T10:45:45.871923+0000","last_became_peered":"2024-04-26T10:45:45.871923+0000","last_unstale":"2024-04-26T10:45:57.161004+0000","last_undegraded":"2024-04-26T10:45:57.161004+0000","last_fullsized":"2024-04-26T10:45:57.161004+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:00.334874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"63'404","reported_seq":921,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158750+0000","last_change":"2024-04-26T10:45:54.184386+0000","last_active":"2024-04-26T10:45:57.158750+0000","last_peered":"2024-04-26T10:45:57.158750+0000","last_clean":"2024-04-26T10:45:57.158750+0000","last_became_active":"2024-04-26T10:45:54.181795+0000","last_became_peered":"2024-04-26T10:45:54.181795+0000","last_unstale":"2024-04-26T10:45:57.158750+0000","last_undegraded":"2024-04-26T10:45:57.158750+0000","last_fullsized":"2024-04-26T10:45:57.158750+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:10.290362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41262,"num_write":371,"num_write_kb":75820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"63'441","reported_seq":564,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161829+0000","last_change":"2024-04-26T10:45:54.188488+0000","last_active":"2024-04-26T10:45:57.161829+0000","last_peered":"2024-04-26T10:45:57.161829+0000","last_clean":"2024-04-26T10:45:57.161829+0000","last_became_active":"2024-04-26T10:45:54.185862+0000","last_became_peered":"2024-04-26T10:45:54.185862+0000","last_unstale":"2024-04-26T10:45:57.161829+0000","last_undegraded":"2024-04-26T10:45:57.161829+0000","last_fullsized":"2024-04-26T10:45:57.161829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:07.585438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31514,"num_write":408,"num_write_kb":107129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"64'431","reported_seq":520,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161320+0000","last_change":"2024-04-26T10:45:48.865579+0000","last_active":"2024-04-26T10:45:57.161320+0000","last_peered":"2024-04-26T10:45:57.161320+0000","last_clean":"2024-04-26T10:45:57.161320+0000","last_became_active":"2024-04-26T10:45:48.865212+0000","last_became_peered":"2024-04-26T10:45:48.865212+0000","last_unstale":"2024-04-26T10:45:57.161320+0000","last_undegraded":"2024-04-26T10:45:57.161320+0000","last_fullsized":"2024-04-26T10:45:57.161320+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:53.808562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9902610,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":9913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9896193,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"63'410","reported_seq":515,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160782+0000","last_change":"2024-04-26T10:45:54.184713+0000","last_active":"2024-04-26T10:45:57.160782+0000","last_peered":"2024-04-26T10:45:57.160782+0000","last_clean":"2024-04-26T10:45:57.160782+0000","last_became_active":"2024-04-26T10:45:54.182167+0000","last_became_peered":"2024-04-26T10:45:54.182167+0000","last_unstale":"2024-04-26T10:45:57.160782+0000","last_undegraded":"2024-04-26T10:45:57.160782+0000","last_fullsized":"2024-04-26T10:45:57.160782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:41:50.625629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12734,"num_write":373,"num_write_kb":34864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"63'84","reported_seq":183,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159590+0000","last_change":"2024-04-26T10:45:45.896842+0000","last_active":"2024-04-26T10:45:57.159590+0000","last_peered":"2024-04-26T10:45:57.159590+0000","last_clean":"2024-04-26T10:45:57.159590+0000","last_became_active":"2024-04-26T10:45:45.874746+0000","last_became_peered":"2024-04-26T10:45:45.874746+0000","last_unstale":"2024-04-26T10:45:57.159590+0000","last_undegraded":"2024-04-26T10:45:57.159590+0000","last_fullsized":"2024-04-26T10:45:57.159590+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:22.649667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"62'332","reported_seq":419,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161969+0000","last_change":"2024-04-26T10:45:56.161772+0000","last_active":"2024-04-26T10:45:57.161969+0000","last_peered":"2024-04-26T10:45:57.161969+0000","last_clean":"2024-04-26T10:45:57.161969+0000","last_became_active":"2024-04-26T10:45:56.161449+0000","last_became_peered":"2024-04-26T10:45:56.161449+0000","last_unstale":"2024-04-26T10:45:57.161969+0000","last_undegraded":"2024-04-26T10:45:57.161969+0000","last_fullsized":"2024-04-26T10:45:57.161969+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:09.499829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"63'487","reported_seq":1096,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158272+0000","last_change":"2024-04-26T10:45:51.160586+0000","last_active":"2024-04-26T10:45:57.158272+0000","last_peered":"2024-04-26T10:45:57.158272+0000","last_clean":"2024-04-26T10:45:57.158272+0000","last_became_active":"2024-04-26T10:45:51.159235+0000","last_became_peered":"2024-04-26T10:45:51.159235+0000","last_unstale":"2024-04-26T10:45:57.158272+0000","last_undegraded":"2024-04-26T10:45:57.158272+0000","last_fullsized":"2024-04-26T10:45:57.158272+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:54.234867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":43316,"num_write":468,"num_write_kb":77062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"62'61","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159565+0000","last_change":"2024-04-26T10:45:53.174204+0000","last_active":"2024-04-26T10:45:57.159565+0000","last_peered":"2024-04-26T10:45:57.159565+0000","last_clean":"2024-04-26T10:45:57.159565+0000","last_became_active":"2024-04-26T10:45:53.173851+0000","last_became_peered":"2024-04-26T10:45:53.173851+0000","last_unstale":"2024-04-26T10:45:57.159565+0000","last_undegraded":"2024-04-26T10:45:57.159565+0000","last_fullsized":"2024-04-26T10:45:57.159565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:50.698470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'457","reported_seq":536,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158314+0000","last_change":"2024-04-26T10:45:54.199966+0000","last_active":"2024-04-26T10:45:57.158314+0000","last_peered":"2024-04-26T10:45:57.158314+0000","last_clean":"2024-04-26T10:45:57.158314+0000","last_became_active":"2024-04-26T10:45:54.189622+0000","last_became_peered":"2024-04-26T10:45:54.189622+0000","last_unstale":"2024-04-26T10:45:57.158314+0000","last_undegraded":"2024-04-26T10:45:57.158314+0000","last_fullsized":"2024-04-26T10:45:57.158314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:53.540098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14848,"num_write":427,"num_write_kb":71903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'377","reported_seq":838,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160362+0000","last_change":"2024-04-26T10:45:49.867665+0000","last_active":"2024-04-26T10:45:57.160362+0000","last_peered":"2024-04-26T10:45:57.160362+0000","last_clean":"2024-04-26T10:45:57.160362+0000","last_became_active":"2024-04-26T10:45:49.866707+0000","last_became_peered":"2024-04-26T10:45:49.866707+0000","last_unstale":"2024-04-26T10:45:57.160362+0000","last_undegraded":"2024-04-26T10:45:57.160362+0000","last_fullsized":"2024-04-26T10:45:57.160362+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:23.401341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26932,"num_write":349,"num_write_kb":55611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"62'562","reported_seq":643,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158775+0000","last_change":"2024-04-26T10:42:25.683890+0000","last_active":"2024-04-26T10:45:57.158775+0000","last_peered":"2024-04-26T10:45:57.158775+0000","last_clean":"2024-04-26T10:45:57.158775+0000","last_became_active":"2024-04-26T10:42:25.683467+0000","last_became_peered":"2024-04-26T10:42:25.683467+0000","last_unstale":"2024-04-26T10:45:57.158775+0000","last_undegraded":"2024-04-26T10:45:57.158775+0000","last_fullsized":"2024-04-26T10:45:57.158775+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":8440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'425","reported_seq":878,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159122+0000","last_change":"2024-04-26T10:45:56.163245+0000","last_active":"2024-04-26T10:45:57.159122+0000","last_peered":"2024-04-26T10:45:57.159122+0000","last_clean":"2024-04-26T10:45:57.159122+0000","last_became_active":"2024-04-26T10:45:56.161315+0000","last_became_peered":"2024-04-26T10:45:56.161315+0000","last_unstale":"2024-04-26T10:45:57.159122+0000","last_undegraded":"2024-04-26T10:45:57.159122+0000","last_fullsized":"2024-04-26T10:45:57.159122+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:29.938631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":19004,"num_write":390,"num_write_kb":75524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"62'259","reported_seq":331,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158373+0000","last_change":"2024-04-26T10:45:56.160840+0000","last_active":"2024-04-26T10:45:57.158373+0000","last_peered":"2024-04-26T10:45:57.158373+0000","last_clean":"2024-04-26T10:45:57.158373+0000","last_became_active":"2024-04-26T10:45:56.160344+0000","last_became_peered":"2024-04-26T10:45:56.160344+0000","last_unstale":"2024-04-26T10:45:57.158373+0000","last_undegraded":"2024-04-26T10:45:57.158373+0000","last_fullsized":"2024-04-26T10:45:57.158373+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:50.232753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'418","reported_seq":929,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159365+0000","last_change":"2024-04-26T10:45:55.179671+0000","last_active":"2024-04-26T10:45:57.159365+0000","last_peered":"2024-04-26T10:45:57.159365+0000","last_clean":"2024-04-26T10:45:57.159365+0000","last_became_active":"2024-04-26T10:45:55.178079+0000","last_became_peered":"2024-04-26T10:45:55.178079+0000","last_unstale":"2024-04-26T10:45:57.159365+0000","last_undegraded":"2024-04-26T10:45:57.159365+0000","last_fullsized":"2024-04-26T10:45:57.159365+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:36.749926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":34476,"num_write":379,"num_write_kb":101645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"62'494","reported_seq":575,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159163+0000","last_change":"2024-04-26T10:42:25.688221+0000","last_active":"2024-04-26T10:45:57.159163+0000","last_peered":"2024-04-26T10:45:57.159163+0000","last_clean":"2024-04-26T10:45:57.159163+0000","last_became_active":"2024-04-26T10:42:25.687829+0000","last_became_peered":"2024-04-26T10:42:25.687829+0000","last_unstale":"2024-04-26T10:45:57.159163+0000","last_undegraded":"2024-04-26T10:45:57.159163+0000","last_fullsized":"2024-04-26T10:45:57.159163+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:05.939715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":12543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"63'406","reported_seq":586,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159122+0000","last_change":"2024-04-26T10:45:54.192178+0000","last_active":"2024-04-26T10:45:57.159122+0000","last_peered":"2024-04-26T10:45:57.159122+0000","last_clean":"2024-04-26T10:45:57.159122+0000","last_became_active":"2024-04-26T10:45:54.189591+0000","last_became_peered":"2024-04-26T10:45:54.189591+0000","last_unstale":"2024-04-26T10:45:57.159122+0000","last_undegraded":"2024-04-26T10:45:57.159122+0000","last_fullsized":"2024-04-26T10:45:57.159122+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:31.509288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":45941,"num_write":372,"num_write_kb":80011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"62'61","reported_seq":160,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160386+0000","last_change":"2024-04-26T10:45:45.895125+0000","last_active":"2024-04-26T10:45:57.160386+0000","last_peered":"2024-04-26T10:45:57.160386+0000","last_clean":"2024-04-26T10:45:57.160386+0000","last_became_active":"2024-04-26T10:45:45.874300+0000","last_became_peered":"2024-04-26T10:45:45.874300+0000","last_unstale":"2024-04-26T10:45:57.160386+0000","last_undegraded":"2024-04-26T10:45:57.160386+0000","last_fullsized":"2024-04-26T10:45:57.160386+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:26.528893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"63'375","reported_seq":823,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161710+0000","last_change":"2024-04-26T10:45:56.163670+0000","last_active":"2024-04-26T10:45:57.161710+0000","last_peered":"2024-04-26T10:45:57.161710+0000","last_clean":"2024-04-26T10:45:57.161710+0000","last_became_active":"2024-04-26T10:45:56.160416+0000","last_became_peered":"2024-04-26T10:45:56.160416+0000","last_unstale":"2024-04-26T10:45:57.161710+0000","last_undegraded":"2024-04-26T10:45:57.161710+0000","last_fullsized":"2024-04-26T10:45:57.161710+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:43.147179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16213,"num_write":354,"num_write_kb":54493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":332,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"62'276","reported_seq":368,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160846+0000","last_change":"2024-04-26T10:45:56.160817+0000","last_active":"2024-04-26T10:45:57.160846+0000","last_peered":"2024-04-26T10:45:57.160846+0000","last_clean":"2024-04-26T10:45:57.160846+0000","last_became_active":"2024-04-26T10:45:56.160414+0000","last_became_peered":"2024-04-26T10:45:56.160414+0000","last_unstale":"2024-04-26T10:45:57.160846+0000","last_undegraded":"2024-04-26T10:45:57.160846+0000","last_fullsized":"2024-04-26T10:45:57.160846+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:40.374381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"63'379","reported_seq":475,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161030+0000","last_change":"2024-04-26T10:45:53.177365+0000","last_active":"2024-04-26T10:45:57.161030+0000","last_peered":"2024-04-26T10:45:57.161030+0000","last_clean":"2024-04-26T10:45:57.161030+0000","last_became_active":"2024-04-26T10:45:53.173645+0000","last_became_peered":"2024-04-26T10:45:53.173645+0000","last_unstale":"2024-04-26T10:45:57.161030+0000","last_undegraded":"2024-04-26T10:45:57.161030+0000","last_fullsized":"2024-04-26T10:45:57.161030+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:32.390075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20480,"num_write":343,"num_write_kb":25788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"62'237","reported_seq":347,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159471+0000","last_change":"2024-04-26T10:45:48.867081+0000","last_active":"2024-04-26T10:45:57.159471+0000","last_peered":"2024-04-26T10:45:57.159471+0000","last_clean":"2024-04-26T10:45:57.159471+0000","last_became_active":"2024-04-26T10:45:48.866716+0000","last_became_peered":"2024-04-26T10:45:48.866716+0000","last_unstale":"2024-04-26T10:45:57.159471+0000","last_undegraded":"2024-04-26T10:45:57.159471+0000","last_fullsized":"2024-04-26T10:45:57.159471+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:16.712392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":12393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"63'419","reported_seq":570,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158951+0000","last_change":"2024-04-26T10:42:26.041729+0000","last_active":"2024-04-26T10:45:57.158951+0000","last_peered":"2024-04-26T10:45:57.158951+0000","last_clean":"2024-04-26T10:45:57.158951+0000","last_became_active":"2024-04-26T10:42:26.040504+0000","last_became_peered":"2024-04-26T10:42:26.040504+0000","last_unstale":"2024-04-26T10:45:57.158951+0000","last_undegraded":"2024-04-26T10:45:57.158951+0000","last_fullsized":"2024-04-26T10:45:57.158951+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39582,"num_write":378,"num_write_kb":54867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"62'61","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159083+0000","last_change":"2024-04-26T10:45:53.227750+0000","last_active":"2024-04-26T10:45:57.159083+0000","last_peered":"2024-04-26T10:45:57.159083+0000","last_clean":"2024-04-26T10:45:57.159083+0000","last_became_active":"2024-04-26T10:45:53.178804+0000","last_became_peered":"2024-04-26T10:45:53.178804+0000","last_unstale":"2024-04-26T10:45:57.159083+0000","last_undegraded":"2024-04-26T10:45:57.159083+0000","last_fullsized":"2024-04-26T10:45:57.159083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:56.795614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'437","reported_seq":523,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162221+0000","last_change":"2024-04-26T10:45:53.181155+0000","last_active":"2024-04-26T10:45:57.162221+0000","last_peered":"2024-04-26T10:45:57.162221+0000","last_clean":"2024-04-26T10:45:57.162221+0000","last_became_active":"2024-04-26T10:45:53.177071+0000","last_became_peered":"2024-04-26T10:45:53.177071+0000","last_unstale":"2024-04-26T10:45:57.162221+0000","last_undegraded":"2024-04-26T10:45:57.162221+0000","last_fullsized":"2024-04-26T10:45:57.162221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:34.219319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":7562,"num_write":400,"num_write_kb":26121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"62'58","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158941+0000","last_change":"2024-04-26T10:45:53.197669+0000","last_active":"2024-04-26T10:45:57.158941+0000","last_peered":"2024-04-26T10:45:57.158941+0000","last_clean":"2024-04-26T10:45:57.158941+0000","last_became_active":"2024-04-26T10:45:53.173542+0000","last_became_peered":"2024-04-26T10:45:53.173542+0000","last_unstale":"2024-04-26T10:45:57.158941+0000","last_undegraded":"2024-04-26T10:45:57.158941+0000","last_fullsized":"2024-04-26T10:45:57.158941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:34.409430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2672,"num_read_kb":1454712,"num_write":24538,"num_write_kb":4190103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26671,"ondisk_log_size":26671,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128811551,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":5770,"num_write_kb":129888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257691648,"data_stored":257623102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},"log_size":7595,"ondisk_log_size":7595,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738416,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":183416,"kb_used_data":80164,"kb_used_omap":1,"kb_used_meta":103230,"kb_avail":94188424,"statfs":{"total":96636764160,"available":96448946176,"internally_reserved":0,"allocated":82087936,"data_stored":81566103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105707974},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:45:25 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.20300000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42599999999999999,"15min":0.436},"min":{"1min":0.26000000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.22900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]}]},{"osd":1,"up_from":70,"seq":300647710725,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136028,"kb_used_data":90440,"kb_used_omap":7,"kb_used_meta":45560,"kb_avail":94235812,"statfs":{"total":96636764160,"available":96497471488,"internally_reserved":0,"allocated":92610560,"data_stored":92059263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7181,"internal_metadata":46654451},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738417,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214380,"kb_used_data":84896,"kb_used_omap":1,"kb_used_meta":129470,"kb_avail":94157460,"statfs":{"total":96636764160,"available":96417239040,"internally_reserved":0,"allocated":86933504,"data_stored":86396712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132577734},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Fri Apr 26 10:45:26 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.43099999999999999,"15min":0.44900000000000001},"min":{"1min":0.21199999999999999,"5min":0.183,"15min":0.183},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.442,"15min":0.46500000000000002},"min":{"1min":0.23499999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57199999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.65700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":85422080,"data_stored":85400264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":91099136,"data_stored":91062815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81170432,"data_stored":81160023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:46:04.840 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T10:46:04.840 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:46:05.171 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:46:05.173 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:46:05.182 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-04-26T10:46:03.650828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129401919,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2852,"num_read_kb":1456290,"num_write":30511,"num_write_kb":4323451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9253,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34423,"ondisk_log_size":34423,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":222,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":533824,"kb_used_data":255500,"kb_used_omap":10,"kb_used_meta":278261,"kb_avail":282581696,"statfs":{"total":289910292480,"available":289363656704,"internally_reserved":0,"allocated":261632000,"data_stored":260022078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10369,"internal_metadata":284940159},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-494,"num_objects_misplaced":-354,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1332,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.494930"},"pg_stats":[{"pgid":"4.3f","version":"63'415","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160204+0000","last_change":"2024-04-26T10:42:26.045527+0000","last_active":"2024-04-26T10:45:57.160204+0000","last_peered":"2024-04-26T10:45:57.160204+0000","last_clean":"2024-04-26T10:45:57.160204+0000","last_became_active":"2024-04-26T10:42:26.044597+0000","last_became_peered":"2024-04-26T10:42:26.044597+0000","last_unstale":"2024-04-26T10:45:57.160204+0000","last_undegraded":"2024-04-26T10:45:57.160204+0000","last_fullsized":"2024-04-26T10:45:57.160204+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22963,"num_write":385,"num_write_kb":71406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"63'396","reported_seq":521,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159219+0000","last_change":"2024-04-26T10:45:54.194523+0000","last_active":"2024-04-26T10:45:57.159219+0000","last_peered":"2024-04-26T10:45:57.159219+0000","last_clean":"2024-04-26T10:45:57.159219+0000","last_became_active":"2024-04-26T10:45:54.192613+0000","last_became_peered":"2024-04-26T10:45:54.192613+0000","last_unstale":"2024-04-26T10:45:57.159219+0000","last_undegraded":"2024-04-26T10:45:57.159219+0000","last_fullsized":"2024-04-26T10:45:57.159219+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:22.723004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9499,"num_write":371,"num_write_kb":38601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"63'366","reported_seq":449,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161698+0000","last_change":"2024-04-26T10:45:55.183758+0000","last_active":"2024-04-26T10:45:57.161698+0000","last_peered":"2024-04-26T10:45:57.161698+0000","last_clean":"2024-04-26T10:45:57.161698+0000","last_became_active":"2024-04-26T10:45:55.180991+0000","last_became_peered":"2024-04-26T10:45:55.180991+0000","last_unstale":"2024-04-26T10:45:57.161698+0000","last_undegraded":"2024-04-26T10:45:57.161698+0000","last_fullsized":"2024-04-26T10:45:57.161698+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:29.645448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6211,"num_write":338,"num_write_kb":38844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"63'394","reported_seq":545,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160935+0000","last_change":"2024-04-26T10:45:51.162341+0000","last_active":"2024-04-26T10:45:57.160935+0000","last_peered":"2024-04-26T10:45:57.160935+0000","last_clean":"2024-04-26T10:45:57.160935+0000","last_became_active":"2024-04-26T10:45:51.159099+0000","last_became_peered":"2024-04-26T10:45:51.159099+0000","last_unstale":"2024-04-26T10:45:57.160935+0000","last_undegraded":"2024-04-26T10:45:57.160935+0000","last_fullsized":"2024-04-26T10:45:57.160935+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:18.605866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":52323,"num_write":357,"num_write_kb":63323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"63'409","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160398+0000","last_change":"2024-04-26T10:42:26.041191+0000","last_active":"2024-04-26T10:45:57.160398+0000","last_peered":"2024-04-26T10:45:57.160398+0000","last_clean":"2024-04-26T10:45:57.160398+0000","last_became_active":"2024-04-26T10:42:26.040487+0000","last_became_peered":"2024-04-26T10:42:26.040487+0000","last_unstale":"2024-04-26T10:45:57.160398+0000","last_undegraded":"2024-04-26T10:45:57.160398+0000","last_fullsized":"2024-04-26T10:45:57.160398+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":372,"num_write_kb":42764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'385","reported_seq":464,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161234+0000","last_change":"2024-04-26T10:45:49.864662+0000","last_active":"2024-04-26T10:45:57.161234+0000","last_peered":"2024-04-26T10:45:57.161234+0000","last_clean":"2024-04-26T10:45:57.161234+0000","last_became_active":"2024-04-26T10:45:49.861811+0000","last_became_peered":"2024-04-26T10:45:49.861811+0000","last_unstale":"2024-04-26T10:45:57.161234+0000","last_undegraded":"2024-04-26T10:45:57.161234+0000","last_fullsized":"2024-04-26T10:45:57.161234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:25.549464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4124,"num_write":356,"num_write_kb":69857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"63'425","reported_seq":534,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160809+0000","last_change":"2024-04-26T10:45:50.869572+0000","last_active":"2024-04-26T10:45:57.160809+0000","last_peered":"2024-04-26T10:45:57.160809+0000","last_clean":"2024-04-26T10:45:57.160809+0000","last_became_active":"2024-04-26T10:45:50.866996+0000","last_became_peered":"2024-04-26T10:45:50.866996+0000","last_unstale":"2024-04-26T10:45:57.160809+0000","last_undegraded":"2024-04-26T10:45:57.160809+0000","last_fullsized":"2024-04-26T10:45:57.160809+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:17.631869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13036,"num_write":390,"num_write_kb":67193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"63'399","reported_seq":507,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.164304+0000","last_change":"2024-04-26T10:45:58.164304+0000","last_active":"2024-04-26T10:45:58.164304+0000","last_peered":"2024-04-26T10:45:58.164304+0000","last_clean":"2024-04-26T10:45:58.164304+0000","last_became_active":"2024-04-26T10:45:58.162532+0000","last_became_peered":"2024-04-26T10:45:58.162532+0000","last_unstale":"2024-04-26T10:45:58.164304+0000","last_undegraded":"2024-04-26T10:45:58.164304+0000","last_fullsized":"2024-04-26T10:45:58.164304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:50.164416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25678,"num_write":356,"num_write_kb":116549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"63'442","reported_seq":589,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159518+0000","last_change":"2024-04-26T10:42:26.045893+0000","last_active":"2024-04-26T10:45:57.159518+0000","last_peered":"2024-04-26T10:45:57.159518+0000","last_clean":"2024-04-26T10:45:57.159518+0000","last_became_active":"2024-04-26T10:42:26.045177+0000","last_became_peered":"2024-04-26T10:42:26.045177+0000","last_unstale":"2024-04-26T10:45:57.159518+0000","last_undegraded":"2024-04-26T10:45:57.159518+0000","last_fullsized":"2024-04-26T10:45:57.159518+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35111,"num_write":413,"num_write_kb":60306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'393","reported_seq":515,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159399+0000","last_change":"2024-04-26T10:45:54.192984+0000","last_active":"2024-04-26T10:45:57.159399+0000","last_peered":"2024-04-26T10:45:57.159399+0000","last_clean":"2024-04-26T10:45:57.159399+0000","last_became_active":"2024-04-26T10:45:54.191514+0000","last_became_peered":"2024-04-26T10:45:54.191514+0000","last_unstale":"2024-04-26T10:45:57.159399+0000","last_undegraded":"2024-04-26T10:45:57.159399+0000","last_fullsized":"2024-04-26T10:45:57.159399+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:33.809143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5355,"num_write":351,"num_write_kb":38901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"63'377","reported_seq":482,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161319+0000","last_change":"2024-04-26T10:45:49.865172+0000","last_active":"2024-04-26T10:45:57.161319+0000","last_peered":"2024-04-26T10:45:57.161319+0000","last_clean":"2024-04-26T10:45:57.161319+0000","last_became_active":"2024-04-26T10:45:49.862718+0000","last_became_peered":"2024-04-26T10:45:49.862718+0000","last_unstale":"2024-04-26T10:45:57.161319+0000","last_undegraded":"2024-04-26T10:45:57.161319+0000","last_fullsized":"2024-04-26T10:45:57.161319+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:43.129958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18030,"num_write":355,"num_write_kb":67044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"63'365","reported_seq":808,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.167133+0000","last_change":"2024-04-26T10:45:57.166219+0000","last_active":"2024-04-26T10:45:57.167133+0000","last_peered":"2024-04-26T10:45:57.167133+0000","last_clean":"2024-04-26T10:45:57.167133+0000","last_became_active":"2024-04-26T10:45:57.164964+0000","last_became_peered":"2024-04-26T10:45:57.164964+0000","last_unstale":"2024-04-26T10:45:57.167133+0000","last_undegraded":"2024-04-26T10:45:57.167133+0000","last_fullsized":"2024-04-26T10:45:57.167133+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:55.064831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14866,"num_write":337,"num_write_kb":71188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'397","reported_seq":490,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160289+0000","last_change":"2024-04-26T10:42:26.042607+0000","last_active":"2024-04-26T10:45:57.160289+0000","last_peered":"2024-04-26T10:45:57.160289+0000","last_clean":"2024-04-26T10:45:57.160289+0000","last_became_active":"2024-04-26T10:42:26.041617+0000","last_became_peered":"2024-04-26T10:42:26.041617+0000","last_unstale":"2024-04-26T10:45:57.160289+0000","last_undegraded":"2024-04-26T10:45:57.160289+0000","last_fullsized":"2024-04-26T10:45:57.160289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8192,"num_write":362,"num_write_kb":54822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"63'408","reported_seq":487,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161186+0000","last_change":"2024-04-26T10:45:53.181618+0000","last_active":"2024-04-26T10:45:57.161186+0000","last_peered":"2024-04-26T10:45:57.161186+0000","last_clean":"2024-04-26T10:45:57.161186+0000","last_became_active":"2024-04-26T10:45:53.177677+0000","last_became_peered":"2024-04-26T10:45:53.177677+0000","last_unstale":"2024-04-26T10:45:57.161186+0000","last_undegraded":"2024-04-26T10:45:57.161186+0000","last_fullsized":"2024-04-26T10:45:57.161186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:06.719053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4688,"num_write":374,"num_write_kb":21766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"63'409","reported_seq":522,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160533+0000","last_change":"2024-04-26T10:45:54.188625+0000","last_active":"2024-04-26T10:45:57.160533+0000","last_peered":"2024-04-26T10:45:57.160533+0000","last_clean":"2024-04-26T10:45:57.160533+0000","last_became_active":"2024-04-26T10:45:54.185826+0000","last_became_peered":"2024-04-26T10:45:54.185826+0000","last_unstale":"2024-04-26T10:45:57.160533+0000","last_undegraded":"2024-04-26T10:45:57.160533+0000","last_fullsized":"2024-04-26T10:45:57.160533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:48.401265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25968,"num_write":366,"num_write_kb":75698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"63'460","reported_seq":562,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162279+0000","last_change":"2024-04-26T10:45:53.176893+0000","last_active":"2024-04-26T10:45:57.162279+0000","last_peered":"2024-04-26T10:45:57.162279+0000","last_clean":"2024-04-26T10:45:57.162279+0000","last_became_active":"2024-04-26T10:45:53.174699+0000","last_became_peered":"2024-04-26T10:45:53.174699+0000","last_unstale":"2024-04-26T10:45:57.162279+0000","last_undegraded":"2024-04-26T10:45:57.162279+0000","last_fullsized":"2024-04-26T10:45:57.162279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:41.919177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16269,"num_write":426,"num_write_kb":67839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"63'393","reported_seq":512,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159625+0000","last_change":"2024-04-26T10:42:26.049338+0000","last_active":"2024-04-26T10:45:57.159625+0000","last_peered":"2024-04-26T10:45:57.159625+0000","last_clean":"2024-04-26T10:45:57.159625+0000","last_became_active":"2024-04-26T10:42:26.049014+0000","last_became_peered":"2024-04-26T10:42:26.049014+0000","last_unstale":"2024-04-26T10:45:57.159625+0000","last_undegraded":"2024-04-26T10:45:57.159625+0000","last_fullsized":"2024-04-26T10:45:57.159625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":25712,"num_write":362,"num_write_kb":42020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'428","reported_seq":554,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159673+0000","last_change":"2024-04-26T10:45:54.192786+0000","last_active":"2024-04-26T10:45:57.159673+0000","last_peered":"2024-04-26T10:45:57.159673+0000","last_clean":"2024-04-26T10:45:57.159673+0000","last_became_active":"2024-04-26T10:45:54.189852+0000","last_became_peered":"2024-04-26T10:45:54.189852+0000","last_unstale":"2024-04-26T10:45:57.159673+0000","last_undegraded":"2024-04-26T10:45:57.159673+0000","last_fullsized":"2024-04-26T10:45:57.159673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:29.968564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12316,"num_write":384,"num_write_kb":87656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"63'446","reported_seq":587,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158810+0000","last_change":"2024-04-26T10:45:54.186962+0000","last_active":"2024-04-26T10:45:57.158810+0000","last_peered":"2024-04-26T10:45:57.158810+0000","last_clean":"2024-04-26T10:45:57.158810+0000","last_became_active":"2024-04-26T10:45:54.184063+0000","last_became_peered":"2024-04-26T10:45:54.184063+0000","last_unstale":"2024-04-26T10:45:57.158810+0000","last_undegraded":"2024-04-26T10:45:57.158810+0000","last_fullsized":"2024-04-26T10:45:57.158810+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:59.349649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":53414,"num_write":401,"num_write_kb":80048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":550,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161291+0000","last_change":"2024-04-26T10:45:50.869971+0000","last_active":"2024-04-26T10:45:57.161291+0000","last_peered":"2024-04-26T10:45:57.161291+0000","last_clean":"2024-04-26T10:45:57.161291+0000","last_became_active":"2024-04-26T10:45:50.867680+0000","last_became_peered":"2024-04-26T10:45:50.867680+0000","last_unstale":"2024-04-26T10:45:57.161291+0000","last_undegraded":"2024-04-26T10:45:57.161291+0000","last_fullsized":"2024-04-26T10:45:57.161291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:17.680371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19859,"num_write":405,"num_write_kb":51119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"63'408","reported_seq":862,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161853+0000","last_change":"2024-04-26T10:45:56.163683+0000","last_active":"2024-04-26T10:45:57.161853+0000","last_peered":"2024-04-26T10:45:57.161853+0000","last_clean":"2024-04-26T10:45:57.161853+0000","last_became_active":"2024-04-26T10:45:56.160360+0000","last_became_peered":"2024-04-26T10:45:56.160360+0000","last_unstale":"2024-04-26T10:45:57.161853+0000","last_undegraded":"2024-04-26T10:45:57.161853+0000","last_fullsized":"2024-04-26T10:45:57.161853+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:44.845909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":15372,"num_write":366,"num_write_kb":75855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"63'452","reported_seq":1017,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158921+0000","last_change":"2024-04-26T10:45:52.175372+0000","last_active":"2024-04-26T10:45:57.158921+0000","last_peered":"2024-04-26T10:45:57.158921+0000","last_clean":"2024-04-26T10:45:57.158921+0000","last_became_active":"2024-04-26T10:45:52.173702+0000","last_became_peered":"2024-04-26T10:45:52.173702+0000","last_unstale":"2024-04-26T10:45:57.158921+0000","last_undegraded":"2024-04-26T10:45:57.158921+0000","last_fullsized":"2024-04-26T10:45:57.158921+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:55.459452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43729,"num_write":421,"num_write_kb":79804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"63'408","reported_seq":882,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.163833+0000","last_change":"2024-04-26T10:45:57.163475+0000","last_active":"2024-04-26T10:45:57.163833+0000","last_peered":"2024-04-26T10:45:57.163833+0000","last_clean":"2024-04-26T10:45:57.163833+0000","last_became_active":"2024-04-26T10:45:57.162147+0000","last_became_peered":"2024-04-26T10:45:57.162147+0000","last_unstale":"2024-04-26T10:45:57.163833+0000","last_undegraded":"2024-04-26T10:45:57.163833+0000","last_fullsized":"2024-04-26T10:45:57.163833+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:18.287163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":30320,"num_write":372,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'453","reported_seq":615,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158621+0000","last_change":"2024-04-26T10:45:54.184330+0000","last_active":"2024-04-26T10:45:57.158621+0000","last_peered":"2024-04-26T10:45:57.158621+0000","last_clean":"2024-04-26T10:45:57.158621+0000","last_became_active":"2024-04-26T10:45:54.181881+0000","last_became_peered":"2024-04-26T10:45:54.181881+0000","last_unstale":"2024-04-26T10:45:57.158621+0000","last_undegraded":"2024-04-26T10:45:57.158621+0000","last_fullsized":"2024-04-26T10:45:57.158621+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:02.066091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":19864,"num_write":422,"num_write_kb":51638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"63'439","reported_seq":954,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160299+0000","last_change":"2024-04-26T10:45:48.867766+0000","last_active":"2024-04-26T10:45:57.160299+0000","last_peered":"2024-04-26T10:45:57.160299+0000","last_clean":"2024-04-26T10:45:57.160299+0000","last_became_active":"2024-04-26T10:45:48.866159+0000","last_became_peered":"2024-04-26T10:45:48.866159+0000","last_unstale":"2024-04-26T10:45:57.160299+0000","last_undegraded":"2024-04-26T10:45:57.160299+0000","last_fullsized":"2024-04-26T10:45:57.160299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:39.736649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8912,"num_write":417,"num_write_kb":46575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"63'513","reported_seq":1158,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158983+0000","last_change":"2024-04-26T10:45:51.160003+0000","last_active":"2024-04-26T10:45:57.158983+0000","last_peered":"2024-04-26T10:45:57.158983+0000","last_clean":"2024-04-26T10:45:57.158983+0000","last_became_active":"2024-04-26T10:45:51.158698+0000","last_became_peered":"2024-04-26T10:45:51.158698+0000","last_unstale":"2024-04-26T10:45:57.158983+0000","last_undegraded":"2024-04-26T10:45:57.158983+0000","last_fullsized":"2024-04-26T10:45:57.158983+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:36.990095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":70751,"num_write":473,"num_write_kb":88902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'406","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161212+0000","last_change":"2024-04-26T10:45:56.164805+0000","last_active":"2024-04-26T10:45:57.161212+0000","last_peered":"2024-04-26T10:45:57.161212+0000","last_clean":"2024-04-26T10:45:57.161212+0000","last_became_active":"2024-04-26T10:45:56.162419+0000","last_became_peered":"2024-04-26T10:45:56.162419+0000","last_unstale":"2024-04-26T10:45:57.161212+0000","last_undegraded":"2024-04-26T10:45:57.161212+0000","last_fullsized":"2024-04-26T10:45:57.161212+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:53.474847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":32121,"num_write":372,"num_write_kb":60163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"63'402","reported_seq":867,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.167147+0000","last_change":"2024-04-26T10:45:57.166225+0000","last_active":"2024-04-26T10:45:57.167147+0000","last_peered":"2024-04-26T10:45:57.167147+0000","last_clean":"2024-04-26T10:45:57.167147+0000","last_became_active":"2024-04-26T10:45:57.165064+0000","last_became_peered":"2024-04-26T10:45:57.165064+0000","last_unstale":"2024-04-26T10:45:57.167147+0000","last_undegraded":"2024-04-26T10:45:57.167147+0000","last_fullsized":"2024-04-26T10:45:57.167147+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:52.273357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":6824,"num_write":378,"num_write_kb":72156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"63'407","reported_seq":888,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.166516+0000","last_change":"2024-04-26T10:45:58.163989+0000","last_active":"2024-04-26T10:45:58.166516+0000","last_peered":"2024-04-26T10:45:58.166516+0000","last_clean":"2024-04-26T10:45:58.166516+0000","last_became_active":"2024-04-26T10:45:58.161850+0000","last_became_peered":"2024-04-26T10:45:58.161850+0000","last_unstale":"2024-04-26T10:45:58.166516+0000","last_undegraded":"2024-04-26T10:45:58.166516+0000","last_fullsized":"2024-04-26T10:45:58.166516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:17:09.805958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25898,"num_write":372,"num_write_kb":59274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":346,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'490","reported_seq":1058,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159063+0000","last_change":"2024-04-26T10:45:55.179785+0000","last_active":"2024-04-26T10:45:57.159063+0000","last_peered":"2024-04-26T10:45:57.159063+0000","last_clean":"2024-04-26T10:45:57.159063+0000","last_became_active":"2024-04-26T10:45:55.178083+0000","last_became_peered":"2024-04-26T10:45:55.178083+0000","last_unstale":"2024-04-26T10:45:57.159063+0000","last_undegraded":"2024-04-26T10:45:57.159063+0000","last_fullsized":"2024-04-26T10:45:57.159063+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:23.269957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33597,"num_write":449,"num_write_kb":87981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"63'474","reported_seq":563,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158167+0000","last_change":"2024-04-26T10:45:54.189228+0000","last_active":"2024-04-26T10:45:57.158167+0000","last_peered":"2024-04-26T10:45:57.158167+0000","last_clean":"2024-04-26T10:45:57.158167+0000","last_became_active":"2024-04-26T10:45:54.186011+0000","last_became_peered":"2024-04-26T10:45:54.186011+0000","last_unstale":"2024-04-26T10:45:57.158167+0000","last_undegraded":"2024-04-26T10:45:57.158167+0000","last_fullsized":"2024-04-26T10:45:57.158167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.355145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30886,"num_write":441,"num_write_kb":118807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'443","reported_seq":547,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162005+0000","last_change":"2024-04-26T10:45:48.864423+0000","last_active":"2024-04-26T10:45:57.162005+0000","last_peered":"2024-04-26T10:45:57.162005+0000","last_clean":"2024-04-26T10:45:57.162005+0000","last_became_active":"2024-04-26T10:45:48.861918+0000","last_became_peered":"2024-04-26T10:45:48.861918+0000","last_unstale":"2024-04-26T10:45:57.162005+0000","last_undegraded":"2024-04-26T10:45:57.162005+0000","last_fullsized":"2024-04-26T10:45:57.162005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:11.356135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20556,"num_write":413,"num_write_kb":91647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"63'376","reported_seq":478,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159241+0000","last_change":"2024-04-26T10:42:26.041757+0000","last_active":"2024-04-26T10:45:57.159241+0000","last_peered":"2024-04-26T10:45:57.159241+0000","last_clean":"2024-04-26T10:45:57.159241+0000","last_became_active":"2024-04-26T10:42:26.040920+0000","last_became_peered":"2024-04-26T10:42:26.040920+0000","last_unstale":"2024-04-26T10:45:57.159241+0000","last_undegraded":"2024-04-26T10:45:57.159241+0000","last_fullsized":"2024-04-26T10:45:57.159241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10124,"num_write":344,"num_write_kb":66899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"62'453","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161061+0000","last_change":"2024-04-26T10:45:48.862782+0000","last_active":"2024-04-26T10:45:57.161061+0000","last_peered":"2024-04-26T10:45:57.161061+0000","last_clean":"2024-04-26T10:45:57.161061+0000","last_became_active":"2024-04-26T10:45:48.862424+0000","last_became_peered":"2024-04-26T10:45:48.862424+0000","last_unstale":"2024-04-26T10:45:57.161061+0000","last_undegraded":"2024-04-26T10:45:57.161061+0000","last_fullsized":"2024-04-26T10:45:57.161061+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:16.548893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"63'403","reported_seq":520,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159394+0000","last_change":"2024-04-26T10:42:26.041850+0000","last_active":"2024-04-26T10:45:57.159394+0000","last_peered":"2024-04-26T10:45:57.159394+0000","last_clean":"2024-04-26T10:45:57.159394+0000","last_became_active":"2024-04-26T10:42:26.040464+0000","last_became_peered":"2024-04-26T10:42:26.040464+0000","last_unstale":"2024-04-26T10:45:57.159394+0000","last_undegraded":"2024-04-26T10:45:57.159394+0000","last_fullsized":"2024-04-26T10:45:57.159394+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24588,"num_write":363,"num_write_kb":51190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"62'49","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158264+0000","last_change":"2024-04-26T10:45:45.862317+0000","last_active":"2024-04-26T10:45:57.158264+0000","last_peered":"2024-04-26T10:45:57.158264+0000","last_clean":"2024-04-26T10:45:57.158264+0000","last_became_active":"2024-04-26T10:45:45.862029+0000","last_became_peered":"2024-04-26T10:45:45.862029+0000","last_unstale":"2024-04-26T10:45:57.158264+0000","last_undegraded":"2024-04-26T10:45:57.158264+0000","last_fullsized":"2024-04-26T10:45:57.158264+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:02.521534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'407","reported_seq":887,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159309+0000","last_change":"2024-04-26T10:45:52.170710+0000","last_active":"2024-04-26T10:45:57.159309+0000","last_peered":"2024-04-26T10:45:57.159309+0000","last_clean":"2024-04-26T10:45:57.159309+0000","last_became_active":"2024-04-26T10:45:52.169295+0000","last_became_peered":"2024-04-26T10:45:52.169295+0000","last_unstale":"2024-04-26T10:45:57.159309+0000","last_undegraded":"2024-04-26T10:45:57.159309+0000","last_fullsized":"2024-04-26T10:45:57.159309+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:10.995530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":7077,"num_write":367,"num_write_kb":42434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"62'66","reported_seq":160,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159731+0000","last_change":"2024-04-26T10:45:45.874440+0000","last_active":"2024-04-26T10:45:57.159731+0000","last_peered":"2024-04-26T10:45:57.159731+0000","last_clean":"2024-04-26T10:45:57.159731+0000","last_became_active":"2024-04-26T10:45:45.874030+0000","last_became_peered":"2024-04-26T10:45:45.874030+0000","last_unstale":"2024-04-26T10:45:57.159731+0000","last_undegraded":"2024-04-26T10:45:57.159731+0000","last_fullsized":"2024-04-26T10:45:57.159731+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:22.711644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"63'406","reported_seq":898,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159545+0000","last_change":"2024-04-26T10:45:49.863376+0000","last_active":"2024-04-26T10:45:57.159545+0000","last_peered":"2024-04-26T10:45:57.159545+0000","last_clean":"2024-04-26T10:45:57.159545+0000","last_became_active":"2024-04-26T10:45:49.861979+0000","last_became_peered":"2024-04-26T10:45:49.861979+0000","last_unstale":"2024-04-26T10:45:57.159545+0000","last_undegraded":"2024-04-26T10:45:57.159545+0000","last_fullsized":"2024-04-26T10:45:57.159545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:16.553043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":25977,"num_write":374,"num_write_kb":104172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'66","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161876+0000","last_change":"2024-04-26T10:45:45.871507+0000","last_active":"2024-04-26T10:45:57.161876+0000","last_peered":"2024-04-26T10:45:57.161876+0000","last_clean":"2024-04-26T10:45:57.161876+0000","last_became_active":"2024-04-26T10:45:45.871120+0000","last_became_peered":"2024-04-26T10:45:45.871120+0000","last_unstale":"2024-04-26T10:45:57.161876+0000","last_undegraded":"2024-04-26T10:45:57.161876+0000","last_fullsized":"2024-04-26T10:45:57.161876+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:56.162347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"62'200","reported_seq":281,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161233+0000","last_change":"2024-04-26T10:45:48.866225+0000","last_active":"2024-04-26T10:45:57.161233+0000","last_peered":"2024-04-26T10:45:57.161233+0000","last_clean":"2024-04-26T10:45:57.161233+0000","last_became_active":"2024-04-26T10:45:48.865878+0000","last_became_peered":"2024-04-26T10:45:48.865878+0000","last_unstale":"2024-04-26T10:45:57.161233+0000","last_undegraded":"2024-04-26T10:45:57.161233+0000","last_fullsized":"2024-04-26T10:45:57.161233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:42:39.518391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"63'415","reported_seq":908,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.164897+0000","last_change":"2024-04-26T10:45:57.164421+0000","last_active":"2024-04-26T10:45:57.164897+0000","last_peered":"2024-04-26T10:45:57.164897+0000","last_clean":"2024-04-26T10:45:57.164897+0000","last_became_active":"2024-04-26T10:45:57.163263+0000","last_became_peered":"2024-04-26T10:45:57.163263+0000","last_unstale":"2024-04-26T10:45:57.164897+0000","last_undegraded":"2024-04-26T10:45:57.164897+0000","last_fullsized":"2024-04-26T10:45:57.164897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:16.262869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15757,"num_write":380,"num_write_kb":54727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"62'342","reported_seq":448,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159793+0000","last_change":"2024-04-26T10:45:48.866915+0000","last_active":"2024-04-26T10:45:57.159793+0000","last_peered":"2024-04-26T10:45:57.159793+0000","last_clean":"2024-04-26T10:45:57.159793+0000","last_became_active":"2024-04-26T10:45:48.866497+0000","last_became_peered":"2024-04-26T10:45:48.866497+0000","last_unstale":"2024-04-26T10:45:57.159793+0000","last_undegraded":"2024-04-26T10:45:57.159793+0000","last_fullsized":"2024-04-26T10:45:57.159793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:04.796882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"63'481","reported_seq":670,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158706+0000","last_change":"2024-04-26T10:45:54.184646+0000","last_active":"2024-04-26T10:45:57.158706+0000","last_peered":"2024-04-26T10:45:57.158706+0000","last_clean":"2024-04-26T10:45:57.158706+0000","last_became_active":"2024-04-26T10:45:54.181993+0000","last_became_peered":"2024-04-26T10:45:54.181993+0000","last_unstale":"2024-04-26T10:45:57.158706+0000","last_undegraded":"2024-04-26T10:45:57.158706+0000","last_fullsized":"2024-04-26T10:45:57.158706+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:34.664600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":45251,"num_write":451,"num_write_kb":105365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"62'460","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160768+0000","last_change":"2024-04-26T10:45:48.865887+0000","last_active":"2024-04-26T10:45:57.160768+0000","last_peered":"2024-04-26T10:45:57.160768+0000","last_clean":"2024-04-26T10:45:57.160768+0000","last_became_active":"2024-04-26T10:45:48.865520+0000","last_became_peered":"2024-04-26T10:45:48.865520+0000","last_unstale":"2024-04-26T10:45:57.160768+0000","last_undegraded":"2024-04-26T10:45:57.160768+0000","last_fullsized":"2024-04-26T10:45:57.160768+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:34.308634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":407,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'420","reported_seq":503,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.165736+0000","last_change":"2024-04-26T10:45:57.165390+0000","last_active":"2024-04-26T10:45:57.165736+0000","last_peered":"2024-04-26T10:45:57.165736+0000","last_clean":"2024-04-26T10:45:57.165736+0000","last_became_active":"2024-04-26T10:45:57.162014+0000","last_became_peered":"2024-04-26T10:45:57.162014+0000","last_unstale":"2024-04-26T10:45:57.165736+0000","last_undegraded":"2024-04-26T10:45:57.165736+0000","last_fullsized":"2024-04-26T10:45:57.165736+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:19.491785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13025,"num_write":385,"num_write_kb":38595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"62'67","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161113+0000","last_change":"2024-04-26T10:45:45.860717+0000","last_active":"2024-04-26T10:45:57.161113+0000","last_peered":"2024-04-26T10:45:57.161113+0000","last_clean":"2024-04-26T10:45:57.161113+0000","last_became_active":"2024-04-26T10:45:45.860175+0000","last_became_peered":"2024-04-26T10:45:45.860175+0000","last_unstale":"2024-04-26T10:45:57.161113+0000","last_undegraded":"2024-04-26T10:45:57.161113+0000","last_fullsized":"2024-04-26T10:45:57.161113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:30.736518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"63'452","reported_seq":965,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.166761+0000","last_change":"2024-04-26T10:45:58.166413+0000","last_active":"2024-04-26T10:45:58.166761+0000","last_peered":"2024-04-26T10:45:58.166761+0000","last_clean":"2024-04-26T10:45:58.166761+0000","last_became_active":"2024-04-26T10:45:58.164105+0000","last_became_peered":"2024-04-26T10:45:58.164105+0000","last_unstale":"2024-04-26T10:45:58.166761+0000","last_undegraded":"2024-04-26T10:45:58.166761+0000","last_fullsized":"2024-04-26T10:45:58.166761+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:05.536110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23217,"num_write":416,"num_write_kb":71418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":388,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"62'200","reported_seq":277,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158343+0000","last_change":"2024-04-26T10:45:56.160957+0000","last_active":"2024-04-26T10:45:57.158343+0000","last_peered":"2024-04-26T10:45:57.158343+0000","last_clean":"2024-04-26T10:45:57.158343+0000","last_became_active":"2024-04-26T10:45:56.160475+0000","last_became_peered":"2024-04-26T10:45:56.160475+0000","last_unstale":"2024-04-26T10:45:57.158343+0000","last_undegraded":"2024-04-26T10:45:57.158343+0000","last_fullsized":"2024-04-26T10:45:57.158343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:48.896541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'430","reported_seq":512,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.165078+0000","last_change":"2024-04-26T10:45:57.164742+0000","last_active":"2024-04-26T10:45:57.165078+0000","last_peered":"2024-04-26T10:45:57.165078+0000","last_clean":"2024-04-26T10:45:57.165078+0000","last_became_active":"2024-04-26T10:45:57.162070+0000","last_became_peered":"2024-04-26T10:45:57.162070+0000","last_unstale":"2024-04-26T10:45:57.165078+0000","last_undegraded":"2024-04-26T10:45:57.165078+0000","last_fullsized":"2024-04-26T10:45:57.165078+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:14.872176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":24352,"num_write":392,"num_write_kb":21976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"62'233","reported_seq":306,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160855+0000","last_change":"2024-04-26T10:45:48.862856+0000","last_active":"2024-04-26T10:45:57.160855+0000","last_peered":"2024-04-26T10:45:57.160855+0000","last_clean":"2024-04-26T10:45:57.160855+0000","last_became_active":"2024-04-26T10:45:48.862517+0000","last_became_peered":"2024-04-26T10:45:48.862517+0000","last_unstale":"2024-04-26T10:45:57.160855+0000","last_undegraded":"2024-04-26T10:45:57.160855+0000","last_fullsized":"2024-04-26T10:45:57.160855+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:43.799960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"63'393","reported_seq":478,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160672+0000","last_change":"2024-04-26T10:45:55.180960+0000","last_active":"2024-04-26T10:45:57.160672+0000","last_peered":"2024-04-26T10:45:57.160672+0000","last_clean":"2024-04-26T10:45:57.160672+0000","last_became_active":"2024-04-26T10:45:55.177758+0000","last_became_peered":"2024-04-26T10:45:55.177758+0000","last_unstale":"2024-04-26T10:45:57.160672+0000","last_undegraded":"2024-04-26T10:45:57.160672+0000","last_fullsized":"2024-04-26T10:45:57.160672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:47.889251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8671,"num_write":368,"num_write_kb":38542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"62'49","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158855+0000","last_change":"2024-04-26T10:45:45.874789+0000","last_active":"2024-04-26T10:45:57.158855+0000","last_peered":"2024-04-26T10:45:57.158855+0000","last_clean":"2024-04-26T10:45:57.158855+0000","last_became_active":"2024-04-26T10:45:45.874328+0000","last_became_peered":"2024-04-26T10:45:45.874328+0000","last_unstale":"2024-04-26T10:45:57.158855+0000","last_undegraded":"2024-04-26T10:45:57.158855+0000","last_fullsized":"2024-04-26T10:45:57.158855+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:27.431661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"63'368","reported_seq":463,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162061+0000","last_change":"2024-04-26T10:45:56.165615+0000","last_active":"2024-04-26T10:45:57.162061+0000","last_peered":"2024-04-26T10:45:57.162061+0000","last_clean":"2024-04-26T10:45:57.162061+0000","last_became_active":"2024-04-26T10:45:56.163456+0000","last_became_peered":"2024-04-26T10:45:56.163456+0000","last_unstale":"2024-04-26T10:45:57.162061+0000","last_undegraded":"2024-04-26T10:45:57.162061+0000","last_fullsized":"2024-04-26T10:45:57.162061+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:14.480860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":19222,"num_write":336,"num_write_kb":58903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"62'619","reported_seq":747,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159149+0000","last_change":"2024-04-26T10:45:56.162511+0000","last_active":"2024-04-26T10:45:57.159149+0000","last_peered":"2024-04-26T10:45:57.159149+0000","last_clean":"2024-04-26T10:45:57.159149+0000","last_became_active":"2024-04-26T10:45:56.161604+0000","last_became_peered":"2024-04-26T10:45:56.161604+0000","last_unstale":"2024-04-26T10:45:57.159149+0000","last_undegraded":"2024-04-26T10:45:57.159149+0000","last_fullsized":"2024-04-26T10:45:57.159149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:39.366865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":558,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"63'383","reported_seq":822,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.165607+0000","last_change":"2024-04-26T10:45:58.165237+0000","last_active":"2024-04-26T10:45:58.165607+0000","last_peered":"2024-04-26T10:45:58.165607+0000","last_clean":"2024-04-26T10:45:58.165607+0000","last_became_active":"2024-04-26T10:45:58.162264+0000","last_became_peered":"2024-04-26T10:45:58.162264+0000","last_unstale":"2024-04-26T10:45:58.165607+0000","last_undegraded":"2024-04-26T10:45:58.165607+0000","last_fullsized":"2024-04-26T10:45:58.165607+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:12.784168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":14260,"num_write":349,"num_write_kb":50367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":229,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161708+0000","last_change":"2024-04-26T10:45:45.871511+0000","last_active":"2024-04-26T10:45:57.161708+0000","last_peered":"2024-04-26T10:45:57.161708+0000","last_clean":"2024-04-26T10:45:57.161708+0000","last_became_active":"2024-04-26T10:45:45.871155+0000","last_became_peered":"2024-04-26T10:45:45.871155+0000","last_unstale":"2024-04-26T10:45:57.161708+0000","last_undegraded":"2024-04-26T10:45:57.161708+0000","last_fullsized":"2024-04-26T10:45:57.161708+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:53.015361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160932+0000","last_change":"2024-04-26T10:45:45.861068+0000","last_active":"2024-04-26T10:45:57.160932+0000","last_peered":"2024-04-26T10:45:57.160932+0000","last_clean":"2024-04-26T10:45:57.160932+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:57.160932+0000","last_undegraded":"2024-04-26T10:45:57.160932+0000","last_fullsized":"2024-04-26T10:45:57.160932+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:16.348009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"62'743","reported_seq":824,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158521+0000","last_change":"2024-04-26T10:42:25.686765+0000","last_active":"2024-04-26T10:45:57.158521+0000","last_peered":"2024-04-26T10:45:57.158521+0000","last_clean":"2024-04-26T10:45:57.158521+0000","last_became_active":"2024-04-26T10:42:25.686009+0000","last_became_peered":"2024-04-26T10:42:25.686009+0000","last_unstale":"2024-04-26T10:45:57.158521+0000","last_undegraded":"2024-04-26T10:45:57.158521+0000","last_fullsized":"2024-04-26T10:45:57.158521+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:54.627815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'442","reported_seq":567,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160853+0000","last_change":"2024-04-26T10:45:55.181074+0000","last_active":"2024-04-26T10:45:57.160853+0000","last_peered":"2024-04-26T10:45:57.160853+0000","last_clean":"2024-04-26T10:45:57.160853+0000","last_became_active":"2024-04-26T10:45:55.177751+0000","last_became_peered":"2024-04-26T10:45:55.177751+0000","last_unstale":"2024-04-26T10:45:57.160853+0000","last_undegraded":"2024-04-26T10:45:57.160853+0000","last_fullsized":"2024-04-26T10:45:57.160853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:01.323521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":34346,"num_write":406,"num_write_kb":96298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162129+0000","last_change":"2024-04-26T10:45:45.872099+0000","last_active":"2024-04-26T10:45:57.162129+0000","last_peered":"2024-04-26T10:45:57.162129+0000","last_clean":"2024-04-26T10:45:57.162129+0000","last_became_active":"2024-04-26T10:45:45.871741+0000","last_became_peered":"2024-04-26T10:45:45.871741+0000","last_unstale":"2024-04-26T10:45:57.162129+0000","last_undegraded":"2024-04-26T10:45:57.162129+0000","last_fullsized":"2024-04-26T10:45:57.162129+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:53.226378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"63'102","reported_seq":219,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158049+0000","last_change":"2024-04-26T10:45:56.160802+0000","last_active":"2024-04-26T10:45:57.158049+0000","last_peered":"2024-04-26T10:45:57.158049+0000","last_clean":"2024-04-26T10:45:57.158049+0000","last_became_active":"2024-04-26T10:45:56.160328+0000","last_became_peered":"2024-04-26T10:45:56.160328+0000","last_unstale":"2024-04-26T10:45:57.158049+0000","last_undegraded":"2024-04-26T10:45:57.158049+0000","last_fullsized":"2024-04-26T10:45:57.158049+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:47.864335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467631,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":44,"num_write_kb":1460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2935262,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'485","reported_seq":620,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162426+0000","last_change":"2024-04-26T10:45:57.165815+0000","last_active":"2024-04-26T10:45:58.162426+0000","last_peered":"2024-04-26T10:45:58.162426+0000","last_clean":"2024-04-26T10:45:58.162426+0000","last_became_active":"2024-04-26T10:45:57.162752+0000","last_became_peered":"2024-04-26T10:45:57.162752+0000","last_unstale":"2024-04-26T10:45:58.162426+0000","last_undegraded":"2024-04-26T10:45:58.162426+0000","last_fullsized":"2024-04-26T10:45:58.162426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:10.743149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27703,"num_write":454,"num_write_kb":121509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158512+0000","last_change":"2024-04-26T10:45:53.180892+0000","last_active":"2024-04-26T10:45:57.158512+0000","last_peered":"2024-04-26T10:45:57.158512+0000","last_clean":"2024-04-26T10:45:57.158512+0000","last_became_active":"2024-04-26T10:45:53.180675+0000","last_became_peered":"2024-04-26T10:45:53.180675+0000","last_unstale":"2024-04-26T10:45:57.158512+0000","last_undegraded":"2024-04-26T10:45:57.158512+0000","last_fullsized":"2024-04-26T10:45:57.158512+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:45.758505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"62'306","reported_seq":413,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159253+0000","last_change":"2024-04-26T10:45:48.865095+0000","last_active":"2024-04-26T10:45:57.159253+0000","last_peered":"2024-04-26T10:45:57.159253+0000","last_clean":"2024-04-26T10:45:57.159253+0000","last_became_active":"2024-04-26T10:45:48.864763+0000","last_became_peered":"2024-04-26T10:45:48.864763+0000","last_unstale":"2024-04-26T10:45:57.159253+0000","last_undegraded":"2024-04-26T10:45:57.159253+0000","last_fullsized":"2024-04-26T10:45:57.159253+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:12.665388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"63'336","reported_seq":748,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.165797+0000","last_change":"2024-04-26T10:45:58.165267+0000","last_active":"2024-04-26T10:45:58.165797+0000","last_peered":"2024-04-26T10:45:58.165797+0000","last_clean":"2024-04-26T10:45:58.165797+0000","last_became_active":"2024-04-26T10:45:58.162320+0000","last_became_peered":"2024-04-26T10:45:58.162320+0000","last_unstale":"2024-04-26T10:45:58.165797+0000","last_undegraded":"2024-04-26T10:45:58.165797+0000","last_fullsized":"2024-04-26T10:45:58.165797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:40.611364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12035,"num_write":314,"num_write_kb":29928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":306,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160636+0000","last_change":"2024-04-26T10:45:45.861233+0000","last_active":"2024-04-26T10:45:57.160636+0000","last_peered":"2024-04-26T10:45:57.160636+0000","last_clean":"2024-04-26T10:45:57.160636+0000","last_became_active":"2024-04-26T10:45:45.860924+0000","last_became_peered":"2024-04-26T10:45:45.860924+0000","last_unstale":"2024-04-26T10:45:57.160636+0000","last_undegraded":"2024-04-26T10:45:57.160636+0000","last_fullsized":"2024-04-26T10:45:57.160636+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:11.746110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"62'64","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160997+0000","last_change":"2024-04-26T10:45:45.861230+0000","last_active":"2024-04-26T10:45:57.160997+0000","last_peered":"2024-04-26T10:45:57.160997+0000","last_clean":"2024-04-26T10:45:57.160997+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:57.160997+0000","last_undegraded":"2024-04-26T10:45:57.160997+0000","last_fullsized":"2024-04-26T10:45:57.160997+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:53.564033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"63'421","reported_seq":513,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158851+0000","last_change":"2024-04-26T10:45:54.188138+0000","last_active":"2024-04-26T10:45:57.158851+0000","last_peered":"2024-04-26T10:45:57.158851+0000","last_clean":"2024-04-26T10:45:57.158851+0000","last_became_active":"2024-04-26T10:45:54.185053+0000","last_became_peered":"2024-04-26T10:45:54.185053+0000","last_unstale":"2024-04-26T10:45:57.158851+0000","last_undegraded":"2024-04-26T10:45:57.158851+0000","last_fullsized":"2024-04-26T10:45:57.158851+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:55:26.158040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28557,"num_write":385,"num_write_kb":93083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"62'480","reported_seq":553,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160417+0000","last_change":"2024-04-26T10:45:48.862894+0000","last_active":"2024-04-26T10:45:57.160417+0000","last_peered":"2024-04-26T10:45:57.160417+0000","last_clean":"2024-04-26T10:45:57.160417+0000","last_became_active":"2024-04-26T10:45:48.862564+0000","last_became_peered":"2024-04-26T10:45:48.862564+0000","last_unstale":"2024-04-26T10:45:57.160417+0000","last_undegraded":"2024-04-26T10:45:57.160417+0000","last_fullsized":"2024-04-26T10:45:57.160417+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:38.835403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":84,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158830+0000","last_change":"2024-04-26T10:42:21.405754+0000","last_active":"2024-04-26T10:45:57.158830+0000","last_peered":"2024-04-26T10:45:57.158830+0000","last_clean":"2024-04-26T10:45:57.158830+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:45:57.158830+0000","last_undegraded":"2024-04-26T10:45:57.158830+0000","last_fullsized":"2024-04-26T10:45:57.158830+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:47.123256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'352","reported_seq":776,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158735+0000","last_change":"2024-04-26T10:45:53.183401+0000","last_active":"2024-04-26T10:45:57.158735+0000","last_peered":"2024-04-26T10:45:57.158735+0000","last_clean":"2024-04-26T10:45:57.158735+0000","last_became_active":"2024-04-26T10:45:53.182454+0000","last_became_peered":"2024-04-26T10:45:53.182454+0000","last_unstale":"2024-04-26T10:45:57.158735+0000","last_undegraded":"2024-04-26T10:45:57.158735+0000","last_fullsized":"2024-04-26T10:45:57.158735+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:38.569626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":1905,"num_write":313,"num_write_kb":25573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"62'59","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158485+0000","last_change":"2024-04-26T10:45:53.177446+0000","last_active":"2024-04-26T10:45:57.158485+0000","last_peered":"2024-04-26T10:45:57.158485+0000","last_clean":"2024-04-26T10:45:57.158485+0000","last_became_active":"2024-04-26T10:45:53.176996+0000","last_became_peered":"2024-04-26T10:45:53.176996+0000","last_unstale":"2024-04-26T10:45:57.158485+0000","last_undegraded":"2024-04-26T10:45:57.158485+0000","last_fullsized":"2024-04-26T10:45:57.158485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:23.679423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":88,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161096+0000","last_change":"2024-04-26T10:45:53.175046+0000","last_active":"2024-04-26T10:45:57.161096+0000","last_peered":"2024-04-26T10:45:57.161096+0000","last_clean":"2024-04-26T10:45:57.161096+0000","last_became_active":"2024-04-26T10:45:53.174781+0000","last_became_peered":"2024-04-26T10:45:53.174781+0000","last_unstale":"2024-04-26T10:45:57.161096+0000","last_undegraded":"2024-04-26T10:45:57.161096+0000","last_fullsized":"2024-04-26T10:45:57.161096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:22.742084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'408","reported_seq":907,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160325+0000","last_change":"2024-04-26T10:45:54.186637+0000","last_active":"2024-04-26T10:45:57.160325+0000","last_peered":"2024-04-26T10:45:57.160325+0000","last_clean":"2024-04-26T10:45:57.160325+0000","last_became_active":"2024-04-26T10:45:54.185238+0000","last_became_peered":"2024-04-26T10:45:54.185238+0000","last_unstale":"2024-04-26T10:45:57.160325+0000","last_undegraded":"2024-04-26T10:45:57.160325+0000","last_fullsized":"2024-04-26T10:45:57.160325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:54.735683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19939,"num_write":382,"num_write_kb":63433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"62'55","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159609+0000","last_change":"2024-04-26T10:45:53.205131+0000","last_active":"2024-04-26T10:45:57.159609+0000","last_peered":"2024-04-26T10:45:57.159609+0000","last_clean":"2024-04-26T10:45:57.159609+0000","last_became_active":"2024-04-26T10:45:53.177305+0000","last_became_peered":"2024-04-26T10:45:53.177305+0000","last_unstale":"2024-04-26T10:45:57.159609+0000","last_undegraded":"2024-04-26T10:45:57.159609+0000","last_fullsized":"2024-04-26T10:45:57.159609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:30.829530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158557+0000","last_change":"2024-04-26T10:45:53.177593+0000","last_active":"2024-04-26T10:45:57.158557+0000","last_peered":"2024-04-26T10:45:57.158557+0000","last_clean":"2024-04-26T10:45:57.158557+0000","last_became_active":"2024-04-26T10:45:53.177249+0000","last_became_peered":"2024-04-26T10:45:53.177249+0000","last_unstale":"2024-04-26T10:45:57.158557+0000","last_undegraded":"2024-04-26T10:45:57.158557+0000","last_fullsized":"2024-04-26T10:45:57.158557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:41.564852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'418","reported_seq":877,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158405+0000","last_change":"2024-04-26T10:45:56.162729+0000","last_active":"2024-04-26T10:45:57.158405+0000","last_peered":"2024-04-26T10:45:57.158405+0000","last_clean":"2024-04-26T10:45:57.158405+0000","last_became_active":"2024-04-26T10:45:56.160440+0000","last_became_peered":"2024-04-26T10:45:56.160440+0000","last_unstale":"2024-04-26T10:45:57.158405+0000","last_undegraded":"2024-04-26T10:45:57.158405+0000","last_fullsized":"2024-04-26T10:45:57.158405+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:32.155653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20110,"num_write":390,"num_write_kb":75171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"64'66","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159242+0000","last_change":"2024-04-26T10:45:53.203538+0000","last_active":"2024-04-26T10:45:57.159242+0000","last_peered":"2024-04-26T10:45:57.159242+0000","last_clean":"2024-04-26T10:45:57.159242+0000","last_became_active":"2024-04-26T10:45:53.175946+0000","last_became_peered":"2024-04-26T10:45:53.175946+0000","last_unstale":"2024-04-26T10:45:57.159242+0000","last_undegraded":"2024-04-26T10:45:57.159242+0000","last_fullsized":"2024-04-26T10:45:57.159242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:15.016761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161004+0000","last_change":"2024-04-26T10:45:45.872224+0000","last_active":"2024-04-26T10:45:57.161004+0000","last_peered":"2024-04-26T10:45:57.161004+0000","last_clean":"2024-04-26T10:45:57.161004+0000","last_became_active":"2024-04-26T10:45:45.871923+0000","last_became_peered":"2024-04-26T10:45:45.871923+0000","last_unstale":"2024-04-26T10:45:57.161004+0000","last_undegraded":"2024-04-26T10:45:57.161004+0000","last_fullsized":"2024-04-26T10:45:57.161004+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:00.334874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"63'404","reported_seq":921,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158750+0000","last_change":"2024-04-26T10:45:54.184386+0000","last_active":"2024-04-26T10:45:57.158750+0000","last_peered":"2024-04-26T10:45:57.158750+0000","last_clean":"2024-04-26T10:45:57.158750+0000","last_became_active":"2024-04-26T10:45:54.181795+0000","last_became_peered":"2024-04-26T10:45:54.181795+0000","last_unstale":"2024-04-26T10:45:57.158750+0000","last_undegraded":"2024-04-26T10:45:57.158750+0000","last_fullsized":"2024-04-26T10:45:57.158750+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:10.290362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41262,"num_write":371,"num_write_kb":75820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"63'441","reported_seq":564,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161829+0000","last_change":"2024-04-26T10:45:54.188488+0000","last_active":"2024-04-26T10:45:57.161829+0000","last_peered":"2024-04-26T10:45:57.161829+0000","last_clean":"2024-04-26T10:45:57.161829+0000","last_became_active":"2024-04-26T10:45:54.185862+0000","last_became_peered":"2024-04-26T10:45:54.185862+0000","last_unstale":"2024-04-26T10:45:57.161829+0000","last_undegraded":"2024-04-26T10:45:57.161829+0000","last_fullsized":"2024-04-26T10:45:57.161829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:07.585438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31514,"num_write":408,"num_write_kb":107129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"64'431","reported_seq":520,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161320+0000","last_change":"2024-04-26T10:45:48.865579+0000","last_active":"2024-04-26T10:45:57.161320+0000","last_peered":"2024-04-26T10:45:57.161320+0000","last_clean":"2024-04-26T10:45:57.161320+0000","last_became_active":"2024-04-26T10:45:48.865212+0000","last_became_peered":"2024-04-26T10:45:48.865212+0000","last_unstale":"2024-04-26T10:45:57.161320+0000","last_undegraded":"2024-04-26T10:45:57.161320+0000","last_fullsized":"2024-04-26T10:45:57.161320+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:53.808562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9902610,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":9913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9896193,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"63'410","reported_seq":515,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160782+0000","last_change":"2024-04-26T10:45:54.184713+0000","last_active":"2024-04-26T10:45:57.160782+0000","last_peered":"2024-04-26T10:45:57.160782+0000","last_clean":"2024-04-26T10:45:57.160782+0000","last_became_active":"2024-04-26T10:45:54.182167+0000","last_became_peered":"2024-04-26T10:45:54.182167+0000","last_unstale":"2024-04-26T10:45:57.160782+0000","last_undegraded":"2024-04-26T10:45:57.160782+0000","last_fullsized":"2024-04-26T10:45:57.160782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:41:50.625629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12734,"num_write":373,"num_write_kb":34864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"63'84","reported_seq":183,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159590+0000","last_change":"2024-04-26T10:45:45.896842+0000","last_active":"2024-04-26T10:45:57.159590+0000","last_peered":"2024-04-26T10:45:57.159590+0000","last_clean":"2024-04-26T10:45:57.159590+0000","last_became_active":"2024-04-26T10:45:45.874746+0000","last_became_peered":"2024-04-26T10:45:45.874746+0000","last_unstale":"2024-04-26T10:45:57.159590+0000","last_undegraded":"2024-04-26T10:45:57.159590+0000","last_fullsized":"2024-04-26T10:45:57.159590+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:22.649667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"62'332","reported_seq":419,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161969+0000","last_change":"2024-04-26T10:45:56.161772+0000","last_active":"2024-04-26T10:45:57.161969+0000","last_peered":"2024-04-26T10:45:57.161969+0000","last_clean":"2024-04-26T10:45:57.161969+0000","last_became_active":"2024-04-26T10:45:56.161449+0000","last_became_peered":"2024-04-26T10:45:56.161449+0000","last_unstale":"2024-04-26T10:45:57.161969+0000","last_undegraded":"2024-04-26T10:45:57.161969+0000","last_fullsized":"2024-04-26T10:45:57.161969+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:09.499829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"63'487","reported_seq":1096,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158272+0000","last_change":"2024-04-26T10:45:51.160586+0000","last_active":"2024-04-26T10:45:57.158272+0000","last_peered":"2024-04-26T10:45:57.158272+0000","last_clean":"2024-04-26T10:45:57.158272+0000","last_became_active":"2024-04-26T10:45:51.159235+0000","last_became_peered":"2024-04-26T10:45:51.159235+0000","last_unstale":"2024-04-26T10:45:57.158272+0000","last_undegraded":"2024-04-26T10:45:57.158272+0000","last_fullsized":"2024-04-26T10:45:57.158272+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:54.234867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":43316,"num_write":468,"num_write_kb":77062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"62'61","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159565+0000","last_change":"2024-04-26T10:45:53.174204+0000","last_active":"2024-04-26T10:45:57.159565+0000","last_peered":"2024-04-26T10:45:57.159565+0000","last_clean":"2024-04-26T10:45:57.159565+0000","last_became_active":"2024-04-26T10:45:53.173851+0000","last_became_peered":"2024-04-26T10:45:53.173851+0000","last_unstale":"2024-04-26T10:45:57.159565+0000","last_undegraded":"2024-04-26T10:45:57.159565+0000","last_fullsized":"2024-04-26T10:45:57.159565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:50.698470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'457","reported_seq":536,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158314+0000","last_change":"2024-04-26T10:45:54.199966+0000","last_active":"2024-04-26T10:45:57.158314+0000","last_peered":"2024-04-26T10:45:57.158314+0000","last_clean":"2024-04-26T10:45:57.158314+0000","last_became_active":"2024-04-26T10:45:54.189622+0000","last_became_peered":"2024-04-26T10:45:54.189622+0000","last_unstale":"2024-04-26T10:45:57.158314+0000","last_undegraded":"2024-04-26T10:45:57.158314+0000","last_fullsized":"2024-04-26T10:45:57.158314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:53.540098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14848,"num_write":427,"num_write_kb":71903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'377","reported_seq":838,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160362+0000","last_change":"2024-04-26T10:45:49.867665+0000","last_active":"2024-04-26T10:45:57.160362+0000","last_peered":"2024-04-26T10:45:57.160362+0000","last_clean":"2024-04-26T10:45:57.160362+0000","last_became_active":"2024-04-26T10:45:49.866707+0000","last_became_peered":"2024-04-26T10:45:49.866707+0000","last_unstale":"2024-04-26T10:45:57.160362+0000","last_undegraded":"2024-04-26T10:45:57.160362+0000","last_fullsized":"2024-04-26T10:45:57.160362+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:23.401341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26932,"num_write":349,"num_write_kb":55611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"62'562","reported_seq":643,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158775+0000","last_change":"2024-04-26T10:42:25.683890+0000","last_active":"2024-04-26T10:45:57.158775+0000","last_peered":"2024-04-26T10:45:57.158775+0000","last_clean":"2024-04-26T10:45:57.158775+0000","last_became_active":"2024-04-26T10:42:25.683467+0000","last_became_peered":"2024-04-26T10:42:25.683467+0000","last_unstale":"2024-04-26T10:45:57.158775+0000","last_undegraded":"2024-04-26T10:45:57.158775+0000","last_fullsized":"2024-04-26T10:45:57.158775+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":8440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'425","reported_seq":878,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159122+0000","last_change":"2024-04-26T10:45:56.163245+0000","last_active":"2024-04-26T10:45:57.159122+0000","last_peered":"2024-04-26T10:45:57.159122+0000","last_clean":"2024-04-26T10:45:57.159122+0000","last_became_active":"2024-04-26T10:45:56.161315+0000","last_became_peered":"2024-04-26T10:45:56.161315+0000","last_unstale":"2024-04-26T10:45:57.159122+0000","last_undegraded":"2024-04-26T10:45:57.159122+0000","last_fullsized":"2024-04-26T10:45:57.159122+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:29.938631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":19004,"num_write":390,"num_write_kb":75524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"62'259","reported_seq":331,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158373+0000","last_change":"2024-04-26T10:45:56.160840+0000","last_active":"2024-04-26T10:45:57.158373+0000","last_peered":"2024-04-26T10:45:57.158373+0000","last_clean":"2024-04-26T10:45:57.158373+0000","last_became_active":"2024-04-26T10:45:56.160344+0000","last_became_peered":"2024-04-26T10:45:56.160344+0000","last_unstale":"2024-04-26T10:45:57.158373+0000","last_undegraded":"2024-04-26T10:45:57.158373+0000","last_fullsized":"2024-04-26T10:45:57.158373+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:50.232753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'418","reported_seq":929,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159365+0000","last_change":"2024-04-26T10:45:55.179671+0000","last_active":"2024-04-26T10:45:57.159365+0000","last_peered":"2024-04-26T10:45:57.159365+0000","last_clean":"2024-04-26T10:45:57.159365+0000","last_became_active":"2024-04-26T10:45:55.178079+0000","last_became_peered":"2024-04-26T10:45:55.178079+0000","last_unstale":"2024-04-26T10:45:57.159365+0000","last_undegraded":"2024-04-26T10:45:57.159365+0000","last_fullsized":"2024-04-26T10:45:57.159365+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:36.749926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":34476,"num_write":379,"num_write_kb":101645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"62'494","reported_seq":575,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159163+0000","last_change":"2024-04-26T10:42:25.688221+0000","last_active":"2024-04-26T10:45:57.159163+0000","last_peered":"2024-04-26T10:45:57.159163+0000","last_clean":"2024-04-26T10:45:57.159163+0000","last_became_active":"2024-04-26T10:42:25.687829+0000","last_became_peered":"2024-04-26T10:42:25.687829+0000","last_unstale":"2024-04-26T10:45:57.159163+0000","last_undegraded":"2024-04-26T10:45:57.159163+0000","last_fullsized":"2024-04-26T10:45:57.159163+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:05.939715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":12543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"63'406","reported_seq":586,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159122+0000","last_change":"2024-04-26T10:45:54.192178+0000","last_active":"2024-04-26T10:45:57.159122+0000","last_peered":"2024-04-26T10:45:57.159122+0000","last_clean":"2024-04-26T10:45:57.159122+0000","last_became_active":"2024-04-26T10:45:54.189591+0000","last_became_peered":"2024-04-26T10:45:54.189591+0000","last_unstale":"2024-04-26T10:45:57.159122+0000","last_undegraded":"2024-04-26T10:45:57.159122+0000","last_fullsized":"2024-04-26T10:45:57.159122+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:31.509288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":45941,"num_write":372,"num_write_kb":80011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"62'61","reported_seq":160,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160386+0000","last_change":"2024-04-26T10:45:45.895125+0000","last_active":"2024-04-26T10:45:57.160386+0000","last_peered":"2024-04-26T10:45:57.160386+0000","last_clean":"2024-04-26T10:45:57.160386+0000","last_became_active":"2024-04-26T10:45:45.874300+0000","last_became_peered":"2024-04-26T10:45:45.874300+0000","last_unstale":"2024-04-26T10:45:57.160386+0000","last_undegraded":"2024-04-26T10:45:57.160386+0000","last_fullsized":"2024-04-26T10:45:57.160386+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:26.528893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"63'375","reported_seq":823,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161710+0000","last_change":"2024-04-26T10:45:56.163670+0000","last_active":"2024-04-26T10:45:57.161710+0000","last_peered":"2024-04-26T10:45:57.161710+0000","last_clean":"2024-04-26T10:45:57.161710+0000","last_became_active":"2024-04-26T10:45:56.160416+0000","last_became_peered":"2024-04-26T10:45:56.160416+0000","last_unstale":"2024-04-26T10:45:57.161710+0000","last_undegraded":"2024-04-26T10:45:57.161710+0000","last_fullsized":"2024-04-26T10:45:57.161710+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:43.147179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16213,"num_write":354,"num_write_kb":54493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":332,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"62'276","reported_seq":368,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160846+0000","last_change":"2024-04-26T10:45:56.160817+0000","last_active":"2024-04-26T10:45:57.160846+0000","last_peered":"2024-04-26T10:45:57.160846+0000","last_clean":"2024-04-26T10:45:57.160846+0000","last_became_active":"2024-04-26T10:45:56.160414+0000","last_became_peered":"2024-04-26T10:45:56.160414+0000","last_unstale":"2024-04-26T10:45:57.160846+0000","last_undegraded":"2024-04-26T10:45:57.160846+0000","last_fullsized":"2024-04-26T10:45:57.160846+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:40.374381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"63'379","reported_seq":475,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161030+0000","last_change":"2024-04-26T10:45:53.177365+0000","last_active":"2024-04-26T10:45:57.161030+0000","last_peered":"2024-04-26T10:45:57.161030+0000","last_clean":"2024-04-26T10:45:57.161030+0000","last_became_active":"2024-04-26T10:45:53.173645+0000","last_became_peered":"2024-04-26T10:45:53.173645+0000","last_unstale":"2024-04-26T10:45:57.161030+0000","last_undegraded":"2024-04-26T10:45:57.161030+0000","last_fullsized":"2024-04-26T10:45:57.161030+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:32.390075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20480,"num_write":343,"num_write_kb":25788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"62'237","reported_seq":347,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159471+0000","last_change":"2024-04-26T10:45:48.867081+0000","last_active":"2024-04-26T10:45:57.159471+0000","last_peered":"2024-04-26T10:45:57.159471+0000","last_clean":"2024-04-26T10:45:57.159471+0000","last_became_active":"2024-04-26T10:45:48.866716+0000","last_became_peered":"2024-04-26T10:45:48.866716+0000","last_unstale":"2024-04-26T10:45:57.159471+0000","last_undegraded":"2024-04-26T10:45:57.159471+0000","last_fullsized":"2024-04-26T10:45:57.159471+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:16.712392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":12393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"63'419","reported_seq":570,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158951+0000","last_change":"2024-04-26T10:42:26.041729+0000","last_active":"2024-04-26T10:45:57.158951+0000","last_peered":"2024-04-26T10:45:57.158951+0000","last_clean":"2024-04-26T10:45:57.158951+0000","last_became_active":"2024-04-26T10:42:26.040504+0000","last_became_peered":"2024-04-26T10:42:26.040504+0000","last_unstale":"2024-04-26T10:45:57.158951+0000","last_undegraded":"2024-04-26T10:45:57.158951+0000","last_fullsized":"2024-04-26T10:45:57.158951+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39582,"num_write":378,"num_write_kb":54867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"62'61","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159083+0000","last_change":"2024-04-26T10:45:53.227750+0000","last_active":"2024-04-26T10:45:57.159083+0000","last_peered":"2024-04-26T10:45:57.159083+0000","last_clean":"2024-04-26T10:45:57.159083+0000","last_became_active":"2024-04-26T10:45:53.178804+0000","last_became_peered":"2024-04-26T10:45:53.178804+0000","last_unstale":"2024-04-26T10:45:57.159083+0000","last_undegraded":"2024-04-26T10:45:57.159083+0000","last_fullsized":"2024-04-26T10:45:57.159083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:56.795614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'437","reported_seq":523,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162221+0000","last_change":"2024-04-26T10:45:53.181155+0000","last_active":"2024-04-26T10:45:57.162221+0000","last_peered":"2024-04-26T10:45:57.162221+0000","last_clean":"2024-04-26T10:45:57.162221+0000","last_became_active":"2024-04-26T10:45:53.177071+0000","last_became_peered":"2024-04-26T10:45:53.177071+0000","last_unstale":"2024-04-26T10:45:57.162221+0000","last_undegraded":"2024-04-26T10:45:57.162221+0000","last_fullsized":"2024-04-26T10:45:57.162221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:34.219319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":7562,"num_write":400,"num_write_kb":26121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"62'58","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158941+0000","last_change":"2024-04-26T10:45:53.197669+0000","last_active":"2024-04-26T10:45:57.158941+0000","last_peered":"2024-04-26T10:45:57.158941+0000","last_clean":"2024-04-26T10:45:57.158941+0000","last_became_active":"2024-04-26T10:45:53.173542+0000","last_became_peered":"2024-04-26T10:45:53.173542+0000","last_unstale":"2024-04-26T10:45:57.158941+0000","last_undegraded":"2024-04-26T10:45:57.158941+0000","last_fullsized":"2024-04-26T10:45:57.158941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:34.409430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2672,"num_read_kb":1454712,"num_write":24538,"num_write_kb":4190103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26671,"ondisk_log_size":26671,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128811551,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":5770,"num_write_kb":129888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257691648,"data_stored":257623102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},"log_size":7595,"ondisk_log_size":7595,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738416,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":183416,"kb_used_data":80164,"kb_used_omap":1,"kb_used_meta":103230,"kb_avail":94188424,"statfs":{"total":96636764160,"available":96448946176,"internally_reserved":0,"allocated":82087936,"data_stored":81566103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105707974},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:45:25 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.20300000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42599999999999999,"15min":0.436},"min":{"1min":0.26000000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.22900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]}]},{"osd":1,"up_from":70,"seq":300647710725,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136028,"kb_used_data":90440,"kb_used_omap":7,"kb_used_meta":45560,"kb_avail":94235812,"statfs":{"total":96636764160,"available":96497471488,"internally_reserved":0,"allocated":92610560,"data_stored":92059263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7181,"internal_metadata":46654451},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738417,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214380,"kb_used_data":84896,"kb_used_omap":1,"kb_used_meta":129470,"kb_avail":94157460,"statfs":{"total":96636764160,"available":96417239040,"internally_reserved":0,"allocated":86933504,"data_stored":86396712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132577734},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Fri Apr 26 10:45:26 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.43099999999999999,"15min":0.44900000000000001},"min":{"1min":0.21199999999999999,"5min":0.183,"15min":0.183},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.442,"15min":0.46500000000000002},"min":{"1min":0.23499999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57199999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.65700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":85422080,"data_stored":85400264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":91099136,"data_stored":91062815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81170432,"data_stored":81160023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:46:05.186 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:46:05.515 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:46:05.515 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":84,"fsid":"9837de44-a9e8-4979-adc4-611f3ddc44ce","created":"2024-04-26T10:42:11.337159+0000","modified":"2024-04-26T10:45:58.156434+0000","last_up_change":"2024-04-26T10:45:44.834285+0000","last_in_change":"2024-04-26T10:42:12.136647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:42:19.632084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:42:19.779089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:42:24.266614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:42:25.014684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eabed31c-c043-43de-a756-e217d5287116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":28839},{"type":"v1","addr":"172.21.15.60:6801","nonce":28839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":28839},{"type":"v1","addr":"172.21.15.60:6803","nonce":28839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":28839},{"type":"v1","addr":"172.21.15.60:6807","nonce":28839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":28839},{"type":"v1","addr":"172.21.15.60:6805","nonce":28839}]},"public_addr":"172.21.15.60:6801/28839","cluster_addr":"172.21.15.60:6803/28839","heartbeat_back_addr":"172.21.15.60:6807/28839","heartbeat_front_addr":"172.21.15.60:6805/28839","state":["exists","up"]},{"osd":1,"uuid":"7013621f-db09-4096-bc24-428bb170edd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":25,"up_from":70,"up_thru":83,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":5359},{"type":"v1","addr":"172.21.15.87:6801","nonce":5359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":5359},{"type":"v1","addr":"172.21.15.87:6803","nonce":5359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":5359},{"type":"v1","addr":"172.21.15.87:6807","nonce":5359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":5359},{"type":"v1","addr":"172.21.15.87:6805","nonce":5359}]},"public_addr":"172.21.15.87:6801/5359","cluster_addr":"172.21.15.87:6803/5359","heartbeat_back_addr":"172.21.15.87:6807/5359","heartbeat_front_addr":"172.21.15.87:6805/5359","state":["exists","up"]},{"osd":2,"uuid":"a1efeadd-cf55-4ed5-9918-36607fd62229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":28733},{"type":"v1","addr":"172.21.15.195:6801","nonce":28733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":28733},{"type":"v1","addr":"172.21.15.195:6803","nonce":28733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":28733},{"type":"v1","addr":"172.21.15.195:6807","nonce":28733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":28733},{"type":"v1","addr":"172.21.15.195:6805","nonce":28733}]},"public_addr":"172.21.15.195:6801/28733","cluster_addr":"172.21.15.195:6803/28733","heartbeat_back_addr":"172.21.15.195:6807/28733","heartbeat_front_addr":"172.21.15.195:6805/28733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.152046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.177399+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.123066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":0,"to":1}]},{"pgid":"4.6","mappings":[{"from":0,"to":1}]},{"pgid":"4.12","mappings":[{"from":2,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:46:06.529 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T10:46:06.529 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T10:46:06.668 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-04-26T10:46:06.668 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T10:46:06.669 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-04-26T10:46:06.680 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T10:46:06.972 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T10:46:06.985 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T10:46:06.985 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T10:46:07.110 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-04-26T10:46:07.110 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-26T10:46:07.110 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-04-26T10:46:07.121 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T10:46:07.413 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T10:46:07.427 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T10:46:07.428 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T10:46:07.553 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-04-26T10:46:07.554 INFO:teuthology.orchestra.run.smithi049.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T10:46:07.554 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-04-26T10:46:07.564 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T10:46:07.857 INFO:teuthology.orchestra.run.smithi049.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T10:46:07.871 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:46:08.165 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:46:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:46:08.176 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-04-26T10:46:07.651553+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129401919,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2852,"num_read_kb":1456290,"num_write":30511,"num_write_kb":4323451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9253,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34423,"ondisk_log_size":34423,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":533824,"kb_used_data":255500,"kb_used_omap":10,"kb_used_meta":278261,"kb_avail":282581696,"statfs":{"total":289910292480,"available":289363656704,"internally_reserved":0,"allocated":261632000,"data_stored":260022078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10369,"internal_metadata":284940159},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-494,"num_objects_misplaced":-354,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1332,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002048"},"pg_stats":[{"pgid":"4.3f","version":"63'415","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160204+0000","last_change":"2024-04-26T10:42:26.045527+0000","last_active":"2024-04-26T10:45:57.160204+0000","last_peered":"2024-04-26T10:45:57.160204+0000","last_clean":"2024-04-26T10:45:57.160204+0000","last_became_active":"2024-04-26T10:42:26.044597+0000","last_became_peered":"2024-04-26T10:42:26.044597+0000","last_unstale":"2024-04-26T10:45:57.160204+0000","last_undegraded":"2024-04-26T10:45:57.160204+0000","last_fullsized":"2024-04-26T10:45:57.160204+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:26:10.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22963,"num_write":385,"num_write_kb":71406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"63'396","reported_seq":521,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159219+0000","last_change":"2024-04-26T10:45:54.194523+0000","last_active":"2024-04-26T10:45:57.159219+0000","last_peered":"2024-04-26T10:45:57.159219+0000","last_clean":"2024-04-26T10:45:57.159219+0000","last_became_active":"2024-04-26T10:45:54.192613+0000","last_became_peered":"2024-04-26T10:45:54.192613+0000","last_unstale":"2024-04-26T10:45:57.159219+0000","last_undegraded":"2024-04-26T10:45:57.159219+0000","last_fullsized":"2024-04-26T10:45:57.159219+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:22.723004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9499,"num_write":371,"num_write_kb":38601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"63'366","reported_seq":449,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161698+0000","last_change":"2024-04-26T10:45:55.183758+0000","last_active":"2024-04-26T10:45:57.161698+0000","last_peered":"2024-04-26T10:45:57.161698+0000","last_clean":"2024-04-26T10:45:57.161698+0000","last_became_active":"2024-04-26T10:45:55.180991+0000","last_became_peered":"2024-04-26T10:45:55.180991+0000","last_unstale":"2024-04-26T10:45:57.161698+0000","last_undegraded":"2024-04-26T10:45:57.161698+0000","last_fullsized":"2024-04-26T10:45:57.161698+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:29.645448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6211,"num_write":338,"num_write_kb":38844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"63'394","reported_seq":545,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160935+0000","last_change":"2024-04-26T10:45:51.162341+0000","last_active":"2024-04-26T10:45:57.160935+0000","last_peered":"2024-04-26T10:45:57.160935+0000","last_clean":"2024-04-26T10:45:57.160935+0000","last_became_active":"2024-04-26T10:45:51.159099+0000","last_became_peered":"2024-04-26T10:45:51.159099+0000","last_unstale":"2024-04-26T10:45:57.160935+0000","last_undegraded":"2024-04-26T10:45:57.160935+0000","last_fullsized":"2024-04-26T10:45:57.160935+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:18.605866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":52323,"num_write":357,"num_write_kb":63323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"63'409","reported_seq":507,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160398+0000","last_change":"2024-04-26T10:42:26.041191+0000","last_active":"2024-04-26T10:45:57.160398+0000","last_peered":"2024-04-26T10:45:57.160398+0000","last_clean":"2024-04-26T10:45:57.160398+0000","last_became_active":"2024-04-26T10:42:26.040487+0000","last_became_peered":"2024-04-26T10:42:26.040487+0000","last_unstale":"2024-04-26T10:45:57.160398+0000","last_undegraded":"2024-04-26T10:45:57.160398+0000","last_fullsized":"2024-04-26T10:45:57.160398+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:59.807461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":372,"num_write_kb":42764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'385","reported_seq":464,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161234+0000","last_change":"2024-04-26T10:45:49.864662+0000","last_active":"2024-04-26T10:45:57.161234+0000","last_peered":"2024-04-26T10:45:57.161234+0000","last_clean":"2024-04-26T10:45:57.161234+0000","last_became_active":"2024-04-26T10:45:49.861811+0000","last_became_peered":"2024-04-26T10:45:49.861811+0000","last_unstale":"2024-04-26T10:45:57.161234+0000","last_undegraded":"2024-04-26T10:45:57.161234+0000","last_fullsized":"2024-04-26T10:45:57.161234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:25.549464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4124,"num_write":356,"num_write_kb":69857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"63'425","reported_seq":534,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160809+0000","last_change":"2024-04-26T10:45:50.869572+0000","last_active":"2024-04-26T10:45:57.160809+0000","last_peered":"2024-04-26T10:45:57.160809+0000","last_clean":"2024-04-26T10:45:57.160809+0000","last_became_active":"2024-04-26T10:45:50.866996+0000","last_became_peered":"2024-04-26T10:45:50.866996+0000","last_unstale":"2024-04-26T10:45:57.160809+0000","last_undegraded":"2024-04-26T10:45:57.160809+0000","last_fullsized":"2024-04-26T10:45:57.160809+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:17.631869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13036,"num_write":390,"num_write_kb":67193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"63'399","reported_seq":507,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.164304+0000","last_change":"2024-04-26T10:45:58.164304+0000","last_active":"2024-04-26T10:45:58.164304+0000","last_peered":"2024-04-26T10:45:58.164304+0000","last_clean":"2024-04-26T10:45:58.164304+0000","last_became_active":"2024-04-26T10:45:58.162532+0000","last_became_peered":"2024-04-26T10:45:58.162532+0000","last_unstale":"2024-04-26T10:45:58.164304+0000","last_undegraded":"2024-04-26T10:45:58.164304+0000","last_fullsized":"2024-04-26T10:45:58.164304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:50.164416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25678,"num_write":356,"num_write_kb":116549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"63'442","reported_seq":589,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159518+0000","last_change":"2024-04-26T10:42:26.045893+0000","last_active":"2024-04-26T10:45:57.159518+0000","last_peered":"2024-04-26T10:45:57.159518+0000","last_clean":"2024-04-26T10:45:57.159518+0000","last_became_active":"2024-04-26T10:42:26.045177+0000","last_became_peered":"2024-04-26T10:42:26.045177+0000","last_unstale":"2024-04-26T10:45:57.159518+0000","last_undegraded":"2024-04-26T10:45:57.159518+0000","last_fullsized":"2024-04-26T10:45:57.159518+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:56.640567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35111,"num_write":413,"num_write_kb":60306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'393","reported_seq":515,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159399+0000","last_change":"2024-04-26T10:45:54.192984+0000","last_active":"2024-04-26T10:45:57.159399+0000","last_peered":"2024-04-26T10:45:57.159399+0000","last_clean":"2024-04-26T10:45:57.159399+0000","last_became_active":"2024-04-26T10:45:54.191514+0000","last_became_peered":"2024-04-26T10:45:54.191514+0000","last_unstale":"2024-04-26T10:45:57.159399+0000","last_undegraded":"2024-04-26T10:45:57.159399+0000","last_fullsized":"2024-04-26T10:45:57.159399+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:33.809143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5355,"num_write":351,"num_write_kb":38901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"63'377","reported_seq":482,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161319+0000","last_change":"2024-04-26T10:45:49.865172+0000","last_active":"2024-04-26T10:45:57.161319+0000","last_peered":"2024-04-26T10:45:57.161319+0000","last_clean":"2024-04-26T10:45:57.161319+0000","last_became_active":"2024-04-26T10:45:49.862718+0000","last_became_peered":"2024-04-26T10:45:49.862718+0000","last_unstale":"2024-04-26T10:45:57.161319+0000","last_undegraded":"2024-04-26T10:45:57.161319+0000","last_fullsized":"2024-04-26T10:45:57.161319+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:43.129958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18030,"num_write":355,"num_write_kb":67044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"63'365","reported_seq":808,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.167133+0000","last_change":"2024-04-26T10:45:57.166219+0000","last_active":"2024-04-26T10:45:57.167133+0000","last_peered":"2024-04-26T10:45:57.167133+0000","last_clean":"2024-04-26T10:45:57.167133+0000","last_became_active":"2024-04-26T10:45:57.164964+0000","last_became_peered":"2024-04-26T10:45:57.164964+0000","last_unstale":"2024-04-26T10:45:57.167133+0000","last_undegraded":"2024-04-26T10:45:57.167133+0000","last_fullsized":"2024-04-26T10:45:57.167133+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:55.064831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14866,"num_write":337,"num_write_kb":71188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'397","reported_seq":490,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160289+0000","last_change":"2024-04-26T10:42:26.042607+0000","last_active":"2024-04-26T10:45:57.160289+0000","last_peered":"2024-04-26T10:45:57.160289+0000","last_clean":"2024-04-26T10:45:57.160289+0000","last_became_active":"2024-04-26T10:42:26.041617+0000","last_became_peered":"2024-04-26T10:42:26.041617+0000","last_unstale":"2024-04-26T10:45:57.160289+0000","last_undegraded":"2024-04-26T10:45:57.160289+0000","last_fullsized":"2024-04-26T10:45:57.160289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:38.606552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8192,"num_write":362,"num_write_kb":54822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"63'408","reported_seq":487,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161186+0000","last_change":"2024-04-26T10:45:53.181618+0000","last_active":"2024-04-26T10:45:57.161186+0000","last_peered":"2024-04-26T10:45:57.161186+0000","last_clean":"2024-04-26T10:45:57.161186+0000","last_became_active":"2024-04-26T10:45:53.177677+0000","last_became_peered":"2024-04-26T10:45:53.177677+0000","last_unstale":"2024-04-26T10:45:57.161186+0000","last_undegraded":"2024-04-26T10:45:57.161186+0000","last_fullsized":"2024-04-26T10:45:57.161186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:06.719053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4688,"num_write":374,"num_write_kb":21766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"63'409","reported_seq":522,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160533+0000","last_change":"2024-04-26T10:45:54.188625+0000","last_active":"2024-04-26T10:45:57.160533+0000","last_peered":"2024-04-26T10:45:57.160533+0000","last_clean":"2024-04-26T10:45:57.160533+0000","last_became_active":"2024-04-26T10:45:54.185826+0000","last_became_peered":"2024-04-26T10:45:54.185826+0000","last_unstale":"2024-04-26T10:45:57.160533+0000","last_undegraded":"2024-04-26T10:45:57.160533+0000","last_fullsized":"2024-04-26T10:45:57.160533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:48.401265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25968,"num_write":366,"num_write_kb":75698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"63'460","reported_seq":562,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162279+0000","last_change":"2024-04-26T10:45:53.176893+0000","last_active":"2024-04-26T10:45:57.162279+0000","last_peered":"2024-04-26T10:45:57.162279+0000","last_clean":"2024-04-26T10:45:57.162279+0000","last_became_active":"2024-04-26T10:45:53.174699+0000","last_became_peered":"2024-04-26T10:45:53.174699+0000","last_unstale":"2024-04-26T10:45:57.162279+0000","last_undegraded":"2024-04-26T10:45:57.162279+0000","last_fullsized":"2024-04-26T10:45:57.162279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:41.919177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16269,"num_write":426,"num_write_kb":67839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"63'393","reported_seq":512,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159625+0000","last_change":"2024-04-26T10:42:26.049338+0000","last_active":"2024-04-26T10:45:57.159625+0000","last_peered":"2024-04-26T10:45:57.159625+0000","last_clean":"2024-04-26T10:45:57.159625+0000","last_became_active":"2024-04-26T10:42:26.049014+0000","last_became_peered":"2024-04-26T10:42:26.049014+0000","last_unstale":"2024-04-26T10:45:57.159625+0000","last_undegraded":"2024-04-26T10:45:57.159625+0000","last_fullsized":"2024-04-26T10:45:57.159625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:43.329958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":25712,"num_write":362,"num_write_kb":42020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'428","reported_seq":554,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159673+0000","last_change":"2024-04-26T10:45:54.192786+0000","last_active":"2024-04-26T10:45:57.159673+0000","last_peered":"2024-04-26T10:45:57.159673+0000","last_clean":"2024-04-26T10:45:57.159673+0000","last_became_active":"2024-04-26T10:45:54.189852+0000","last_became_peered":"2024-04-26T10:45:54.189852+0000","last_unstale":"2024-04-26T10:45:57.159673+0000","last_undegraded":"2024-04-26T10:45:57.159673+0000","last_fullsized":"2024-04-26T10:45:57.159673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:29.968564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12316,"num_write":384,"num_write_kb":87656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"63'446","reported_seq":587,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158810+0000","last_change":"2024-04-26T10:45:54.186962+0000","last_active":"2024-04-26T10:45:57.158810+0000","last_peered":"2024-04-26T10:45:57.158810+0000","last_clean":"2024-04-26T10:45:57.158810+0000","last_became_active":"2024-04-26T10:45:54.184063+0000","last_became_peered":"2024-04-26T10:45:54.184063+0000","last_unstale":"2024-04-26T10:45:57.158810+0000","last_undegraded":"2024-04-26T10:45:57.158810+0000","last_fullsized":"2024-04-26T10:45:57.158810+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:59.349649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":53414,"num_write":401,"num_write_kb":80048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":550,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161291+0000","last_change":"2024-04-26T10:45:50.869971+0000","last_active":"2024-04-26T10:45:57.161291+0000","last_peered":"2024-04-26T10:45:57.161291+0000","last_clean":"2024-04-26T10:45:57.161291+0000","last_became_active":"2024-04-26T10:45:50.867680+0000","last_became_peered":"2024-04-26T10:45:50.867680+0000","last_unstale":"2024-04-26T10:45:57.161291+0000","last_undegraded":"2024-04-26T10:45:57.161291+0000","last_fullsized":"2024-04-26T10:45:57.161291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:17.680371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19859,"num_write":405,"num_write_kb":51119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"63'408","reported_seq":862,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161853+0000","last_change":"2024-04-26T10:45:56.163683+0000","last_active":"2024-04-26T10:45:57.161853+0000","last_peered":"2024-04-26T10:45:57.161853+0000","last_clean":"2024-04-26T10:45:57.161853+0000","last_became_active":"2024-04-26T10:45:56.160360+0000","last_became_peered":"2024-04-26T10:45:56.160360+0000","last_unstale":"2024-04-26T10:45:57.161853+0000","last_undegraded":"2024-04-26T10:45:57.161853+0000","last_fullsized":"2024-04-26T10:45:57.161853+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:44.845909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":15372,"num_write":366,"num_write_kb":75855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"63'452","reported_seq":1017,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158921+0000","last_change":"2024-04-26T10:45:52.175372+0000","last_active":"2024-04-26T10:45:57.158921+0000","last_peered":"2024-04-26T10:45:57.158921+0000","last_clean":"2024-04-26T10:45:57.158921+0000","last_became_active":"2024-04-26T10:45:52.173702+0000","last_became_peered":"2024-04-26T10:45:52.173702+0000","last_unstale":"2024-04-26T10:45:57.158921+0000","last_undegraded":"2024-04-26T10:45:57.158921+0000","last_fullsized":"2024-04-26T10:45:57.158921+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:55.459452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43729,"num_write":421,"num_write_kb":79804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"63'408","reported_seq":882,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.163833+0000","last_change":"2024-04-26T10:45:57.163475+0000","last_active":"2024-04-26T10:45:57.163833+0000","last_peered":"2024-04-26T10:45:57.163833+0000","last_clean":"2024-04-26T10:45:57.163833+0000","last_became_active":"2024-04-26T10:45:57.162147+0000","last_became_peered":"2024-04-26T10:45:57.162147+0000","last_unstale":"2024-04-26T10:45:57.163833+0000","last_undegraded":"2024-04-26T10:45:57.163833+0000","last_fullsized":"2024-04-26T10:45:57.163833+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:18.287163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":30320,"num_write":372,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'453","reported_seq":615,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158621+0000","last_change":"2024-04-26T10:45:54.184330+0000","last_active":"2024-04-26T10:45:57.158621+0000","last_peered":"2024-04-26T10:45:57.158621+0000","last_clean":"2024-04-26T10:45:57.158621+0000","last_became_active":"2024-04-26T10:45:54.181881+0000","last_became_peered":"2024-04-26T10:45:54.181881+0000","last_unstale":"2024-04-26T10:45:57.158621+0000","last_undegraded":"2024-04-26T10:45:57.158621+0000","last_fullsized":"2024-04-26T10:45:57.158621+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:02.066091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":19864,"num_write":422,"num_write_kb":51638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"63'439","reported_seq":954,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160299+0000","last_change":"2024-04-26T10:45:48.867766+0000","last_active":"2024-04-26T10:45:57.160299+0000","last_peered":"2024-04-26T10:45:57.160299+0000","last_clean":"2024-04-26T10:45:57.160299+0000","last_became_active":"2024-04-26T10:45:48.866159+0000","last_became_peered":"2024-04-26T10:45:48.866159+0000","last_unstale":"2024-04-26T10:45:57.160299+0000","last_undegraded":"2024-04-26T10:45:57.160299+0000","last_fullsized":"2024-04-26T10:45:57.160299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:39.736649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8912,"num_write":417,"num_write_kb":46575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"63'513","reported_seq":1158,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158983+0000","last_change":"2024-04-26T10:45:51.160003+0000","last_active":"2024-04-26T10:45:57.158983+0000","last_peered":"2024-04-26T10:45:57.158983+0000","last_clean":"2024-04-26T10:45:57.158983+0000","last_became_active":"2024-04-26T10:45:51.158698+0000","last_became_peered":"2024-04-26T10:45:51.158698+0000","last_unstale":"2024-04-26T10:45:57.158983+0000","last_undegraded":"2024-04-26T10:45:57.158983+0000","last_fullsized":"2024-04-26T10:45:57.158983+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:36.990095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":70751,"num_write":473,"num_write_kb":88902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'406","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161212+0000","last_change":"2024-04-26T10:45:56.164805+0000","last_active":"2024-04-26T10:45:57.161212+0000","last_peered":"2024-04-26T10:45:57.161212+0000","last_clean":"2024-04-26T10:45:57.161212+0000","last_became_active":"2024-04-26T10:45:56.162419+0000","last_became_peered":"2024-04-26T10:45:56.162419+0000","last_unstale":"2024-04-26T10:45:57.161212+0000","last_undegraded":"2024-04-26T10:45:57.161212+0000","last_fullsized":"2024-04-26T10:45:57.161212+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:53.474847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":32121,"num_write":372,"num_write_kb":60163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"63'402","reported_seq":867,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.167147+0000","last_change":"2024-04-26T10:45:57.166225+0000","last_active":"2024-04-26T10:45:57.167147+0000","last_peered":"2024-04-26T10:45:57.167147+0000","last_clean":"2024-04-26T10:45:57.167147+0000","last_became_active":"2024-04-26T10:45:57.165064+0000","last_became_peered":"2024-04-26T10:45:57.165064+0000","last_unstale":"2024-04-26T10:45:57.167147+0000","last_undegraded":"2024-04-26T10:45:57.167147+0000","last_fullsized":"2024-04-26T10:45:57.167147+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:36:52.273357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":6824,"num_write":378,"num_write_kb":72156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"63'407","reported_seq":888,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.166516+0000","last_change":"2024-04-26T10:45:58.163989+0000","last_active":"2024-04-26T10:45:58.166516+0000","last_peered":"2024-04-26T10:45:58.166516+0000","last_clean":"2024-04-26T10:45:58.166516+0000","last_became_active":"2024-04-26T10:45:58.161850+0000","last_became_peered":"2024-04-26T10:45:58.161850+0000","last_unstale":"2024-04-26T10:45:58.166516+0000","last_undegraded":"2024-04-26T10:45:58.166516+0000","last_fullsized":"2024-04-26T10:45:58.166516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:17:09.805958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25898,"num_write":372,"num_write_kb":59274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":346,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'490","reported_seq":1058,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159063+0000","last_change":"2024-04-26T10:45:55.179785+0000","last_active":"2024-04-26T10:45:57.159063+0000","last_peered":"2024-04-26T10:45:57.159063+0000","last_clean":"2024-04-26T10:45:57.159063+0000","last_became_active":"2024-04-26T10:45:55.178083+0000","last_became_peered":"2024-04-26T10:45:55.178083+0000","last_unstale":"2024-04-26T10:45:57.159063+0000","last_undegraded":"2024-04-26T10:45:57.159063+0000","last_fullsized":"2024-04-26T10:45:57.159063+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:23.269957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33597,"num_write":449,"num_write_kb":87981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"63'474","reported_seq":563,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158167+0000","last_change":"2024-04-26T10:45:54.189228+0000","last_active":"2024-04-26T10:45:57.158167+0000","last_peered":"2024-04-26T10:45:57.158167+0000","last_clean":"2024-04-26T10:45:57.158167+0000","last_became_active":"2024-04-26T10:45:54.186011+0000","last_became_peered":"2024-04-26T10:45:54.186011+0000","last_unstale":"2024-04-26T10:45:57.158167+0000","last_undegraded":"2024-04-26T10:45:57.158167+0000","last_fullsized":"2024-04-26T10:45:57.158167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:50.355145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30886,"num_write":441,"num_write_kb":118807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'443","reported_seq":547,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162005+0000","last_change":"2024-04-26T10:45:48.864423+0000","last_active":"2024-04-26T10:45:57.162005+0000","last_peered":"2024-04-26T10:45:57.162005+0000","last_clean":"2024-04-26T10:45:57.162005+0000","last_became_active":"2024-04-26T10:45:48.861918+0000","last_became_peered":"2024-04-26T10:45:48.861918+0000","last_unstale":"2024-04-26T10:45:57.162005+0000","last_undegraded":"2024-04-26T10:45:57.162005+0000","last_fullsized":"2024-04-26T10:45:57.162005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:11.356135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20556,"num_write":413,"num_write_kb":91647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"63'376","reported_seq":478,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159241+0000","last_change":"2024-04-26T10:42:26.041757+0000","last_active":"2024-04-26T10:45:57.159241+0000","last_peered":"2024-04-26T10:45:57.159241+0000","last_clean":"2024-04-26T10:45:57.159241+0000","last_became_active":"2024-04-26T10:42:26.040920+0000","last_became_peered":"2024-04-26T10:42:26.040920+0000","last_unstale":"2024-04-26T10:45:57.159241+0000","last_undegraded":"2024-04-26T10:45:57.159241+0000","last_fullsized":"2024-04-26T10:45:57.159241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:28.414307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10124,"num_write":344,"num_write_kb":66899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"62'453","reported_seq":533,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161061+0000","last_change":"2024-04-26T10:45:48.862782+0000","last_active":"2024-04-26T10:45:57.161061+0000","last_peered":"2024-04-26T10:45:57.161061+0000","last_clean":"2024-04-26T10:45:57.161061+0000","last_became_active":"2024-04-26T10:45:48.862424+0000","last_became_peered":"2024-04-26T10:45:48.862424+0000","last_unstale":"2024-04-26T10:45:57.161061+0000","last_undegraded":"2024-04-26T10:45:57.161061+0000","last_fullsized":"2024-04-26T10:45:57.161061+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:16.548893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"63'403","reported_seq":520,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159394+0000","last_change":"2024-04-26T10:42:26.041850+0000","last_active":"2024-04-26T10:45:57.159394+0000","last_peered":"2024-04-26T10:45:57.159394+0000","last_clean":"2024-04-26T10:45:57.159394+0000","last_became_active":"2024-04-26T10:42:26.040464+0000","last_became_peered":"2024-04-26T10:42:26.040464+0000","last_unstale":"2024-04-26T10:45:57.159394+0000","last_undegraded":"2024-04-26T10:45:57.159394+0000","last_fullsized":"2024-04-26T10:45:57.159394+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:56.051496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24588,"num_write":363,"num_write_kb":51190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"62'49","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158264+0000","last_change":"2024-04-26T10:45:45.862317+0000","last_active":"2024-04-26T10:45:57.158264+0000","last_peered":"2024-04-26T10:45:57.158264+0000","last_clean":"2024-04-26T10:45:57.158264+0000","last_became_active":"2024-04-26T10:45:45.862029+0000","last_became_peered":"2024-04-26T10:45:45.862029+0000","last_unstale":"2024-04-26T10:45:57.158264+0000","last_undegraded":"2024-04-26T10:45:57.158264+0000","last_fullsized":"2024-04-26T10:45:57.158264+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:02.521534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'407","reported_seq":887,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159309+0000","last_change":"2024-04-26T10:45:52.170710+0000","last_active":"2024-04-26T10:45:57.159309+0000","last_peered":"2024-04-26T10:45:57.159309+0000","last_clean":"2024-04-26T10:45:57.159309+0000","last_became_active":"2024-04-26T10:45:52.169295+0000","last_became_peered":"2024-04-26T10:45:52.169295+0000","last_unstale":"2024-04-26T10:45:57.159309+0000","last_undegraded":"2024-04-26T10:45:57.159309+0000","last_fullsized":"2024-04-26T10:45:57.159309+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:10.995530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":7077,"num_write":367,"num_write_kb":42434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"62'66","reported_seq":160,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159731+0000","last_change":"2024-04-26T10:45:45.874440+0000","last_active":"2024-04-26T10:45:57.159731+0000","last_peered":"2024-04-26T10:45:57.159731+0000","last_clean":"2024-04-26T10:45:57.159731+0000","last_became_active":"2024-04-26T10:45:45.874030+0000","last_became_peered":"2024-04-26T10:45:45.874030+0000","last_unstale":"2024-04-26T10:45:57.159731+0000","last_undegraded":"2024-04-26T10:45:57.159731+0000","last_fullsized":"2024-04-26T10:45:57.159731+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:18:22.711644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"63'406","reported_seq":898,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159545+0000","last_change":"2024-04-26T10:45:49.863376+0000","last_active":"2024-04-26T10:45:57.159545+0000","last_peered":"2024-04-26T10:45:57.159545+0000","last_clean":"2024-04-26T10:45:57.159545+0000","last_became_active":"2024-04-26T10:45:49.861979+0000","last_became_peered":"2024-04-26T10:45:49.861979+0000","last_unstale":"2024-04-26T10:45:57.159545+0000","last_undegraded":"2024-04-26T10:45:57.159545+0000","last_fullsized":"2024-04-26T10:45:57.159545+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:16.553043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":25977,"num_write":374,"num_write_kb":104172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'66","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161876+0000","last_change":"2024-04-26T10:45:45.871507+0000","last_active":"2024-04-26T10:45:57.161876+0000","last_peered":"2024-04-26T10:45:57.161876+0000","last_clean":"2024-04-26T10:45:57.161876+0000","last_became_active":"2024-04-26T10:45:45.871120+0000","last_became_peered":"2024-04-26T10:45:45.871120+0000","last_unstale":"2024-04-26T10:45:57.161876+0000","last_undegraded":"2024-04-26T10:45:57.161876+0000","last_fullsized":"2024-04-26T10:45:57.161876+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:56.162347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"62'200","reported_seq":281,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161233+0000","last_change":"2024-04-26T10:45:48.866225+0000","last_active":"2024-04-26T10:45:57.161233+0000","last_peered":"2024-04-26T10:45:57.161233+0000","last_clean":"2024-04-26T10:45:57.161233+0000","last_became_active":"2024-04-26T10:45:48.865878+0000","last_became_peered":"2024-04-26T10:45:48.865878+0000","last_unstale":"2024-04-26T10:45:57.161233+0000","last_undegraded":"2024-04-26T10:45:57.161233+0000","last_fullsized":"2024-04-26T10:45:57.161233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:42:39.518391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"63'415","reported_seq":908,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.164897+0000","last_change":"2024-04-26T10:45:57.164421+0000","last_active":"2024-04-26T10:45:57.164897+0000","last_peered":"2024-04-26T10:45:57.164897+0000","last_clean":"2024-04-26T10:45:57.164897+0000","last_became_active":"2024-04-26T10:45:57.163263+0000","last_became_peered":"2024-04-26T10:45:57.163263+0000","last_unstale":"2024-04-26T10:45:57.164897+0000","last_undegraded":"2024-04-26T10:45:57.164897+0000","last_fullsized":"2024-04-26T10:45:57.164897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:06:16.262869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15757,"num_write":380,"num_write_kb":54727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"62'342","reported_seq":448,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159793+0000","last_change":"2024-04-26T10:45:48.866915+0000","last_active":"2024-04-26T10:45:57.159793+0000","last_peered":"2024-04-26T10:45:57.159793+0000","last_clean":"2024-04-26T10:45:57.159793+0000","last_became_active":"2024-04-26T10:45:48.866497+0000","last_became_peered":"2024-04-26T10:45:48.866497+0000","last_unstale":"2024-04-26T10:45:57.159793+0000","last_undegraded":"2024-04-26T10:45:57.159793+0000","last_fullsized":"2024-04-26T10:45:57.159793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:04.796882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"63'481","reported_seq":670,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158706+0000","last_change":"2024-04-26T10:45:54.184646+0000","last_active":"2024-04-26T10:45:57.158706+0000","last_peered":"2024-04-26T10:45:57.158706+0000","last_clean":"2024-04-26T10:45:57.158706+0000","last_became_active":"2024-04-26T10:45:54.181993+0000","last_became_peered":"2024-04-26T10:45:54.181993+0000","last_unstale":"2024-04-26T10:45:57.158706+0000","last_undegraded":"2024-04-26T10:45:57.158706+0000","last_fullsized":"2024-04-26T10:45:57.158706+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:34.664600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":45251,"num_write":451,"num_write_kb":105365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"62'460","reported_seq":541,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160768+0000","last_change":"2024-04-26T10:45:48.865887+0000","last_active":"2024-04-26T10:45:57.160768+0000","last_peered":"2024-04-26T10:45:57.160768+0000","last_clean":"2024-04-26T10:45:57.160768+0000","last_became_active":"2024-04-26T10:45:48.865520+0000","last_became_peered":"2024-04-26T10:45:48.865520+0000","last_unstale":"2024-04-26T10:45:57.160768+0000","last_undegraded":"2024-04-26T10:45:57.160768+0000","last_fullsized":"2024-04-26T10:45:57.160768+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:34.308634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":407,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'420","reported_seq":503,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.165736+0000","last_change":"2024-04-26T10:45:57.165390+0000","last_active":"2024-04-26T10:45:57.165736+0000","last_peered":"2024-04-26T10:45:57.165736+0000","last_clean":"2024-04-26T10:45:57.165736+0000","last_became_active":"2024-04-26T10:45:57.162014+0000","last_became_peered":"2024-04-26T10:45:57.162014+0000","last_unstale":"2024-04-26T10:45:57.165736+0000","last_undegraded":"2024-04-26T10:45:57.165736+0000","last_fullsized":"2024-04-26T10:45:57.165736+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:19.491785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13025,"num_write":385,"num_write_kb":38595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"62'67","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161113+0000","last_change":"2024-04-26T10:45:45.860717+0000","last_active":"2024-04-26T10:45:57.161113+0000","last_peered":"2024-04-26T10:45:57.161113+0000","last_clean":"2024-04-26T10:45:57.161113+0000","last_became_active":"2024-04-26T10:45:45.860175+0000","last_became_peered":"2024-04-26T10:45:45.860175+0000","last_unstale":"2024-04-26T10:45:57.161113+0000","last_undegraded":"2024-04-26T10:45:57.161113+0000","last_fullsized":"2024-04-26T10:45:57.161113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:30.736518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"63'452","reported_seq":965,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.166761+0000","last_change":"2024-04-26T10:45:58.166413+0000","last_active":"2024-04-26T10:45:58.166761+0000","last_peered":"2024-04-26T10:45:58.166761+0000","last_clean":"2024-04-26T10:45:58.166761+0000","last_became_active":"2024-04-26T10:45:58.164105+0000","last_became_peered":"2024-04-26T10:45:58.164105+0000","last_unstale":"2024-04-26T10:45:58.166761+0000","last_undegraded":"2024-04-26T10:45:58.166761+0000","last_fullsized":"2024-04-26T10:45:58.166761+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:05.536110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23217,"num_write":416,"num_write_kb":71418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":388,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"62'200","reported_seq":277,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158343+0000","last_change":"2024-04-26T10:45:56.160957+0000","last_active":"2024-04-26T10:45:57.158343+0000","last_peered":"2024-04-26T10:45:57.158343+0000","last_clean":"2024-04-26T10:45:57.158343+0000","last_became_active":"2024-04-26T10:45:56.160475+0000","last_became_peered":"2024-04-26T10:45:56.160475+0000","last_unstale":"2024-04-26T10:45:57.158343+0000","last_undegraded":"2024-04-26T10:45:57.158343+0000","last_fullsized":"2024-04-26T10:45:57.158343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:48.896541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'430","reported_seq":512,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.165078+0000","last_change":"2024-04-26T10:45:57.164742+0000","last_active":"2024-04-26T10:45:57.165078+0000","last_peered":"2024-04-26T10:45:57.165078+0000","last_clean":"2024-04-26T10:45:57.165078+0000","last_became_active":"2024-04-26T10:45:57.162070+0000","last_became_peered":"2024-04-26T10:45:57.162070+0000","last_unstale":"2024-04-26T10:45:57.165078+0000","last_undegraded":"2024-04-26T10:45:57.165078+0000","last_fullsized":"2024-04-26T10:45:57.165078+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:14.872176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":24352,"num_write":392,"num_write_kb":21976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"62'233","reported_seq":306,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160855+0000","last_change":"2024-04-26T10:45:48.862856+0000","last_active":"2024-04-26T10:45:57.160855+0000","last_peered":"2024-04-26T10:45:57.160855+0000","last_clean":"2024-04-26T10:45:57.160855+0000","last_became_active":"2024-04-26T10:45:48.862517+0000","last_became_peered":"2024-04-26T10:45:48.862517+0000","last_unstale":"2024-04-26T10:45:57.160855+0000","last_undegraded":"2024-04-26T10:45:57.160855+0000","last_fullsized":"2024-04-26T10:45:57.160855+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:43.799960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"63'393","reported_seq":478,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160672+0000","last_change":"2024-04-26T10:45:55.180960+0000","last_active":"2024-04-26T10:45:57.160672+0000","last_peered":"2024-04-26T10:45:57.160672+0000","last_clean":"2024-04-26T10:45:57.160672+0000","last_became_active":"2024-04-26T10:45:55.177758+0000","last_became_peered":"2024-04-26T10:45:55.177758+0000","last_unstale":"2024-04-26T10:45:57.160672+0000","last_undegraded":"2024-04-26T10:45:57.160672+0000","last_fullsized":"2024-04-26T10:45:57.160672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:47.889251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8671,"num_write":368,"num_write_kb":38542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"62'49","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158855+0000","last_change":"2024-04-26T10:45:45.874789+0000","last_active":"2024-04-26T10:45:57.158855+0000","last_peered":"2024-04-26T10:45:57.158855+0000","last_clean":"2024-04-26T10:45:57.158855+0000","last_became_active":"2024-04-26T10:45:45.874328+0000","last_became_peered":"2024-04-26T10:45:45.874328+0000","last_unstale":"2024-04-26T10:45:57.158855+0000","last_undegraded":"2024-04-26T10:45:57.158855+0000","last_fullsized":"2024-04-26T10:45:57.158855+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:27.431661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"63'368","reported_seq":463,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162061+0000","last_change":"2024-04-26T10:45:56.165615+0000","last_active":"2024-04-26T10:45:57.162061+0000","last_peered":"2024-04-26T10:45:57.162061+0000","last_clean":"2024-04-26T10:45:57.162061+0000","last_became_active":"2024-04-26T10:45:56.163456+0000","last_became_peered":"2024-04-26T10:45:56.163456+0000","last_unstale":"2024-04-26T10:45:57.162061+0000","last_undegraded":"2024-04-26T10:45:57.162061+0000","last_fullsized":"2024-04-26T10:45:57.162061+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:14.480860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":19222,"num_write":336,"num_write_kb":58903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"62'619","reported_seq":747,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159149+0000","last_change":"2024-04-26T10:45:56.162511+0000","last_active":"2024-04-26T10:45:57.159149+0000","last_peered":"2024-04-26T10:45:57.159149+0000","last_clean":"2024-04-26T10:45:57.159149+0000","last_became_active":"2024-04-26T10:45:56.161604+0000","last_became_peered":"2024-04-26T10:45:56.161604+0000","last_unstale":"2024-04-26T10:45:57.159149+0000","last_undegraded":"2024-04-26T10:45:57.159149+0000","last_fullsized":"2024-04-26T10:45:57.159149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:39.366865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":558,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"63'383","reported_seq":822,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.165607+0000","last_change":"2024-04-26T10:45:58.165237+0000","last_active":"2024-04-26T10:45:58.165607+0000","last_peered":"2024-04-26T10:45:58.165607+0000","last_clean":"2024-04-26T10:45:58.165607+0000","last_became_active":"2024-04-26T10:45:58.162264+0000","last_became_peered":"2024-04-26T10:45:58.162264+0000","last_unstale":"2024-04-26T10:45:58.165607+0000","last_undegraded":"2024-04-26T10:45:58.165607+0000","last_fullsized":"2024-04-26T10:45:58.165607+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:12.784168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":14260,"num_write":349,"num_write_kb":50367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":229,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161708+0000","last_change":"2024-04-26T10:45:45.871511+0000","last_active":"2024-04-26T10:45:57.161708+0000","last_peered":"2024-04-26T10:45:57.161708+0000","last_clean":"2024-04-26T10:45:57.161708+0000","last_became_active":"2024-04-26T10:45:45.871155+0000","last_became_peered":"2024-04-26T10:45:45.871155+0000","last_unstale":"2024-04-26T10:45:57.161708+0000","last_undegraded":"2024-04-26T10:45:57.161708+0000","last_fullsized":"2024-04-26T10:45:57.161708+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:53.015361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160932+0000","last_change":"2024-04-26T10:45:45.861068+0000","last_active":"2024-04-26T10:45:57.160932+0000","last_peered":"2024-04-26T10:45:57.160932+0000","last_clean":"2024-04-26T10:45:57.160932+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:57.160932+0000","last_undegraded":"2024-04-26T10:45:57.160932+0000","last_fullsized":"2024-04-26T10:45:57.160932+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:16.348009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"62'743","reported_seq":824,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158521+0000","last_change":"2024-04-26T10:42:25.686765+0000","last_active":"2024-04-26T10:45:57.158521+0000","last_peered":"2024-04-26T10:45:57.158521+0000","last_clean":"2024-04-26T10:45:57.158521+0000","last_became_active":"2024-04-26T10:42:25.686009+0000","last_became_peered":"2024-04-26T10:42:25.686009+0000","last_unstale":"2024-04-26T10:45:57.158521+0000","last_undegraded":"2024-04-26T10:45:57.158521+0000","last_fullsized":"2024-04-26T10:45:57.158521+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:54.627815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'442","reported_seq":567,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160853+0000","last_change":"2024-04-26T10:45:55.181074+0000","last_active":"2024-04-26T10:45:57.160853+0000","last_peered":"2024-04-26T10:45:57.160853+0000","last_clean":"2024-04-26T10:45:57.160853+0000","last_became_active":"2024-04-26T10:45:55.177751+0000","last_became_peered":"2024-04-26T10:45:55.177751+0000","last_unstale":"2024-04-26T10:45:57.160853+0000","last_undegraded":"2024-04-26T10:45:57.160853+0000","last_fullsized":"2024-04-26T10:45:57.160853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:01.323521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":34346,"num_write":406,"num_write_kb":96298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162129+0000","last_change":"2024-04-26T10:45:45.872099+0000","last_active":"2024-04-26T10:45:57.162129+0000","last_peered":"2024-04-26T10:45:57.162129+0000","last_clean":"2024-04-26T10:45:57.162129+0000","last_became_active":"2024-04-26T10:45:45.871741+0000","last_became_peered":"2024-04-26T10:45:45.871741+0000","last_unstale":"2024-04-26T10:45:57.162129+0000","last_undegraded":"2024-04-26T10:45:57.162129+0000","last_fullsized":"2024-04-26T10:45:57.162129+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:53.226378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"63'102","reported_seq":219,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158049+0000","last_change":"2024-04-26T10:45:56.160802+0000","last_active":"2024-04-26T10:45:57.158049+0000","last_peered":"2024-04-26T10:45:57.158049+0000","last_clean":"2024-04-26T10:45:57.158049+0000","last_became_active":"2024-04-26T10:45:56.160328+0000","last_became_peered":"2024-04-26T10:45:56.160328+0000","last_unstale":"2024-04-26T10:45:57.158049+0000","last_undegraded":"2024-04-26T10:45:57.158049+0000","last_fullsized":"2024-04-26T10:45:57.158049+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:47.864335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467631,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":44,"num_write_kb":1460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2935262,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'485","reported_seq":620,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162426+0000","last_change":"2024-04-26T10:45:57.165815+0000","last_active":"2024-04-26T10:45:58.162426+0000","last_peered":"2024-04-26T10:45:58.162426+0000","last_clean":"2024-04-26T10:45:58.162426+0000","last_became_active":"2024-04-26T10:45:57.162752+0000","last_became_peered":"2024-04-26T10:45:57.162752+0000","last_unstale":"2024-04-26T10:45:58.162426+0000","last_undegraded":"2024-04-26T10:45:58.162426+0000","last_fullsized":"2024-04-26T10:45:58.162426+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:10.743149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27703,"num_write":454,"num_write_kb":121509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158512+0000","last_change":"2024-04-26T10:45:53.180892+0000","last_active":"2024-04-26T10:45:57.158512+0000","last_peered":"2024-04-26T10:45:57.158512+0000","last_clean":"2024-04-26T10:45:57.158512+0000","last_became_active":"2024-04-26T10:45:53.180675+0000","last_became_peered":"2024-04-26T10:45:53.180675+0000","last_unstale":"2024-04-26T10:45:57.158512+0000","last_undegraded":"2024-04-26T10:45:57.158512+0000","last_fullsized":"2024-04-26T10:45:57.158512+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:45.758505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"62'306","reported_seq":413,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159253+0000","last_change":"2024-04-26T10:45:48.865095+0000","last_active":"2024-04-26T10:45:57.159253+0000","last_peered":"2024-04-26T10:45:57.159253+0000","last_clean":"2024-04-26T10:45:57.159253+0000","last_became_active":"2024-04-26T10:45:48.864763+0000","last_became_peered":"2024-04-26T10:45:48.864763+0000","last_unstale":"2024-04-26T10:45:57.159253+0000","last_undegraded":"2024-04-26T10:45:57.159253+0000","last_fullsized":"2024-04-26T10:45:57.159253+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:12.665388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"63'336","reported_seq":748,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.165797+0000","last_change":"2024-04-26T10:45:58.165267+0000","last_active":"2024-04-26T10:45:58.165797+0000","last_peered":"2024-04-26T10:45:58.165797+0000","last_clean":"2024-04-26T10:45:58.165797+0000","last_became_active":"2024-04-26T10:45:58.162320+0000","last_became_peered":"2024-04-26T10:45:58.162320+0000","last_unstale":"2024-04-26T10:45:58.165797+0000","last_undegraded":"2024-04-26T10:45:58.165797+0000","last_fullsized":"2024-04-26T10:45:58.165797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:40.611364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12035,"num_write":314,"num_write_kb":29928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":306,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160636+0000","last_change":"2024-04-26T10:45:45.861233+0000","last_active":"2024-04-26T10:45:57.160636+0000","last_peered":"2024-04-26T10:45:57.160636+0000","last_clean":"2024-04-26T10:45:57.160636+0000","last_became_active":"2024-04-26T10:45:45.860924+0000","last_became_peered":"2024-04-26T10:45:45.860924+0000","last_unstale":"2024-04-26T10:45:57.160636+0000","last_undegraded":"2024-04-26T10:45:57.160636+0000","last_fullsized":"2024-04-26T10:45:57.160636+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:11.746110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"62'64","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160997+0000","last_change":"2024-04-26T10:45:45.861230+0000","last_active":"2024-04-26T10:45:57.160997+0000","last_peered":"2024-04-26T10:45:57.160997+0000","last_clean":"2024-04-26T10:45:57.160997+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:57.160997+0000","last_undegraded":"2024-04-26T10:45:57.160997+0000","last_fullsized":"2024-04-26T10:45:57.160997+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:53.564033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"63'421","reported_seq":513,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158851+0000","last_change":"2024-04-26T10:45:54.188138+0000","last_active":"2024-04-26T10:45:57.158851+0000","last_peered":"2024-04-26T10:45:57.158851+0000","last_clean":"2024-04-26T10:45:57.158851+0000","last_became_active":"2024-04-26T10:45:54.185053+0000","last_became_peered":"2024-04-26T10:45:54.185053+0000","last_unstale":"2024-04-26T10:45:57.158851+0000","last_undegraded":"2024-04-26T10:45:57.158851+0000","last_fullsized":"2024-04-26T10:45:57.158851+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:55:26.158040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28557,"num_write":385,"num_write_kb":93083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"62'480","reported_seq":553,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160417+0000","last_change":"2024-04-26T10:45:48.862894+0000","last_active":"2024-04-26T10:45:57.160417+0000","last_peered":"2024-04-26T10:45:57.160417+0000","last_clean":"2024-04-26T10:45:57.160417+0000","last_became_active":"2024-04-26T10:45:48.862564+0000","last_became_peered":"2024-04-26T10:45:48.862564+0000","last_unstale":"2024-04-26T10:45:57.160417+0000","last_undegraded":"2024-04-26T10:45:57.160417+0000","last_fullsized":"2024-04-26T10:45:57.160417+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:38.835403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":84,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158830+0000","last_change":"2024-04-26T10:42:21.405754+0000","last_active":"2024-04-26T10:45:57.158830+0000","last_peered":"2024-04-26T10:45:57.158830+0000","last_clean":"2024-04-26T10:45:57.158830+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:45:57.158830+0000","last_undegraded":"2024-04-26T10:45:57.158830+0000","last_fullsized":"2024-04-26T10:45:57.158830+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:43:47.123256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'352","reported_seq":776,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158735+0000","last_change":"2024-04-26T10:45:53.183401+0000","last_active":"2024-04-26T10:45:57.158735+0000","last_peered":"2024-04-26T10:45:57.158735+0000","last_clean":"2024-04-26T10:45:57.158735+0000","last_became_active":"2024-04-26T10:45:53.182454+0000","last_became_peered":"2024-04-26T10:45:53.182454+0000","last_unstale":"2024-04-26T10:45:57.158735+0000","last_undegraded":"2024-04-26T10:45:57.158735+0000","last_fullsized":"2024-04-26T10:45:57.158735+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:38.569626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":1905,"num_write":313,"num_write_kb":25573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"62'59","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158485+0000","last_change":"2024-04-26T10:45:53.177446+0000","last_active":"2024-04-26T10:45:57.158485+0000","last_peered":"2024-04-26T10:45:57.158485+0000","last_clean":"2024-04-26T10:45:57.158485+0000","last_became_active":"2024-04-26T10:45:53.176996+0000","last_became_peered":"2024-04-26T10:45:53.176996+0000","last_unstale":"2024-04-26T10:45:57.158485+0000","last_undegraded":"2024-04-26T10:45:57.158485+0000","last_fullsized":"2024-04-26T10:45:57.158485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:23.679423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":88,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161096+0000","last_change":"2024-04-26T10:45:53.175046+0000","last_active":"2024-04-26T10:45:57.161096+0000","last_peered":"2024-04-26T10:45:57.161096+0000","last_clean":"2024-04-26T10:45:57.161096+0000","last_became_active":"2024-04-26T10:45:53.174781+0000","last_became_peered":"2024-04-26T10:45:53.174781+0000","last_unstale":"2024-04-26T10:45:57.161096+0000","last_undegraded":"2024-04-26T10:45:57.161096+0000","last_fullsized":"2024-04-26T10:45:57.161096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:22.742084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'408","reported_seq":907,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160325+0000","last_change":"2024-04-26T10:45:54.186637+0000","last_active":"2024-04-26T10:45:57.160325+0000","last_peered":"2024-04-26T10:45:57.160325+0000","last_clean":"2024-04-26T10:45:57.160325+0000","last_became_active":"2024-04-26T10:45:54.185238+0000","last_became_peered":"2024-04-26T10:45:54.185238+0000","last_unstale":"2024-04-26T10:45:57.160325+0000","last_undegraded":"2024-04-26T10:45:57.160325+0000","last_fullsized":"2024-04-26T10:45:57.160325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:54.735683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19939,"num_write":382,"num_write_kb":63433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"62'55","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159609+0000","last_change":"2024-04-26T10:45:53.205131+0000","last_active":"2024-04-26T10:45:57.159609+0000","last_peered":"2024-04-26T10:45:57.159609+0000","last_clean":"2024-04-26T10:45:57.159609+0000","last_became_active":"2024-04-26T10:45:53.177305+0000","last_became_peered":"2024-04-26T10:45:53.177305+0000","last_unstale":"2024-04-26T10:45:57.159609+0000","last_undegraded":"2024-04-26T10:45:57.159609+0000","last_fullsized":"2024-04-26T10:45:57.159609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:30.829530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158557+0000","last_change":"2024-04-26T10:45:53.177593+0000","last_active":"2024-04-26T10:45:57.158557+0000","last_peered":"2024-04-26T10:45:57.158557+0000","last_clean":"2024-04-26T10:45:57.158557+0000","last_became_active":"2024-04-26T10:45:53.177249+0000","last_became_peered":"2024-04-26T10:45:53.177249+0000","last_unstale":"2024-04-26T10:45:57.158557+0000","last_undegraded":"2024-04-26T10:45:57.158557+0000","last_fullsized":"2024-04-26T10:45:57.158557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:41.564852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'418","reported_seq":877,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158405+0000","last_change":"2024-04-26T10:45:56.162729+0000","last_active":"2024-04-26T10:45:57.158405+0000","last_peered":"2024-04-26T10:45:57.158405+0000","last_clean":"2024-04-26T10:45:57.158405+0000","last_became_active":"2024-04-26T10:45:56.160440+0000","last_became_peered":"2024-04-26T10:45:56.160440+0000","last_unstale":"2024-04-26T10:45:57.158405+0000","last_undegraded":"2024-04-26T10:45:57.158405+0000","last_fullsized":"2024-04-26T10:45:57.158405+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:32.155653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20110,"num_write":390,"num_write_kb":75171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"64'66","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159242+0000","last_change":"2024-04-26T10:45:53.203538+0000","last_active":"2024-04-26T10:45:57.159242+0000","last_peered":"2024-04-26T10:45:57.159242+0000","last_clean":"2024-04-26T10:45:57.159242+0000","last_became_active":"2024-04-26T10:45:53.175946+0000","last_became_peered":"2024-04-26T10:45:53.175946+0000","last_unstale":"2024-04-26T10:45:57.159242+0000","last_undegraded":"2024-04-26T10:45:57.159242+0000","last_fullsized":"2024-04-26T10:45:57.159242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:15.016761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161004+0000","last_change":"2024-04-26T10:45:45.872224+0000","last_active":"2024-04-26T10:45:57.161004+0000","last_peered":"2024-04-26T10:45:57.161004+0000","last_clean":"2024-04-26T10:45:57.161004+0000","last_became_active":"2024-04-26T10:45:45.871923+0000","last_became_peered":"2024-04-26T10:45:45.871923+0000","last_unstale":"2024-04-26T10:45:57.161004+0000","last_undegraded":"2024-04-26T10:45:57.161004+0000","last_fullsized":"2024-04-26T10:45:57.161004+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:00.334874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"63'404","reported_seq":921,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158750+0000","last_change":"2024-04-26T10:45:54.184386+0000","last_active":"2024-04-26T10:45:57.158750+0000","last_peered":"2024-04-26T10:45:57.158750+0000","last_clean":"2024-04-26T10:45:57.158750+0000","last_became_active":"2024-04-26T10:45:54.181795+0000","last_became_peered":"2024-04-26T10:45:54.181795+0000","last_unstale":"2024-04-26T10:45:57.158750+0000","last_undegraded":"2024-04-26T10:45:57.158750+0000","last_fullsized":"2024-04-26T10:45:57.158750+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:10.290362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41262,"num_write":371,"num_write_kb":75820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"63'441","reported_seq":564,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161829+0000","last_change":"2024-04-26T10:45:54.188488+0000","last_active":"2024-04-26T10:45:57.161829+0000","last_peered":"2024-04-26T10:45:57.161829+0000","last_clean":"2024-04-26T10:45:57.161829+0000","last_became_active":"2024-04-26T10:45:54.185862+0000","last_became_peered":"2024-04-26T10:45:54.185862+0000","last_unstale":"2024-04-26T10:45:57.161829+0000","last_undegraded":"2024-04-26T10:45:57.161829+0000","last_fullsized":"2024-04-26T10:45:57.161829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:07.585438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31514,"num_write":408,"num_write_kb":107129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"64'431","reported_seq":520,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161320+0000","last_change":"2024-04-26T10:45:48.865579+0000","last_active":"2024-04-26T10:45:57.161320+0000","last_peered":"2024-04-26T10:45:57.161320+0000","last_clean":"2024-04-26T10:45:57.161320+0000","last_became_active":"2024-04-26T10:45:48.865212+0000","last_became_peered":"2024-04-26T10:45:48.865212+0000","last_unstale":"2024-04-26T10:45:57.161320+0000","last_undegraded":"2024-04-26T10:45:57.161320+0000","last_fullsized":"2024-04-26T10:45:57.161320+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:10:53.808562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9902610,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":9913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9896193,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"63'410","reported_seq":515,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160782+0000","last_change":"2024-04-26T10:45:54.184713+0000","last_active":"2024-04-26T10:45:57.160782+0000","last_peered":"2024-04-26T10:45:57.160782+0000","last_clean":"2024-04-26T10:45:57.160782+0000","last_became_active":"2024-04-26T10:45:54.182167+0000","last_became_peered":"2024-04-26T10:45:54.182167+0000","last_unstale":"2024-04-26T10:45:57.160782+0000","last_undegraded":"2024-04-26T10:45:57.160782+0000","last_fullsized":"2024-04-26T10:45:57.160782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:41:50.625629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12734,"num_write":373,"num_write_kb":34864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"63'84","reported_seq":183,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159590+0000","last_change":"2024-04-26T10:45:45.896842+0000","last_active":"2024-04-26T10:45:57.159590+0000","last_peered":"2024-04-26T10:45:57.159590+0000","last_clean":"2024-04-26T10:45:57.159590+0000","last_became_active":"2024-04-26T10:45:45.874746+0000","last_became_peered":"2024-04-26T10:45:45.874746+0000","last_unstale":"2024-04-26T10:45:57.159590+0000","last_undegraded":"2024-04-26T10:45:57.159590+0000","last_fullsized":"2024-04-26T10:45:57.159590+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:22.649667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"62'332","reported_seq":419,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161969+0000","last_change":"2024-04-26T10:45:56.161772+0000","last_active":"2024-04-26T10:45:57.161969+0000","last_peered":"2024-04-26T10:45:57.161969+0000","last_clean":"2024-04-26T10:45:57.161969+0000","last_became_active":"2024-04-26T10:45:56.161449+0000","last_became_peered":"2024-04-26T10:45:56.161449+0000","last_unstale":"2024-04-26T10:45:57.161969+0000","last_undegraded":"2024-04-26T10:45:57.161969+0000","last_fullsized":"2024-04-26T10:45:57.161969+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:09.499829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"63'487","reported_seq":1096,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158272+0000","last_change":"2024-04-26T10:45:51.160586+0000","last_active":"2024-04-26T10:45:57.158272+0000","last_peered":"2024-04-26T10:45:57.158272+0000","last_clean":"2024-04-26T10:45:57.158272+0000","last_became_active":"2024-04-26T10:45:51.159235+0000","last_became_peered":"2024-04-26T10:45:51.159235+0000","last_unstale":"2024-04-26T10:45:57.158272+0000","last_undegraded":"2024-04-26T10:45:57.158272+0000","last_fullsized":"2024-04-26T10:45:57.158272+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:54.234867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":43316,"num_write":468,"num_write_kb":77062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"62'61","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159565+0000","last_change":"2024-04-26T10:45:53.174204+0000","last_active":"2024-04-26T10:45:57.159565+0000","last_peered":"2024-04-26T10:45:57.159565+0000","last_clean":"2024-04-26T10:45:57.159565+0000","last_became_active":"2024-04-26T10:45:53.173851+0000","last_became_peered":"2024-04-26T10:45:53.173851+0000","last_unstale":"2024-04-26T10:45:57.159565+0000","last_undegraded":"2024-04-26T10:45:57.159565+0000","last_fullsized":"2024-04-26T10:45:57.159565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:50.698470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'457","reported_seq":536,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158314+0000","last_change":"2024-04-26T10:45:54.199966+0000","last_active":"2024-04-26T10:45:57.158314+0000","last_peered":"2024-04-26T10:45:57.158314+0000","last_clean":"2024-04-26T10:45:57.158314+0000","last_became_active":"2024-04-26T10:45:54.189622+0000","last_became_peered":"2024-04-26T10:45:54.189622+0000","last_unstale":"2024-04-26T10:45:57.158314+0000","last_undegraded":"2024-04-26T10:45:57.158314+0000","last_fullsized":"2024-04-26T10:45:57.158314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:53.540098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14848,"num_write":427,"num_write_kb":71903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'377","reported_seq":838,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160362+0000","last_change":"2024-04-26T10:45:49.867665+0000","last_active":"2024-04-26T10:45:57.160362+0000","last_peered":"2024-04-26T10:45:57.160362+0000","last_clean":"2024-04-26T10:45:57.160362+0000","last_became_active":"2024-04-26T10:45:49.866707+0000","last_became_peered":"2024-04-26T10:45:49.866707+0000","last_unstale":"2024-04-26T10:45:57.160362+0000","last_undegraded":"2024-04-26T10:45:57.160362+0000","last_fullsized":"2024-04-26T10:45:57.160362+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:23.401341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26932,"num_write":349,"num_write_kb":55611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"62'562","reported_seq":643,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158775+0000","last_change":"2024-04-26T10:42:25.683890+0000","last_active":"2024-04-26T10:45:57.158775+0000","last_peered":"2024-04-26T10:45:57.158775+0000","last_clean":"2024-04-26T10:45:57.158775+0000","last_became_active":"2024-04-26T10:42:25.683467+0000","last_became_peered":"2024-04-26T10:42:25.683467+0000","last_unstale":"2024-04-26T10:45:57.158775+0000","last_undegraded":"2024-04-26T10:45:57.158775+0000","last_fullsized":"2024-04-26T10:45:57.158775+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:04.870117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":8440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'425","reported_seq":878,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159122+0000","last_change":"2024-04-26T10:45:56.163245+0000","last_active":"2024-04-26T10:45:57.159122+0000","last_peered":"2024-04-26T10:45:57.159122+0000","last_clean":"2024-04-26T10:45:57.159122+0000","last_became_active":"2024-04-26T10:45:56.161315+0000","last_became_peered":"2024-04-26T10:45:56.161315+0000","last_unstale":"2024-04-26T10:45:57.159122+0000","last_undegraded":"2024-04-26T10:45:57.159122+0000","last_fullsized":"2024-04-26T10:45:57.159122+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:29.938631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":19004,"num_write":390,"num_write_kb":75524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"62'259","reported_seq":331,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158373+0000","last_change":"2024-04-26T10:45:56.160840+0000","last_active":"2024-04-26T10:45:57.158373+0000","last_peered":"2024-04-26T10:45:57.158373+0000","last_clean":"2024-04-26T10:45:57.158373+0000","last_became_active":"2024-04-26T10:45:56.160344+0000","last_became_peered":"2024-04-26T10:45:56.160344+0000","last_unstale":"2024-04-26T10:45:57.158373+0000","last_undegraded":"2024-04-26T10:45:57.158373+0000","last_fullsized":"2024-04-26T10:45:57.158373+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:50.232753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'418","reported_seq":929,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159365+0000","last_change":"2024-04-26T10:45:55.179671+0000","last_active":"2024-04-26T10:45:57.159365+0000","last_peered":"2024-04-26T10:45:57.159365+0000","last_clean":"2024-04-26T10:45:57.159365+0000","last_became_active":"2024-04-26T10:45:55.178079+0000","last_became_peered":"2024-04-26T10:45:55.178079+0000","last_unstale":"2024-04-26T10:45:57.159365+0000","last_undegraded":"2024-04-26T10:45:57.159365+0000","last_fullsized":"2024-04-26T10:45:57.159365+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:36.749926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":34476,"num_write":379,"num_write_kb":101645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"62'494","reported_seq":575,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159163+0000","last_change":"2024-04-26T10:42:25.688221+0000","last_active":"2024-04-26T10:45:57.159163+0000","last_peered":"2024-04-26T10:45:57.159163+0000","last_clean":"2024-04-26T10:45:57.159163+0000","last_became_active":"2024-04-26T10:42:25.687829+0000","last_became_peered":"2024-04-26T10:42:25.687829+0000","last_unstale":"2024-04-26T10:45:57.159163+0000","last_undegraded":"2024-04-26T10:45:57.159163+0000","last_fullsized":"2024-04-26T10:45:57.159163+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:05.939715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":12543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"63'406","reported_seq":586,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159122+0000","last_change":"2024-04-26T10:45:54.192178+0000","last_active":"2024-04-26T10:45:57.159122+0000","last_peered":"2024-04-26T10:45:57.159122+0000","last_clean":"2024-04-26T10:45:57.159122+0000","last_became_active":"2024-04-26T10:45:54.189591+0000","last_became_peered":"2024-04-26T10:45:54.189591+0000","last_unstale":"2024-04-26T10:45:57.159122+0000","last_undegraded":"2024-04-26T10:45:57.159122+0000","last_fullsized":"2024-04-26T10:45:57.159122+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:31.509288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":45941,"num_write":372,"num_write_kb":80011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"62'61","reported_seq":160,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160386+0000","last_change":"2024-04-26T10:45:45.895125+0000","last_active":"2024-04-26T10:45:57.160386+0000","last_peered":"2024-04-26T10:45:57.160386+0000","last_clean":"2024-04-26T10:45:57.160386+0000","last_became_active":"2024-04-26T10:45:45.874300+0000","last_became_peered":"2024-04-26T10:45:45.874300+0000","last_unstale":"2024-04-26T10:45:57.160386+0000","last_undegraded":"2024-04-26T10:45:57.160386+0000","last_fullsized":"2024-04-26T10:45:57.160386+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:26.528893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"63'375","reported_seq":823,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161710+0000","last_change":"2024-04-26T10:45:56.163670+0000","last_active":"2024-04-26T10:45:57.161710+0000","last_peered":"2024-04-26T10:45:57.161710+0000","last_clean":"2024-04-26T10:45:57.161710+0000","last_became_active":"2024-04-26T10:45:56.160416+0000","last_became_peered":"2024-04-26T10:45:56.160416+0000","last_unstale":"2024-04-26T10:45:57.161710+0000","last_undegraded":"2024-04-26T10:45:57.161710+0000","last_fullsized":"2024-04-26T10:45:57.161710+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:43.147179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16213,"num_write":354,"num_write_kb":54493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":332,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"62'276","reported_seq":368,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.160846+0000","last_change":"2024-04-26T10:45:56.160817+0000","last_active":"2024-04-26T10:45:57.160846+0000","last_peered":"2024-04-26T10:45:57.160846+0000","last_clean":"2024-04-26T10:45:57.160846+0000","last_became_active":"2024-04-26T10:45:56.160414+0000","last_became_peered":"2024-04-26T10:45:56.160414+0000","last_unstale":"2024-04-26T10:45:57.160846+0000","last_undegraded":"2024-04-26T10:45:57.160846+0000","last_fullsized":"2024-04-26T10:45:57.160846+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:40.374381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"63'379","reported_seq":475,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.161030+0000","last_change":"2024-04-26T10:45:53.177365+0000","last_active":"2024-04-26T10:45:57.161030+0000","last_peered":"2024-04-26T10:45:57.161030+0000","last_clean":"2024-04-26T10:45:57.161030+0000","last_became_active":"2024-04-26T10:45:53.173645+0000","last_became_peered":"2024-04-26T10:45:53.173645+0000","last_unstale":"2024-04-26T10:45:57.161030+0000","last_undegraded":"2024-04-26T10:45:57.161030+0000","last_fullsized":"2024-04-26T10:45:57.161030+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:32.390075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20480,"num_write":343,"num_write_kb":25788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"62'237","reported_seq":347,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159471+0000","last_change":"2024-04-26T10:45:48.867081+0000","last_active":"2024-04-26T10:45:57.159471+0000","last_peered":"2024-04-26T10:45:57.159471+0000","last_clean":"2024-04-26T10:45:57.159471+0000","last_became_active":"2024-04-26T10:45:48.866716+0000","last_became_peered":"2024-04-26T10:45:48.866716+0000","last_unstale":"2024-04-26T10:45:57.159471+0000","last_undegraded":"2024-04-26T10:45:57.159471+0000","last_fullsized":"2024-04-26T10:45:57.159471+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:16.712392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":12393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"63'419","reported_seq":570,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158951+0000","last_change":"2024-04-26T10:42:26.041729+0000","last_active":"2024-04-26T10:45:57.158951+0000","last_peered":"2024-04-26T10:45:57.158951+0000","last_clean":"2024-04-26T10:45:57.158951+0000","last_became_active":"2024-04-26T10:42:26.040504+0000","last_became_peered":"2024-04-26T10:42:26.040504+0000","last_unstale":"2024-04-26T10:45:57.158951+0000","last_undegraded":"2024-04-26T10:45:57.158951+0000","last_fullsized":"2024-04-26T10:45:57.158951+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:38.590526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39582,"num_write":378,"num_write_kb":54867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"62'61","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.159083+0000","last_change":"2024-04-26T10:45:53.227750+0000","last_active":"2024-04-26T10:45:57.159083+0000","last_peered":"2024-04-26T10:45:57.159083+0000","last_clean":"2024-04-26T10:45:57.159083+0000","last_became_active":"2024-04-26T10:45:53.178804+0000","last_became_peered":"2024-04-26T10:45:53.178804+0000","last_unstale":"2024-04-26T10:45:57.159083+0000","last_undegraded":"2024-04-26T10:45:57.159083+0000","last_fullsized":"2024-04-26T10:45:57.159083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:56.795614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'437","reported_seq":523,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.162221+0000","last_change":"2024-04-26T10:45:53.181155+0000","last_active":"2024-04-26T10:45:57.162221+0000","last_peered":"2024-04-26T10:45:57.162221+0000","last_clean":"2024-04-26T10:45:57.162221+0000","last_became_active":"2024-04-26T10:45:53.177071+0000","last_became_peered":"2024-04-26T10:45:53.177071+0000","last_unstale":"2024-04-26T10:45:57.162221+0000","last_undegraded":"2024-04-26T10:45:57.162221+0000","last_fullsized":"2024-04-26T10:45:57.162221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:34.219319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":7562,"num_write":400,"num_write_kb":26121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"62'58","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-04-26T10:45:57.158941+0000","last_change":"2024-04-26T10:45:53.197669+0000","last_active":"2024-04-26T10:45:57.158941+0000","last_peered":"2024-04-26T10:45:57.158941+0000","last_clean":"2024-04-26T10:45:57.158941+0000","last_became_active":"2024-04-26T10:45:53.173542+0000","last_became_peered":"2024-04-26T10:45:53.173542+0000","last_unstale":"2024-04-26T10:45:57.158941+0000","last_undegraded":"2024-04-26T10:45:57.158941+0000","last_fullsized":"2024-04-26T10:45:57.158941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:34.409430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2672,"num_read_kb":1454712,"num_write":24538,"num_write_kb":4190103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26671,"ondisk_log_size":26671,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128811551,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":5770,"num_write_kb":129888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257691648,"data_stored":257623102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},"log_size":7595,"ondisk_log_size":7595,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738417,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":183416,"kb_used_data":80164,"kb_used_omap":1,"kb_used_meta":103230,"kb_avail":94188424,"statfs":{"total":96636764160,"available":96448946176,"internally_reserved":0,"allocated":82087936,"data_stored":81566103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105707974},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:45:25 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.20300000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42599999999999999,"15min":0.436},"min":{"1min":0.26000000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":1,"up_from":70,"seq":300647710726,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136028,"kb_used_data":90440,"kb_used_omap":7,"kb_used_meta":45560,"kb_avail":94235812,"statfs":{"total":96636764160,"available":96497471488,"internally_reserved":0,"allocated":92610560,"data_stored":92059263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7181,"internal_metadata":46654451},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738418,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214380,"kb_used_data":84896,"kb_used_omap":1,"kb_used_meta":129470,"kb_avail":94157460,"statfs":{"total":96636764160,"available":96417239040,"internally_reserved":0,"allocated":86933504,"data_stored":86396712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132577734},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Fri Apr 26 10:45:26 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.43099999999999999,"15min":0.44900000000000001},"min":{"1min":0.21199999999999999,"5min":0.183,"15min":0.183},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.442,"15min":0.46500000000000002},"min":{"1min":0.23499999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57199999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.53000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":85422080,"data_stored":85400264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":91099136,"data_stored":91062815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81170432,"data_stored":81160023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:46:08.184 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.184 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.184 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.184 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.184 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.184 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.184 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.184 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.184 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.185 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.185 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.185 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.185 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.185 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.185 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.186 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.186 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.186 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.186 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.186 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.186 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.186 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.186 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.186 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.186 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.187 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.187 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.187 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.187 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.187 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.187 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.187 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.187 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.187 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.188 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.188 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.188 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.188 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.188 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.188 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.188 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.188 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.188 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.188 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.189 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.189 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.189 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.189 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.189 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.189 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.189 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.189 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.189 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.190 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.190 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.190 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.190 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.190 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.190 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.190 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.190 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.190 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.191 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.191 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.191 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.191 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.191 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.191 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.191 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.191 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.191 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.191 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.192 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.192 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.192 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.192 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.192 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.192 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.192 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.192 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.192 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.192 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.193 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.193 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.193 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.193 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.193 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.193 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.193 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.193 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.194 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.194 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.194 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.194 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.194 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.194 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.194 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.194 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.194 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.195 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.195 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.195 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.195 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.195 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.195 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:08.195 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T10:46:28.197 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:46:28.514 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:46:28.516 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:46:28.525 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-04-26T10:46:27.656756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129401919,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2852,"num_read_kb":1456290,"num_write":30511,"num_write_kb":4323451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9253,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34428,"ondisk_log_size":34428,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":537892,"kb_used_data":255500,"kb_used_omap":10,"kb_used_meta":282357,"kb_avail":282577628,"statfs":{"total":289910292480,"available":289359491072,"internally_reserved":0,"allocated":261632000,"data_stored":260022078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10369,"internal_metadata":289134463},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003394"},"pg_stats":[{"pgid":"4.3f","version":"63'415","reported_seq":542,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161074+0000","last_change":"2024-04-26T10:42:26.045527+0000","last_active":"2024-04-26T10:45:58.161074+0000","last_peered":"2024-04-26T10:45:58.161074+0000","last_clean":"2024-04-26T10:45:58.161074+0000","last_became_active":"2024-04-26T10:42:26.044597+0000","last_became_peered":"2024-04-26T10:42:26.044597+0000","last_unstale":"2024-04-26T10:45:58.161074+0000","last_undegraded":"2024-04-26T10:45:58.161074+0000","last_fullsized":"2024-04-26T10:45:58.161074+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22963,"num_write":385,"num_write_kb":71406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"63'396","reported_seq":522,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160496+0000","last_change":"2024-04-26T10:45:54.194523+0000","last_active":"2024-04-26T10:45:58.160496+0000","last_peered":"2024-04-26T10:45:58.160496+0000","last_clean":"2024-04-26T10:45:58.160496+0000","last_became_active":"2024-04-26T10:45:54.192613+0000","last_became_peered":"2024-04-26T10:45:54.192613+0000","last_unstale":"2024-04-26T10:45:58.160496+0000","last_undegraded":"2024-04-26T10:45:58.160496+0000","last_fullsized":"2024-04-26T10:45:58.160496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9499,"num_write":371,"num_write_kb":38601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"63'366","reported_seq":450,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162668+0000","last_change":"2024-04-26T10:45:55.183758+0000","last_active":"2024-04-26T10:45:58.162668+0000","last_peered":"2024-04-26T10:45:58.162668+0000","last_clean":"2024-04-26T10:45:58.162668+0000","last_became_active":"2024-04-26T10:45:55.180991+0000","last_became_peered":"2024-04-26T10:45:55.180991+0000","last_unstale":"2024-04-26T10:45:58.162668+0000","last_undegraded":"2024-04-26T10:45:58.162668+0000","last_fullsized":"2024-04-26T10:45:58.162668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6211,"num_write":338,"num_write_kb":38844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"63'394","reported_seq":546,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161957+0000","last_change":"2024-04-26T10:45:51.162341+0000","last_active":"2024-04-26T10:45:58.161957+0000","last_peered":"2024-04-26T10:45:58.161957+0000","last_clean":"2024-04-26T10:45:58.161957+0000","last_became_active":"2024-04-26T10:45:51.159099+0000","last_became_peered":"2024-04-26T10:45:51.159099+0000","last_unstale":"2024-04-26T10:45:58.161957+0000","last_undegraded":"2024-04-26T10:45:58.161957+0000","last_fullsized":"2024-04-26T10:45:58.161957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":52323,"num_write":357,"num_write_kb":63323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"63'409","reported_seq":508,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160484+0000","last_change":"2024-04-26T10:42:26.041191+0000","last_active":"2024-04-26T10:45:58.160484+0000","last_peered":"2024-04-26T10:45:58.160484+0000","last_clean":"2024-04-26T10:45:58.160484+0000","last_became_active":"2024-04-26T10:42:26.040487+0000","last_became_peered":"2024-04-26T10:42:26.040487+0000","last_unstale":"2024-04-26T10:45:58.160484+0000","last_undegraded":"2024-04-26T10:45:58.160484+0000","last_fullsized":"2024-04-26T10:45:58.160484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":372,"num_write_kb":42764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'385","reported_seq":476,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:21.300652+0000","last_change":"2024-04-26T10:46:21.300788+0000","last_active":"2024-04-26T10:46:21.300652+0000","last_peered":"2024-04-26T10:46:21.300652+0000","last_clean":"2024-04-26T10:46:21.300652+0000","last_became_active":"2024-04-26T10:45:49.861811+0000","last_became_peered":"2024-04-26T10:45:49.861811+0000","last_unstale":"2024-04-26T10:46:21.300652+0000","last_undegraded":"2024-04-26T10:46:21.300652+0000","last_fullsized":"2024-04-26T10:46:21.300652+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'385","last_scrub_stamp":"2024-04-26T10:46:21.300632+0000","last_deep_scrub":"63'385","last_deep_scrub_stamp":"2024-04-26T10:46:21.300632+0000","last_clean_scrub_stamp":"2024-04-26T10:46:21.300632+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:50.462322+0000","scrub_duration":0.0030393180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4124,"num_write":356,"num_write_kb":69857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"63'425","reported_seq":535,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161609+0000","last_change":"2024-04-26T10:45:50.869572+0000","last_active":"2024-04-26T10:45:58.161609+0000","last_peered":"2024-04-26T10:45:58.161609+0000","last_clean":"2024-04-26T10:45:58.161609+0000","last_became_active":"2024-04-26T10:45:50.866996+0000","last_became_peered":"2024-04-26T10:45:50.866996+0000","last_unstale":"2024-04-26T10:45:58.161609+0000","last_undegraded":"2024-04-26T10:45:58.161609+0000","last_fullsized":"2024-04-26T10:45:58.161609+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13036,"num_write":390,"num_write_kb":67193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"63'399","reported_seq":508,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.164893+0000","last_change":"2024-04-26T10:45:58.164304+0000","last_active":"2024-04-26T10:45:58.164893+0000","last_peered":"2024-04-26T10:45:58.164893+0000","last_clean":"2024-04-26T10:45:58.164893+0000","last_became_active":"2024-04-26T10:45:58.162532+0000","last_became_peered":"2024-04-26T10:45:58.162532+0000","last_unstale":"2024-04-26T10:45:58.164893+0000","last_undegraded":"2024-04-26T10:45:58.164893+0000","last_fullsized":"2024-04-26T10:45:58.164893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25678,"num_write":356,"num_write_kb":116549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"63'442","reported_seq":590,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160776+0000","last_change":"2024-04-26T10:42:26.045893+0000","last_active":"2024-04-26T10:45:58.160776+0000","last_peered":"2024-04-26T10:45:58.160776+0000","last_clean":"2024-04-26T10:45:58.160776+0000","last_became_active":"2024-04-26T10:42:26.045177+0000","last_became_peered":"2024-04-26T10:42:26.045177+0000","last_unstale":"2024-04-26T10:45:58.160776+0000","last_undegraded":"2024-04-26T10:45:58.160776+0000","last_fullsized":"2024-04-26T10:45:58.160776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35111,"num_write":413,"num_write_kb":60306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'393","reported_seq":516,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160602+0000","last_change":"2024-04-26T10:45:54.192984+0000","last_active":"2024-04-26T10:45:58.160602+0000","last_peered":"2024-04-26T10:45:58.160602+0000","last_clean":"2024-04-26T10:45:58.160602+0000","last_became_active":"2024-04-26T10:45:54.191514+0000","last_became_peered":"2024-04-26T10:45:54.191514+0000","last_unstale":"2024-04-26T10:45:58.160602+0000","last_undegraded":"2024-04-26T10:45:58.160602+0000","last_fullsized":"2024-04-26T10:45:58.160602+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5355,"num_write":351,"num_write_kb":38901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"63'377","reported_seq":483,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162538+0000","last_change":"2024-04-26T10:45:49.865172+0000","last_active":"2024-04-26T10:45:58.162538+0000","last_peered":"2024-04-26T10:45:58.162538+0000","last_clean":"2024-04-26T10:45:58.162538+0000","last_became_active":"2024-04-26T10:45:49.862718+0000","last_became_peered":"2024-04-26T10:45:49.862718+0000","last_unstale":"2024-04-26T10:45:58.162538+0000","last_undegraded":"2024-04-26T10:45:58.162538+0000","last_fullsized":"2024-04-26T10:45:58.162538+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18030,"num_write":355,"num_write_kb":67044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"63'365","reported_seq":809,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160338+0000","last_change":"2024-04-26T10:45:57.166219+0000","last_active":"2024-04-26T10:45:58.160338+0000","last_peered":"2024-04-26T10:45:58.160338+0000","last_clean":"2024-04-26T10:45:58.160338+0000","last_became_active":"2024-04-26T10:45:57.164964+0000","last_became_peered":"2024-04-26T10:45:57.164964+0000","last_unstale":"2024-04-26T10:45:58.160338+0000","last_undegraded":"2024-04-26T10:45:58.160338+0000","last_fullsized":"2024-04-26T10:45:58.160338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14866,"num_write":337,"num_write_kb":71188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'397","reported_seq":491,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160243+0000","last_change":"2024-04-26T10:42:26.042607+0000","last_active":"2024-04-26T10:45:58.160243+0000","last_peered":"2024-04-26T10:45:58.160243+0000","last_clean":"2024-04-26T10:45:58.160243+0000","last_became_active":"2024-04-26T10:42:26.041617+0000","last_became_peered":"2024-04-26T10:42:26.041617+0000","last_unstale":"2024-04-26T10:45:58.160243+0000","last_undegraded":"2024-04-26T10:45:58.160243+0000","last_fullsized":"2024-04-26T10:45:58.160243+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8192,"num_write":362,"num_write_kb":54822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"63'408","reported_seq":488,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161739+0000","last_change":"2024-04-26T10:45:53.181618+0000","last_active":"2024-04-26T10:45:58.161739+0000","last_peered":"2024-04-26T10:45:58.161739+0000","last_clean":"2024-04-26T10:45:58.161739+0000","last_became_active":"2024-04-26T10:45:53.177677+0000","last_became_peered":"2024-04-26T10:45:53.177677+0000","last_unstale":"2024-04-26T10:45:58.161739+0000","last_undegraded":"2024-04-26T10:45:58.161739+0000","last_fullsized":"2024-04-26T10:45:58.161739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4688,"num_write":374,"num_write_kb":21766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"63'409","reported_seq":523,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161518+0000","last_change":"2024-04-26T10:45:54.188625+0000","last_active":"2024-04-26T10:45:58.161518+0000","last_peered":"2024-04-26T10:45:58.161518+0000","last_clean":"2024-04-26T10:45:58.161518+0000","last_became_active":"2024-04-26T10:45:54.185826+0000","last_became_peered":"2024-04-26T10:45:54.185826+0000","last_unstale":"2024-04-26T10:45:58.161518+0000","last_undegraded":"2024-04-26T10:45:58.161518+0000","last_fullsized":"2024-04-26T10:45:58.161518+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25968,"num_write":366,"num_write_kb":75698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"63'460","reported_seq":574,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:20.325508+0000","last_change":"2024-04-26T10:46:20.325615+0000","last_active":"2024-04-26T10:46:20.325508+0000","last_peered":"2024-04-26T10:46:20.325508+0000","last_clean":"2024-04-26T10:46:20.325508+0000","last_became_active":"2024-04-26T10:45:53.174699+0000","last_became_peered":"2024-04-26T10:45:53.174699+0000","last_unstale":"2024-04-26T10:46:20.325508+0000","last_undegraded":"2024-04-26T10:46:20.325508+0000","last_fullsized":"2024-04-26T10:46:20.325508+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'460","last_scrub_stamp":"2024-04-26T10:46:20.325486+0000","last_deep_scrub":"63'460","last_deep_scrub_stamp":"2024-04-26T10:46:20.325486+0000","last_clean_scrub_stamp":"2024-04-26T10:46:20.325486+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:51.733701+0000","scrub_duration":0.0023796759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16269,"num_write":426,"num_write_kb":67839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"63'393","reported_seq":513,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161065+0000","last_change":"2024-04-26T10:42:26.049338+0000","last_active":"2024-04-26T10:45:58.161065+0000","last_peered":"2024-04-26T10:45:58.161065+0000","last_clean":"2024-04-26T10:45:58.161065+0000","last_became_active":"2024-04-26T10:42:26.049014+0000","last_became_peered":"2024-04-26T10:42:26.049014+0000","last_unstale":"2024-04-26T10:45:58.161065+0000","last_undegraded":"2024-04-26T10:45:58.161065+0000","last_fullsized":"2024-04-26T10:45:58.161065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":25712,"num_write":362,"num_write_kb":42020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'428","reported_seq":566,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:15.921115+0000","last_change":"2024-04-26T10:46:15.921226+0000","last_active":"2024-04-26T10:46:15.921115+0000","last_peered":"2024-04-26T10:46:15.921115+0000","last_clean":"2024-04-26T10:46:15.921115+0000","last_became_active":"2024-04-26T10:45:54.189852+0000","last_became_peered":"2024-04-26T10:45:54.189852+0000","last_unstale":"2024-04-26T10:46:15.921115+0000","last_undegraded":"2024-04-26T10:46:15.921115+0000","last_fullsized":"2024-04-26T10:46:15.921115+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'428","last_scrub_stamp":"2024-04-26T10:46:15.921093+0000","last_deep_scrub":"63'428","last_deep_scrub_stamp":"2024-04-26T10:46:15.921093+0000","last_clean_scrub_stamp":"2024-04-26T10:46:15.921093+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:06.246994+0000","scrub_duration":0.0037567920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12316,"num_write":384,"num_write_kb":87656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"63'446","reported_seq":588,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160212+0000","last_change":"2024-04-26T10:45:54.186962+0000","last_active":"2024-04-26T10:45:58.160212+0000","last_peered":"2024-04-26T10:45:58.160212+0000","last_clean":"2024-04-26T10:45:58.160212+0000","last_became_active":"2024-04-26T10:45:54.184063+0000","last_became_peered":"2024-04-26T10:45:54.184063+0000","last_unstale":"2024-04-26T10:45:58.160212+0000","last_undegraded":"2024-04-26T10:45:58.160212+0000","last_fullsized":"2024-04-26T10:45:58.160212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":53414,"num_write":401,"num_write_kb":80048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":551,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162132+0000","last_change":"2024-04-26T10:45:50.869971+0000","last_active":"2024-04-26T10:45:58.162132+0000","last_peered":"2024-04-26T10:45:58.162132+0000","last_clean":"2024-04-26T10:45:58.162132+0000","last_became_active":"2024-04-26T10:45:50.867680+0000","last_became_peered":"2024-04-26T10:45:50.867680+0000","last_unstale":"2024-04-26T10:45:58.162132+0000","last_undegraded":"2024-04-26T10:45:58.162132+0000","last_fullsized":"2024-04-26T10:45:58.162132+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19859,"num_write":405,"num_write_kb":51119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"63'408","reported_seq":863,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161955+0000","last_change":"2024-04-26T10:45:56.163683+0000","last_active":"2024-04-26T10:45:58.161955+0000","last_peered":"2024-04-26T10:45:58.161955+0000","last_clean":"2024-04-26T10:45:58.161955+0000","last_became_active":"2024-04-26T10:45:56.160360+0000","last_became_peered":"2024-04-26T10:45:56.160360+0000","last_unstale":"2024-04-26T10:45:58.161955+0000","last_undegraded":"2024-04-26T10:45:58.161955+0000","last_fullsized":"2024-04-26T10:45:58.161955+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":15372,"num_write":366,"num_write_kb":75855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"63'452","reported_seq":1018,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159893+0000","last_change":"2024-04-26T10:45:52.175372+0000","last_active":"2024-04-26T10:45:58.159893+0000","last_peered":"2024-04-26T10:45:58.159893+0000","last_clean":"2024-04-26T10:45:58.159893+0000","last_became_active":"2024-04-26T10:45:52.173702+0000","last_became_peered":"2024-04-26T10:45:52.173702+0000","last_unstale":"2024-04-26T10:45:58.159893+0000","last_undegraded":"2024-04-26T10:45:58.159893+0000","last_fullsized":"2024-04-26T10:45:58.159893+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43729,"num_write":421,"num_write_kb":79804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"63'408","reported_seq":883,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159635+0000","last_change":"2024-04-26T10:45:57.163475+0000","last_active":"2024-04-26T10:45:58.159635+0000","last_peered":"2024-04-26T10:45:58.159635+0000","last_clean":"2024-04-26T10:45:58.159635+0000","last_became_active":"2024-04-26T10:45:57.162147+0000","last_became_peered":"2024-04-26T10:45:57.162147+0000","last_unstale":"2024-04-26T10:45:58.159635+0000","last_undegraded":"2024-04-26T10:45:58.159635+0000","last_fullsized":"2024-04-26T10:45:58.159635+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":30320,"num_write":372,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'453","reported_seq":616,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159767+0000","last_change":"2024-04-26T10:45:54.184330+0000","last_active":"2024-04-26T10:45:58.159767+0000","last_peered":"2024-04-26T10:45:58.159767+0000","last_clean":"2024-04-26T10:45:58.159767+0000","last_became_active":"2024-04-26T10:45:54.181881+0000","last_became_peered":"2024-04-26T10:45:54.181881+0000","last_unstale":"2024-04-26T10:45:58.159767+0000","last_undegraded":"2024-04-26T10:45:58.159767+0000","last_fullsized":"2024-04-26T10:45:58.159767+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":19864,"num_write":422,"num_write_kb":51638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"63'439","reported_seq":966,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:07.911110+0000","last_change":"2024-04-26T10:46:07.911236+0000","last_active":"2024-04-26T10:46:07.911110+0000","last_peered":"2024-04-26T10:46:07.911110+0000","last_clean":"2024-04-26T10:46:07.911110+0000","last_became_active":"2024-04-26T10:45:48.866159+0000","last_became_peered":"2024-04-26T10:45:48.866159+0000","last_unstale":"2024-04-26T10:46:07.911110+0000","last_undegraded":"2024-04-26T10:46:07.911110+0000","last_fullsized":"2024-04-26T10:46:07.911110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'439","last_scrub_stamp":"2024-04-26T10:46:07.911088+0000","last_deep_scrub":"63'439","last_deep_scrub_stamp":"2024-04-26T10:46:07.911088+0000","last_clean_scrub_stamp":"2024-04-26T10:46:07.911088+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:32.755490+0000","scrub_duration":0.0024222179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8912,"num_write":417,"num_write_kb":46575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"63'513","reported_seq":1159,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160459+0000","last_change":"2024-04-26T10:45:51.160003+0000","last_active":"2024-04-26T10:45:58.160459+0000","last_peered":"2024-04-26T10:45:58.160459+0000","last_clean":"2024-04-26T10:45:58.160459+0000","last_became_active":"2024-04-26T10:45:51.158698+0000","last_became_peered":"2024-04-26T10:45:51.158698+0000","last_unstale":"2024-04-26T10:45:58.160459+0000","last_undegraded":"2024-04-26T10:45:58.160459+0000","last_fullsized":"2024-04-26T10:45:58.160459+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":70751,"num_write":473,"num_write_kb":88902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'406","reported_seq":534,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162541+0000","last_change":"2024-04-26T10:45:56.164805+0000","last_active":"2024-04-26T10:45:58.162541+0000","last_peered":"2024-04-26T10:45:58.162541+0000","last_clean":"2024-04-26T10:45:58.162541+0000","last_became_active":"2024-04-26T10:45:56.162419+0000","last_became_peered":"2024-04-26T10:45:56.162419+0000","last_unstale":"2024-04-26T10:45:58.162541+0000","last_undegraded":"2024-04-26T10:45:58.162541+0000","last_fullsized":"2024-04-26T10:45:58.162541+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":32121,"num_write":372,"num_write_kb":60163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"63'402","reported_seq":868,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160993+0000","last_change":"2024-04-26T10:45:57.166225+0000","last_active":"2024-04-26T10:45:58.160993+0000","last_peered":"2024-04-26T10:45:58.160993+0000","last_clean":"2024-04-26T10:45:58.160993+0000","last_became_active":"2024-04-26T10:45:57.165064+0000","last_became_peered":"2024-04-26T10:45:57.165064+0000","last_unstale":"2024-04-26T10:45:58.160993+0000","last_undegraded":"2024-04-26T10:45:58.160993+0000","last_fullsized":"2024-04-26T10:45:58.160993+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":6824,"num_write":378,"num_write_kb":72156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"63'407","reported_seq":889,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:59.681981+0000","last_change":"2024-04-26T10:45:58.163989+0000","last_active":"2024-04-26T10:45:59.681981+0000","last_peered":"2024-04-26T10:45:59.681981+0000","last_clean":"2024-04-26T10:45:59.681981+0000","last_became_active":"2024-04-26T10:45:58.161850+0000","last_became_peered":"2024-04-26T10:45:58.161850+0000","last_unstale":"2024-04-26T10:45:59.681981+0000","last_undegraded":"2024-04-26T10:45:59.681981+0000","last_fullsized":"2024-04-26T10:45:59.681981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25898,"num_write":372,"num_write_kb":59274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":346,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'490","reported_seq":1059,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160092+0000","last_change":"2024-04-26T10:45:55.179785+0000","last_active":"2024-04-26T10:45:58.160092+0000","last_peered":"2024-04-26T10:45:58.160092+0000","last_clean":"2024-04-26T10:45:58.160092+0000","last_became_active":"2024-04-26T10:45:55.178083+0000","last_became_peered":"2024-04-26T10:45:55.178083+0000","last_unstale":"2024-04-26T10:45:58.160092+0000","last_undegraded":"2024-04-26T10:45:58.160092+0000","last_fullsized":"2024-04-26T10:45:58.160092+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33597,"num_write":449,"num_write_kb":87981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"63'474","reported_seq":564,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159545+0000","last_change":"2024-04-26T10:45:54.189228+0000","last_active":"2024-04-26T10:45:58.159545+0000","last_peered":"2024-04-26T10:45:58.159545+0000","last_clean":"2024-04-26T10:45:58.159545+0000","last_became_active":"2024-04-26T10:45:54.186011+0000","last_became_peered":"2024-04-26T10:45:54.186011+0000","last_unstale":"2024-04-26T10:45:58.159545+0000","last_undegraded":"2024-04-26T10:45:58.159545+0000","last_fullsized":"2024-04-26T10:45:58.159545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30886,"num_write":441,"num_write_kb":118807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'443","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161578+0000","last_change":"2024-04-26T10:45:48.864423+0000","last_active":"2024-04-26T10:45:58.161578+0000","last_peered":"2024-04-26T10:45:58.161578+0000","last_clean":"2024-04-26T10:45:58.161578+0000","last_became_active":"2024-04-26T10:45:48.861918+0000","last_became_peered":"2024-04-26T10:45:48.861918+0000","last_unstale":"2024-04-26T10:45:58.161578+0000","last_undegraded":"2024-04-26T10:45:58.161578+0000","last_fullsized":"2024-04-26T10:45:58.161578+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20556,"num_write":413,"num_write_kb":91647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"63'376","reported_seq":479,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160599+0000","last_change":"2024-04-26T10:42:26.041757+0000","last_active":"2024-04-26T10:45:58.160599+0000","last_peered":"2024-04-26T10:45:58.160599+0000","last_clean":"2024-04-26T10:45:58.160599+0000","last_became_active":"2024-04-26T10:42:26.040920+0000","last_became_peered":"2024-04-26T10:42:26.040920+0000","last_unstale":"2024-04-26T10:45:58.160599+0000","last_undegraded":"2024-04-26T10:45:58.160599+0000","last_fullsized":"2024-04-26T10:45:58.160599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10124,"num_write":344,"num_write_kb":66899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"62'453","reported_seq":534,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161595+0000","last_change":"2024-04-26T10:45:48.862782+0000","last_active":"2024-04-26T10:45:58.161595+0000","last_peered":"2024-04-26T10:45:58.161595+0000","last_clean":"2024-04-26T10:45:58.161595+0000","last_became_active":"2024-04-26T10:45:48.862424+0000","last_became_peered":"2024-04-26T10:45:48.862424+0000","last_unstale":"2024-04-26T10:45:58.161595+0000","last_undegraded":"2024-04-26T10:45:58.161595+0000","last_fullsized":"2024-04-26T10:45:58.161595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"63'403","reported_seq":532,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:10.923122+0000","last_change":"2024-04-26T10:46:10.923239+0000","last_active":"2024-04-26T10:46:10.923122+0000","last_peered":"2024-04-26T10:46:10.923122+0000","last_clean":"2024-04-26T10:46:10.923122+0000","last_became_active":"2024-04-26T10:42:26.040464+0000","last_became_peered":"2024-04-26T10:42:26.040464+0000","last_unstale":"2024-04-26T10:46:10.923122+0000","last_undegraded":"2024-04-26T10:46:10.923122+0000","last_fullsized":"2024-04-26T10:46:10.923122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'403","last_scrub_stamp":"2024-04-26T10:46:10.923100+0000","last_deep_scrub":"63'403","last_deep_scrub_stamp":"2024-04-26T10:46:10.923100+0000","last_clean_scrub_stamp":"2024-04-26T10:46:10.923100+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:00.804186+0000","scrub_duration":0.0037994579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24588,"num_write":363,"num_write_kb":51190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"62'49","reported_seq":144,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159679+0000","last_change":"2024-04-26T10:45:45.862317+0000","last_active":"2024-04-26T10:45:58.159679+0000","last_peered":"2024-04-26T10:45:58.159679+0000","last_clean":"2024-04-26T10:45:58.159679+0000","last_became_active":"2024-04-26T10:45:45.862029+0000","last_became_peered":"2024-04-26T10:45:45.862029+0000","last_unstale":"2024-04-26T10:45:58.159679+0000","last_undegraded":"2024-04-26T10:45:58.159679+0000","last_fullsized":"2024-04-26T10:45:58.159679+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'407","reported_seq":888,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160627+0000","last_change":"2024-04-26T10:45:52.170710+0000","last_active":"2024-04-26T10:45:58.160627+0000","last_peered":"2024-04-26T10:45:58.160627+0000","last_clean":"2024-04-26T10:45:58.160627+0000","last_became_active":"2024-04-26T10:45:52.169295+0000","last_became_peered":"2024-04-26T10:45:52.169295+0000","last_unstale":"2024-04-26T10:45:58.160627+0000","last_undegraded":"2024-04-26T10:45:58.160627+0000","last_fullsized":"2024-04-26T10:45:58.160627+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":7077,"num_write":367,"num_write_kb":42434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"62'66","reported_seq":161,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159949+0000","last_change":"2024-04-26T10:45:45.874440+0000","last_active":"2024-04-26T10:45:58.159949+0000","last_peered":"2024-04-26T10:45:58.159949+0000","last_clean":"2024-04-26T10:45:58.159949+0000","last_became_active":"2024-04-26T10:45:45.874030+0000","last_became_peered":"2024-04-26T10:45:45.874030+0000","last_unstale":"2024-04-26T10:45:58.159949+0000","last_undegraded":"2024-04-26T10:45:58.159949+0000","last_fullsized":"2024-04-26T10:45:58.159949+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"63'406","reported_seq":899,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160833+0000","last_change":"2024-04-26T10:45:49.863376+0000","last_active":"2024-04-26T10:45:58.160833+0000","last_peered":"2024-04-26T10:45:58.160833+0000","last_clean":"2024-04-26T10:45:58.160833+0000","last_became_active":"2024-04-26T10:45:49.861979+0000","last_became_peered":"2024-04-26T10:45:49.861979+0000","last_unstale":"2024-04-26T10:45:58.160833+0000","last_undegraded":"2024-04-26T10:45:58.160833+0000","last_fullsized":"2024-04-26T10:45:58.160833+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":25977,"num_write":374,"num_write_kb":104172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'66","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161614+0000","last_change":"2024-04-26T10:45:45.871507+0000","last_active":"2024-04-26T10:45:58.161614+0000","last_peered":"2024-04-26T10:45:58.161614+0000","last_clean":"2024-04-26T10:45:58.161614+0000","last_became_active":"2024-04-26T10:45:45.871120+0000","last_became_peered":"2024-04-26T10:45:45.871120+0000","last_unstale":"2024-04-26T10:45:58.161614+0000","last_undegraded":"2024-04-26T10:45:58.161614+0000","last_fullsized":"2024-04-26T10:45:58.161614+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"62'200","reported_seq":282,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162741+0000","last_change":"2024-04-26T10:45:48.866225+0000","last_active":"2024-04-26T10:45:58.162741+0000","last_peered":"2024-04-26T10:45:58.162741+0000","last_clean":"2024-04-26T10:45:58.162741+0000","last_became_active":"2024-04-26T10:45:48.865878+0000","last_became_peered":"2024-04-26T10:45:48.865878+0000","last_unstale":"2024-04-26T10:45:58.162741+0000","last_undegraded":"2024-04-26T10:45:58.162741+0000","last_fullsized":"2024-04-26T10:45:58.162741+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"63'415","reported_seq":920,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:11.914657+0000","last_change":"2024-04-26T10:46:11.914773+0000","last_active":"2024-04-26T10:46:11.914657+0000","last_peered":"2024-04-26T10:46:11.914657+0000","last_clean":"2024-04-26T10:46:11.914657+0000","last_became_active":"2024-04-26T10:45:57.163263+0000","last_became_peered":"2024-04-26T10:45:57.163263+0000","last_unstale":"2024-04-26T10:46:11.914657+0000","last_undegraded":"2024-04-26T10:46:11.914657+0000","last_fullsized":"2024-04-26T10:46:11.914657+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'415","last_scrub_stamp":"2024-04-26T10:46:11.914637+0000","last_deep_scrub":"63'415","last_deep_scrub_stamp":"2024-04-26T10:46:11.914637+0000","last_clean_scrub_stamp":"2024-04-26T10:46:11.914637+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:19.456262+0000","scrub_duration":0.0026733759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15757,"num_write":380,"num_write_kb":54727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"62'342","reported_seq":449,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160870+0000","last_change":"2024-04-26T10:45:48.866915+0000","last_active":"2024-04-26T10:45:58.160870+0000","last_peered":"2024-04-26T10:45:58.160870+0000","last_clean":"2024-04-26T10:45:58.160870+0000","last_became_active":"2024-04-26T10:45:48.866497+0000","last_became_peered":"2024-04-26T10:45:48.866497+0000","last_unstale":"2024-04-26T10:45:58.160870+0000","last_undegraded":"2024-04-26T10:45:58.160870+0000","last_fullsized":"2024-04-26T10:45:58.160870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"63'481","reported_seq":671,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159950+0000","last_change":"2024-04-26T10:45:54.184646+0000","last_active":"2024-04-26T10:45:58.159950+0000","last_peered":"2024-04-26T10:45:58.159950+0000","last_clean":"2024-04-26T10:45:58.159950+0000","last_became_active":"2024-04-26T10:45:54.181993+0000","last_became_peered":"2024-04-26T10:45:54.181993+0000","last_unstale":"2024-04-26T10:45:58.159950+0000","last_undegraded":"2024-04-26T10:45:58.159950+0000","last_fullsized":"2024-04-26T10:45:58.159950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":45251,"num_write":451,"num_write_kb":105365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"62'460","reported_seq":542,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162232+0000","last_change":"2024-04-26T10:45:48.865887+0000","last_active":"2024-04-26T10:45:58.162232+0000","last_peered":"2024-04-26T10:45:58.162232+0000","last_clean":"2024-04-26T10:45:58.162232+0000","last_became_active":"2024-04-26T10:45:48.865520+0000","last_became_peered":"2024-04-26T10:45:48.865520+0000","last_unstale":"2024-04-26T10:45:58.162232+0000","last_undegraded":"2024-04-26T10:45:58.162232+0000","last_fullsized":"2024-04-26T10:45:58.162232+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":407,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'420","reported_seq":504,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161880+0000","last_change":"2024-04-26T10:45:57.165390+0000","last_active":"2024-04-26T10:45:58.161880+0000","last_peered":"2024-04-26T10:45:58.161880+0000","last_clean":"2024-04-26T10:45:58.161880+0000","last_became_active":"2024-04-26T10:45:57.162014+0000","last_became_peered":"2024-04-26T10:45:57.162014+0000","last_unstale":"2024-04-26T10:45:58.161880+0000","last_undegraded":"2024-04-26T10:45:58.161880+0000","last_fullsized":"2024-04-26T10:45:58.161880+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13025,"num_write":385,"num_write_kb":38595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"62'67","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161983+0000","last_change":"2024-04-26T10:45:45.860717+0000","last_active":"2024-04-26T10:45:58.161983+0000","last_peered":"2024-04-26T10:45:58.161983+0000","last_clean":"2024-04-26T10:45:58.161983+0000","last_became_active":"2024-04-26T10:45:45.860175+0000","last_became_peered":"2024-04-26T10:45:45.860175+0000","last_unstale":"2024-04-26T10:45:58.161983+0000","last_undegraded":"2024-04-26T10:45:58.161983+0000","last_fullsized":"2024-04-26T10:45:58.161983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"63'452","reported_seq":966,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:59.681950+0000","last_change":"2024-04-26T10:45:58.166413+0000","last_active":"2024-04-26T10:45:59.681950+0000","last_peered":"2024-04-26T10:45:59.681950+0000","last_clean":"2024-04-26T10:45:59.681950+0000","last_became_active":"2024-04-26T10:45:58.164105+0000","last_became_peered":"2024-04-26T10:45:58.164105+0000","last_unstale":"2024-04-26T10:45:59.681950+0000","last_undegraded":"2024-04-26T10:45:59.681950+0000","last_fullsized":"2024-04-26T10:45:59.681950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23217,"num_write":416,"num_write_kb":71418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":388,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"62'200","reported_seq":278,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159939+0000","last_change":"2024-04-26T10:45:56.160957+0000","last_active":"2024-04-26T10:45:58.159939+0000","last_peered":"2024-04-26T10:45:58.159939+0000","last_clean":"2024-04-26T10:45:58.159939+0000","last_became_active":"2024-04-26T10:45:56.160475+0000","last_became_peered":"2024-04-26T10:45:56.160475+0000","last_unstale":"2024-04-26T10:45:58.159939+0000","last_undegraded":"2024-04-26T10:45:58.159939+0000","last_fullsized":"2024-04-26T10:45:58.159939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'430","reported_seq":513,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162319+0000","last_change":"2024-04-26T10:45:57.164742+0000","last_active":"2024-04-26T10:45:58.162319+0000","last_peered":"2024-04-26T10:45:58.162319+0000","last_clean":"2024-04-26T10:45:58.162319+0000","last_became_active":"2024-04-26T10:45:57.162070+0000","last_became_peered":"2024-04-26T10:45:57.162070+0000","last_unstale":"2024-04-26T10:45:58.162319+0000","last_undegraded":"2024-04-26T10:45:58.162319+0000","last_fullsized":"2024-04-26T10:45:58.162319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":24352,"num_write":392,"num_write_kb":21976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"62'233","reported_seq":307,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161329+0000","last_change":"2024-04-26T10:45:48.862856+0000","last_active":"2024-04-26T10:45:58.161329+0000","last_peered":"2024-04-26T10:45:58.161329+0000","last_clean":"2024-04-26T10:45:58.161329+0000","last_became_active":"2024-04-26T10:45:48.862517+0000","last_became_peered":"2024-04-26T10:45:48.862517+0000","last_unstale":"2024-04-26T10:45:58.161329+0000","last_undegraded":"2024-04-26T10:45:58.161329+0000","last_fullsized":"2024-04-26T10:45:58.161329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"63'393","reported_seq":479,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162206+0000","last_change":"2024-04-26T10:45:55.180960+0000","last_active":"2024-04-26T10:45:58.162206+0000","last_peered":"2024-04-26T10:45:58.162206+0000","last_clean":"2024-04-26T10:45:58.162206+0000","last_became_active":"2024-04-26T10:45:55.177758+0000","last_became_peered":"2024-04-26T10:45:55.177758+0000","last_unstale":"2024-04-26T10:45:58.162206+0000","last_undegraded":"2024-04-26T10:45:58.162206+0000","last_fullsized":"2024-04-26T10:45:58.162206+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8671,"num_write":368,"num_write_kb":38542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"62'49","reported_seq":144,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160077+0000","last_change":"2024-04-26T10:45:45.874789+0000","last_active":"2024-04-26T10:45:58.160077+0000","last_peered":"2024-04-26T10:45:58.160077+0000","last_clean":"2024-04-26T10:45:58.160077+0000","last_became_active":"2024-04-26T10:45:45.874328+0000","last_became_peered":"2024-04-26T10:45:45.874328+0000","last_unstale":"2024-04-26T10:45:58.160077+0000","last_undegraded":"2024-04-26T10:45:58.160077+0000","last_fullsized":"2024-04-26T10:45:58.160077+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"63'368","reported_seq":464,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162768+0000","last_change":"2024-04-26T10:45:56.165615+0000","last_active":"2024-04-26T10:45:58.162768+0000","last_peered":"2024-04-26T10:45:58.162768+0000","last_clean":"2024-04-26T10:45:58.162768+0000","last_became_active":"2024-04-26T10:45:56.163456+0000","last_became_peered":"2024-04-26T10:45:56.163456+0000","last_unstale":"2024-04-26T10:45:58.162768+0000","last_undegraded":"2024-04-26T10:45:58.162768+0000","last_fullsized":"2024-04-26T10:45:58.162768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":19222,"num_write":336,"num_write_kb":58903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"62'619","reported_seq":748,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159889+0000","last_change":"2024-04-26T10:45:56.162511+0000","last_active":"2024-04-26T10:45:58.159889+0000","last_peered":"2024-04-26T10:45:58.159889+0000","last_clean":"2024-04-26T10:45:58.159889+0000","last_became_active":"2024-04-26T10:45:56.161604+0000","last_became_peered":"2024-04-26T10:45:56.161604+0000","last_unstale":"2024-04-26T10:45:58.159889+0000","last_undegraded":"2024-04-26T10:45:58.159889+0000","last_fullsized":"2024-04-26T10:45:58.159889+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":558,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"63'383","reported_seq":823,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:59.682112+0000","last_change":"2024-04-26T10:45:58.165237+0000","last_active":"2024-04-26T10:45:59.682112+0000","last_peered":"2024-04-26T10:45:59.682112+0000","last_clean":"2024-04-26T10:45:59.682112+0000","last_became_active":"2024-04-26T10:45:58.162264+0000","last_became_peered":"2024-04-26T10:45:58.162264+0000","last_unstale":"2024-04-26T10:45:59.682112+0000","last_undegraded":"2024-04-26T10:45:59.682112+0000","last_fullsized":"2024-04-26T10:45:59.682112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":14260,"num_write":349,"num_write_kb":50367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":230,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161343+0000","last_change":"2024-04-26T10:45:45.871511+0000","last_active":"2024-04-26T10:45:58.161343+0000","last_peered":"2024-04-26T10:45:58.161343+0000","last_clean":"2024-04-26T10:45:58.161343+0000","last_became_active":"2024-04-26T10:45:45.871155+0000","last_became_peered":"2024-04-26T10:45:45.871155+0000","last_unstale":"2024-04-26T10:45:58.161343+0000","last_undegraded":"2024-04-26T10:45:58.161343+0000","last_fullsized":"2024-04-26T10:45:58.161343+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161402+0000","last_change":"2024-04-26T10:45:45.861068+0000","last_active":"2024-04-26T10:45:58.161402+0000","last_peered":"2024-04-26T10:45:58.161402+0000","last_clean":"2024-04-26T10:45:58.161402+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:58.161402+0000","last_undegraded":"2024-04-26T10:45:58.161402+0000","last_fullsized":"2024-04-26T10:45:58.161402+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"62'743","reported_seq":825,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159763+0000","last_change":"2024-04-26T10:42:25.686765+0000","last_active":"2024-04-26T10:45:58.159763+0000","last_peered":"2024-04-26T10:45:58.159763+0000","last_clean":"2024-04-26T10:45:58.159763+0000","last_became_active":"2024-04-26T10:42:25.686009+0000","last_became_peered":"2024-04-26T10:42:25.686009+0000","last_unstale":"2024-04-26T10:45:58.159763+0000","last_undegraded":"2024-04-26T10:45:58.159763+0000","last_fullsized":"2024-04-26T10:45:58.159763+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'442","reported_seq":568,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162375+0000","last_change":"2024-04-26T10:45:55.181074+0000","last_active":"2024-04-26T10:45:58.162375+0000","last_peered":"2024-04-26T10:45:58.162375+0000","last_clean":"2024-04-26T10:45:58.162375+0000","last_became_active":"2024-04-26T10:45:55.177751+0000","last_became_peered":"2024-04-26T10:45:55.177751+0000","last_unstale":"2024-04-26T10:45:58.162375+0000","last_undegraded":"2024-04-26T10:45:58.162375+0000","last_fullsized":"2024-04-26T10:45:58.162375+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":34346,"num_write":406,"num_write_kb":96298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161948+0000","last_change":"2024-04-26T10:45:45.872099+0000","last_active":"2024-04-26T10:45:58.161948+0000","last_peered":"2024-04-26T10:45:58.161948+0000","last_clean":"2024-04-26T10:45:58.161948+0000","last_became_active":"2024-04-26T10:45:45.871741+0000","last_became_peered":"2024-04-26T10:45:45.871741+0000","last_unstale":"2024-04-26T10:45:58.161948+0000","last_undegraded":"2024-04-26T10:45:58.161948+0000","last_fullsized":"2024-04-26T10:45:58.161948+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"63'102","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159454+0000","last_change":"2024-04-26T10:45:56.160802+0000","last_active":"2024-04-26T10:45:58.159454+0000","last_peered":"2024-04-26T10:45:58.159454+0000","last_clean":"2024-04-26T10:45:58.159454+0000","last_became_active":"2024-04-26T10:45:56.160328+0000","last_became_peered":"2024-04-26T10:45:56.160328+0000","last_unstale":"2024-04-26T10:45:58.159454+0000","last_undegraded":"2024-04-26T10:45:58.159454+0000","last_fullsized":"2024-04-26T10:45:58.159454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467631,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":44,"num_write_kb":1460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2935262,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'485","reported_seq":621,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.876202+0000","last_change":"2024-04-26T10:45:57.165815+0000","last_active":"2024-04-26T10:45:58.876202+0000","last_peered":"2024-04-26T10:45:58.876202+0000","last_clean":"2024-04-26T10:45:58.876202+0000","last_became_active":"2024-04-26T10:45:57.162752+0000","last_became_peered":"2024-04-26T10:45:57.162752+0000","last_unstale":"2024-04-26T10:45:58.876202+0000","last_undegraded":"2024-04-26T10:45:58.876202+0000","last_fullsized":"2024-04-26T10:45:58.876202+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27703,"num_write":454,"num_write_kb":121509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159848+0000","last_change":"2024-04-26T10:45:53.180892+0000","last_active":"2024-04-26T10:45:58.159848+0000","last_peered":"2024-04-26T10:45:58.159848+0000","last_clean":"2024-04-26T10:45:58.159848+0000","last_became_active":"2024-04-26T10:45:53.180675+0000","last_became_peered":"2024-04-26T10:45:53.180675+0000","last_unstale":"2024-04-26T10:45:58.159848+0000","last_undegraded":"2024-04-26T10:45:58.159848+0000","last_fullsized":"2024-04-26T10:45:58.159848+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"62'306","reported_seq":414,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160423+0000","last_change":"2024-04-26T10:45:48.865095+0000","last_active":"2024-04-26T10:45:58.160423+0000","last_peered":"2024-04-26T10:45:58.160423+0000","last_clean":"2024-04-26T10:45:58.160423+0000","last_became_active":"2024-04-26T10:45:48.864763+0000","last_became_peered":"2024-04-26T10:45:48.864763+0000","last_unstale":"2024-04-26T10:45:58.160423+0000","last_undegraded":"2024-04-26T10:45:58.160423+0000","last_fullsized":"2024-04-26T10:45:58.160423+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"63'336","reported_seq":749,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:59.682135+0000","last_change":"2024-04-26T10:45:58.165267+0000","last_active":"2024-04-26T10:45:59.682135+0000","last_peered":"2024-04-26T10:45:59.682135+0000","last_clean":"2024-04-26T10:45:59.682135+0000","last_became_active":"2024-04-26T10:45:58.162320+0000","last_became_peered":"2024-04-26T10:45:58.162320+0000","last_unstale":"2024-04-26T10:45:59.682135+0000","last_undegraded":"2024-04-26T10:45:59.682135+0000","last_fullsized":"2024-04-26T10:45:59.682135+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12035,"num_write":314,"num_write_kb":29928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":306,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161152+0000","last_change":"2024-04-26T10:45:45.861233+0000","last_active":"2024-04-26T10:45:58.161152+0000","last_peered":"2024-04-26T10:45:58.161152+0000","last_clean":"2024-04-26T10:45:58.161152+0000","last_became_active":"2024-04-26T10:45:45.860924+0000","last_became_peered":"2024-04-26T10:45:45.860924+0000","last_unstale":"2024-04-26T10:45:58.161152+0000","last_undegraded":"2024-04-26T10:45:58.161152+0000","last_fullsized":"2024-04-26T10:45:58.161152+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"62'64","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161518+0000","last_change":"2024-04-26T10:45:45.861230+0000","last_active":"2024-04-26T10:45:58.161518+0000","last_peered":"2024-04-26T10:45:58.161518+0000","last_clean":"2024-04-26T10:45:58.161518+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:58.161518+0000","last_undegraded":"2024-04-26T10:45:58.161518+0000","last_fullsized":"2024-04-26T10:45:58.161518+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"63'421","reported_seq":514,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160380+0000","last_change":"2024-04-26T10:45:54.188138+0000","last_active":"2024-04-26T10:45:58.160380+0000","last_peered":"2024-04-26T10:45:58.160380+0000","last_clean":"2024-04-26T10:45:58.160380+0000","last_became_active":"2024-04-26T10:45:54.185053+0000","last_became_peered":"2024-04-26T10:45:54.185053+0000","last_unstale":"2024-04-26T10:45:58.160380+0000","last_undegraded":"2024-04-26T10:45:58.160380+0000","last_fullsized":"2024-04-26T10:45:58.160380+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28557,"num_write":385,"num_write_kb":93083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"62'480","reported_seq":554,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161962+0000","last_change":"2024-04-26T10:45:48.862894+0000","last_active":"2024-04-26T10:45:58.161962+0000","last_peered":"2024-04-26T10:45:58.161962+0000","last_clean":"2024-04-26T10:45:58.161962+0000","last_became_active":"2024-04-26T10:45:48.862564+0000","last_became_peered":"2024-04-26T10:45:48.862564+0000","last_unstale":"2024-04-26T10:45:58.161962+0000","last_undegraded":"2024-04-26T10:45:58.161962+0000","last_fullsized":"2024-04-26T10:45:58.161962+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160379+0000","last_change":"2024-04-26T10:42:21.405754+0000","last_active":"2024-04-26T10:45:58.160379+0000","last_peered":"2024-04-26T10:45:58.160379+0000","last_clean":"2024-04-26T10:45:58.160379+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:45:58.160379+0000","last_undegraded":"2024-04-26T10:45:58.160379+0000","last_fullsized":"2024-04-26T10:45:58.160379+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'352","reported_seq":777,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159929+0000","last_change":"2024-04-26T10:45:53.183401+0000","last_active":"2024-04-26T10:45:58.159929+0000","last_peered":"2024-04-26T10:45:58.159929+0000","last_clean":"2024-04-26T10:45:58.159929+0000","last_became_active":"2024-04-26T10:45:53.182454+0000","last_became_peered":"2024-04-26T10:45:53.182454+0000","last_unstale":"2024-04-26T10:45:58.159929+0000","last_undegraded":"2024-04-26T10:45:58.159929+0000","last_fullsized":"2024-04-26T10:45:58.159929+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":1905,"num_write":313,"num_write_kb":25573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"62'59","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159987+0000","last_change":"2024-04-26T10:45:53.177446+0000","last_active":"2024-04-26T10:45:58.159987+0000","last_peered":"2024-04-26T10:45:58.159987+0000","last_clean":"2024-04-26T10:45:58.159987+0000","last_became_active":"2024-04-26T10:45:53.176996+0000","last_became_peered":"2024-04-26T10:45:53.176996+0000","last_unstale":"2024-04-26T10:45:58.159987+0000","last_undegraded":"2024-04-26T10:45:58.159987+0000","last_fullsized":"2024-04-26T10:45:58.159987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":89,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162375+0000","last_change":"2024-04-26T10:45:53.175046+0000","last_active":"2024-04-26T10:45:58.162375+0000","last_peered":"2024-04-26T10:45:58.162375+0000","last_clean":"2024-04-26T10:45:58.162375+0000","last_became_active":"2024-04-26T10:45:53.174781+0000","last_became_peered":"2024-04-26T10:45:53.174781+0000","last_unstale":"2024-04-26T10:45:58.162375+0000","last_undegraded":"2024-04-26T10:45:58.162375+0000","last_fullsized":"2024-04-26T10:45:58.162375+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'408","reported_seq":908,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160351+0000","last_change":"2024-04-26T10:45:54.186637+0000","last_active":"2024-04-26T10:45:58.160351+0000","last_peered":"2024-04-26T10:45:58.160351+0000","last_clean":"2024-04-26T10:45:58.160351+0000","last_became_active":"2024-04-26T10:45:54.185238+0000","last_became_peered":"2024-04-26T10:45:54.185238+0000","last_unstale":"2024-04-26T10:45:58.160351+0000","last_undegraded":"2024-04-26T10:45:58.160351+0000","last_fullsized":"2024-04-26T10:45:58.160351+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19939,"num_write":382,"num_write_kb":63433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"62'55","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161004+0000","last_change":"2024-04-26T10:45:53.205131+0000","last_active":"2024-04-26T10:45:58.161004+0000","last_peered":"2024-04-26T10:45:58.161004+0000","last_clean":"2024-04-26T10:45:58.161004+0000","last_became_active":"2024-04-26T10:45:53.177305+0000","last_became_peered":"2024-04-26T10:45:53.177305+0000","last_unstale":"2024-04-26T10:45:58.161004+0000","last_undegraded":"2024-04-26T10:45:58.161004+0000","last_fullsized":"2024-04-26T10:45:58.161004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160248+0000","last_change":"2024-04-26T10:45:53.177593+0000","last_active":"2024-04-26T10:45:58.160248+0000","last_peered":"2024-04-26T10:45:58.160248+0000","last_clean":"2024-04-26T10:45:58.160248+0000","last_became_active":"2024-04-26T10:45:53.177249+0000","last_became_peered":"2024-04-26T10:45:53.177249+0000","last_unstale":"2024-04-26T10:45:58.160248+0000","last_undegraded":"2024-04-26T10:45:58.160248+0000","last_fullsized":"2024-04-26T10:45:58.160248+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'418","reported_seq":878,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159665+0000","last_change":"2024-04-26T10:45:56.162729+0000","last_active":"2024-04-26T10:45:58.159665+0000","last_peered":"2024-04-26T10:45:58.159665+0000","last_clean":"2024-04-26T10:45:58.159665+0000","last_became_active":"2024-04-26T10:45:56.160440+0000","last_became_peered":"2024-04-26T10:45:56.160440+0000","last_unstale":"2024-04-26T10:45:58.159665+0000","last_undegraded":"2024-04-26T10:45:58.159665+0000","last_fullsized":"2024-04-26T10:45:58.159665+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20110,"num_write":390,"num_write_kb":75171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"84'67","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:20.114106+0000","last_change":"2024-04-26T10:46:20.114217+0000","last_active":"2024-04-26T10:46:20.114106+0000","last_peered":"2024-04-26T10:46:20.114106+0000","last_clean":"2024-04-26T10:46:20.114106+0000","last_became_active":"2024-04-26T10:45:53.175946+0000","last_became_peered":"2024-04-26T10:45:53.175946+0000","last_unstale":"2024-04-26T10:46:20.114106+0000","last_undegraded":"2024-04-26T10:46:20.114106+0000","last_fullsized":"2024-04-26T10:46:20.114106+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'67","last_scrub_stamp":"2024-04-26T10:46:20.114082+0000","last_deep_scrub":"84'67","last_deep_scrub_stamp":"2024-04-26T10:46:20.114082+0000","last_clean_scrub_stamp":"2024-04-26T10:46:20.114082+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:16.069289+0000","scrub_duration":0.00304288,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162589+0000","last_change":"2024-04-26T10:45:45.872224+0000","last_active":"2024-04-26T10:45:58.162589+0000","last_peered":"2024-04-26T10:45:58.162589+0000","last_clean":"2024-04-26T10:45:58.162589+0000","last_became_active":"2024-04-26T10:45:45.871923+0000","last_became_peered":"2024-04-26T10:45:45.871923+0000","last_unstale":"2024-04-26T10:45:58.162589+0000","last_undegraded":"2024-04-26T10:45:58.162589+0000","last_fullsized":"2024-04-26T10:45:58.162589+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"63'404","reported_seq":922,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159831+0000","last_change":"2024-04-26T10:45:54.184386+0000","last_active":"2024-04-26T10:45:58.159831+0000","last_peered":"2024-04-26T10:45:58.159831+0000","last_clean":"2024-04-26T10:45:58.159831+0000","last_became_active":"2024-04-26T10:45:54.181795+0000","last_became_peered":"2024-04-26T10:45:54.181795+0000","last_unstale":"2024-04-26T10:45:58.159831+0000","last_undegraded":"2024-04-26T10:45:58.159831+0000","last_fullsized":"2024-04-26T10:45:58.159831+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41262,"num_write":371,"num_write_kb":75820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"63'441","reported_seq":565,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161758+0000","last_change":"2024-04-26T10:45:54.188488+0000","last_active":"2024-04-26T10:45:58.161758+0000","last_peered":"2024-04-26T10:45:58.161758+0000","last_clean":"2024-04-26T10:45:58.161758+0000","last_became_active":"2024-04-26T10:45:54.185862+0000","last_became_peered":"2024-04-26T10:45:54.185862+0000","last_unstale":"2024-04-26T10:45:58.161758+0000","last_undegraded":"2024-04-26T10:45:58.161758+0000","last_fullsized":"2024-04-26T10:45:58.161758+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31514,"num_write":408,"num_write_kb":107129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"64'431","reported_seq":521,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161811+0000","last_change":"2024-04-26T10:45:48.865579+0000","last_active":"2024-04-26T10:45:58.161811+0000","last_peered":"2024-04-26T10:45:58.161811+0000","last_clean":"2024-04-26T10:45:58.161811+0000","last_became_active":"2024-04-26T10:45:48.865212+0000","last_became_peered":"2024-04-26T10:45:48.865212+0000","last_unstale":"2024-04-26T10:45:58.161811+0000","last_undegraded":"2024-04-26T10:45:58.161811+0000","last_fullsized":"2024-04-26T10:45:58.161811+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9902610,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":9913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9896193,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"63'410","reported_seq":516,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161317+0000","last_change":"2024-04-26T10:45:54.184713+0000","last_active":"2024-04-26T10:45:58.161317+0000","last_peered":"2024-04-26T10:45:58.161317+0000","last_clean":"2024-04-26T10:45:58.161317+0000","last_became_active":"2024-04-26T10:45:54.182167+0000","last_became_peered":"2024-04-26T10:45:54.182167+0000","last_unstale":"2024-04-26T10:45:58.161317+0000","last_undegraded":"2024-04-26T10:45:58.161317+0000","last_fullsized":"2024-04-26T10:45:58.161317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12734,"num_write":373,"num_write_kb":34864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"63'84","reported_seq":184,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160923+0000","last_change":"2024-04-26T10:45:45.896842+0000","last_active":"2024-04-26T10:45:58.160923+0000","last_peered":"2024-04-26T10:45:58.160923+0000","last_clean":"2024-04-26T10:45:58.160923+0000","last_became_active":"2024-04-26T10:45:45.874746+0000","last_became_peered":"2024-04-26T10:45:45.874746+0000","last_unstale":"2024-04-26T10:45:58.160923+0000","last_undegraded":"2024-04-26T10:45:58.160923+0000","last_fullsized":"2024-04-26T10:45:58.160923+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"84'333","reported_seq":432,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:14.252839+0000","last_change":"2024-04-26T10:46:14.252936+0000","last_active":"2024-04-26T10:46:14.252839+0000","last_peered":"2024-04-26T10:46:14.252839+0000","last_clean":"2024-04-26T10:46:14.252839+0000","last_became_active":"2024-04-26T10:45:56.161449+0000","last_became_peered":"2024-04-26T10:45:56.161449+0000","last_unstale":"2024-04-26T10:46:14.252839+0000","last_undegraded":"2024-04-26T10:46:14.252839+0000","last_fullsized":"2024-04-26T10:46:14.252839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'333","last_scrub_stamp":"2024-04-26T10:46:14.252815+0000","last_deep_scrub":"84'333","last_deep_scrub_stamp":"2024-04-26T10:46:14.252815+0000","last_clean_scrub_stamp":"2024-04-26T10:46:14.252815+0000","objects_scrubbed":1,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:06.020647+0000","scrub_duration":0.0087233659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"63'487","reported_seq":1097,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159640+0000","last_change":"2024-04-26T10:45:51.160586+0000","last_active":"2024-04-26T10:45:58.159640+0000","last_peered":"2024-04-26T10:45:58.159640+0000","last_clean":"2024-04-26T10:45:58.159640+0000","last_became_active":"2024-04-26T10:45:51.159235+0000","last_became_peered":"2024-04-26T10:45:51.159235+0000","last_unstale":"2024-04-26T10:45:58.159640+0000","last_undegraded":"2024-04-26T10:45:58.159640+0000","last_fullsized":"2024-04-26T10:45:58.159640+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":43316,"num_write":468,"num_write_kb":77062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"62'61","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:11.105029+0000","last_change":"2024-04-26T10:46:11.105133+0000","last_active":"2024-04-26T10:46:11.105029+0000","last_peered":"2024-04-26T10:46:11.105029+0000","last_clean":"2024-04-26T10:46:11.105029+0000","last_became_active":"2024-04-26T10:45:53.173851+0000","last_became_peered":"2024-04-26T10:45:53.173851+0000","last_unstale":"2024-04-26T10:46:11.105029+0000","last_undegraded":"2024-04-26T10:46:11.105029+0000","last_fullsized":"2024-04-26T10:46:11.105029+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'61","last_scrub_stamp":"2024-04-26T10:46:11.105005+0000","last_deep_scrub":"62'61","last_deep_scrub_stamp":"2024-04-26T10:46:11.105005+0000","last_clean_scrub_stamp":"2024-04-26T10:46:11.105005+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:57.257799+0000","scrub_duration":0.0016999000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'457","reported_seq":537,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159739+0000","last_change":"2024-04-26T10:45:54.199966+0000","last_active":"2024-04-26T10:45:58.159739+0000","last_peered":"2024-04-26T10:45:58.159739+0000","last_clean":"2024-04-26T10:45:58.159739+0000","last_became_active":"2024-04-26T10:45:54.189622+0000","last_became_peered":"2024-04-26T10:45:54.189622+0000","last_unstale":"2024-04-26T10:45:58.159739+0000","last_undegraded":"2024-04-26T10:45:58.159739+0000","last_fullsized":"2024-04-26T10:45:58.159739+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14848,"num_write":427,"num_write_kb":71903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'377","reported_seq":839,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161189+0000","last_change":"2024-04-26T10:45:49.867665+0000","last_active":"2024-04-26T10:45:58.161189+0000","last_peered":"2024-04-26T10:45:58.161189+0000","last_clean":"2024-04-26T10:45:58.161189+0000","last_became_active":"2024-04-26T10:45:49.866707+0000","last_became_peered":"2024-04-26T10:45:49.866707+0000","last_unstale":"2024-04-26T10:45:58.161189+0000","last_undegraded":"2024-04-26T10:45:58.161189+0000","last_fullsized":"2024-04-26T10:45:58.161189+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26932,"num_write":349,"num_write_kb":55611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"62'562","reported_seq":644,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159809+0000","last_change":"2024-04-26T10:42:25.683890+0000","last_active":"2024-04-26T10:45:58.159809+0000","last_peered":"2024-04-26T10:45:58.159809+0000","last_clean":"2024-04-26T10:45:58.159809+0000","last_became_active":"2024-04-26T10:42:25.683467+0000","last_became_peered":"2024-04-26T10:42:25.683467+0000","last_unstale":"2024-04-26T10:45:58.159809+0000","last_undegraded":"2024-04-26T10:45:58.159809+0000","last_fullsized":"2024-04-26T10:45:58.159809+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":8440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'425","reported_seq":879,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160491+0000","last_change":"2024-04-26T10:45:56.163245+0000","last_active":"2024-04-26T10:45:58.160491+0000","last_peered":"2024-04-26T10:45:58.160491+0000","last_clean":"2024-04-26T10:45:58.160491+0000","last_became_active":"2024-04-26T10:45:56.161315+0000","last_became_peered":"2024-04-26T10:45:56.161315+0000","last_unstale":"2024-04-26T10:45:58.160491+0000","last_undegraded":"2024-04-26T10:45:58.160491+0000","last_fullsized":"2024-04-26T10:45:58.160491+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":19004,"num_write":390,"num_write_kb":75524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"62'259","reported_seq":332,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159752+0000","last_change":"2024-04-26T10:45:56.160840+0000","last_active":"2024-04-26T10:45:58.159752+0000","last_peered":"2024-04-26T10:45:58.159752+0000","last_clean":"2024-04-26T10:45:58.159752+0000","last_became_active":"2024-04-26T10:45:56.160344+0000","last_became_peered":"2024-04-26T10:45:56.160344+0000","last_unstale":"2024-04-26T10:45:58.159752+0000","last_undegraded":"2024-04-26T10:45:58.159752+0000","last_fullsized":"2024-04-26T10:45:58.159752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'418","reported_seq":930,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160634+0000","last_change":"2024-04-26T10:45:55.179671+0000","last_active":"2024-04-26T10:45:58.160634+0000","last_peered":"2024-04-26T10:45:58.160634+0000","last_clean":"2024-04-26T10:45:58.160634+0000","last_became_active":"2024-04-26T10:45:55.178079+0000","last_became_peered":"2024-04-26T10:45:55.178079+0000","last_unstale":"2024-04-26T10:45:58.160634+0000","last_undegraded":"2024-04-26T10:45:58.160634+0000","last_fullsized":"2024-04-26T10:45:58.160634+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":34476,"num_write":379,"num_write_kb":101645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"62'494","reported_seq":576,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160169+0000","last_change":"2024-04-26T10:42:25.688221+0000","last_active":"2024-04-26T10:45:58.160169+0000","last_peered":"2024-04-26T10:45:58.160169+0000","last_clean":"2024-04-26T10:45:58.160169+0000","last_became_active":"2024-04-26T10:42:25.687829+0000","last_became_peered":"2024-04-26T10:42:25.687829+0000","last_unstale":"2024-04-26T10:45:58.160169+0000","last_undegraded":"2024-04-26T10:45:58.160169+0000","last_fullsized":"2024-04-26T10:45:58.160169+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":12543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"63'406","reported_seq":587,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160465+0000","last_change":"2024-04-26T10:45:54.192178+0000","last_active":"2024-04-26T10:45:58.160465+0000","last_peered":"2024-04-26T10:45:58.160465+0000","last_clean":"2024-04-26T10:45:58.160465+0000","last_became_active":"2024-04-26T10:45:54.189591+0000","last_became_peered":"2024-04-26T10:45:54.189591+0000","last_unstale":"2024-04-26T10:45:58.160465+0000","last_undegraded":"2024-04-26T10:45:58.160465+0000","last_fullsized":"2024-04-26T10:45:58.160465+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":45941,"num_write":372,"num_write_kb":80011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"62'61","reported_seq":161,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160605+0000","last_change":"2024-04-26T10:45:45.895125+0000","last_active":"2024-04-26T10:45:58.160605+0000","last_peered":"2024-04-26T10:45:58.160605+0000","last_clean":"2024-04-26T10:45:58.160605+0000","last_became_active":"2024-04-26T10:45:45.874300+0000","last_became_peered":"2024-04-26T10:45:45.874300+0000","last_unstale":"2024-04-26T10:45:58.160605+0000","last_undegraded":"2024-04-26T10:45:58.160605+0000","last_fullsized":"2024-04-26T10:45:58.160605+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"63'375","reported_seq":835,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:19.295162+0000","last_change":"2024-04-26T10:46:19.295289+0000","last_active":"2024-04-26T10:46:19.295162+0000","last_peered":"2024-04-26T10:46:19.295162+0000","last_clean":"2024-04-26T10:46:19.295162+0000","last_became_active":"2024-04-26T10:45:56.160416+0000","last_became_peered":"2024-04-26T10:45:56.160416+0000","last_unstale":"2024-04-26T10:46:19.295162+0000","last_undegraded":"2024-04-26T10:46:19.295162+0000","last_fullsized":"2024-04-26T10:46:19.295162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'375","last_scrub_stamp":"2024-04-26T10:46:19.295138+0000","last_deep_scrub":"63'375","last_deep_scrub_stamp":"2024-04-26T10:46:19.295138+0000","last_clean_scrub_stamp":"2024-04-26T10:46:19.295138+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:58.675348+0000","scrub_duration":0.0023697280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16213,"num_write":354,"num_write_kb":54493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":332,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"84'278","reported_seq":382,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:12.320143+0000","last_change":"2024-04-26T10:46:12.320242+0000","last_active":"2024-04-26T10:46:12.320143+0000","last_peered":"2024-04-26T10:46:12.320143+0000","last_clean":"2024-04-26T10:46:12.320143+0000","last_became_active":"2024-04-26T10:45:56.160414+0000","last_became_peered":"2024-04-26T10:45:56.160414+0000","last_unstale":"2024-04-26T10:46:12.320143+0000","last_undegraded":"2024-04-26T10:46:12.320143+0000","last_fullsized":"2024-04-26T10:46:12.320143+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'278","last_scrub_stamp":"2024-04-26T10:46:12.320120+0000","last_deep_scrub":"84'278","last_deep_scrub_stamp":"2024-04-26T10:46:12.320120+0000","last_clean_scrub_stamp":"2024-04-26T10:46:12.320120+0000","objects_scrubbed":2,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:17:48.308771+0000","scrub_duration":0.0082694940000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"63'379","reported_seq":476,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161505+0000","last_change":"2024-04-26T10:45:53.177365+0000","last_active":"2024-04-26T10:45:58.161505+0000","last_peered":"2024-04-26T10:45:58.161505+0000","last_clean":"2024-04-26T10:45:58.161505+0000","last_became_active":"2024-04-26T10:45:53.173645+0000","last_became_peered":"2024-04-26T10:45:53.173645+0000","last_unstale":"2024-04-26T10:45:58.161505+0000","last_undegraded":"2024-04-26T10:45:58.161505+0000","last_fullsized":"2024-04-26T10:45:58.161505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20480,"num_write":343,"num_write_kb":25788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"62'237","reported_seq":348,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160802+0000","last_change":"2024-04-26T10:45:48.867081+0000","last_active":"2024-04-26T10:45:58.160802+0000","last_peered":"2024-04-26T10:45:58.160802+0000","last_clean":"2024-04-26T10:45:58.160802+0000","last_became_active":"2024-04-26T10:45:48.866716+0000","last_became_peered":"2024-04-26T10:45:48.866716+0000","last_unstale":"2024-04-26T10:45:58.160802+0000","last_undegraded":"2024-04-26T10:45:58.160802+0000","last_fullsized":"2024-04-26T10:45:58.160802+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":12393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"63'419","reported_seq":571,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160213+0000","last_change":"2024-04-26T10:42:26.041729+0000","last_active":"2024-04-26T10:45:58.160213+0000","last_peered":"2024-04-26T10:45:58.160213+0000","last_clean":"2024-04-26T10:45:58.160213+0000","last_became_active":"2024-04-26T10:42:26.040504+0000","last_became_peered":"2024-04-26T10:42:26.040504+0000","last_unstale":"2024-04-26T10:45:58.160213+0000","last_undegraded":"2024-04-26T10:45:58.160213+0000","last_fullsized":"2024-04-26T10:45:58.160213+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39582,"num_write":378,"num_write_kb":54867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"84'62","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:09.103458+0000","last_change":"2024-04-26T10:46:09.103560+0000","last_active":"2024-04-26T10:46:09.103458+0000","last_peered":"2024-04-26T10:46:09.103458+0000","last_clean":"2024-04-26T10:46:09.103458+0000","last_became_active":"2024-04-26T10:45:53.178804+0000","last_became_peered":"2024-04-26T10:45:53.178804+0000","last_unstale":"2024-04-26T10:46:09.103458+0000","last_undegraded":"2024-04-26T10:46:09.103458+0000","last_fullsized":"2024-04-26T10:46:09.103458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'62","last_scrub_stamp":"2024-04-26T10:46:09.103432+0000","last_deep_scrub":"84'62","last_deep_scrub_stamp":"2024-04-26T10:46:09.103432+0000","last_clean_scrub_stamp":"2024-04-26T10:46:09.103432+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:25.007335+0000","scrub_duration":0.00814082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'437","reported_seq":535,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:18.250920+0000","last_change":"2024-04-26T10:46:18.251026+0000","last_active":"2024-04-26T10:46:18.250920+0000","last_peered":"2024-04-26T10:46:18.250920+0000","last_clean":"2024-04-26T10:46:18.250920+0000","last_became_active":"2024-04-26T10:45:53.177071+0000","last_became_peered":"2024-04-26T10:45:53.177071+0000","last_unstale":"2024-04-26T10:46:18.250920+0000","last_undegraded":"2024-04-26T10:46:18.250920+0000","last_fullsized":"2024-04-26T10:46:18.250920+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'437","last_scrub_stamp":"2024-04-26T10:46:18.250898+0000","last_deep_scrub":"63'437","last_deep_scrub_stamp":"2024-04-26T10:46:18.250898+0000","last_clean_scrub_stamp":"2024-04-26T10:46:18.250898+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:10.767270+0000","scrub_duration":0.002104093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":7562,"num_write":400,"num_write_kb":26121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"62'58","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160347+0000","last_change":"2024-04-26T10:45:53.197669+0000","last_active":"2024-04-26T10:45:58.160347+0000","last_peered":"2024-04-26T10:45:58.160347+0000","last_clean":"2024-04-26T10:45:58.160347+0000","last_became_active":"2024-04-26T10:45:53.173542+0000","last_became_peered":"2024-04-26T10:45:53.173542+0000","last_unstale":"2024-04-26T10:45:58.160347+0000","last_undegraded":"2024-04-26T10:45:58.160347+0000","last_fullsized":"2024-04-26T10:45:58.160347+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2672,"num_read_kb":1454712,"num_write":24538,"num_write_kb":4190103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26671,"ondisk_log_size":26671,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128811551,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":5770,"num_write_kb":129888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257691648,"data_stored":257623102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},"log_size":7600,"ondisk_log_size":7600,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738421,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187500,"kb_used_data":80164,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94184340,"statfs":{"total":96636764160,"available":96444764160,"internally_reserved":0,"allocated":82087936,"data_stored":81566103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:45:25 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.20300000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.442},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.42599999999999999,"15min":0.436},"min":{"1min":0.26000000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]}]},{"osd":1,"up_from":70,"seq":300647710730,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136016,"kb_used_data":90440,"kb_used_omap":7,"kb_used_meta":45560,"kb_avail":94235824,"statfs":{"total":96636764160,"available":96497483776,"internally_reserved":0,"allocated":92610560,"data_stored":92059263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7181,"internal_metadata":46654451},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214376,"kb_used_data":84896,"kb_used_omap":1,"kb_used_meta":129470,"kb_avail":94157464,"statfs":{"total":96636764160,"available":96417243136,"internally_reserved":0,"allocated":86933504,"data_stored":86396712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132577734},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Apr 26 10:45:26 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.43099999999999999,"15min":0.44900000000000001},"min":{"1min":0.21199999999999999,"5min":0.183,"15min":0.183},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.442,"15min":0.46500000000000002},"min":{"1min":0.23499999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.57199999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.42099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":85422080,"data_stored":85400264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":91099136,"data_stored":91062815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81170432,"data_stored":81160023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:46:28.530 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.530 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.530 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.531 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.531 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.531 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.531 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.531 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.531 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.531 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.531 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.531 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.532 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.532 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.532 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.533 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.533 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.533 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.533 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.533 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.533 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.533 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.533 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.533 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.533 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.534 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.534 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.534 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.534 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.534 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.534 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.535 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.535 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.535 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.535 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.535 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.535 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.535 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.535 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.535 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.536 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.536 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.536 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.536 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.536 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.536 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.536 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.536 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.536 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.536 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.537 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.537 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.537 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.537 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.537 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.537 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.537 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.537 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.537 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.537 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.538 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.538 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.538 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.538 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.538 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.538 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.538 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.538 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.538 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.539 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.539 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.539 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.539 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.539 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.539 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.539 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.539 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.539 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.539 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.540 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.540 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.540 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.540 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.540 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.540 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.540 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.540 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.540 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.541 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.541 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.541 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.541 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:28.541 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T10:46:48.542 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:46:48.858 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:46:48.860 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:46:48.867 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":216,"stamp":"2024-04-26T10:46:47.662252+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129401919,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2852,"num_read_kb":1456290,"num_write":30511,"num_write_kb":4323451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9253,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34434,"ondisk_log_size":34434,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":537892,"kb_used_data":255500,"kb_used_omap":10,"kb_used_meta":282357,"kb_avail":282577628,"statfs":{"total":289910292480,"available":289359491072,"internally_reserved":0,"allocated":261632000,"data_stored":260022078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10369,"internal_metadata":289134463},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003445"},"pg_stats":[{"pgid":"4.3f","version":"63'415","reported_seq":543,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:06.973032+0000","last_change":"2024-04-26T10:42:26.045527+0000","last_active":"2024-04-26T10:46:06.973032+0000","last_peered":"2024-04-26T10:46:06.973032+0000","last_clean":"2024-04-26T10:46:06.973032+0000","last_became_active":"2024-04-26T10:42:26.044597+0000","last_became_peered":"2024-04-26T10:42:26.044597+0000","last_unstale":"2024-04-26T10:46:06.973032+0000","last_undegraded":"2024-04-26T10:46:06.973032+0000","last_fullsized":"2024-04-26T10:46:06.973032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22963,"num_write":385,"num_write_kb":71406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"63'396","reported_seq":523,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:06.973056+0000","last_change":"2024-04-26T10:45:54.194523+0000","last_active":"2024-04-26T10:46:06.973056+0000","last_peered":"2024-04-26T10:46:06.973056+0000","last_clean":"2024-04-26T10:46:06.973056+0000","last_became_active":"2024-04-26T10:45:54.192613+0000","last_became_peered":"2024-04-26T10:45:54.192613+0000","last_unstale":"2024-04-26T10:46:06.973056+0000","last_undegraded":"2024-04-26T10:46:06.973056+0000","last_fullsized":"2024-04-26T10:46:06.973056+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9499,"num_write":371,"num_write_kb":38601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"63'366","reported_seq":461,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:24.288364+0000","last_change":"2024-04-26T10:46:24.288483+0000","last_active":"2024-04-26T10:46:24.288364+0000","last_peered":"2024-04-26T10:46:24.288364+0000","last_clean":"2024-04-26T10:46:24.288364+0000","last_became_active":"2024-04-26T10:45:55.180991+0000","last_became_peered":"2024-04-26T10:45:55.180991+0000","last_unstale":"2024-04-26T10:46:24.288364+0000","last_undegraded":"2024-04-26T10:46:24.288364+0000","last_fullsized":"2024-04-26T10:46:24.288364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'366","last_scrub_stamp":"2024-04-26T10:46:24.288343+0000","last_deep_scrub":"63'366","last_deep_scrub_stamp":"2024-04-26T10:46:24.288343+0000","last_clean_scrub_stamp":"2024-04-26T10:46:24.288343+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:09.803889+0000","scrub_duration":0.0024847200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6211,"num_write":338,"num_write_kb":38844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"63'394","reported_seq":546,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161957+0000","last_change":"2024-04-26T10:45:51.162341+0000","last_active":"2024-04-26T10:45:58.161957+0000","last_peered":"2024-04-26T10:45:58.161957+0000","last_clean":"2024-04-26T10:45:58.161957+0000","last_became_active":"2024-04-26T10:45:51.159099+0000","last_became_peered":"2024-04-26T10:45:51.159099+0000","last_unstale":"2024-04-26T10:45:58.161957+0000","last_undegraded":"2024-04-26T10:45:58.161957+0000","last_fullsized":"2024-04-26T10:45:58.161957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":52323,"num_write":357,"num_write_kb":63323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"63'409","reported_seq":508,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160484+0000","last_change":"2024-04-26T10:42:26.041191+0000","last_active":"2024-04-26T10:45:58.160484+0000","last_peered":"2024-04-26T10:45:58.160484+0000","last_clean":"2024-04-26T10:45:58.160484+0000","last_became_active":"2024-04-26T10:42:26.040487+0000","last_became_peered":"2024-04-26T10:42:26.040487+0000","last_unstale":"2024-04-26T10:45:58.160484+0000","last_undegraded":"2024-04-26T10:45:58.160484+0000","last_fullsized":"2024-04-26T10:45:58.160484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":372,"num_write_kb":42764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'385","reported_seq":476,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:21.300652+0000","last_change":"2024-04-26T10:46:21.300788+0000","last_active":"2024-04-26T10:46:21.300652+0000","last_peered":"2024-04-26T10:46:21.300652+0000","last_clean":"2024-04-26T10:46:21.300652+0000","last_became_active":"2024-04-26T10:45:49.861811+0000","last_became_peered":"2024-04-26T10:45:49.861811+0000","last_unstale":"2024-04-26T10:46:21.300652+0000","last_undegraded":"2024-04-26T10:46:21.300652+0000","last_fullsized":"2024-04-26T10:46:21.300652+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'385","last_scrub_stamp":"2024-04-26T10:46:21.300632+0000","last_deep_scrub":"63'385","last_deep_scrub_stamp":"2024-04-26T10:46:21.300632+0000","last_clean_scrub_stamp":"2024-04-26T10:46:21.300632+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:50.462322+0000","scrub_duration":0.0030393180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4124,"num_write":356,"num_write_kb":69857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"63'425","reported_seq":535,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161609+0000","last_change":"2024-04-26T10:45:50.869572+0000","last_active":"2024-04-26T10:45:58.161609+0000","last_peered":"2024-04-26T10:45:58.161609+0000","last_clean":"2024-04-26T10:45:58.161609+0000","last_became_active":"2024-04-26T10:45:50.866996+0000","last_became_peered":"2024-04-26T10:45:50.866996+0000","last_unstale":"2024-04-26T10:45:58.161609+0000","last_undegraded":"2024-04-26T10:45:58.161609+0000","last_fullsized":"2024-04-26T10:45:58.161609+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13036,"num_write":390,"num_write_kb":67193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"63'399","reported_seq":508,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.164893+0000","last_change":"2024-04-26T10:45:58.164304+0000","last_active":"2024-04-26T10:45:58.164893+0000","last_peered":"2024-04-26T10:45:58.164893+0000","last_clean":"2024-04-26T10:45:58.164893+0000","last_became_active":"2024-04-26T10:45:58.162532+0000","last_became_peered":"2024-04-26T10:45:58.162532+0000","last_unstale":"2024-04-26T10:45:58.164893+0000","last_undegraded":"2024-04-26T10:45:58.164893+0000","last_fullsized":"2024-04-26T10:45:58.164893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25678,"num_write":356,"num_write_kb":116549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"63'442","reported_seq":590,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160776+0000","last_change":"2024-04-26T10:42:26.045893+0000","last_active":"2024-04-26T10:45:58.160776+0000","last_peered":"2024-04-26T10:45:58.160776+0000","last_clean":"2024-04-26T10:45:58.160776+0000","last_became_active":"2024-04-26T10:42:26.045177+0000","last_became_peered":"2024-04-26T10:42:26.045177+0000","last_unstale":"2024-04-26T10:45:58.160776+0000","last_undegraded":"2024-04-26T10:45:58.160776+0000","last_fullsized":"2024-04-26T10:45:58.160776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35111,"num_write":413,"num_write_kb":60306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'393","reported_seq":516,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160602+0000","last_change":"2024-04-26T10:45:54.192984+0000","last_active":"2024-04-26T10:45:58.160602+0000","last_peered":"2024-04-26T10:45:58.160602+0000","last_clean":"2024-04-26T10:45:58.160602+0000","last_became_active":"2024-04-26T10:45:54.191514+0000","last_became_peered":"2024-04-26T10:45:54.191514+0000","last_unstale":"2024-04-26T10:45:58.160602+0000","last_undegraded":"2024-04-26T10:45:58.160602+0000","last_fullsized":"2024-04-26T10:45:58.160602+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5355,"num_write":351,"num_write_kb":38901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"63'377","reported_seq":483,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162538+0000","last_change":"2024-04-26T10:45:49.865172+0000","last_active":"2024-04-26T10:45:58.162538+0000","last_peered":"2024-04-26T10:45:58.162538+0000","last_clean":"2024-04-26T10:45:58.162538+0000","last_became_active":"2024-04-26T10:45:49.862718+0000","last_became_peered":"2024-04-26T10:45:49.862718+0000","last_unstale":"2024-04-26T10:45:58.162538+0000","last_undegraded":"2024-04-26T10:45:58.162538+0000","last_fullsized":"2024-04-26T10:45:58.162538+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18030,"num_write":355,"num_write_kb":67044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"63'365","reported_seq":809,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160338+0000","last_change":"2024-04-26T10:45:57.166219+0000","last_active":"2024-04-26T10:45:58.160338+0000","last_peered":"2024-04-26T10:45:58.160338+0000","last_clean":"2024-04-26T10:45:58.160338+0000","last_became_active":"2024-04-26T10:45:57.164964+0000","last_became_peered":"2024-04-26T10:45:57.164964+0000","last_unstale":"2024-04-26T10:45:58.160338+0000","last_undegraded":"2024-04-26T10:45:58.160338+0000","last_fullsized":"2024-04-26T10:45:58.160338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14866,"num_write":337,"num_write_kb":71188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'397","reported_seq":491,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160243+0000","last_change":"2024-04-26T10:42:26.042607+0000","last_active":"2024-04-26T10:45:58.160243+0000","last_peered":"2024-04-26T10:45:58.160243+0000","last_clean":"2024-04-26T10:45:58.160243+0000","last_became_active":"2024-04-26T10:42:26.041617+0000","last_became_peered":"2024-04-26T10:42:26.041617+0000","last_unstale":"2024-04-26T10:45:58.160243+0000","last_undegraded":"2024-04-26T10:45:58.160243+0000","last_fullsized":"2024-04-26T10:45:58.160243+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8192,"num_write":362,"num_write_kb":54822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"63'408","reported_seq":499,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:34.396188+0000","last_change":"2024-04-26T10:46:34.396311+0000","last_active":"2024-04-26T10:46:34.396188+0000","last_peered":"2024-04-26T10:46:34.396188+0000","last_clean":"2024-04-26T10:46:34.396188+0000","last_became_active":"2024-04-26T10:45:53.177677+0000","last_became_peered":"2024-04-26T10:45:53.177677+0000","last_unstale":"2024-04-26T10:46:34.396188+0000","last_undegraded":"2024-04-26T10:46:34.396188+0000","last_fullsized":"2024-04-26T10:46:34.396188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:34.396168+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:34.396168+0000","last_clean_scrub_stamp":"2024-04-26T10:46:34.396168+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:28.312103+0000","scrub_duration":0.002988662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4688,"num_write":374,"num_write_kb":21766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"63'409","reported_seq":523,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161518+0000","last_change":"2024-04-26T10:45:54.188625+0000","last_active":"2024-04-26T10:45:58.161518+0000","last_peered":"2024-04-26T10:45:58.161518+0000","last_clean":"2024-04-26T10:45:58.161518+0000","last_became_active":"2024-04-26T10:45:54.185826+0000","last_became_peered":"2024-04-26T10:45:54.185826+0000","last_unstale":"2024-04-26T10:45:58.161518+0000","last_undegraded":"2024-04-26T10:45:58.161518+0000","last_fullsized":"2024-04-26T10:45:58.161518+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25968,"num_write":366,"num_write_kb":75698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"63'460","reported_seq":574,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:20.325508+0000","last_change":"2024-04-26T10:46:20.325615+0000","last_active":"2024-04-26T10:46:20.325508+0000","last_peered":"2024-04-26T10:46:20.325508+0000","last_clean":"2024-04-26T10:46:20.325508+0000","last_became_active":"2024-04-26T10:45:53.174699+0000","last_became_peered":"2024-04-26T10:45:53.174699+0000","last_unstale":"2024-04-26T10:46:20.325508+0000","last_undegraded":"2024-04-26T10:46:20.325508+0000","last_fullsized":"2024-04-26T10:46:20.325508+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'460","last_scrub_stamp":"2024-04-26T10:46:20.325486+0000","last_deep_scrub":"63'460","last_deep_scrub_stamp":"2024-04-26T10:46:20.325486+0000","last_clean_scrub_stamp":"2024-04-26T10:46:20.325486+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:51.733701+0000","scrub_duration":0.0023796759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16269,"num_write":426,"num_write_kb":67839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"63'393","reported_seq":513,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161065+0000","last_change":"2024-04-26T10:42:26.049338+0000","last_active":"2024-04-26T10:45:58.161065+0000","last_peered":"2024-04-26T10:45:58.161065+0000","last_clean":"2024-04-26T10:45:58.161065+0000","last_became_active":"2024-04-26T10:42:26.049014+0000","last_became_peered":"2024-04-26T10:42:26.049014+0000","last_unstale":"2024-04-26T10:45:58.161065+0000","last_undegraded":"2024-04-26T10:45:58.161065+0000","last_fullsized":"2024-04-26T10:45:58.161065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":25712,"num_write":362,"num_write_kb":42020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'428","reported_seq":566,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:15.921115+0000","last_change":"2024-04-26T10:46:15.921226+0000","last_active":"2024-04-26T10:46:15.921115+0000","last_peered":"2024-04-26T10:46:15.921115+0000","last_clean":"2024-04-26T10:46:15.921115+0000","last_became_active":"2024-04-26T10:45:54.189852+0000","last_became_peered":"2024-04-26T10:45:54.189852+0000","last_unstale":"2024-04-26T10:46:15.921115+0000","last_undegraded":"2024-04-26T10:46:15.921115+0000","last_fullsized":"2024-04-26T10:46:15.921115+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'428","last_scrub_stamp":"2024-04-26T10:46:15.921093+0000","last_deep_scrub":"63'428","last_deep_scrub_stamp":"2024-04-26T10:46:15.921093+0000","last_clean_scrub_stamp":"2024-04-26T10:46:15.921093+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:06.246994+0000","scrub_duration":0.0037567920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12316,"num_write":384,"num_write_kb":87656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"63'446","reported_seq":599,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:34.106864+0000","last_change":"2024-04-26T10:46:34.106970+0000","last_active":"2024-04-26T10:46:34.106864+0000","last_peered":"2024-04-26T10:46:34.106864+0000","last_clean":"2024-04-26T10:46:34.106864+0000","last_became_active":"2024-04-26T10:45:54.184063+0000","last_became_peered":"2024-04-26T10:45:54.184063+0000","last_unstale":"2024-04-26T10:46:34.106864+0000","last_undegraded":"2024-04-26T10:46:34.106864+0000","last_fullsized":"2024-04-26T10:46:34.106864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'446","last_scrub_stamp":"2024-04-26T10:46:34.106840+0000","last_deep_scrub":"63'446","last_deep_scrub_stamp":"2024-04-26T10:46:34.106840+0000","last_clean_scrub_stamp":"2024-04-26T10:46:34.106840+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:53.038982+0000","scrub_duration":0.003191504,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":53414,"num_write":401,"num_write_kb":80048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":562,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:43.456409+0000","last_change":"2024-04-26T10:46:43.456513+0000","last_active":"2024-04-26T10:46:43.456409+0000","last_peered":"2024-04-26T10:46:43.456409+0000","last_clean":"2024-04-26T10:46:43.456409+0000","last_became_active":"2024-04-26T10:45:50.867680+0000","last_became_peered":"2024-04-26T10:45:50.867680+0000","last_unstale":"2024-04-26T10:46:43.456409+0000","last_undegraded":"2024-04-26T10:46:43.456409+0000","last_fullsized":"2024-04-26T10:46:43.456409+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'438","last_scrub_stamp":"2024-04-26T10:46:43.456387+0000","last_deep_scrub":"63'438","last_deep_scrub_stamp":"2024-04-26T10:46:43.456387+0000","last_clean_scrub_stamp":"2024-04-26T10:46:43.456387+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:45.105492+0000","scrub_duration":0.002559675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19859,"num_write":405,"num_write_kb":51119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"63'408","reported_seq":874,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:26.338673+0000","last_change":"2024-04-26T10:46:26.338811+0000","last_active":"2024-04-26T10:46:26.338673+0000","last_peered":"2024-04-26T10:46:26.338673+0000","last_clean":"2024-04-26T10:46:26.338673+0000","last_became_active":"2024-04-26T10:45:56.160360+0000","last_became_peered":"2024-04-26T10:45:56.160360+0000","last_unstale":"2024-04-26T10:46:26.338673+0000","last_undegraded":"2024-04-26T10:46:26.338673+0000","last_fullsized":"2024-04-26T10:46:26.338673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:26.338639+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:26.338639+0000","last_clean_scrub_stamp":"2024-04-26T10:46:26.338639+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:34.117967+0000","scrub_duration":0.0027084209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":15372,"num_write":366,"num_write_kb":75855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"63'452","reported_seq":1018,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159893+0000","last_change":"2024-04-26T10:45:52.175372+0000","last_active":"2024-04-26T10:45:58.159893+0000","last_peered":"2024-04-26T10:45:58.159893+0000","last_clean":"2024-04-26T10:45:58.159893+0000","last_became_active":"2024-04-26T10:45:52.173702+0000","last_became_peered":"2024-04-26T10:45:52.173702+0000","last_unstale":"2024-04-26T10:45:58.159893+0000","last_undegraded":"2024-04-26T10:45:58.159893+0000","last_fullsized":"2024-04-26T10:45:58.159893+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43729,"num_write":421,"num_write_kb":79804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"63'408","reported_seq":894,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:30.067044+0000","last_change":"2024-04-26T10:46:30.067162+0000","last_active":"2024-04-26T10:46:30.067044+0000","last_peered":"2024-04-26T10:46:30.067044+0000","last_clean":"2024-04-26T10:46:30.067044+0000","last_became_active":"2024-04-26T10:45:57.162147+0000","last_became_peered":"2024-04-26T10:45:57.162147+0000","last_unstale":"2024-04-26T10:46:30.067044+0000","last_undegraded":"2024-04-26T10:46:30.067044+0000","last_fullsized":"2024-04-26T10:46:30.067044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:30.067019+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:30.067019+0000","last_clean_scrub_stamp":"2024-04-26T10:46:30.067019+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:46.527639+0000","scrub_duration":0.0026815810000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":30320,"num_write":372,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'453","reported_seq":616,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159767+0000","last_change":"2024-04-26T10:45:54.184330+0000","last_active":"2024-04-26T10:45:58.159767+0000","last_peered":"2024-04-26T10:45:58.159767+0000","last_clean":"2024-04-26T10:45:58.159767+0000","last_became_active":"2024-04-26T10:45:54.181881+0000","last_became_peered":"2024-04-26T10:45:54.181881+0000","last_unstale":"2024-04-26T10:45:58.159767+0000","last_undegraded":"2024-04-26T10:45:58.159767+0000","last_fullsized":"2024-04-26T10:45:58.159767+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":19864,"num_write":422,"num_write_kb":51638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"63'439","reported_seq":966,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:07.911110+0000","last_change":"2024-04-26T10:46:07.911236+0000","last_active":"2024-04-26T10:46:07.911110+0000","last_peered":"2024-04-26T10:46:07.911110+0000","last_clean":"2024-04-26T10:46:07.911110+0000","last_became_active":"2024-04-26T10:45:48.866159+0000","last_became_peered":"2024-04-26T10:45:48.866159+0000","last_unstale":"2024-04-26T10:46:07.911110+0000","last_undegraded":"2024-04-26T10:46:07.911110+0000","last_fullsized":"2024-04-26T10:46:07.911110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'439","last_scrub_stamp":"2024-04-26T10:46:07.911088+0000","last_deep_scrub":"63'439","last_deep_scrub_stamp":"2024-04-26T10:46:07.911088+0000","last_clean_scrub_stamp":"2024-04-26T10:46:07.911088+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:32.755490+0000","scrub_duration":0.0024222179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8912,"num_write":417,"num_write_kb":46575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"63'513","reported_seq":1159,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160459+0000","last_change":"2024-04-26T10:45:51.160003+0000","last_active":"2024-04-26T10:45:58.160459+0000","last_peered":"2024-04-26T10:45:58.160459+0000","last_clean":"2024-04-26T10:45:58.160459+0000","last_became_active":"2024-04-26T10:45:51.158698+0000","last_became_peered":"2024-04-26T10:45:51.158698+0000","last_unstale":"2024-04-26T10:45:58.160459+0000","last_undegraded":"2024-04-26T10:45:58.160459+0000","last_fullsized":"2024-04-26T10:45:58.160459+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":70751,"num_write":473,"num_write_kb":88902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'406","reported_seq":534,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162541+0000","last_change":"2024-04-26T10:45:56.164805+0000","last_active":"2024-04-26T10:45:58.162541+0000","last_peered":"2024-04-26T10:45:58.162541+0000","last_clean":"2024-04-26T10:45:58.162541+0000","last_became_active":"2024-04-26T10:45:56.162419+0000","last_became_peered":"2024-04-26T10:45:56.162419+0000","last_unstale":"2024-04-26T10:45:58.162541+0000","last_undegraded":"2024-04-26T10:45:58.162541+0000","last_fullsized":"2024-04-26T10:45:58.162541+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":32121,"num_write":372,"num_write_kb":60163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"63'402","reported_seq":879,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:38.854775+0000","last_change":"2024-04-26T10:46:38.854895+0000","last_active":"2024-04-26T10:46:38.854775+0000","last_peered":"2024-04-26T10:46:38.854775+0000","last_clean":"2024-04-26T10:46:38.854775+0000","last_became_active":"2024-04-26T10:45:57.165064+0000","last_became_peered":"2024-04-26T10:45:57.165064+0000","last_unstale":"2024-04-26T10:46:38.854775+0000","last_undegraded":"2024-04-26T10:46:38.854775+0000","last_fullsized":"2024-04-26T10:46:38.854775+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'402","last_scrub_stamp":"2024-04-26T10:46:38.854753+0000","last_deep_scrub":"63'402","last_deep_scrub_stamp":"2024-04-26T10:46:38.854753+0000","last_clean_scrub_stamp":"2024-04-26T10:46:38.854753+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:36.110686+0000","scrub_duration":0.0022249689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":6824,"num_write":378,"num_write_kb":72156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"63'407","reported_seq":889,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:59.681981+0000","last_change":"2024-04-26T10:45:58.163989+0000","last_active":"2024-04-26T10:45:59.681981+0000","last_peered":"2024-04-26T10:45:59.681981+0000","last_clean":"2024-04-26T10:45:59.681981+0000","last_became_active":"2024-04-26T10:45:58.161850+0000","last_became_peered":"2024-04-26T10:45:58.161850+0000","last_unstale":"2024-04-26T10:45:59.681981+0000","last_undegraded":"2024-04-26T10:45:59.681981+0000","last_fullsized":"2024-04-26T10:45:59.681981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25898,"num_write":372,"num_write_kb":59274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":346,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'490","reported_seq":1060,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:06.972874+0000","last_change":"2024-04-26T10:45:55.179785+0000","last_active":"2024-04-26T10:46:06.972874+0000","last_peered":"2024-04-26T10:46:06.972874+0000","last_clean":"2024-04-26T10:46:06.972874+0000","last_became_active":"2024-04-26T10:45:55.178083+0000","last_became_peered":"2024-04-26T10:45:55.178083+0000","last_unstale":"2024-04-26T10:46:06.972874+0000","last_undegraded":"2024-04-26T10:46:06.972874+0000","last_fullsized":"2024-04-26T10:46:06.972874+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33597,"num_write":449,"num_write_kb":87981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"63'474","reported_seq":575,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:41.218309+0000","last_change":"2024-04-26T10:46:41.218435+0000","last_active":"2024-04-26T10:46:41.218309+0000","last_peered":"2024-04-26T10:46:41.218309+0000","last_clean":"2024-04-26T10:46:41.218309+0000","last_became_active":"2024-04-26T10:45:54.186011+0000","last_became_peered":"2024-04-26T10:45:54.186011+0000","last_unstale":"2024-04-26T10:46:41.218309+0000","last_undegraded":"2024-04-26T10:46:41.218309+0000","last_fullsized":"2024-04-26T10:46:41.218309+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'474","last_scrub_stamp":"2024-04-26T10:46:41.218267+0000","last_deep_scrub":"63'474","last_deep_scrub_stamp":"2024-04-26T10:46:41.218267+0000","last_clean_scrub_stamp":"2024-04-26T10:46:41.218267+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:19.308910+0000","scrub_duration":0.003558748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30886,"num_write":441,"num_write_kb":118807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'443","reported_seq":559,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:37.402412+0000","last_change":"2024-04-26T10:46:37.402510+0000","last_active":"2024-04-26T10:46:37.402412+0000","last_peered":"2024-04-26T10:46:37.402412+0000","last_clean":"2024-04-26T10:46:37.402412+0000","last_became_active":"2024-04-26T10:45:48.861918+0000","last_became_peered":"2024-04-26T10:45:48.861918+0000","last_unstale":"2024-04-26T10:46:37.402412+0000","last_undegraded":"2024-04-26T10:46:37.402412+0000","last_fullsized":"2024-04-26T10:46:37.402412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'443","last_scrub_stamp":"2024-04-26T10:46:37.402390+0000","last_deep_scrub":"63'443","last_deep_scrub_stamp":"2024-04-26T10:46:37.402390+0000","last_clean_scrub_stamp":"2024-04-26T10:46:37.402390+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:31.390744+0000","scrub_duration":0.0023535019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20556,"num_write":413,"num_write_kb":91647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"63'376","reported_seq":479,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160599+0000","last_change":"2024-04-26T10:42:26.041757+0000","last_active":"2024-04-26T10:45:58.160599+0000","last_peered":"2024-04-26T10:45:58.160599+0000","last_clean":"2024-04-26T10:45:58.160599+0000","last_became_active":"2024-04-26T10:42:26.040920+0000","last_became_peered":"2024-04-26T10:42:26.040920+0000","last_unstale":"2024-04-26T10:45:58.160599+0000","last_undegraded":"2024-04-26T10:45:58.160599+0000","last_fullsized":"2024-04-26T10:45:58.160599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10124,"num_write":344,"num_write_kb":66899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"62'453","reported_seq":534,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161595+0000","last_change":"2024-04-26T10:45:48.862782+0000","last_active":"2024-04-26T10:45:58.161595+0000","last_peered":"2024-04-26T10:45:58.161595+0000","last_clean":"2024-04-26T10:45:58.161595+0000","last_became_active":"2024-04-26T10:45:48.862424+0000","last_became_peered":"2024-04-26T10:45:48.862424+0000","last_unstale":"2024-04-26T10:45:58.161595+0000","last_undegraded":"2024-04-26T10:45:58.161595+0000","last_fullsized":"2024-04-26T10:45:58.161595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"63'403","reported_seq":532,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:10.923122+0000","last_change":"2024-04-26T10:46:10.923239+0000","last_active":"2024-04-26T10:46:10.923122+0000","last_peered":"2024-04-26T10:46:10.923122+0000","last_clean":"2024-04-26T10:46:10.923122+0000","last_became_active":"2024-04-26T10:42:26.040464+0000","last_became_peered":"2024-04-26T10:42:26.040464+0000","last_unstale":"2024-04-26T10:46:10.923122+0000","last_undegraded":"2024-04-26T10:46:10.923122+0000","last_fullsized":"2024-04-26T10:46:10.923122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'403","last_scrub_stamp":"2024-04-26T10:46:10.923100+0000","last_deep_scrub":"63'403","last_deep_scrub_stamp":"2024-04-26T10:46:10.923100+0000","last_clean_scrub_stamp":"2024-04-26T10:46:10.923100+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:00.804186+0000","scrub_duration":0.0037994579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24588,"num_write":363,"num_write_kb":51190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"62'49","reported_seq":144,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159679+0000","last_change":"2024-04-26T10:45:45.862317+0000","last_active":"2024-04-26T10:45:58.159679+0000","last_peered":"2024-04-26T10:45:58.159679+0000","last_clean":"2024-04-26T10:45:58.159679+0000","last_became_active":"2024-04-26T10:45:45.862029+0000","last_became_peered":"2024-04-26T10:45:45.862029+0000","last_unstale":"2024-04-26T10:45:58.159679+0000","last_undegraded":"2024-04-26T10:45:58.159679+0000","last_fullsized":"2024-04-26T10:45:58.159679+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'407","reported_seq":888,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160627+0000","last_change":"2024-04-26T10:45:52.170710+0000","last_active":"2024-04-26T10:45:58.160627+0000","last_peered":"2024-04-26T10:45:58.160627+0000","last_clean":"2024-04-26T10:45:58.160627+0000","last_became_active":"2024-04-26T10:45:52.169295+0000","last_became_peered":"2024-04-26T10:45:52.169295+0000","last_unstale":"2024-04-26T10:45:58.160627+0000","last_undegraded":"2024-04-26T10:45:58.160627+0000","last_fullsized":"2024-04-26T10:45:58.160627+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":7077,"num_write":367,"num_write_kb":42434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"62'66","reported_seq":161,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159949+0000","last_change":"2024-04-26T10:45:45.874440+0000","last_active":"2024-04-26T10:45:58.159949+0000","last_peered":"2024-04-26T10:45:58.159949+0000","last_clean":"2024-04-26T10:45:58.159949+0000","last_became_active":"2024-04-26T10:45:45.874030+0000","last_became_peered":"2024-04-26T10:45:45.874030+0000","last_unstale":"2024-04-26T10:45:58.159949+0000","last_undegraded":"2024-04-26T10:45:58.159949+0000","last_fullsized":"2024-04-26T10:45:58.159949+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"63'406","reported_seq":899,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160833+0000","last_change":"2024-04-26T10:45:49.863376+0000","last_active":"2024-04-26T10:45:58.160833+0000","last_peered":"2024-04-26T10:45:58.160833+0000","last_clean":"2024-04-26T10:45:58.160833+0000","last_became_active":"2024-04-26T10:45:49.861979+0000","last_became_peered":"2024-04-26T10:45:49.861979+0000","last_unstale":"2024-04-26T10:45:58.160833+0000","last_undegraded":"2024-04-26T10:45:58.160833+0000","last_fullsized":"2024-04-26T10:45:58.160833+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":25977,"num_write":374,"num_write_kb":104172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"63'66","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161614+0000","last_change":"2024-04-26T10:45:45.871507+0000","last_active":"2024-04-26T10:45:58.161614+0000","last_peered":"2024-04-26T10:45:58.161614+0000","last_clean":"2024-04-26T10:45:58.161614+0000","last_became_active":"2024-04-26T10:45:45.871120+0000","last_became_peered":"2024-04-26T10:45:45.871120+0000","last_unstale":"2024-04-26T10:45:58.161614+0000","last_undegraded":"2024-04-26T10:45:58.161614+0000","last_fullsized":"2024-04-26T10:45:58.161614+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"62'200","reported_seq":282,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162741+0000","last_change":"2024-04-26T10:45:48.866225+0000","last_active":"2024-04-26T10:45:58.162741+0000","last_peered":"2024-04-26T10:45:58.162741+0000","last_clean":"2024-04-26T10:45:58.162741+0000","last_became_active":"2024-04-26T10:45:48.865878+0000","last_became_peered":"2024-04-26T10:45:48.865878+0000","last_unstale":"2024-04-26T10:45:58.162741+0000","last_undegraded":"2024-04-26T10:45:58.162741+0000","last_fullsized":"2024-04-26T10:45:58.162741+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"63'415","reported_seq":920,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:11.914657+0000","last_change":"2024-04-26T10:46:11.914773+0000","last_active":"2024-04-26T10:46:11.914657+0000","last_peered":"2024-04-26T10:46:11.914657+0000","last_clean":"2024-04-26T10:46:11.914657+0000","last_became_active":"2024-04-26T10:45:57.163263+0000","last_became_peered":"2024-04-26T10:45:57.163263+0000","last_unstale":"2024-04-26T10:46:11.914657+0000","last_undegraded":"2024-04-26T10:46:11.914657+0000","last_fullsized":"2024-04-26T10:46:11.914657+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'415","last_scrub_stamp":"2024-04-26T10:46:11.914637+0000","last_deep_scrub":"63'415","last_deep_scrub_stamp":"2024-04-26T10:46:11.914637+0000","last_clean_scrub_stamp":"2024-04-26T10:46:11.914637+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:19.456262+0000","scrub_duration":0.0026733759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15757,"num_write":380,"num_write_kb":54727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"62'342","reported_seq":449,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160870+0000","last_change":"2024-04-26T10:45:48.866915+0000","last_active":"2024-04-26T10:45:58.160870+0000","last_peered":"2024-04-26T10:45:58.160870+0000","last_clean":"2024-04-26T10:45:58.160870+0000","last_became_active":"2024-04-26T10:45:48.866497+0000","last_became_peered":"2024-04-26T10:45:48.866497+0000","last_unstale":"2024-04-26T10:45:58.160870+0000","last_undegraded":"2024-04-26T10:45:58.160870+0000","last_fullsized":"2024-04-26T10:45:58.160870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"63'481","reported_seq":671,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159950+0000","last_change":"2024-04-26T10:45:54.184646+0000","last_active":"2024-04-26T10:45:58.159950+0000","last_peered":"2024-04-26T10:45:58.159950+0000","last_clean":"2024-04-26T10:45:58.159950+0000","last_became_active":"2024-04-26T10:45:54.181993+0000","last_became_peered":"2024-04-26T10:45:54.181993+0000","last_unstale":"2024-04-26T10:45:58.159950+0000","last_undegraded":"2024-04-26T10:45:58.159950+0000","last_fullsized":"2024-04-26T10:45:58.159950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":45251,"num_write":451,"num_write_kb":105365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"84'462","reported_seq":555,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:40.432545+0000","last_change":"2024-04-26T10:46:40.432691+0000","last_active":"2024-04-26T10:46:40.432545+0000","last_peered":"2024-04-26T10:46:40.432545+0000","last_clean":"2024-04-26T10:46:40.432545+0000","last_became_active":"2024-04-26T10:45:48.865520+0000","last_became_peered":"2024-04-26T10:45:48.865520+0000","last_unstale":"2024-04-26T10:46:40.432545+0000","last_undegraded":"2024-04-26T10:46:40.432545+0000","last_fullsized":"2024-04-26T10:46:40.432545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'462","last_scrub_stamp":"2024-04-26T10:46:40.432509+0000","last_deep_scrub":"84'462","last_deep_scrub_stamp":"2024-04-26T10:46:40.432509+0000","last_clean_scrub_stamp":"2024-04-26T10:46:40.432509+0000","objects_scrubbed":2,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:15.817808+0000","scrub_duration":0.010610122,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":407,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'420","reported_seq":504,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161880+0000","last_change":"2024-04-26T10:45:57.165390+0000","last_active":"2024-04-26T10:45:58.161880+0000","last_peered":"2024-04-26T10:45:58.161880+0000","last_clean":"2024-04-26T10:45:58.161880+0000","last_became_active":"2024-04-26T10:45:57.162014+0000","last_became_peered":"2024-04-26T10:45:57.162014+0000","last_unstale":"2024-04-26T10:45:58.161880+0000","last_undegraded":"2024-04-26T10:45:58.161880+0000","last_fullsized":"2024-04-26T10:45:58.161880+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13025,"num_write":385,"num_write_kb":38595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"62'67","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161983+0000","last_change":"2024-04-26T10:45:45.860717+0000","last_active":"2024-04-26T10:45:58.161983+0000","last_peered":"2024-04-26T10:45:58.161983+0000","last_clean":"2024-04-26T10:45:58.161983+0000","last_became_active":"2024-04-26T10:45:45.860175+0000","last_became_peered":"2024-04-26T10:45:45.860175+0000","last_unstale":"2024-04-26T10:45:58.161983+0000","last_undegraded":"2024-04-26T10:45:58.161983+0000","last_fullsized":"2024-04-26T10:45:58.161983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"63'452","reported_seq":966,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:59.681950+0000","last_change":"2024-04-26T10:45:58.166413+0000","last_active":"2024-04-26T10:45:59.681950+0000","last_peered":"2024-04-26T10:45:59.681950+0000","last_clean":"2024-04-26T10:45:59.681950+0000","last_became_active":"2024-04-26T10:45:58.164105+0000","last_became_peered":"2024-04-26T10:45:58.164105+0000","last_unstale":"2024-04-26T10:45:59.681950+0000","last_undegraded":"2024-04-26T10:45:59.681950+0000","last_fullsized":"2024-04-26T10:45:59.681950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23217,"num_write":416,"num_write_kb":71418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":388,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"62'200","reported_seq":278,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159939+0000","last_change":"2024-04-26T10:45:56.160957+0000","last_active":"2024-04-26T10:45:58.159939+0000","last_peered":"2024-04-26T10:45:58.159939+0000","last_clean":"2024-04-26T10:45:58.159939+0000","last_became_active":"2024-04-26T10:45:56.160475+0000","last_became_peered":"2024-04-26T10:45:56.160475+0000","last_unstale":"2024-04-26T10:45:58.159939+0000","last_undegraded":"2024-04-26T10:45:58.159939+0000","last_fullsized":"2024-04-26T10:45:58.159939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'430","reported_seq":513,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162319+0000","last_change":"2024-04-26T10:45:57.164742+0000","last_active":"2024-04-26T10:45:58.162319+0000","last_peered":"2024-04-26T10:45:58.162319+0000","last_clean":"2024-04-26T10:45:58.162319+0000","last_became_active":"2024-04-26T10:45:57.162070+0000","last_became_peered":"2024-04-26T10:45:57.162070+0000","last_unstale":"2024-04-26T10:45:58.162319+0000","last_undegraded":"2024-04-26T10:45:58.162319+0000","last_fullsized":"2024-04-26T10:45:58.162319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":24352,"num_write":392,"num_write_kb":21976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"62'233","reported_seq":307,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161329+0000","last_change":"2024-04-26T10:45:48.862856+0000","last_active":"2024-04-26T10:45:58.161329+0000","last_peered":"2024-04-26T10:45:58.161329+0000","last_clean":"2024-04-26T10:45:58.161329+0000","last_became_active":"2024-04-26T10:45:48.862517+0000","last_became_peered":"2024-04-26T10:45:48.862517+0000","last_unstale":"2024-04-26T10:45:58.161329+0000","last_undegraded":"2024-04-26T10:45:58.161329+0000","last_fullsized":"2024-04-26T10:45:58.161329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"63'393","reported_seq":479,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162206+0000","last_change":"2024-04-26T10:45:55.180960+0000","last_active":"2024-04-26T10:45:58.162206+0000","last_peered":"2024-04-26T10:45:58.162206+0000","last_clean":"2024-04-26T10:45:58.162206+0000","last_became_active":"2024-04-26T10:45:55.177758+0000","last_became_peered":"2024-04-26T10:45:55.177758+0000","last_unstale":"2024-04-26T10:45:58.162206+0000","last_undegraded":"2024-04-26T10:45:58.162206+0000","last_fullsized":"2024-04-26T10:45:58.162206+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8671,"num_write":368,"num_write_kb":38542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"62'49","reported_seq":144,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160077+0000","last_change":"2024-04-26T10:45:45.874789+0000","last_active":"2024-04-26T10:45:58.160077+0000","last_peered":"2024-04-26T10:45:58.160077+0000","last_clean":"2024-04-26T10:45:58.160077+0000","last_became_active":"2024-04-26T10:45:45.874328+0000","last_became_peered":"2024-04-26T10:45:45.874328+0000","last_unstale":"2024-04-26T10:45:58.160077+0000","last_undegraded":"2024-04-26T10:45:58.160077+0000","last_fullsized":"2024-04-26T10:45:58.160077+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"63'368","reported_seq":464,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162768+0000","last_change":"2024-04-26T10:45:56.165615+0000","last_active":"2024-04-26T10:45:58.162768+0000","last_peered":"2024-04-26T10:45:58.162768+0000","last_clean":"2024-04-26T10:45:58.162768+0000","last_became_active":"2024-04-26T10:45:56.163456+0000","last_became_peered":"2024-04-26T10:45:56.163456+0000","last_unstale":"2024-04-26T10:45:58.162768+0000","last_undegraded":"2024-04-26T10:45:58.162768+0000","last_fullsized":"2024-04-26T10:45:58.162768+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":19222,"num_write":336,"num_write_kb":58903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"62'619","reported_seq":748,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159889+0000","last_change":"2024-04-26T10:45:56.162511+0000","last_active":"2024-04-26T10:45:58.159889+0000","last_peered":"2024-04-26T10:45:58.159889+0000","last_clean":"2024-04-26T10:45:58.159889+0000","last_became_active":"2024-04-26T10:45:56.161604+0000","last_became_peered":"2024-04-26T10:45:56.161604+0000","last_unstale":"2024-04-26T10:45:58.159889+0000","last_undegraded":"2024-04-26T10:45:58.159889+0000","last_fullsized":"2024-04-26T10:45:58.159889+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":558,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"63'383","reported_seq":823,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:59.682112+0000","last_change":"2024-04-26T10:45:58.165237+0000","last_active":"2024-04-26T10:45:59.682112+0000","last_peered":"2024-04-26T10:45:59.682112+0000","last_clean":"2024-04-26T10:45:59.682112+0000","last_became_active":"2024-04-26T10:45:58.162264+0000","last_became_peered":"2024-04-26T10:45:58.162264+0000","last_unstale":"2024-04-26T10:45:59.682112+0000","last_undegraded":"2024-04-26T10:45:59.682112+0000","last_fullsized":"2024-04-26T10:45:59.682112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":14260,"num_write":349,"num_write_kb":50367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":230,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161343+0000","last_change":"2024-04-26T10:45:45.871511+0000","last_active":"2024-04-26T10:45:58.161343+0000","last_peered":"2024-04-26T10:45:58.161343+0000","last_clean":"2024-04-26T10:45:58.161343+0000","last_became_active":"2024-04-26T10:45:45.871155+0000","last_became_peered":"2024-04-26T10:45:45.871155+0000","last_unstale":"2024-04-26T10:45:58.161343+0000","last_undegraded":"2024-04-26T10:45:58.161343+0000","last_fullsized":"2024-04-26T10:45:58.161343+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161402+0000","last_change":"2024-04-26T10:45:45.861068+0000","last_active":"2024-04-26T10:45:58.161402+0000","last_peered":"2024-04-26T10:45:58.161402+0000","last_clean":"2024-04-26T10:45:58.161402+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:58.161402+0000","last_undegraded":"2024-04-26T10:45:58.161402+0000","last_fullsized":"2024-04-26T10:45:58.161402+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"62'743","reported_seq":826,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:07.857524+0000","last_change":"2024-04-26T10:42:25.686765+0000","last_active":"2024-04-26T10:46:07.857524+0000","last_peered":"2024-04-26T10:46:07.857524+0000","last_clean":"2024-04-26T10:46:07.857524+0000","last_became_active":"2024-04-26T10:42:25.686009+0000","last_became_peered":"2024-04-26T10:42:25.686009+0000","last_unstale":"2024-04-26T10:46:07.857524+0000","last_undegraded":"2024-04-26T10:46:07.857524+0000","last_fullsized":"2024-04-26T10:46:07.857524+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'442","reported_seq":568,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162375+0000","last_change":"2024-04-26T10:45:55.181074+0000","last_active":"2024-04-26T10:45:58.162375+0000","last_peered":"2024-04-26T10:45:58.162375+0000","last_clean":"2024-04-26T10:45:58.162375+0000","last_became_active":"2024-04-26T10:45:55.177751+0000","last_became_peered":"2024-04-26T10:45:55.177751+0000","last_unstale":"2024-04-26T10:45:58.162375+0000","last_undegraded":"2024-04-26T10:45:58.162375+0000","last_fullsized":"2024-04-26T10:45:58.162375+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":34346,"num_write":406,"num_write_kb":96298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161948+0000","last_change":"2024-04-26T10:45:45.872099+0000","last_active":"2024-04-26T10:45:58.161948+0000","last_peered":"2024-04-26T10:45:58.161948+0000","last_clean":"2024-04-26T10:45:58.161948+0000","last_became_active":"2024-04-26T10:45:45.871741+0000","last_became_peered":"2024-04-26T10:45:45.871741+0000","last_unstale":"2024-04-26T10:45:58.161948+0000","last_undegraded":"2024-04-26T10:45:58.161948+0000","last_fullsized":"2024-04-26T10:45:58.161948+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"63'102","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159454+0000","last_change":"2024-04-26T10:45:56.160802+0000","last_active":"2024-04-26T10:45:58.159454+0000","last_peered":"2024-04-26T10:45:58.159454+0000","last_clean":"2024-04-26T10:45:58.159454+0000","last_became_active":"2024-04-26T10:45:56.160328+0000","last_became_peered":"2024-04-26T10:45:56.160328+0000","last_unstale":"2024-04-26T10:45:58.159454+0000","last_undegraded":"2024-04-26T10:45:58.159454+0000","last_fullsized":"2024-04-26T10:45:58.159454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467631,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":44,"num_write_kb":1460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2935262,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'485","reported_seq":621,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.876202+0000","last_change":"2024-04-26T10:45:57.165815+0000","last_active":"2024-04-26T10:45:58.876202+0000","last_peered":"2024-04-26T10:45:58.876202+0000","last_clean":"2024-04-26T10:45:58.876202+0000","last_became_active":"2024-04-26T10:45:57.162752+0000","last_became_peered":"2024-04-26T10:45:57.162752+0000","last_unstale":"2024-04-26T10:45:58.876202+0000","last_undegraded":"2024-04-26T10:45:58.876202+0000","last_fullsized":"2024-04-26T10:45:58.876202+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27703,"num_write":454,"num_write_kb":121509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159848+0000","last_change":"2024-04-26T10:45:53.180892+0000","last_active":"2024-04-26T10:45:58.159848+0000","last_peered":"2024-04-26T10:45:58.159848+0000","last_clean":"2024-04-26T10:45:58.159848+0000","last_became_active":"2024-04-26T10:45:53.180675+0000","last_became_peered":"2024-04-26T10:45:53.180675+0000","last_unstale":"2024-04-26T10:45:58.159848+0000","last_undegraded":"2024-04-26T10:45:58.159848+0000","last_fullsized":"2024-04-26T10:45:58.159848+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"62'306","reported_seq":415,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:06.972412+0000","last_change":"2024-04-26T10:45:48.865095+0000","last_active":"2024-04-26T10:46:06.972412+0000","last_peered":"2024-04-26T10:46:06.972412+0000","last_clean":"2024-04-26T10:46:06.972412+0000","last_became_active":"2024-04-26T10:45:48.864763+0000","last_became_peered":"2024-04-26T10:45:48.864763+0000","last_unstale":"2024-04-26T10:46:06.972412+0000","last_undegraded":"2024-04-26T10:46:06.972412+0000","last_fullsized":"2024-04-26T10:46:06.972412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"63'336","reported_seq":749,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:59.682135+0000","last_change":"2024-04-26T10:45:58.165267+0000","last_active":"2024-04-26T10:45:59.682135+0000","last_peered":"2024-04-26T10:45:59.682135+0000","last_clean":"2024-04-26T10:45:59.682135+0000","last_became_active":"2024-04-26T10:45:58.162320+0000","last_became_peered":"2024-04-26T10:45:58.162320+0000","last_unstale":"2024-04-26T10:45:59.682135+0000","last_undegraded":"2024-04-26T10:45:59.682135+0000","last_fullsized":"2024-04-26T10:45:59.682135+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12035,"num_write":314,"num_write_kb":29928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":306,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161152+0000","last_change":"2024-04-26T10:45:45.861233+0000","last_active":"2024-04-26T10:45:58.161152+0000","last_peered":"2024-04-26T10:45:58.161152+0000","last_clean":"2024-04-26T10:45:58.161152+0000","last_became_active":"2024-04-26T10:45:45.860924+0000","last_became_peered":"2024-04-26T10:45:45.860924+0000","last_unstale":"2024-04-26T10:45:58.161152+0000","last_undegraded":"2024-04-26T10:45:58.161152+0000","last_fullsized":"2024-04-26T10:45:58.161152+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"62'64","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161518+0000","last_change":"2024-04-26T10:45:45.861230+0000","last_active":"2024-04-26T10:45:58.161518+0000","last_peered":"2024-04-26T10:45:58.161518+0000","last_clean":"2024-04-26T10:45:58.161518+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:58.161518+0000","last_undegraded":"2024-04-26T10:45:58.161518+0000","last_fullsized":"2024-04-26T10:45:58.161518+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"63'421","reported_seq":514,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160380+0000","last_change":"2024-04-26T10:45:54.188138+0000","last_active":"2024-04-26T10:45:58.160380+0000","last_peered":"2024-04-26T10:45:58.160380+0000","last_clean":"2024-04-26T10:45:58.160380+0000","last_became_active":"2024-04-26T10:45:54.185053+0000","last_became_peered":"2024-04-26T10:45:54.185053+0000","last_unstale":"2024-04-26T10:45:58.160380+0000","last_undegraded":"2024-04-26T10:45:58.160380+0000","last_fullsized":"2024-04-26T10:45:58.160380+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28557,"num_write":385,"num_write_kb":93083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"62'480","reported_seq":554,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161962+0000","last_change":"2024-04-26T10:45:48.862894+0000","last_active":"2024-04-26T10:45:58.161962+0000","last_peered":"2024-04-26T10:45:58.161962+0000","last_clean":"2024-04-26T10:45:58.161962+0000","last_became_active":"2024-04-26T10:45:48.862564+0000","last_became_peered":"2024-04-26T10:45:48.862564+0000","last_unstale":"2024-04-26T10:45:58.161962+0000","last_undegraded":"2024-04-26T10:45:58.161962+0000","last_fullsized":"2024-04-26T10:45:58.161962+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":86,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:07.857422+0000","last_change":"2024-04-26T10:42:21.405754+0000","last_active":"2024-04-26T10:46:07.857422+0000","last_peered":"2024-04-26T10:46:07.857422+0000","last_clean":"2024-04-26T10:46:07.857422+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:46:07.857422+0000","last_undegraded":"2024-04-26T10:46:07.857422+0000","last_fullsized":"2024-04-26T10:46:07.857422+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'352","reported_seq":778,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:06.972664+0000","last_change":"2024-04-26T10:45:53.183401+0000","last_active":"2024-04-26T10:46:06.972664+0000","last_peered":"2024-04-26T10:46:06.972664+0000","last_clean":"2024-04-26T10:46:06.972664+0000","last_became_active":"2024-04-26T10:45:53.182454+0000","last_became_peered":"2024-04-26T10:45:53.182454+0000","last_unstale":"2024-04-26T10:46:06.972664+0000","last_undegraded":"2024-04-26T10:46:06.972664+0000","last_fullsized":"2024-04-26T10:46:06.972664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":1905,"num_write":313,"num_write_kb":25573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"62'59","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:32.065405+0000","last_change":"2024-04-26T10:46:32.065523+0000","last_active":"2024-04-26T10:46:32.065405+0000","last_peered":"2024-04-26T10:46:32.065405+0000","last_clean":"2024-04-26T10:46:32.065405+0000","last_became_active":"2024-04-26T10:45:53.176996+0000","last_became_peered":"2024-04-26T10:45:53.176996+0000","last_unstale":"2024-04-26T10:46:32.065405+0000","last_undegraded":"2024-04-26T10:46:32.065405+0000","last_fullsized":"2024-04-26T10:46:32.065405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'59","last_scrub_stamp":"2024-04-26T10:46:32.065382+0000","last_deep_scrub":"62'59","last_deep_scrub_stamp":"2024-04-26T10:46:32.065382+0000","last_clean_scrub_stamp":"2024-04-26T10:46:32.065382+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:26.427635+0000","scrub_duration":0.0016833690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":89,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162375+0000","last_change":"2024-04-26T10:45:53.175046+0000","last_active":"2024-04-26T10:45:58.162375+0000","last_peered":"2024-04-26T10:45:58.162375+0000","last_clean":"2024-04-26T10:45:58.162375+0000","last_became_active":"2024-04-26T10:45:53.174781+0000","last_became_peered":"2024-04-26T10:45:53.174781+0000","last_unstale":"2024-04-26T10:45:58.162375+0000","last_undegraded":"2024-04-26T10:45:58.162375+0000","last_fullsized":"2024-04-26T10:45:58.162375+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'408","reported_seq":920,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:31.846626+0000","last_change":"2024-04-26T10:46:31.846626+0000","last_active":"2024-04-26T10:46:31.846626+0000","last_peered":"2024-04-26T10:46:31.846626+0000","last_clean":"2024-04-26T10:46:31.846626+0000","last_became_active":"2024-04-26T10:45:54.185238+0000","last_became_peered":"2024-04-26T10:45:54.185238+0000","last_unstale":"2024-04-26T10:46:31.846626+0000","last_undegraded":"2024-04-26T10:46:31.846626+0000","last_fullsized":"2024-04-26T10:46:31.846626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:31.846485+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:31.846485+0000","last_clean_scrub_stamp":"2024-04-26T10:46:31.846485+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:36.109042+0000","scrub_duration":0.0024474840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19939,"num_write":382,"num_write_kb":63433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"84'56","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:43.249487+0000","last_change":"2024-04-26T10:46:43.249602+0000","last_active":"2024-04-26T10:46:43.249487+0000","last_peered":"2024-04-26T10:46:43.249487+0000","last_clean":"2024-04-26T10:46:43.249487+0000","last_became_active":"2024-04-26T10:45:53.177305+0000","last_became_peered":"2024-04-26T10:45:53.177305+0000","last_unstale":"2024-04-26T10:46:43.249487+0000","last_undegraded":"2024-04-26T10:46:43.249487+0000","last_fullsized":"2024-04-26T10:46:43.249487+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'56","last_scrub_stamp":"2024-04-26T10:46:43.249467+0000","last_deep_scrub":"84'56","last_deep_scrub_stamp":"2024-04-26T10:46:43.249467+0000","last_clean_scrub_stamp":"2024-04-26T10:46:43.249467+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:52.720824+0000","scrub_duration":0.0031266789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:38.180460+0000","last_change":"2024-04-26T10:46:38.180572+0000","last_active":"2024-04-26T10:46:38.180460+0000","last_peered":"2024-04-26T10:46:38.180460+0000","last_clean":"2024-04-26T10:46:38.180460+0000","last_became_active":"2024-04-26T10:45:53.177249+0000","last_became_peered":"2024-04-26T10:45:53.177249+0000","last_unstale":"2024-04-26T10:46:38.180460+0000","last_undegraded":"2024-04-26T10:46:38.180460+0000","last_fullsized":"2024-04-26T10:46:38.180460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:46:38.180438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:46:38.180438+0000","last_clean_scrub_stamp":"2024-04-26T10:46:38.180438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:09.067544+0000","scrub_duration":0.00179721,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'418","reported_seq":878,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159665+0000","last_change":"2024-04-26T10:45:56.162729+0000","last_active":"2024-04-26T10:45:58.159665+0000","last_peered":"2024-04-26T10:45:58.159665+0000","last_clean":"2024-04-26T10:45:58.159665+0000","last_became_active":"2024-04-26T10:45:56.160440+0000","last_became_peered":"2024-04-26T10:45:56.160440+0000","last_unstale":"2024-04-26T10:45:58.159665+0000","last_undegraded":"2024-04-26T10:45:58.159665+0000","last_fullsized":"2024-04-26T10:45:58.159665+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20110,"num_write":390,"num_write_kb":75171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"84'67","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:20.114106+0000","last_change":"2024-04-26T10:46:20.114217+0000","last_active":"2024-04-26T10:46:20.114106+0000","last_peered":"2024-04-26T10:46:20.114106+0000","last_clean":"2024-04-26T10:46:20.114106+0000","last_became_active":"2024-04-26T10:45:53.175946+0000","last_became_peered":"2024-04-26T10:45:53.175946+0000","last_unstale":"2024-04-26T10:46:20.114106+0000","last_undegraded":"2024-04-26T10:46:20.114106+0000","last_fullsized":"2024-04-26T10:46:20.114106+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'67","last_scrub_stamp":"2024-04-26T10:46:20.114082+0000","last_deep_scrub":"84'67","last_deep_scrub_stamp":"2024-04-26T10:46:20.114082+0000","last_clean_scrub_stamp":"2024-04-26T10:46:20.114082+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:16.069289+0000","scrub_duration":0.00304288,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162589+0000","last_change":"2024-04-26T10:45:45.872224+0000","last_active":"2024-04-26T10:45:58.162589+0000","last_peered":"2024-04-26T10:45:58.162589+0000","last_clean":"2024-04-26T10:45:58.162589+0000","last_became_active":"2024-04-26T10:45:45.871923+0000","last_became_peered":"2024-04-26T10:45:45.871923+0000","last_unstale":"2024-04-26T10:45:58.162589+0000","last_undegraded":"2024-04-26T10:45:58.162589+0000","last_fullsized":"2024-04-26T10:45:58.162589+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"63'404","reported_seq":934,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:27.939150+0000","last_change":"2024-04-26T10:46:27.939150+0000","last_active":"2024-04-26T10:46:27.939150+0000","last_peered":"2024-04-26T10:46:27.939150+0000","last_clean":"2024-04-26T10:46:27.939150+0000","last_became_active":"2024-04-26T10:45:54.181795+0000","last_became_peered":"2024-04-26T10:45:54.181795+0000","last_unstale":"2024-04-26T10:46:27.939150+0000","last_undegraded":"2024-04-26T10:46:27.939150+0000","last_fullsized":"2024-04-26T10:46:27.939150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'404","last_scrub_stamp":"2024-04-26T10:46:27.939009+0000","last_deep_scrub":"63'404","last_deep_scrub_stamp":"2024-04-26T10:46:27.939009+0000","last_clean_scrub_stamp":"2024-04-26T10:46:27.939009+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:43.424977+0000","scrub_duration":0.0025994030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41262,"num_write":371,"num_write_kb":75820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"63'441","reported_seq":565,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161758+0000","last_change":"2024-04-26T10:45:54.188488+0000","last_active":"2024-04-26T10:45:58.161758+0000","last_peered":"2024-04-26T10:45:58.161758+0000","last_clean":"2024-04-26T10:45:58.161758+0000","last_became_active":"2024-04-26T10:45:54.185862+0000","last_became_peered":"2024-04-26T10:45:54.185862+0000","last_unstale":"2024-04-26T10:45:58.161758+0000","last_undegraded":"2024-04-26T10:45:58.161758+0000","last_fullsized":"2024-04-26T10:45:58.161758+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31514,"num_write":408,"num_write_kb":107129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"64'431","reported_seq":521,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161811+0000","last_change":"2024-04-26T10:45:48.865579+0000","last_active":"2024-04-26T10:45:58.161811+0000","last_peered":"2024-04-26T10:45:58.161811+0000","last_clean":"2024-04-26T10:45:58.161811+0000","last_became_active":"2024-04-26T10:45:48.865212+0000","last_became_peered":"2024-04-26T10:45:48.865212+0000","last_unstale":"2024-04-26T10:45:58.161811+0000","last_undegraded":"2024-04-26T10:45:58.161811+0000","last_fullsized":"2024-04-26T10:45:58.161811+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9902610,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":9913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9896193,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"63'410","reported_seq":516,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161317+0000","last_change":"2024-04-26T10:45:54.184713+0000","last_active":"2024-04-26T10:45:58.161317+0000","last_peered":"2024-04-26T10:45:58.161317+0000","last_clean":"2024-04-26T10:45:58.161317+0000","last_became_active":"2024-04-26T10:45:54.182167+0000","last_became_peered":"2024-04-26T10:45:54.182167+0000","last_unstale":"2024-04-26T10:45:58.161317+0000","last_undegraded":"2024-04-26T10:45:58.161317+0000","last_fullsized":"2024-04-26T10:45:58.161317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12734,"num_write":373,"num_write_kb":34864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"63'84","reported_seq":184,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160923+0000","last_change":"2024-04-26T10:45:45.896842+0000","last_active":"2024-04-26T10:45:58.160923+0000","last_peered":"2024-04-26T10:45:58.160923+0000","last_clean":"2024-04-26T10:45:58.160923+0000","last_became_active":"2024-04-26T10:45:45.874746+0000","last_became_peered":"2024-04-26T10:45:45.874746+0000","last_unstale":"2024-04-26T10:45:58.160923+0000","last_undegraded":"2024-04-26T10:45:58.160923+0000","last_fullsized":"2024-04-26T10:45:58.160923+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"84'333","reported_seq":432,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:14.252839+0000","last_change":"2024-04-26T10:46:14.252936+0000","last_active":"2024-04-26T10:46:14.252839+0000","last_peered":"2024-04-26T10:46:14.252839+0000","last_clean":"2024-04-26T10:46:14.252839+0000","last_became_active":"2024-04-26T10:45:56.161449+0000","last_became_peered":"2024-04-26T10:45:56.161449+0000","last_unstale":"2024-04-26T10:46:14.252839+0000","last_undegraded":"2024-04-26T10:46:14.252839+0000","last_fullsized":"2024-04-26T10:46:14.252839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'333","last_scrub_stamp":"2024-04-26T10:46:14.252815+0000","last_deep_scrub":"84'333","last_deep_scrub_stamp":"2024-04-26T10:46:14.252815+0000","last_clean_scrub_stamp":"2024-04-26T10:46:14.252815+0000","objects_scrubbed":1,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:06.020647+0000","scrub_duration":0.0087233659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"63'487","reported_seq":1097,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159640+0000","last_change":"2024-04-26T10:45:51.160586+0000","last_active":"2024-04-26T10:45:58.159640+0000","last_peered":"2024-04-26T10:45:58.159640+0000","last_clean":"2024-04-26T10:45:58.159640+0000","last_became_active":"2024-04-26T10:45:51.159235+0000","last_became_peered":"2024-04-26T10:45:51.159235+0000","last_unstale":"2024-04-26T10:45:58.159640+0000","last_undegraded":"2024-04-26T10:45:58.159640+0000","last_fullsized":"2024-04-26T10:45:58.159640+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":43316,"num_write":468,"num_write_kb":77062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"62'61","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:11.105029+0000","last_change":"2024-04-26T10:46:11.105133+0000","last_active":"2024-04-26T10:46:11.105029+0000","last_peered":"2024-04-26T10:46:11.105029+0000","last_clean":"2024-04-26T10:46:11.105029+0000","last_became_active":"2024-04-26T10:45:53.173851+0000","last_became_peered":"2024-04-26T10:45:53.173851+0000","last_unstale":"2024-04-26T10:46:11.105029+0000","last_undegraded":"2024-04-26T10:46:11.105029+0000","last_fullsized":"2024-04-26T10:46:11.105029+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'61","last_scrub_stamp":"2024-04-26T10:46:11.105005+0000","last_deep_scrub":"62'61","last_deep_scrub_stamp":"2024-04-26T10:46:11.105005+0000","last_clean_scrub_stamp":"2024-04-26T10:46:11.105005+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:57.257799+0000","scrub_duration":0.0016999000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'457","reported_seq":537,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159739+0000","last_change":"2024-04-26T10:45:54.199966+0000","last_active":"2024-04-26T10:45:58.159739+0000","last_peered":"2024-04-26T10:45:58.159739+0000","last_clean":"2024-04-26T10:45:58.159739+0000","last_became_active":"2024-04-26T10:45:54.189622+0000","last_became_peered":"2024-04-26T10:45:54.189622+0000","last_unstale":"2024-04-26T10:45:58.159739+0000","last_undegraded":"2024-04-26T10:45:58.159739+0000","last_fullsized":"2024-04-26T10:45:58.159739+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14848,"num_write":427,"num_write_kb":71903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'377","reported_seq":851,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:29.894860+0000","last_change":"2024-04-26T10:46:29.894860+0000","last_active":"2024-04-26T10:46:29.894860+0000","last_peered":"2024-04-26T10:46:29.894860+0000","last_clean":"2024-04-26T10:46:29.894860+0000","last_became_active":"2024-04-26T10:45:49.866707+0000","last_became_peered":"2024-04-26T10:45:49.866707+0000","last_unstale":"2024-04-26T10:46:29.894860+0000","last_undegraded":"2024-04-26T10:46:29.894860+0000","last_fullsized":"2024-04-26T10:46:29.894860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'377","last_scrub_stamp":"2024-04-26T10:46:29.894727+0000","last_deep_scrub":"63'377","last_deep_scrub_stamp":"2024-04-26T10:46:29.894727+0000","last_clean_scrub_stamp":"2024-04-26T10:46:29.894727+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:20.517004+0000","scrub_duration":0.0019921740000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26932,"num_write":349,"num_write_kb":55611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"62'562","reported_seq":644,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159809+0000","last_change":"2024-04-26T10:42:25.683890+0000","last_active":"2024-04-26T10:45:58.159809+0000","last_peered":"2024-04-26T10:45:58.159809+0000","last_clean":"2024-04-26T10:45:58.159809+0000","last_became_active":"2024-04-26T10:42:25.683467+0000","last_became_peered":"2024-04-26T10:42:25.683467+0000","last_unstale":"2024-04-26T10:45:58.159809+0000","last_undegraded":"2024-04-26T10:45:58.159809+0000","last_fullsized":"2024-04-26T10:45:58.159809+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":8440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'425","reported_seq":879,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160491+0000","last_change":"2024-04-26T10:45:56.163245+0000","last_active":"2024-04-26T10:45:58.160491+0000","last_peered":"2024-04-26T10:45:58.160491+0000","last_clean":"2024-04-26T10:45:58.160491+0000","last_became_active":"2024-04-26T10:45:56.161315+0000","last_became_peered":"2024-04-26T10:45:56.161315+0000","last_unstale":"2024-04-26T10:45:58.160491+0000","last_undegraded":"2024-04-26T10:45:58.160491+0000","last_fullsized":"2024-04-26T10:45:58.160491+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":19004,"num_write":390,"num_write_kb":75524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"62'259","reported_seq":332,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159752+0000","last_change":"2024-04-26T10:45:56.160840+0000","last_active":"2024-04-26T10:45:58.159752+0000","last_peered":"2024-04-26T10:45:58.159752+0000","last_clean":"2024-04-26T10:45:58.159752+0000","last_became_active":"2024-04-26T10:45:56.160344+0000","last_became_peered":"2024-04-26T10:45:56.160344+0000","last_unstale":"2024-04-26T10:45:58.159752+0000","last_undegraded":"2024-04-26T10:45:58.159752+0000","last_fullsized":"2024-04-26T10:45:58.159752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'418","reported_seq":941,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:41.880581+0000","last_change":"2024-04-26T10:46:41.881058+0000","last_active":"2024-04-26T10:46:41.880581+0000","last_peered":"2024-04-26T10:46:41.880581+0000","last_clean":"2024-04-26T10:46:41.880581+0000","last_became_active":"2024-04-26T10:45:55.178079+0000","last_became_peered":"2024-04-26T10:45:55.178079+0000","last_unstale":"2024-04-26T10:46:41.880581+0000","last_undegraded":"2024-04-26T10:46:41.880581+0000","last_fullsized":"2024-04-26T10:46:41.880581+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'418","last_scrub_stamp":"2024-04-26T10:46:41.880550+0000","last_deep_scrub":"63'418","last_deep_scrub_stamp":"2024-04-26T10:46:41.880550+0000","last_clean_scrub_stamp":"2024-04-26T10:46:41.880550+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:06:37.113070+0000","scrub_duration":0.0024544520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":34476,"num_write":379,"num_write_kb":101645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"62'494","reported_seq":576,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160169+0000","last_change":"2024-04-26T10:42:25.688221+0000","last_active":"2024-04-26T10:45:58.160169+0000","last_peered":"2024-04-26T10:45:58.160169+0000","last_clean":"2024-04-26T10:45:58.160169+0000","last_became_active":"2024-04-26T10:42:25.687829+0000","last_became_peered":"2024-04-26T10:42:25.687829+0000","last_unstale":"2024-04-26T10:45:58.160169+0000","last_undegraded":"2024-04-26T10:45:58.160169+0000","last_fullsized":"2024-04-26T10:45:58.160169+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":12543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"63'406","reported_seq":587,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160465+0000","last_change":"2024-04-26T10:45:54.192178+0000","last_active":"2024-04-26T10:45:58.160465+0000","last_peered":"2024-04-26T10:45:58.160465+0000","last_clean":"2024-04-26T10:45:58.160465+0000","last_became_active":"2024-04-26T10:45:54.189591+0000","last_became_peered":"2024-04-26T10:45:54.189591+0000","last_unstale":"2024-04-26T10:45:58.160465+0000","last_undegraded":"2024-04-26T10:45:58.160465+0000","last_fullsized":"2024-04-26T10:45:58.160465+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":45941,"num_write":372,"num_write_kb":80011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"62'61","reported_seq":161,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160605+0000","last_change":"2024-04-26T10:45:45.895125+0000","last_active":"2024-04-26T10:45:58.160605+0000","last_peered":"2024-04-26T10:45:58.160605+0000","last_clean":"2024-04-26T10:45:58.160605+0000","last_became_active":"2024-04-26T10:45:45.874300+0000","last_became_peered":"2024-04-26T10:45:45.874300+0000","last_unstale":"2024-04-26T10:45:58.160605+0000","last_undegraded":"2024-04-26T10:45:58.160605+0000","last_fullsized":"2024-04-26T10:45:58.160605+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"63'375","reported_seq":835,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:19.295162+0000","last_change":"2024-04-26T10:46:19.295289+0000","last_active":"2024-04-26T10:46:19.295162+0000","last_peered":"2024-04-26T10:46:19.295162+0000","last_clean":"2024-04-26T10:46:19.295162+0000","last_became_active":"2024-04-26T10:45:56.160416+0000","last_became_peered":"2024-04-26T10:45:56.160416+0000","last_unstale":"2024-04-26T10:46:19.295162+0000","last_undegraded":"2024-04-26T10:46:19.295162+0000","last_fullsized":"2024-04-26T10:46:19.295162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'375","last_scrub_stamp":"2024-04-26T10:46:19.295138+0000","last_deep_scrub":"63'375","last_deep_scrub_stamp":"2024-04-26T10:46:19.295138+0000","last_clean_scrub_stamp":"2024-04-26T10:46:19.295138+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:58.675348+0000","scrub_duration":0.0023697280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16213,"num_write":354,"num_write_kb":54493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":332,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"84'278","reported_seq":382,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:12.320143+0000","last_change":"2024-04-26T10:46:12.320242+0000","last_active":"2024-04-26T10:46:12.320143+0000","last_peered":"2024-04-26T10:46:12.320143+0000","last_clean":"2024-04-26T10:46:12.320143+0000","last_became_active":"2024-04-26T10:45:56.160414+0000","last_became_peered":"2024-04-26T10:45:56.160414+0000","last_unstale":"2024-04-26T10:46:12.320143+0000","last_undegraded":"2024-04-26T10:46:12.320143+0000","last_fullsized":"2024-04-26T10:46:12.320143+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'278","last_scrub_stamp":"2024-04-26T10:46:12.320120+0000","last_deep_scrub":"84'278","last_deep_scrub_stamp":"2024-04-26T10:46:12.320120+0000","last_clean_scrub_stamp":"2024-04-26T10:46:12.320120+0000","objects_scrubbed":2,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:17:48.308771+0000","scrub_duration":0.0082694940000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"63'379","reported_seq":476,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161505+0000","last_change":"2024-04-26T10:45:53.177365+0000","last_active":"2024-04-26T10:45:58.161505+0000","last_peered":"2024-04-26T10:45:58.161505+0000","last_clean":"2024-04-26T10:45:58.161505+0000","last_became_active":"2024-04-26T10:45:53.173645+0000","last_became_peered":"2024-04-26T10:45:53.173645+0000","last_unstale":"2024-04-26T10:45:58.161505+0000","last_undegraded":"2024-04-26T10:45:58.161505+0000","last_fullsized":"2024-04-26T10:45:58.161505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20480,"num_write":343,"num_write_kb":25788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"62'237","reported_seq":348,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160802+0000","last_change":"2024-04-26T10:45:48.867081+0000","last_active":"2024-04-26T10:45:58.160802+0000","last_peered":"2024-04-26T10:45:58.160802+0000","last_clean":"2024-04-26T10:45:58.160802+0000","last_became_active":"2024-04-26T10:45:48.866716+0000","last_became_peered":"2024-04-26T10:45:48.866716+0000","last_unstale":"2024-04-26T10:45:58.160802+0000","last_undegraded":"2024-04-26T10:45:58.160802+0000","last_fullsized":"2024-04-26T10:45:58.160802+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":12393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"63'419","reported_seq":571,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160213+0000","last_change":"2024-04-26T10:42:26.041729+0000","last_active":"2024-04-26T10:45:58.160213+0000","last_peered":"2024-04-26T10:45:58.160213+0000","last_clean":"2024-04-26T10:45:58.160213+0000","last_became_active":"2024-04-26T10:42:26.040504+0000","last_became_peered":"2024-04-26T10:42:26.040504+0000","last_unstale":"2024-04-26T10:45:58.160213+0000","last_undegraded":"2024-04-26T10:45:58.160213+0000","last_fullsized":"2024-04-26T10:45:58.160213+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39582,"num_write":378,"num_write_kb":54867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"84'62","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:09.103458+0000","last_change":"2024-04-26T10:46:09.103560+0000","last_active":"2024-04-26T10:46:09.103458+0000","last_peered":"2024-04-26T10:46:09.103458+0000","last_clean":"2024-04-26T10:46:09.103458+0000","last_became_active":"2024-04-26T10:45:53.178804+0000","last_became_peered":"2024-04-26T10:45:53.178804+0000","last_unstale":"2024-04-26T10:46:09.103458+0000","last_undegraded":"2024-04-26T10:46:09.103458+0000","last_fullsized":"2024-04-26T10:46:09.103458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'62","last_scrub_stamp":"2024-04-26T10:46:09.103432+0000","last_deep_scrub":"84'62","last_deep_scrub_stamp":"2024-04-26T10:46:09.103432+0000","last_clean_scrub_stamp":"2024-04-26T10:46:09.103432+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:25.007335+0000","scrub_duration":0.00814082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'437","reported_seq":535,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:18.250920+0000","last_change":"2024-04-26T10:46:18.251026+0000","last_active":"2024-04-26T10:46:18.250920+0000","last_peered":"2024-04-26T10:46:18.250920+0000","last_clean":"2024-04-26T10:46:18.250920+0000","last_became_active":"2024-04-26T10:45:53.177071+0000","last_became_peered":"2024-04-26T10:45:53.177071+0000","last_unstale":"2024-04-26T10:46:18.250920+0000","last_undegraded":"2024-04-26T10:46:18.250920+0000","last_fullsized":"2024-04-26T10:46:18.250920+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'437","last_scrub_stamp":"2024-04-26T10:46:18.250898+0000","last_deep_scrub":"63'437","last_deep_scrub_stamp":"2024-04-26T10:46:18.250898+0000","last_clean_scrub_stamp":"2024-04-26T10:46:18.250898+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:10.767270+0000","scrub_duration":0.002104093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":7562,"num_write":400,"num_write_kb":26121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"84'61","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:25.042019+0000","last_change":"2024-04-26T10:46:25.042141+0000","last_active":"2024-04-26T10:46:25.042019+0000","last_peered":"2024-04-26T10:46:25.042019+0000","last_clean":"2024-04-26T10:46:25.042019+0000","last_became_active":"2024-04-26T10:45:53.173542+0000","last_became_peered":"2024-04-26T10:45:53.173542+0000","last_unstale":"2024-04-26T10:46:25.042019+0000","last_undegraded":"2024-04-26T10:46:25.042019+0000","last_fullsized":"2024-04-26T10:46:25.042019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'61","last_scrub_stamp":"2024-04-26T10:46:25.041995+0000","last_deep_scrub":"84'61","last_deep_scrub_stamp":"2024-04-26T10:46:25.041995+0000","last_clean_scrub_stamp":"2024-04-26T10:46:25.041995+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:44:18.722171+0000","scrub_duration":0.010280186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2672,"num_read_kb":1454712,"num_write":24538,"num_write_kb":4190103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26671,"ondisk_log_size":26671,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128811551,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":5770,"num_write_kb":129888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257691648,"data_stored":257623102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},"log_size":7606,"ondisk_log_size":7606,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738425,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187500,"kb_used_data":80164,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94184340,"statfs":{"total":96636764160,"available":96444764160,"internally_reserved":0,"allocated":82087936,"data_stored":81566103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.42199999999999999,"15min":0.43099999999999999},"min":{"1min":0.20599999999999999,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.57199999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.435},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42699999999999999,"15min":0.436},"min":{"1min":0.216,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":1,"up_from":70,"seq":300647710734,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136016,"kb_used_data":90440,"kb_used_omap":7,"kb_used_meta":45560,"kb_avail":94235824,"statfs":{"total":96636764160,"available":96497483776,"internally_reserved":0,"allocated":92610560,"data_stored":92059263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7181,"internal_metadata":46654451},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738426,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214376,"kb_used_data":84896,"kb_used_omap":1,"kb_used_meta":129470,"kb_avail":94157464,"statfs":{"total":96636764160,"available":96417243136,"internally_reserved":0,"allocated":86933504,"data_stored":86396712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132577734},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":2,"last update":"Fri Apr 26 10:46:29 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.42999999999999999,"15min":0.44900000000000001},"min":{"1min":0.253,"5min":0.183,"15min":0.183},"max":{"1min":0.58999999999999997,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.437,"15min":0.46300000000000002},"min":{"1min":0.23999999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.65700000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.53400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":85422080,"data_stored":85400264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":91099136,"data_stored":91062815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81170432,"data_stored":81160023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:46:48.871 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.871 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.871 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.871 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.872 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.872 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.872 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.872 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.872 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.872 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.872 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.872 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.872 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.873 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.873 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.873 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.873 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.873 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.873 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.873 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.873 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.874 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.874 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.874 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.874 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.874 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.874 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.874 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.874 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.874 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.875 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.875 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.875 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.875 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.875 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.875 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.875 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.875 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.875 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.875 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.876 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.876 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.876 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.876 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.876 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.876 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.876 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.876 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.876 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.877 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.877 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.877 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.877 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.877 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.877 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.877 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.877 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.877 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.878 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.878 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.878 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.878 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.878 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.878 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.878 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.878 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.878 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.879 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.879 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.879 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.879 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.879 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.879 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.879 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:46:48.880 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T10:47:08.881 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:47:09.192 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:47:09.194 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:47:09.203 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2024-04-26T10:47:07.667684+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129401919,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2852,"num_read_kb":1456290,"num_write":30511,"num_write_kb":4323451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9253,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34448,"ondisk_log_size":34448,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":537892,"kb_used_data":255500,"kb_used_omap":10,"kb_used_meta":282357,"kb_avail":282577628,"statfs":{"total":289910292480,"available":289359491072,"internally_reserved":0,"allocated":261632000,"data_stored":260022078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10369,"internal_metadata":289134463},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003177"},"pg_stats":[{"pgid":"4.3f","version":"63'415","reported_seq":554,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:52.748402+0000","last_change":"2024-04-26T10:46:52.748512+0000","last_active":"2024-04-26T10:46:52.748402+0000","last_peered":"2024-04-26T10:46:52.748402+0000","last_clean":"2024-04-26T10:46:52.748402+0000","last_became_active":"2024-04-26T10:42:26.044597+0000","last_became_peered":"2024-04-26T10:42:26.044597+0000","last_unstale":"2024-04-26T10:46:52.748402+0000","last_undegraded":"2024-04-26T10:46:52.748402+0000","last_fullsized":"2024-04-26T10:46:52.748402+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'415","last_scrub_stamp":"2024-04-26T10:46:52.748380+0000","last_deep_scrub":"63'415","last_deep_scrub_stamp":"2024-04-26T10:46:52.748380+0000","last_clean_scrub_stamp":"2024-04-26T10:46:52.748380+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:44.118436+0000","scrub_duration":0.002346842,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22963,"num_write":385,"num_write_kb":71406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"63'396","reported_seq":523,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:06.973056+0000","last_change":"2024-04-26T10:45:54.194523+0000","last_active":"2024-04-26T10:46:06.973056+0000","last_peered":"2024-04-26T10:46:06.973056+0000","last_clean":"2024-04-26T10:46:06.973056+0000","last_became_active":"2024-04-26T10:45:54.192613+0000","last_became_peered":"2024-04-26T10:45:54.192613+0000","last_unstale":"2024-04-26T10:46:06.973056+0000","last_undegraded":"2024-04-26T10:46:06.973056+0000","last_fullsized":"2024-04-26T10:46:06.973056+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9499,"num_write":371,"num_write_kb":38601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"63'366","reported_seq":461,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:24.288364+0000","last_change":"2024-04-26T10:46:24.288483+0000","last_active":"2024-04-26T10:46:24.288364+0000","last_peered":"2024-04-26T10:46:24.288364+0000","last_clean":"2024-04-26T10:46:24.288364+0000","last_became_active":"2024-04-26T10:45:55.180991+0000","last_became_peered":"2024-04-26T10:45:55.180991+0000","last_unstale":"2024-04-26T10:46:24.288364+0000","last_undegraded":"2024-04-26T10:46:24.288364+0000","last_fullsized":"2024-04-26T10:46:24.288364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'366","last_scrub_stamp":"2024-04-26T10:46:24.288343+0000","last_deep_scrub":"63'366","last_deep_scrub_stamp":"2024-04-26T10:46:24.288343+0000","last_clean_scrub_stamp":"2024-04-26T10:46:24.288343+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:09.803889+0000","scrub_duration":0.0024847200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6211,"num_write":338,"num_write_kb":38844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"63'394","reported_seq":546,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161957+0000","last_change":"2024-04-26T10:45:51.162341+0000","last_active":"2024-04-26T10:45:58.161957+0000","last_peered":"2024-04-26T10:45:58.161957+0000","last_clean":"2024-04-26T10:45:58.161957+0000","last_became_active":"2024-04-26T10:45:51.159099+0000","last_became_peered":"2024-04-26T10:45:51.159099+0000","last_unstale":"2024-04-26T10:45:58.161957+0000","last_undegraded":"2024-04-26T10:45:58.161957+0000","last_fullsized":"2024-04-26T10:45:58.161957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":52323,"num_write":357,"num_write_kb":63323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"63'409","reported_seq":519,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:46.894502+0000","last_change":"2024-04-26T10:46:46.894628+0000","last_active":"2024-04-26T10:46:46.894502+0000","last_peered":"2024-04-26T10:46:46.894502+0000","last_clean":"2024-04-26T10:46:46.894502+0000","last_became_active":"2024-04-26T10:42:26.040487+0000","last_became_peered":"2024-04-26T10:42:26.040487+0000","last_unstale":"2024-04-26T10:46:46.894502+0000","last_undegraded":"2024-04-26T10:46:46.894502+0000","last_fullsized":"2024-04-26T10:46:46.894502+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'409","last_scrub_stamp":"2024-04-26T10:46:46.894476+0000","last_deep_scrub":"63'409","last_deep_scrub_stamp":"2024-04-26T10:46:46.894476+0000","last_clean_scrub_stamp":"2024-04-26T10:46:46.894476+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:34.325893+0000","scrub_duration":0.0034301790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":372,"num_write_kb":42764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'385","reported_seq":476,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:21.300652+0000","last_change":"2024-04-26T10:46:21.300788+0000","last_active":"2024-04-26T10:46:21.300652+0000","last_peered":"2024-04-26T10:46:21.300652+0000","last_clean":"2024-04-26T10:46:21.300652+0000","last_became_active":"2024-04-26T10:45:49.861811+0000","last_became_peered":"2024-04-26T10:45:49.861811+0000","last_unstale":"2024-04-26T10:46:21.300652+0000","last_undegraded":"2024-04-26T10:46:21.300652+0000","last_fullsized":"2024-04-26T10:46:21.300652+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'385","last_scrub_stamp":"2024-04-26T10:46:21.300632+0000","last_deep_scrub":"63'385","last_deep_scrub_stamp":"2024-04-26T10:46:21.300632+0000","last_clean_scrub_stamp":"2024-04-26T10:46:21.300632+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:50.462322+0000","scrub_duration":0.0030393180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4124,"num_write":356,"num_write_kb":69857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"63'425","reported_seq":535,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161609+0000","last_change":"2024-04-26T10:45:50.869572+0000","last_active":"2024-04-26T10:45:58.161609+0000","last_peered":"2024-04-26T10:45:58.161609+0000","last_clean":"2024-04-26T10:45:58.161609+0000","last_became_active":"2024-04-26T10:45:50.866996+0000","last_became_peered":"2024-04-26T10:45:50.866996+0000","last_unstale":"2024-04-26T10:45:58.161609+0000","last_undegraded":"2024-04-26T10:45:58.161609+0000","last_fullsized":"2024-04-26T10:45:58.161609+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13036,"num_write":390,"num_write_kb":67193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"63'399","reported_seq":508,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.164893+0000","last_change":"2024-04-26T10:45:58.164304+0000","last_active":"2024-04-26T10:45:58.164893+0000","last_peered":"2024-04-26T10:45:58.164893+0000","last_clean":"2024-04-26T10:45:58.164893+0000","last_became_active":"2024-04-26T10:45:58.162532+0000","last_became_peered":"2024-04-26T10:45:58.162532+0000","last_unstale":"2024-04-26T10:45:58.164893+0000","last_undegraded":"2024-04-26T10:45:58.164893+0000","last_fullsized":"2024-04-26T10:45:58.164893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25678,"num_write":356,"num_write_kb":116549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"63'442","reported_seq":590,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160776+0000","last_change":"2024-04-26T10:42:26.045893+0000","last_active":"2024-04-26T10:45:58.160776+0000","last_peered":"2024-04-26T10:45:58.160776+0000","last_clean":"2024-04-26T10:45:58.160776+0000","last_became_active":"2024-04-26T10:42:26.045177+0000","last_became_peered":"2024-04-26T10:42:26.045177+0000","last_unstale":"2024-04-26T10:45:58.160776+0000","last_undegraded":"2024-04-26T10:45:58.160776+0000","last_fullsized":"2024-04-26T10:45:58.160776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35111,"num_write":413,"num_write_kb":60306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'393","reported_seq":516,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160602+0000","last_change":"2024-04-26T10:45:54.192984+0000","last_active":"2024-04-26T10:45:58.160602+0000","last_peered":"2024-04-26T10:45:58.160602+0000","last_clean":"2024-04-26T10:45:58.160602+0000","last_became_active":"2024-04-26T10:45:54.191514+0000","last_became_peered":"2024-04-26T10:45:54.191514+0000","last_unstale":"2024-04-26T10:45:58.160602+0000","last_undegraded":"2024-04-26T10:45:58.160602+0000","last_fullsized":"2024-04-26T10:45:58.160602+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5355,"num_write":351,"num_write_kb":38901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"63'377","reported_seq":483,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162538+0000","last_change":"2024-04-26T10:45:49.865172+0000","last_active":"2024-04-26T10:45:58.162538+0000","last_peered":"2024-04-26T10:45:58.162538+0000","last_clean":"2024-04-26T10:45:58.162538+0000","last_became_active":"2024-04-26T10:45:49.862718+0000","last_became_peered":"2024-04-26T10:45:49.862718+0000","last_unstale":"2024-04-26T10:45:58.162538+0000","last_undegraded":"2024-04-26T10:45:58.162538+0000","last_fullsized":"2024-04-26T10:45:58.162538+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18030,"num_write":355,"num_write_kb":67044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"63'365","reported_seq":809,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160338+0000","last_change":"2024-04-26T10:45:57.166219+0000","last_active":"2024-04-26T10:45:58.160338+0000","last_peered":"2024-04-26T10:45:58.160338+0000","last_clean":"2024-04-26T10:45:58.160338+0000","last_became_active":"2024-04-26T10:45:57.164964+0000","last_became_peered":"2024-04-26T10:45:57.164964+0000","last_unstale":"2024-04-26T10:45:58.160338+0000","last_undegraded":"2024-04-26T10:45:58.160338+0000","last_fullsized":"2024-04-26T10:45:58.160338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14866,"num_write":337,"num_write_kb":71188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'397","reported_seq":491,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160243+0000","last_change":"2024-04-26T10:42:26.042607+0000","last_active":"2024-04-26T10:45:58.160243+0000","last_peered":"2024-04-26T10:45:58.160243+0000","last_clean":"2024-04-26T10:45:58.160243+0000","last_became_active":"2024-04-26T10:42:26.041617+0000","last_became_peered":"2024-04-26T10:42:26.041617+0000","last_unstale":"2024-04-26T10:45:58.160243+0000","last_undegraded":"2024-04-26T10:45:58.160243+0000","last_fullsized":"2024-04-26T10:45:58.160243+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8192,"num_write":362,"num_write_kb":54822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"63'408","reported_seq":499,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:34.396188+0000","last_change":"2024-04-26T10:46:34.396311+0000","last_active":"2024-04-26T10:46:34.396188+0000","last_peered":"2024-04-26T10:46:34.396188+0000","last_clean":"2024-04-26T10:46:34.396188+0000","last_became_active":"2024-04-26T10:45:53.177677+0000","last_became_peered":"2024-04-26T10:45:53.177677+0000","last_unstale":"2024-04-26T10:46:34.396188+0000","last_undegraded":"2024-04-26T10:46:34.396188+0000","last_fullsized":"2024-04-26T10:46:34.396188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:34.396168+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:34.396168+0000","last_clean_scrub_stamp":"2024-04-26T10:46:34.396168+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:28.312103+0000","scrub_duration":0.002988662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4688,"num_write":374,"num_write_kb":21766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"63'409","reported_seq":534,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:47.541512+0000","last_change":"2024-04-26T10:46:47.541645+0000","last_active":"2024-04-26T10:46:47.541512+0000","last_peered":"2024-04-26T10:46:47.541512+0000","last_clean":"2024-04-26T10:46:47.541512+0000","last_became_active":"2024-04-26T10:45:54.185826+0000","last_became_peered":"2024-04-26T10:45:54.185826+0000","last_unstale":"2024-04-26T10:46:47.541512+0000","last_undegraded":"2024-04-26T10:46:47.541512+0000","last_fullsized":"2024-04-26T10:46:47.541512+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'409","last_scrub_stamp":"2024-04-26T10:46:47.541492+0000","last_deep_scrub":"63'409","last_deep_scrub_stamp":"2024-04-26T10:46:47.541492+0000","last_clean_scrub_stamp":"2024-04-26T10:46:47.541492+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:05.889065+0000","scrub_duration":0.0023676470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25968,"num_write":366,"num_write_kb":75698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"63'460","reported_seq":574,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:20.325508+0000","last_change":"2024-04-26T10:46:20.325615+0000","last_active":"2024-04-26T10:46:20.325508+0000","last_peered":"2024-04-26T10:46:20.325508+0000","last_clean":"2024-04-26T10:46:20.325508+0000","last_became_active":"2024-04-26T10:45:53.174699+0000","last_became_peered":"2024-04-26T10:45:53.174699+0000","last_unstale":"2024-04-26T10:46:20.325508+0000","last_undegraded":"2024-04-26T10:46:20.325508+0000","last_fullsized":"2024-04-26T10:46:20.325508+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'460","last_scrub_stamp":"2024-04-26T10:46:20.325486+0000","last_deep_scrub":"63'460","last_deep_scrub_stamp":"2024-04-26T10:46:20.325486+0000","last_clean_scrub_stamp":"2024-04-26T10:46:20.325486+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:51.733701+0000","scrub_duration":0.0023796759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16269,"num_write":426,"num_write_kb":67839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"63'393","reported_seq":513,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161065+0000","last_change":"2024-04-26T10:42:26.049338+0000","last_active":"2024-04-26T10:45:58.161065+0000","last_peered":"2024-04-26T10:45:58.161065+0000","last_clean":"2024-04-26T10:45:58.161065+0000","last_became_active":"2024-04-26T10:42:26.049014+0000","last_became_peered":"2024-04-26T10:42:26.049014+0000","last_unstale":"2024-04-26T10:45:58.161065+0000","last_undegraded":"2024-04-26T10:45:58.161065+0000","last_fullsized":"2024-04-26T10:45:58.161065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":25712,"num_write":362,"num_write_kb":42020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'428","reported_seq":566,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:15.921115+0000","last_change":"2024-04-26T10:46:15.921226+0000","last_active":"2024-04-26T10:46:15.921115+0000","last_peered":"2024-04-26T10:46:15.921115+0000","last_clean":"2024-04-26T10:46:15.921115+0000","last_became_active":"2024-04-26T10:45:54.189852+0000","last_became_peered":"2024-04-26T10:45:54.189852+0000","last_unstale":"2024-04-26T10:46:15.921115+0000","last_undegraded":"2024-04-26T10:46:15.921115+0000","last_fullsized":"2024-04-26T10:46:15.921115+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'428","last_scrub_stamp":"2024-04-26T10:46:15.921093+0000","last_deep_scrub":"63'428","last_deep_scrub_stamp":"2024-04-26T10:46:15.921093+0000","last_clean_scrub_stamp":"2024-04-26T10:46:15.921093+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:06.246994+0000","scrub_duration":0.0037567920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12316,"num_write":384,"num_write_kb":87656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"63'446","reported_seq":599,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:34.106864+0000","last_change":"2024-04-26T10:46:34.106970+0000","last_active":"2024-04-26T10:46:34.106864+0000","last_peered":"2024-04-26T10:46:34.106864+0000","last_clean":"2024-04-26T10:46:34.106864+0000","last_became_active":"2024-04-26T10:45:54.184063+0000","last_became_peered":"2024-04-26T10:45:54.184063+0000","last_unstale":"2024-04-26T10:46:34.106864+0000","last_undegraded":"2024-04-26T10:46:34.106864+0000","last_fullsized":"2024-04-26T10:46:34.106864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'446","last_scrub_stamp":"2024-04-26T10:46:34.106840+0000","last_deep_scrub":"63'446","last_deep_scrub_stamp":"2024-04-26T10:46:34.106840+0000","last_clean_scrub_stamp":"2024-04-26T10:46:34.106840+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:53.038982+0000","scrub_duration":0.003191504,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":53414,"num_write":401,"num_write_kb":80048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":562,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:43.456409+0000","last_change":"2024-04-26T10:46:43.456513+0000","last_active":"2024-04-26T10:46:43.456409+0000","last_peered":"2024-04-26T10:46:43.456409+0000","last_clean":"2024-04-26T10:46:43.456409+0000","last_became_active":"2024-04-26T10:45:50.867680+0000","last_became_peered":"2024-04-26T10:45:50.867680+0000","last_unstale":"2024-04-26T10:46:43.456409+0000","last_undegraded":"2024-04-26T10:46:43.456409+0000","last_fullsized":"2024-04-26T10:46:43.456409+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'438","last_scrub_stamp":"2024-04-26T10:46:43.456387+0000","last_deep_scrub":"63'438","last_deep_scrub_stamp":"2024-04-26T10:46:43.456387+0000","last_clean_scrub_stamp":"2024-04-26T10:46:43.456387+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:45.105492+0000","scrub_duration":0.002559675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19859,"num_write":405,"num_write_kb":51119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"63'408","reported_seq":874,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:26.338673+0000","last_change":"2024-04-26T10:46:26.338811+0000","last_active":"2024-04-26T10:46:26.338673+0000","last_peered":"2024-04-26T10:46:26.338673+0000","last_clean":"2024-04-26T10:46:26.338673+0000","last_became_active":"2024-04-26T10:45:56.160360+0000","last_became_peered":"2024-04-26T10:45:56.160360+0000","last_unstale":"2024-04-26T10:46:26.338673+0000","last_undegraded":"2024-04-26T10:46:26.338673+0000","last_fullsized":"2024-04-26T10:46:26.338673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:26.338639+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:26.338639+0000","last_clean_scrub_stamp":"2024-04-26T10:46:26.338639+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:34.117967+0000","scrub_duration":0.0027084209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":15372,"num_write":366,"num_write_kb":75855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"63'452","reported_seq":1019,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:06.972935+0000","last_change":"2024-04-26T10:45:52.175372+0000","last_active":"2024-04-26T10:46:06.972935+0000","last_peered":"2024-04-26T10:46:06.972935+0000","last_clean":"2024-04-26T10:46:06.972935+0000","last_became_active":"2024-04-26T10:45:52.173702+0000","last_became_peered":"2024-04-26T10:45:52.173702+0000","last_unstale":"2024-04-26T10:46:06.972935+0000","last_undegraded":"2024-04-26T10:46:06.972935+0000","last_fullsized":"2024-04-26T10:46:06.972935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43729,"num_write":421,"num_write_kb":79804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"63'408","reported_seq":894,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:30.067044+0000","last_change":"2024-04-26T10:46:30.067162+0000","last_active":"2024-04-26T10:46:30.067044+0000","last_peered":"2024-04-26T10:46:30.067044+0000","last_clean":"2024-04-26T10:46:30.067044+0000","last_became_active":"2024-04-26T10:45:57.162147+0000","last_became_peered":"2024-04-26T10:45:57.162147+0000","last_unstale":"2024-04-26T10:46:30.067044+0000","last_undegraded":"2024-04-26T10:46:30.067044+0000","last_fullsized":"2024-04-26T10:46:30.067044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:30.067019+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:30.067019+0000","last_clean_scrub_stamp":"2024-04-26T10:46:30.067019+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:46.527639+0000","scrub_duration":0.0026815810000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":30320,"num_write":372,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'453","reported_seq":628,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:57.799503+0000","last_change":"2024-04-26T10:46:57.799635+0000","last_active":"2024-04-26T10:46:57.799503+0000","last_peered":"2024-04-26T10:46:57.799503+0000","last_clean":"2024-04-26T10:46:57.799503+0000","last_became_active":"2024-04-26T10:45:54.181881+0000","last_became_peered":"2024-04-26T10:45:54.181881+0000","last_unstale":"2024-04-26T10:46:57.799503+0000","last_undegraded":"2024-04-26T10:46:57.799503+0000","last_fullsized":"2024-04-26T10:46:57.799503+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'453","last_scrub_stamp":"2024-04-26T10:46:57.799480+0000","last_deep_scrub":"63'453","last_deep_scrub_stamp":"2024-04-26T10:46:57.799480+0000","last_clean_scrub_stamp":"2024-04-26T10:46:57.799480+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:42.095942+0000","scrub_duration":0.003413672,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":19864,"num_write":422,"num_write_kb":51638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"63'439","reported_seq":967,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:07.911236+0000","last_change":"2024-04-26T10:46:07.911236+0000","last_active":"2024-04-26T10:46:07.911236+0000","last_peered":"2024-04-26T10:46:07.911236+0000","last_clean":"2024-04-26T10:46:07.911236+0000","last_became_active":"2024-04-26T10:45:48.866159+0000","last_became_peered":"2024-04-26T10:45:48.866159+0000","last_unstale":"2024-04-26T10:46:07.911236+0000","last_undegraded":"2024-04-26T10:46:07.911236+0000","last_fullsized":"2024-04-26T10:46:07.911236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'439","last_scrub_stamp":"2024-04-26T10:46:07.911088+0000","last_deep_scrub":"63'439","last_deep_scrub_stamp":"2024-04-26T10:46:07.911088+0000","last_clean_scrub_stamp":"2024-04-26T10:46:07.911088+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:32.755490+0000","scrub_duration":0.0024222179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8912,"num_write":417,"num_write_kb":46575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"63'513","reported_seq":1160,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:07.857821+0000","last_change":"2024-04-26T10:45:51.160003+0000","last_active":"2024-04-26T10:46:07.857821+0000","last_peered":"2024-04-26T10:46:07.857821+0000","last_clean":"2024-04-26T10:46:07.857821+0000","last_became_active":"2024-04-26T10:45:51.158698+0000","last_became_peered":"2024-04-26T10:45:51.158698+0000","last_unstale":"2024-04-26T10:46:07.857821+0000","last_undegraded":"2024-04-26T10:46:07.857821+0000","last_fullsized":"2024-04-26T10:46:07.857821+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":70751,"num_write":473,"num_write_kb":88902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'406","reported_seq":545,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:54.455676+0000","last_change":"2024-04-26T10:46:54.455779+0000","last_active":"2024-04-26T10:46:54.455676+0000","last_peered":"2024-04-26T10:46:54.455676+0000","last_clean":"2024-04-26T10:46:54.455676+0000","last_became_active":"2024-04-26T10:45:56.162419+0000","last_became_peered":"2024-04-26T10:45:56.162419+0000","last_unstale":"2024-04-26T10:46:54.455676+0000","last_undegraded":"2024-04-26T10:46:54.455676+0000","last_fullsized":"2024-04-26T10:46:54.455676+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'406","last_scrub_stamp":"2024-04-26T10:46:54.455655+0000","last_deep_scrub":"63'406","last_deep_scrub_stamp":"2024-04-26T10:46:54.455655+0000","last_clean_scrub_stamp":"2024-04-26T10:46:54.455655+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:35.943745+0000","scrub_duration":0.0024701179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":32121,"num_write":372,"num_write_kb":60163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"63'402","reported_seq":880,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:38.854895+0000","last_change":"2024-04-26T10:46:38.854895+0000","last_active":"2024-04-26T10:46:38.854895+0000","last_peered":"2024-04-26T10:46:38.854895+0000","last_clean":"2024-04-26T10:46:38.854895+0000","last_became_active":"2024-04-26T10:45:57.165064+0000","last_became_peered":"2024-04-26T10:45:57.165064+0000","last_unstale":"2024-04-26T10:46:38.854895+0000","last_undegraded":"2024-04-26T10:46:38.854895+0000","last_fullsized":"2024-04-26T10:46:38.854895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'402","last_scrub_stamp":"2024-04-26T10:46:38.854753+0000","last_deep_scrub":"63'402","last_deep_scrub_stamp":"2024-04-26T10:46:38.854753+0000","last_clean_scrub_stamp":"2024-04-26T10:46:38.854753+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:36.110686+0000","scrub_duration":0.0022249689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":6824,"num_write":378,"num_write_kb":72156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"63'407","reported_seq":889,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:59.681981+0000","last_change":"2024-04-26T10:45:58.163989+0000","last_active":"2024-04-26T10:45:59.681981+0000","last_peered":"2024-04-26T10:45:59.681981+0000","last_clean":"2024-04-26T10:45:59.681981+0000","last_became_active":"2024-04-26T10:45:58.161850+0000","last_became_peered":"2024-04-26T10:45:58.161850+0000","last_unstale":"2024-04-26T10:45:59.681981+0000","last_undegraded":"2024-04-26T10:45:59.681981+0000","last_fullsized":"2024-04-26T10:45:59.681981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25898,"num_write":372,"num_write_kb":59274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":346,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'490","reported_seq":1071,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:51.777219+0000","last_change":"2024-04-26T10:46:51.777320+0000","last_active":"2024-04-26T10:46:51.777219+0000","last_peered":"2024-04-26T10:46:51.777219+0000","last_clean":"2024-04-26T10:46:51.777219+0000","last_became_active":"2024-04-26T10:45:55.178083+0000","last_became_peered":"2024-04-26T10:45:55.178083+0000","last_unstale":"2024-04-26T10:46:51.777219+0000","last_undegraded":"2024-04-26T10:46:51.777219+0000","last_fullsized":"2024-04-26T10:46:51.777219+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'490","last_scrub_stamp":"2024-04-26T10:46:51.777196+0000","last_deep_scrub":"63'490","last_deep_scrub_stamp":"2024-04-26T10:46:51.777196+0000","last_clean_scrub_stamp":"2024-04-26T10:46:51.777196+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:16:31.651731+0000","scrub_duration":0.0022270390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33597,"num_write":449,"num_write_kb":87981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"63'474","reported_seq":575,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:41.218309+0000","last_change":"2024-04-26T10:46:41.218435+0000","last_active":"2024-04-26T10:46:41.218309+0000","last_peered":"2024-04-26T10:46:41.218309+0000","last_clean":"2024-04-26T10:46:41.218309+0000","last_became_active":"2024-04-26T10:45:54.186011+0000","last_became_peered":"2024-04-26T10:45:54.186011+0000","last_unstale":"2024-04-26T10:46:41.218309+0000","last_undegraded":"2024-04-26T10:46:41.218309+0000","last_fullsized":"2024-04-26T10:46:41.218309+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'474","last_scrub_stamp":"2024-04-26T10:46:41.218267+0000","last_deep_scrub":"63'474","last_deep_scrub_stamp":"2024-04-26T10:46:41.218267+0000","last_clean_scrub_stamp":"2024-04-26T10:46:41.218267+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:19.308910+0000","scrub_duration":0.003558748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30886,"num_write":441,"num_write_kb":118807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'443","reported_seq":559,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:37.402412+0000","last_change":"2024-04-26T10:46:37.402510+0000","last_active":"2024-04-26T10:46:37.402412+0000","last_peered":"2024-04-26T10:46:37.402412+0000","last_clean":"2024-04-26T10:46:37.402412+0000","last_became_active":"2024-04-26T10:45:48.861918+0000","last_became_peered":"2024-04-26T10:45:48.861918+0000","last_unstale":"2024-04-26T10:46:37.402412+0000","last_undegraded":"2024-04-26T10:46:37.402412+0000","last_fullsized":"2024-04-26T10:46:37.402412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'443","last_scrub_stamp":"2024-04-26T10:46:37.402390+0000","last_deep_scrub":"63'443","last_deep_scrub_stamp":"2024-04-26T10:46:37.402390+0000","last_clean_scrub_stamp":"2024-04-26T10:46:37.402390+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:31.390744+0000","scrub_duration":0.0023535019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20556,"num_write":413,"num_write_kb":91647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"63'376","reported_seq":490,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:49.818167+0000","last_change":"2024-04-26T10:46:49.818309+0000","last_active":"2024-04-26T10:46:49.818167+0000","last_peered":"2024-04-26T10:46:49.818167+0000","last_clean":"2024-04-26T10:46:49.818167+0000","last_became_active":"2024-04-26T10:42:26.040920+0000","last_became_peered":"2024-04-26T10:42:26.040920+0000","last_unstale":"2024-04-26T10:46:49.818167+0000","last_undegraded":"2024-04-26T10:46:49.818167+0000","last_fullsized":"2024-04-26T10:46:49.818167+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'376","last_scrub_stamp":"2024-04-26T10:46:49.818144+0000","last_deep_scrub":"63'376","last_deep_scrub_stamp":"2024-04-26T10:46:49.818144+0000","last_clean_scrub_stamp":"2024-04-26T10:46:49.818144+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:42.631428+0000","scrub_duration":0.002993571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10124,"num_write":344,"num_write_kb":66899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"62'453","reported_seq":534,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161595+0000","last_change":"2024-04-26T10:45:48.862782+0000","last_active":"2024-04-26T10:45:58.161595+0000","last_peered":"2024-04-26T10:45:58.161595+0000","last_clean":"2024-04-26T10:45:58.161595+0000","last_became_active":"2024-04-26T10:45:48.862424+0000","last_became_peered":"2024-04-26T10:45:48.862424+0000","last_unstale":"2024-04-26T10:45:58.161595+0000","last_undegraded":"2024-04-26T10:45:58.161595+0000","last_fullsized":"2024-04-26T10:45:58.161595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"63'403","reported_seq":532,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:10.923122+0000","last_change":"2024-04-26T10:46:10.923239+0000","last_active":"2024-04-26T10:46:10.923122+0000","last_peered":"2024-04-26T10:46:10.923122+0000","last_clean":"2024-04-26T10:46:10.923122+0000","last_became_active":"2024-04-26T10:42:26.040464+0000","last_became_peered":"2024-04-26T10:42:26.040464+0000","last_unstale":"2024-04-26T10:46:10.923122+0000","last_undegraded":"2024-04-26T10:46:10.923122+0000","last_fullsized":"2024-04-26T10:46:10.923122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'403","last_scrub_stamp":"2024-04-26T10:46:10.923100+0000","last_deep_scrub":"63'403","last_deep_scrub_stamp":"2024-04-26T10:46:10.923100+0000","last_clean_scrub_stamp":"2024-04-26T10:46:10.923100+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:00.804186+0000","scrub_duration":0.0037994579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24588,"num_write":363,"num_write_kb":51190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"62'49","reported_seq":144,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159679+0000","last_change":"2024-04-26T10:45:45.862317+0000","last_active":"2024-04-26T10:45:58.159679+0000","last_peered":"2024-04-26T10:45:58.159679+0000","last_clean":"2024-04-26T10:45:58.159679+0000","last_became_active":"2024-04-26T10:45:45.862029+0000","last_became_peered":"2024-04-26T10:45:45.862029+0000","last_unstale":"2024-04-26T10:45:58.159679+0000","last_undegraded":"2024-04-26T10:45:58.159679+0000","last_fullsized":"2024-04-26T10:45:58.159679+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'407","reported_seq":888,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160627+0000","last_change":"2024-04-26T10:45:52.170710+0000","last_active":"2024-04-26T10:45:58.160627+0000","last_peered":"2024-04-26T10:45:58.160627+0000","last_clean":"2024-04-26T10:45:58.160627+0000","last_became_active":"2024-04-26T10:45:52.169295+0000","last_became_peered":"2024-04-26T10:45:52.169295+0000","last_unstale":"2024-04-26T10:45:58.160627+0000","last_undegraded":"2024-04-26T10:45:58.160627+0000","last_fullsized":"2024-04-26T10:45:58.160627+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":7077,"num_write":367,"num_write_kb":42434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"62'66","reported_seq":161,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159949+0000","last_change":"2024-04-26T10:45:45.874440+0000","last_active":"2024-04-26T10:45:58.159949+0000","last_peered":"2024-04-26T10:45:58.159949+0000","last_clean":"2024-04-26T10:45:58.159949+0000","last_became_active":"2024-04-26T10:45:45.874030+0000","last_became_peered":"2024-04-26T10:45:45.874030+0000","last_unstale":"2024-04-26T10:45:58.159949+0000","last_undegraded":"2024-04-26T10:45:58.159949+0000","last_fullsized":"2024-04-26T10:45:58.159949+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"63'406","reported_seq":899,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160833+0000","last_change":"2024-04-26T10:45:49.863376+0000","last_active":"2024-04-26T10:45:58.160833+0000","last_peered":"2024-04-26T10:45:58.160833+0000","last_clean":"2024-04-26T10:45:58.160833+0000","last_became_active":"2024-04-26T10:45:49.861979+0000","last_became_peered":"2024-04-26T10:45:49.861979+0000","last_unstale":"2024-04-26T10:45:58.160833+0000","last_undegraded":"2024-04-26T10:45:58.160833+0000","last_fullsized":"2024-04-26T10:45:58.160833+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":25977,"num_write":374,"num_write_kb":104172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"84'70","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:56.460947+0000","last_change":"2024-04-26T10:46:56.461080+0000","last_active":"2024-04-26T10:46:56.460947+0000","last_peered":"2024-04-26T10:46:56.460947+0000","last_clean":"2024-04-26T10:46:56.460947+0000","last_became_active":"2024-04-26T10:45:45.871120+0000","last_became_peered":"2024-04-26T10:45:45.871120+0000","last_unstale":"2024-04-26T10:46:56.460947+0000","last_undegraded":"2024-04-26T10:46:56.460947+0000","last_fullsized":"2024-04-26T10:46:56.460947+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'70","last_scrub_stamp":"2024-04-26T10:46:56.460924+0000","last_deep_scrub":"84'70","last_deep_scrub_stamp":"2024-04-26T10:46:56.460924+0000","last_clean_scrub_stamp":"2024-04-26T10:46:56.460924+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:06.245761+0000","scrub_duration":0.0046851239999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"84'202","reported_seq":295,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:45.516881+0000","last_change":"2024-04-26T10:46:45.516981+0000","last_active":"2024-04-26T10:46:45.516881+0000","last_peered":"2024-04-26T10:46:45.516881+0000","last_clean":"2024-04-26T10:46:45.516881+0000","last_became_active":"2024-04-26T10:45:48.865878+0000","last_became_peered":"2024-04-26T10:45:48.865878+0000","last_unstale":"2024-04-26T10:46:45.516881+0000","last_undegraded":"2024-04-26T10:46:45.516881+0000","last_fullsized":"2024-04-26T10:46:45.516881+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'202","last_scrub_stamp":"2024-04-26T10:46:45.516857+0000","last_deep_scrub":"84'202","last_deep_scrub_stamp":"2024-04-26T10:46:45.516857+0000","last_clean_scrub_stamp":"2024-04-26T10:46:45.516857+0000","objects_scrubbed":2,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:35.343559+0000","scrub_duration":0.011504359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"63'415","reported_seq":921,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:11.914773+0000","last_change":"2024-04-26T10:46:11.914773+0000","last_active":"2024-04-26T10:46:11.914773+0000","last_peered":"2024-04-26T10:46:11.914773+0000","last_clean":"2024-04-26T10:46:11.914773+0000","last_became_active":"2024-04-26T10:45:57.163263+0000","last_became_peered":"2024-04-26T10:45:57.163263+0000","last_unstale":"2024-04-26T10:46:11.914773+0000","last_undegraded":"2024-04-26T10:46:11.914773+0000","last_fullsized":"2024-04-26T10:46:11.914773+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'415","last_scrub_stamp":"2024-04-26T10:46:11.914637+0000","last_deep_scrub":"63'415","last_deep_scrub_stamp":"2024-04-26T10:46:11.914637+0000","last_clean_scrub_stamp":"2024-04-26T10:46:11.914637+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:19.456262+0000","scrub_duration":0.0026733759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15757,"num_write":380,"num_write_kb":54727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"62'342","reported_seq":450,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:06.972475+0000","last_change":"2024-04-26T10:45:48.866915+0000","last_active":"2024-04-26T10:46:06.972475+0000","last_peered":"2024-04-26T10:46:06.972475+0000","last_clean":"2024-04-26T10:46:06.972475+0000","last_became_active":"2024-04-26T10:45:48.866497+0000","last_became_peered":"2024-04-26T10:45:48.866497+0000","last_unstale":"2024-04-26T10:46:06.972475+0000","last_undegraded":"2024-04-26T10:46:06.972475+0000","last_fullsized":"2024-04-26T10:46:06.972475+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"63'481","reported_seq":672,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:06.972785+0000","last_change":"2024-04-26T10:45:54.184646+0000","last_active":"2024-04-26T10:46:06.972785+0000","last_peered":"2024-04-26T10:46:06.972785+0000","last_clean":"2024-04-26T10:46:06.972785+0000","last_became_active":"2024-04-26T10:45:54.181993+0000","last_became_peered":"2024-04-26T10:45:54.181993+0000","last_unstale":"2024-04-26T10:46:06.972785+0000","last_undegraded":"2024-04-26T10:46:06.972785+0000","last_fullsized":"2024-04-26T10:46:06.972785+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":45251,"num_write":451,"num_write_kb":105365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"84'462","reported_seq":555,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:40.432545+0000","last_change":"2024-04-26T10:46:40.432691+0000","last_active":"2024-04-26T10:46:40.432545+0000","last_peered":"2024-04-26T10:46:40.432545+0000","last_clean":"2024-04-26T10:46:40.432545+0000","last_became_active":"2024-04-26T10:45:48.865520+0000","last_became_peered":"2024-04-26T10:45:48.865520+0000","last_unstale":"2024-04-26T10:46:40.432545+0000","last_undegraded":"2024-04-26T10:46:40.432545+0000","last_fullsized":"2024-04-26T10:46:40.432545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'462","last_scrub_stamp":"2024-04-26T10:46:40.432509+0000","last_deep_scrub":"84'462","last_deep_scrub_stamp":"2024-04-26T10:46:40.432509+0000","last_clean_scrub_stamp":"2024-04-26T10:46:40.432509+0000","objects_scrubbed":2,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:15.817808+0000","scrub_duration":0.010610122,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":407,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'420","reported_seq":504,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161880+0000","last_change":"2024-04-26T10:45:57.165390+0000","last_active":"2024-04-26T10:45:58.161880+0000","last_peered":"2024-04-26T10:45:58.161880+0000","last_clean":"2024-04-26T10:45:58.161880+0000","last_became_active":"2024-04-26T10:45:57.162014+0000","last_became_peered":"2024-04-26T10:45:57.162014+0000","last_unstale":"2024-04-26T10:45:58.161880+0000","last_undegraded":"2024-04-26T10:45:58.161880+0000","last_fullsized":"2024-04-26T10:45:58.161880+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13025,"num_write":385,"num_write_kb":38595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"62'67","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:51.506238+0000","last_change":"2024-04-26T10:46:51.506347+0000","last_active":"2024-04-26T10:46:51.506238+0000","last_peered":"2024-04-26T10:46:51.506238+0000","last_clean":"2024-04-26T10:46:51.506238+0000","last_became_active":"2024-04-26T10:45:45.860175+0000","last_became_peered":"2024-04-26T10:45:45.860175+0000","last_unstale":"2024-04-26T10:46:51.506238+0000","last_undegraded":"2024-04-26T10:46:51.506238+0000","last_fullsized":"2024-04-26T10:46:51.506238+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'67","last_scrub_stamp":"2024-04-26T10:46:51.506217+0000","last_deep_scrub":"62'67","last_deep_scrub_stamp":"2024-04-26T10:46:51.506217+0000","last_clean_scrub_stamp":"2024-04-26T10:46:51.506217+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:02.699431+0000","scrub_duration":0.0015865510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"63'452","reported_seq":966,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:59.681950+0000","last_change":"2024-04-26T10:45:58.166413+0000","last_active":"2024-04-26T10:45:59.681950+0000","last_peered":"2024-04-26T10:45:59.681950+0000","last_clean":"2024-04-26T10:45:59.681950+0000","last_became_active":"2024-04-26T10:45:58.164105+0000","last_became_peered":"2024-04-26T10:45:58.164105+0000","last_unstale":"2024-04-26T10:45:59.681950+0000","last_undegraded":"2024-04-26T10:45:59.681950+0000","last_fullsized":"2024-04-26T10:45:59.681950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23217,"num_write":416,"num_write_kb":71418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":388,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"62'200","reported_seq":278,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159939+0000","last_change":"2024-04-26T10:45:56.160957+0000","last_active":"2024-04-26T10:45:58.159939+0000","last_peered":"2024-04-26T10:45:58.159939+0000","last_clean":"2024-04-26T10:45:58.159939+0000","last_became_active":"2024-04-26T10:45:56.160475+0000","last_became_peered":"2024-04-26T10:45:56.160475+0000","last_unstale":"2024-04-26T10:45:58.159939+0000","last_undegraded":"2024-04-26T10:45:58.159939+0000","last_fullsized":"2024-04-26T10:45:58.159939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'430","reported_seq":513,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162319+0000","last_change":"2024-04-26T10:45:57.164742+0000","last_active":"2024-04-26T10:45:58.162319+0000","last_peered":"2024-04-26T10:45:58.162319+0000","last_clean":"2024-04-26T10:45:58.162319+0000","last_became_active":"2024-04-26T10:45:57.162070+0000","last_became_peered":"2024-04-26T10:45:57.162070+0000","last_unstale":"2024-04-26T10:45:58.162319+0000","last_undegraded":"2024-04-26T10:45:58.162319+0000","last_fullsized":"2024-04-26T10:45:58.162319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":24352,"num_write":392,"num_write_kb":21976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"62'233","reported_seq":307,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161329+0000","last_change":"2024-04-26T10:45:48.862856+0000","last_active":"2024-04-26T10:45:58.161329+0000","last_peered":"2024-04-26T10:45:58.161329+0000","last_clean":"2024-04-26T10:45:58.161329+0000","last_became_active":"2024-04-26T10:45:48.862517+0000","last_became_peered":"2024-04-26T10:45:48.862517+0000","last_unstale":"2024-04-26T10:45:58.161329+0000","last_undegraded":"2024-04-26T10:45:58.161329+0000","last_fullsized":"2024-04-26T10:45:58.161329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"63'393","reported_seq":490,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:01.534168+0000","last_change":"2024-04-26T10:47:01.534285+0000","last_active":"2024-04-26T10:47:01.534168+0000","last_peered":"2024-04-26T10:47:01.534168+0000","last_clean":"2024-04-26T10:47:01.534168+0000","last_became_active":"2024-04-26T10:45:55.177758+0000","last_became_peered":"2024-04-26T10:45:55.177758+0000","last_unstale":"2024-04-26T10:47:01.534168+0000","last_undegraded":"2024-04-26T10:47:01.534168+0000","last_fullsized":"2024-04-26T10:47:01.534168+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'393","last_scrub_stamp":"2024-04-26T10:47:01.534143+0000","last_deep_scrub":"63'393","last_deep_scrub_stamp":"2024-04-26T10:47:01.534143+0000","last_clean_scrub_stamp":"2024-04-26T10:47:01.534143+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:15.470762+0000","scrub_duration":0.0026004790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8671,"num_write":368,"num_write_kb":38542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"62'49","reported_seq":156,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:02.831959+0000","last_change":"2024-04-26T10:47:02.832067+0000","last_active":"2024-04-26T10:47:02.831959+0000","last_peered":"2024-04-26T10:47:02.831959+0000","last_clean":"2024-04-26T10:47:02.831959+0000","last_became_active":"2024-04-26T10:45:45.874328+0000","last_became_peered":"2024-04-26T10:45:45.874328+0000","last_unstale":"2024-04-26T10:47:02.831959+0000","last_undegraded":"2024-04-26T10:47:02.831959+0000","last_fullsized":"2024-04-26T10:47:02.831959+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'49","last_scrub_stamp":"2024-04-26T10:47:02.831935+0000","last_deep_scrub":"62'49","last_deep_scrub_stamp":"2024-04-26T10:47:02.831935+0000","last_clean_scrub_stamp":"2024-04-26T10:47:02.831935+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:21.771123+0000","scrub_duration":0.0016852690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"63'368","reported_seq":475,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:49.494381+0000","last_change":"2024-04-26T10:46:49.494481+0000","last_active":"2024-04-26T10:46:49.494381+0000","last_peered":"2024-04-26T10:46:49.494381+0000","last_clean":"2024-04-26T10:46:49.494381+0000","last_became_active":"2024-04-26T10:45:56.163456+0000","last_became_peered":"2024-04-26T10:45:56.163456+0000","last_unstale":"2024-04-26T10:46:49.494381+0000","last_undegraded":"2024-04-26T10:46:49.494381+0000","last_fullsized":"2024-04-26T10:46:49.494381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'368","last_scrub_stamp":"2024-04-26T10:46:49.494360+0000","last_deep_scrub":"63'368","last_deep_scrub_stamp":"2024-04-26T10:46:49.494360+0000","last_clean_scrub_stamp":"2024-04-26T10:46:49.494360+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:27.081977+0000","scrub_duration":0.0025223229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":19222,"num_write":336,"num_write_kb":58903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"62'619","reported_seq":749,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:06.972470+0000","last_change":"2024-04-26T10:45:56.162511+0000","last_active":"2024-04-26T10:46:06.972470+0000","last_peered":"2024-04-26T10:46:06.972470+0000","last_clean":"2024-04-26T10:46:06.972470+0000","last_became_active":"2024-04-26T10:45:56.161604+0000","last_became_peered":"2024-04-26T10:45:56.161604+0000","last_unstale":"2024-04-26T10:46:06.972470+0000","last_undegraded":"2024-04-26T10:46:06.972470+0000","last_fullsized":"2024-04-26T10:46:06.972470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":558,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"63'383","reported_seq":823,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:59.682112+0000","last_change":"2024-04-26T10:45:58.165237+0000","last_active":"2024-04-26T10:45:59.682112+0000","last_peered":"2024-04-26T10:45:59.682112+0000","last_clean":"2024-04-26T10:45:59.682112+0000","last_became_active":"2024-04-26T10:45:58.162264+0000","last_became_peered":"2024-04-26T10:45:58.162264+0000","last_unstale":"2024-04-26T10:45:59.682112+0000","last_undegraded":"2024-04-26T10:45:59.682112+0000","last_fullsized":"2024-04-26T10:45:59.682112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":14260,"num_write":349,"num_write_kb":50367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":230,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161343+0000","last_change":"2024-04-26T10:45:45.871511+0000","last_active":"2024-04-26T10:45:58.161343+0000","last_peered":"2024-04-26T10:45:58.161343+0000","last_clean":"2024-04-26T10:45:58.161343+0000","last_became_active":"2024-04-26T10:45:45.871155+0000","last_became_peered":"2024-04-26T10:45:45.871155+0000","last_unstale":"2024-04-26T10:45:58.161343+0000","last_undegraded":"2024-04-26T10:45:58.161343+0000","last_fullsized":"2024-04-26T10:45:58.161343+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161402+0000","last_change":"2024-04-26T10:45:45.861068+0000","last_active":"2024-04-26T10:45:58.161402+0000","last_peered":"2024-04-26T10:45:58.161402+0000","last_clean":"2024-04-26T10:45:58.161402+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:58.161402+0000","last_undegraded":"2024-04-26T10:45:58.161402+0000","last_fullsized":"2024-04-26T10:45:58.161402+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"62'743","reported_seq":826,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:07.857524+0000","last_change":"2024-04-26T10:42:25.686765+0000","last_active":"2024-04-26T10:46:07.857524+0000","last_peered":"2024-04-26T10:46:07.857524+0000","last_clean":"2024-04-26T10:46:07.857524+0000","last_became_active":"2024-04-26T10:42:25.686009+0000","last_became_peered":"2024-04-26T10:42:25.686009+0000","last_unstale":"2024-04-26T10:46:07.857524+0000","last_undegraded":"2024-04-26T10:46:07.857524+0000","last_fullsized":"2024-04-26T10:46:07.857524+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'442","reported_seq":579,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:48.508835+0000","last_change":"2024-04-26T10:46:48.508984+0000","last_active":"2024-04-26T10:46:48.508835+0000","last_peered":"2024-04-26T10:46:48.508835+0000","last_clean":"2024-04-26T10:46:48.508835+0000","last_became_active":"2024-04-26T10:45:55.177751+0000","last_became_peered":"2024-04-26T10:45:55.177751+0000","last_unstale":"2024-04-26T10:46:48.508835+0000","last_undegraded":"2024-04-26T10:46:48.508835+0000","last_fullsized":"2024-04-26T10:46:48.508835+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'442","last_scrub_stamp":"2024-04-26T10:46:48.508814+0000","last_deep_scrub":"63'442","last_deep_scrub_stamp":"2024-04-26T10:46:48.508814+0000","last_clean_scrub_stamp":"2024-04-26T10:46:48.508814+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:00.772322+0000","scrub_duration":0.0025059779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":34346,"num_write":406,"num_write_kb":96298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:59.508478+0000","last_change":"2024-04-26T10:46:59.508611+0000","last_active":"2024-04-26T10:46:59.508478+0000","last_peered":"2024-04-26T10:46:59.508478+0000","last_clean":"2024-04-26T10:46:59.508478+0000","last_became_active":"2024-04-26T10:45:45.871741+0000","last_became_peered":"2024-04-26T10:45:45.871741+0000","last_unstale":"2024-04-26T10:46:59.508478+0000","last_undegraded":"2024-04-26T10:46:59.508478+0000","last_fullsized":"2024-04-26T10:46:59.508478+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:46:59.508440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:46:59.508440+0000","last_clean_scrub_stamp":"2024-04-26T10:46:59.508440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:10.498353+0000","scrub_duration":0.0018823100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"63'102","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159454+0000","last_change":"2024-04-26T10:45:56.160802+0000","last_active":"2024-04-26T10:45:58.159454+0000","last_peered":"2024-04-26T10:45:58.159454+0000","last_clean":"2024-04-26T10:45:58.159454+0000","last_became_active":"2024-04-26T10:45:56.160328+0000","last_became_peered":"2024-04-26T10:45:56.160328+0000","last_unstale":"2024-04-26T10:45:58.159454+0000","last_undegraded":"2024-04-26T10:45:58.159454+0000","last_fullsized":"2024-04-26T10:45:58.159454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467631,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":44,"num_write_kb":1460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2935262,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'485","reported_seq":621,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.876202+0000","last_change":"2024-04-26T10:45:57.165815+0000","last_active":"2024-04-26T10:45:58.876202+0000","last_peered":"2024-04-26T10:45:58.876202+0000","last_clean":"2024-04-26T10:45:58.876202+0000","last_became_active":"2024-04-26T10:45:57.162752+0000","last_became_peered":"2024-04-26T10:45:57.162752+0000","last_unstale":"2024-04-26T10:45:58.876202+0000","last_undegraded":"2024-04-26T10:45:58.876202+0000","last_fullsized":"2024-04-26T10:45:58.876202+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27703,"num_write":454,"num_write_kb":121509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:48.199178+0000","last_change":"2024-04-26T10:46:48.199307+0000","last_active":"2024-04-26T10:46:48.199178+0000","last_peered":"2024-04-26T10:46:48.199178+0000","last_clean":"2024-04-26T10:46:48.199178+0000","last_became_active":"2024-04-26T10:45:53.180675+0000","last_became_peered":"2024-04-26T10:45:53.180675+0000","last_unstale":"2024-04-26T10:46:48.199178+0000","last_undegraded":"2024-04-26T10:46:48.199178+0000","last_fullsized":"2024-04-26T10:46:48.199178+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:46:48.199158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:46:48.199158+0000","last_clean_scrub_stamp":"2024-04-26T10:46:48.199158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:51:28.631493+0000","scrub_duration":0.0016680530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"84'308","reported_seq":428,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:59.784023+0000","last_change":"2024-04-26T10:46:59.784129+0000","last_active":"2024-04-26T10:46:59.784023+0000","last_peered":"2024-04-26T10:46:59.784023+0000","last_clean":"2024-04-26T10:46:59.784023+0000","last_became_active":"2024-04-26T10:45:48.864763+0000","last_became_peered":"2024-04-26T10:45:48.864763+0000","last_unstale":"2024-04-26T10:46:59.784023+0000","last_undegraded":"2024-04-26T10:46:59.784023+0000","last_fullsized":"2024-04-26T10:46:59.784023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'308","last_scrub_stamp":"2024-04-26T10:46:59.784001+0000","last_deep_scrub":"84'308","last_deep_scrub_stamp":"2024-04-26T10:46:59.784001+0000","last_clean_scrub_stamp":"2024-04-26T10:46:59.784001+0000","objects_scrubbed":2,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:33.251239+0000","scrub_duration":0.014317998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"63'336","reported_seq":749,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:59.682135+0000","last_change":"2024-04-26T10:45:58.165267+0000","last_active":"2024-04-26T10:45:59.682135+0000","last_peered":"2024-04-26T10:45:59.682135+0000","last_clean":"2024-04-26T10:45:59.682135+0000","last_became_active":"2024-04-26T10:45:58.162320+0000","last_became_peered":"2024-04-26T10:45:58.162320+0000","last_unstale":"2024-04-26T10:45:59.682135+0000","last_undegraded":"2024-04-26T10:45:59.682135+0000","last_fullsized":"2024-04-26T10:45:59.682135+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12035,"num_write":314,"num_write_kb":29928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":306,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161152+0000","last_change":"2024-04-26T10:45:45.861233+0000","last_active":"2024-04-26T10:45:58.161152+0000","last_peered":"2024-04-26T10:45:58.161152+0000","last_clean":"2024-04-26T10:45:58.161152+0000","last_became_active":"2024-04-26T10:45:45.860924+0000","last_became_peered":"2024-04-26T10:45:45.860924+0000","last_unstale":"2024-04-26T10:45:58.161152+0000","last_undegraded":"2024-04-26T10:45:58.161152+0000","last_fullsized":"2024-04-26T10:45:58.161152+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"62'64","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161518+0000","last_change":"2024-04-26T10:45:45.861230+0000","last_active":"2024-04-26T10:45:58.161518+0000","last_peered":"2024-04-26T10:45:58.161518+0000","last_clean":"2024-04-26T10:45:58.161518+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:58.161518+0000","last_undegraded":"2024-04-26T10:45:58.161518+0000","last_fullsized":"2024-04-26T10:45:58.161518+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"63'421","reported_seq":514,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160380+0000","last_change":"2024-04-26T10:45:54.188138+0000","last_active":"2024-04-26T10:45:58.160380+0000","last_peered":"2024-04-26T10:45:58.160380+0000","last_clean":"2024-04-26T10:45:58.160380+0000","last_became_active":"2024-04-26T10:45:54.185053+0000","last_became_peered":"2024-04-26T10:45:54.185053+0000","last_unstale":"2024-04-26T10:45:58.160380+0000","last_undegraded":"2024-04-26T10:45:58.160380+0000","last_fullsized":"2024-04-26T10:45:58.160380+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28557,"num_write":385,"num_write_kb":93083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"62'480","reported_seq":554,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161962+0000","last_change":"2024-04-26T10:45:48.862894+0000","last_active":"2024-04-26T10:45:58.161962+0000","last_peered":"2024-04-26T10:45:58.161962+0000","last_clean":"2024-04-26T10:45:58.161962+0000","last_became_active":"2024-04-26T10:45:48.862564+0000","last_became_peered":"2024-04-26T10:45:48.862564+0000","last_unstale":"2024-04-26T10:45:58.161962+0000","last_undegraded":"2024-04-26T10:45:58.161962+0000","last_fullsized":"2024-04-26T10:45:58.161962+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":86,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:07.857422+0000","last_change":"2024-04-26T10:42:21.405754+0000","last_active":"2024-04-26T10:46:07.857422+0000","last_peered":"2024-04-26T10:46:07.857422+0000","last_clean":"2024-04-26T10:46:07.857422+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:46:07.857422+0000","last_undegraded":"2024-04-26T10:46:07.857422+0000","last_fullsized":"2024-04-26T10:46:07.857422+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'352","reported_seq":778,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:06.972664+0000","last_change":"2024-04-26T10:45:53.183401+0000","last_active":"2024-04-26T10:46:06.972664+0000","last_peered":"2024-04-26T10:46:06.972664+0000","last_clean":"2024-04-26T10:46:06.972664+0000","last_became_active":"2024-04-26T10:45:53.182454+0000","last_became_peered":"2024-04-26T10:45:53.182454+0000","last_unstale":"2024-04-26T10:46:06.972664+0000","last_undegraded":"2024-04-26T10:46:06.972664+0000","last_fullsized":"2024-04-26T10:46:06.972664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":1905,"num_write":313,"num_write_kb":25573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"62'59","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:32.065405+0000","last_change":"2024-04-26T10:46:32.065523+0000","last_active":"2024-04-26T10:46:32.065405+0000","last_peered":"2024-04-26T10:46:32.065405+0000","last_clean":"2024-04-26T10:46:32.065405+0000","last_became_active":"2024-04-26T10:45:53.176996+0000","last_became_peered":"2024-04-26T10:45:53.176996+0000","last_unstale":"2024-04-26T10:46:32.065405+0000","last_undegraded":"2024-04-26T10:46:32.065405+0000","last_fullsized":"2024-04-26T10:46:32.065405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'59","last_scrub_stamp":"2024-04-26T10:46:32.065382+0000","last_deep_scrub":"62'59","last_deep_scrub_stamp":"2024-04-26T10:46:32.065382+0000","last_clean_scrub_stamp":"2024-04-26T10:46:32.065382+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:26.427635+0000","scrub_duration":0.0016833690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":89,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162375+0000","last_change":"2024-04-26T10:45:53.175046+0000","last_active":"2024-04-26T10:45:58.162375+0000","last_peered":"2024-04-26T10:45:58.162375+0000","last_clean":"2024-04-26T10:45:58.162375+0000","last_became_active":"2024-04-26T10:45:53.174781+0000","last_became_peered":"2024-04-26T10:45:53.174781+0000","last_unstale":"2024-04-26T10:45:58.162375+0000","last_undegraded":"2024-04-26T10:45:58.162375+0000","last_fullsized":"2024-04-26T10:45:58.162375+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'408","reported_seq":920,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:31.846626+0000","last_change":"2024-04-26T10:46:31.846626+0000","last_active":"2024-04-26T10:46:31.846626+0000","last_peered":"2024-04-26T10:46:31.846626+0000","last_clean":"2024-04-26T10:46:31.846626+0000","last_became_active":"2024-04-26T10:45:54.185238+0000","last_became_peered":"2024-04-26T10:45:54.185238+0000","last_unstale":"2024-04-26T10:46:31.846626+0000","last_undegraded":"2024-04-26T10:46:31.846626+0000","last_fullsized":"2024-04-26T10:46:31.846626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:31.846485+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:31.846485+0000","last_clean_scrub_stamp":"2024-04-26T10:46:31.846485+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:36.109042+0000","scrub_duration":0.0024474840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19939,"num_write":382,"num_write_kb":63433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"84'56","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:43.249487+0000","last_change":"2024-04-26T10:46:43.249602+0000","last_active":"2024-04-26T10:46:43.249487+0000","last_peered":"2024-04-26T10:46:43.249487+0000","last_clean":"2024-04-26T10:46:43.249487+0000","last_became_active":"2024-04-26T10:45:53.177305+0000","last_became_peered":"2024-04-26T10:45:53.177305+0000","last_unstale":"2024-04-26T10:46:43.249487+0000","last_undegraded":"2024-04-26T10:46:43.249487+0000","last_fullsized":"2024-04-26T10:46:43.249487+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'56","last_scrub_stamp":"2024-04-26T10:46:43.249467+0000","last_deep_scrub":"84'56","last_deep_scrub_stamp":"2024-04-26T10:46:43.249467+0000","last_clean_scrub_stamp":"2024-04-26T10:46:43.249467+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:52.720824+0000","scrub_duration":0.0031266789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:38.180460+0000","last_change":"2024-04-26T10:46:38.180572+0000","last_active":"2024-04-26T10:46:38.180460+0000","last_peered":"2024-04-26T10:46:38.180460+0000","last_clean":"2024-04-26T10:46:38.180460+0000","last_became_active":"2024-04-26T10:45:53.177249+0000","last_became_peered":"2024-04-26T10:45:53.177249+0000","last_unstale":"2024-04-26T10:46:38.180460+0000","last_undegraded":"2024-04-26T10:46:38.180460+0000","last_fullsized":"2024-04-26T10:46:38.180460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:46:38.180438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:46:38.180438+0000","last_clean_scrub_stamp":"2024-04-26T10:46:38.180438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:09.067544+0000","scrub_duration":0.00179721,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'418","reported_seq":889,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:04.180135+0000","last_change":"2024-04-26T10:47:04.180286+0000","last_active":"2024-04-26T10:47:04.180135+0000","last_peered":"2024-04-26T10:47:04.180135+0000","last_clean":"2024-04-26T10:47:04.180135+0000","last_became_active":"2024-04-26T10:45:56.160440+0000","last_became_peered":"2024-04-26T10:45:56.160440+0000","last_unstale":"2024-04-26T10:47:04.180135+0000","last_undegraded":"2024-04-26T10:47:04.180135+0000","last_fullsized":"2024-04-26T10:47:04.180135+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'418","last_scrub_stamp":"2024-04-26T10:47:04.180097+0000","last_deep_scrub":"63'418","last_deep_scrub_stamp":"2024-04-26T10:47:04.180097+0000","last_clean_scrub_stamp":"2024-04-26T10:47:04.180097+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:48.800820+0000","scrub_duration":0.0025539730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20110,"num_write":390,"num_write_kb":75171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"84'67","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:20.114106+0000","last_change":"2024-04-26T10:46:20.114217+0000","last_active":"2024-04-26T10:46:20.114106+0000","last_peered":"2024-04-26T10:46:20.114106+0000","last_clean":"2024-04-26T10:46:20.114106+0000","last_became_active":"2024-04-26T10:45:53.175946+0000","last_became_peered":"2024-04-26T10:45:53.175946+0000","last_unstale":"2024-04-26T10:46:20.114106+0000","last_undegraded":"2024-04-26T10:46:20.114106+0000","last_fullsized":"2024-04-26T10:46:20.114106+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'67","last_scrub_stamp":"2024-04-26T10:46:20.114082+0000","last_deep_scrub":"84'67","last_deep_scrub_stamp":"2024-04-26T10:46:20.114082+0000","last_clean_scrub_stamp":"2024-04-26T10:46:20.114082+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:16.069289+0000","scrub_duration":0.00304288,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162589+0000","last_change":"2024-04-26T10:45:45.872224+0000","last_active":"2024-04-26T10:45:58.162589+0000","last_peered":"2024-04-26T10:45:58.162589+0000","last_clean":"2024-04-26T10:45:58.162589+0000","last_became_active":"2024-04-26T10:45:45.871923+0000","last_became_peered":"2024-04-26T10:45:45.871923+0000","last_unstale":"2024-04-26T10:45:58.162589+0000","last_undegraded":"2024-04-26T10:45:58.162589+0000","last_fullsized":"2024-04-26T10:45:58.162589+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"63'404","reported_seq":934,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:27.939150+0000","last_change":"2024-04-26T10:46:27.939150+0000","last_active":"2024-04-26T10:46:27.939150+0000","last_peered":"2024-04-26T10:46:27.939150+0000","last_clean":"2024-04-26T10:46:27.939150+0000","last_became_active":"2024-04-26T10:45:54.181795+0000","last_became_peered":"2024-04-26T10:45:54.181795+0000","last_unstale":"2024-04-26T10:46:27.939150+0000","last_undegraded":"2024-04-26T10:46:27.939150+0000","last_fullsized":"2024-04-26T10:46:27.939150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'404","last_scrub_stamp":"2024-04-26T10:46:27.939009+0000","last_deep_scrub":"63'404","last_deep_scrub_stamp":"2024-04-26T10:46:27.939009+0000","last_clean_scrub_stamp":"2024-04-26T10:46:27.939009+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:43.424977+0000","scrub_duration":0.0025994030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41262,"num_write":371,"num_write_kb":75820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"63'441","reported_seq":565,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161758+0000","last_change":"2024-04-26T10:45:54.188488+0000","last_active":"2024-04-26T10:45:58.161758+0000","last_peered":"2024-04-26T10:45:58.161758+0000","last_clean":"2024-04-26T10:45:58.161758+0000","last_became_active":"2024-04-26T10:45:54.185862+0000","last_became_peered":"2024-04-26T10:45:54.185862+0000","last_unstale":"2024-04-26T10:45:58.161758+0000","last_undegraded":"2024-04-26T10:45:58.161758+0000","last_fullsized":"2024-04-26T10:45:58.161758+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31514,"num_write":408,"num_write_kb":107129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"64'431","reported_seq":521,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161811+0000","last_change":"2024-04-26T10:45:48.865579+0000","last_active":"2024-04-26T10:45:58.161811+0000","last_peered":"2024-04-26T10:45:58.161811+0000","last_clean":"2024-04-26T10:45:58.161811+0000","last_became_active":"2024-04-26T10:45:48.865212+0000","last_became_peered":"2024-04-26T10:45:48.865212+0000","last_unstale":"2024-04-26T10:45:58.161811+0000","last_undegraded":"2024-04-26T10:45:58.161811+0000","last_fullsized":"2024-04-26T10:45:58.161811+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9902610,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":9913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9896193,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"63'410","reported_seq":516,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161317+0000","last_change":"2024-04-26T10:45:54.184713+0000","last_active":"2024-04-26T10:45:58.161317+0000","last_peered":"2024-04-26T10:45:58.161317+0000","last_clean":"2024-04-26T10:45:58.161317+0000","last_became_active":"2024-04-26T10:45:54.182167+0000","last_became_peered":"2024-04-26T10:45:54.182167+0000","last_unstale":"2024-04-26T10:45:58.161317+0000","last_undegraded":"2024-04-26T10:45:58.161317+0000","last_fullsized":"2024-04-26T10:45:58.161317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12734,"num_write":373,"num_write_kb":34864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"84'86","reported_seq":197,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:03.870934+0000","last_change":"2024-04-26T10:47:03.871072+0000","last_active":"2024-04-26T10:47:03.870934+0000","last_peered":"2024-04-26T10:47:03.870934+0000","last_clean":"2024-04-26T10:47:03.870934+0000","last_became_active":"2024-04-26T10:45:45.874746+0000","last_became_peered":"2024-04-26T10:45:45.874746+0000","last_unstale":"2024-04-26T10:47:03.870934+0000","last_undegraded":"2024-04-26T10:47:03.870934+0000","last_fullsized":"2024-04-26T10:47:03.870934+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'86","last_scrub_stamp":"2024-04-26T10:47:03.870909+0000","last_deep_scrub":"84'86","last_deep_scrub_stamp":"2024-04-26T10:47:03.870909+0000","last_clean_scrub_stamp":"2024-04-26T10:47:03.870909+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:03:47.013205+0000","scrub_duration":0.0039681769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"84'333","reported_seq":432,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:14.252839+0000","last_change":"2024-04-26T10:46:14.252936+0000","last_active":"2024-04-26T10:46:14.252839+0000","last_peered":"2024-04-26T10:46:14.252839+0000","last_clean":"2024-04-26T10:46:14.252839+0000","last_became_active":"2024-04-26T10:45:56.161449+0000","last_became_peered":"2024-04-26T10:45:56.161449+0000","last_unstale":"2024-04-26T10:46:14.252839+0000","last_undegraded":"2024-04-26T10:46:14.252839+0000","last_fullsized":"2024-04-26T10:46:14.252839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'333","last_scrub_stamp":"2024-04-26T10:46:14.252815+0000","last_deep_scrub":"84'333","last_deep_scrub_stamp":"2024-04-26T10:46:14.252815+0000","last_clean_scrub_stamp":"2024-04-26T10:46:14.252815+0000","objects_scrubbed":1,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:06.020647+0000","scrub_duration":0.0087233659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"63'487","reported_seq":1097,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159640+0000","last_change":"2024-04-26T10:45:51.160586+0000","last_active":"2024-04-26T10:45:58.159640+0000","last_peered":"2024-04-26T10:45:58.159640+0000","last_clean":"2024-04-26T10:45:58.159640+0000","last_became_active":"2024-04-26T10:45:51.159235+0000","last_became_peered":"2024-04-26T10:45:51.159235+0000","last_unstale":"2024-04-26T10:45:58.159640+0000","last_undegraded":"2024-04-26T10:45:58.159640+0000","last_fullsized":"2024-04-26T10:45:58.159640+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":43316,"num_write":468,"num_write_kb":77062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"62'61","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:11.105029+0000","last_change":"2024-04-26T10:46:11.105133+0000","last_active":"2024-04-26T10:46:11.105029+0000","last_peered":"2024-04-26T10:46:11.105029+0000","last_clean":"2024-04-26T10:46:11.105029+0000","last_became_active":"2024-04-26T10:45:53.173851+0000","last_became_peered":"2024-04-26T10:45:53.173851+0000","last_unstale":"2024-04-26T10:46:11.105029+0000","last_undegraded":"2024-04-26T10:46:11.105029+0000","last_fullsized":"2024-04-26T10:46:11.105029+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'61","last_scrub_stamp":"2024-04-26T10:46:11.105005+0000","last_deep_scrub":"62'61","last_deep_scrub_stamp":"2024-04-26T10:46:11.105005+0000","last_clean_scrub_stamp":"2024-04-26T10:46:11.105005+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:57.257799+0000","scrub_duration":0.0016999000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'457","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:47.223896+0000","last_change":"2024-04-26T10:46:47.224014+0000","last_active":"2024-04-26T10:46:47.223896+0000","last_peered":"2024-04-26T10:46:47.223896+0000","last_clean":"2024-04-26T10:46:47.223896+0000","last_became_active":"2024-04-26T10:45:54.189622+0000","last_became_peered":"2024-04-26T10:45:54.189622+0000","last_unstale":"2024-04-26T10:46:47.223896+0000","last_undegraded":"2024-04-26T10:46:47.223896+0000","last_fullsized":"2024-04-26T10:46:47.223896+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'457","last_scrub_stamp":"2024-04-26T10:46:47.223873+0000","last_deep_scrub":"63'457","last_deep_scrub_stamp":"2024-04-26T10:46:47.223873+0000","last_clean_scrub_stamp":"2024-04-26T10:46:47.223873+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:53:33.293955+0000","scrub_duration":0.003282943,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14848,"num_write":427,"num_write_kb":71903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'377","reported_seq":851,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:29.894860+0000","last_change":"2024-04-26T10:46:29.894860+0000","last_active":"2024-04-26T10:46:29.894860+0000","last_peered":"2024-04-26T10:46:29.894860+0000","last_clean":"2024-04-26T10:46:29.894860+0000","last_became_active":"2024-04-26T10:45:49.866707+0000","last_became_peered":"2024-04-26T10:45:49.866707+0000","last_unstale":"2024-04-26T10:46:29.894860+0000","last_undegraded":"2024-04-26T10:46:29.894860+0000","last_fullsized":"2024-04-26T10:46:29.894860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'377","last_scrub_stamp":"2024-04-26T10:46:29.894727+0000","last_deep_scrub":"63'377","last_deep_scrub_stamp":"2024-04-26T10:46:29.894727+0000","last_clean_scrub_stamp":"2024-04-26T10:46:29.894727+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:20.517004+0000","scrub_duration":0.0019921740000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26932,"num_write":349,"num_write_kb":55611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"62'562","reported_seq":644,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159809+0000","last_change":"2024-04-26T10:42:25.683890+0000","last_active":"2024-04-26T10:45:58.159809+0000","last_peered":"2024-04-26T10:45:58.159809+0000","last_clean":"2024-04-26T10:45:58.159809+0000","last_became_active":"2024-04-26T10:42:25.683467+0000","last_became_peered":"2024-04-26T10:42:25.683467+0000","last_unstale":"2024-04-26T10:45:58.159809+0000","last_undegraded":"2024-04-26T10:45:58.159809+0000","last_fullsized":"2024-04-26T10:45:58.159809+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":8440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'425","reported_seq":879,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160491+0000","last_change":"2024-04-26T10:45:56.163245+0000","last_active":"2024-04-26T10:45:58.160491+0000","last_peered":"2024-04-26T10:45:58.160491+0000","last_clean":"2024-04-26T10:45:58.160491+0000","last_became_active":"2024-04-26T10:45:56.161315+0000","last_became_peered":"2024-04-26T10:45:56.161315+0000","last_unstale":"2024-04-26T10:45:58.160491+0000","last_undegraded":"2024-04-26T10:45:58.160491+0000","last_fullsized":"2024-04-26T10:45:58.160491+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":19004,"num_write":390,"num_write_kb":75524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"62'259","reported_seq":332,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159752+0000","last_change":"2024-04-26T10:45:56.160840+0000","last_active":"2024-04-26T10:45:58.159752+0000","last_peered":"2024-04-26T10:45:58.159752+0000","last_clean":"2024-04-26T10:45:58.159752+0000","last_became_active":"2024-04-26T10:45:56.160344+0000","last_became_peered":"2024-04-26T10:45:56.160344+0000","last_unstale":"2024-04-26T10:45:58.159752+0000","last_undegraded":"2024-04-26T10:45:58.159752+0000","last_fullsized":"2024-04-26T10:45:58.159752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'418","reported_seq":941,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:41.880581+0000","last_change":"2024-04-26T10:46:41.881058+0000","last_active":"2024-04-26T10:46:41.880581+0000","last_peered":"2024-04-26T10:46:41.880581+0000","last_clean":"2024-04-26T10:46:41.880581+0000","last_became_active":"2024-04-26T10:45:55.178079+0000","last_became_peered":"2024-04-26T10:45:55.178079+0000","last_unstale":"2024-04-26T10:46:41.880581+0000","last_undegraded":"2024-04-26T10:46:41.880581+0000","last_fullsized":"2024-04-26T10:46:41.880581+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'418","last_scrub_stamp":"2024-04-26T10:46:41.880550+0000","last_deep_scrub":"63'418","last_deep_scrub_stamp":"2024-04-26T10:46:41.880550+0000","last_clean_scrub_stamp":"2024-04-26T10:46:41.880550+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:06:37.113070+0000","scrub_duration":0.0024544520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":34476,"num_write":379,"num_write_kb":101645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"62'494","reported_seq":576,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160169+0000","last_change":"2024-04-26T10:42:25.688221+0000","last_active":"2024-04-26T10:45:58.160169+0000","last_peered":"2024-04-26T10:45:58.160169+0000","last_clean":"2024-04-26T10:45:58.160169+0000","last_became_active":"2024-04-26T10:42:25.687829+0000","last_became_peered":"2024-04-26T10:42:25.687829+0000","last_unstale":"2024-04-26T10:45:58.160169+0000","last_undegraded":"2024-04-26T10:45:58.160169+0000","last_fullsized":"2024-04-26T10:45:58.160169+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":12543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"63'406","reported_seq":587,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160465+0000","last_change":"2024-04-26T10:45:54.192178+0000","last_active":"2024-04-26T10:45:58.160465+0000","last_peered":"2024-04-26T10:45:58.160465+0000","last_clean":"2024-04-26T10:45:58.160465+0000","last_became_active":"2024-04-26T10:45:54.189591+0000","last_became_peered":"2024-04-26T10:45:54.189591+0000","last_unstale":"2024-04-26T10:45:58.160465+0000","last_undegraded":"2024-04-26T10:45:58.160465+0000","last_fullsized":"2024-04-26T10:45:58.160465+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":45941,"num_write":372,"num_write_kb":80011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"62'61","reported_seq":161,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160605+0000","last_change":"2024-04-26T10:45:45.895125+0000","last_active":"2024-04-26T10:45:58.160605+0000","last_peered":"2024-04-26T10:45:58.160605+0000","last_clean":"2024-04-26T10:45:58.160605+0000","last_became_active":"2024-04-26T10:45:45.874300+0000","last_became_peered":"2024-04-26T10:45:45.874300+0000","last_unstale":"2024-04-26T10:45:58.160605+0000","last_undegraded":"2024-04-26T10:45:58.160605+0000","last_fullsized":"2024-04-26T10:45:58.160605+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"63'375","reported_seq":835,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:19.295162+0000","last_change":"2024-04-26T10:46:19.295289+0000","last_active":"2024-04-26T10:46:19.295162+0000","last_peered":"2024-04-26T10:46:19.295162+0000","last_clean":"2024-04-26T10:46:19.295162+0000","last_became_active":"2024-04-26T10:45:56.160416+0000","last_became_peered":"2024-04-26T10:45:56.160416+0000","last_unstale":"2024-04-26T10:46:19.295162+0000","last_undegraded":"2024-04-26T10:46:19.295162+0000","last_fullsized":"2024-04-26T10:46:19.295162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'375","last_scrub_stamp":"2024-04-26T10:46:19.295138+0000","last_deep_scrub":"63'375","last_deep_scrub_stamp":"2024-04-26T10:46:19.295138+0000","last_clean_scrub_stamp":"2024-04-26T10:46:19.295138+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:58.675348+0000","scrub_duration":0.0023697280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16213,"num_write":354,"num_write_kb":54493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":332,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"84'278","reported_seq":382,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:12.320143+0000","last_change":"2024-04-26T10:46:12.320242+0000","last_active":"2024-04-26T10:46:12.320143+0000","last_peered":"2024-04-26T10:46:12.320143+0000","last_clean":"2024-04-26T10:46:12.320143+0000","last_became_active":"2024-04-26T10:45:56.160414+0000","last_became_peered":"2024-04-26T10:45:56.160414+0000","last_unstale":"2024-04-26T10:46:12.320143+0000","last_undegraded":"2024-04-26T10:46:12.320143+0000","last_fullsized":"2024-04-26T10:46:12.320143+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'278","last_scrub_stamp":"2024-04-26T10:46:12.320120+0000","last_deep_scrub":"84'278","last_deep_scrub_stamp":"2024-04-26T10:46:12.320120+0000","last_clean_scrub_stamp":"2024-04-26T10:46:12.320120+0000","objects_scrubbed":2,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:17:48.308771+0000","scrub_duration":0.0082694940000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"63'379","reported_seq":476,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161505+0000","last_change":"2024-04-26T10:45:53.177365+0000","last_active":"2024-04-26T10:45:58.161505+0000","last_peered":"2024-04-26T10:45:58.161505+0000","last_clean":"2024-04-26T10:45:58.161505+0000","last_became_active":"2024-04-26T10:45:53.173645+0000","last_became_peered":"2024-04-26T10:45:53.173645+0000","last_unstale":"2024-04-26T10:45:58.161505+0000","last_undegraded":"2024-04-26T10:45:58.161505+0000","last_fullsized":"2024-04-26T10:45:58.161505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20480,"num_write":343,"num_write_kb":25788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"84'241","reported_seq":363,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:58.792941+0000","last_change":"2024-04-26T10:46:58.793068+0000","last_active":"2024-04-26T10:46:58.792941+0000","last_peered":"2024-04-26T10:46:58.792941+0000","last_clean":"2024-04-26T10:46:58.792941+0000","last_became_active":"2024-04-26T10:45:48.866716+0000","last_became_peered":"2024-04-26T10:45:48.866716+0000","last_unstale":"2024-04-26T10:46:58.792941+0000","last_undegraded":"2024-04-26T10:46:58.792941+0000","last_fullsized":"2024-04-26T10:46:58.792941+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'241","last_scrub_stamp":"2024-04-26T10:46:58.792919+0000","last_deep_scrub":"84'241","last_deep_scrub_stamp":"2024-04-26T10:46:58.792919+0000","last_clean_scrub_stamp":"2024-04-26T10:46:58.792919+0000","objects_scrubbed":4,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:35.543499+0000","scrub_duration":0.021440362000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":12393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"63'419","reported_seq":582,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:54.737588+0000","last_change":"2024-04-26T10:46:54.737707+0000","last_active":"2024-04-26T10:46:54.737588+0000","last_peered":"2024-04-26T10:46:54.737588+0000","last_clean":"2024-04-26T10:46:54.737588+0000","last_became_active":"2024-04-26T10:42:26.040504+0000","last_became_peered":"2024-04-26T10:42:26.040504+0000","last_unstale":"2024-04-26T10:46:54.737588+0000","last_undegraded":"2024-04-26T10:46:54.737588+0000","last_fullsized":"2024-04-26T10:46:54.737588+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'419","last_scrub_stamp":"2024-04-26T10:46:54.737548+0000","last_deep_scrub":"63'419","last_deep_scrub_stamp":"2024-04-26T10:46:54.737548+0000","last_clean_scrub_stamp":"2024-04-26T10:46:54.737548+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:36.073071+0000","scrub_duration":0.0037174790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39582,"num_write":378,"num_write_kb":54867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"84'62","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:09.103458+0000","last_change":"2024-04-26T10:46:09.103560+0000","last_active":"2024-04-26T10:46:09.103458+0000","last_peered":"2024-04-26T10:46:09.103458+0000","last_clean":"2024-04-26T10:46:09.103458+0000","last_became_active":"2024-04-26T10:45:53.178804+0000","last_became_peered":"2024-04-26T10:45:53.178804+0000","last_unstale":"2024-04-26T10:46:09.103458+0000","last_undegraded":"2024-04-26T10:46:09.103458+0000","last_fullsized":"2024-04-26T10:46:09.103458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'62","last_scrub_stamp":"2024-04-26T10:46:09.103432+0000","last_deep_scrub":"84'62","last_deep_scrub_stamp":"2024-04-26T10:46:09.103432+0000","last_clean_scrub_stamp":"2024-04-26T10:46:09.103432+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:25.007335+0000","scrub_duration":0.00814082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'437","reported_seq":535,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:18.250920+0000","last_change":"2024-04-26T10:46:18.251026+0000","last_active":"2024-04-26T10:46:18.250920+0000","last_peered":"2024-04-26T10:46:18.250920+0000","last_clean":"2024-04-26T10:46:18.250920+0000","last_became_active":"2024-04-26T10:45:53.177071+0000","last_became_peered":"2024-04-26T10:45:53.177071+0000","last_unstale":"2024-04-26T10:46:18.250920+0000","last_undegraded":"2024-04-26T10:46:18.250920+0000","last_fullsized":"2024-04-26T10:46:18.250920+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'437","last_scrub_stamp":"2024-04-26T10:46:18.250898+0000","last_deep_scrub":"63'437","last_deep_scrub_stamp":"2024-04-26T10:46:18.250898+0000","last_clean_scrub_stamp":"2024-04-26T10:46:18.250898+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:10.767270+0000","scrub_duration":0.002104093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":7562,"num_write":400,"num_write_kb":26121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"84'61","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:25.042019+0000","last_change":"2024-04-26T10:46:25.042141+0000","last_active":"2024-04-26T10:46:25.042019+0000","last_peered":"2024-04-26T10:46:25.042019+0000","last_clean":"2024-04-26T10:46:25.042019+0000","last_became_active":"2024-04-26T10:45:53.173542+0000","last_became_peered":"2024-04-26T10:45:53.173542+0000","last_unstale":"2024-04-26T10:46:25.042019+0000","last_undegraded":"2024-04-26T10:46:25.042019+0000","last_fullsized":"2024-04-26T10:46:25.042019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'61","last_scrub_stamp":"2024-04-26T10:46:25.041995+0000","last_deep_scrub":"84'61","last_deep_scrub_stamp":"2024-04-26T10:46:25.041995+0000","last_clean_scrub_stamp":"2024-04-26T10:46:25.041995+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:44:18.722171+0000","scrub_duration":0.010280186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2672,"num_read_kb":1454712,"num_write":24538,"num_write_kb":4190103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26671,"ondisk_log_size":26671,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128811551,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":5770,"num_write_kb":129888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257691648,"data_stored":257623102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},"log_size":7620,"ondisk_log_size":7620,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738429,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187500,"kb_used_data":80164,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94184340,"statfs":{"total":96636764160,"available":96444764160,"internally_reserved":0,"allocated":82087936,"data_stored":81566103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.42199999999999999,"15min":0.43099999999999999},"min":{"1min":0.20599999999999999,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.57199999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42699999999999999,"15min":0.436},"min":{"1min":0.216,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.504}]},{"osd":1,"last update":"Fri Apr 26 10:46:49 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.63200000000000001}]}]},{"osd":1,"up_from":70,"seq":300647710738,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136016,"kb_used_data":90440,"kb_used_omap":7,"kb_used_meta":45560,"kb_avail":94235824,"statfs":{"total":96636764160,"available":96497483776,"internally_reserved":0,"allocated":92610560,"data_stored":92059263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7181,"internal_metadata":46654451},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:46:45 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Apr 26 10:46:45 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.44},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.41499999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214376,"kb_used_data":84896,"kb_used_omap":1,"kb_used_meta":129470,"kb_avail":94157464,"statfs":{"total":96636764160,"available":96417243136,"internally_reserved":0,"allocated":86933504,"data_stored":86396712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132577734},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.439},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.45500000000000002}]},{"osd":2,"last update":"Fri Apr 26 10:46:29 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.42999999999999999,"15min":0.44900000000000001},"min":{"1min":0.253,"5min":0.183,"15min":0.183},"max":{"1min":0.58999999999999997,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.38},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.437,"15min":0.46300000000000002},"min":{"1min":0.23999999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.65700000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.40600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":85422080,"data_stored":85400264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":91099136,"data_stored":91062815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81170432,"data_stored":81160023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:47:09.208 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.208 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.208 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.208 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.209 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.209 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.209 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.209 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.209 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.209 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.209 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.209 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.210 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.210 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.210 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.210 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.210 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.210 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.210 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.210 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.211 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.211 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.211 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.211 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.211 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.211 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.211 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.211 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.212 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.212 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.212 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.212 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.212 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.212 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.212 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.212 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.212 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.213 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.213 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.213 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.213 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.213 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.213 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.213 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.213 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.214 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.214 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.214 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.214 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.214 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.214 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.215 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:09.215 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T10:47:29.216 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:47:29.529 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:47:29.530 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:47:29.540 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-04-26T10:47:27.673172+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129401919,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2852,"num_read_kb":1456290,"num_write":30511,"num_write_kb":4323451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9253,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34460,"ondisk_log_size":34460,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":537892,"kb_used_data":255500,"kb_used_omap":10,"kb_used_meta":282357,"kb_avail":282577628,"statfs":{"total":289910292480,"available":289359491072,"internally_reserved":0,"allocated":261632000,"data_stored":260022078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10369,"internal_metadata":289134463},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003436"},"pg_stats":[{"pgid":"4.3f","version":"63'415","reported_seq":554,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:52.748402+0000","last_change":"2024-04-26T10:46:52.748512+0000","last_active":"2024-04-26T10:46:52.748402+0000","last_peered":"2024-04-26T10:46:52.748402+0000","last_clean":"2024-04-26T10:46:52.748402+0000","last_became_active":"2024-04-26T10:42:26.044597+0000","last_became_peered":"2024-04-26T10:42:26.044597+0000","last_unstale":"2024-04-26T10:46:52.748402+0000","last_undegraded":"2024-04-26T10:46:52.748402+0000","last_fullsized":"2024-04-26T10:46:52.748402+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'415","last_scrub_stamp":"2024-04-26T10:46:52.748380+0000","last_deep_scrub":"63'415","last_deep_scrub_stamp":"2024-04-26T10:46:52.748380+0000","last_clean_scrub_stamp":"2024-04-26T10:46:52.748380+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:44.118436+0000","scrub_duration":0.002346842,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22963,"num_write":385,"num_write_kb":71406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"63'396","reported_seq":523,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:06.973056+0000","last_change":"2024-04-26T10:45:54.194523+0000","last_active":"2024-04-26T10:46:06.973056+0000","last_peered":"2024-04-26T10:46:06.973056+0000","last_clean":"2024-04-26T10:46:06.973056+0000","last_became_active":"2024-04-26T10:45:54.192613+0000","last_became_peered":"2024-04-26T10:45:54.192613+0000","last_unstale":"2024-04-26T10:46:06.973056+0000","last_undegraded":"2024-04-26T10:46:06.973056+0000","last_fullsized":"2024-04-26T10:46:06.973056+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9499,"num_write":371,"num_write_kb":38601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"63'366","reported_seq":461,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:24.288364+0000","last_change":"2024-04-26T10:46:24.288483+0000","last_active":"2024-04-26T10:46:24.288364+0000","last_peered":"2024-04-26T10:46:24.288364+0000","last_clean":"2024-04-26T10:46:24.288364+0000","last_became_active":"2024-04-26T10:45:55.180991+0000","last_became_peered":"2024-04-26T10:45:55.180991+0000","last_unstale":"2024-04-26T10:46:24.288364+0000","last_undegraded":"2024-04-26T10:46:24.288364+0000","last_fullsized":"2024-04-26T10:46:24.288364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'366","last_scrub_stamp":"2024-04-26T10:46:24.288343+0000","last_deep_scrub":"63'366","last_deep_scrub_stamp":"2024-04-26T10:46:24.288343+0000","last_clean_scrub_stamp":"2024-04-26T10:46:24.288343+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:09.803889+0000","scrub_duration":0.0024847200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6211,"num_write":338,"num_write_kb":38844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"63'394","reported_seq":546,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161957+0000","last_change":"2024-04-26T10:45:51.162341+0000","last_active":"2024-04-26T10:45:58.161957+0000","last_peered":"2024-04-26T10:45:58.161957+0000","last_clean":"2024-04-26T10:45:58.161957+0000","last_became_active":"2024-04-26T10:45:51.159099+0000","last_became_peered":"2024-04-26T10:45:51.159099+0000","last_unstale":"2024-04-26T10:45:58.161957+0000","last_undegraded":"2024-04-26T10:45:58.161957+0000","last_fullsized":"2024-04-26T10:45:58.161957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":52323,"num_write":357,"num_write_kb":63323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"63'409","reported_seq":519,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:46.894502+0000","last_change":"2024-04-26T10:46:46.894628+0000","last_active":"2024-04-26T10:46:46.894502+0000","last_peered":"2024-04-26T10:46:46.894502+0000","last_clean":"2024-04-26T10:46:46.894502+0000","last_became_active":"2024-04-26T10:42:26.040487+0000","last_became_peered":"2024-04-26T10:42:26.040487+0000","last_unstale":"2024-04-26T10:46:46.894502+0000","last_undegraded":"2024-04-26T10:46:46.894502+0000","last_fullsized":"2024-04-26T10:46:46.894502+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'409","last_scrub_stamp":"2024-04-26T10:46:46.894476+0000","last_deep_scrub":"63'409","last_deep_scrub_stamp":"2024-04-26T10:46:46.894476+0000","last_clean_scrub_stamp":"2024-04-26T10:46:46.894476+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:34.325893+0000","scrub_duration":0.0034301790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":372,"num_write_kb":42764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'385","reported_seq":476,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:21.300652+0000","last_change":"2024-04-26T10:46:21.300788+0000","last_active":"2024-04-26T10:46:21.300652+0000","last_peered":"2024-04-26T10:46:21.300652+0000","last_clean":"2024-04-26T10:46:21.300652+0000","last_became_active":"2024-04-26T10:45:49.861811+0000","last_became_peered":"2024-04-26T10:45:49.861811+0000","last_unstale":"2024-04-26T10:46:21.300652+0000","last_undegraded":"2024-04-26T10:46:21.300652+0000","last_fullsized":"2024-04-26T10:46:21.300652+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'385","last_scrub_stamp":"2024-04-26T10:46:21.300632+0000","last_deep_scrub":"63'385","last_deep_scrub_stamp":"2024-04-26T10:46:21.300632+0000","last_clean_scrub_stamp":"2024-04-26T10:46:21.300632+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:50.462322+0000","scrub_duration":0.0030393180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4124,"num_write":356,"num_write_kb":69857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"63'425","reported_seq":535,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161609+0000","last_change":"2024-04-26T10:45:50.869572+0000","last_active":"2024-04-26T10:45:58.161609+0000","last_peered":"2024-04-26T10:45:58.161609+0000","last_clean":"2024-04-26T10:45:58.161609+0000","last_became_active":"2024-04-26T10:45:50.866996+0000","last_became_peered":"2024-04-26T10:45:50.866996+0000","last_unstale":"2024-04-26T10:45:58.161609+0000","last_undegraded":"2024-04-26T10:45:58.161609+0000","last_fullsized":"2024-04-26T10:45:58.161609+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13036,"num_write":390,"num_write_kb":67193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"63'399","reported_seq":508,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.164893+0000","last_change":"2024-04-26T10:45:58.164304+0000","last_active":"2024-04-26T10:45:58.164893+0000","last_peered":"2024-04-26T10:45:58.164893+0000","last_clean":"2024-04-26T10:45:58.164893+0000","last_became_active":"2024-04-26T10:45:58.162532+0000","last_became_peered":"2024-04-26T10:45:58.162532+0000","last_unstale":"2024-04-26T10:45:58.164893+0000","last_undegraded":"2024-04-26T10:45:58.164893+0000","last_fullsized":"2024-04-26T10:45:58.164893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25678,"num_write":356,"num_write_kb":116549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"63'442","reported_seq":602,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:09.239513+0000","last_change":"2024-04-26T10:47:09.239513+0000","last_active":"2024-04-26T10:47:09.239513+0000","last_peered":"2024-04-26T10:47:09.239513+0000","last_clean":"2024-04-26T10:47:09.239513+0000","last_became_active":"2024-04-26T10:42:26.045177+0000","last_became_peered":"2024-04-26T10:42:26.045177+0000","last_unstale":"2024-04-26T10:47:09.239513+0000","last_undegraded":"2024-04-26T10:47:09.239513+0000","last_fullsized":"2024-04-26T10:47:09.239513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'442","last_scrub_stamp":"2024-04-26T10:47:09.239378+0000","last_deep_scrub":"63'442","last_deep_scrub_stamp":"2024-04-26T10:47:09.239378+0000","last_clean_scrub_stamp":"2024-04-26T10:47:09.239378+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:55.718285+0000","scrub_duration":0.0028840749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35111,"num_write":413,"num_write_kb":60306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'393","reported_seq":517,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:06.973025+0000","last_change":"2024-04-26T10:45:54.192984+0000","last_active":"2024-04-26T10:46:06.973025+0000","last_peered":"2024-04-26T10:46:06.973025+0000","last_clean":"2024-04-26T10:46:06.973025+0000","last_became_active":"2024-04-26T10:45:54.191514+0000","last_became_peered":"2024-04-26T10:45:54.191514+0000","last_unstale":"2024-04-26T10:46:06.973025+0000","last_undegraded":"2024-04-26T10:46:06.973025+0000","last_fullsized":"2024-04-26T10:46:06.973025+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5355,"num_write":351,"num_write_kb":38901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"63'377","reported_seq":494,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:10.635782+0000","last_change":"2024-04-26T10:47:10.635889+0000","last_active":"2024-04-26T10:47:10.635782+0000","last_peered":"2024-04-26T10:47:10.635782+0000","last_clean":"2024-04-26T10:47:10.635782+0000","last_became_active":"2024-04-26T10:45:49.862718+0000","last_became_peered":"2024-04-26T10:45:49.862718+0000","last_unstale":"2024-04-26T10:47:10.635782+0000","last_undegraded":"2024-04-26T10:47:10.635782+0000","last_fullsized":"2024-04-26T10:47:10.635782+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'377","last_scrub_stamp":"2024-04-26T10:47:10.635759+0000","last_deep_scrub":"63'377","last_deep_scrub_stamp":"2024-04-26T10:47:10.635759+0000","last_clean_scrub_stamp":"2024-04-26T10:47:10.635759+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:29.097205+0000","scrub_duration":0.0028839180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18030,"num_write":355,"num_write_kb":67044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"63'365","reported_seq":810,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:06.973022+0000","last_change":"2024-04-26T10:45:57.166219+0000","last_active":"2024-04-26T10:46:06.973022+0000","last_peered":"2024-04-26T10:46:06.973022+0000","last_clean":"2024-04-26T10:46:06.973022+0000","last_became_active":"2024-04-26T10:45:57.164964+0000","last_became_peered":"2024-04-26T10:45:57.164964+0000","last_unstale":"2024-04-26T10:46:06.973022+0000","last_undegraded":"2024-04-26T10:46:06.973022+0000","last_fullsized":"2024-04-26T10:46:06.973022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14866,"num_write":337,"num_write_kb":71188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'397","reported_seq":492,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:06.972985+0000","last_change":"2024-04-26T10:42:26.042607+0000","last_active":"2024-04-26T10:46:06.972985+0000","last_peered":"2024-04-26T10:46:06.972985+0000","last_clean":"2024-04-26T10:46:06.972985+0000","last_became_active":"2024-04-26T10:42:26.041617+0000","last_became_peered":"2024-04-26T10:42:26.041617+0000","last_unstale":"2024-04-26T10:46:06.972985+0000","last_undegraded":"2024-04-26T10:46:06.972985+0000","last_fullsized":"2024-04-26T10:46:06.972985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8192,"num_write":362,"num_write_kb":54822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"63'408","reported_seq":499,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:34.396188+0000","last_change":"2024-04-26T10:46:34.396311+0000","last_active":"2024-04-26T10:46:34.396188+0000","last_peered":"2024-04-26T10:46:34.396188+0000","last_clean":"2024-04-26T10:46:34.396188+0000","last_became_active":"2024-04-26T10:45:53.177677+0000","last_became_peered":"2024-04-26T10:45:53.177677+0000","last_unstale":"2024-04-26T10:46:34.396188+0000","last_undegraded":"2024-04-26T10:46:34.396188+0000","last_fullsized":"2024-04-26T10:46:34.396188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:34.396168+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:34.396168+0000","last_clean_scrub_stamp":"2024-04-26T10:46:34.396168+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:28.312103+0000","scrub_duration":0.002988662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4688,"num_write":374,"num_write_kb":21766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"63'409","reported_seq":534,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:47.541512+0000","last_change":"2024-04-26T10:46:47.541645+0000","last_active":"2024-04-26T10:46:47.541512+0000","last_peered":"2024-04-26T10:46:47.541512+0000","last_clean":"2024-04-26T10:46:47.541512+0000","last_became_active":"2024-04-26T10:45:54.185826+0000","last_became_peered":"2024-04-26T10:45:54.185826+0000","last_unstale":"2024-04-26T10:46:47.541512+0000","last_undegraded":"2024-04-26T10:46:47.541512+0000","last_fullsized":"2024-04-26T10:46:47.541512+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'409","last_scrub_stamp":"2024-04-26T10:46:47.541492+0000","last_deep_scrub":"63'409","last_deep_scrub_stamp":"2024-04-26T10:46:47.541492+0000","last_clean_scrub_stamp":"2024-04-26T10:46:47.541492+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:05.889065+0000","scrub_duration":0.0023676470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25968,"num_write":366,"num_write_kb":75698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"63'460","reported_seq":574,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:20.325508+0000","last_change":"2024-04-26T10:46:20.325615+0000","last_active":"2024-04-26T10:46:20.325508+0000","last_peered":"2024-04-26T10:46:20.325508+0000","last_clean":"2024-04-26T10:46:20.325508+0000","last_became_active":"2024-04-26T10:45:53.174699+0000","last_became_peered":"2024-04-26T10:45:53.174699+0000","last_unstale":"2024-04-26T10:46:20.325508+0000","last_undegraded":"2024-04-26T10:46:20.325508+0000","last_fullsized":"2024-04-26T10:46:20.325508+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'460","last_scrub_stamp":"2024-04-26T10:46:20.325486+0000","last_deep_scrub":"63'460","last_deep_scrub_stamp":"2024-04-26T10:46:20.325486+0000","last_clean_scrub_stamp":"2024-04-26T10:46:20.325486+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:51.733701+0000","scrub_duration":0.0023796759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16269,"num_write":426,"num_write_kb":67839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"63'393","reported_seq":525,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:11.204577+0000","last_change":"2024-04-26T10:47:11.204709+0000","last_active":"2024-04-26T10:47:11.204577+0000","last_peered":"2024-04-26T10:47:11.204577+0000","last_clean":"2024-04-26T10:47:11.204577+0000","last_became_active":"2024-04-26T10:42:26.049014+0000","last_became_peered":"2024-04-26T10:42:26.049014+0000","last_unstale":"2024-04-26T10:47:11.204577+0000","last_undegraded":"2024-04-26T10:47:11.204577+0000","last_fullsized":"2024-04-26T10:47:11.204577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'393","last_scrub_stamp":"2024-04-26T10:47:11.204553+0000","last_deep_scrub":"63'393","last_deep_scrub_stamp":"2024-04-26T10:47:11.204553+0000","last_clean_scrub_stamp":"2024-04-26T10:47:11.204553+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:49.026292+0000","scrub_duration":0.0022247619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":25712,"num_write":362,"num_write_kb":42020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'428","reported_seq":567,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:15.921226+0000","last_change":"2024-04-26T10:46:15.921226+0000","last_active":"2024-04-26T10:46:15.921226+0000","last_peered":"2024-04-26T10:46:15.921226+0000","last_clean":"2024-04-26T10:46:15.921226+0000","last_became_active":"2024-04-26T10:45:54.189852+0000","last_became_peered":"2024-04-26T10:45:54.189852+0000","last_unstale":"2024-04-26T10:46:15.921226+0000","last_undegraded":"2024-04-26T10:46:15.921226+0000","last_fullsized":"2024-04-26T10:46:15.921226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'428","last_scrub_stamp":"2024-04-26T10:46:15.921093+0000","last_deep_scrub":"63'428","last_deep_scrub_stamp":"2024-04-26T10:46:15.921093+0000","last_clean_scrub_stamp":"2024-04-26T10:46:15.921093+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:06.246994+0000","scrub_duration":0.0037567920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12316,"num_write":384,"num_write_kb":87656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"63'446","reported_seq":599,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:34.106864+0000","last_change":"2024-04-26T10:46:34.106970+0000","last_active":"2024-04-26T10:46:34.106864+0000","last_peered":"2024-04-26T10:46:34.106864+0000","last_clean":"2024-04-26T10:46:34.106864+0000","last_became_active":"2024-04-26T10:45:54.184063+0000","last_became_peered":"2024-04-26T10:45:54.184063+0000","last_unstale":"2024-04-26T10:46:34.106864+0000","last_undegraded":"2024-04-26T10:46:34.106864+0000","last_fullsized":"2024-04-26T10:46:34.106864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'446","last_scrub_stamp":"2024-04-26T10:46:34.106840+0000","last_deep_scrub":"63'446","last_deep_scrub_stamp":"2024-04-26T10:46:34.106840+0000","last_clean_scrub_stamp":"2024-04-26T10:46:34.106840+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:53.038982+0000","scrub_duration":0.003191504,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":53414,"num_write":401,"num_write_kb":80048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":562,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:43.456409+0000","last_change":"2024-04-26T10:46:43.456513+0000","last_active":"2024-04-26T10:46:43.456409+0000","last_peered":"2024-04-26T10:46:43.456409+0000","last_clean":"2024-04-26T10:46:43.456409+0000","last_became_active":"2024-04-26T10:45:50.867680+0000","last_became_peered":"2024-04-26T10:45:50.867680+0000","last_unstale":"2024-04-26T10:46:43.456409+0000","last_undegraded":"2024-04-26T10:46:43.456409+0000","last_fullsized":"2024-04-26T10:46:43.456409+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'438","last_scrub_stamp":"2024-04-26T10:46:43.456387+0000","last_deep_scrub":"63'438","last_deep_scrub_stamp":"2024-04-26T10:46:43.456387+0000","last_clean_scrub_stamp":"2024-04-26T10:46:43.456387+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:45.105492+0000","scrub_duration":0.002559675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19859,"num_write":405,"num_write_kb":51119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"63'408","reported_seq":874,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:26.338673+0000","last_change":"2024-04-26T10:46:26.338811+0000","last_active":"2024-04-26T10:46:26.338673+0000","last_peered":"2024-04-26T10:46:26.338673+0000","last_clean":"2024-04-26T10:46:26.338673+0000","last_became_active":"2024-04-26T10:45:56.160360+0000","last_became_peered":"2024-04-26T10:45:56.160360+0000","last_unstale":"2024-04-26T10:46:26.338673+0000","last_undegraded":"2024-04-26T10:46:26.338673+0000","last_fullsized":"2024-04-26T10:46:26.338673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:26.338639+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:26.338639+0000","last_clean_scrub_stamp":"2024-04-26T10:46:26.338639+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:34.117967+0000","scrub_duration":0.0027084209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":15372,"num_write":366,"num_write_kb":75855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"63'452","reported_seq":1019,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:06.972935+0000","last_change":"2024-04-26T10:45:52.175372+0000","last_active":"2024-04-26T10:46:06.972935+0000","last_peered":"2024-04-26T10:46:06.972935+0000","last_clean":"2024-04-26T10:46:06.972935+0000","last_became_active":"2024-04-26T10:45:52.173702+0000","last_became_peered":"2024-04-26T10:45:52.173702+0000","last_unstale":"2024-04-26T10:46:06.972935+0000","last_undegraded":"2024-04-26T10:46:06.972935+0000","last_fullsized":"2024-04-26T10:46:06.972935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43729,"num_write":421,"num_write_kb":79804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"63'408","reported_seq":894,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:30.067044+0000","last_change":"2024-04-26T10:46:30.067162+0000","last_active":"2024-04-26T10:46:30.067044+0000","last_peered":"2024-04-26T10:46:30.067044+0000","last_clean":"2024-04-26T10:46:30.067044+0000","last_became_active":"2024-04-26T10:45:57.162147+0000","last_became_peered":"2024-04-26T10:45:57.162147+0000","last_unstale":"2024-04-26T10:46:30.067044+0000","last_undegraded":"2024-04-26T10:46:30.067044+0000","last_fullsized":"2024-04-26T10:46:30.067044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:30.067019+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:30.067019+0000","last_clean_scrub_stamp":"2024-04-26T10:46:30.067019+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:46.527639+0000","scrub_duration":0.0026815810000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":30320,"num_write":372,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'453","reported_seq":628,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:57.799503+0000","last_change":"2024-04-26T10:46:57.799635+0000","last_active":"2024-04-26T10:46:57.799503+0000","last_peered":"2024-04-26T10:46:57.799503+0000","last_clean":"2024-04-26T10:46:57.799503+0000","last_became_active":"2024-04-26T10:45:54.181881+0000","last_became_peered":"2024-04-26T10:45:54.181881+0000","last_unstale":"2024-04-26T10:46:57.799503+0000","last_undegraded":"2024-04-26T10:46:57.799503+0000","last_fullsized":"2024-04-26T10:46:57.799503+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'453","last_scrub_stamp":"2024-04-26T10:46:57.799480+0000","last_deep_scrub":"63'453","last_deep_scrub_stamp":"2024-04-26T10:46:57.799480+0000","last_clean_scrub_stamp":"2024-04-26T10:46:57.799480+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:42.095942+0000","scrub_duration":0.003413672,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":19864,"num_write":422,"num_write_kb":51638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"63'439","reported_seq":967,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:07.911236+0000","last_change":"2024-04-26T10:46:07.911236+0000","last_active":"2024-04-26T10:46:07.911236+0000","last_peered":"2024-04-26T10:46:07.911236+0000","last_clean":"2024-04-26T10:46:07.911236+0000","last_became_active":"2024-04-26T10:45:48.866159+0000","last_became_peered":"2024-04-26T10:45:48.866159+0000","last_unstale":"2024-04-26T10:46:07.911236+0000","last_undegraded":"2024-04-26T10:46:07.911236+0000","last_fullsized":"2024-04-26T10:46:07.911236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'439","last_scrub_stamp":"2024-04-26T10:46:07.911088+0000","last_deep_scrub":"63'439","last_deep_scrub_stamp":"2024-04-26T10:46:07.911088+0000","last_clean_scrub_stamp":"2024-04-26T10:46:07.911088+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:32.755490+0000","scrub_duration":0.0024222179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8912,"num_write":417,"num_write_kb":46575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"63'513","reported_seq":1160,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:07.857821+0000","last_change":"2024-04-26T10:45:51.160003+0000","last_active":"2024-04-26T10:46:07.857821+0000","last_peered":"2024-04-26T10:46:07.857821+0000","last_clean":"2024-04-26T10:46:07.857821+0000","last_became_active":"2024-04-26T10:45:51.158698+0000","last_became_peered":"2024-04-26T10:45:51.158698+0000","last_unstale":"2024-04-26T10:46:07.857821+0000","last_undegraded":"2024-04-26T10:46:07.857821+0000","last_fullsized":"2024-04-26T10:46:07.857821+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":70751,"num_write":473,"num_write_kb":88902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'406","reported_seq":545,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:54.455676+0000","last_change":"2024-04-26T10:46:54.455779+0000","last_active":"2024-04-26T10:46:54.455676+0000","last_peered":"2024-04-26T10:46:54.455676+0000","last_clean":"2024-04-26T10:46:54.455676+0000","last_became_active":"2024-04-26T10:45:56.162419+0000","last_became_peered":"2024-04-26T10:45:56.162419+0000","last_unstale":"2024-04-26T10:46:54.455676+0000","last_undegraded":"2024-04-26T10:46:54.455676+0000","last_fullsized":"2024-04-26T10:46:54.455676+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'406","last_scrub_stamp":"2024-04-26T10:46:54.455655+0000","last_deep_scrub":"63'406","last_deep_scrub_stamp":"2024-04-26T10:46:54.455655+0000","last_clean_scrub_stamp":"2024-04-26T10:46:54.455655+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:35.943745+0000","scrub_duration":0.0024701179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":32121,"num_write":372,"num_write_kb":60163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"63'402","reported_seq":880,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:38.854895+0000","last_change":"2024-04-26T10:46:38.854895+0000","last_active":"2024-04-26T10:46:38.854895+0000","last_peered":"2024-04-26T10:46:38.854895+0000","last_clean":"2024-04-26T10:46:38.854895+0000","last_became_active":"2024-04-26T10:45:57.165064+0000","last_became_peered":"2024-04-26T10:45:57.165064+0000","last_unstale":"2024-04-26T10:46:38.854895+0000","last_undegraded":"2024-04-26T10:46:38.854895+0000","last_fullsized":"2024-04-26T10:46:38.854895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'402","last_scrub_stamp":"2024-04-26T10:46:38.854753+0000","last_deep_scrub":"63'402","last_deep_scrub_stamp":"2024-04-26T10:46:38.854753+0000","last_clean_scrub_stamp":"2024-04-26T10:46:38.854753+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:36.110686+0000","scrub_duration":0.0022249689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":6824,"num_write":378,"num_write_kb":72156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"63'407","reported_seq":889,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:59.681981+0000","last_change":"2024-04-26T10:45:58.163989+0000","last_active":"2024-04-26T10:45:59.681981+0000","last_peered":"2024-04-26T10:45:59.681981+0000","last_clean":"2024-04-26T10:45:59.681981+0000","last_became_active":"2024-04-26T10:45:58.161850+0000","last_became_peered":"2024-04-26T10:45:58.161850+0000","last_unstale":"2024-04-26T10:45:59.681981+0000","last_undegraded":"2024-04-26T10:45:59.681981+0000","last_fullsized":"2024-04-26T10:45:59.681981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25898,"num_write":372,"num_write_kb":59274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":346,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'490","reported_seq":1071,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:51.777219+0000","last_change":"2024-04-26T10:46:51.777320+0000","last_active":"2024-04-26T10:46:51.777219+0000","last_peered":"2024-04-26T10:46:51.777219+0000","last_clean":"2024-04-26T10:46:51.777219+0000","last_became_active":"2024-04-26T10:45:55.178083+0000","last_became_peered":"2024-04-26T10:45:55.178083+0000","last_unstale":"2024-04-26T10:46:51.777219+0000","last_undegraded":"2024-04-26T10:46:51.777219+0000","last_fullsized":"2024-04-26T10:46:51.777219+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'490","last_scrub_stamp":"2024-04-26T10:46:51.777196+0000","last_deep_scrub":"63'490","last_deep_scrub_stamp":"2024-04-26T10:46:51.777196+0000","last_clean_scrub_stamp":"2024-04-26T10:46:51.777196+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:16:31.651731+0000","scrub_duration":0.0022270390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33597,"num_write":449,"num_write_kb":87981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"63'474","reported_seq":575,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:41.218309+0000","last_change":"2024-04-26T10:46:41.218435+0000","last_active":"2024-04-26T10:46:41.218309+0000","last_peered":"2024-04-26T10:46:41.218309+0000","last_clean":"2024-04-26T10:46:41.218309+0000","last_became_active":"2024-04-26T10:45:54.186011+0000","last_became_peered":"2024-04-26T10:45:54.186011+0000","last_unstale":"2024-04-26T10:46:41.218309+0000","last_undegraded":"2024-04-26T10:46:41.218309+0000","last_fullsized":"2024-04-26T10:46:41.218309+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'474","last_scrub_stamp":"2024-04-26T10:46:41.218267+0000","last_deep_scrub":"63'474","last_deep_scrub_stamp":"2024-04-26T10:46:41.218267+0000","last_clean_scrub_stamp":"2024-04-26T10:46:41.218267+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:19.308910+0000","scrub_duration":0.003558748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30886,"num_write":441,"num_write_kb":118807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'443","reported_seq":559,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:37.402412+0000","last_change":"2024-04-26T10:46:37.402510+0000","last_active":"2024-04-26T10:46:37.402412+0000","last_peered":"2024-04-26T10:46:37.402412+0000","last_clean":"2024-04-26T10:46:37.402412+0000","last_became_active":"2024-04-26T10:45:48.861918+0000","last_became_peered":"2024-04-26T10:45:48.861918+0000","last_unstale":"2024-04-26T10:46:37.402412+0000","last_undegraded":"2024-04-26T10:46:37.402412+0000","last_fullsized":"2024-04-26T10:46:37.402412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'443","last_scrub_stamp":"2024-04-26T10:46:37.402390+0000","last_deep_scrub":"63'443","last_deep_scrub_stamp":"2024-04-26T10:46:37.402390+0000","last_clean_scrub_stamp":"2024-04-26T10:46:37.402390+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:31.390744+0000","scrub_duration":0.0023535019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20556,"num_write":413,"num_write_kb":91647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"63'376","reported_seq":491,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:49.818309+0000","last_change":"2024-04-26T10:46:49.818309+0000","last_active":"2024-04-26T10:46:49.818309+0000","last_peered":"2024-04-26T10:46:49.818309+0000","last_clean":"2024-04-26T10:46:49.818309+0000","last_became_active":"2024-04-26T10:42:26.040920+0000","last_became_peered":"2024-04-26T10:42:26.040920+0000","last_unstale":"2024-04-26T10:46:49.818309+0000","last_undegraded":"2024-04-26T10:46:49.818309+0000","last_fullsized":"2024-04-26T10:46:49.818309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'376","last_scrub_stamp":"2024-04-26T10:46:49.818144+0000","last_deep_scrub":"63'376","last_deep_scrub_stamp":"2024-04-26T10:46:49.818144+0000","last_clean_scrub_stamp":"2024-04-26T10:46:49.818144+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:42.631428+0000","scrub_duration":0.002993571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10124,"num_write":344,"num_write_kb":66899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"62'453","reported_seq":534,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161595+0000","last_change":"2024-04-26T10:45:48.862782+0000","last_active":"2024-04-26T10:45:58.161595+0000","last_peered":"2024-04-26T10:45:58.161595+0000","last_clean":"2024-04-26T10:45:58.161595+0000","last_became_active":"2024-04-26T10:45:48.862424+0000","last_became_peered":"2024-04-26T10:45:48.862424+0000","last_unstale":"2024-04-26T10:45:58.161595+0000","last_undegraded":"2024-04-26T10:45:58.161595+0000","last_fullsized":"2024-04-26T10:45:58.161595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"63'403","reported_seq":533,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:10.923239+0000","last_change":"2024-04-26T10:46:10.923239+0000","last_active":"2024-04-26T10:46:10.923239+0000","last_peered":"2024-04-26T10:46:10.923239+0000","last_clean":"2024-04-26T10:46:10.923239+0000","last_became_active":"2024-04-26T10:42:26.040464+0000","last_became_peered":"2024-04-26T10:42:26.040464+0000","last_unstale":"2024-04-26T10:46:10.923239+0000","last_undegraded":"2024-04-26T10:46:10.923239+0000","last_fullsized":"2024-04-26T10:46:10.923239+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'403","last_scrub_stamp":"2024-04-26T10:46:10.923100+0000","last_deep_scrub":"63'403","last_deep_scrub_stamp":"2024-04-26T10:46:10.923100+0000","last_clean_scrub_stamp":"2024-04-26T10:46:10.923100+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:00.804186+0000","scrub_duration":0.0037994579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24588,"num_write":363,"num_write_kb":51190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"62'49","reported_seq":156,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:17.105113+0000","last_change":"2024-04-26T10:47:17.105218+0000","last_active":"2024-04-26T10:47:17.105113+0000","last_peered":"2024-04-26T10:47:17.105113+0000","last_clean":"2024-04-26T10:47:17.105113+0000","last_became_active":"2024-04-26T10:45:45.862029+0000","last_became_peered":"2024-04-26T10:45:45.862029+0000","last_unstale":"2024-04-26T10:47:17.105113+0000","last_undegraded":"2024-04-26T10:47:17.105113+0000","last_fullsized":"2024-04-26T10:47:17.105113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'49","last_scrub_stamp":"2024-04-26T10:47:17.105090+0000","last_deep_scrub":"62'49","last_deep_scrub_stamp":"2024-04-26T10:47:17.105090+0000","last_clean_scrub_stamp":"2024-04-26T10:47:17.105090+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:22.790230+0000","scrub_duration":0.0016239309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'407","reported_seq":900,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:23.067400+0000","last_change":"2024-04-26T10:47:23.067513+0000","last_active":"2024-04-26T10:47:23.067400+0000","last_peered":"2024-04-26T10:47:23.067400+0000","last_clean":"2024-04-26T10:47:23.067400+0000","last_became_active":"2024-04-26T10:45:52.169295+0000","last_became_peered":"2024-04-26T10:45:52.169295+0000","last_unstale":"2024-04-26T10:47:23.067400+0000","last_undegraded":"2024-04-26T10:47:23.067400+0000","last_fullsized":"2024-04-26T10:47:23.067400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'407","last_scrub_stamp":"2024-04-26T10:47:23.067376+0000","last_deep_scrub":"63'407","last_deep_scrub_stamp":"2024-04-26T10:47:23.067376+0000","last_clean_scrub_stamp":"2024-04-26T10:47:23.067376+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:45.140990+0000","scrub_duration":0.0024592289999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":7077,"num_write":367,"num_write_kb":42434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"62'66","reported_seq":173,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:11.778529+0000","last_change":"2024-04-26T10:47:11.778687+0000","last_active":"2024-04-26T10:47:11.778529+0000","last_peered":"2024-04-26T10:47:11.778529+0000","last_clean":"2024-04-26T10:47:11.778529+0000","last_became_active":"2024-04-26T10:45:45.874030+0000","last_became_peered":"2024-04-26T10:45:45.874030+0000","last_unstale":"2024-04-26T10:47:11.778529+0000","last_undegraded":"2024-04-26T10:47:11.778529+0000","last_fullsized":"2024-04-26T10:47:11.778529+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'66","last_scrub_stamp":"2024-04-26T10:47:11.778503+0000","last_deep_scrub":"62'66","last_deep_scrub_stamp":"2024-04-26T10:47:11.778503+0000","last_clean_scrub_stamp":"2024-04-26T10:47:11.778503+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:30.448994+0000","scrub_duration":0.001798846,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"63'406","reported_seq":911,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:24.024745+0000","last_change":"2024-04-26T10:47:24.024848+0000","last_active":"2024-04-26T10:47:24.024745+0000","last_peered":"2024-04-26T10:47:24.024745+0000","last_clean":"2024-04-26T10:47:24.024745+0000","last_became_active":"2024-04-26T10:45:49.861979+0000","last_became_peered":"2024-04-26T10:45:49.861979+0000","last_unstale":"2024-04-26T10:47:24.024745+0000","last_undegraded":"2024-04-26T10:47:24.024745+0000","last_fullsized":"2024-04-26T10:47:24.024745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'406","last_scrub_stamp":"2024-04-26T10:47:24.024723+0000","last_deep_scrub":"63'406","last_deep_scrub_stamp":"2024-04-26T10:47:24.024723+0000","last_clean_scrub_stamp":"2024-04-26T10:47:24.024723+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:07:41.862917+0000","scrub_duration":0.0024237550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":25977,"num_write":374,"num_write_kb":104172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"84'70","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:56.460947+0000","last_change":"2024-04-26T10:46:56.461080+0000","last_active":"2024-04-26T10:46:56.460947+0000","last_peered":"2024-04-26T10:46:56.460947+0000","last_clean":"2024-04-26T10:46:56.460947+0000","last_became_active":"2024-04-26T10:45:45.871120+0000","last_became_peered":"2024-04-26T10:45:45.871120+0000","last_unstale":"2024-04-26T10:46:56.460947+0000","last_undegraded":"2024-04-26T10:46:56.460947+0000","last_fullsized":"2024-04-26T10:46:56.460947+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'70","last_scrub_stamp":"2024-04-26T10:46:56.460924+0000","last_deep_scrub":"84'70","last_deep_scrub_stamp":"2024-04-26T10:46:56.460924+0000","last_clean_scrub_stamp":"2024-04-26T10:46:56.460924+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:06.245761+0000","scrub_duration":0.0046851239999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"84'202","reported_seq":295,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:45.516881+0000","last_change":"2024-04-26T10:46:45.516981+0000","last_active":"2024-04-26T10:46:45.516881+0000","last_peered":"2024-04-26T10:46:45.516881+0000","last_clean":"2024-04-26T10:46:45.516881+0000","last_became_active":"2024-04-26T10:45:48.865878+0000","last_became_peered":"2024-04-26T10:45:48.865878+0000","last_unstale":"2024-04-26T10:46:45.516881+0000","last_undegraded":"2024-04-26T10:46:45.516881+0000","last_fullsized":"2024-04-26T10:46:45.516881+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'202","last_scrub_stamp":"2024-04-26T10:46:45.516857+0000","last_deep_scrub":"84'202","last_deep_scrub_stamp":"2024-04-26T10:46:45.516857+0000","last_clean_scrub_stamp":"2024-04-26T10:46:45.516857+0000","objects_scrubbed":2,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:35.343559+0000","scrub_duration":0.011504359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"63'415","reported_seq":921,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:11.914773+0000","last_change":"2024-04-26T10:46:11.914773+0000","last_active":"2024-04-26T10:46:11.914773+0000","last_peered":"2024-04-26T10:46:11.914773+0000","last_clean":"2024-04-26T10:46:11.914773+0000","last_became_active":"2024-04-26T10:45:57.163263+0000","last_became_peered":"2024-04-26T10:45:57.163263+0000","last_unstale":"2024-04-26T10:46:11.914773+0000","last_undegraded":"2024-04-26T10:46:11.914773+0000","last_fullsized":"2024-04-26T10:46:11.914773+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'415","last_scrub_stamp":"2024-04-26T10:46:11.914637+0000","last_deep_scrub":"63'415","last_deep_scrub_stamp":"2024-04-26T10:46:11.914637+0000","last_clean_scrub_stamp":"2024-04-26T10:46:11.914637+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:19.456262+0000","scrub_duration":0.0026733759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15757,"num_write":380,"num_write_kb":54727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"84'344","reported_seq":463,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:04.860552+0000","last_change":"2024-04-26T10:47:04.860677+0000","last_active":"2024-04-26T10:47:04.860552+0000","last_peered":"2024-04-26T10:47:04.860552+0000","last_clean":"2024-04-26T10:47:04.860552+0000","last_became_active":"2024-04-26T10:45:48.866497+0000","last_became_peered":"2024-04-26T10:45:48.866497+0000","last_unstale":"2024-04-26T10:47:04.860552+0000","last_undegraded":"2024-04-26T10:47:04.860552+0000","last_fullsized":"2024-04-26T10:47:04.860552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'344","last_scrub_stamp":"2024-04-26T10:47:04.860530+0000","last_deep_scrub":"84'344","last_deep_scrub_stamp":"2024-04-26T10:47:04.860530+0000","last_clean_scrub_stamp":"2024-04-26T10:47:04.860530+0000","objects_scrubbed":2,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:42.826483+0000","scrub_duration":0.011514284,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"63'481","reported_seq":683,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:23.694129+0000","last_change":"2024-04-26T10:47:23.694244+0000","last_active":"2024-04-26T10:47:23.694129+0000","last_peered":"2024-04-26T10:47:23.694129+0000","last_clean":"2024-04-26T10:47:23.694129+0000","last_became_active":"2024-04-26T10:45:54.181993+0000","last_became_peered":"2024-04-26T10:45:54.181993+0000","last_unstale":"2024-04-26T10:47:23.694129+0000","last_undegraded":"2024-04-26T10:47:23.694129+0000","last_fullsized":"2024-04-26T10:47:23.694129+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'481","last_scrub_stamp":"2024-04-26T10:47:23.694106+0000","last_deep_scrub":"63'481","last_deep_scrub_stamp":"2024-04-26T10:47:23.694106+0000","last_clean_scrub_stamp":"2024-04-26T10:47:23.694106+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:27.709900+0000","scrub_duration":0.0032272659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":45251,"num_write":451,"num_write_kb":105365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"84'462","reported_seq":555,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:40.432545+0000","last_change":"2024-04-26T10:46:40.432691+0000","last_active":"2024-04-26T10:46:40.432545+0000","last_peered":"2024-04-26T10:46:40.432545+0000","last_clean":"2024-04-26T10:46:40.432545+0000","last_became_active":"2024-04-26T10:45:48.865520+0000","last_became_peered":"2024-04-26T10:45:48.865520+0000","last_unstale":"2024-04-26T10:46:40.432545+0000","last_undegraded":"2024-04-26T10:46:40.432545+0000","last_fullsized":"2024-04-26T10:46:40.432545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'462","last_scrub_stamp":"2024-04-26T10:46:40.432509+0000","last_deep_scrub":"84'462","last_deep_scrub_stamp":"2024-04-26T10:46:40.432509+0000","last_clean_scrub_stamp":"2024-04-26T10:46:40.432509+0000","objects_scrubbed":2,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:15.817808+0000","scrub_duration":0.010610122,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":407,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'420","reported_seq":504,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161880+0000","last_change":"2024-04-26T10:45:57.165390+0000","last_active":"2024-04-26T10:45:58.161880+0000","last_peered":"2024-04-26T10:45:58.161880+0000","last_clean":"2024-04-26T10:45:58.161880+0000","last_became_active":"2024-04-26T10:45:57.162014+0000","last_became_peered":"2024-04-26T10:45:57.162014+0000","last_unstale":"2024-04-26T10:45:58.161880+0000","last_undegraded":"2024-04-26T10:45:58.161880+0000","last_fullsized":"2024-04-26T10:45:58.161880+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13025,"num_write":385,"num_write_kb":38595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"62'67","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:51.506238+0000","last_change":"2024-04-26T10:46:51.506347+0000","last_active":"2024-04-26T10:46:51.506238+0000","last_peered":"2024-04-26T10:46:51.506238+0000","last_clean":"2024-04-26T10:46:51.506238+0000","last_became_active":"2024-04-26T10:45:45.860175+0000","last_became_peered":"2024-04-26T10:45:45.860175+0000","last_unstale":"2024-04-26T10:46:51.506238+0000","last_undegraded":"2024-04-26T10:46:51.506238+0000","last_fullsized":"2024-04-26T10:46:51.506238+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'67","last_scrub_stamp":"2024-04-26T10:46:51.506217+0000","last_deep_scrub":"62'67","last_deep_scrub_stamp":"2024-04-26T10:46:51.506217+0000","last_clean_scrub_stamp":"2024-04-26T10:46:51.506217+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:02.699431+0000","scrub_duration":0.0015865510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"63'452","reported_seq":966,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:59.681950+0000","last_change":"2024-04-26T10:45:58.166413+0000","last_active":"2024-04-26T10:45:59.681950+0000","last_peered":"2024-04-26T10:45:59.681950+0000","last_clean":"2024-04-26T10:45:59.681950+0000","last_became_active":"2024-04-26T10:45:58.164105+0000","last_became_peered":"2024-04-26T10:45:58.164105+0000","last_unstale":"2024-04-26T10:45:59.681950+0000","last_undegraded":"2024-04-26T10:45:59.681950+0000","last_fullsized":"2024-04-26T10:45:59.681950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23217,"num_write":416,"num_write_kb":71418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":388,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"62'200","reported_seq":278,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159939+0000","last_change":"2024-04-26T10:45:56.160957+0000","last_active":"2024-04-26T10:45:58.159939+0000","last_peered":"2024-04-26T10:45:58.159939+0000","last_clean":"2024-04-26T10:45:58.159939+0000","last_became_active":"2024-04-26T10:45:56.160475+0000","last_became_peered":"2024-04-26T10:45:56.160475+0000","last_unstale":"2024-04-26T10:45:58.159939+0000","last_undegraded":"2024-04-26T10:45:58.159939+0000","last_fullsized":"2024-04-26T10:45:58.159939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'430","reported_seq":513,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162319+0000","last_change":"2024-04-26T10:45:57.164742+0000","last_active":"2024-04-26T10:45:58.162319+0000","last_peered":"2024-04-26T10:45:58.162319+0000","last_clean":"2024-04-26T10:45:58.162319+0000","last_became_active":"2024-04-26T10:45:57.162070+0000","last_became_peered":"2024-04-26T10:45:57.162070+0000","last_unstale":"2024-04-26T10:45:58.162319+0000","last_undegraded":"2024-04-26T10:45:58.162319+0000","last_fullsized":"2024-04-26T10:45:58.162319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":24352,"num_write":392,"num_write_kb":21976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"84'234","reported_seq":319,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:15.624839+0000","last_change":"2024-04-26T10:47:15.625011+0000","last_active":"2024-04-26T10:47:15.624839+0000","last_peered":"2024-04-26T10:47:15.624839+0000","last_clean":"2024-04-26T10:47:15.624839+0000","last_became_active":"2024-04-26T10:45:48.862517+0000","last_became_peered":"2024-04-26T10:45:48.862517+0000","last_unstale":"2024-04-26T10:47:15.624839+0000","last_undegraded":"2024-04-26T10:47:15.624839+0000","last_fullsized":"2024-04-26T10:47:15.624839+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'234","last_scrub_stamp":"2024-04-26T10:47:15.624801+0000","last_deep_scrub":"84'234","last_deep_scrub_stamp":"2024-04-26T10:47:15.624801+0000","last_clean_scrub_stamp":"2024-04-26T10:47:15.624801+0000","objects_scrubbed":1,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:41.779523+0000","scrub_duration":0.0093436560000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"63'393","reported_seq":490,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:01.534168+0000","last_change":"2024-04-26T10:47:01.534285+0000","last_active":"2024-04-26T10:47:01.534168+0000","last_peered":"2024-04-26T10:47:01.534168+0000","last_clean":"2024-04-26T10:47:01.534168+0000","last_became_active":"2024-04-26T10:45:55.177758+0000","last_became_peered":"2024-04-26T10:45:55.177758+0000","last_unstale":"2024-04-26T10:47:01.534168+0000","last_undegraded":"2024-04-26T10:47:01.534168+0000","last_fullsized":"2024-04-26T10:47:01.534168+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'393","last_scrub_stamp":"2024-04-26T10:47:01.534143+0000","last_deep_scrub":"63'393","last_deep_scrub_stamp":"2024-04-26T10:47:01.534143+0000","last_clean_scrub_stamp":"2024-04-26T10:47:01.534143+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:15.470762+0000","scrub_duration":0.0026004790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8671,"num_write":368,"num_write_kb":38542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"62'49","reported_seq":156,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:02.831959+0000","last_change":"2024-04-26T10:47:02.832067+0000","last_active":"2024-04-26T10:47:02.831959+0000","last_peered":"2024-04-26T10:47:02.831959+0000","last_clean":"2024-04-26T10:47:02.831959+0000","last_became_active":"2024-04-26T10:45:45.874328+0000","last_became_peered":"2024-04-26T10:45:45.874328+0000","last_unstale":"2024-04-26T10:47:02.831959+0000","last_undegraded":"2024-04-26T10:47:02.831959+0000","last_fullsized":"2024-04-26T10:47:02.831959+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'49","last_scrub_stamp":"2024-04-26T10:47:02.831935+0000","last_deep_scrub":"62'49","last_deep_scrub_stamp":"2024-04-26T10:47:02.831935+0000","last_clean_scrub_stamp":"2024-04-26T10:47:02.831935+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:21.771123+0000","scrub_duration":0.0016852690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"63'368","reported_seq":475,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:49.494381+0000","last_change":"2024-04-26T10:46:49.494481+0000","last_active":"2024-04-26T10:46:49.494381+0000","last_peered":"2024-04-26T10:46:49.494381+0000","last_clean":"2024-04-26T10:46:49.494381+0000","last_became_active":"2024-04-26T10:45:56.163456+0000","last_became_peered":"2024-04-26T10:45:56.163456+0000","last_unstale":"2024-04-26T10:46:49.494381+0000","last_undegraded":"2024-04-26T10:46:49.494381+0000","last_fullsized":"2024-04-26T10:46:49.494381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'368","last_scrub_stamp":"2024-04-26T10:46:49.494360+0000","last_deep_scrub":"63'368","last_deep_scrub_stamp":"2024-04-26T10:46:49.494360+0000","last_clean_scrub_stamp":"2024-04-26T10:46:49.494360+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:27.081977+0000","scrub_duration":0.0025223229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":19222,"num_write":336,"num_write_kb":58903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"84'620","reported_seq":761,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:14.719236+0000","last_change":"2024-04-26T10:47:14.719342+0000","last_active":"2024-04-26T10:47:14.719236+0000","last_peered":"2024-04-26T10:47:14.719236+0000","last_clean":"2024-04-26T10:47:14.719236+0000","last_became_active":"2024-04-26T10:45:56.161604+0000","last_became_peered":"2024-04-26T10:45:56.161604+0000","last_unstale":"2024-04-26T10:47:14.719236+0000","last_undegraded":"2024-04-26T10:47:14.719236+0000","last_fullsized":"2024-04-26T10:47:14.719236+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'620","last_scrub_stamp":"2024-04-26T10:47:14.719213+0000","last_deep_scrub":"84'620","last_deep_scrub_stamp":"2024-04-26T10:47:14.719213+0000","last_clean_scrub_stamp":"2024-04-26T10:47:14.719213+0000","objects_scrubbed":1,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:29.417733+0000","scrub_duration":0.010567363999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":558,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"63'383","reported_seq":823,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:59.682112+0000","last_change":"2024-04-26T10:45:58.165237+0000","last_active":"2024-04-26T10:45:59.682112+0000","last_peered":"2024-04-26T10:45:59.682112+0000","last_clean":"2024-04-26T10:45:59.682112+0000","last_became_active":"2024-04-26T10:45:58.162264+0000","last_became_peered":"2024-04-26T10:45:58.162264+0000","last_unstale":"2024-04-26T10:45:59.682112+0000","last_undegraded":"2024-04-26T10:45:59.682112+0000","last_fullsized":"2024-04-26T10:45:59.682112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":14260,"num_write":349,"num_write_kb":50367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":230,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161343+0000","last_change":"2024-04-26T10:45:45.871511+0000","last_active":"2024-04-26T10:45:58.161343+0000","last_peered":"2024-04-26T10:45:58.161343+0000","last_clean":"2024-04-26T10:45:58.161343+0000","last_became_active":"2024-04-26T10:45:45.871155+0000","last_became_peered":"2024-04-26T10:45:45.871155+0000","last_unstale":"2024-04-26T10:45:58.161343+0000","last_undegraded":"2024-04-26T10:45:58.161343+0000","last_fullsized":"2024-04-26T10:45:58.161343+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161402+0000","last_change":"2024-04-26T10:45:45.861068+0000","last_active":"2024-04-26T10:45:58.161402+0000","last_peered":"2024-04-26T10:45:58.161402+0000","last_clean":"2024-04-26T10:45:58.161402+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:58.161402+0000","last_undegraded":"2024-04-26T10:45:58.161402+0000","last_fullsized":"2024-04-26T10:45:58.161402+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"84'745","reported_seq":839,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:16.132144+0000","last_change":"2024-04-26T10:47:16.132263+0000","last_active":"2024-04-26T10:47:16.132144+0000","last_peered":"2024-04-26T10:47:16.132144+0000","last_clean":"2024-04-26T10:47:16.132144+0000","last_became_active":"2024-04-26T10:42:25.686009+0000","last_became_peered":"2024-04-26T10:42:25.686009+0000","last_unstale":"2024-04-26T10:47:16.132144+0000","last_undegraded":"2024-04-26T10:47:16.132144+0000","last_fullsized":"2024-04-26T10:47:16.132144+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'745","last_scrub_stamp":"2024-04-26T10:47:16.132120+0000","last_deep_scrub":"84'745","last_deep_scrub_stamp":"2024-04-26T10:47:16.132120+0000","last_clean_scrub_stamp":"2024-04-26T10:47:16.132120+0000","objects_scrubbed":2,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:40:39.935186+0000","scrub_duration":0.015566577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'442","reported_seq":579,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:48.508835+0000","last_change":"2024-04-26T10:46:48.508984+0000","last_active":"2024-04-26T10:46:48.508835+0000","last_peered":"2024-04-26T10:46:48.508835+0000","last_clean":"2024-04-26T10:46:48.508835+0000","last_became_active":"2024-04-26T10:45:55.177751+0000","last_became_peered":"2024-04-26T10:45:55.177751+0000","last_unstale":"2024-04-26T10:46:48.508835+0000","last_undegraded":"2024-04-26T10:46:48.508835+0000","last_fullsized":"2024-04-26T10:46:48.508835+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'442","last_scrub_stamp":"2024-04-26T10:46:48.508814+0000","last_deep_scrub":"63'442","last_deep_scrub_stamp":"2024-04-26T10:46:48.508814+0000","last_clean_scrub_stamp":"2024-04-26T10:46:48.508814+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:00.772322+0000","scrub_duration":0.0025059779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":34346,"num_write":406,"num_write_kb":96298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:59.508478+0000","last_change":"2024-04-26T10:46:59.508611+0000","last_active":"2024-04-26T10:46:59.508478+0000","last_peered":"2024-04-26T10:46:59.508478+0000","last_clean":"2024-04-26T10:46:59.508478+0000","last_became_active":"2024-04-26T10:45:45.871741+0000","last_became_peered":"2024-04-26T10:45:45.871741+0000","last_unstale":"2024-04-26T10:46:59.508478+0000","last_undegraded":"2024-04-26T10:46:59.508478+0000","last_fullsized":"2024-04-26T10:46:59.508478+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:46:59.508440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:46:59.508440+0000","last_clean_scrub_stamp":"2024-04-26T10:46:59.508440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:10.498353+0000","scrub_duration":0.0018823100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"63'102","reported_seq":220,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159454+0000","last_change":"2024-04-26T10:45:56.160802+0000","last_active":"2024-04-26T10:45:58.159454+0000","last_peered":"2024-04-26T10:45:58.159454+0000","last_clean":"2024-04-26T10:45:58.159454+0000","last_became_active":"2024-04-26T10:45:56.160328+0000","last_became_peered":"2024-04-26T10:45:56.160328+0000","last_unstale":"2024-04-26T10:45:58.159454+0000","last_undegraded":"2024-04-26T10:45:58.159454+0000","last_fullsized":"2024-04-26T10:45:58.159454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467631,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":44,"num_write_kb":1460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2935262,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'485","reported_seq":621,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.876202+0000","last_change":"2024-04-26T10:45:57.165815+0000","last_active":"2024-04-26T10:45:58.876202+0000","last_peered":"2024-04-26T10:45:58.876202+0000","last_clean":"2024-04-26T10:45:58.876202+0000","last_became_active":"2024-04-26T10:45:57.162752+0000","last_became_peered":"2024-04-26T10:45:57.162752+0000","last_unstale":"2024-04-26T10:45:58.876202+0000","last_undegraded":"2024-04-26T10:45:58.876202+0000","last_fullsized":"2024-04-26T10:45:58.876202+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27703,"num_write":454,"num_write_kb":121509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:48.199178+0000","last_change":"2024-04-26T10:46:48.199307+0000","last_active":"2024-04-26T10:46:48.199178+0000","last_peered":"2024-04-26T10:46:48.199178+0000","last_clean":"2024-04-26T10:46:48.199178+0000","last_became_active":"2024-04-26T10:45:53.180675+0000","last_became_peered":"2024-04-26T10:45:53.180675+0000","last_unstale":"2024-04-26T10:46:48.199178+0000","last_undegraded":"2024-04-26T10:46:48.199178+0000","last_fullsized":"2024-04-26T10:46:48.199178+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:46:48.199158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:46:48.199158+0000","last_clean_scrub_stamp":"2024-04-26T10:46:48.199158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:51:28.631493+0000","scrub_duration":0.0016680530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"84'308","reported_seq":428,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:59.784023+0000","last_change":"2024-04-26T10:46:59.784129+0000","last_active":"2024-04-26T10:46:59.784023+0000","last_peered":"2024-04-26T10:46:59.784023+0000","last_clean":"2024-04-26T10:46:59.784023+0000","last_became_active":"2024-04-26T10:45:48.864763+0000","last_became_peered":"2024-04-26T10:45:48.864763+0000","last_unstale":"2024-04-26T10:46:59.784023+0000","last_undegraded":"2024-04-26T10:46:59.784023+0000","last_fullsized":"2024-04-26T10:46:59.784023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'308","last_scrub_stamp":"2024-04-26T10:46:59.784001+0000","last_deep_scrub":"84'308","last_deep_scrub_stamp":"2024-04-26T10:46:59.784001+0000","last_clean_scrub_stamp":"2024-04-26T10:46:59.784001+0000","objects_scrubbed":2,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:33.251239+0000","scrub_duration":0.014317998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"63'336","reported_seq":749,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:59.682135+0000","last_change":"2024-04-26T10:45:58.165267+0000","last_active":"2024-04-26T10:45:59.682135+0000","last_peered":"2024-04-26T10:45:59.682135+0000","last_clean":"2024-04-26T10:45:59.682135+0000","last_became_active":"2024-04-26T10:45:58.162320+0000","last_became_peered":"2024-04-26T10:45:58.162320+0000","last_unstale":"2024-04-26T10:45:59.682135+0000","last_undegraded":"2024-04-26T10:45:59.682135+0000","last_fullsized":"2024-04-26T10:45:59.682135+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12035,"num_write":314,"num_write_kb":29928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":306,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161152+0000","last_change":"2024-04-26T10:45:45.861233+0000","last_active":"2024-04-26T10:45:58.161152+0000","last_peered":"2024-04-26T10:45:58.161152+0000","last_clean":"2024-04-26T10:45:58.161152+0000","last_became_active":"2024-04-26T10:45:45.860924+0000","last_became_peered":"2024-04-26T10:45:45.860924+0000","last_unstale":"2024-04-26T10:45:58.161152+0000","last_undegraded":"2024-04-26T10:45:58.161152+0000","last_fullsized":"2024-04-26T10:45:58.161152+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"62'64","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161518+0000","last_change":"2024-04-26T10:45:45.861230+0000","last_active":"2024-04-26T10:45:58.161518+0000","last_peered":"2024-04-26T10:45:58.161518+0000","last_clean":"2024-04-26T10:45:58.161518+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:45:58.161518+0000","last_undegraded":"2024-04-26T10:45:58.161518+0000","last_fullsized":"2024-04-26T10:45:58.161518+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"63'421","reported_seq":525,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:10.204604+0000","last_change":"2024-04-26T10:47:10.204714+0000","last_active":"2024-04-26T10:47:10.204604+0000","last_peered":"2024-04-26T10:47:10.204604+0000","last_clean":"2024-04-26T10:47:10.204604+0000","last_became_active":"2024-04-26T10:45:54.185053+0000","last_became_peered":"2024-04-26T10:45:54.185053+0000","last_unstale":"2024-04-26T10:47:10.204604+0000","last_undegraded":"2024-04-26T10:47:10.204604+0000","last_fullsized":"2024-04-26T10:47:10.204604+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'421","last_scrub_stamp":"2024-04-26T10:47:10.204582+0000","last_deep_scrub":"63'421","last_deep_scrub_stamp":"2024-04-26T10:47:10.204582+0000","last_clean_scrub_stamp":"2024-04-26T10:47:10.204582+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:56.649265+0000","scrub_duration":0.0030152209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28557,"num_write":385,"num_write_kb":93083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"62'480","reported_seq":554,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161962+0000","last_change":"2024-04-26T10:45:48.862894+0000","last_active":"2024-04-26T10:45:58.161962+0000","last_peered":"2024-04-26T10:45:58.161962+0000","last_clean":"2024-04-26T10:45:58.161962+0000","last_became_active":"2024-04-26T10:45:48.862564+0000","last_became_peered":"2024-04-26T10:45:48.862564+0000","last_unstale":"2024-04-26T10:45:58.161962+0000","last_undegraded":"2024-04-26T10:45:58.161962+0000","last_fullsized":"2024-04-26T10:45:58.161962+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:14.184935+0000","last_change":"2024-04-26T10:47:14.185031+0000","last_active":"2024-04-26T10:47:14.184935+0000","last_peered":"2024-04-26T10:47:14.184935+0000","last_clean":"2024-04-26T10:47:14.184935+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:47:14.184935+0000","last_undegraded":"2024-04-26T10:47:14.184935+0000","last_fullsized":"2024-04-26T10:47:14.184935+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:47:14.184915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:47:14.184915+0000","last_clean_scrub_stamp":"2024-04-26T10:47:14.184915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:43.653892+0000","scrub_duration":0.0016064040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'352","reported_seq":789,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:20.639969+0000","last_change":"2024-04-26T10:47:20.640088+0000","last_active":"2024-04-26T10:47:20.639969+0000","last_peered":"2024-04-26T10:47:20.639969+0000","last_clean":"2024-04-26T10:47:20.639969+0000","last_became_active":"2024-04-26T10:45:53.182454+0000","last_became_peered":"2024-04-26T10:45:53.182454+0000","last_unstale":"2024-04-26T10:47:20.639969+0000","last_undegraded":"2024-04-26T10:47:20.639969+0000","last_fullsized":"2024-04-26T10:47:20.639969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'352","last_scrub_stamp":"2024-04-26T10:47:20.639947+0000","last_deep_scrub":"63'352","last_deep_scrub_stamp":"2024-04-26T10:47:20.639947+0000","last_clean_scrub_stamp":"2024-04-26T10:47:20.639947+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:15.753783+0000","scrub_duration":0.0025067420000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":1905,"num_write":313,"num_write_kb":25573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"62'59","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:32.065405+0000","last_change":"2024-04-26T10:46:32.065523+0000","last_active":"2024-04-26T10:46:32.065405+0000","last_peered":"2024-04-26T10:46:32.065405+0000","last_clean":"2024-04-26T10:46:32.065405+0000","last_became_active":"2024-04-26T10:45:53.176996+0000","last_became_peered":"2024-04-26T10:45:53.176996+0000","last_unstale":"2024-04-26T10:46:32.065405+0000","last_undegraded":"2024-04-26T10:46:32.065405+0000","last_fullsized":"2024-04-26T10:46:32.065405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'59","last_scrub_stamp":"2024-04-26T10:46:32.065382+0000","last_deep_scrub":"62'59","last_deep_scrub_stamp":"2024-04-26T10:46:32.065382+0000","last_clean_scrub_stamp":"2024-04-26T10:46:32.065382+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:26.427635+0000","scrub_duration":0.0016833690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":89,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162375+0000","last_change":"2024-04-26T10:45:53.175046+0000","last_active":"2024-04-26T10:45:58.162375+0000","last_peered":"2024-04-26T10:45:58.162375+0000","last_clean":"2024-04-26T10:45:58.162375+0000","last_became_active":"2024-04-26T10:45:53.174781+0000","last_became_peered":"2024-04-26T10:45:53.174781+0000","last_unstale":"2024-04-26T10:45:58.162375+0000","last_undegraded":"2024-04-26T10:45:58.162375+0000","last_fullsized":"2024-04-26T10:45:58.162375+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'408","reported_seq":920,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:31.846626+0000","last_change":"2024-04-26T10:46:31.846626+0000","last_active":"2024-04-26T10:46:31.846626+0000","last_peered":"2024-04-26T10:46:31.846626+0000","last_clean":"2024-04-26T10:46:31.846626+0000","last_became_active":"2024-04-26T10:45:54.185238+0000","last_became_peered":"2024-04-26T10:45:54.185238+0000","last_unstale":"2024-04-26T10:46:31.846626+0000","last_undegraded":"2024-04-26T10:46:31.846626+0000","last_fullsized":"2024-04-26T10:46:31.846626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:31.846485+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:31.846485+0000","last_clean_scrub_stamp":"2024-04-26T10:46:31.846485+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:36.109042+0000","scrub_duration":0.0024474840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19939,"num_write":382,"num_write_kb":63433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"84'56","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:43.249487+0000","last_change":"2024-04-26T10:46:43.249602+0000","last_active":"2024-04-26T10:46:43.249487+0000","last_peered":"2024-04-26T10:46:43.249487+0000","last_clean":"2024-04-26T10:46:43.249487+0000","last_became_active":"2024-04-26T10:45:53.177305+0000","last_became_peered":"2024-04-26T10:45:53.177305+0000","last_unstale":"2024-04-26T10:46:43.249487+0000","last_undegraded":"2024-04-26T10:46:43.249487+0000","last_fullsized":"2024-04-26T10:46:43.249487+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'56","last_scrub_stamp":"2024-04-26T10:46:43.249467+0000","last_deep_scrub":"84'56","last_deep_scrub_stamp":"2024-04-26T10:46:43.249467+0000","last_clean_scrub_stamp":"2024-04-26T10:46:43.249467+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:52.720824+0000","scrub_duration":0.0031266789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:38.180460+0000","last_change":"2024-04-26T10:46:38.180572+0000","last_active":"2024-04-26T10:46:38.180460+0000","last_peered":"2024-04-26T10:46:38.180460+0000","last_clean":"2024-04-26T10:46:38.180460+0000","last_became_active":"2024-04-26T10:45:53.177249+0000","last_became_peered":"2024-04-26T10:45:53.177249+0000","last_unstale":"2024-04-26T10:46:38.180460+0000","last_undegraded":"2024-04-26T10:46:38.180460+0000","last_fullsized":"2024-04-26T10:46:38.180460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:46:38.180438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:46:38.180438+0000","last_clean_scrub_stamp":"2024-04-26T10:46:38.180438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:09.067544+0000","scrub_duration":0.00179721,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'418","reported_seq":889,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:04.180135+0000","last_change":"2024-04-26T10:47:04.180286+0000","last_active":"2024-04-26T10:47:04.180135+0000","last_peered":"2024-04-26T10:47:04.180135+0000","last_clean":"2024-04-26T10:47:04.180135+0000","last_became_active":"2024-04-26T10:45:56.160440+0000","last_became_peered":"2024-04-26T10:45:56.160440+0000","last_unstale":"2024-04-26T10:47:04.180135+0000","last_undegraded":"2024-04-26T10:47:04.180135+0000","last_fullsized":"2024-04-26T10:47:04.180135+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'418","last_scrub_stamp":"2024-04-26T10:47:04.180097+0000","last_deep_scrub":"63'418","last_deep_scrub_stamp":"2024-04-26T10:47:04.180097+0000","last_clean_scrub_stamp":"2024-04-26T10:47:04.180097+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:48.800820+0000","scrub_duration":0.0025539730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20110,"num_write":390,"num_write_kb":75171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"84'67","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:20.114106+0000","last_change":"2024-04-26T10:46:20.114217+0000","last_active":"2024-04-26T10:46:20.114106+0000","last_peered":"2024-04-26T10:46:20.114106+0000","last_clean":"2024-04-26T10:46:20.114106+0000","last_became_active":"2024-04-26T10:45:53.175946+0000","last_became_peered":"2024-04-26T10:45:53.175946+0000","last_unstale":"2024-04-26T10:46:20.114106+0000","last_undegraded":"2024-04-26T10:46:20.114106+0000","last_fullsized":"2024-04-26T10:46:20.114106+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'67","last_scrub_stamp":"2024-04-26T10:46:20.114082+0000","last_deep_scrub":"84'67","last_deep_scrub_stamp":"2024-04-26T10:46:20.114082+0000","last_clean_scrub_stamp":"2024-04-26T10:46:20.114082+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:16.069289+0000","scrub_duration":0.00304288,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162589+0000","last_change":"2024-04-26T10:45:45.872224+0000","last_active":"2024-04-26T10:45:58.162589+0000","last_peered":"2024-04-26T10:45:58.162589+0000","last_clean":"2024-04-26T10:45:58.162589+0000","last_became_active":"2024-04-26T10:45:45.871923+0000","last_became_peered":"2024-04-26T10:45:45.871923+0000","last_unstale":"2024-04-26T10:45:58.162589+0000","last_undegraded":"2024-04-26T10:45:58.162589+0000","last_fullsized":"2024-04-26T10:45:58.162589+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"63'404","reported_seq":934,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:27.939150+0000","last_change":"2024-04-26T10:46:27.939150+0000","last_active":"2024-04-26T10:46:27.939150+0000","last_peered":"2024-04-26T10:46:27.939150+0000","last_clean":"2024-04-26T10:46:27.939150+0000","last_became_active":"2024-04-26T10:45:54.181795+0000","last_became_peered":"2024-04-26T10:45:54.181795+0000","last_unstale":"2024-04-26T10:46:27.939150+0000","last_undegraded":"2024-04-26T10:46:27.939150+0000","last_fullsized":"2024-04-26T10:46:27.939150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'404","last_scrub_stamp":"2024-04-26T10:46:27.939009+0000","last_deep_scrub":"63'404","last_deep_scrub_stamp":"2024-04-26T10:46:27.939009+0000","last_clean_scrub_stamp":"2024-04-26T10:46:27.939009+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:43.424977+0000","scrub_duration":0.0025994030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41262,"num_write":371,"num_write_kb":75820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"63'441","reported_seq":576,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:18.633017+0000","last_change":"2024-04-26T10:47:18.633141+0000","last_active":"2024-04-26T10:47:18.633017+0000","last_peered":"2024-04-26T10:47:18.633017+0000","last_clean":"2024-04-26T10:47:18.633017+0000","last_became_active":"2024-04-26T10:45:54.185862+0000","last_became_peered":"2024-04-26T10:45:54.185862+0000","last_unstale":"2024-04-26T10:47:18.633017+0000","last_undegraded":"2024-04-26T10:47:18.633017+0000","last_fullsized":"2024-04-26T10:47:18.633017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'441","last_scrub_stamp":"2024-04-26T10:47:18.632997+0000","last_deep_scrub":"63'441","last_deep_scrub_stamp":"2024-04-26T10:47:18.632997+0000","last_clean_scrub_stamp":"2024-04-26T10:47:18.632997+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:05.485177+0000","scrub_duration":0.0027604090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31514,"num_write":408,"num_write_kb":107129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"64'431","reported_seq":521,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161811+0000","last_change":"2024-04-26T10:45:48.865579+0000","last_active":"2024-04-26T10:45:58.161811+0000","last_peered":"2024-04-26T10:45:58.161811+0000","last_clean":"2024-04-26T10:45:58.161811+0000","last_became_active":"2024-04-26T10:45:48.865212+0000","last_became_peered":"2024-04-26T10:45:48.865212+0000","last_unstale":"2024-04-26T10:45:58.161811+0000","last_undegraded":"2024-04-26T10:45:58.161811+0000","last_fullsized":"2024-04-26T10:45:58.161811+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9902610,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":9913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9896193,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"63'410","reported_seq":516,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161317+0000","last_change":"2024-04-26T10:45:54.184713+0000","last_active":"2024-04-26T10:45:58.161317+0000","last_peered":"2024-04-26T10:45:58.161317+0000","last_clean":"2024-04-26T10:45:58.161317+0000","last_became_active":"2024-04-26T10:45:54.182167+0000","last_became_peered":"2024-04-26T10:45:54.182167+0000","last_unstale":"2024-04-26T10:45:58.161317+0000","last_undegraded":"2024-04-26T10:45:58.161317+0000","last_fullsized":"2024-04-26T10:45:58.161317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12734,"num_write":373,"num_write_kb":34864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"84'86","reported_seq":198,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:03.871072+0000","last_change":"2024-04-26T10:47:03.871072+0000","last_active":"2024-04-26T10:47:03.871072+0000","last_peered":"2024-04-26T10:47:03.871072+0000","last_clean":"2024-04-26T10:47:03.871072+0000","last_became_active":"2024-04-26T10:45:45.874746+0000","last_became_peered":"2024-04-26T10:45:45.874746+0000","last_unstale":"2024-04-26T10:47:03.871072+0000","last_undegraded":"2024-04-26T10:47:03.871072+0000","last_fullsized":"2024-04-26T10:47:03.871072+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'86","last_scrub_stamp":"2024-04-26T10:47:03.870909+0000","last_deep_scrub":"84'86","last_deep_scrub_stamp":"2024-04-26T10:47:03.870909+0000","last_clean_scrub_stamp":"2024-04-26T10:47:03.870909+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:03:47.013205+0000","scrub_duration":0.0039681769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"84'333","reported_seq":432,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:14.252839+0000","last_change":"2024-04-26T10:46:14.252936+0000","last_active":"2024-04-26T10:46:14.252839+0000","last_peered":"2024-04-26T10:46:14.252839+0000","last_clean":"2024-04-26T10:46:14.252839+0000","last_became_active":"2024-04-26T10:45:56.161449+0000","last_became_peered":"2024-04-26T10:45:56.161449+0000","last_unstale":"2024-04-26T10:46:14.252839+0000","last_undegraded":"2024-04-26T10:46:14.252839+0000","last_fullsized":"2024-04-26T10:46:14.252839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'333","last_scrub_stamp":"2024-04-26T10:46:14.252815+0000","last_deep_scrub":"84'333","last_deep_scrub_stamp":"2024-04-26T10:46:14.252815+0000","last_clean_scrub_stamp":"2024-04-26T10:46:14.252815+0000","objects_scrubbed":1,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:06.020647+0000","scrub_duration":0.0087233659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"63'487","reported_seq":1109,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:22.045006+0000","last_change":"2024-04-26T10:47:22.045108+0000","last_active":"2024-04-26T10:47:22.045006+0000","last_peered":"2024-04-26T10:47:22.045006+0000","last_clean":"2024-04-26T10:47:22.045006+0000","last_became_active":"2024-04-26T10:45:51.159235+0000","last_became_peered":"2024-04-26T10:45:51.159235+0000","last_unstale":"2024-04-26T10:47:22.045006+0000","last_undegraded":"2024-04-26T10:47:22.045006+0000","last_fullsized":"2024-04-26T10:47:22.045006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'487","last_scrub_stamp":"2024-04-26T10:47:22.044982+0000","last_deep_scrub":"63'487","last_deep_scrub_stamp":"2024-04-26T10:47:22.044982+0000","last_clean_scrub_stamp":"2024-04-26T10:47:22.044982+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:31.153345+0000","scrub_duration":0.0026463189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":43316,"num_write":468,"num_write_kb":77062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"62'61","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:11.105029+0000","last_change":"2024-04-26T10:46:11.105133+0000","last_active":"2024-04-26T10:46:11.105029+0000","last_peered":"2024-04-26T10:46:11.105029+0000","last_clean":"2024-04-26T10:46:11.105029+0000","last_became_active":"2024-04-26T10:45:53.173851+0000","last_became_peered":"2024-04-26T10:45:53.173851+0000","last_unstale":"2024-04-26T10:46:11.105029+0000","last_undegraded":"2024-04-26T10:46:11.105029+0000","last_fullsized":"2024-04-26T10:46:11.105029+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'61","last_scrub_stamp":"2024-04-26T10:46:11.105005+0000","last_deep_scrub":"62'61","last_deep_scrub_stamp":"2024-04-26T10:46:11.105005+0000","last_clean_scrub_stamp":"2024-04-26T10:46:11.105005+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:57.257799+0000","scrub_duration":0.0016999000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'457","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:47.223896+0000","last_change":"2024-04-26T10:46:47.224014+0000","last_active":"2024-04-26T10:46:47.223896+0000","last_peered":"2024-04-26T10:46:47.223896+0000","last_clean":"2024-04-26T10:46:47.223896+0000","last_became_active":"2024-04-26T10:45:54.189622+0000","last_became_peered":"2024-04-26T10:45:54.189622+0000","last_unstale":"2024-04-26T10:46:47.223896+0000","last_undegraded":"2024-04-26T10:46:47.223896+0000","last_fullsized":"2024-04-26T10:46:47.223896+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'457","last_scrub_stamp":"2024-04-26T10:46:47.223873+0000","last_deep_scrub":"63'457","last_deep_scrub_stamp":"2024-04-26T10:46:47.223873+0000","last_clean_scrub_stamp":"2024-04-26T10:46:47.223873+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:53:33.293955+0000","scrub_duration":0.003282943,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14848,"num_write":427,"num_write_kb":71903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'377","reported_seq":851,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:29.894860+0000","last_change":"2024-04-26T10:46:29.894860+0000","last_active":"2024-04-26T10:46:29.894860+0000","last_peered":"2024-04-26T10:46:29.894860+0000","last_clean":"2024-04-26T10:46:29.894860+0000","last_became_active":"2024-04-26T10:45:49.866707+0000","last_became_peered":"2024-04-26T10:45:49.866707+0000","last_unstale":"2024-04-26T10:46:29.894860+0000","last_undegraded":"2024-04-26T10:46:29.894860+0000","last_fullsized":"2024-04-26T10:46:29.894860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'377","last_scrub_stamp":"2024-04-26T10:46:29.894727+0000","last_deep_scrub":"63'377","last_deep_scrub_stamp":"2024-04-26T10:46:29.894727+0000","last_clean_scrub_stamp":"2024-04-26T10:46:29.894727+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:20.517004+0000","scrub_duration":0.0019921740000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26932,"num_write":349,"num_write_kb":55611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"84'564","reported_seq":658,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:21.029077+0000","last_change":"2024-04-26T10:47:21.029194+0000","last_active":"2024-04-26T10:47:21.029077+0000","last_peered":"2024-04-26T10:47:21.029077+0000","last_clean":"2024-04-26T10:47:21.029077+0000","last_became_active":"2024-04-26T10:42:25.683467+0000","last_became_peered":"2024-04-26T10:42:25.683467+0000","last_unstale":"2024-04-26T10:47:21.029077+0000","last_undegraded":"2024-04-26T10:47:21.029077+0000","last_fullsized":"2024-04-26T10:47:21.029077+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'564","last_scrub_stamp":"2024-04-26T10:47:21.029056+0000","last_deep_scrub":"84'564","last_deep_scrub_stamp":"2024-04-26T10:47:21.029056+0000","last_clean_scrub_stamp":"2024-04-26T10:47:21.029056+0000","objects_scrubbed":2,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:57.701118+0000","scrub_duration":0.016487087000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":8440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'425","reported_seq":879,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160491+0000","last_change":"2024-04-26T10:45:56.163245+0000","last_active":"2024-04-26T10:45:58.160491+0000","last_peered":"2024-04-26T10:45:58.160491+0000","last_clean":"2024-04-26T10:45:58.160491+0000","last_became_active":"2024-04-26T10:45:56.161315+0000","last_became_peered":"2024-04-26T10:45:56.161315+0000","last_unstale":"2024-04-26T10:45:58.160491+0000","last_undegraded":"2024-04-26T10:45:58.160491+0000","last_fullsized":"2024-04-26T10:45:58.160491+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":19004,"num_write":390,"num_write_kb":75524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"62'259","reported_seq":332,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.159752+0000","last_change":"2024-04-26T10:45:56.160840+0000","last_active":"2024-04-26T10:45:58.159752+0000","last_peered":"2024-04-26T10:45:58.159752+0000","last_clean":"2024-04-26T10:45:58.159752+0000","last_became_active":"2024-04-26T10:45:56.160344+0000","last_became_peered":"2024-04-26T10:45:56.160344+0000","last_unstale":"2024-04-26T10:45:58.159752+0000","last_undegraded":"2024-04-26T10:45:58.159752+0000","last_fullsized":"2024-04-26T10:45:58.159752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'418","reported_seq":941,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:41.880581+0000","last_change":"2024-04-26T10:46:41.881058+0000","last_active":"2024-04-26T10:46:41.880581+0000","last_peered":"2024-04-26T10:46:41.880581+0000","last_clean":"2024-04-26T10:46:41.880581+0000","last_became_active":"2024-04-26T10:45:55.178079+0000","last_became_peered":"2024-04-26T10:45:55.178079+0000","last_unstale":"2024-04-26T10:46:41.880581+0000","last_undegraded":"2024-04-26T10:46:41.880581+0000","last_fullsized":"2024-04-26T10:46:41.880581+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'418","last_scrub_stamp":"2024-04-26T10:46:41.880550+0000","last_deep_scrub":"63'418","last_deep_scrub_stamp":"2024-04-26T10:46:41.880550+0000","last_clean_scrub_stamp":"2024-04-26T10:46:41.880550+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:06:37.113070+0000","scrub_duration":0.0024544520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":34476,"num_write":379,"num_write_kb":101645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"84'497","reported_seq":590,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:05.841771+0000","last_change":"2024-04-26T10:47:05.841910+0000","last_active":"2024-04-26T10:47:05.841771+0000","last_peered":"2024-04-26T10:47:05.841771+0000","last_clean":"2024-04-26T10:47:05.841771+0000","last_became_active":"2024-04-26T10:42:25.687829+0000","last_became_peered":"2024-04-26T10:42:25.687829+0000","last_unstale":"2024-04-26T10:47:05.841771+0000","last_undegraded":"2024-04-26T10:47:05.841771+0000","last_fullsized":"2024-04-26T10:47:05.841771+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'497","last_scrub_stamp":"2024-04-26T10:47:05.841747+0000","last_deep_scrub":"84'497","last_deep_scrub_stamp":"2024-04-26T10:47:05.841747+0000","last_clean_scrub_stamp":"2024-04-26T10:47:05.841747+0000","objects_scrubbed":3,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:04.414657+0000","scrub_duration":0.021777650999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":12543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"63'406","reported_seq":587,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.160465+0000","last_change":"2024-04-26T10:45:54.192178+0000","last_active":"2024-04-26T10:45:58.160465+0000","last_peered":"2024-04-26T10:45:58.160465+0000","last_clean":"2024-04-26T10:45:58.160465+0000","last_became_active":"2024-04-26T10:45:54.189591+0000","last_became_peered":"2024-04-26T10:45:54.189591+0000","last_unstale":"2024-04-26T10:45:58.160465+0000","last_undegraded":"2024-04-26T10:45:58.160465+0000","last_fullsized":"2024-04-26T10:45:58.160465+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":45941,"num_write":372,"num_write_kb":80011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"84'62","reported_seq":173,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:06.870171+0000","last_change":"2024-04-26T10:47:06.870273+0000","last_active":"2024-04-26T10:47:06.870171+0000","last_peered":"2024-04-26T10:47:06.870171+0000","last_clean":"2024-04-26T10:47:06.870171+0000","last_became_active":"2024-04-26T10:45:45.874300+0000","last_became_peered":"2024-04-26T10:45:45.874300+0000","last_unstale":"2024-04-26T10:47:06.870171+0000","last_undegraded":"2024-04-26T10:47:06.870171+0000","last_fullsized":"2024-04-26T10:47:06.870171+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'62","last_scrub_stamp":"2024-04-26T10:47:06.870147+0000","last_deep_scrub":"84'62","last_deep_scrub_stamp":"2024-04-26T10:47:06.870147+0000","last_clean_scrub_stamp":"2024-04-26T10:47:06.870147+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:46.778599+0000","scrub_duration":0.0095987950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"63'375","reported_seq":835,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:19.295162+0000","last_change":"2024-04-26T10:46:19.295289+0000","last_active":"2024-04-26T10:46:19.295162+0000","last_peered":"2024-04-26T10:46:19.295162+0000","last_clean":"2024-04-26T10:46:19.295162+0000","last_became_active":"2024-04-26T10:45:56.160416+0000","last_became_peered":"2024-04-26T10:45:56.160416+0000","last_unstale":"2024-04-26T10:46:19.295162+0000","last_undegraded":"2024-04-26T10:46:19.295162+0000","last_fullsized":"2024-04-26T10:46:19.295162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'375","last_scrub_stamp":"2024-04-26T10:46:19.295138+0000","last_deep_scrub":"63'375","last_deep_scrub_stamp":"2024-04-26T10:46:19.295138+0000","last_clean_scrub_stamp":"2024-04-26T10:46:19.295138+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:58.675348+0000","scrub_duration":0.0023697280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16213,"num_write":354,"num_write_kb":54493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":332,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"84'278","reported_seq":382,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:12.320143+0000","last_change":"2024-04-26T10:46:12.320242+0000","last_active":"2024-04-26T10:46:12.320143+0000","last_peered":"2024-04-26T10:46:12.320143+0000","last_clean":"2024-04-26T10:46:12.320143+0000","last_became_active":"2024-04-26T10:45:56.160414+0000","last_became_peered":"2024-04-26T10:45:56.160414+0000","last_unstale":"2024-04-26T10:46:12.320143+0000","last_undegraded":"2024-04-26T10:46:12.320143+0000","last_fullsized":"2024-04-26T10:46:12.320143+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'278","last_scrub_stamp":"2024-04-26T10:46:12.320120+0000","last_deep_scrub":"84'278","last_deep_scrub_stamp":"2024-04-26T10:46:12.320120+0000","last_clean_scrub_stamp":"2024-04-26T10:46:12.320120+0000","objects_scrubbed":2,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:17:48.308771+0000","scrub_duration":0.0082694940000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"63'379","reported_seq":476,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161505+0000","last_change":"2024-04-26T10:45:53.177365+0000","last_active":"2024-04-26T10:45:58.161505+0000","last_peered":"2024-04-26T10:45:58.161505+0000","last_clean":"2024-04-26T10:45:58.161505+0000","last_became_active":"2024-04-26T10:45:53.173645+0000","last_became_peered":"2024-04-26T10:45:53.173645+0000","last_unstale":"2024-04-26T10:45:58.161505+0000","last_undegraded":"2024-04-26T10:45:58.161505+0000","last_fullsized":"2024-04-26T10:45:58.161505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20480,"num_write":343,"num_write_kb":25788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"84'241","reported_seq":363,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:58.792941+0000","last_change":"2024-04-26T10:46:58.793068+0000","last_active":"2024-04-26T10:46:58.792941+0000","last_peered":"2024-04-26T10:46:58.792941+0000","last_clean":"2024-04-26T10:46:58.792941+0000","last_became_active":"2024-04-26T10:45:48.866716+0000","last_became_peered":"2024-04-26T10:45:48.866716+0000","last_unstale":"2024-04-26T10:46:58.792941+0000","last_undegraded":"2024-04-26T10:46:58.792941+0000","last_fullsized":"2024-04-26T10:46:58.792941+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'241","last_scrub_stamp":"2024-04-26T10:46:58.792919+0000","last_deep_scrub":"84'241","last_deep_scrub_stamp":"2024-04-26T10:46:58.792919+0000","last_clean_scrub_stamp":"2024-04-26T10:46:58.792919+0000","objects_scrubbed":4,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:35.543499+0000","scrub_duration":0.021440362000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":12393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"63'419","reported_seq":583,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:54.737707+0000","last_change":"2024-04-26T10:46:54.737707+0000","last_active":"2024-04-26T10:46:54.737707+0000","last_peered":"2024-04-26T10:46:54.737707+0000","last_clean":"2024-04-26T10:46:54.737707+0000","last_became_active":"2024-04-26T10:42:26.040504+0000","last_became_peered":"2024-04-26T10:42:26.040504+0000","last_unstale":"2024-04-26T10:46:54.737707+0000","last_undegraded":"2024-04-26T10:46:54.737707+0000","last_fullsized":"2024-04-26T10:46:54.737707+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'419","last_scrub_stamp":"2024-04-26T10:46:54.737548+0000","last_deep_scrub":"63'419","last_deep_scrub_stamp":"2024-04-26T10:46:54.737548+0000","last_clean_scrub_stamp":"2024-04-26T10:46:54.737548+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:36.073071+0000","scrub_duration":0.0037174790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39582,"num_write":378,"num_write_kb":54867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"84'62","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:09.103458+0000","last_change":"2024-04-26T10:46:09.103560+0000","last_active":"2024-04-26T10:46:09.103458+0000","last_peered":"2024-04-26T10:46:09.103458+0000","last_clean":"2024-04-26T10:46:09.103458+0000","last_became_active":"2024-04-26T10:45:53.178804+0000","last_became_peered":"2024-04-26T10:45:53.178804+0000","last_unstale":"2024-04-26T10:46:09.103458+0000","last_undegraded":"2024-04-26T10:46:09.103458+0000","last_fullsized":"2024-04-26T10:46:09.103458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'62","last_scrub_stamp":"2024-04-26T10:46:09.103432+0000","last_deep_scrub":"84'62","last_deep_scrub_stamp":"2024-04-26T10:46:09.103432+0000","last_clean_scrub_stamp":"2024-04-26T10:46:09.103432+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:25.007335+0000","scrub_duration":0.00814082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'437","reported_seq":535,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:18.250920+0000","last_change":"2024-04-26T10:46:18.251026+0000","last_active":"2024-04-26T10:46:18.250920+0000","last_peered":"2024-04-26T10:46:18.250920+0000","last_clean":"2024-04-26T10:46:18.250920+0000","last_became_active":"2024-04-26T10:45:53.177071+0000","last_became_peered":"2024-04-26T10:45:53.177071+0000","last_unstale":"2024-04-26T10:46:18.250920+0000","last_undegraded":"2024-04-26T10:46:18.250920+0000","last_fullsized":"2024-04-26T10:46:18.250920+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'437","last_scrub_stamp":"2024-04-26T10:46:18.250898+0000","last_deep_scrub":"63'437","last_deep_scrub_stamp":"2024-04-26T10:46:18.250898+0000","last_clean_scrub_stamp":"2024-04-26T10:46:18.250898+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:10.767270+0000","scrub_duration":0.002104093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":7562,"num_write":400,"num_write_kb":26121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"84'61","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:25.042019+0000","last_change":"2024-04-26T10:46:25.042141+0000","last_active":"2024-04-26T10:46:25.042019+0000","last_peered":"2024-04-26T10:46:25.042019+0000","last_clean":"2024-04-26T10:46:25.042019+0000","last_became_active":"2024-04-26T10:45:53.173542+0000","last_became_peered":"2024-04-26T10:45:53.173542+0000","last_unstale":"2024-04-26T10:46:25.042019+0000","last_undegraded":"2024-04-26T10:46:25.042019+0000","last_fullsized":"2024-04-26T10:46:25.042019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'61","last_scrub_stamp":"2024-04-26T10:46:25.041995+0000","last_deep_scrub":"84'61","last_deep_scrub_stamp":"2024-04-26T10:46:25.041995+0000","last_clean_scrub_stamp":"2024-04-26T10:46:25.041995+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:44:18.722171+0000","scrub_duration":0.010280186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2672,"num_read_kb":1454712,"num_write":24538,"num_write_kb":4190103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26671,"ondisk_log_size":26671,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128811551,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":5770,"num_write_kb":129888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257691648,"data_stored":257623102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},"log_size":7632,"ondisk_log_size":7632,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738433,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187500,"kb_used_data":80164,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94184340,"statfs":{"total":96636764160,"available":96444764160,"internally_reserved":0,"allocated":82087936,"data_stored":81566103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:46:25 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.42199999999999999,"15min":0.43099999999999999},"min":{"1min":0.20599999999999999,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.57199999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.42699999999999999,"15min":0.436},"min":{"1min":0.216,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.45000000000000001}]},{"osd":1,"last update":"Fri Apr 26 10:46:49 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.52800000000000002}]}]},{"osd":1,"up_from":70,"seq":300647710742,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136016,"kb_used_data":90440,"kb_used_omap":7,"kb_used_meta":45560,"kb_avail":94235824,"statfs":{"total":96636764160,"available":96497483776,"internally_reserved":0,"allocated":92610560,"data_stored":92059263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7181,"internal_metadata":46654451},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:46:45 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.52300000000000002}]},{"osd":2,"last update":"Fri Apr 26 10:46:45 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.435}]}]},{"osd":0,"up_from":8,"seq":34359738434,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214376,"kb_used_data":84896,"kb_used_omap":1,"kb_used_meta":129470,"kb_avail":94157464,"statfs":{"total":96636764160,"available":96417243136,"internally_reserved":0,"allocated":86933504,"data_stored":86396712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132577734},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.504},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Apr 26 10:46:29 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.42999999999999999,"15min":0.44900000000000001},"min":{"1min":0.253,"5min":0.183,"15min":0.183},"max":{"1min":0.58999999999999997,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.437,"15min":0.46300000000000002},"min":{"1min":0.23999999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.65700000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.59999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":85422080,"data_stored":85400264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":91099136,"data_stored":91062815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81170432,"data_stored":81160023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:47:29.545 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.545 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.545 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.545 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.545 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.545 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.546 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.546 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.546 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.546 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.546 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.546 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.547 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.547 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.547 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.547 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.547 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.547 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.547 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.547 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.548 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.548 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.548 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.548 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.548 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.548 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.548 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.549 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.549 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.549 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.549 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.549 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:29.549 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T10:47:49.550 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:47:49.867 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:47:49.869 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:47:49.877 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":247,"stamp":"2024-04-26T10:47:49.678823+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129401919,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2852,"num_read_kb":1456290,"num_write":30511,"num_write_kb":4323451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9253,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34473,"ondisk_log_size":34473,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":541988,"kb_used_data":255500,"kb_used_omap":10,"kb_used_meta":286453,"kb_avail":282573532,"statfs":{"total":289910292480,"available":289355296768,"internally_reserved":0,"allocated":261632000,"data_stored":260022078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10369,"internal_metadata":293328767},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002842"},"pg_stats":[{"pgid":"4.3f","version":"63'415","reported_seq":554,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:52.748402+0000","last_change":"2024-04-26T10:46:52.748512+0000","last_active":"2024-04-26T10:46:52.748402+0000","last_peered":"2024-04-26T10:46:52.748402+0000","last_clean":"2024-04-26T10:46:52.748402+0000","last_became_active":"2024-04-26T10:42:26.044597+0000","last_became_peered":"2024-04-26T10:42:26.044597+0000","last_unstale":"2024-04-26T10:46:52.748402+0000","last_undegraded":"2024-04-26T10:46:52.748402+0000","last_fullsized":"2024-04-26T10:46:52.748402+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'415","last_scrub_stamp":"2024-04-26T10:46:52.748380+0000","last_deep_scrub":"63'415","last_deep_scrub_stamp":"2024-04-26T10:46:52.748380+0000","last_clean_scrub_stamp":"2024-04-26T10:46:52.748380+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:44.118436+0000","scrub_duration":0.002346842,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22963,"num_write":385,"num_write_kb":71406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"63'396","reported_seq":534,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:40.755775+0000","last_change":"2024-04-26T10:47:40.755886+0000","last_active":"2024-04-26T10:47:40.755775+0000","last_peered":"2024-04-26T10:47:40.755775+0000","last_clean":"2024-04-26T10:47:40.755775+0000","last_became_active":"2024-04-26T10:45:54.192613+0000","last_became_peered":"2024-04-26T10:45:54.192613+0000","last_unstale":"2024-04-26T10:47:40.755775+0000","last_undegraded":"2024-04-26T10:47:40.755775+0000","last_fullsized":"2024-04-26T10:47:40.755775+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'396","last_scrub_stamp":"2024-04-26T10:47:40.755755+0000","last_deep_scrub":"63'396","last_deep_scrub_stamp":"2024-04-26T10:47:40.755755+0000","last_clean_scrub_stamp":"2024-04-26T10:47:40.755755+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:20.899080+0000","scrub_duration":0.0034271380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9499,"num_write":371,"num_write_kb":38601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"63'366","reported_seq":462,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:24.288483+0000","last_change":"2024-04-26T10:46:24.288483+0000","last_active":"2024-04-26T10:46:24.288483+0000","last_peered":"2024-04-26T10:46:24.288483+0000","last_clean":"2024-04-26T10:46:24.288483+0000","last_became_active":"2024-04-26T10:45:55.180991+0000","last_became_peered":"2024-04-26T10:45:55.180991+0000","last_unstale":"2024-04-26T10:46:24.288483+0000","last_undegraded":"2024-04-26T10:46:24.288483+0000","last_fullsized":"2024-04-26T10:46:24.288483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'366","last_scrub_stamp":"2024-04-26T10:46:24.288343+0000","last_deep_scrub":"63'366","last_deep_scrub_stamp":"2024-04-26T10:46:24.288343+0000","last_clean_scrub_stamp":"2024-04-26T10:46:24.288343+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:09.803889+0000","scrub_duration":0.0024847200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6211,"num_write":338,"num_write_kb":38844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"63'394","reported_seq":558,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:27.644272+0000","last_change":"2024-04-26T10:47:27.644272+0000","last_active":"2024-04-26T10:47:27.644272+0000","last_peered":"2024-04-26T10:47:27.644272+0000","last_clean":"2024-04-26T10:47:27.644272+0000","last_became_active":"2024-04-26T10:45:51.159099+0000","last_became_peered":"2024-04-26T10:45:51.159099+0000","last_unstale":"2024-04-26T10:47:27.644272+0000","last_undegraded":"2024-04-26T10:47:27.644272+0000","last_fullsized":"2024-04-26T10:47:27.644272+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'394","last_scrub_stamp":"2024-04-26T10:47:27.644141+0000","last_deep_scrub":"63'394","last_deep_scrub_stamp":"2024-04-26T10:47:27.644141+0000","last_clean_scrub_stamp":"2024-04-26T10:47:27.644141+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:03.603073+0000","scrub_duration":0.00246729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":52323,"num_write":357,"num_write_kb":63323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"63'409","reported_seq":520,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:46.894628+0000","last_change":"2024-04-26T10:46:46.894628+0000","last_active":"2024-04-26T10:46:46.894628+0000","last_peered":"2024-04-26T10:46:46.894628+0000","last_clean":"2024-04-26T10:46:46.894628+0000","last_became_active":"2024-04-26T10:42:26.040487+0000","last_became_peered":"2024-04-26T10:42:26.040487+0000","last_unstale":"2024-04-26T10:46:46.894628+0000","last_undegraded":"2024-04-26T10:46:46.894628+0000","last_fullsized":"2024-04-26T10:46:46.894628+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'409","last_scrub_stamp":"2024-04-26T10:46:46.894476+0000","last_deep_scrub":"63'409","last_deep_scrub_stamp":"2024-04-26T10:46:46.894476+0000","last_clean_scrub_stamp":"2024-04-26T10:46:46.894476+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:34.325893+0000","scrub_duration":0.0034301790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":372,"num_write_kb":42764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'385","reported_seq":476,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:21.300652+0000","last_change":"2024-04-26T10:46:21.300788+0000","last_active":"2024-04-26T10:46:21.300652+0000","last_peered":"2024-04-26T10:46:21.300652+0000","last_clean":"2024-04-26T10:46:21.300652+0000","last_became_active":"2024-04-26T10:45:49.861811+0000","last_became_peered":"2024-04-26T10:45:49.861811+0000","last_unstale":"2024-04-26T10:46:21.300652+0000","last_undegraded":"2024-04-26T10:46:21.300652+0000","last_fullsized":"2024-04-26T10:46:21.300652+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'385","last_scrub_stamp":"2024-04-26T10:46:21.300632+0000","last_deep_scrub":"63'385","last_deep_scrub_stamp":"2024-04-26T10:46:21.300632+0000","last_clean_scrub_stamp":"2024-04-26T10:46:21.300632+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:50.462322+0000","scrub_duration":0.0030393180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4124,"num_write":356,"num_write_kb":69857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"63'425","reported_seq":535,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161609+0000","last_change":"2024-04-26T10:45:50.869572+0000","last_active":"2024-04-26T10:45:58.161609+0000","last_peered":"2024-04-26T10:45:58.161609+0000","last_clean":"2024-04-26T10:45:58.161609+0000","last_became_active":"2024-04-26T10:45:50.866996+0000","last_became_peered":"2024-04-26T10:45:50.866996+0000","last_unstale":"2024-04-26T10:45:58.161609+0000","last_undegraded":"2024-04-26T10:45:58.161609+0000","last_fullsized":"2024-04-26T10:45:58.161609+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13036,"num_write":390,"num_write_kb":67193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"63'399","reported_seq":508,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.164893+0000","last_change":"2024-04-26T10:45:58.164304+0000","last_active":"2024-04-26T10:45:58.164893+0000","last_peered":"2024-04-26T10:45:58.164893+0000","last_clean":"2024-04-26T10:45:58.164893+0000","last_became_active":"2024-04-26T10:45:58.162532+0000","last_became_peered":"2024-04-26T10:45:58.162532+0000","last_unstale":"2024-04-26T10:45:58.164893+0000","last_undegraded":"2024-04-26T10:45:58.164893+0000","last_fullsized":"2024-04-26T10:45:58.164893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25678,"num_write":356,"num_write_kb":116549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"63'442","reported_seq":602,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:09.239513+0000","last_change":"2024-04-26T10:47:09.239513+0000","last_active":"2024-04-26T10:47:09.239513+0000","last_peered":"2024-04-26T10:47:09.239513+0000","last_clean":"2024-04-26T10:47:09.239513+0000","last_became_active":"2024-04-26T10:42:26.045177+0000","last_became_peered":"2024-04-26T10:42:26.045177+0000","last_unstale":"2024-04-26T10:47:09.239513+0000","last_undegraded":"2024-04-26T10:47:09.239513+0000","last_fullsized":"2024-04-26T10:47:09.239513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'442","last_scrub_stamp":"2024-04-26T10:47:09.239378+0000","last_deep_scrub":"63'442","last_deep_scrub_stamp":"2024-04-26T10:47:09.239378+0000","last_clean_scrub_stamp":"2024-04-26T10:47:09.239378+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:55.718285+0000","scrub_duration":0.0028840749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35111,"num_write":413,"num_write_kb":60306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'393","reported_seq":528,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:31.697765+0000","last_change":"2024-04-26T10:47:31.697891+0000","last_active":"2024-04-26T10:47:31.697765+0000","last_peered":"2024-04-26T10:47:31.697765+0000","last_clean":"2024-04-26T10:47:31.697765+0000","last_became_active":"2024-04-26T10:45:54.191514+0000","last_became_peered":"2024-04-26T10:45:54.191514+0000","last_unstale":"2024-04-26T10:47:31.697765+0000","last_undegraded":"2024-04-26T10:47:31.697765+0000","last_fullsized":"2024-04-26T10:47:31.697765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'393","last_scrub_stamp":"2024-04-26T10:47:31.697743+0000","last_deep_scrub":"63'393","last_deep_scrub_stamp":"2024-04-26T10:47:31.697743+0000","last_clean_scrub_stamp":"2024-04-26T10:47:31.697743+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:53:35.353544+0000","scrub_duration":0.0030851210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5355,"num_write":351,"num_write_kb":38901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"63'377","reported_seq":494,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:10.635782+0000","last_change":"2024-04-26T10:47:10.635889+0000","last_active":"2024-04-26T10:47:10.635782+0000","last_peered":"2024-04-26T10:47:10.635782+0000","last_clean":"2024-04-26T10:47:10.635782+0000","last_became_active":"2024-04-26T10:45:49.862718+0000","last_became_peered":"2024-04-26T10:45:49.862718+0000","last_unstale":"2024-04-26T10:47:10.635782+0000","last_undegraded":"2024-04-26T10:47:10.635782+0000","last_fullsized":"2024-04-26T10:47:10.635782+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'377","last_scrub_stamp":"2024-04-26T10:47:10.635759+0000","last_deep_scrub":"63'377","last_deep_scrub_stamp":"2024-04-26T10:47:10.635759+0000","last_clean_scrub_stamp":"2024-04-26T10:47:10.635759+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:29.097205+0000","scrub_duration":0.0028839180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18030,"num_write":355,"num_write_kb":67044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"63'365","reported_seq":821,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:38.660333+0000","last_change":"2024-04-26T10:47:38.660453+0000","last_active":"2024-04-26T10:47:38.660333+0000","last_peered":"2024-04-26T10:47:38.660333+0000","last_clean":"2024-04-26T10:47:38.660333+0000","last_became_active":"2024-04-26T10:45:57.164964+0000","last_became_peered":"2024-04-26T10:45:57.164964+0000","last_unstale":"2024-04-26T10:47:38.660333+0000","last_undegraded":"2024-04-26T10:47:38.660333+0000","last_fullsized":"2024-04-26T10:47:38.660333+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'365","last_scrub_stamp":"2024-04-26T10:47:38.660308+0000","last_deep_scrub":"63'365","last_deep_scrub_stamp":"2024-04-26T10:47:38.660308+0000","last_clean_scrub_stamp":"2024-04-26T10:47:38.660308+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:47.168185+0000","scrub_duration":0.0029265279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14866,"num_write":337,"num_write_kb":71188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'397","reported_seq":503,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:27.693031+0000","last_change":"2024-04-26T10:47:27.693148+0000","last_active":"2024-04-26T10:47:27.693031+0000","last_peered":"2024-04-26T10:47:27.693031+0000","last_clean":"2024-04-26T10:47:27.693031+0000","last_became_active":"2024-04-26T10:42:26.041617+0000","last_became_peered":"2024-04-26T10:42:26.041617+0000","last_unstale":"2024-04-26T10:47:27.693031+0000","last_undegraded":"2024-04-26T10:47:27.693031+0000","last_fullsized":"2024-04-26T10:47:27.693031+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'397","last_scrub_stamp":"2024-04-26T10:47:27.693009+0000","last_deep_scrub":"63'397","last_deep_scrub_stamp":"2024-04-26T10:47:27.693009+0000","last_clean_scrub_stamp":"2024-04-26T10:47:27.693009+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:52.452931+0000","scrub_duration":0.0036373759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8192,"num_write":362,"num_write_kb":54822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"63'408","reported_seq":499,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:34.396188+0000","last_change":"2024-04-26T10:46:34.396311+0000","last_active":"2024-04-26T10:46:34.396188+0000","last_peered":"2024-04-26T10:46:34.396188+0000","last_clean":"2024-04-26T10:46:34.396188+0000","last_became_active":"2024-04-26T10:45:53.177677+0000","last_became_peered":"2024-04-26T10:45:53.177677+0000","last_unstale":"2024-04-26T10:46:34.396188+0000","last_undegraded":"2024-04-26T10:46:34.396188+0000","last_fullsized":"2024-04-26T10:46:34.396188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:34.396168+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:34.396168+0000","last_clean_scrub_stamp":"2024-04-26T10:46:34.396168+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:28.312103+0000","scrub_duration":0.002988662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4688,"num_write":374,"num_write_kb":21766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"63'409","reported_seq":534,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:47.541512+0000","last_change":"2024-04-26T10:46:47.541645+0000","last_active":"2024-04-26T10:46:47.541512+0000","last_peered":"2024-04-26T10:46:47.541512+0000","last_clean":"2024-04-26T10:46:47.541512+0000","last_became_active":"2024-04-26T10:45:54.185826+0000","last_became_peered":"2024-04-26T10:45:54.185826+0000","last_unstale":"2024-04-26T10:46:47.541512+0000","last_undegraded":"2024-04-26T10:46:47.541512+0000","last_fullsized":"2024-04-26T10:46:47.541512+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'409","last_scrub_stamp":"2024-04-26T10:46:47.541492+0000","last_deep_scrub":"63'409","last_deep_scrub_stamp":"2024-04-26T10:46:47.541492+0000","last_clean_scrub_stamp":"2024-04-26T10:46:47.541492+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:05.889065+0000","scrub_duration":0.0023676470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25968,"num_write":366,"num_write_kb":75698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"63'460","reported_seq":574,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:20.325508+0000","last_change":"2024-04-26T10:46:20.325615+0000","last_active":"2024-04-26T10:46:20.325508+0000","last_peered":"2024-04-26T10:46:20.325508+0000","last_clean":"2024-04-26T10:46:20.325508+0000","last_became_active":"2024-04-26T10:45:53.174699+0000","last_became_peered":"2024-04-26T10:45:53.174699+0000","last_unstale":"2024-04-26T10:46:20.325508+0000","last_undegraded":"2024-04-26T10:46:20.325508+0000","last_fullsized":"2024-04-26T10:46:20.325508+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'460","last_scrub_stamp":"2024-04-26T10:46:20.325486+0000","last_deep_scrub":"63'460","last_deep_scrub_stamp":"2024-04-26T10:46:20.325486+0000","last_clean_scrub_stamp":"2024-04-26T10:46:20.325486+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:51.733701+0000","scrub_duration":0.0023796759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16269,"num_write":426,"num_write_kb":67839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"63'393","reported_seq":525,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:11.204577+0000","last_change":"2024-04-26T10:47:11.204709+0000","last_active":"2024-04-26T10:47:11.204577+0000","last_peered":"2024-04-26T10:47:11.204577+0000","last_clean":"2024-04-26T10:47:11.204577+0000","last_became_active":"2024-04-26T10:42:26.049014+0000","last_became_peered":"2024-04-26T10:42:26.049014+0000","last_unstale":"2024-04-26T10:47:11.204577+0000","last_undegraded":"2024-04-26T10:47:11.204577+0000","last_fullsized":"2024-04-26T10:47:11.204577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'393","last_scrub_stamp":"2024-04-26T10:47:11.204553+0000","last_deep_scrub":"63'393","last_deep_scrub_stamp":"2024-04-26T10:47:11.204553+0000","last_clean_scrub_stamp":"2024-04-26T10:47:11.204553+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:49.026292+0000","scrub_duration":0.0022247619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":25712,"num_write":362,"num_write_kb":42020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'428","reported_seq":567,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:15.921226+0000","last_change":"2024-04-26T10:46:15.921226+0000","last_active":"2024-04-26T10:46:15.921226+0000","last_peered":"2024-04-26T10:46:15.921226+0000","last_clean":"2024-04-26T10:46:15.921226+0000","last_became_active":"2024-04-26T10:45:54.189852+0000","last_became_peered":"2024-04-26T10:45:54.189852+0000","last_unstale":"2024-04-26T10:46:15.921226+0000","last_undegraded":"2024-04-26T10:46:15.921226+0000","last_fullsized":"2024-04-26T10:46:15.921226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'428","last_scrub_stamp":"2024-04-26T10:46:15.921093+0000","last_deep_scrub":"63'428","last_deep_scrub_stamp":"2024-04-26T10:46:15.921093+0000","last_clean_scrub_stamp":"2024-04-26T10:46:15.921093+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:06.246994+0000","scrub_duration":0.0037567920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12316,"num_write":384,"num_write_kb":87656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"63'446","reported_seq":599,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:34.106864+0000","last_change":"2024-04-26T10:46:34.106970+0000","last_active":"2024-04-26T10:46:34.106864+0000","last_peered":"2024-04-26T10:46:34.106864+0000","last_clean":"2024-04-26T10:46:34.106864+0000","last_became_active":"2024-04-26T10:45:54.184063+0000","last_became_peered":"2024-04-26T10:45:54.184063+0000","last_unstale":"2024-04-26T10:46:34.106864+0000","last_undegraded":"2024-04-26T10:46:34.106864+0000","last_fullsized":"2024-04-26T10:46:34.106864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'446","last_scrub_stamp":"2024-04-26T10:46:34.106840+0000","last_deep_scrub":"63'446","last_deep_scrub_stamp":"2024-04-26T10:46:34.106840+0000","last_clean_scrub_stamp":"2024-04-26T10:46:34.106840+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:53.038982+0000","scrub_duration":0.003191504,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":53414,"num_write":401,"num_write_kb":80048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":562,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:43.456409+0000","last_change":"2024-04-26T10:46:43.456513+0000","last_active":"2024-04-26T10:46:43.456409+0000","last_peered":"2024-04-26T10:46:43.456409+0000","last_clean":"2024-04-26T10:46:43.456409+0000","last_became_active":"2024-04-26T10:45:50.867680+0000","last_became_peered":"2024-04-26T10:45:50.867680+0000","last_unstale":"2024-04-26T10:46:43.456409+0000","last_undegraded":"2024-04-26T10:46:43.456409+0000","last_fullsized":"2024-04-26T10:46:43.456409+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'438","last_scrub_stamp":"2024-04-26T10:46:43.456387+0000","last_deep_scrub":"63'438","last_deep_scrub_stamp":"2024-04-26T10:46:43.456387+0000","last_clean_scrub_stamp":"2024-04-26T10:46:43.456387+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:45.105492+0000","scrub_duration":0.002559675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19859,"num_write":405,"num_write_kb":51119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"63'408","reported_seq":874,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:26.338673+0000","last_change":"2024-04-26T10:46:26.338811+0000","last_active":"2024-04-26T10:46:26.338673+0000","last_peered":"2024-04-26T10:46:26.338673+0000","last_clean":"2024-04-26T10:46:26.338673+0000","last_became_active":"2024-04-26T10:45:56.160360+0000","last_became_peered":"2024-04-26T10:45:56.160360+0000","last_unstale":"2024-04-26T10:46:26.338673+0000","last_undegraded":"2024-04-26T10:46:26.338673+0000","last_fullsized":"2024-04-26T10:46:26.338673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:26.338639+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:26.338639+0000","last_clean_scrub_stamp":"2024-04-26T10:46:26.338639+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:34.117967+0000","scrub_duration":0.0027084209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":15372,"num_write":366,"num_write_kb":75855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"63'452","reported_seq":1030,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:35.724265+0000","last_change":"2024-04-26T10:47:35.724379+0000","last_active":"2024-04-26T10:47:35.724265+0000","last_peered":"2024-04-26T10:47:35.724265+0000","last_clean":"2024-04-26T10:47:35.724265+0000","last_became_active":"2024-04-26T10:45:52.173702+0000","last_became_peered":"2024-04-26T10:45:52.173702+0000","last_unstale":"2024-04-26T10:47:35.724265+0000","last_undegraded":"2024-04-26T10:47:35.724265+0000","last_fullsized":"2024-04-26T10:47:35.724265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'452","last_scrub_stamp":"2024-04-26T10:47:35.724244+0000","last_deep_scrub":"63'452","last_deep_scrub_stamp":"2024-04-26T10:47:35.724244+0000","last_clean_scrub_stamp":"2024-04-26T10:47:35.724244+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:08.983320+0000","scrub_duration":0.0023523429999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43729,"num_write":421,"num_write_kb":79804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"63'408","reported_seq":894,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:30.067044+0000","last_change":"2024-04-26T10:46:30.067162+0000","last_active":"2024-04-26T10:46:30.067044+0000","last_peered":"2024-04-26T10:46:30.067044+0000","last_clean":"2024-04-26T10:46:30.067044+0000","last_became_active":"2024-04-26T10:45:57.162147+0000","last_became_peered":"2024-04-26T10:45:57.162147+0000","last_unstale":"2024-04-26T10:46:30.067044+0000","last_undegraded":"2024-04-26T10:46:30.067044+0000","last_fullsized":"2024-04-26T10:46:30.067044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:30.067019+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:30.067019+0000","last_clean_scrub_stamp":"2024-04-26T10:46:30.067019+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:46.527639+0000","scrub_duration":0.0026815810000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":30320,"num_write":372,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'453","reported_seq":628,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:57.799503+0000","last_change":"2024-04-26T10:46:57.799635+0000","last_active":"2024-04-26T10:46:57.799503+0000","last_peered":"2024-04-26T10:46:57.799503+0000","last_clean":"2024-04-26T10:46:57.799503+0000","last_became_active":"2024-04-26T10:45:54.181881+0000","last_became_peered":"2024-04-26T10:45:54.181881+0000","last_unstale":"2024-04-26T10:46:57.799503+0000","last_undegraded":"2024-04-26T10:46:57.799503+0000","last_fullsized":"2024-04-26T10:46:57.799503+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'453","last_scrub_stamp":"2024-04-26T10:46:57.799480+0000","last_deep_scrub":"63'453","last_deep_scrub_stamp":"2024-04-26T10:46:57.799480+0000","last_clean_scrub_stamp":"2024-04-26T10:46:57.799480+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:42.095942+0000","scrub_duration":0.003413672,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":19864,"num_write":422,"num_write_kb":51638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"63'439","reported_seq":967,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:07.911236+0000","last_change":"2024-04-26T10:46:07.911236+0000","last_active":"2024-04-26T10:46:07.911236+0000","last_peered":"2024-04-26T10:46:07.911236+0000","last_clean":"2024-04-26T10:46:07.911236+0000","last_became_active":"2024-04-26T10:45:48.866159+0000","last_became_peered":"2024-04-26T10:45:48.866159+0000","last_unstale":"2024-04-26T10:46:07.911236+0000","last_undegraded":"2024-04-26T10:46:07.911236+0000","last_fullsized":"2024-04-26T10:46:07.911236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'439","last_scrub_stamp":"2024-04-26T10:46:07.911088+0000","last_deep_scrub":"63'439","last_deep_scrub_stamp":"2024-04-26T10:46:07.911088+0000","last_clean_scrub_stamp":"2024-04-26T10:46:07.911088+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:32.755490+0000","scrub_duration":0.0024222179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8912,"num_write":417,"num_write_kb":46575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"63'513","reported_seq":1171,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:26.001684+0000","last_change":"2024-04-26T10:47:26.001787+0000","last_active":"2024-04-26T10:47:26.001684+0000","last_peered":"2024-04-26T10:47:26.001684+0000","last_clean":"2024-04-26T10:47:26.001684+0000","last_became_active":"2024-04-26T10:45:51.158698+0000","last_became_peered":"2024-04-26T10:45:51.158698+0000","last_unstale":"2024-04-26T10:47:26.001684+0000","last_undegraded":"2024-04-26T10:47:26.001684+0000","last_fullsized":"2024-04-26T10:47:26.001684+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'513","last_scrub_stamp":"2024-04-26T10:47:26.001661+0000","last_deep_scrub":"63'513","last_deep_scrub_stamp":"2024-04-26T10:47:26.001661+0000","last_clean_scrub_stamp":"2024-04-26T10:47:26.001661+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:32.290818+0000","scrub_duration":0.0023258710000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":70751,"num_write":473,"num_write_kb":88902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'406","reported_seq":545,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:54.455676+0000","last_change":"2024-04-26T10:46:54.455779+0000","last_active":"2024-04-26T10:46:54.455676+0000","last_peered":"2024-04-26T10:46:54.455676+0000","last_clean":"2024-04-26T10:46:54.455676+0000","last_became_active":"2024-04-26T10:45:56.162419+0000","last_became_peered":"2024-04-26T10:45:56.162419+0000","last_unstale":"2024-04-26T10:46:54.455676+0000","last_undegraded":"2024-04-26T10:46:54.455676+0000","last_fullsized":"2024-04-26T10:46:54.455676+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'406","last_scrub_stamp":"2024-04-26T10:46:54.455655+0000","last_deep_scrub":"63'406","last_deep_scrub_stamp":"2024-04-26T10:46:54.455655+0000","last_clean_scrub_stamp":"2024-04-26T10:46:54.455655+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:35.943745+0000","scrub_duration":0.0024701179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":32121,"num_write":372,"num_write_kb":60163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"63'402","reported_seq":880,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:38.854895+0000","last_change":"2024-04-26T10:46:38.854895+0000","last_active":"2024-04-26T10:46:38.854895+0000","last_peered":"2024-04-26T10:46:38.854895+0000","last_clean":"2024-04-26T10:46:38.854895+0000","last_became_active":"2024-04-26T10:45:57.165064+0000","last_became_peered":"2024-04-26T10:45:57.165064+0000","last_unstale":"2024-04-26T10:46:38.854895+0000","last_undegraded":"2024-04-26T10:46:38.854895+0000","last_fullsized":"2024-04-26T10:46:38.854895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'402","last_scrub_stamp":"2024-04-26T10:46:38.854753+0000","last_deep_scrub":"63'402","last_deep_scrub_stamp":"2024-04-26T10:46:38.854753+0000","last_clean_scrub_stamp":"2024-04-26T10:46:38.854753+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:36.110686+0000","scrub_duration":0.0022249689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":6824,"num_write":378,"num_write_kb":72156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"63'407","reported_seq":900,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:39.933502+0000","last_change":"2024-04-26T10:47:39.933613+0000","last_active":"2024-04-26T10:47:39.933502+0000","last_peered":"2024-04-26T10:47:39.933502+0000","last_clean":"2024-04-26T10:47:39.933502+0000","last_became_active":"2024-04-26T10:45:58.161850+0000","last_became_peered":"2024-04-26T10:45:58.161850+0000","last_unstale":"2024-04-26T10:47:39.933502+0000","last_undegraded":"2024-04-26T10:47:39.933502+0000","last_fullsized":"2024-04-26T10:47:39.933502+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'407","last_scrub_stamp":"2024-04-26T10:47:39.933481+0000","last_deep_scrub":"63'407","last_deep_scrub_stamp":"2024-04-26T10:47:39.933481+0000","last_clean_scrub_stamp":"2024-04-26T10:47:39.933481+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:39.377365+0000","scrub_duration":0.0035767009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25898,"num_write":372,"num_write_kb":59274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":346,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'490","reported_seq":1071,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:51.777219+0000","last_change":"2024-04-26T10:46:51.777320+0000","last_active":"2024-04-26T10:46:51.777219+0000","last_peered":"2024-04-26T10:46:51.777219+0000","last_clean":"2024-04-26T10:46:51.777219+0000","last_became_active":"2024-04-26T10:45:55.178083+0000","last_became_peered":"2024-04-26T10:45:55.178083+0000","last_unstale":"2024-04-26T10:46:51.777219+0000","last_undegraded":"2024-04-26T10:46:51.777219+0000","last_fullsized":"2024-04-26T10:46:51.777219+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'490","last_scrub_stamp":"2024-04-26T10:46:51.777196+0000","last_deep_scrub":"63'490","last_deep_scrub_stamp":"2024-04-26T10:46:51.777196+0000","last_clean_scrub_stamp":"2024-04-26T10:46:51.777196+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:16:31.651731+0000","scrub_duration":0.0022270390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33597,"num_write":449,"num_write_kb":87981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"63'474","reported_seq":575,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:41.218309+0000","last_change":"2024-04-26T10:46:41.218435+0000","last_active":"2024-04-26T10:46:41.218309+0000","last_peered":"2024-04-26T10:46:41.218309+0000","last_clean":"2024-04-26T10:46:41.218309+0000","last_became_active":"2024-04-26T10:45:54.186011+0000","last_became_peered":"2024-04-26T10:45:54.186011+0000","last_unstale":"2024-04-26T10:46:41.218309+0000","last_undegraded":"2024-04-26T10:46:41.218309+0000","last_fullsized":"2024-04-26T10:46:41.218309+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'474","last_scrub_stamp":"2024-04-26T10:46:41.218267+0000","last_deep_scrub":"63'474","last_deep_scrub_stamp":"2024-04-26T10:46:41.218267+0000","last_clean_scrub_stamp":"2024-04-26T10:46:41.218267+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:19.308910+0000","scrub_duration":0.003558748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30886,"num_write":441,"num_write_kb":118807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'443","reported_seq":560,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:37.402510+0000","last_change":"2024-04-26T10:46:37.402510+0000","last_active":"2024-04-26T10:46:37.402510+0000","last_peered":"2024-04-26T10:46:37.402510+0000","last_clean":"2024-04-26T10:46:37.402510+0000","last_became_active":"2024-04-26T10:45:48.861918+0000","last_became_peered":"2024-04-26T10:45:48.861918+0000","last_unstale":"2024-04-26T10:46:37.402510+0000","last_undegraded":"2024-04-26T10:46:37.402510+0000","last_fullsized":"2024-04-26T10:46:37.402510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'443","last_scrub_stamp":"2024-04-26T10:46:37.402390+0000","last_deep_scrub":"63'443","last_deep_scrub_stamp":"2024-04-26T10:46:37.402390+0000","last_clean_scrub_stamp":"2024-04-26T10:46:37.402390+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:31.390744+0000","scrub_duration":0.0023535019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20556,"num_write":413,"num_write_kb":91647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"63'376","reported_seq":491,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:49.818309+0000","last_change":"2024-04-26T10:46:49.818309+0000","last_active":"2024-04-26T10:46:49.818309+0000","last_peered":"2024-04-26T10:46:49.818309+0000","last_clean":"2024-04-26T10:46:49.818309+0000","last_became_active":"2024-04-26T10:42:26.040920+0000","last_became_peered":"2024-04-26T10:42:26.040920+0000","last_unstale":"2024-04-26T10:46:49.818309+0000","last_undegraded":"2024-04-26T10:46:49.818309+0000","last_fullsized":"2024-04-26T10:46:49.818309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'376","last_scrub_stamp":"2024-04-26T10:46:49.818144+0000","last_deep_scrub":"63'376","last_deep_scrub_stamp":"2024-04-26T10:46:49.818144+0000","last_clean_scrub_stamp":"2024-04-26T10:46:49.818144+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:42.631428+0000","scrub_duration":0.002993571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10124,"num_write":344,"num_write_kb":66899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"62'453","reported_seq":534,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161595+0000","last_change":"2024-04-26T10:45:48.862782+0000","last_active":"2024-04-26T10:45:58.161595+0000","last_peered":"2024-04-26T10:45:58.161595+0000","last_clean":"2024-04-26T10:45:58.161595+0000","last_became_active":"2024-04-26T10:45:48.862424+0000","last_became_peered":"2024-04-26T10:45:48.862424+0000","last_unstale":"2024-04-26T10:45:58.161595+0000","last_undegraded":"2024-04-26T10:45:58.161595+0000","last_fullsized":"2024-04-26T10:45:58.161595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"63'403","reported_seq":533,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:10.923239+0000","last_change":"2024-04-26T10:46:10.923239+0000","last_active":"2024-04-26T10:46:10.923239+0000","last_peered":"2024-04-26T10:46:10.923239+0000","last_clean":"2024-04-26T10:46:10.923239+0000","last_became_active":"2024-04-26T10:42:26.040464+0000","last_became_peered":"2024-04-26T10:42:26.040464+0000","last_unstale":"2024-04-26T10:46:10.923239+0000","last_undegraded":"2024-04-26T10:46:10.923239+0000","last_fullsized":"2024-04-26T10:46:10.923239+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'403","last_scrub_stamp":"2024-04-26T10:46:10.923100+0000","last_deep_scrub":"63'403","last_deep_scrub_stamp":"2024-04-26T10:46:10.923100+0000","last_clean_scrub_stamp":"2024-04-26T10:46:10.923100+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:00.804186+0000","scrub_duration":0.0037994579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24588,"num_write":363,"num_write_kb":51190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"62'49","reported_seq":156,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:17.105113+0000","last_change":"2024-04-26T10:47:17.105218+0000","last_active":"2024-04-26T10:47:17.105113+0000","last_peered":"2024-04-26T10:47:17.105113+0000","last_clean":"2024-04-26T10:47:17.105113+0000","last_became_active":"2024-04-26T10:45:45.862029+0000","last_became_peered":"2024-04-26T10:45:45.862029+0000","last_unstale":"2024-04-26T10:47:17.105113+0000","last_undegraded":"2024-04-26T10:47:17.105113+0000","last_fullsized":"2024-04-26T10:47:17.105113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'49","last_scrub_stamp":"2024-04-26T10:47:17.105090+0000","last_deep_scrub":"62'49","last_deep_scrub_stamp":"2024-04-26T10:47:17.105090+0000","last_clean_scrub_stamp":"2024-04-26T10:47:17.105090+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:22.790230+0000","scrub_duration":0.0016239309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'407","reported_seq":900,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:23.067400+0000","last_change":"2024-04-26T10:47:23.067513+0000","last_active":"2024-04-26T10:47:23.067400+0000","last_peered":"2024-04-26T10:47:23.067400+0000","last_clean":"2024-04-26T10:47:23.067400+0000","last_became_active":"2024-04-26T10:45:52.169295+0000","last_became_peered":"2024-04-26T10:45:52.169295+0000","last_unstale":"2024-04-26T10:47:23.067400+0000","last_undegraded":"2024-04-26T10:47:23.067400+0000","last_fullsized":"2024-04-26T10:47:23.067400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'407","last_scrub_stamp":"2024-04-26T10:47:23.067376+0000","last_deep_scrub":"63'407","last_deep_scrub_stamp":"2024-04-26T10:47:23.067376+0000","last_clean_scrub_stamp":"2024-04-26T10:47:23.067376+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:45.140990+0000","scrub_duration":0.0024592289999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":7077,"num_write":367,"num_write_kb":42434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"62'66","reported_seq":173,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:11.778529+0000","last_change":"2024-04-26T10:47:11.778687+0000","last_active":"2024-04-26T10:47:11.778529+0000","last_peered":"2024-04-26T10:47:11.778529+0000","last_clean":"2024-04-26T10:47:11.778529+0000","last_became_active":"2024-04-26T10:45:45.874030+0000","last_became_peered":"2024-04-26T10:45:45.874030+0000","last_unstale":"2024-04-26T10:47:11.778529+0000","last_undegraded":"2024-04-26T10:47:11.778529+0000","last_fullsized":"2024-04-26T10:47:11.778529+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'66","last_scrub_stamp":"2024-04-26T10:47:11.778503+0000","last_deep_scrub":"62'66","last_deep_scrub_stamp":"2024-04-26T10:47:11.778503+0000","last_clean_scrub_stamp":"2024-04-26T10:47:11.778503+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:30.448994+0000","scrub_duration":0.001798846,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"63'406","reported_seq":911,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:24.024745+0000","last_change":"2024-04-26T10:47:24.024848+0000","last_active":"2024-04-26T10:47:24.024745+0000","last_peered":"2024-04-26T10:47:24.024745+0000","last_clean":"2024-04-26T10:47:24.024745+0000","last_became_active":"2024-04-26T10:45:49.861979+0000","last_became_peered":"2024-04-26T10:45:49.861979+0000","last_unstale":"2024-04-26T10:47:24.024745+0000","last_undegraded":"2024-04-26T10:47:24.024745+0000","last_fullsized":"2024-04-26T10:47:24.024745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'406","last_scrub_stamp":"2024-04-26T10:47:24.024723+0000","last_deep_scrub":"63'406","last_deep_scrub_stamp":"2024-04-26T10:47:24.024723+0000","last_clean_scrub_stamp":"2024-04-26T10:47:24.024723+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:07:41.862917+0000","scrub_duration":0.0024237550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":25977,"num_write":374,"num_write_kb":104172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"84'70","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:56.460947+0000","last_change":"2024-04-26T10:46:56.461080+0000","last_active":"2024-04-26T10:46:56.460947+0000","last_peered":"2024-04-26T10:46:56.460947+0000","last_clean":"2024-04-26T10:46:56.460947+0000","last_became_active":"2024-04-26T10:45:45.871120+0000","last_became_peered":"2024-04-26T10:45:45.871120+0000","last_unstale":"2024-04-26T10:46:56.460947+0000","last_undegraded":"2024-04-26T10:46:56.460947+0000","last_fullsized":"2024-04-26T10:46:56.460947+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'70","last_scrub_stamp":"2024-04-26T10:46:56.460924+0000","last_deep_scrub":"84'70","last_deep_scrub_stamp":"2024-04-26T10:46:56.460924+0000","last_clean_scrub_stamp":"2024-04-26T10:46:56.460924+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:06.245761+0000","scrub_duration":0.0046851239999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"84'202","reported_seq":295,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:45.516881+0000","last_change":"2024-04-26T10:46:45.516981+0000","last_active":"2024-04-26T10:46:45.516881+0000","last_peered":"2024-04-26T10:46:45.516881+0000","last_clean":"2024-04-26T10:46:45.516881+0000","last_became_active":"2024-04-26T10:45:48.865878+0000","last_became_peered":"2024-04-26T10:45:48.865878+0000","last_unstale":"2024-04-26T10:46:45.516881+0000","last_undegraded":"2024-04-26T10:46:45.516881+0000","last_fullsized":"2024-04-26T10:46:45.516881+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'202","last_scrub_stamp":"2024-04-26T10:46:45.516857+0000","last_deep_scrub":"84'202","last_deep_scrub_stamp":"2024-04-26T10:46:45.516857+0000","last_clean_scrub_stamp":"2024-04-26T10:46:45.516857+0000","objects_scrubbed":2,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:35.343559+0000","scrub_duration":0.011504359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"63'415","reported_seq":921,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:11.914773+0000","last_change":"2024-04-26T10:46:11.914773+0000","last_active":"2024-04-26T10:46:11.914773+0000","last_peered":"2024-04-26T10:46:11.914773+0000","last_clean":"2024-04-26T10:46:11.914773+0000","last_became_active":"2024-04-26T10:45:57.163263+0000","last_became_peered":"2024-04-26T10:45:57.163263+0000","last_unstale":"2024-04-26T10:46:11.914773+0000","last_undegraded":"2024-04-26T10:46:11.914773+0000","last_fullsized":"2024-04-26T10:46:11.914773+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'415","last_scrub_stamp":"2024-04-26T10:46:11.914637+0000","last_deep_scrub":"63'415","last_deep_scrub_stamp":"2024-04-26T10:46:11.914637+0000","last_clean_scrub_stamp":"2024-04-26T10:46:11.914637+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:19.456262+0000","scrub_duration":0.0026733759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15757,"num_write":380,"num_write_kb":54727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"84'344","reported_seq":463,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:04.860552+0000","last_change":"2024-04-26T10:47:04.860677+0000","last_active":"2024-04-26T10:47:04.860552+0000","last_peered":"2024-04-26T10:47:04.860552+0000","last_clean":"2024-04-26T10:47:04.860552+0000","last_became_active":"2024-04-26T10:45:48.866497+0000","last_became_peered":"2024-04-26T10:45:48.866497+0000","last_unstale":"2024-04-26T10:47:04.860552+0000","last_undegraded":"2024-04-26T10:47:04.860552+0000","last_fullsized":"2024-04-26T10:47:04.860552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'344","last_scrub_stamp":"2024-04-26T10:47:04.860530+0000","last_deep_scrub":"84'344","last_deep_scrub_stamp":"2024-04-26T10:47:04.860530+0000","last_clean_scrub_stamp":"2024-04-26T10:47:04.860530+0000","objects_scrubbed":2,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:42.826483+0000","scrub_duration":0.011514284,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"63'481","reported_seq":683,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:23.694129+0000","last_change":"2024-04-26T10:47:23.694244+0000","last_active":"2024-04-26T10:47:23.694129+0000","last_peered":"2024-04-26T10:47:23.694129+0000","last_clean":"2024-04-26T10:47:23.694129+0000","last_became_active":"2024-04-26T10:45:54.181993+0000","last_became_peered":"2024-04-26T10:45:54.181993+0000","last_unstale":"2024-04-26T10:47:23.694129+0000","last_undegraded":"2024-04-26T10:47:23.694129+0000","last_fullsized":"2024-04-26T10:47:23.694129+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'481","last_scrub_stamp":"2024-04-26T10:47:23.694106+0000","last_deep_scrub":"63'481","last_deep_scrub_stamp":"2024-04-26T10:47:23.694106+0000","last_clean_scrub_stamp":"2024-04-26T10:47:23.694106+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:27.709900+0000","scrub_duration":0.0032272659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":45251,"num_write":451,"num_write_kb":105365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"84'462","reported_seq":555,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:40.432545+0000","last_change":"2024-04-26T10:46:40.432691+0000","last_active":"2024-04-26T10:46:40.432545+0000","last_peered":"2024-04-26T10:46:40.432545+0000","last_clean":"2024-04-26T10:46:40.432545+0000","last_became_active":"2024-04-26T10:45:48.865520+0000","last_became_peered":"2024-04-26T10:45:48.865520+0000","last_unstale":"2024-04-26T10:46:40.432545+0000","last_undegraded":"2024-04-26T10:46:40.432545+0000","last_fullsized":"2024-04-26T10:46:40.432545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'462","last_scrub_stamp":"2024-04-26T10:46:40.432509+0000","last_deep_scrub":"84'462","last_deep_scrub_stamp":"2024-04-26T10:46:40.432509+0000","last_clean_scrub_stamp":"2024-04-26T10:46:40.432509+0000","objects_scrubbed":2,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:15.817808+0000","scrub_duration":0.010610122,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":407,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'420","reported_seq":504,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161880+0000","last_change":"2024-04-26T10:45:57.165390+0000","last_active":"2024-04-26T10:45:58.161880+0000","last_peered":"2024-04-26T10:45:58.161880+0000","last_clean":"2024-04-26T10:45:58.161880+0000","last_became_active":"2024-04-26T10:45:57.162014+0000","last_became_peered":"2024-04-26T10:45:57.162014+0000","last_unstale":"2024-04-26T10:45:58.161880+0000","last_undegraded":"2024-04-26T10:45:58.161880+0000","last_fullsized":"2024-04-26T10:45:58.161880+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13025,"num_write":385,"num_write_kb":38595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"62'67","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:51.506238+0000","last_change":"2024-04-26T10:46:51.506347+0000","last_active":"2024-04-26T10:46:51.506238+0000","last_peered":"2024-04-26T10:46:51.506238+0000","last_clean":"2024-04-26T10:46:51.506238+0000","last_became_active":"2024-04-26T10:45:45.860175+0000","last_became_peered":"2024-04-26T10:45:45.860175+0000","last_unstale":"2024-04-26T10:46:51.506238+0000","last_undegraded":"2024-04-26T10:46:51.506238+0000","last_fullsized":"2024-04-26T10:46:51.506238+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'67","last_scrub_stamp":"2024-04-26T10:46:51.506217+0000","last_deep_scrub":"62'67","last_deep_scrub_stamp":"2024-04-26T10:46:51.506217+0000","last_clean_scrub_stamp":"2024-04-26T10:46:51.506217+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:02.699431+0000","scrub_duration":0.0015865510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"63'452","reported_seq":977,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:37.035003+0000","last_change":"2024-04-26T10:47:37.035134+0000","last_active":"2024-04-26T10:47:37.035003+0000","last_peered":"2024-04-26T10:47:37.035003+0000","last_clean":"2024-04-26T10:47:37.035003+0000","last_became_active":"2024-04-26T10:45:58.164105+0000","last_became_peered":"2024-04-26T10:45:58.164105+0000","last_unstale":"2024-04-26T10:47:37.035003+0000","last_undegraded":"2024-04-26T10:47:37.035003+0000","last_fullsized":"2024-04-26T10:47:37.035003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'452","last_scrub_stamp":"2024-04-26T10:47:37.034983+0000","last_deep_scrub":"63'452","last_deep_scrub_stamp":"2024-04-26T10:47:37.034983+0000","last_clean_scrub_stamp":"2024-04-26T10:47:37.034983+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:38.528620+0000","scrub_duration":0.002456293,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23217,"num_write":416,"num_write_kb":71418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":388,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'203","reported_seq":292,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:33.990315+0000","last_change":"2024-04-26T10:47:33.990424+0000","last_active":"2024-04-26T10:47:33.990315+0000","last_peered":"2024-04-26T10:47:33.990315+0000","last_clean":"2024-04-26T10:47:33.990315+0000","last_became_active":"2024-04-26T10:45:56.160475+0000","last_became_peered":"2024-04-26T10:45:56.160475+0000","last_unstale":"2024-04-26T10:47:33.990315+0000","last_undegraded":"2024-04-26T10:47:33.990315+0000","last_fullsized":"2024-04-26T10:47:33.990315+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'203","last_scrub_stamp":"2024-04-26T10:47:33.990294+0000","last_deep_scrub":"84'203","last_deep_scrub_stamp":"2024-04-26T10:47:33.990294+0000","last_clean_scrub_stamp":"2024-04-26T10:47:33.990294+0000","objects_scrubbed":3,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:32.037541+0000","scrub_duration":0.015319917000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'430","reported_seq":513,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162319+0000","last_change":"2024-04-26T10:45:57.164742+0000","last_active":"2024-04-26T10:45:58.162319+0000","last_peered":"2024-04-26T10:45:58.162319+0000","last_clean":"2024-04-26T10:45:58.162319+0000","last_became_active":"2024-04-26T10:45:57.162070+0000","last_became_peered":"2024-04-26T10:45:57.162070+0000","last_unstale":"2024-04-26T10:45:58.162319+0000","last_undegraded":"2024-04-26T10:45:58.162319+0000","last_fullsized":"2024-04-26T10:45:58.162319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":24352,"num_write":392,"num_write_kb":21976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"84'234","reported_seq":319,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:15.624839+0000","last_change":"2024-04-26T10:47:15.625011+0000","last_active":"2024-04-26T10:47:15.624839+0000","last_peered":"2024-04-26T10:47:15.624839+0000","last_clean":"2024-04-26T10:47:15.624839+0000","last_became_active":"2024-04-26T10:45:48.862517+0000","last_became_peered":"2024-04-26T10:45:48.862517+0000","last_unstale":"2024-04-26T10:47:15.624839+0000","last_undegraded":"2024-04-26T10:47:15.624839+0000","last_fullsized":"2024-04-26T10:47:15.624839+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'234","last_scrub_stamp":"2024-04-26T10:47:15.624801+0000","last_deep_scrub":"84'234","last_deep_scrub_stamp":"2024-04-26T10:47:15.624801+0000","last_clean_scrub_stamp":"2024-04-26T10:47:15.624801+0000","objects_scrubbed":1,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:41.779523+0000","scrub_duration":0.0093436560000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"63'393","reported_seq":490,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:01.534168+0000","last_change":"2024-04-26T10:47:01.534285+0000","last_active":"2024-04-26T10:47:01.534168+0000","last_peered":"2024-04-26T10:47:01.534168+0000","last_clean":"2024-04-26T10:47:01.534168+0000","last_became_active":"2024-04-26T10:45:55.177758+0000","last_became_peered":"2024-04-26T10:45:55.177758+0000","last_unstale":"2024-04-26T10:47:01.534168+0000","last_undegraded":"2024-04-26T10:47:01.534168+0000","last_fullsized":"2024-04-26T10:47:01.534168+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'393","last_scrub_stamp":"2024-04-26T10:47:01.534143+0000","last_deep_scrub":"63'393","last_deep_scrub_stamp":"2024-04-26T10:47:01.534143+0000","last_clean_scrub_stamp":"2024-04-26T10:47:01.534143+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:15.470762+0000","scrub_duration":0.0026004790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8671,"num_write":368,"num_write_kb":38542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"62'49","reported_seq":156,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:02.831959+0000","last_change":"2024-04-26T10:47:02.832067+0000","last_active":"2024-04-26T10:47:02.831959+0000","last_peered":"2024-04-26T10:47:02.831959+0000","last_clean":"2024-04-26T10:47:02.831959+0000","last_became_active":"2024-04-26T10:45:45.874328+0000","last_became_peered":"2024-04-26T10:45:45.874328+0000","last_unstale":"2024-04-26T10:47:02.831959+0000","last_undegraded":"2024-04-26T10:47:02.831959+0000","last_fullsized":"2024-04-26T10:47:02.831959+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'49","last_scrub_stamp":"2024-04-26T10:47:02.831935+0000","last_deep_scrub":"62'49","last_deep_scrub_stamp":"2024-04-26T10:47:02.831935+0000","last_clean_scrub_stamp":"2024-04-26T10:47:02.831935+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:21.771123+0000","scrub_duration":0.0016852690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"63'368","reported_seq":475,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:49.494381+0000","last_change":"2024-04-26T10:46:49.494481+0000","last_active":"2024-04-26T10:46:49.494381+0000","last_peered":"2024-04-26T10:46:49.494381+0000","last_clean":"2024-04-26T10:46:49.494381+0000","last_became_active":"2024-04-26T10:45:56.163456+0000","last_became_peered":"2024-04-26T10:45:56.163456+0000","last_unstale":"2024-04-26T10:46:49.494381+0000","last_undegraded":"2024-04-26T10:46:49.494381+0000","last_fullsized":"2024-04-26T10:46:49.494381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'368","last_scrub_stamp":"2024-04-26T10:46:49.494360+0000","last_deep_scrub":"63'368","last_deep_scrub_stamp":"2024-04-26T10:46:49.494360+0000","last_clean_scrub_stamp":"2024-04-26T10:46:49.494360+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:27.081977+0000","scrub_duration":0.0025223229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":19222,"num_write":336,"num_write_kb":58903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"84'620","reported_seq":761,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:14.719236+0000","last_change":"2024-04-26T10:47:14.719342+0000","last_active":"2024-04-26T10:47:14.719236+0000","last_peered":"2024-04-26T10:47:14.719236+0000","last_clean":"2024-04-26T10:47:14.719236+0000","last_became_active":"2024-04-26T10:45:56.161604+0000","last_became_peered":"2024-04-26T10:45:56.161604+0000","last_unstale":"2024-04-26T10:47:14.719236+0000","last_undegraded":"2024-04-26T10:47:14.719236+0000","last_fullsized":"2024-04-26T10:47:14.719236+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'620","last_scrub_stamp":"2024-04-26T10:47:14.719213+0000","last_deep_scrub":"84'620","last_deep_scrub_stamp":"2024-04-26T10:47:14.719213+0000","last_clean_scrub_stamp":"2024-04-26T10:47:14.719213+0000","objects_scrubbed":1,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:29.417733+0000","scrub_duration":0.010567363999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":558,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"63'383","reported_seq":834,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:38.953689+0000","last_change":"2024-04-26T10:47:38.953783+0000","last_active":"2024-04-26T10:47:38.953689+0000","last_peered":"2024-04-26T10:47:38.953689+0000","last_clean":"2024-04-26T10:47:38.953689+0000","last_became_active":"2024-04-26T10:45:58.162264+0000","last_became_peered":"2024-04-26T10:45:58.162264+0000","last_unstale":"2024-04-26T10:47:38.953689+0000","last_undegraded":"2024-04-26T10:47:38.953689+0000","last_fullsized":"2024-04-26T10:47:38.953689+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'383","last_scrub_stamp":"2024-04-26T10:47:38.953668+0000","last_deep_scrub":"63'383","last_deep_scrub_stamp":"2024-04-26T10:47:38.953668+0000","last_clean_scrub_stamp":"2024-04-26T10:47:38.953668+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:51.290039+0000","scrub_duration":0.002468446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":14260,"num_write":349,"num_write_kb":50367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"84'159","reported_seq":244,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:28.647857+0000","last_change":"2024-04-26T10:47:28.647857+0000","last_active":"2024-04-26T10:47:28.647857+0000","last_peered":"2024-04-26T10:47:28.647857+0000","last_clean":"2024-04-26T10:47:28.647857+0000","last_became_active":"2024-04-26T10:45:45.871155+0000","last_became_peered":"2024-04-26T10:45:45.871155+0000","last_unstale":"2024-04-26T10:47:28.647857+0000","last_undegraded":"2024-04-26T10:47:28.647857+0000","last_fullsized":"2024-04-26T10:47:28.647857+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'159","last_scrub_stamp":"2024-04-26T10:47:28.647724+0000","last_deep_scrub":"84'159","last_deep_scrub_stamp":"2024-04-26T10:47:28.647724+0000","last_clean_scrub_stamp":"2024-04-26T10:47:28.647724+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:46.139695+0000","scrub_duration":0.0043961449999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:42.656296+0000","last_change":"2024-04-26T10:47:42.656296+0000","last_active":"2024-04-26T10:47:42.656296+0000","last_peered":"2024-04-26T10:47:42.656296+0000","last_clean":"2024-04-26T10:47:42.656296+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:47:42.656296+0000","last_undegraded":"2024-04-26T10:47:42.656296+0000","last_fullsized":"2024-04-26T10:47:42.656296+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:47:42.656145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:47:42.656145+0000","last_clean_scrub_stamp":"2024-04-26T10:47:42.656145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:12.355980+0000","scrub_duration":0.0019280339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"84'745","reported_seq":839,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:16.132144+0000","last_change":"2024-04-26T10:47:16.132263+0000","last_active":"2024-04-26T10:47:16.132144+0000","last_peered":"2024-04-26T10:47:16.132144+0000","last_clean":"2024-04-26T10:47:16.132144+0000","last_became_active":"2024-04-26T10:42:25.686009+0000","last_became_peered":"2024-04-26T10:42:25.686009+0000","last_unstale":"2024-04-26T10:47:16.132144+0000","last_undegraded":"2024-04-26T10:47:16.132144+0000","last_fullsized":"2024-04-26T10:47:16.132144+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'745","last_scrub_stamp":"2024-04-26T10:47:16.132120+0000","last_deep_scrub":"84'745","last_deep_scrub_stamp":"2024-04-26T10:47:16.132120+0000","last_clean_scrub_stamp":"2024-04-26T10:47:16.132120+0000","objects_scrubbed":2,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:40:39.935186+0000","scrub_duration":0.015566577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'442","reported_seq":580,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:48.508984+0000","last_change":"2024-04-26T10:46:48.508984+0000","last_active":"2024-04-26T10:46:48.508984+0000","last_peered":"2024-04-26T10:46:48.508984+0000","last_clean":"2024-04-26T10:46:48.508984+0000","last_became_active":"2024-04-26T10:45:55.177751+0000","last_became_peered":"2024-04-26T10:45:55.177751+0000","last_unstale":"2024-04-26T10:46:48.508984+0000","last_undegraded":"2024-04-26T10:46:48.508984+0000","last_fullsized":"2024-04-26T10:46:48.508984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'442","last_scrub_stamp":"2024-04-26T10:46:48.508814+0000","last_deep_scrub":"63'442","last_deep_scrub_stamp":"2024-04-26T10:46:48.508814+0000","last_clean_scrub_stamp":"2024-04-26T10:46:48.508814+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:00.772322+0000","scrub_duration":0.0025059779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":34346,"num_write":406,"num_write_kb":96298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:59.508611+0000","last_change":"2024-04-26T10:46:59.508611+0000","last_active":"2024-04-26T10:46:59.508611+0000","last_peered":"2024-04-26T10:46:59.508611+0000","last_clean":"2024-04-26T10:46:59.508611+0000","last_became_active":"2024-04-26T10:45:45.871741+0000","last_became_peered":"2024-04-26T10:45:45.871741+0000","last_unstale":"2024-04-26T10:46:59.508611+0000","last_undegraded":"2024-04-26T10:46:59.508611+0000","last_fullsized":"2024-04-26T10:46:59.508611+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:46:59.508440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:46:59.508440+0000","last_clean_scrub_stamp":"2024-04-26T10:46:59.508440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:10.498353+0000","scrub_duration":0.0018823100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"84'103","reported_seq":232,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:28.024387+0000","last_change":"2024-04-26T10:47:28.024514+0000","last_active":"2024-04-26T10:47:28.024387+0000","last_peered":"2024-04-26T10:47:28.024387+0000","last_clean":"2024-04-26T10:47:28.024387+0000","last_became_active":"2024-04-26T10:45:56.160328+0000","last_became_peered":"2024-04-26T10:45:56.160328+0000","last_unstale":"2024-04-26T10:47:28.024387+0000","last_undegraded":"2024-04-26T10:47:28.024387+0000","last_fullsized":"2024-04-26T10:47:28.024387+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'103","last_scrub_stamp":"2024-04-26T10:47:28.024363+0000","last_deep_scrub":"84'103","last_deep_scrub_stamp":"2024-04-26T10:47:28.024363+0000","last_clean_scrub_stamp":"2024-04-26T10:47:28.024363+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:38.934942+0000","scrub_duration":0.0055471219999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467631,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":44,"num_write_kb":1460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2935262,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'485","reported_seq":621,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.876202+0000","last_change":"2024-04-26T10:45:57.165815+0000","last_active":"2024-04-26T10:45:58.876202+0000","last_peered":"2024-04-26T10:45:58.876202+0000","last_clean":"2024-04-26T10:45:58.876202+0000","last_became_active":"2024-04-26T10:45:57.162752+0000","last_became_peered":"2024-04-26T10:45:57.162752+0000","last_unstale":"2024-04-26T10:45:58.876202+0000","last_undegraded":"2024-04-26T10:45:58.876202+0000","last_fullsized":"2024-04-26T10:45:58.876202+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27703,"num_write":454,"num_write_kb":121509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:48.199178+0000","last_change":"2024-04-26T10:46:48.199307+0000","last_active":"2024-04-26T10:46:48.199178+0000","last_peered":"2024-04-26T10:46:48.199178+0000","last_clean":"2024-04-26T10:46:48.199178+0000","last_became_active":"2024-04-26T10:45:53.180675+0000","last_became_peered":"2024-04-26T10:45:53.180675+0000","last_unstale":"2024-04-26T10:46:48.199178+0000","last_undegraded":"2024-04-26T10:46:48.199178+0000","last_fullsized":"2024-04-26T10:46:48.199178+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:46:48.199158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:46:48.199158+0000","last_clean_scrub_stamp":"2024-04-26T10:46:48.199158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:51:28.631493+0000","scrub_duration":0.0016680530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"84'308","reported_seq":428,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:59.784023+0000","last_change":"2024-04-26T10:46:59.784129+0000","last_active":"2024-04-26T10:46:59.784023+0000","last_peered":"2024-04-26T10:46:59.784023+0000","last_clean":"2024-04-26T10:46:59.784023+0000","last_became_active":"2024-04-26T10:45:48.864763+0000","last_became_peered":"2024-04-26T10:45:48.864763+0000","last_unstale":"2024-04-26T10:46:59.784023+0000","last_undegraded":"2024-04-26T10:46:59.784023+0000","last_fullsized":"2024-04-26T10:46:59.784023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'308","last_scrub_stamp":"2024-04-26T10:46:59.784001+0000","last_deep_scrub":"84'308","last_deep_scrub_stamp":"2024-04-26T10:46:59.784001+0000","last_clean_scrub_stamp":"2024-04-26T10:46:59.784001+0000","objects_scrubbed":2,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:33.251239+0000","scrub_duration":0.014317998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"63'336","reported_seq":760,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:38.002684+0000","last_change":"2024-04-26T10:47:38.002814+0000","last_active":"2024-04-26T10:47:38.002684+0000","last_peered":"2024-04-26T10:47:38.002684+0000","last_clean":"2024-04-26T10:47:38.002684+0000","last_became_active":"2024-04-26T10:45:58.162320+0000","last_became_peered":"2024-04-26T10:45:58.162320+0000","last_unstale":"2024-04-26T10:47:38.002684+0000","last_undegraded":"2024-04-26T10:47:38.002684+0000","last_fullsized":"2024-04-26T10:47:38.002684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'336","last_scrub_stamp":"2024-04-26T10:47:38.002662+0000","last_deep_scrub":"63'336","last_deep_scrub_stamp":"2024-04-26T10:47:38.002662+0000","last_clean_scrub_stamp":"2024-04-26T10:47:38.002662+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:42.263583+0000","scrub_duration":0.0026625630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12035,"num_write":314,"num_write_kb":29928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":306,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:32.654284+0000","last_change":"2024-04-26T10:47:32.654284+0000","last_active":"2024-04-26T10:47:32.654284+0000","last_peered":"2024-04-26T10:47:32.654284+0000","last_clean":"2024-04-26T10:47:32.654284+0000","last_became_active":"2024-04-26T10:45:45.860924+0000","last_became_peered":"2024-04-26T10:45:45.860924+0000","last_unstale":"2024-04-26T10:47:32.654284+0000","last_undegraded":"2024-04-26T10:47:32.654284+0000","last_fullsized":"2024-04-26T10:47:32.654284+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:47:32.654143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:47:32.654143+0000","last_clean_scrub_stamp":"2024-04-26T10:47:32.654143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:20.647001+0000","scrub_duration":0.0015127770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"62'64","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:34.677094+0000","last_change":"2024-04-26T10:47:34.677094+0000","last_active":"2024-04-26T10:47:34.677094+0000","last_peered":"2024-04-26T10:47:34.677094+0000","last_clean":"2024-04-26T10:47:34.677094+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:47:34.677094+0000","last_undegraded":"2024-04-26T10:47:34.677094+0000","last_fullsized":"2024-04-26T10:47:34.677094+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'64","last_scrub_stamp":"2024-04-26T10:47:34.676937+0000","last_deep_scrub":"62'64","last_deep_scrub_stamp":"2024-04-26T10:47:34.676937+0000","last_clean_scrub_stamp":"2024-04-26T10:47:34.676937+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:05.788359+0000","scrub_duration":0.001549861,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"63'421","reported_seq":525,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:10.204604+0000","last_change":"2024-04-26T10:47:10.204714+0000","last_active":"2024-04-26T10:47:10.204604+0000","last_peered":"2024-04-26T10:47:10.204604+0000","last_clean":"2024-04-26T10:47:10.204604+0000","last_became_active":"2024-04-26T10:45:54.185053+0000","last_became_peered":"2024-04-26T10:45:54.185053+0000","last_unstale":"2024-04-26T10:47:10.204604+0000","last_undegraded":"2024-04-26T10:47:10.204604+0000","last_fullsized":"2024-04-26T10:47:10.204604+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'421","last_scrub_stamp":"2024-04-26T10:47:10.204582+0000","last_deep_scrub":"63'421","last_deep_scrub_stamp":"2024-04-26T10:47:10.204582+0000","last_clean_scrub_stamp":"2024-04-26T10:47:10.204582+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:56.649265+0000","scrub_duration":0.0030152209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28557,"num_write":385,"num_write_kb":93083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"62'480","reported_seq":555,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:07.412578+0000","last_change":"2024-04-26T10:45:48.862894+0000","last_active":"2024-04-26T10:46:07.412578+0000","last_peered":"2024-04-26T10:46:07.412578+0000","last_clean":"2024-04-26T10:46:07.412578+0000","last_became_active":"2024-04-26T10:45:48.862564+0000","last_became_peered":"2024-04-26T10:45:48.862564+0000","last_unstale":"2024-04-26T10:46:07.412578+0000","last_undegraded":"2024-04-26T10:46:07.412578+0000","last_fullsized":"2024-04-26T10:46:07.412578+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:24.664396+0000","last_clean_scrub_stamp":"2024-04-26T10:42:24.664396+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:14.184935+0000","last_change":"2024-04-26T10:47:14.185031+0000","last_active":"2024-04-26T10:47:14.184935+0000","last_peered":"2024-04-26T10:47:14.184935+0000","last_clean":"2024-04-26T10:47:14.184935+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:47:14.184935+0000","last_undegraded":"2024-04-26T10:47:14.184935+0000","last_fullsized":"2024-04-26T10:47:14.184935+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:47:14.184915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:47:14.184915+0000","last_clean_scrub_stamp":"2024-04-26T10:47:14.184915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:43.653892+0000","scrub_duration":0.0016064040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'352","reported_seq":789,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:20.639969+0000","last_change":"2024-04-26T10:47:20.640088+0000","last_active":"2024-04-26T10:47:20.639969+0000","last_peered":"2024-04-26T10:47:20.639969+0000","last_clean":"2024-04-26T10:47:20.639969+0000","last_became_active":"2024-04-26T10:45:53.182454+0000","last_became_peered":"2024-04-26T10:45:53.182454+0000","last_unstale":"2024-04-26T10:47:20.639969+0000","last_undegraded":"2024-04-26T10:47:20.639969+0000","last_fullsized":"2024-04-26T10:47:20.639969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'352","last_scrub_stamp":"2024-04-26T10:47:20.639947+0000","last_deep_scrub":"63'352","last_deep_scrub_stamp":"2024-04-26T10:47:20.639947+0000","last_clean_scrub_stamp":"2024-04-26T10:47:20.639947+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:15.753783+0000","scrub_duration":0.0025067420000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":1905,"num_write":313,"num_write_kb":25573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"62'59","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:32.065405+0000","last_change":"2024-04-26T10:46:32.065523+0000","last_active":"2024-04-26T10:46:32.065405+0000","last_peered":"2024-04-26T10:46:32.065405+0000","last_clean":"2024-04-26T10:46:32.065405+0000","last_became_active":"2024-04-26T10:45:53.176996+0000","last_became_peered":"2024-04-26T10:45:53.176996+0000","last_unstale":"2024-04-26T10:46:32.065405+0000","last_undegraded":"2024-04-26T10:46:32.065405+0000","last_fullsized":"2024-04-26T10:46:32.065405+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'59","last_scrub_stamp":"2024-04-26T10:46:32.065382+0000","last_deep_scrub":"62'59","last_deep_scrub_stamp":"2024-04-26T10:46:32.065382+0000","last_clean_scrub_stamp":"2024-04-26T10:46:32.065382+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:26.427635+0000","scrub_duration":0.0016833690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":89,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162375+0000","last_change":"2024-04-26T10:45:53.175046+0000","last_active":"2024-04-26T10:45:58.162375+0000","last_peered":"2024-04-26T10:45:58.162375+0000","last_clean":"2024-04-26T10:45:58.162375+0000","last_became_active":"2024-04-26T10:45:53.174781+0000","last_became_peered":"2024-04-26T10:45:53.174781+0000","last_unstale":"2024-04-26T10:45:58.162375+0000","last_undegraded":"2024-04-26T10:45:58.162375+0000","last_fullsized":"2024-04-26T10:45:58.162375+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'408","reported_seq":920,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:31.846626+0000","last_change":"2024-04-26T10:46:31.846626+0000","last_active":"2024-04-26T10:46:31.846626+0000","last_peered":"2024-04-26T10:46:31.846626+0000","last_clean":"2024-04-26T10:46:31.846626+0000","last_became_active":"2024-04-26T10:45:54.185238+0000","last_became_peered":"2024-04-26T10:45:54.185238+0000","last_unstale":"2024-04-26T10:46:31.846626+0000","last_undegraded":"2024-04-26T10:46:31.846626+0000","last_fullsized":"2024-04-26T10:46:31.846626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:31.846485+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:31.846485+0000","last_clean_scrub_stamp":"2024-04-26T10:46:31.846485+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:36.109042+0000","scrub_duration":0.0024474840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19939,"num_write":382,"num_write_kb":63433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"84'56","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:43.249487+0000","last_change":"2024-04-26T10:46:43.249602+0000","last_active":"2024-04-26T10:46:43.249487+0000","last_peered":"2024-04-26T10:46:43.249487+0000","last_clean":"2024-04-26T10:46:43.249487+0000","last_became_active":"2024-04-26T10:45:53.177305+0000","last_became_peered":"2024-04-26T10:45:53.177305+0000","last_unstale":"2024-04-26T10:46:43.249487+0000","last_undegraded":"2024-04-26T10:46:43.249487+0000","last_fullsized":"2024-04-26T10:46:43.249487+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'56","last_scrub_stamp":"2024-04-26T10:46:43.249467+0000","last_deep_scrub":"84'56","last_deep_scrub_stamp":"2024-04-26T10:46:43.249467+0000","last_clean_scrub_stamp":"2024-04-26T10:46:43.249467+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:52.720824+0000","scrub_duration":0.0031266789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:38.180460+0000","last_change":"2024-04-26T10:46:38.180572+0000","last_active":"2024-04-26T10:46:38.180460+0000","last_peered":"2024-04-26T10:46:38.180460+0000","last_clean":"2024-04-26T10:46:38.180460+0000","last_became_active":"2024-04-26T10:45:53.177249+0000","last_became_peered":"2024-04-26T10:45:53.177249+0000","last_unstale":"2024-04-26T10:46:38.180460+0000","last_undegraded":"2024-04-26T10:46:38.180460+0000","last_fullsized":"2024-04-26T10:46:38.180460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:46:38.180438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:46:38.180438+0000","last_clean_scrub_stamp":"2024-04-26T10:46:38.180438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:09.067544+0000","scrub_duration":0.00179721,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'418","reported_seq":889,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:04.180135+0000","last_change":"2024-04-26T10:47:04.180286+0000","last_active":"2024-04-26T10:47:04.180135+0000","last_peered":"2024-04-26T10:47:04.180135+0000","last_clean":"2024-04-26T10:47:04.180135+0000","last_became_active":"2024-04-26T10:45:56.160440+0000","last_became_peered":"2024-04-26T10:45:56.160440+0000","last_unstale":"2024-04-26T10:47:04.180135+0000","last_undegraded":"2024-04-26T10:47:04.180135+0000","last_fullsized":"2024-04-26T10:47:04.180135+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'418","last_scrub_stamp":"2024-04-26T10:47:04.180097+0000","last_deep_scrub":"63'418","last_deep_scrub_stamp":"2024-04-26T10:47:04.180097+0000","last_clean_scrub_stamp":"2024-04-26T10:47:04.180097+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:48.800820+0000","scrub_duration":0.0025539730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20110,"num_write":390,"num_write_kb":75171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"84'67","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:20.114106+0000","last_change":"2024-04-26T10:46:20.114217+0000","last_active":"2024-04-26T10:46:20.114106+0000","last_peered":"2024-04-26T10:46:20.114106+0000","last_clean":"2024-04-26T10:46:20.114106+0000","last_became_active":"2024-04-26T10:45:53.175946+0000","last_became_peered":"2024-04-26T10:45:53.175946+0000","last_unstale":"2024-04-26T10:46:20.114106+0000","last_undegraded":"2024-04-26T10:46:20.114106+0000","last_fullsized":"2024-04-26T10:46:20.114106+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'67","last_scrub_stamp":"2024-04-26T10:46:20.114082+0000","last_deep_scrub":"84'67","last_deep_scrub_stamp":"2024-04-26T10:46:20.114082+0000","last_clean_scrub_stamp":"2024-04-26T10:46:20.114082+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:16.069289+0000","scrub_duration":0.00304288,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.162589+0000","last_change":"2024-04-26T10:45:45.872224+0000","last_active":"2024-04-26T10:45:58.162589+0000","last_peered":"2024-04-26T10:45:58.162589+0000","last_clean":"2024-04-26T10:45:58.162589+0000","last_became_active":"2024-04-26T10:45:45.871923+0000","last_became_peered":"2024-04-26T10:45:45.871923+0000","last_unstale":"2024-04-26T10:45:58.162589+0000","last_undegraded":"2024-04-26T10:45:58.162589+0000","last_fullsized":"2024-04-26T10:45:58.162589+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:20.398928+0000","last_clean_scrub_stamp":"2024-04-26T10:42:20.398928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"63'404","reported_seq":934,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:27.939150+0000","last_change":"2024-04-26T10:46:27.939150+0000","last_active":"2024-04-26T10:46:27.939150+0000","last_peered":"2024-04-26T10:46:27.939150+0000","last_clean":"2024-04-26T10:46:27.939150+0000","last_became_active":"2024-04-26T10:45:54.181795+0000","last_became_peered":"2024-04-26T10:45:54.181795+0000","last_unstale":"2024-04-26T10:46:27.939150+0000","last_undegraded":"2024-04-26T10:46:27.939150+0000","last_fullsized":"2024-04-26T10:46:27.939150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'404","last_scrub_stamp":"2024-04-26T10:46:27.939009+0000","last_deep_scrub":"63'404","last_deep_scrub_stamp":"2024-04-26T10:46:27.939009+0000","last_clean_scrub_stamp":"2024-04-26T10:46:27.939009+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:43.424977+0000","scrub_duration":0.0025994030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41262,"num_write":371,"num_write_kb":75820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"63'441","reported_seq":576,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:18.633017+0000","last_change":"2024-04-26T10:47:18.633141+0000","last_active":"2024-04-26T10:47:18.633017+0000","last_peered":"2024-04-26T10:47:18.633017+0000","last_clean":"2024-04-26T10:47:18.633017+0000","last_became_active":"2024-04-26T10:45:54.185862+0000","last_became_peered":"2024-04-26T10:45:54.185862+0000","last_unstale":"2024-04-26T10:47:18.633017+0000","last_undegraded":"2024-04-26T10:47:18.633017+0000","last_fullsized":"2024-04-26T10:47:18.633017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'441","last_scrub_stamp":"2024-04-26T10:47:18.632997+0000","last_deep_scrub":"63'441","last_deep_scrub_stamp":"2024-04-26T10:47:18.632997+0000","last_clean_scrub_stamp":"2024-04-26T10:47:18.632997+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:05.485177+0000","scrub_duration":0.0027604090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31514,"num_write":408,"num_write_kb":107129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"84'437","reported_seq":538,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:48.684693+0000","last_change":"2024-04-26T10:47:48.684853+0000","last_active":"2024-04-26T10:47:48.684693+0000","last_peered":"2024-04-26T10:47:48.684693+0000","last_clean":"2024-04-26T10:47:48.684693+0000","last_became_active":"2024-04-26T10:45:48.865212+0000","last_became_peered":"2024-04-26T10:45:48.865212+0000","last_unstale":"2024-04-26T10:47:48.684693+0000","last_undegraded":"2024-04-26T10:47:48.684693+0000","last_fullsized":"2024-04-26T10:47:48.684693+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'437","last_scrub_stamp":"2024-04-26T10:47:48.684672+0000","last_deep_scrub":"84'437","last_deep_scrub_stamp":"2024-04-26T10:47:48.684672+0000","last_clean_scrub_stamp":"2024-04-26T10:47:48.684672+0000","objects_scrubbed":6,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:21.823279+0000","scrub_duration":0.020050841999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9902610,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":9913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9896193,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"63'410","reported_seq":516,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161317+0000","last_change":"2024-04-26T10:45:54.184713+0000","last_active":"2024-04-26T10:45:58.161317+0000","last_peered":"2024-04-26T10:45:58.161317+0000","last_clean":"2024-04-26T10:45:58.161317+0000","last_became_active":"2024-04-26T10:45:54.182167+0000","last_became_peered":"2024-04-26T10:45:54.182167+0000","last_unstale":"2024-04-26T10:45:58.161317+0000","last_undegraded":"2024-04-26T10:45:58.161317+0000","last_fullsized":"2024-04-26T10:45:58.161317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12734,"num_write":373,"num_write_kb":34864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"84'86","reported_seq":198,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:03.871072+0000","last_change":"2024-04-26T10:47:03.871072+0000","last_active":"2024-04-26T10:47:03.871072+0000","last_peered":"2024-04-26T10:47:03.871072+0000","last_clean":"2024-04-26T10:47:03.871072+0000","last_became_active":"2024-04-26T10:45:45.874746+0000","last_became_peered":"2024-04-26T10:45:45.874746+0000","last_unstale":"2024-04-26T10:47:03.871072+0000","last_undegraded":"2024-04-26T10:47:03.871072+0000","last_fullsized":"2024-04-26T10:47:03.871072+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'86","last_scrub_stamp":"2024-04-26T10:47:03.870909+0000","last_deep_scrub":"84'86","last_deep_scrub_stamp":"2024-04-26T10:47:03.870909+0000","last_clean_scrub_stamp":"2024-04-26T10:47:03.870909+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:03:47.013205+0000","scrub_duration":0.0039681769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"84'333","reported_seq":432,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:14.252839+0000","last_change":"2024-04-26T10:46:14.252936+0000","last_active":"2024-04-26T10:46:14.252839+0000","last_peered":"2024-04-26T10:46:14.252839+0000","last_clean":"2024-04-26T10:46:14.252839+0000","last_became_active":"2024-04-26T10:45:56.161449+0000","last_became_peered":"2024-04-26T10:45:56.161449+0000","last_unstale":"2024-04-26T10:46:14.252839+0000","last_undegraded":"2024-04-26T10:46:14.252839+0000","last_fullsized":"2024-04-26T10:46:14.252839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'333","last_scrub_stamp":"2024-04-26T10:46:14.252815+0000","last_deep_scrub":"84'333","last_deep_scrub_stamp":"2024-04-26T10:46:14.252815+0000","last_clean_scrub_stamp":"2024-04-26T10:46:14.252815+0000","objects_scrubbed":1,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:06.020647+0000","scrub_duration":0.0087233659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"63'487","reported_seq":1109,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:22.045006+0000","last_change":"2024-04-26T10:47:22.045108+0000","last_active":"2024-04-26T10:47:22.045006+0000","last_peered":"2024-04-26T10:47:22.045006+0000","last_clean":"2024-04-26T10:47:22.045006+0000","last_became_active":"2024-04-26T10:45:51.159235+0000","last_became_peered":"2024-04-26T10:45:51.159235+0000","last_unstale":"2024-04-26T10:47:22.045006+0000","last_undegraded":"2024-04-26T10:47:22.045006+0000","last_fullsized":"2024-04-26T10:47:22.045006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'487","last_scrub_stamp":"2024-04-26T10:47:22.044982+0000","last_deep_scrub":"63'487","last_deep_scrub_stamp":"2024-04-26T10:47:22.044982+0000","last_clean_scrub_stamp":"2024-04-26T10:47:22.044982+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:31.153345+0000","scrub_duration":0.0026463189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":43316,"num_write":468,"num_write_kb":77062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"62'61","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:11.105029+0000","last_change":"2024-04-26T10:46:11.105133+0000","last_active":"2024-04-26T10:46:11.105029+0000","last_peered":"2024-04-26T10:46:11.105029+0000","last_clean":"2024-04-26T10:46:11.105029+0000","last_became_active":"2024-04-26T10:45:53.173851+0000","last_became_peered":"2024-04-26T10:45:53.173851+0000","last_unstale":"2024-04-26T10:46:11.105029+0000","last_undegraded":"2024-04-26T10:46:11.105029+0000","last_fullsized":"2024-04-26T10:46:11.105029+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'61","last_scrub_stamp":"2024-04-26T10:46:11.105005+0000","last_deep_scrub":"62'61","last_deep_scrub_stamp":"2024-04-26T10:46:11.105005+0000","last_clean_scrub_stamp":"2024-04-26T10:46:11.105005+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:57.257799+0000","scrub_duration":0.0016999000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'457","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:47.223896+0000","last_change":"2024-04-26T10:46:47.224014+0000","last_active":"2024-04-26T10:46:47.223896+0000","last_peered":"2024-04-26T10:46:47.223896+0000","last_clean":"2024-04-26T10:46:47.223896+0000","last_became_active":"2024-04-26T10:45:54.189622+0000","last_became_peered":"2024-04-26T10:45:54.189622+0000","last_unstale":"2024-04-26T10:46:47.223896+0000","last_undegraded":"2024-04-26T10:46:47.223896+0000","last_fullsized":"2024-04-26T10:46:47.223896+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'457","last_scrub_stamp":"2024-04-26T10:46:47.223873+0000","last_deep_scrub":"63'457","last_deep_scrub_stamp":"2024-04-26T10:46:47.223873+0000","last_clean_scrub_stamp":"2024-04-26T10:46:47.223873+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:53:33.293955+0000","scrub_duration":0.003282943,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14848,"num_write":427,"num_write_kb":71903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'377","reported_seq":851,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:29.894860+0000","last_change":"2024-04-26T10:46:29.894860+0000","last_active":"2024-04-26T10:46:29.894860+0000","last_peered":"2024-04-26T10:46:29.894860+0000","last_clean":"2024-04-26T10:46:29.894860+0000","last_became_active":"2024-04-26T10:45:49.866707+0000","last_became_peered":"2024-04-26T10:45:49.866707+0000","last_unstale":"2024-04-26T10:46:29.894860+0000","last_undegraded":"2024-04-26T10:46:29.894860+0000","last_fullsized":"2024-04-26T10:46:29.894860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'377","last_scrub_stamp":"2024-04-26T10:46:29.894727+0000","last_deep_scrub":"63'377","last_deep_scrub_stamp":"2024-04-26T10:46:29.894727+0000","last_clean_scrub_stamp":"2024-04-26T10:46:29.894727+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:20.517004+0000","scrub_duration":0.0019921740000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26932,"num_write":349,"num_write_kb":55611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"84'564","reported_seq":658,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:21.029077+0000","last_change":"2024-04-26T10:47:21.029194+0000","last_active":"2024-04-26T10:47:21.029077+0000","last_peered":"2024-04-26T10:47:21.029077+0000","last_clean":"2024-04-26T10:47:21.029077+0000","last_became_active":"2024-04-26T10:42:25.683467+0000","last_became_peered":"2024-04-26T10:42:25.683467+0000","last_unstale":"2024-04-26T10:47:21.029077+0000","last_undegraded":"2024-04-26T10:47:21.029077+0000","last_fullsized":"2024-04-26T10:47:21.029077+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'564","last_scrub_stamp":"2024-04-26T10:47:21.029056+0000","last_deep_scrub":"84'564","last_deep_scrub_stamp":"2024-04-26T10:47:21.029056+0000","last_clean_scrub_stamp":"2024-04-26T10:47:21.029056+0000","objects_scrubbed":2,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:57.701118+0000","scrub_duration":0.016487087000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":8440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'425","reported_seq":890,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:26.996068+0000","last_change":"2024-04-26T10:47:26.996171+0000","last_active":"2024-04-26T10:47:26.996068+0000","last_peered":"2024-04-26T10:47:26.996068+0000","last_clean":"2024-04-26T10:47:26.996068+0000","last_became_active":"2024-04-26T10:45:56.161315+0000","last_became_peered":"2024-04-26T10:45:56.161315+0000","last_unstale":"2024-04-26T10:47:26.996068+0000","last_undegraded":"2024-04-26T10:47:26.996068+0000","last_fullsized":"2024-04-26T10:47:26.996068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'425","last_scrub_stamp":"2024-04-26T10:47:26.996045+0000","last_deep_scrub":"63'425","last_deep_scrub_stamp":"2024-04-26T10:47:26.996045+0000","last_clean_scrub_stamp":"2024-04-26T10:47:26.996045+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:14.103578+0000","scrub_duration":0.002384251,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":19004,"num_write":390,"num_write_kb":75524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"84'260","reported_seq":344,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:31.083586+0000","last_change":"2024-04-26T10:47:31.083683+0000","last_active":"2024-04-26T10:47:31.083586+0000","last_peered":"2024-04-26T10:47:31.083586+0000","last_clean":"2024-04-26T10:47:31.083586+0000","last_became_active":"2024-04-26T10:45:56.160344+0000","last_became_peered":"2024-04-26T10:45:56.160344+0000","last_unstale":"2024-04-26T10:47:31.083586+0000","last_undegraded":"2024-04-26T10:47:31.083586+0000","last_fullsized":"2024-04-26T10:47:31.083586+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'260","last_scrub_stamp":"2024-04-26T10:47:31.083562+0000","last_deep_scrub":"84'260","last_deep_scrub_stamp":"2024-04-26T10:47:31.083562+0000","last_clean_scrub_stamp":"2024-04-26T10:47:31.083562+0000","objects_scrubbed":1,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:15.212393+0000","scrub_duration":0.0092315850000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'418","reported_seq":942,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:41.881058+0000","last_change":"2024-04-26T10:46:41.881058+0000","last_active":"2024-04-26T10:46:41.881058+0000","last_peered":"2024-04-26T10:46:41.881058+0000","last_clean":"2024-04-26T10:46:41.881058+0000","last_became_active":"2024-04-26T10:45:55.178079+0000","last_became_peered":"2024-04-26T10:45:55.178079+0000","last_unstale":"2024-04-26T10:46:41.881058+0000","last_undegraded":"2024-04-26T10:46:41.881058+0000","last_fullsized":"2024-04-26T10:46:41.881058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'418","last_scrub_stamp":"2024-04-26T10:46:41.880550+0000","last_deep_scrub":"63'418","last_deep_scrub_stamp":"2024-04-26T10:46:41.880550+0000","last_clean_scrub_stamp":"2024-04-26T10:46:41.880550+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:06:37.113070+0000","scrub_duration":0.0024544520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":34476,"num_write":379,"num_write_kb":101645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"84'497","reported_seq":591,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:05.841910+0000","last_change":"2024-04-26T10:47:05.841910+0000","last_active":"2024-04-26T10:47:05.841910+0000","last_peered":"2024-04-26T10:47:05.841910+0000","last_clean":"2024-04-26T10:47:05.841910+0000","last_became_active":"2024-04-26T10:42:25.687829+0000","last_became_peered":"2024-04-26T10:42:25.687829+0000","last_unstale":"2024-04-26T10:47:05.841910+0000","last_undegraded":"2024-04-26T10:47:05.841910+0000","last_fullsized":"2024-04-26T10:47:05.841910+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'497","last_scrub_stamp":"2024-04-26T10:47:05.841747+0000","last_deep_scrub":"84'497","last_deep_scrub_stamp":"2024-04-26T10:47:05.841747+0000","last_clean_scrub_stamp":"2024-04-26T10:47:05.841747+0000","objects_scrubbed":3,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:04.414657+0000","scrub_duration":0.021777650999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":12543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"63'406","reported_seq":599,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:28.675106+0000","last_change":"2024-04-26T10:47:28.675106+0000","last_active":"2024-04-26T10:47:28.675106+0000","last_peered":"2024-04-26T10:47:28.675106+0000","last_clean":"2024-04-26T10:47:28.675106+0000","last_became_active":"2024-04-26T10:45:54.189591+0000","last_became_peered":"2024-04-26T10:45:54.189591+0000","last_unstale":"2024-04-26T10:47:28.675106+0000","last_undegraded":"2024-04-26T10:47:28.675106+0000","last_fullsized":"2024-04-26T10:47:28.675106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'406","last_scrub_stamp":"2024-04-26T10:47:28.674971+0000","last_deep_scrub":"63'406","last_deep_scrub_stamp":"2024-04-26T10:47:28.674971+0000","last_clean_scrub_stamp":"2024-04-26T10:47:28.674971+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:00.503759+0000","scrub_duration":0.0032453080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":45941,"num_write":372,"num_write_kb":80011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"84'62","reported_seq":174,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:06.870273+0000","last_change":"2024-04-26T10:47:06.870273+0000","last_active":"2024-04-26T10:47:06.870273+0000","last_peered":"2024-04-26T10:47:06.870273+0000","last_clean":"2024-04-26T10:47:06.870273+0000","last_became_active":"2024-04-26T10:45:45.874300+0000","last_became_peered":"2024-04-26T10:45:45.874300+0000","last_unstale":"2024-04-26T10:47:06.870273+0000","last_undegraded":"2024-04-26T10:47:06.870273+0000","last_fullsized":"2024-04-26T10:47:06.870273+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'62","last_scrub_stamp":"2024-04-26T10:47:06.870147+0000","last_deep_scrub":"84'62","last_deep_scrub_stamp":"2024-04-26T10:47:06.870147+0000","last_clean_scrub_stamp":"2024-04-26T10:47:06.870147+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:46.778599+0000","scrub_duration":0.0095987950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"63'375","reported_seq":835,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:19.295162+0000","last_change":"2024-04-26T10:46:19.295289+0000","last_active":"2024-04-26T10:46:19.295162+0000","last_peered":"2024-04-26T10:46:19.295162+0000","last_clean":"2024-04-26T10:46:19.295162+0000","last_became_active":"2024-04-26T10:45:56.160416+0000","last_became_peered":"2024-04-26T10:45:56.160416+0000","last_unstale":"2024-04-26T10:46:19.295162+0000","last_undegraded":"2024-04-26T10:46:19.295162+0000","last_fullsized":"2024-04-26T10:46:19.295162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'375","last_scrub_stamp":"2024-04-26T10:46:19.295138+0000","last_deep_scrub":"63'375","last_deep_scrub_stamp":"2024-04-26T10:46:19.295138+0000","last_clean_scrub_stamp":"2024-04-26T10:46:19.295138+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:58.675348+0000","scrub_duration":0.0023697280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16213,"num_write":354,"num_write_kb":54493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":332,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"84'278","reported_seq":382,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:12.320143+0000","last_change":"2024-04-26T10:46:12.320242+0000","last_active":"2024-04-26T10:46:12.320143+0000","last_peered":"2024-04-26T10:46:12.320143+0000","last_clean":"2024-04-26T10:46:12.320143+0000","last_became_active":"2024-04-26T10:45:56.160414+0000","last_became_peered":"2024-04-26T10:45:56.160414+0000","last_unstale":"2024-04-26T10:46:12.320143+0000","last_undegraded":"2024-04-26T10:46:12.320143+0000","last_fullsized":"2024-04-26T10:46:12.320143+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'278","last_scrub_stamp":"2024-04-26T10:46:12.320120+0000","last_deep_scrub":"84'278","last_deep_scrub_stamp":"2024-04-26T10:46:12.320120+0000","last_clean_scrub_stamp":"2024-04-26T10:46:12.320120+0000","objects_scrubbed":2,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:17:48.308771+0000","scrub_duration":0.0082694940000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"63'379","reported_seq":476,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.161505+0000","last_change":"2024-04-26T10:45:53.177365+0000","last_active":"2024-04-26T10:45:58.161505+0000","last_peered":"2024-04-26T10:45:58.161505+0000","last_clean":"2024-04-26T10:45:58.161505+0000","last_became_active":"2024-04-26T10:45:53.173645+0000","last_became_peered":"2024-04-26T10:45:53.173645+0000","last_unstale":"2024-04-26T10:45:58.161505+0000","last_undegraded":"2024-04-26T10:45:58.161505+0000","last_fullsized":"2024-04-26T10:45:58.161505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20480,"num_write":343,"num_write_kb":25788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"84'241","reported_seq":364,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:58.793068+0000","last_change":"2024-04-26T10:46:58.793068+0000","last_active":"2024-04-26T10:46:58.793068+0000","last_peered":"2024-04-26T10:46:58.793068+0000","last_clean":"2024-04-26T10:46:58.793068+0000","last_became_active":"2024-04-26T10:45:48.866716+0000","last_became_peered":"2024-04-26T10:45:48.866716+0000","last_unstale":"2024-04-26T10:46:58.793068+0000","last_undegraded":"2024-04-26T10:46:58.793068+0000","last_fullsized":"2024-04-26T10:46:58.793068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'241","last_scrub_stamp":"2024-04-26T10:46:58.792919+0000","last_deep_scrub":"84'241","last_deep_scrub_stamp":"2024-04-26T10:46:58.792919+0000","last_clean_scrub_stamp":"2024-04-26T10:46:58.792919+0000","objects_scrubbed":4,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:35.543499+0000","scrub_duration":0.021440362000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":12393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"63'419","reported_seq":583,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:54.737707+0000","last_change":"2024-04-26T10:46:54.737707+0000","last_active":"2024-04-26T10:46:54.737707+0000","last_peered":"2024-04-26T10:46:54.737707+0000","last_clean":"2024-04-26T10:46:54.737707+0000","last_became_active":"2024-04-26T10:42:26.040504+0000","last_became_peered":"2024-04-26T10:42:26.040504+0000","last_unstale":"2024-04-26T10:46:54.737707+0000","last_undegraded":"2024-04-26T10:46:54.737707+0000","last_fullsized":"2024-04-26T10:46:54.737707+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'419","last_scrub_stamp":"2024-04-26T10:46:54.737548+0000","last_deep_scrub":"63'419","last_deep_scrub_stamp":"2024-04-26T10:46:54.737548+0000","last_clean_scrub_stamp":"2024-04-26T10:46:54.737548+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:36.073071+0000","scrub_duration":0.0037174790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39582,"num_write":378,"num_write_kb":54867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"84'62","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:09.103458+0000","last_change":"2024-04-26T10:46:09.103560+0000","last_active":"2024-04-26T10:46:09.103458+0000","last_peered":"2024-04-26T10:46:09.103458+0000","last_clean":"2024-04-26T10:46:09.103458+0000","last_became_active":"2024-04-26T10:45:53.178804+0000","last_became_peered":"2024-04-26T10:45:53.178804+0000","last_unstale":"2024-04-26T10:46:09.103458+0000","last_undegraded":"2024-04-26T10:46:09.103458+0000","last_fullsized":"2024-04-26T10:46:09.103458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'62","last_scrub_stamp":"2024-04-26T10:46:09.103432+0000","last_deep_scrub":"84'62","last_deep_scrub_stamp":"2024-04-26T10:46:09.103432+0000","last_clean_scrub_stamp":"2024-04-26T10:46:09.103432+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:25.007335+0000","scrub_duration":0.00814082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'437","reported_seq":535,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:18.250920+0000","last_change":"2024-04-26T10:46:18.251026+0000","last_active":"2024-04-26T10:46:18.250920+0000","last_peered":"2024-04-26T10:46:18.250920+0000","last_clean":"2024-04-26T10:46:18.250920+0000","last_became_active":"2024-04-26T10:45:53.177071+0000","last_became_peered":"2024-04-26T10:45:53.177071+0000","last_unstale":"2024-04-26T10:46:18.250920+0000","last_undegraded":"2024-04-26T10:46:18.250920+0000","last_fullsized":"2024-04-26T10:46:18.250920+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'437","last_scrub_stamp":"2024-04-26T10:46:18.250898+0000","last_deep_scrub":"63'437","last_deep_scrub_stamp":"2024-04-26T10:46:18.250898+0000","last_clean_scrub_stamp":"2024-04-26T10:46:18.250898+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:10.767270+0000","scrub_duration":0.002104093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":7562,"num_write":400,"num_write_kb":26121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"84'61","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:25.042019+0000","last_change":"2024-04-26T10:46:25.042141+0000","last_active":"2024-04-26T10:46:25.042019+0000","last_peered":"2024-04-26T10:46:25.042019+0000","last_clean":"2024-04-26T10:46:25.042019+0000","last_became_active":"2024-04-26T10:45:53.173542+0000","last_became_peered":"2024-04-26T10:45:53.173542+0000","last_unstale":"2024-04-26T10:46:25.042019+0000","last_undegraded":"2024-04-26T10:46:25.042019+0000","last_fullsized":"2024-04-26T10:46:25.042019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'61","last_scrub_stamp":"2024-04-26T10:46:25.041995+0000","last_deep_scrub":"84'61","last_deep_scrub_stamp":"2024-04-26T10:46:25.041995+0000","last_clean_scrub_stamp":"2024-04-26T10:46:25.041995+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:44:18.722171+0000","scrub_duration":0.010280186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2672,"num_read_kb":1454712,"num_write":24538,"num_write_kb":4190103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26671,"ondisk_log_size":26671,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128811551,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":5770,"num_write_kb":129888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257691648,"data_stored":257623102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},"log_size":7643,"ondisk_log_size":7643,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738437,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187500,"kb_used_data":80164,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94184340,"statfs":{"total":96636764160,"available":96444764160,"internally_reserved":0,"allocated":82087936,"data_stored":81566103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:47:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.42799999999999999,"15min":0.433},"min":{"1min":0.34699999999999998,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.58899999999999997,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.433,"15min":0.438},"min":{"1min":0.34799999999999998,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.46999999999999997}]},{"osd":1,"last update":"Fri Apr 26 10:46:49 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.42599999999999999}]}]},{"osd":1,"up_from":70,"seq":300647710747,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140112,"kb_used_data":90440,"kb_used_omap":7,"kb_used_meta":49656,"kb_avail":94231728,"statfs":{"total":96636764160,"available":96493289472,"internally_reserved":0,"allocated":92610560,"data_stored":92059263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7181,"internal_metadata":50848755},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45000000000000001,"15min":0.44700000000000001},"min":{"1min":0.34699999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.56200000000000006,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.44900000000000001,"15min":0.443},"min":{"1min":0.318,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.56399999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.55100000000000005}]},{"osd":2,"last update":"Fri Apr 26 10:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.45400000000000001,"15min":0.44700000000000001},"min":{"1min":0.33500000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.63100000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.46000000000000002},"min":{"1min":0.30499999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.64200000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.52900000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214376,"kb_used_data":84896,"kb_used_omap":1,"kb_used_meta":129470,"kb_avail":94157464,"statfs":{"total":96636764160,"available":96417243136,"internally_reserved":0,"allocated":86933504,"data_stored":86396712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132577734},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.375},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.45300000000000001}]},{"osd":2,"last update":"Fri Apr 26 10:47:29 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.438,"15min":0.45200000000000001},"min":{"1min":0.38,"5min":0.183,"15min":0.183},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.44400000000000001,"15min":0.46600000000000003},"min":{"1min":0.38,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.69299999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.51200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":85422080,"data_stored":85400264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":91099136,"data_stored":91062815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81170432,"data_stored":81160023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:47:49.885 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:49.885 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:49.886 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:49.887 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:49.887 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:49.887 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:49.888 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T10:42:24.664396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=24, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:49.888 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:49.888 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T10:42:20.398928+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:49.888 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:49.889 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:47:49.889 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T10:48:09.891 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:48:10.209 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:48:10.210 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:48:10.220 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":257,"stamp":"2024-04-26T10:48:09.683893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129401919,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2852,"num_read_kb":1456290,"num_write":30511,"num_write_kb":4323451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9253,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34478,"ondisk_log_size":34478,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":541988,"kb_used_data":255500,"kb_used_omap":10,"kb_used_meta":286453,"kb_avail":282573532,"statfs":{"total":289910292480,"available":289355296768,"internally_reserved":0,"allocated":261632000,"data_stored":260022078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10369,"internal_metadata":293328767},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002939"},"pg_stats":[{"pgid":"4.3f","version":"63'415","reported_seq":554,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:52.748402+0000","last_change":"2024-04-26T10:46:52.748512+0000","last_active":"2024-04-26T10:46:52.748402+0000","last_peered":"2024-04-26T10:46:52.748402+0000","last_clean":"2024-04-26T10:46:52.748402+0000","last_became_active":"2024-04-26T10:42:26.044597+0000","last_became_peered":"2024-04-26T10:42:26.044597+0000","last_unstale":"2024-04-26T10:46:52.748402+0000","last_undegraded":"2024-04-26T10:46:52.748402+0000","last_fullsized":"2024-04-26T10:46:52.748402+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'415","last_scrub_stamp":"2024-04-26T10:46:52.748380+0000","last_deep_scrub":"63'415","last_deep_scrub_stamp":"2024-04-26T10:46:52.748380+0000","last_clean_scrub_stamp":"2024-04-26T10:46:52.748380+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:44.118436+0000","scrub_duration":0.002346842,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22963,"num_write":385,"num_write_kb":71406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"63'396","reported_seq":534,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:40.755775+0000","last_change":"2024-04-26T10:47:40.755886+0000","last_active":"2024-04-26T10:47:40.755775+0000","last_peered":"2024-04-26T10:47:40.755775+0000","last_clean":"2024-04-26T10:47:40.755775+0000","last_became_active":"2024-04-26T10:45:54.192613+0000","last_became_peered":"2024-04-26T10:45:54.192613+0000","last_unstale":"2024-04-26T10:47:40.755775+0000","last_undegraded":"2024-04-26T10:47:40.755775+0000","last_fullsized":"2024-04-26T10:47:40.755775+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'396","last_scrub_stamp":"2024-04-26T10:47:40.755755+0000","last_deep_scrub":"63'396","last_deep_scrub_stamp":"2024-04-26T10:47:40.755755+0000","last_clean_scrub_stamp":"2024-04-26T10:47:40.755755+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:20.899080+0000","scrub_duration":0.0034271380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9499,"num_write":371,"num_write_kb":38601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"63'366","reported_seq":462,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:24.288483+0000","last_change":"2024-04-26T10:46:24.288483+0000","last_active":"2024-04-26T10:46:24.288483+0000","last_peered":"2024-04-26T10:46:24.288483+0000","last_clean":"2024-04-26T10:46:24.288483+0000","last_became_active":"2024-04-26T10:45:55.180991+0000","last_became_peered":"2024-04-26T10:45:55.180991+0000","last_unstale":"2024-04-26T10:46:24.288483+0000","last_undegraded":"2024-04-26T10:46:24.288483+0000","last_fullsized":"2024-04-26T10:46:24.288483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'366","last_scrub_stamp":"2024-04-26T10:46:24.288343+0000","last_deep_scrub":"63'366","last_deep_scrub_stamp":"2024-04-26T10:46:24.288343+0000","last_clean_scrub_stamp":"2024-04-26T10:46:24.288343+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:09.803889+0000","scrub_duration":0.0024847200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6211,"num_write":338,"num_write_kb":38844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"63'394","reported_seq":558,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:27.644272+0000","last_change":"2024-04-26T10:47:27.644272+0000","last_active":"2024-04-26T10:47:27.644272+0000","last_peered":"2024-04-26T10:47:27.644272+0000","last_clean":"2024-04-26T10:47:27.644272+0000","last_became_active":"2024-04-26T10:45:51.159099+0000","last_became_peered":"2024-04-26T10:45:51.159099+0000","last_unstale":"2024-04-26T10:47:27.644272+0000","last_undegraded":"2024-04-26T10:47:27.644272+0000","last_fullsized":"2024-04-26T10:47:27.644272+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'394","last_scrub_stamp":"2024-04-26T10:47:27.644141+0000","last_deep_scrub":"63'394","last_deep_scrub_stamp":"2024-04-26T10:47:27.644141+0000","last_clean_scrub_stamp":"2024-04-26T10:47:27.644141+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:03.603073+0000","scrub_duration":0.00246729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":52323,"num_write":357,"num_write_kb":63323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"63'409","reported_seq":520,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:46.894628+0000","last_change":"2024-04-26T10:46:46.894628+0000","last_active":"2024-04-26T10:46:46.894628+0000","last_peered":"2024-04-26T10:46:46.894628+0000","last_clean":"2024-04-26T10:46:46.894628+0000","last_became_active":"2024-04-26T10:42:26.040487+0000","last_became_peered":"2024-04-26T10:42:26.040487+0000","last_unstale":"2024-04-26T10:46:46.894628+0000","last_undegraded":"2024-04-26T10:46:46.894628+0000","last_fullsized":"2024-04-26T10:46:46.894628+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'409","last_scrub_stamp":"2024-04-26T10:46:46.894476+0000","last_deep_scrub":"63'409","last_deep_scrub_stamp":"2024-04-26T10:46:46.894476+0000","last_clean_scrub_stamp":"2024-04-26T10:46:46.894476+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:34.325893+0000","scrub_duration":0.0034301790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":372,"num_write_kb":42764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'385","reported_seq":476,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:21.300652+0000","last_change":"2024-04-26T10:46:21.300788+0000","last_active":"2024-04-26T10:46:21.300652+0000","last_peered":"2024-04-26T10:46:21.300652+0000","last_clean":"2024-04-26T10:46:21.300652+0000","last_became_active":"2024-04-26T10:45:49.861811+0000","last_became_peered":"2024-04-26T10:45:49.861811+0000","last_unstale":"2024-04-26T10:46:21.300652+0000","last_undegraded":"2024-04-26T10:46:21.300652+0000","last_fullsized":"2024-04-26T10:46:21.300652+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'385","last_scrub_stamp":"2024-04-26T10:46:21.300632+0000","last_deep_scrub":"63'385","last_deep_scrub_stamp":"2024-04-26T10:46:21.300632+0000","last_clean_scrub_stamp":"2024-04-26T10:46:21.300632+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:50.462322+0000","scrub_duration":0.0030393180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4124,"num_write":356,"num_write_kb":69857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"63'425","reported_seq":546,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:55.576950+0000","last_change":"2024-04-26T10:47:55.577087+0000","last_active":"2024-04-26T10:47:55.576950+0000","last_peered":"2024-04-26T10:47:55.576950+0000","last_clean":"2024-04-26T10:47:55.576950+0000","last_became_active":"2024-04-26T10:45:50.866996+0000","last_became_peered":"2024-04-26T10:45:50.866996+0000","last_unstale":"2024-04-26T10:47:55.576950+0000","last_undegraded":"2024-04-26T10:47:55.576950+0000","last_fullsized":"2024-04-26T10:47:55.576950+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'425","last_scrub_stamp":"2024-04-26T10:47:55.576916+0000","last_deep_scrub":"63'425","last_deep_scrub_stamp":"2024-04-26T10:47:55.576916+0000","last_clean_scrub_stamp":"2024-04-26T10:47:55.576916+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:34:40.031269+0000","scrub_duration":0.0031622040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13036,"num_write":390,"num_write_kb":67193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"63'399","reported_seq":508,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:45:58.164893+0000","last_change":"2024-04-26T10:45:58.164304+0000","last_active":"2024-04-26T10:45:58.164893+0000","last_peered":"2024-04-26T10:45:58.164893+0000","last_clean":"2024-04-26T10:45:58.164893+0000","last_became_active":"2024-04-26T10:45:58.162532+0000","last_became_peered":"2024-04-26T10:45:58.162532+0000","last_unstale":"2024-04-26T10:45:58.164893+0000","last_undegraded":"2024-04-26T10:45:58.164893+0000","last_fullsized":"2024-04-26T10:45:58.164893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25678,"num_write":356,"num_write_kb":116549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"63'442","reported_seq":602,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:09.239513+0000","last_change":"2024-04-26T10:47:09.239513+0000","last_active":"2024-04-26T10:47:09.239513+0000","last_peered":"2024-04-26T10:47:09.239513+0000","last_clean":"2024-04-26T10:47:09.239513+0000","last_became_active":"2024-04-26T10:42:26.045177+0000","last_became_peered":"2024-04-26T10:42:26.045177+0000","last_unstale":"2024-04-26T10:47:09.239513+0000","last_undegraded":"2024-04-26T10:47:09.239513+0000","last_fullsized":"2024-04-26T10:47:09.239513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'442","last_scrub_stamp":"2024-04-26T10:47:09.239378+0000","last_deep_scrub":"63'442","last_deep_scrub_stamp":"2024-04-26T10:47:09.239378+0000","last_clean_scrub_stamp":"2024-04-26T10:47:09.239378+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:55.718285+0000","scrub_duration":0.0028840749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35111,"num_write":413,"num_write_kb":60306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'393","reported_seq":528,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:31.697765+0000","last_change":"2024-04-26T10:47:31.697891+0000","last_active":"2024-04-26T10:47:31.697765+0000","last_peered":"2024-04-26T10:47:31.697765+0000","last_clean":"2024-04-26T10:47:31.697765+0000","last_became_active":"2024-04-26T10:45:54.191514+0000","last_became_peered":"2024-04-26T10:45:54.191514+0000","last_unstale":"2024-04-26T10:47:31.697765+0000","last_undegraded":"2024-04-26T10:47:31.697765+0000","last_fullsized":"2024-04-26T10:47:31.697765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'393","last_scrub_stamp":"2024-04-26T10:47:31.697743+0000","last_deep_scrub":"63'393","last_deep_scrub_stamp":"2024-04-26T10:47:31.697743+0000","last_clean_scrub_stamp":"2024-04-26T10:47:31.697743+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:53:35.353544+0000","scrub_duration":0.0030851210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5355,"num_write":351,"num_write_kb":38901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"63'377","reported_seq":495,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:10.635889+0000","last_change":"2024-04-26T10:47:10.635889+0000","last_active":"2024-04-26T10:47:10.635889+0000","last_peered":"2024-04-26T10:47:10.635889+0000","last_clean":"2024-04-26T10:47:10.635889+0000","last_became_active":"2024-04-26T10:45:49.862718+0000","last_became_peered":"2024-04-26T10:45:49.862718+0000","last_unstale":"2024-04-26T10:47:10.635889+0000","last_undegraded":"2024-04-26T10:47:10.635889+0000","last_fullsized":"2024-04-26T10:47:10.635889+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'377","last_scrub_stamp":"2024-04-26T10:47:10.635759+0000","last_deep_scrub":"63'377","last_deep_scrub_stamp":"2024-04-26T10:47:10.635759+0000","last_clean_scrub_stamp":"2024-04-26T10:47:10.635759+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:29.097205+0000","scrub_duration":0.0028839180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18030,"num_write":355,"num_write_kb":67044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"63'365","reported_seq":821,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:38.660333+0000","last_change":"2024-04-26T10:47:38.660453+0000","last_active":"2024-04-26T10:47:38.660333+0000","last_peered":"2024-04-26T10:47:38.660333+0000","last_clean":"2024-04-26T10:47:38.660333+0000","last_became_active":"2024-04-26T10:45:57.164964+0000","last_became_peered":"2024-04-26T10:45:57.164964+0000","last_unstale":"2024-04-26T10:47:38.660333+0000","last_undegraded":"2024-04-26T10:47:38.660333+0000","last_fullsized":"2024-04-26T10:47:38.660333+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'365","last_scrub_stamp":"2024-04-26T10:47:38.660308+0000","last_deep_scrub":"63'365","last_deep_scrub_stamp":"2024-04-26T10:47:38.660308+0000","last_clean_scrub_stamp":"2024-04-26T10:47:38.660308+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:47.168185+0000","scrub_duration":0.0029265279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14866,"num_write":337,"num_write_kb":71188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'397","reported_seq":503,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:27.693031+0000","last_change":"2024-04-26T10:47:27.693148+0000","last_active":"2024-04-26T10:47:27.693031+0000","last_peered":"2024-04-26T10:47:27.693031+0000","last_clean":"2024-04-26T10:47:27.693031+0000","last_became_active":"2024-04-26T10:42:26.041617+0000","last_became_peered":"2024-04-26T10:42:26.041617+0000","last_unstale":"2024-04-26T10:47:27.693031+0000","last_undegraded":"2024-04-26T10:47:27.693031+0000","last_fullsized":"2024-04-26T10:47:27.693031+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'397","last_scrub_stamp":"2024-04-26T10:47:27.693009+0000","last_deep_scrub":"63'397","last_deep_scrub_stamp":"2024-04-26T10:47:27.693009+0000","last_clean_scrub_stamp":"2024-04-26T10:47:27.693009+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:52.452931+0000","scrub_duration":0.0036373759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8192,"num_write":362,"num_write_kb":54822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"63'408","reported_seq":500,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:34.396311+0000","last_change":"2024-04-26T10:46:34.396311+0000","last_active":"2024-04-26T10:46:34.396311+0000","last_peered":"2024-04-26T10:46:34.396311+0000","last_clean":"2024-04-26T10:46:34.396311+0000","last_became_active":"2024-04-26T10:45:53.177677+0000","last_became_peered":"2024-04-26T10:45:53.177677+0000","last_unstale":"2024-04-26T10:46:34.396311+0000","last_undegraded":"2024-04-26T10:46:34.396311+0000","last_fullsized":"2024-04-26T10:46:34.396311+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:34.396168+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:34.396168+0000","last_clean_scrub_stamp":"2024-04-26T10:46:34.396168+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:28.312103+0000","scrub_duration":0.002988662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4688,"num_write":374,"num_write_kb":21766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"63'409","reported_seq":535,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:47.541645+0000","last_change":"2024-04-26T10:46:47.541645+0000","last_active":"2024-04-26T10:46:47.541645+0000","last_peered":"2024-04-26T10:46:47.541645+0000","last_clean":"2024-04-26T10:46:47.541645+0000","last_became_active":"2024-04-26T10:45:54.185826+0000","last_became_peered":"2024-04-26T10:45:54.185826+0000","last_unstale":"2024-04-26T10:46:47.541645+0000","last_undegraded":"2024-04-26T10:46:47.541645+0000","last_fullsized":"2024-04-26T10:46:47.541645+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'409","last_scrub_stamp":"2024-04-26T10:46:47.541492+0000","last_deep_scrub":"63'409","last_deep_scrub_stamp":"2024-04-26T10:46:47.541492+0000","last_clean_scrub_stamp":"2024-04-26T10:46:47.541492+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:05.889065+0000","scrub_duration":0.0023676470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25968,"num_write":366,"num_write_kb":75698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"63'460","reported_seq":575,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:20.325615+0000","last_change":"2024-04-26T10:46:20.325615+0000","last_active":"2024-04-26T10:46:20.325615+0000","last_peered":"2024-04-26T10:46:20.325615+0000","last_clean":"2024-04-26T10:46:20.325615+0000","last_became_active":"2024-04-26T10:45:53.174699+0000","last_became_peered":"2024-04-26T10:45:53.174699+0000","last_unstale":"2024-04-26T10:46:20.325615+0000","last_undegraded":"2024-04-26T10:46:20.325615+0000","last_fullsized":"2024-04-26T10:46:20.325615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'460","last_scrub_stamp":"2024-04-26T10:46:20.325486+0000","last_deep_scrub":"63'460","last_deep_scrub_stamp":"2024-04-26T10:46:20.325486+0000","last_clean_scrub_stamp":"2024-04-26T10:46:20.325486+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:51.733701+0000","scrub_duration":0.0023796759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16269,"num_write":426,"num_write_kb":67839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"63'393","reported_seq":525,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:11.204577+0000","last_change":"2024-04-26T10:47:11.204709+0000","last_active":"2024-04-26T10:47:11.204577+0000","last_peered":"2024-04-26T10:47:11.204577+0000","last_clean":"2024-04-26T10:47:11.204577+0000","last_became_active":"2024-04-26T10:42:26.049014+0000","last_became_peered":"2024-04-26T10:42:26.049014+0000","last_unstale":"2024-04-26T10:47:11.204577+0000","last_undegraded":"2024-04-26T10:47:11.204577+0000","last_fullsized":"2024-04-26T10:47:11.204577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'393","last_scrub_stamp":"2024-04-26T10:47:11.204553+0000","last_deep_scrub":"63'393","last_deep_scrub_stamp":"2024-04-26T10:47:11.204553+0000","last_clean_scrub_stamp":"2024-04-26T10:47:11.204553+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:49.026292+0000","scrub_duration":0.0022247619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":25712,"num_write":362,"num_write_kb":42020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'428","reported_seq":567,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:15.921226+0000","last_change":"2024-04-26T10:46:15.921226+0000","last_active":"2024-04-26T10:46:15.921226+0000","last_peered":"2024-04-26T10:46:15.921226+0000","last_clean":"2024-04-26T10:46:15.921226+0000","last_became_active":"2024-04-26T10:45:54.189852+0000","last_became_peered":"2024-04-26T10:45:54.189852+0000","last_unstale":"2024-04-26T10:46:15.921226+0000","last_undegraded":"2024-04-26T10:46:15.921226+0000","last_fullsized":"2024-04-26T10:46:15.921226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'428","last_scrub_stamp":"2024-04-26T10:46:15.921093+0000","last_deep_scrub":"63'428","last_deep_scrub_stamp":"2024-04-26T10:46:15.921093+0000","last_clean_scrub_stamp":"2024-04-26T10:46:15.921093+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:06.246994+0000","scrub_duration":0.0037567920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12316,"num_write":384,"num_write_kb":87656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"63'446","reported_seq":599,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:34.106864+0000","last_change":"2024-04-26T10:46:34.106970+0000","last_active":"2024-04-26T10:46:34.106864+0000","last_peered":"2024-04-26T10:46:34.106864+0000","last_clean":"2024-04-26T10:46:34.106864+0000","last_became_active":"2024-04-26T10:45:54.184063+0000","last_became_peered":"2024-04-26T10:45:54.184063+0000","last_unstale":"2024-04-26T10:46:34.106864+0000","last_undegraded":"2024-04-26T10:46:34.106864+0000","last_fullsized":"2024-04-26T10:46:34.106864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'446","last_scrub_stamp":"2024-04-26T10:46:34.106840+0000","last_deep_scrub":"63'446","last_deep_scrub_stamp":"2024-04-26T10:46:34.106840+0000","last_clean_scrub_stamp":"2024-04-26T10:46:34.106840+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:53.038982+0000","scrub_duration":0.003191504,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":53414,"num_write":401,"num_write_kb":80048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":563,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:43.456513+0000","last_change":"2024-04-26T10:46:43.456513+0000","last_active":"2024-04-26T10:46:43.456513+0000","last_peered":"2024-04-26T10:46:43.456513+0000","last_clean":"2024-04-26T10:46:43.456513+0000","last_became_active":"2024-04-26T10:45:50.867680+0000","last_became_peered":"2024-04-26T10:45:50.867680+0000","last_unstale":"2024-04-26T10:46:43.456513+0000","last_undegraded":"2024-04-26T10:46:43.456513+0000","last_fullsized":"2024-04-26T10:46:43.456513+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'438","last_scrub_stamp":"2024-04-26T10:46:43.456387+0000","last_deep_scrub":"63'438","last_deep_scrub_stamp":"2024-04-26T10:46:43.456387+0000","last_clean_scrub_stamp":"2024-04-26T10:46:43.456387+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:45.105492+0000","scrub_duration":0.002559675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19859,"num_write":405,"num_write_kb":51119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"63'408","reported_seq":875,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:26.338811+0000","last_change":"2024-04-26T10:46:26.338811+0000","last_active":"2024-04-26T10:46:26.338811+0000","last_peered":"2024-04-26T10:46:26.338811+0000","last_clean":"2024-04-26T10:46:26.338811+0000","last_became_active":"2024-04-26T10:45:56.160360+0000","last_became_peered":"2024-04-26T10:45:56.160360+0000","last_unstale":"2024-04-26T10:46:26.338811+0000","last_undegraded":"2024-04-26T10:46:26.338811+0000","last_fullsized":"2024-04-26T10:46:26.338811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:26.338639+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:26.338639+0000","last_clean_scrub_stamp":"2024-04-26T10:46:26.338639+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:34.117967+0000","scrub_duration":0.0027084209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":15372,"num_write":366,"num_write_kb":75855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"63'452","reported_seq":1030,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:35.724265+0000","last_change":"2024-04-26T10:47:35.724379+0000","last_active":"2024-04-26T10:47:35.724265+0000","last_peered":"2024-04-26T10:47:35.724265+0000","last_clean":"2024-04-26T10:47:35.724265+0000","last_became_active":"2024-04-26T10:45:52.173702+0000","last_became_peered":"2024-04-26T10:45:52.173702+0000","last_unstale":"2024-04-26T10:47:35.724265+0000","last_undegraded":"2024-04-26T10:47:35.724265+0000","last_fullsized":"2024-04-26T10:47:35.724265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'452","last_scrub_stamp":"2024-04-26T10:47:35.724244+0000","last_deep_scrub":"63'452","last_deep_scrub_stamp":"2024-04-26T10:47:35.724244+0000","last_clean_scrub_stamp":"2024-04-26T10:47:35.724244+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:08.983320+0000","scrub_duration":0.0023523429999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43729,"num_write":421,"num_write_kb":79804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"63'408","reported_seq":894,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:30.067044+0000","last_change":"2024-04-26T10:46:30.067162+0000","last_active":"2024-04-26T10:46:30.067044+0000","last_peered":"2024-04-26T10:46:30.067044+0000","last_clean":"2024-04-26T10:46:30.067044+0000","last_became_active":"2024-04-26T10:45:57.162147+0000","last_became_peered":"2024-04-26T10:45:57.162147+0000","last_unstale":"2024-04-26T10:46:30.067044+0000","last_undegraded":"2024-04-26T10:46:30.067044+0000","last_fullsized":"2024-04-26T10:46:30.067044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:30.067019+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:30.067019+0000","last_clean_scrub_stamp":"2024-04-26T10:46:30.067019+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:46.527639+0000","scrub_duration":0.0026815810000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":30320,"num_write":372,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'453","reported_seq":628,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:57.799503+0000","last_change":"2024-04-26T10:46:57.799635+0000","last_active":"2024-04-26T10:46:57.799503+0000","last_peered":"2024-04-26T10:46:57.799503+0000","last_clean":"2024-04-26T10:46:57.799503+0000","last_became_active":"2024-04-26T10:45:54.181881+0000","last_became_peered":"2024-04-26T10:45:54.181881+0000","last_unstale":"2024-04-26T10:46:57.799503+0000","last_undegraded":"2024-04-26T10:46:57.799503+0000","last_fullsized":"2024-04-26T10:46:57.799503+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'453","last_scrub_stamp":"2024-04-26T10:46:57.799480+0000","last_deep_scrub":"63'453","last_deep_scrub_stamp":"2024-04-26T10:46:57.799480+0000","last_clean_scrub_stamp":"2024-04-26T10:46:57.799480+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:42.095942+0000","scrub_duration":0.003413672,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":19864,"num_write":422,"num_write_kb":51638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"63'439","reported_seq":967,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:07.911236+0000","last_change":"2024-04-26T10:46:07.911236+0000","last_active":"2024-04-26T10:46:07.911236+0000","last_peered":"2024-04-26T10:46:07.911236+0000","last_clean":"2024-04-26T10:46:07.911236+0000","last_became_active":"2024-04-26T10:45:48.866159+0000","last_became_peered":"2024-04-26T10:45:48.866159+0000","last_unstale":"2024-04-26T10:46:07.911236+0000","last_undegraded":"2024-04-26T10:46:07.911236+0000","last_fullsized":"2024-04-26T10:46:07.911236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'439","last_scrub_stamp":"2024-04-26T10:46:07.911088+0000","last_deep_scrub":"63'439","last_deep_scrub_stamp":"2024-04-26T10:46:07.911088+0000","last_clean_scrub_stamp":"2024-04-26T10:46:07.911088+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:32.755490+0000","scrub_duration":0.0024222179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8912,"num_write":417,"num_write_kb":46575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"63'513","reported_seq":1171,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:26.001684+0000","last_change":"2024-04-26T10:47:26.001787+0000","last_active":"2024-04-26T10:47:26.001684+0000","last_peered":"2024-04-26T10:47:26.001684+0000","last_clean":"2024-04-26T10:47:26.001684+0000","last_became_active":"2024-04-26T10:45:51.158698+0000","last_became_peered":"2024-04-26T10:45:51.158698+0000","last_unstale":"2024-04-26T10:47:26.001684+0000","last_undegraded":"2024-04-26T10:47:26.001684+0000","last_fullsized":"2024-04-26T10:47:26.001684+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'513","last_scrub_stamp":"2024-04-26T10:47:26.001661+0000","last_deep_scrub":"63'513","last_deep_scrub_stamp":"2024-04-26T10:47:26.001661+0000","last_clean_scrub_stamp":"2024-04-26T10:47:26.001661+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:32.290818+0000","scrub_duration":0.0023258710000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":70751,"num_write":473,"num_write_kb":88902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'406","reported_seq":546,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:54.455779+0000","last_change":"2024-04-26T10:46:54.455779+0000","last_active":"2024-04-26T10:46:54.455779+0000","last_peered":"2024-04-26T10:46:54.455779+0000","last_clean":"2024-04-26T10:46:54.455779+0000","last_became_active":"2024-04-26T10:45:56.162419+0000","last_became_peered":"2024-04-26T10:45:56.162419+0000","last_unstale":"2024-04-26T10:46:54.455779+0000","last_undegraded":"2024-04-26T10:46:54.455779+0000","last_fullsized":"2024-04-26T10:46:54.455779+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'406","last_scrub_stamp":"2024-04-26T10:46:54.455655+0000","last_deep_scrub":"63'406","last_deep_scrub_stamp":"2024-04-26T10:46:54.455655+0000","last_clean_scrub_stamp":"2024-04-26T10:46:54.455655+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:35.943745+0000","scrub_duration":0.0024701179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":32121,"num_write":372,"num_write_kb":60163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"63'402","reported_seq":880,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:38.854895+0000","last_change":"2024-04-26T10:46:38.854895+0000","last_active":"2024-04-26T10:46:38.854895+0000","last_peered":"2024-04-26T10:46:38.854895+0000","last_clean":"2024-04-26T10:46:38.854895+0000","last_became_active":"2024-04-26T10:45:57.165064+0000","last_became_peered":"2024-04-26T10:45:57.165064+0000","last_unstale":"2024-04-26T10:46:38.854895+0000","last_undegraded":"2024-04-26T10:46:38.854895+0000","last_fullsized":"2024-04-26T10:46:38.854895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'402","last_scrub_stamp":"2024-04-26T10:46:38.854753+0000","last_deep_scrub":"63'402","last_deep_scrub_stamp":"2024-04-26T10:46:38.854753+0000","last_clean_scrub_stamp":"2024-04-26T10:46:38.854753+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:36.110686+0000","scrub_duration":0.0022249689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":6824,"num_write":378,"num_write_kb":72156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"63'407","reported_seq":901,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:39.933613+0000","last_change":"2024-04-26T10:47:39.933613+0000","last_active":"2024-04-26T10:47:39.933613+0000","last_peered":"2024-04-26T10:47:39.933613+0000","last_clean":"2024-04-26T10:47:39.933613+0000","last_became_active":"2024-04-26T10:45:58.161850+0000","last_became_peered":"2024-04-26T10:45:58.161850+0000","last_unstale":"2024-04-26T10:47:39.933613+0000","last_undegraded":"2024-04-26T10:47:39.933613+0000","last_fullsized":"2024-04-26T10:47:39.933613+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'407","last_scrub_stamp":"2024-04-26T10:47:39.933481+0000","last_deep_scrub":"63'407","last_deep_scrub_stamp":"2024-04-26T10:47:39.933481+0000","last_clean_scrub_stamp":"2024-04-26T10:47:39.933481+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:39.377365+0000","scrub_duration":0.0035767009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25898,"num_write":372,"num_write_kb":59274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":346,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'490","reported_seq":1071,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:51.777219+0000","last_change":"2024-04-26T10:46:51.777320+0000","last_active":"2024-04-26T10:46:51.777219+0000","last_peered":"2024-04-26T10:46:51.777219+0000","last_clean":"2024-04-26T10:46:51.777219+0000","last_became_active":"2024-04-26T10:45:55.178083+0000","last_became_peered":"2024-04-26T10:45:55.178083+0000","last_unstale":"2024-04-26T10:46:51.777219+0000","last_undegraded":"2024-04-26T10:46:51.777219+0000","last_fullsized":"2024-04-26T10:46:51.777219+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'490","last_scrub_stamp":"2024-04-26T10:46:51.777196+0000","last_deep_scrub":"63'490","last_deep_scrub_stamp":"2024-04-26T10:46:51.777196+0000","last_clean_scrub_stamp":"2024-04-26T10:46:51.777196+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:16:31.651731+0000","scrub_duration":0.0022270390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33597,"num_write":449,"num_write_kb":87981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"63'474","reported_seq":576,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:41.218435+0000","last_change":"2024-04-26T10:46:41.218435+0000","last_active":"2024-04-26T10:46:41.218435+0000","last_peered":"2024-04-26T10:46:41.218435+0000","last_clean":"2024-04-26T10:46:41.218435+0000","last_became_active":"2024-04-26T10:45:54.186011+0000","last_became_peered":"2024-04-26T10:45:54.186011+0000","last_unstale":"2024-04-26T10:46:41.218435+0000","last_undegraded":"2024-04-26T10:46:41.218435+0000","last_fullsized":"2024-04-26T10:46:41.218435+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'474","last_scrub_stamp":"2024-04-26T10:46:41.218267+0000","last_deep_scrub":"63'474","last_deep_scrub_stamp":"2024-04-26T10:46:41.218267+0000","last_clean_scrub_stamp":"2024-04-26T10:46:41.218267+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:19.308910+0000","scrub_duration":0.003558748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30886,"num_write":441,"num_write_kb":118807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'443","reported_seq":560,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:37.402510+0000","last_change":"2024-04-26T10:46:37.402510+0000","last_active":"2024-04-26T10:46:37.402510+0000","last_peered":"2024-04-26T10:46:37.402510+0000","last_clean":"2024-04-26T10:46:37.402510+0000","last_became_active":"2024-04-26T10:45:48.861918+0000","last_became_peered":"2024-04-26T10:45:48.861918+0000","last_unstale":"2024-04-26T10:46:37.402510+0000","last_undegraded":"2024-04-26T10:46:37.402510+0000","last_fullsized":"2024-04-26T10:46:37.402510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'443","last_scrub_stamp":"2024-04-26T10:46:37.402390+0000","last_deep_scrub":"63'443","last_deep_scrub_stamp":"2024-04-26T10:46:37.402390+0000","last_clean_scrub_stamp":"2024-04-26T10:46:37.402390+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:31.390744+0000","scrub_duration":0.0023535019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20556,"num_write":413,"num_write_kb":91647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"63'376","reported_seq":491,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:49.818309+0000","last_change":"2024-04-26T10:46:49.818309+0000","last_active":"2024-04-26T10:46:49.818309+0000","last_peered":"2024-04-26T10:46:49.818309+0000","last_clean":"2024-04-26T10:46:49.818309+0000","last_became_active":"2024-04-26T10:42:26.040920+0000","last_became_peered":"2024-04-26T10:42:26.040920+0000","last_unstale":"2024-04-26T10:46:49.818309+0000","last_undegraded":"2024-04-26T10:46:49.818309+0000","last_fullsized":"2024-04-26T10:46:49.818309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'376","last_scrub_stamp":"2024-04-26T10:46:49.818144+0000","last_deep_scrub":"63'376","last_deep_scrub_stamp":"2024-04-26T10:46:49.818144+0000","last_clean_scrub_stamp":"2024-04-26T10:46:49.818144+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:42.631428+0000","scrub_duration":0.002993571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10124,"num_write":344,"num_write_kb":66899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"84'457","reported_seq":550,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:53.637492+0000","last_change":"2024-04-26T10:47:53.637492+0000","last_active":"2024-04-26T10:47:53.637492+0000","last_peered":"2024-04-26T10:47:53.637492+0000","last_clean":"2024-04-26T10:47:53.637492+0000","last_became_active":"2024-04-26T10:45:48.862424+0000","last_became_peered":"2024-04-26T10:45:48.862424+0000","last_unstale":"2024-04-26T10:47:53.637492+0000","last_undegraded":"2024-04-26T10:47:53.637492+0000","last_fullsized":"2024-04-26T10:47:53.637492+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'457","last_scrub_stamp":"2024-04-26T10:47:53.637378+0000","last_deep_scrub":"84'457","last_deep_scrub_stamp":"2024-04-26T10:47:53.637378+0000","last_clean_scrub_stamp":"2024-04-26T10:47:53.637378+0000","objects_scrubbed":4,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:58.972915+0000","scrub_duration":0.016148688000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"63'403","reported_seq":533,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:10.923239+0000","last_change":"2024-04-26T10:46:10.923239+0000","last_active":"2024-04-26T10:46:10.923239+0000","last_peered":"2024-04-26T10:46:10.923239+0000","last_clean":"2024-04-26T10:46:10.923239+0000","last_became_active":"2024-04-26T10:42:26.040464+0000","last_became_peered":"2024-04-26T10:42:26.040464+0000","last_unstale":"2024-04-26T10:46:10.923239+0000","last_undegraded":"2024-04-26T10:46:10.923239+0000","last_fullsized":"2024-04-26T10:46:10.923239+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'403","last_scrub_stamp":"2024-04-26T10:46:10.923100+0000","last_deep_scrub":"63'403","last_deep_scrub_stamp":"2024-04-26T10:46:10.923100+0000","last_clean_scrub_stamp":"2024-04-26T10:46:10.923100+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:00.804186+0000","scrub_duration":0.0037994579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24588,"num_write":363,"num_write_kb":51190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"62'49","reported_seq":156,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:17.105113+0000","last_change":"2024-04-26T10:47:17.105218+0000","last_active":"2024-04-26T10:47:17.105113+0000","last_peered":"2024-04-26T10:47:17.105113+0000","last_clean":"2024-04-26T10:47:17.105113+0000","last_became_active":"2024-04-26T10:45:45.862029+0000","last_became_peered":"2024-04-26T10:45:45.862029+0000","last_unstale":"2024-04-26T10:47:17.105113+0000","last_undegraded":"2024-04-26T10:47:17.105113+0000","last_fullsized":"2024-04-26T10:47:17.105113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'49","last_scrub_stamp":"2024-04-26T10:47:17.105090+0000","last_deep_scrub":"62'49","last_deep_scrub_stamp":"2024-04-26T10:47:17.105090+0000","last_clean_scrub_stamp":"2024-04-26T10:47:17.105090+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:22.790230+0000","scrub_duration":0.0016239309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'407","reported_seq":900,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:23.067400+0000","last_change":"2024-04-26T10:47:23.067513+0000","last_active":"2024-04-26T10:47:23.067400+0000","last_peered":"2024-04-26T10:47:23.067400+0000","last_clean":"2024-04-26T10:47:23.067400+0000","last_became_active":"2024-04-26T10:45:52.169295+0000","last_became_peered":"2024-04-26T10:45:52.169295+0000","last_unstale":"2024-04-26T10:47:23.067400+0000","last_undegraded":"2024-04-26T10:47:23.067400+0000","last_fullsized":"2024-04-26T10:47:23.067400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'407","last_scrub_stamp":"2024-04-26T10:47:23.067376+0000","last_deep_scrub":"63'407","last_deep_scrub_stamp":"2024-04-26T10:47:23.067376+0000","last_clean_scrub_stamp":"2024-04-26T10:47:23.067376+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:45.140990+0000","scrub_duration":0.0024592289999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":7077,"num_write":367,"num_write_kb":42434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"62'66","reported_seq":173,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:11.778529+0000","last_change":"2024-04-26T10:47:11.778687+0000","last_active":"2024-04-26T10:47:11.778529+0000","last_peered":"2024-04-26T10:47:11.778529+0000","last_clean":"2024-04-26T10:47:11.778529+0000","last_became_active":"2024-04-26T10:45:45.874030+0000","last_became_peered":"2024-04-26T10:45:45.874030+0000","last_unstale":"2024-04-26T10:47:11.778529+0000","last_undegraded":"2024-04-26T10:47:11.778529+0000","last_fullsized":"2024-04-26T10:47:11.778529+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'66","last_scrub_stamp":"2024-04-26T10:47:11.778503+0000","last_deep_scrub":"62'66","last_deep_scrub_stamp":"2024-04-26T10:47:11.778503+0000","last_clean_scrub_stamp":"2024-04-26T10:47:11.778503+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:30.448994+0000","scrub_duration":0.001798846,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"63'406","reported_seq":911,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:24.024745+0000","last_change":"2024-04-26T10:47:24.024848+0000","last_active":"2024-04-26T10:47:24.024745+0000","last_peered":"2024-04-26T10:47:24.024745+0000","last_clean":"2024-04-26T10:47:24.024745+0000","last_became_active":"2024-04-26T10:45:49.861979+0000","last_became_peered":"2024-04-26T10:45:49.861979+0000","last_unstale":"2024-04-26T10:47:24.024745+0000","last_undegraded":"2024-04-26T10:47:24.024745+0000","last_fullsized":"2024-04-26T10:47:24.024745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'406","last_scrub_stamp":"2024-04-26T10:47:24.024723+0000","last_deep_scrub":"63'406","last_deep_scrub_stamp":"2024-04-26T10:47:24.024723+0000","last_clean_scrub_stamp":"2024-04-26T10:47:24.024723+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:07:41.862917+0000","scrub_duration":0.0024237550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":25977,"num_write":374,"num_write_kb":104172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"84'70","reported_seq":55,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:56.461080+0000","last_change":"2024-04-26T10:46:56.461080+0000","last_active":"2024-04-26T10:46:56.461080+0000","last_peered":"2024-04-26T10:46:56.461080+0000","last_clean":"2024-04-26T10:46:56.461080+0000","last_became_active":"2024-04-26T10:45:45.871120+0000","last_became_peered":"2024-04-26T10:45:45.871120+0000","last_unstale":"2024-04-26T10:46:56.461080+0000","last_undegraded":"2024-04-26T10:46:56.461080+0000","last_fullsized":"2024-04-26T10:46:56.461080+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'70","last_scrub_stamp":"2024-04-26T10:46:56.460924+0000","last_deep_scrub":"84'70","last_deep_scrub_stamp":"2024-04-26T10:46:56.460924+0000","last_clean_scrub_stamp":"2024-04-26T10:46:56.460924+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:06.245761+0000","scrub_duration":0.0046851239999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"84'202","reported_seq":296,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:45.516981+0000","last_change":"2024-04-26T10:46:45.516981+0000","last_active":"2024-04-26T10:46:45.516981+0000","last_peered":"2024-04-26T10:46:45.516981+0000","last_clean":"2024-04-26T10:46:45.516981+0000","last_became_active":"2024-04-26T10:45:48.865878+0000","last_became_peered":"2024-04-26T10:45:48.865878+0000","last_unstale":"2024-04-26T10:46:45.516981+0000","last_undegraded":"2024-04-26T10:46:45.516981+0000","last_fullsized":"2024-04-26T10:46:45.516981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'202","last_scrub_stamp":"2024-04-26T10:46:45.516857+0000","last_deep_scrub":"84'202","last_deep_scrub_stamp":"2024-04-26T10:46:45.516857+0000","last_clean_scrub_stamp":"2024-04-26T10:46:45.516857+0000","objects_scrubbed":2,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:35.343559+0000","scrub_duration":0.011504359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"63'415","reported_seq":921,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:11.914773+0000","last_change":"2024-04-26T10:46:11.914773+0000","last_active":"2024-04-26T10:46:11.914773+0000","last_peered":"2024-04-26T10:46:11.914773+0000","last_clean":"2024-04-26T10:46:11.914773+0000","last_became_active":"2024-04-26T10:45:57.163263+0000","last_became_peered":"2024-04-26T10:45:57.163263+0000","last_unstale":"2024-04-26T10:46:11.914773+0000","last_undegraded":"2024-04-26T10:46:11.914773+0000","last_fullsized":"2024-04-26T10:46:11.914773+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'415","last_scrub_stamp":"2024-04-26T10:46:11.914637+0000","last_deep_scrub":"63'415","last_deep_scrub_stamp":"2024-04-26T10:46:11.914637+0000","last_clean_scrub_stamp":"2024-04-26T10:46:11.914637+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:19.456262+0000","scrub_duration":0.0026733759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15757,"num_write":380,"num_write_kb":54727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"84'344","reported_seq":463,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:04.860552+0000","last_change":"2024-04-26T10:47:04.860677+0000","last_active":"2024-04-26T10:47:04.860552+0000","last_peered":"2024-04-26T10:47:04.860552+0000","last_clean":"2024-04-26T10:47:04.860552+0000","last_became_active":"2024-04-26T10:45:48.866497+0000","last_became_peered":"2024-04-26T10:45:48.866497+0000","last_unstale":"2024-04-26T10:47:04.860552+0000","last_undegraded":"2024-04-26T10:47:04.860552+0000","last_fullsized":"2024-04-26T10:47:04.860552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'344","last_scrub_stamp":"2024-04-26T10:47:04.860530+0000","last_deep_scrub":"84'344","last_deep_scrub_stamp":"2024-04-26T10:47:04.860530+0000","last_clean_scrub_stamp":"2024-04-26T10:47:04.860530+0000","objects_scrubbed":2,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:42.826483+0000","scrub_duration":0.011514284,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"63'481","reported_seq":683,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:23.694129+0000","last_change":"2024-04-26T10:47:23.694244+0000","last_active":"2024-04-26T10:47:23.694129+0000","last_peered":"2024-04-26T10:47:23.694129+0000","last_clean":"2024-04-26T10:47:23.694129+0000","last_became_active":"2024-04-26T10:45:54.181993+0000","last_became_peered":"2024-04-26T10:45:54.181993+0000","last_unstale":"2024-04-26T10:47:23.694129+0000","last_undegraded":"2024-04-26T10:47:23.694129+0000","last_fullsized":"2024-04-26T10:47:23.694129+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'481","last_scrub_stamp":"2024-04-26T10:47:23.694106+0000","last_deep_scrub":"63'481","last_deep_scrub_stamp":"2024-04-26T10:47:23.694106+0000","last_clean_scrub_stamp":"2024-04-26T10:47:23.694106+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:27.709900+0000","scrub_duration":0.0032272659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":45251,"num_write":451,"num_write_kb":105365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"84'462","reported_seq":556,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:40.432691+0000","last_change":"2024-04-26T10:46:40.432691+0000","last_active":"2024-04-26T10:46:40.432691+0000","last_peered":"2024-04-26T10:46:40.432691+0000","last_clean":"2024-04-26T10:46:40.432691+0000","last_became_active":"2024-04-26T10:45:48.865520+0000","last_became_peered":"2024-04-26T10:45:48.865520+0000","last_unstale":"2024-04-26T10:46:40.432691+0000","last_undegraded":"2024-04-26T10:46:40.432691+0000","last_fullsized":"2024-04-26T10:46:40.432691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'462","last_scrub_stamp":"2024-04-26T10:46:40.432509+0000","last_deep_scrub":"84'462","last_deep_scrub_stamp":"2024-04-26T10:46:40.432509+0000","last_clean_scrub_stamp":"2024-04-26T10:46:40.432509+0000","objects_scrubbed":2,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:15.817808+0000","scrub_duration":0.010610122,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":407,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'420","reported_seq":505,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:07.412921+0000","last_change":"2024-04-26T10:45:57.165390+0000","last_active":"2024-04-26T10:46:07.412921+0000","last_peered":"2024-04-26T10:46:07.412921+0000","last_clean":"2024-04-26T10:46:07.412921+0000","last_became_active":"2024-04-26T10:45:57.162014+0000","last_became_peered":"2024-04-26T10:45:57.162014+0000","last_unstale":"2024-04-26T10:46:07.412921+0000","last_undegraded":"2024-04-26T10:46:07.412921+0000","last_fullsized":"2024-04-26T10:46:07.412921+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13025,"num_write":385,"num_write_kb":38595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"62'67","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:51.506347+0000","last_change":"2024-04-26T10:46:51.506347+0000","last_active":"2024-04-26T10:46:51.506347+0000","last_peered":"2024-04-26T10:46:51.506347+0000","last_clean":"2024-04-26T10:46:51.506347+0000","last_became_active":"2024-04-26T10:45:45.860175+0000","last_became_peered":"2024-04-26T10:45:45.860175+0000","last_unstale":"2024-04-26T10:46:51.506347+0000","last_undegraded":"2024-04-26T10:46:51.506347+0000","last_fullsized":"2024-04-26T10:46:51.506347+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'67","last_scrub_stamp":"2024-04-26T10:46:51.506217+0000","last_deep_scrub":"62'67","last_deep_scrub_stamp":"2024-04-26T10:46:51.506217+0000","last_clean_scrub_stamp":"2024-04-26T10:46:51.506217+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:02.699431+0000","scrub_duration":0.0015865510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"63'452","reported_seq":977,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:37.035003+0000","last_change":"2024-04-26T10:47:37.035134+0000","last_active":"2024-04-26T10:47:37.035003+0000","last_peered":"2024-04-26T10:47:37.035003+0000","last_clean":"2024-04-26T10:47:37.035003+0000","last_became_active":"2024-04-26T10:45:58.164105+0000","last_became_peered":"2024-04-26T10:45:58.164105+0000","last_unstale":"2024-04-26T10:47:37.035003+0000","last_undegraded":"2024-04-26T10:47:37.035003+0000","last_fullsized":"2024-04-26T10:47:37.035003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'452","last_scrub_stamp":"2024-04-26T10:47:37.034983+0000","last_deep_scrub":"63'452","last_deep_scrub_stamp":"2024-04-26T10:47:37.034983+0000","last_clean_scrub_stamp":"2024-04-26T10:47:37.034983+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:38.528620+0000","scrub_duration":0.002456293,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23217,"num_write":416,"num_write_kb":71418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":388,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'203","reported_seq":292,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:33.990315+0000","last_change":"2024-04-26T10:47:33.990424+0000","last_active":"2024-04-26T10:47:33.990315+0000","last_peered":"2024-04-26T10:47:33.990315+0000","last_clean":"2024-04-26T10:47:33.990315+0000","last_became_active":"2024-04-26T10:45:56.160475+0000","last_became_peered":"2024-04-26T10:45:56.160475+0000","last_unstale":"2024-04-26T10:47:33.990315+0000","last_undegraded":"2024-04-26T10:47:33.990315+0000","last_fullsized":"2024-04-26T10:47:33.990315+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'203","last_scrub_stamp":"2024-04-26T10:47:33.990294+0000","last_deep_scrub":"84'203","last_deep_scrub_stamp":"2024-04-26T10:47:33.990294+0000","last_clean_scrub_stamp":"2024-04-26T10:47:33.990294+0000","objects_scrubbed":3,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:32.037541+0000","scrub_duration":0.015319917000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'430","reported_seq":514,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:07.412875+0000","last_change":"2024-04-26T10:45:57.164742+0000","last_active":"2024-04-26T10:46:07.412875+0000","last_peered":"2024-04-26T10:46:07.412875+0000","last_clean":"2024-04-26T10:46:07.412875+0000","last_became_active":"2024-04-26T10:45:57.162070+0000","last_became_peered":"2024-04-26T10:45:57.162070+0000","last_unstale":"2024-04-26T10:46:07.412875+0000","last_undegraded":"2024-04-26T10:46:07.412875+0000","last_fullsized":"2024-04-26T10:46:07.412875+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":24352,"num_write":392,"num_write_kb":21976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"84'234","reported_seq":320,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:15.625011+0000","last_change":"2024-04-26T10:47:15.625011+0000","last_active":"2024-04-26T10:47:15.625011+0000","last_peered":"2024-04-26T10:47:15.625011+0000","last_clean":"2024-04-26T10:47:15.625011+0000","last_became_active":"2024-04-26T10:45:48.862517+0000","last_became_peered":"2024-04-26T10:45:48.862517+0000","last_unstale":"2024-04-26T10:47:15.625011+0000","last_undegraded":"2024-04-26T10:47:15.625011+0000","last_fullsized":"2024-04-26T10:47:15.625011+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'234","last_scrub_stamp":"2024-04-26T10:47:15.624801+0000","last_deep_scrub":"84'234","last_deep_scrub_stamp":"2024-04-26T10:47:15.624801+0000","last_clean_scrub_stamp":"2024-04-26T10:47:15.624801+0000","objects_scrubbed":1,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:41.779523+0000","scrub_duration":0.0093436560000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"63'393","reported_seq":491,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:01.534285+0000","last_change":"2024-04-26T10:47:01.534285+0000","last_active":"2024-04-26T10:47:01.534285+0000","last_peered":"2024-04-26T10:47:01.534285+0000","last_clean":"2024-04-26T10:47:01.534285+0000","last_became_active":"2024-04-26T10:45:55.177758+0000","last_became_peered":"2024-04-26T10:45:55.177758+0000","last_unstale":"2024-04-26T10:47:01.534285+0000","last_undegraded":"2024-04-26T10:47:01.534285+0000","last_fullsized":"2024-04-26T10:47:01.534285+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'393","last_scrub_stamp":"2024-04-26T10:47:01.534143+0000","last_deep_scrub":"63'393","last_deep_scrub_stamp":"2024-04-26T10:47:01.534143+0000","last_clean_scrub_stamp":"2024-04-26T10:47:01.534143+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:15.470762+0000","scrub_duration":0.0026004790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8671,"num_write":368,"num_write_kb":38542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"62'49","reported_seq":156,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:02.831959+0000","last_change":"2024-04-26T10:47:02.832067+0000","last_active":"2024-04-26T10:47:02.831959+0000","last_peered":"2024-04-26T10:47:02.831959+0000","last_clean":"2024-04-26T10:47:02.831959+0000","last_became_active":"2024-04-26T10:45:45.874328+0000","last_became_peered":"2024-04-26T10:45:45.874328+0000","last_unstale":"2024-04-26T10:47:02.831959+0000","last_undegraded":"2024-04-26T10:47:02.831959+0000","last_fullsized":"2024-04-26T10:47:02.831959+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'49","last_scrub_stamp":"2024-04-26T10:47:02.831935+0000","last_deep_scrub":"62'49","last_deep_scrub_stamp":"2024-04-26T10:47:02.831935+0000","last_clean_scrub_stamp":"2024-04-26T10:47:02.831935+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:21.771123+0000","scrub_duration":0.0016852690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"63'368","reported_seq":476,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:49.494481+0000","last_change":"2024-04-26T10:46:49.494481+0000","last_active":"2024-04-26T10:46:49.494481+0000","last_peered":"2024-04-26T10:46:49.494481+0000","last_clean":"2024-04-26T10:46:49.494481+0000","last_became_active":"2024-04-26T10:45:56.163456+0000","last_became_peered":"2024-04-26T10:45:56.163456+0000","last_unstale":"2024-04-26T10:46:49.494481+0000","last_undegraded":"2024-04-26T10:46:49.494481+0000","last_fullsized":"2024-04-26T10:46:49.494481+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'368","last_scrub_stamp":"2024-04-26T10:46:49.494360+0000","last_deep_scrub":"63'368","last_deep_scrub_stamp":"2024-04-26T10:46:49.494360+0000","last_clean_scrub_stamp":"2024-04-26T10:46:49.494360+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:27.081977+0000","scrub_duration":0.0025223229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":19222,"num_write":336,"num_write_kb":58903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"84'620","reported_seq":761,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:14.719236+0000","last_change":"2024-04-26T10:47:14.719342+0000","last_active":"2024-04-26T10:47:14.719236+0000","last_peered":"2024-04-26T10:47:14.719236+0000","last_clean":"2024-04-26T10:47:14.719236+0000","last_became_active":"2024-04-26T10:45:56.161604+0000","last_became_peered":"2024-04-26T10:45:56.161604+0000","last_unstale":"2024-04-26T10:47:14.719236+0000","last_undegraded":"2024-04-26T10:47:14.719236+0000","last_fullsized":"2024-04-26T10:47:14.719236+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'620","last_scrub_stamp":"2024-04-26T10:47:14.719213+0000","last_deep_scrub":"84'620","last_deep_scrub_stamp":"2024-04-26T10:47:14.719213+0000","last_clean_scrub_stamp":"2024-04-26T10:47:14.719213+0000","objects_scrubbed":1,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:29.417733+0000","scrub_duration":0.010567363999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":558,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"63'383","reported_seq":834,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:38.953689+0000","last_change":"2024-04-26T10:47:38.953783+0000","last_active":"2024-04-26T10:47:38.953689+0000","last_peered":"2024-04-26T10:47:38.953689+0000","last_clean":"2024-04-26T10:47:38.953689+0000","last_became_active":"2024-04-26T10:45:58.162264+0000","last_became_peered":"2024-04-26T10:45:58.162264+0000","last_unstale":"2024-04-26T10:47:38.953689+0000","last_undegraded":"2024-04-26T10:47:38.953689+0000","last_fullsized":"2024-04-26T10:47:38.953689+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'383","last_scrub_stamp":"2024-04-26T10:47:38.953668+0000","last_deep_scrub":"63'383","last_deep_scrub_stamp":"2024-04-26T10:47:38.953668+0000","last_clean_scrub_stamp":"2024-04-26T10:47:38.953668+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:51.290039+0000","scrub_duration":0.002468446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":14260,"num_write":349,"num_write_kb":50367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"84'159","reported_seq":244,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:28.647857+0000","last_change":"2024-04-26T10:47:28.647857+0000","last_active":"2024-04-26T10:47:28.647857+0000","last_peered":"2024-04-26T10:47:28.647857+0000","last_clean":"2024-04-26T10:47:28.647857+0000","last_became_active":"2024-04-26T10:45:45.871155+0000","last_became_peered":"2024-04-26T10:45:45.871155+0000","last_unstale":"2024-04-26T10:47:28.647857+0000","last_undegraded":"2024-04-26T10:47:28.647857+0000","last_fullsized":"2024-04-26T10:47:28.647857+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'159","last_scrub_stamp":"2024-04-26T10:47:28.647724+0000","last_deep_scrub":"84'159","last_deep_scrub_stamp":"2024-04-26T10:47:28.647724+0000","last_clean_scrub_stamp":"2024-04-26T10:47:28.647724+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:46.139695+0000","scrub_duration":0.0043961449999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:42.656296+0000","last_change":"2024-04-26T10:47:42.656296+0000","last_active":"2024-04-26T10:47:42.656296+0000","last_peered":"2024-04-26T10:47:42.656296+0000","last_clean":"2024-04-26T10:47:42.656296+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:47:42.656296+0000","last_undegraded":"2024-04-26T10:47:42.656296+0000","last_fullsized":"2024-04-26T10:47:42.656296+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:47:42.656145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:47:42.656145+0000","last_clean_scrub_stamp":"2024-04-26T10:47:42.656145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:12.355980+0000","scrub_duration":0.0019280339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"84'745","reported_seq":839,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:16.132144+0000","last_change":"2024-04-26T10:47:16.132263+0000","last_active":"2024-04-26T10:47:16.132144+0000","last_peered":"2024-04-26T10:47:16.132144+0000","last_clean":"2024-04-26T10:47:16.132144+0000","last_became_active":"2024-04-26T10:42:25.686009+0000","last_became_peered":"2024-04-26T10:42:25.686009+0000","last_unstale":"2024-04-26T10:47:16.132144+0000","last_undegraded":"2024-04-26T10:47:16.132144+0000","last_fullsized":"2024-04-26T10:47:16.132144+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'745","last_scrub_stamp":"2024-04-26T10:47:16.132120+0000","last_deep_scrub":"84'745","last_deep_scrub_stamp":"2024-04-26T10:47:16.132120+0000","last_clean_scrub_stamp":"2024-04-26T10:47:16.132120+0000","objects_scrubbed":2,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:40:39.935186+0000","scrub_duration":0.015566577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'442","reported_seq":580,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:48.508984+0000","last_change":"2024-04-26T10:46:48.508984+0000","last_active":"2024-04-26T10:46:48.508984+0000","last_peered":"2024-04-26T10:46:48.508984+0000","last_clean":"2024-04-26T10:46:48.508984+0000","last_became_active":"2024-04-26T10:45:55.177751+0000","last_became_peered":"2024-04-26T10:45:55.177751+0000","last_unstale":"2024-04-26T10:46:48.508984+0000","last_undegraded":"2024-04-26T10:46:48.508984+0000","last_fullsized":"2024-04-26T10:46:48.508984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'442","last_scrub_stamp":"2024-04-26T10:46:48.508814+0000","last_deep_scrub":"63'442","last_deep_scrub_stamp":"2024-04-26T10:46:48.508814+0000","last_clean_scrub_stamp":"2024-04-26T10:46:48.508814+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:00.772322+0000","scrub_duration":0.0025059779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":34346,"num_write":406,"num_write_kb":96298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:59.508611+0000","last_change":"2024-04-26T10:46:59.508611+0000","last_active":"2024-04-26T10:46:59.508611+0000","last_peered":"2024-04-26T10:46:59.508611+0000","last_clean":"2024-04-26T10:46:59.508611+0000","last_became_active":"2024-04-26T10:45:45.871741+0000","last_became_peered":"2024-04-26T10:45:45.871741+0000","last_unstale":"2024-04-26T10:46:59.508611+0000","last_undegraded":"2024-04-26T10:46:59.508611+0000","last_fullsized":"2024-04-26T10:46:59.508611+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:46:59.508440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:46:59.508440+0000","last_clean_scrub_stamp":"2024-04-26T10:46:59.508440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:10.498353+0000","scrub_duration":0.0018823100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"84'103","reported_seq":233,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:28.024514+0000","last_change":"2024-04-26T10:47:28.024514+0000","last_active":"2024-04-26T10:47:28.024514+0000","last_peered":"2024-04-26T10:47:28.024514+0000","last_clean":"2024-04-26T10:47:28.024514+0000","last_became_active":"2024-04-26T10:45:56.160328+0000","last_became_peered":"2024-04-26T10:45:56.160328+0000","last_unstale":"2024-04-26T10:47:28.024514+0000","last_undegraded":"2024-04-26T10:47:28.024514+0000","last_fullsized":"2024-04-26T10:47:28.024514+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'103","last_scrub_stamp":"2024-04-26T10:47:28.024363+0000","last_deep_scrub":"84'103","last_deep_scrub_stamp":"2024-04-26T10:47:28.024363+0000","last_clean_scrub_stamp":"2024-04-26T10:47:28.024363+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:38.934942+0000","scrub_duration":0.0055471219999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467631,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":44,"num_write_kb":1460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2935262,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'485","reported_seq":622,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:07.412851+0000","last_change":"2024-04-26T10:45:57.165815+0000","last_active":"2024-04-26T10:46:07.412851+0000","last_peered":"2024-04-26T10:46:07.412851+0000","last_clean":"2024-04-26T10:46:07.412851+0000","last_became_active":"2024-04-26T10:45:57.162752+0000","last_became_peered":"2024-04-26T10:45:57.162752+0000","last_unstale":"2024-04-26T10:46:07.412851+0000","last_undegraded":"2024-04-26T10:46:07.412851+0000","last_fullsized":"2024-04-26T10:46:07.412851+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:42:25.668802+0000","last_clean_scrub_stamp":"2024-04-26T10:42:25.668802+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27703,"num_write":454,"num_write_kb":121509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:48.199307+0000","last_change":"2024-04-26T10:46:48.199307+0000","last_active":"2024-04-26T10:46:48.199307+0000","last_peered":"2024-04-26T10:46:48.199307+0000","last_clean":"2024-04-26T10:46:48.199307+0000","last_became_active":"2024-04-26T10:45:53.180675+0000","last_became_peered":"2024-04-26T10:45:53.180675+0000","last_unstale":"2024-04-26T10:46:48.199307+0000","last_undegraded":"2024-04-26T10:46:48.199307+0000","last_fullsized":"2024-04-26T10:46:48.199307+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:46:48.199158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:46:48.199158+0000","last_clean_scrub_stamp":"2024-04-26T10:46:48.199158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:51:28.631493+0000","scrub_duration":0.0016680530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"84'308","reported_seq":428,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:59.784023+0000","last_change":"2024-04-26T10:46:59.784129+0000","last_active":"2024-04-26T10:46:59.784023+0000","last_peered":"2024-04-26T10:46:59.784023+0000","last_clean":"2024-04-26T10:46:59.784023+0000","last_became_active":"2024-04-26T10:45:48.864763+0000","last_became_peered":"2024-04-26T10:45:48.864763+0000","last_unstale":"2024-04-26T10:46:59.784023+0000","last_undegraded":"2024-04-26T10:46:59.784023+0000","last_fullsized":"2024-04-26T10:46:59.784023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'308","last_scrub_stamp":"2024-04-26T10:46:59.784001+0000","last_deep_scrub":"84'308","last_deep_scrub_stamp":"2024-04-26T10:46:59.784001+0000","last_clean_scrub_stamp":"2024-04-26T10:46:59.784001+0000","objects_scrubbed":2,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:33.251239+0000","scrub_duration":0.014317998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"63'336","reported_seq":760,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:38.002684+0000","last_change":"2024-04-26T10:47:38.002814+0000","last_active":"2024-04-26T10:47:38.002684+0000","last_peered":"2024-04-26T10:47:38.002684+0000","last_clean":"2024-04-26T10:47:38.002684+0000","last_became_active":"2024-04-26T10:45:58.162320+0000","last_became_peered":"2024-04-26T10:45:58.162320+0000","last_unstale":"2024-04-26T10:47:38.002684+0000","last_undegraded":"2024-04-26T10:47:38.002684+0000","last_fullsized":"2024-04-26T10:47:38.002684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'336","last_scrub_stamp":"2024-04-26T10:47:38.002662+0000","last_deep_scrub":"63'336","last_deep_scrub_stamp":"2024-04-26T10:47:38.002662+0000","last_clean_scrub_stamp":"2024-04-26T10:47:38.002662+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:42.263583+0000","scrub_duration":0.0026625630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12035,"num_write":314,"num_write_kb":29928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":306,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:32.654284+0000","last_change":"2024-04-26T10:47:32.654284+0000","last_active":"2024-04-26T10:47:32.654284+0000","last_peered":"2024-04-26T10:47:32.654284+0000","last_clean":"2024-04-26T10:47:32.654284+0000","last_became_active":"2024-04-26T10:45:45.860924+0000","last_became_peered":"2024-04-26T10:45:45.860924+0000","last_unstale":"2024-04-26T10:47:32.654284+0000","last_undegraded":"2024-04-26T10:47:32.654284+0000","last_fullsized":"2024-04-26T10:47:32.654284+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:47:32.654143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:47:32.654143+0000","last_clean_scrub_stamp":"2024-04-26T10:47:32.654143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:20.647001+0000","scrub_duration":0.0015127770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"62'64","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:34.677094+0000","last_change":"2024-04-26T10:47:34.677094+0000","last_active":"2024-04-26T10:47:34.677094+0000","last_peered":"2024-04-26T10:47:34.677094+0000","last_clean":"2024-04-26T10:47:34.677094+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:47:34.677094+0000","last_undegraded":"2024-04-26T10:47:34.677094+0000","last_fullsized":"2024-04-26T10:47:34.677094+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'64","last_scrub_stamp":"2024-04-26T10:47:34.676937+0000","last_deep_scrub":"62'64","last_deep_scrub_stamp":"2024-04-26T10:47:34.676937+0000","last_clean_scrub_stamp":"2024-04-26T10:47:34.676937+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:05.788359+0000","scrub_duration":0.001549861,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"63'421","reported_seq":526,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:10.204714+0000","last_change":"2024-04-26T10:47:10.204714+0000","last_active":"2024-04-26T10:47:10.204714+0000","last_peered":"2024-04-26T10:47:10.204714+0000","last_clean":"2024-04-26T10:47:10.204714+0000","last_became_active":"2024-04-26T10:45:54.185053+0000","last_became_peered":"2024-04-26T10:45:54.185053+0000","last_unstale":"2024-04-26T10:47:10.204714+0000","last_undegraded":"2024-04-26T10:47:10.204714+0000","last_fullsized":"2024-04-26T10:47:10.204714+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'421","last_scrub_stamp":"2024-04-26T10:47:10.204582+0000","last_deep_scrub":"63'421","last_deep_scrub_stamp":"2024-04-26T10:47:10.204582+0000","last_clean_scrub_stamp":"2024-04-26T10:47:10.204582+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:56.649265+0000","scrub_duration":0.0030152209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28557,"num_write":385,"num_write_kb":93083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"84'481","reported_seq":567,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:49.689405+0000","last_change":"2024-04-26T10:47:49.689537+0000","last_active":"2024-04-26T10:47:49.689405+0000","last_peered":"2024-04-26T10:47:49.689405+0000","last_clean":"2024-04-26T10:47:49.689405+0000","last_became_active":"2024-04-26T10:45:48.862564+0000","last_became_peered":"2024-04-26T10:45:48.862564+0000","last_unstale":"2024-04-26T10:47:49.689405+0000","last_undegraded":"2024-04-26T10:47:49.689405+0000","last_fullsized":"2024-04-26T10:47:49.689405+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'481","last_scrub_stamp":"2024-04-26T10:47:49.689383+0000","last_deep_scrub":"84'481","last_deep_scrub_stamp":"2024-04-26T10:47:49.689383+0000","last_clean_scrub_stamp":"2024-04-26T10:47:49.689383+0000","objects_scrubbed":1,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:34.876789+0000","scrub_duration":0.0094079750000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:14.184935+0000","last_change":"2024-04-26T10:47:14.185031+0000","last_active":"2024-04-26T10:47:14.184935+0000","last_peered":"2024-04-26T10:47:14.184935+0000","last_clean":"2024-04-26T10:47:14.184935+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:47:14.184935+0000","last_undegraded":"2024-04-26T10:47:14.184935+0000","last_fullsized":"2024-04-26T10:47:14.184935+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:47:14.184915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:47:14.184915+0000","last_clean_scrub_stamp":"2024-04-26T10:47:14.184915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:43.653892+0000","scrub_duration":0.0016064040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'352","reported_seq":789,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:20.639969+0000","last_change":"2024-04-26T10:47:20.640088+0000","last_active":"2024-04-26T10:47:20.639969+0000","last_peered":"2024-04-26T10:47:20.639969+0000","last_clean":"2024-04-26T10:47:20.639969+0000","last_became_active":"2024-04-26T10:45:53.182454+0000","last_became_peered":"2024-04-26T10:45:53.182454+0000","last_unstale":"2024-04-26T10:47:20.639969+0000","last_undegraded":"2024-04-26T10:47:20.639969+0000","last_fullsized":"2024-04-26T10:47:20.639969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'352","last_scrub_stamp":"2024-04-26T10:47:20.639947+0000","last_deep_scrub":"63'352","last_deep_scrub_stamp":"2024-04-26T10:47:20.639947+0000","last_clean_scrub_stamp":"2024-04-26T10:47:20.639947+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:15.753783+0000","scrub_duration":0.0025067420000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":1905,"num_write":313,"num_write_kb":25573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"62'59","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:32.065523+0000","last_change":"2024-04-26T10:46:32.065523+0000","last_active":"2024-04-26T10:46:32.065523+0000","last_peered":"2024-04-26T10:46:32.065523+0000","last_clean":"2024-04-26T10:46:32.065523+0000","last_became_active":"2024-04-26T10:45:53.176996+0000","last_became_peered":"2024-04-26T10:45:53.176996+0000","last_unstale":"2024-04-26T10:46:32.065523+0000","last_undegraded":"2024-04-26T10:46:32.065523+0000","last_fullsized":"2024-04-26T10:46:32.065523+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'59","last_scrub_stamp":"2024-04-26T10:46:32.065382+0000","last_deep_scrub":"62'59","last_deep_scrub_stamp":"2024-04-26T10:46:32.065382+0000","last_clean_scrub_stamp":"2024-04-26T10:46:32.065382+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:26.427635+0000","scrub_duration":0.0016833690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":101,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:48:03.652381+0000","last_change":"2024-04-26T10:48:03.652481+0000","last_active":"2024-04-26T10:48:03.652381+0000","last_peered":"2024-04-26T10:48:03.652381+0000","last_clean":"2024-04-26T10:48:03.652381+0000","last_became_active":"2024-04-26T10:45:53.174781+0000","last_became_peered":"2024-04-26T10:45:53.174781+0000","last_unstale":"2024-04-26T10:48:03.652381+0000","last_undegraded":"2024-04-26T10:48:03.652381+0000","last_fullsized":"2024-04-26T10:48:03.652381+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:48:03.652360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:48:03.652360+0000","last_clean_scrub_stamp":"2024-04-26T10:48:03.652360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:24.898673+0000","scrub_duration":0.0017836110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'408","reported_seq":920,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:31.846626+0000","last_change":"2024-04-26T10:46:31.846626+0000","last_active":"2024-04-26T10:46:31.846626+0000","last_peered":"2024-04-26T10:46:31.846626+0000","last_clean":"2024-04-26T10:46:31.846626+0000","last_became_active":"2024-04-26T10:45:54.185238+0000","last_became_peered":"2024-04-26T10:45:54.185238+0000","last_unstale":"2024-04-26T10:46:31.846626+0000","last_undegraded":"2024-04-26T10:46:31.846626+0000","last_fullsized":"2024-04-26T10:46:31.846626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:31.846485+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:31.846485+0000","last_clean_scrub_stamp":"2024-04-26T10:46:31.846485+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:36.109042+0000","scrub_duration":0.0024474840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19939,"num_write":382,"num_write_kb":63433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"84'56","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:43.249602+0000","last_change":"2024-04-26T10:46:43.249602+0000","last_active":"2024-04-26T10:46:43.249602+0000","last_peered":"2024-04-26T10:46:43.249602+0000","last_clean":"2024-04-26T10:46:43.249602+0000","last_became_active":"2024-04-26T10:45:53.177305+0000","last_became_peered":"2024-04-26T10:45:53.177305+0000","last_unstale":"2024-04-26T10:46:43.249602+0000","last_undegraded":"2024-04-26T10:46:43.249602+0000","last_fullsized":"2024-04-26T10:46:43.249602+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'56","last_scrub_stamp":"2024-04-26T10:46:43.249467+0000","last_deep_scrub":"84'56","last_deep_scrub_stamp":"2024-04-26T10:46:43.249467+0000","last_clean_scrub_stamp":"2024-04-26T10:46:43.249467+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:52.720824+0000","scrub_duration":0.0031266789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:38.180572+0000","last_change":"2024-04-26T10:46:38.180572+0000","last_active":"2024-04-26T10:46:38.180572+0000","last_peered":"2024-04-26T10:46:38.180572+0000","last_clean":"2024-04-26T10:46:38.180572+0000","last_became_active":"2024-04-26T10:45:53.177249+0000","last_became_peered":"2024-04-26T10:45:53.177249+0000","last_unstale":"2024-04-26T10:46:38.180572+0000","last_undegraded":"2024-04-26T10:46:38.180572+0000","last_fullsized":"2024-04-26T10:46:38.180572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:46:38.180438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:46:38.180438+0000","last_clean_scrub_stamp":"2024-04-26T10:46:38.180438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:09.067544+0000","scrub_duration":0.00179721,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'418","reported_seq":890,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:04.180286+0000","last_change":"2024-04-26T10:47:04.180286+0000","last_active":"2024-04-26T10:47:04.180286+0000","last_peered":"2024-04-26T10:47:04.180286+0000","last_clean":"2024-04-26T10:47:04.180286+0000","last_became_active":"2024-04-26T10:45:56.160440+0000","last_became_peered":"2024-04-26T10:45:56.160440+0000","last_unstale":"2024-04-26T10:47:04.180286+0000","last_undegraded":"2024-04-26T10:47:04.180286+0000","last_fullsized":"2024-04-26T10:47:04.180286+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'418","last_scrub_stamp":"2024-04-26T10:47:04.180097+0000","last_deep_scrub":"63'418","last_deep_scrub_stamp":"2024-04-26T10:47:04.180097+0000","last_clean_scrub_stamp":"2024-04-26T10:47:04.180097+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:48.800820+0000","scrub_duration":0.0025539730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20110,"num_write":390,"num_write_kb":75171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"84'67","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:20.114217+0000","last_change":"2024-04-26T10:46:20.114217+0000","last_active":"2024-04-26T10:46:20.114217+0000","last_peered":"2024-04-26T10:46:20.114217+0000","last_clean":"2024-04-26T10:46:20.114217+0000","last_became_active":"2024-04-26T10:45:53.175946+0000","last_became_peered":"2024-04-26T10:45:53.175946+0000","last_unstale":"2024-04-26T10:46:20.114217+0000","last_undegraded":"2024-04-26T10:46:20.114217+0000","last_fullsized":"2024-04-26T10:46:20.114217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'67","last_scrub_stamp":"2024-04-26T10:46:20.114082+0000","last_deep_scrub":"84'67","last_deep_scrub_stamp":"2024-04-26T10:46:20.114082+0000","last_clean_scrub_stamp":"2024-04-26T10:46:20.114082+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:16.069289+0000","scrub_duration":0.00304288,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:50.702464+0000","last_change":"2024-04-26T10:47:50.702464+0000","last_active":"2024-04-26T10:47:50.702464+0000","last_peered":"2024-04-26T10:47:50.702464+0000","last_clean":"2024-04-26T10:47:50.702464+0000","last_became_active":"2024-04-26T10:45:45.871923+0000","last_became_peered":"2024-04-26T10:45:45.871923+0000","last_unstale":"2024-04-26T10:47:50.702464+0000","last_undegraded":"2024-04-26T10:47:50.702464+0000","last_fullsized":"2024-04-26T10:47:50.702464+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:47:50.702314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:47:50.702314+0000","last_clean_scrub_stamp":"2024-04-26T10:47:50.702314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:56.454895+0000","scrub_duration":0.001910105,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"63'404","reported_seq":934,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:27.939150+0000","last_change":"2024-04-26T10:46:27.939150+0000","last_active":"2024-04-26T10:46:27.939150+0000","last_peered":"2024-04-26T10:46:27.939150+0000","last_clean":"2024-04-26T10:46:27.939150+0000","last_became_active":"2024-04-26T10:45:54.181795+0000","last_became_peered":"2024-04-26T10:45:54.181795+0000","last_unstale":"2024-04-26T10:46:27.939150+0000","last_undegraded":"2024-04-26T10:46:27.939150+0000","last_fullsized":"2024-04-26T10:46:27.939150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'404","last_scrub_stamp":"2024-04-26T10:46:27.939009+0000","last_deep_scrub":"63'404","last_deep_scrub_stamp":"2024-04-26T10:46:27.939009+0000","last_clean_scrub_stamp":"2024-04-26T10:46:27.939009+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:43.424977+0000","scrub_duration":0.0025994030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41262,"num_write":371,"num_write_kb":75820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"63'441","reported_seq":577,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:18.633141+0000","last_change":"2024-04-26T10:47:18.633141+0000","last_active":"2024-04-26T10:47:18.633141+0000","last_peered":"2024-04-26T10:47:18.633141+0000","last_clean":"2024-04-26T10:47:18.633141+0000","last_became_active":"2024-04-26T10:45:54.185862+0000","last_became_peered":"2024-04-26T10:45:54.185862+0000","last_unstale":"2024-04-26T10:47:18.633141+0000","last_undegraded":"2024-04-26T10:47:18.633141+0000","last_fullsized":"2024-04-26T10:47:18.633141+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'441","last_scrub_stamp":"2024-04-26T10:47:18.632997+0000","last_deep_scrub":"63'441","last_deep_scrub_stamp":"2024-04-26T10:47:18.632997+0000","last_clean_scrub_stamp":"2024-04-26T10:47:18.632997+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:05.485177+0000","scrub_duration":0.0027604090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31514,"num_write":408,"num_write_kb":107129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"84'437","reported_seq":539,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:48.684853+0000","last_change":"2024-04-26T10:47:48.684853+0000","last_active":"2024-04-26T10:47:48.684853+0000","last_peered":"2024-04-26T10:47:48.684853+0000","last_clean":"2024-04-26T10:47:48.684853+0000","last_became_active":"2024-04-26T10:45:48.865212+0000","last_became_peered":"2024-04-26T10:45:48.865212+0000","last_unstale":"2024-04-26T10:47:48.684853+0000","last_undegraded":"2024-04-26T10:47:48.684853+0000","last_fullsized":"2024-04-26T10:47:48.684853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'437","last_scrub_stamp":"2024-04-26T10:47:48.684672+0000","last_deep_scrub":"84'437","last_deep_scrub_stamp":"2024-04-26T10:47:48.684672+0000","last_clean_scrub_stamp":"2024-04-26T10:47:48.684672+0000","objects_scrubbed":6,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:21.823279+0000","scrub_duration":0.020050841999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9902610,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":9913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9896193,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"63'410","reported_seq":527,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:48:04.660353+0000","last_change":"2024-04-26T10:48:04.660505+0000","last_active":"2024-04-26T10:48:04.660353+0000","last_peered":"2024-04-26T10:48:04.660353+0000","last_clean":"2024-04-26T10:48:04.660353+0000","last_became_active":"2024-04-26T10:45:54.182167+0000","last_became_peered":"2024-04-26T10:45:54.182167+0000","last_unstale":"2024-04-26T10:48:04.660353+0000","last_undegraded":"2024-04-26T10:48:04.660353+0000","last_fullsized":"2024-04-26T10:48:04.660353+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'410","last_scrub_stamp":"2024-04-26T10:48:04.660332+0000","last_deep_scrub":"63'410","last_deep_scrub_stamp":"2024-04-26T10:48:04.660332+0000","last_clean_scrub_stamp":"2024-04-26T10:48:04.660332+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:43.874566+0000","scrub_duration":0.0028846290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12734,"num_write":373,"num_write_kb":34864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"84'86","reported_seq":198,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:03.871072+0000","last_change":"2024-04-26T10:47:03.871072+0000","last_active":"2024-04-26T10:47:03.871072+0000","last_peered":"2024-04-26T10:47:03.871072+0000","last_clean":"2024-04-26T10:47:03.871072+0000","last_became_active":"2024-04-26T10:45:45.874746+0000","last_became_peered":"2024-04-26T10:45:45.874746+0000","last_unstale":"2024-04-26T10:47:03.871072+0000","last_undegraded":"2024-04-26T10:47:03.871072+0000","last_fullsized":"2024-04-26T10:47:03.871072+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'86","last_scrub_stamp":"2024-04-26T10:47:03.870909+0000","last_deep_scrub":"84'86","last_deep_scrub_stamp":"2024-04-26T10:47:03.870909+0000","last_clean_scrub_stamp":"2024-04-26T10:47:03.870909+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:03:47.013205+0000","scrub_duration":0.0039681769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"84'333","reported_seq":433,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:14.252936+0000","last_change":"2024-04-26T10:46:14.252936+0000","last_active":"2024-04-26T10:46:14.252936+0000","last_peered":"2024-04-26T10:46:14.252936+0000","last_clean":"2024-04-26T10:46:14.252936+0000","last_became_active":"2024-04-26T10:45:56.161449+0000","last_became_peered":"2024-04-26T10:45:56.161449+0000","last_unstale":"2024-04-26T10:46:14.252936+0000","last_undegraded":"2024-04-26T10:46:14.252936+0000","last_fullsized":"2024-04-26T10:46:14.252936+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'333","last_scrub_stamp":"2024-04-26T10:46:14.252815+0000","last_deep_scrub":"84'333","last_deep_scrub_stamp":"2024-04-26T10:46:14.252815+0000","last_clean_scrub_stamp":"2024-04-26T10:46:14.252815+0000","objects_scrubbed":1,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:06.020647+0000","scrub_duration":0.0087233659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"63'487","reported_seq":1109,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:22.045006+0000","last_change":"2024-04-26T10:47:22.045108+0000","last_active":"2024-04-26T10:47:22.045006+0000","last_peered":"2024-04-26T10:47:22.045006+0000","last_clean":"2024-04-26T10:47:22.045006+0000","last_became_active":"2024-04-26T10:45:51.159235+0000","last_became_peered":"2024-04-26T10:45:51.159235+0000","last_unstale":"2024-04-26T10:47:22.045006+0000","last_undegraded":"2024-04-26T10:47:22.045006+0000","last_fullsized":"2024-04-26T10:47:22.045006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'487","last_scrub_stamp":"2024-04-26T10:47:22.044982+0000","last_deep_scrub":"63'487","last_deep_scrub_stamp":"2024-04-26T10:47:22.044982+0000","last_clean_scrub_stamp":"2024-04-26T10:47:22.044982+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:31.153345+0000","scrub_duration":0.0026463189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":43316,"num_write":468,"num_write_kb":77062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"62'61","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:11.105029+0000","last_change":"2024-04-26T10:46:11.105133+0000","last_active":"2024-04-26T10:46:11.105029+0000","last_peered":"2024-04-26T10:46:11.105029+0000","last_clean":"2024-04-26T10:46:11.105029+0000","last_became_active":"2024-04-26T10:45:53.173851+0000","last_became_peered":"2024-04-26T10:45:53.173851+0000","last_unstale":"2024-04-26T10:46:11.105029+0000","last_undegraded":"2024-04-26T10:46:11.105029+0000","last_fullsized":"2024-04-26T10:46:11.105029+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'61","last_scrub_stamp":"2024-04-26T10:46:11.105005+0000","last_deep_scrub":"62'61","last_deep_scrub_stamp":"2024-04-26T10:46:11.105005+0000","last_clean_scrub_stamp":"2024-04-26T10:46:11.105005+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:57.257799+0000","scrub_duration":0.0016999000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'457","reported_seq":548,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:47.223896+0000","last_change":"2024-04-26T10:46:47.224014+0000","last_active":"2024-04-26T10:46:47.223896+0000","last_peered":"2024-04-26T10:46:47.223896+0000","last_clean":"2024-04-26T10:46:47.223896+0000","last_became_active":"2024-04-26T10:45:54.189622+0000","last_became_peered":"2024-04-26T10:45:54.189622+0000","last_unstale":"2024-04-26T10:46:47.223896+0000","last_undegraded":"2024-04-26T10:46:47.223896+0000","last_fullsized":"2024-04-26T10:46:47.223896+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'457","last_scrub_stamp":"2024-04-26T10:46:47.223873+0000","last_deep_scrub":"63'457","last_deep_scrub_stamp":"2024-04-26T10:46:47.223873+0000","last_clean_scrub_stamp":"2024-04-26T10:46:47.223873+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:53:33.293955+0000","scrub_duration":0.003282943,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14848,"num_write":427,"num_write_kb":71903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'377","reported_seq":851,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:29.894860+0000","last_change":"2024-04-26T10:46:29.894860+0000","last_active":"2024-04-26T10:46:29.894860+0000","last_peered":"2024-04-26T10:46:29.894860+0000","last_clean":"2024-04-26T10:46:29.894860+0000","last_became_active":"2024-04-26T10:45:49.866707+0000","last_became_peered":"2024-04-26T10:45:49.866707+0000","last_unstale":"2024-04-26T10:46:29.894860+0000","last_undegraded":"2024-04-26T10:46:29.894860+0000","last_fullsized":"2024-04-26T10:46:29.894860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'377","last_scrub_stamp":"2024-04-26T10:46:29.894727+0000","last_deep_scrub":"63'377","last_deep_scrub_stamp":"2024-04-26T10:46:29.894727+0000","last_clean_scrub_stamp":"2024-04-26T10:46:29.894727+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:20.517004+0000","scrub_duration":0.0019921740000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26932,"num_write":349,"num_write_kb":55611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"84'564","reported_seq":658,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:21.029077+0000","last_change":"2024-04-26T10:47:21.029194+0000","last_active":"2024-04-26T10:47:21.029077+0000","last_peered":"2024-04-26T10:47:21.029077+0000","last_clean":"2024-04-26T10:47:21.029077+0000","last_became_active":"2024-04-26T10:42:25.683467+0000","last_became_peered":"2024-04-26T10:42:25.683467+0000","last_unstale":"2024-04-26T10:47:21.029077+0000","last_undegraded":"2024-04-26T10:47:21.029077+0000","last_fullsized":"2024-04-26T10:47:21.029077+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'564","last_scrub_stamp":"2024-04-26T10:47:21.029056+0000","last_deep_scrub":"84'564","last_deep_scrub_stamp":"2024-04-26T10:47:21.029056+0000","last_clean_scrub_stamp":"2024-04-26T10:47:21.029056+0000","objects_scrubbed":2,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:57.701118+0000","scrub_duration":0.016487087000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":8440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'425","reported_seq":891,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:26.996171+0000","last_change":"2024-04-26T10:47:26.996171+0000","last_active":"2024-04-26T10:47:26.996171+0000","last_peered":"2024-04-26T10:47:26.996171+0000","last_clean":"2024-04-26T10:47:26.996171+0000","last_became_active":"2024-04-26T10:45:56.161315+0000","last_became_peered":"2024-04-26T10:45:56.161315+0000","last_unstale":"2024-04-26T10:47:26.996171+0000","last_undegraded":"2024-04-26T10:47:26.996171+0000","last_fullsized":"2024-04-26T10:47:26.996171+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'425","last_scrub_stamp":"2024-04-26T10:47:26.996045+0000","last_deep_scrub":"63'425","last_deep_scrub_stamp":"2024-04-26T10:47:26.996045+0000","last_clean_scrub_stamp":"2024-04-26T10:47:26.996045+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:14.103578+0000","scrub_duration":0.002384251,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":19004,"num_write":390,"num_write_kb":75524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"84'260","reported_seq":344,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:31.083586+0000","last_change":"2024-04-26T10:47:31.083683+0000","last_active":"2024-04-26T10:47:31.083586+0000","last_peered":"2024-04-26T10:47:31.083586+0000","last_clean":"2024-04-26T10:47:31.083586+0000","last_became_active":"2024-04-26T10:45:56.160344+0000","last_became_peered":"2024-04-26T10:45:56.160344+0000","last_unstale":"2024-04-26T10:47:31.083586+0000","last_undegraded":"2024-04-26T10:47:31.083586+0000","last_fullsized":"2024-04-26T10:47:31.083586+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'260","last_scrub_stamp":"2024-04-26T10:47:31.083562+0000","last_deep_scrub":"84'260","last_deep_scrub_stamp":"2024-04-26T10:47:31.083562+0000","last_clean_scrub_stamp":"2024-04-26T10:47:31.083562+0000","objects_scrubbed":1,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:15.212393+0000","scrub_duration":0.0092315850000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'418","reported_seq":942,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:41.881058+0000","last_change":"2024-04-26T10:46:41.881058+0000","last_active":"2024-04-26T10:46:41.881058+0000","last_peered":"2024-04-26T10:46:41.881058+0000","last_clean":"2024-04-26T10:46:41.881058+0000","last_became_active":"2024-04-26T10:45:55.178079+0000","last_became_peered":"2024-04-26T10:45:55.178079+0000","last_unstale":"2024-04-26T10:46:41.881058+0000","last_undegraded":"2024-04-26T10:46:41.881058+0000","last_fullsized":"2024-04-26T10:46:41.881058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'418","last_scrub_stamp":"2024-04-26T10:46:41.880550+0000","last_deep_scrub":"63'418","last_deep_scrub_stamp":"2024-04-26T10:46:41.880550+0000","last_clean_scrub_stamp":"2024-04-26T10:46:41.880550+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:06:37.113070+0000","scrub_duration":0.0024544520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":34476,"num_write":379,"num_write_kb":101645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"84'497","reported_seq":591,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:05.841910+0000","last_change":"2024-04-26T10:47:05.841910+0000","last_active":"2024-04-26T10:47:05.841910+0000","last_peered":"2024-04-26T10:47:05.841910+0000","last_clean":"2024-04-26T10:47:05.841910+0000","last_became_active":"2024-04-26T10:42:25.687829+0000","last_became_peered":"2024-04-26T10:42:25.687829+0000","last_unstale":"2024-04-26T10:47:05.841910+0000","last_undegraded":"2024-04-26T10:47:05.841910+0000","last_fullsized":"2024-04-26T10:47:05.841910+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'497","last_scrub_stamp":"2024-04-26T10:47:05.841747+0000","last_deep_scrub":"84'497","last_deep_scrub_stamp":"2024-04-26T10:47:05.841747+0000","last_clean_scrub_stamp":"2024-04-26T10:47:05.841747+0000","objects_scrubbed":3,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:04.414657+0000","scrub_duration":0.021777650999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":12543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"63'406","reported_seq":599,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:28.675106+0000","last_change":"2024-04-26T10:47:28.675106+0000","last_active":"2024-04-26T10:47:28.675106+0000","last_peered":"2024-04-26T10:47:28.675106+0000","last_clean":"2024-04-26T10:47:28.675106+0000","last_became_active":"2024-04-26T10:45:54.189591+0000","last_became_peered":"2024-04-26T10:45:54.189591+0000","last_unstale":"2024-04-26T10:47:28.675106+0000","last_undegraded":"2024-04-26T10:47:28.675106+0000","last_fullsized":"2024-04-26T10:47:28.675106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'406","last_scrub_stamp":"2024-04-26T10:47:28.674971+0000","last_deep_scrub":"63'406","last_deep_scrub_stamp":"2024-04-26T10:47:28.674971+0000","last_clean_scrub_stamp":"2024-04-26T10:47:28.674971+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:00.503759+0000","scrub_duration":0.0032453080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":45941,"num_write":372,"num_write_kb":80011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"84'62","reported_seq":174,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:06.870273+0000","last_change":"2024-04-26T10:47:06.870273+0000","last_active":"2024-04-26T10:47:06.870273+0000","last_peered":"2024-04-26T10:47:06.870273+0000","last_clean":"2024-04-26T10:47:06.870273+0000","last_became_active":"2024-04-26T10:45:45.874300+0000","last_became_peered":"2024-04-26T10:45:45.874300+0000","last_unstale":"2024-04-26T10:47:06.870273+0000","last_undegraded":"2024-04-26T10:47:06.870273+0000","last_fullsized":"2024-04-26T10:47:06.870273+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'62","last_scrub_stamp":"2024-04-26T10:47:06.870147+0000","last_deep_scrub":"84'62","last_deep_scrub_stamp":"2024-04-26T10:47:06.870147+0000","last_clean_scrub_stamp":"2024-04-26T10:47:06.870147+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:46.778599+0000","scrub_duration":0.0095987950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"63'375","reported_seq":835,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:19.295162+0000","last_change":"2024-04-26T10:46:19.295289+0000","last_active":"2024-04-26T10:46:19.295162+0000","last_peered":"2024-04-26T10:46:19.295162+0000","last_clean":"2024-04-26T10:46:19.295162+0000","last_became_active":"2024-04-26T10:45:56.160416+0000","last_became_peered":"2024-04-26T10:45:56.160416+0000","last_unstale":"2024-04-26T10:46:19.295162+0000","last_undegraded":"2024-04-26T10:46:19.295162+0000","last_fullsized":"2024-04-26T10:46:19.295162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'375","last_scrub_stamp":"2024-04-26T10:46:19.295138+0000","last_deep_scrub":"63'375","last_deep_scrub_stamp":"2024-04-26T10:46:19.295138+0000","last_clean_scrub_stamp":"2024-04-26T10:46:19.295138+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:58.675348+0000","scrub_duration":0.0023697280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16213,"num_write":354,"num_write_kb":54493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":332,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"84'278","reported_seq":382,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:12.320143+0000","last_change":"2024-04-26T10:46:12.320242+0000","last_active":"2024-04-26T10:46:12.320143+0000","last_peered":"2024-04-26T10:46:12.320143+0000","last_clean":"2024-04-26T10:46:12.320143+0000","last_became_active":"2024-04-26T10:45:56.160414+0000","last_became_peered":"2024-04-26T10:45:56.160414+0000","last_unstale":"2024-04-26T10:46:12.320143+0000","last_undegraded":"2024-04-26T10:46:12.320143+0000","last_fullsized":"2024-04-26T10:46:12.320143+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'278","last_scrub_stamp":"2024-04-26T10:46:12.320120+0000","last_deep_scrub":"84'278","last_deep_scrub_stamp":"2024-04-26T10:46:12.320120+0000","last_clean_scrub_stamp":"2024-04-26T10:46:12.320120+0000","objects_scrubbed":2,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:17:48.308771+0000","scrub_duration":0.0082694940000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"63'379","reported_seq":487,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:57.638694+0000","last_change":"2024-04-26T10:47:57.638801+0000","last_active":"2024-04-26T10:47:57.638694+0000","last_peered":"2024-04-26T10:47:57.638694+0000","last_clean":"2024-04-26T10:47:57.638694+0000","last_became_active":"2024-04-26T10:45:53.173645+0000","last_became_peered":"2024-04-26T10:45:53.173645+0000","last_unstale":"2024-04-26T10:47:57.638694+0000","last_undegraded":"2024-04-26T10:47:57.638694+0000","last_fullsized":"2024-04-26T10:47:57.638694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'379","last_scrub_stamp":"2024-04-26T10:47:57.638672+0000","last_deep_scrub":"63'379","last_deep_scrub_stamp":"2024-04-26T10:47:57.638672+0000","last_clean_scrub_stamp":"2024-04-26T10:47:57.638672+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:22.872709+0000","scrub_duration":0.0025599630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20480,"num_write":343,"num_write_kb":25788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"84'241","reported_seq":364,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:58.793068+0000","last_change":"2024-04-26T10:46:58.793068+0000","last_active":"2024-04-26T10:46:58.793068+0000","last_peered":"2024-04-26T10:46:58.793068+0000","last_clean":"2024-04-26T10:46:58.793068+0000","last_became_active":"2024-04-26T10:45:48.866716+0000","last_became_peered":"2024-04-26T10:45:48.866716+0000","last_unstale":"2024-04-26T10:46:58.793068+0000","last_undegraded":"2024-04-26T10:46:58.793068+0000","last_fullsized":"2024-04-26T10:46:58.793068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'241","last_scrub_stamp":"2024-04-26T10:46:58.792919+0000","last_deep_scrub":"84'241","last_deep_scrub_stamp":"2024-04-26T10:46:58.792919+0000","last_clean_scrub_stamp":"2024-04-26T10:46:58.792919+0000","objects_scrubbed":4,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:35.543499+0000","scrub_duration":0.021440362000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":12393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"63'419","reported_seq":583,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:54.737707+0000","last_change":"2024-04-26T10:46:54.737707+0000","last_active":"2024-04-26T10:46:54.737707+0000","last_peered":"2024-04-26T10:46:54.737707+0000","last_clean":"2024-04-26T10:46:54.737707+0000","last_became_active":"2024-04-26T10:42:26.040504+0000","last_became_peered":"2024-04-26T10:42:26.040504+0000","last_unstale":"2024-04-26T10:46:54.737707+0000","last_undegraded":"2024-04-26T10:46:54.737707+0000","last_fullsized":"2024-04-26T10:46:54.737707+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'419","last_scrub_stamp":"2024-04-26T10:46:54.737548+0000","last_deep_scrub":"63'419","last_deep_scrub_stamp":"2024-04-26T10:46:54.737548+0000","last_clean_scrub_stamp":"2024-04-26T10:46:54.737548+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:36.073071+0000","scrub_duration":0.0037174790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39582,"num_write":378,"num_write_kb":54867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"84'62","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:09.103560+0000","last_change":"2024-04-26T10:46:09.103560+0000","last_active":"2024-04-26T10:46:09.103560+0000","last_peered":"2024-04-26T10:46:09.103560+0000","last_clean":"2024-04-26T10:46:09.103560+0000","last_became_active":"2024-04-26T10:45:53.178804+0000","last_became_peered":"2024-04-26T10:45:53.178804+0000","last_unstale":"2024-04-26T10:46:09.103560+0000","last_undegraded":"2024-04-26T10:46:09.103560+0000","last_fullsized":"2024-04-26T10:46:09.103560+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'62","last_scrub_stamp":"2024-04-26T10:46:09.103432+0000","last_deep_scrub":"84'62","last_deep_scrub_stamp":"2024-04-26T10:46:09.103432+0000","last_clean_scrub_stamp":"2024-04-26T10:46:09.103432+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:25.007335+0000","scrub_duration":0.00814082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'437","reported_seq":536,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:18.251026+0000","last_change":"2024-04-26T10:46:18.251026+0000","last_active":"2024-04-26T10:46:18.251026+0000","last_peered":"2024-04-26T10:46:18.251026+0000","last_clean":"2024-04-26T10:46:18.251026+0000","last_became_active":"2024-04-26T10:45:53.177071+0000","last_became_peered":"2024-04-26T10:45:53.177071+0000","last_unstale":"2024-04-26T10:46:18.251026+0000","last_undegraded":"2024-04-26T10:46:18.251026+0000","last_fullsized":"2024-04-26T10:46:18.251026+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'437","last_scrub_stamp":"2024-04-26T10:46:18.250898+0000","last_deep_scrub":"63'437","last_deep_scrub_stamp":"2024-04-26T10:46:18.250898+0000","last_clean_scrub_stamp":"2024-04-26T10:46:18.250898+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:10.767270+0000","scrub_duration":0.002104093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":7562,"num_write":400,"num_write_kb":26121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"84'61","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:25.042141+0000","last_change":"2024-04-26T10:46:25.042141+0000","last_active":"2024-04-26T10:46:25.042141+0000","last_peered":"2024-04-26T10:46:25.042141+0000","last_clean":"2024-04-26T10:46:25.042141+0000","last_became_active":"2024-04-26T10:45:53.173542+0000","last_became_peered":"2024-04-26T10:45:53.173542+0000","last_unstale":"2024-04-26T10:46:25.042141+0000","last_undegraded":"2024-04-26T10:46:25.042141+0000","last_fullsized":"2024-04-26T10:46:25.042141+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'61","last_scrub_stamp":"2024-04-26T10:46:25.041995+0000","last_deep_scrub":"84'61","last_deep_scrub_stamp":"2024-04-26T10:46:25.041995+0000","last_clean_scrub_stamp":"2024-04-26T10:46:25.041995+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:44:18.722171+0000","scrub_duration":0.010280186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2672,"num_read_kb":1454712,"num_write":24538,"num_write_kb":4190103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26671,"ondisk_log_size":26671,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128811551,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":5770,"num_write_kb":129888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257691648,"data_stored":257623102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},"log_size":7648,"ondisk_log_size":7648,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738441,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187500,"kb_used_data":80164,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94184340,"statfs":{"total":96636764160,"available":96444764160,"internally_reserved":0,"allocated":82087936,"data_stored":81566103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:47:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.42799999999999999,"15min":0.433},"min":{"1min":0.34699999999999998,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.58899999999999997,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.433,"15min":0.438},"min":{"1min":0.34799999999999998,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.34599999999999997}]},{"osd":1,"last update":"Fri Apr 26 10:47:51 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45300000000000001,"15min":0.45000000000000001},"min":{"1min":0.36899999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.58999999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.46100000000000002,"15min":0.45500000000000002},"min":{"1min":0.35799999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.63200000000000001,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.5}]}]},{"osd":1,"up_from":70,"seq":300647710751,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140112,"kb_used_data":90440,"kb_used_omap":7,"kb_used_meta":49656,"kb_avail":94231728,"statfs":{"total":96636764160,"available":96493289472,"internally_reserved":0,"allocated":92610560,"data_stored":92059263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7181,"internal_metadata":50848755},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45000000000000001,"15min":0.44700000000000001},"min":{"1min":0.34699999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.56200000000000006,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.44900000000000001,"15min":0.443},"min":{"1min":0.318,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.56399999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Apr 26 10:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.45400000000000001,"15min":0.44700000000000001},"min":{"1min":0.33500000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.63100000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.46000000000000002},"min":{"1min":0.30499999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.64200000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.54000000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214376,"kb_used_data":84896,"kb_used_omap":1,"kb_used_meta":129470,"kb_avail":94157464,"statfs":{"total":96636764160,"available":96417243136,"internally_reserved":0,"allocated":86933504,"data_stored":86396712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132577734},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.41999999999999998,"15min":0.41199999999999998},"min":{"1min":0.36599999999999999,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.42299999999999999,"15min":0.41299999999999998},"min":{"1min":0.36199999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.505}]},{"osd":2,"last update":"Fri Apr 26 10:47:29 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.438,"15min":0.45200000000000001},"min":{"1min":0.38,"5min":0.183,"15min":0.183},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.44400000000000001,"15min":0.46600000000000003},"min":{"1min":0.38,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.69299999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.435}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":85422080,"data_stored":85400264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":91099136,"data_stored":91062815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81170432,"data_stored":81160023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:48:10.225 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:48:10.226 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:48:10.226 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:48:10.226 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T10:42:25.668802+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=42, tm_sec=25, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=46, tm_sec=5, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:48:10.227 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T10:48:30.228 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:48:30.538 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:48:30.540 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-04-26T10:48:30.549 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":267,"stamp":"2024-04-26T10:48:29.689440+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129401919,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2852,"num_read_kb":1456290,"num_write":30511,"num_write_kb":4323451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9253,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34478,"ondisk_log_size":34478,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":541988,"kb_used_data":255500,"kb_used_omap":10,"kb_used_meta":286453,"kb_avail":282573532,"statfs":{"total":289910292480,"available":289355296768,"internally_reserved":0,"allocated":261632000,"data_stored":260022078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10369,"internal_metadata":293328767},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003421"},"pg_stats":[{"pgid":"4.3f","version":"63'415","reported_seq":554,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:52.748402+0000","last_change":"2024-04-26T10:46:52.748512+0000","last_active":"2024-04-26T10:46:52.748402+0000","last_peered":"2024-04-26T10:46:52.748402+0000","last_clean":"2024-04-26T10:46:52.748402+0000","last_became_active":"2024-04-26T10:42:26.044597+0000","last_became_peered":"2024-04-26T10:42:26.044597+0000","last_unstale":"2024-04-26T10:46:52.748402+0000","last_undegraded":"2024-04-26T10:46:52.748402+0000","last_fullsized":"2024-04-26T10:46:52.748402+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'415","last_scrub_stamp":"2024-04-26T10:46:52.748380+0000","last_deep_scrub":"63'415","last_deep_scrub_stamp":"2024-04-26T10:46:52.748380+0000","last_clean_scrub_stamp":"2024-04-26T10:46:52.748380+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:44.118436+0000","scrub_duration":0.002346842,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22963,"num_write":385,"num_write_kb":71406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"63'396","reported_seq":534,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:40.755775+0000","last_change":"2024-04-26T10:47:40.755886+0000","last_active":"2024-04-26T10:47:40.755775+0000","last_peered":"2024-04-26T10:47:40.755775+0000","last_clean":"2024-04-26T10:47:40.755775+0000","last_became_active":"2024-04-26T10:45:54.192613+0000","last_became_peered":"2024-04-26T10:45:54.192613+0000","last_unstale":"2024-04-26T10:47:40.755775+0000","last_undegraded":"2024-04-26T10:47:40.755775+0000","last_fullsized":"2024-04-26T10:47:40.755775+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'396","last_scrub_stamp":"2024-04-26T10:47:40.755755+0000","last_deep_scrub":"63'396","last_deep_scrub_stamp":"2024-04-26T10:47:40.755755+0000","last_clean_scrub_stamp":"2024-04-26T10:47:40.755755+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:20.899080+0000","scrub_duration":0.0034271380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9499,"num_write":371,"num_write_kb":38601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"63'366","reported_seq":462,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:24.288483+0000","last_change":"2024-04-26T10:46:24.288483+0000","last_active":"2024-04-26T10:46:24.288483+0000","last_peered":"2024-04-26T10:46:24.288483+0000","last_clean":"2024-04-26T10:46:24.288483+0000","last_became_active":"2024-04-26T10:45:55.180991+0000","last_became_peered":"2024-04-26T10:45:55.180991+0000","last_unstale":"2024-04-26T10:46:24.288483+0000","last_undegraded":"2024-04-26T10:46:24.288483+0000","last_fullsized":"2024-04-26T10:46:24.288483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'366","last_scrub_stamp":"2024-04-26T10:46:24.288343+0000","last_deep_scrub":"63'366","last_deep_scrub_stamp":"2024-04-26T10:46:24.288343+0000","last_clean_scrub_stamp":"2024-04-26T10:46:24.288343+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:09.803889+0000","scrub_duration":0.0024847200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":6211,"num_write":338,"num_write_kb":38844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"63'394","reported_seq":558,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:27.644272+0000","last_change":"2024-04-26T10:47:27.644272+0000","last_active":"2024-04-26T10:47:27.644272+0000","last_peered":"2024-04-26T10:47:27.644272+0000","last_clean":"2024-04-26T10:47:27.644272+0000","last_became_active":"2024-04-26T10:45:51.159099+0000","last_became_peered":"2024-04-26T10:45:51.159099+0000","last_unstale":"2024-04-26T10:47:27.644272+0000","last_undegraded":"2024-04-26T10:47:27.644272+0000","last_fullsized":"2024-04-26T10:47:27.644272+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'394","last_scrub_stamp":"2024-04-26T10:47:27.644141+0000","last_deep_scrub":"63'394","last_deep_scrub_stamp":"2024-04-26T10:47:27.644141+0000","last_clean_scrub_stamp":"2024-04-26T10:47:27.644141+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:03.603073+0000","scrub_duration":0.00246729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":52323,"num_write":357,"num_write_kb":63323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"63'409","reported_seq":520,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:46.894628+0000","last_change":"2024-04-26T10:46:46.894628+0000","last_active":"2024-04-26T10:46:46.894628+0000","last_peered":"2024-04-26T10:46:46.894628+0000","last_clean":"2024-04-26T10:46:46.894628+0000","last_became_active":"2024-04-26T10:42:26.040487+0000","last_became_peered":"2024-04-26T10:42:26.040487+0000","last_unstale":"2024-04-26T10:46:46.894628+0000","last_undegraded":"2024-04-26T10:46:46.894628+0000","last_fullsized":"2024-04-26T10:46:46.894628+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'409","last_scrub_stamp":"2024-04-26T10:46:46.894476+0000","last_deep_scrub":"63'409","last_deep_scrub_stamp":"2024-04-26T10:46:46.894476+0000","last_clean_scrub_stamp":"2024-04-26T10:46:46.894476+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:34.325893+0000","scrub_duration":0.0034301790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":372,"num_write_kb":42764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'385","reported_seq":477,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:21.300788+0000","last_change":"2024-04-26T10:46:21.300788+0000","last_active":"2024-04-26T10:46:21.300788+0000","last_peered":"2024-04-26T10:46:21.300788+0000","last_clean":"2024-04-26T10:46:21.300788+0000","last_became_active":"2024-04-26T10:45:49.861811+0000","last_became_peered":"2024-04-26T10:45:49.861811+0000","last_unstale":"2024-04-26T10:46:21.300788+0000","last_undegraded":"2024-04-26T10:46:21.300788+0000","last_fullsized":"2024-04-26T10:46:21.300788+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'385","last_scrub_stamp":"2024-04-26T10:46:21.300632+0000","last_deep_scrub":"63'385","last_deep_scrub_stamp":"2024-04-26T10:46:21.300632+0000","last_clean_scrub_stamp":"2024-04-26T10:46:21.300632+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:50.462322+0000","scrub_duration":0.0030393180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4124,"num_write":356,"num_write_kb":69857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"63'425","reported_seq":547,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:55.577087+0000","last_change":"2024-04-26T10:47:55.577087+0000","last_active":"2024-04-26T10:47:55.577087+0000","last_peered":"2024-04-26T10:47:55.577087+0000","last_clean":"2024-04-26T10:47:55.577087+0000","last_became_active":"2024-04-26T10:45:50.866996+0000","last_became_peered":"2024-04-26T10:45:50.866996+0000","last_unstale":"2024-04-26T10:47:55.577087+0000","last_undegraded":"2024-04-26T10:47:55.577087+0000","last_fullsized":"2024-04-26T10:47:55.577087+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'425","last_scrub_stamp":"2024-04-26T10:47:55.576916+0000","last_deep_scrub":"63'425","last_deep_scrub_stamp":"2024-04-26T10:47:55.576916+0000","last_clean_scrub_stamp":"2024-04-26T10:47:55.576916+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:34:40.031269+0000","scrub_duration":0.0031622040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":13036,"num_write":390,"num_write_kb":67193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"63'399","reported_seq":520,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:48:14.832855+0000","last_change":"2024-04-26T10:48:14.832959+0000","last_active":"2024-04-26T10:48:14.832855+0000","last_peered":"2024-04-26T10:48:14.832855+0000","last_clean":"2024-04-26T10:48:14.832855+0000","last_became_active":"2024-04-26T10:45:58.162532+0000","last_became_peered":"2024-04-26T10:45:58.162532+0000","last_unstale":"2024-04-26T10:48:14.832855+0000","last_undegraded":"2024-04-26T10:48:14.832855+0000","last_fullsized":"2024-04-26T10:48:14.832855+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'399","last_scrub_stamp":"2024-04-26T10:48:14.832833+0000","last_deep_scrub":"63'399","last_deep_scrub_stamp":"2024-04-26T10:48:14.832833+0000","last_clean_scrub_stamp":"2024-04-26T10:48:14.832833+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:56:03.887092+0000","scrub_duration":0.002536239,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":25678,"num_write":356,"num_write_kb":116549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"63'442","reported_seq":602,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:09.239513+0000","last_change":"2024-04-26T10:47:09.239513+0000","last_active":"2024-04-26T10:47:09.239513+0000","last_peered":"2024-04-26T10:47:09.239513+0000","last_clean":"2024-04-26T10:47:09.239513+0000","last_became_active":"2024-04-26T10:42:26.045177+0000","last_became_peered":"2024-04-26T10:42:26.045177+0000","last_unstale":"2024-04-26T10:47:09.239513+0000","last_undegraded":"2024-04-26T10:47:09.239513+0000","last_fullsized":"2024-04-26T10:47:09.239513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'442","last_scrub_stamp":"2024-04-26T10:47:09.239378+0000","last_deep_scrub":"63'442","last_deep_scrub_stamp":"2024-04-26T10:47:09.239378+0000","last_clean_scrub_stamp":"2024-04-26T10:47:09.239378+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:14:55.718285+0000","scrub_duration":0.0028840749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":35111,"num_write":413,"num_write_kb":60306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"63'393","reported_seq":528,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:31.697765+0000","last_change":"2024-04-26T10:47:31.697891+0000","last_active":"2024-04-26T10:47:31.697765+0000","last_peered":"2024-04-26T10:47:31.697765+0000","last_clean":"2024-04-26T10:47:31.697765+0000","last_became_active":"2024-04-26T10:45:54.191514+0000","last_became_peered":"2024-04-26T10:45:54.191514+0000","last_unstale":"2024-04-26T10:47:31.697765+0000","last_undegraded":"2024-04-26T10:47:31.697765+0000","last_fullsized":"2024-04-26T10:47:31.697765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'393","last_scrub_stamp":"2024-04-26T10:47:31.697743+0000","last_deep_scrub":"63'393","last_deep_scrub_stamp":"2024-04-26T10:47:31.697743+0000","last_clean_scrub_stamp":"2024-04-26T10:47:31.697743+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:53:35.353544+0000","scrub_duration":0.0030851210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":5355,"num_write":351,"num_write_kb":38901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"63'377","reported_seq":495,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:10.635889+0000","last_change":"2024-04-26T10:47:10.635889+0000","last_active":"2024-04-26T10:47:10.635889+0000","last_peered":"2024-04-26T10:47:10.635889+0000","last_clean":"2024-04-26T10:47:10.635889+0000","last_became_active":"2024-04-26T10:45:49.862718+0000","last_became_peered":"2024-04-26T10:45:49.862718+0000","last_unstale":"2024-04-26T10:47:10.635889+0000","last_undegraded":"2024-04-26T10:47:10.635889+0000","last_fullsized":"2024-04-26T10:47:10.635889+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'377","last_scrub_stamp":"2024-04-26T10:47:10.635759+0000","last_deep_scrub":"63'377","last_deep_scrub_stamp":"2024-04-26T10:47:10.635759+0000","last_clean_scrub_stamp":"2024-04-26T10:47:10.635759+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:29.097205+0000","scrub_duration":0.0028839180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":18030,"num_write":355,"num_write_kb":67044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"63'365","reported_seq":821,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:38.660333+0000","last_change":"2024-04-26T10:47:38.660453+0000","last_active":"2024-04-26T10:47:38.660333+0000","last_peered":"2024-04-26T10:47:38.660333+0000","last_clean":"2024-04-26T10:47:38.660333+0000","last_became_active":"2024-04-26T10:45:57.164964+0000","last_became_peered":"2024-04-26T10:45:57.164964+0000","last_unstale":"2024-04-26T10:47:38.660333+0000","last_undegraded":"2024-04-26T10:47:38.660333+0000","last_fullsized":"2024-04-26T10:47:38.660333+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'365","last_scrub_stamp":"2024-04-26T10:47:38.660308+0000","last_deep_scrub":"63'365","last_deep_scrub_stamp":"2024-04-26T10:47:38.660308+0000","last_clean_scrub_stamp":"2024-04-26T10:47:38.660308+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:47.168185+0000","scrub_duration":0.0029265279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14866,"num_write":337,"num_write_kb":71188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"63'397","reported_seq":503,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:27.693031+0000","last_change":"2024-04-26T10:47:27.693148+0000","last_active":"2024-04-26T10:47:27.693031+0000","last_peered":"2024-04-26T10:47:27.693031+0000","last_clean":"2024-04-26T10:47:27.693031+0000","last_became_active":"2024-04-26T10:42:26.041617+0000","last_became_peered":"2024-04-26T10:42:26.041617+0000","last_unstale":"2024-04-26T10:47:27.693031+0000","last_undegraded":"2024-04-26T10:47:27.693031+0000","last_fullsized":"2024-04-26T10:47:27.693031+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'397","last_scrub_stamp":"2024-04-26T10:47:27.693009+0000","last_deep_scrub":"63'397","last_deep_scrub_stamp":"2024-04-26T10:47:27.693009+0000","last_clean_scrub_stamp":"2024-04-26T10:47:27.693009+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:52.452931+0000","scrub_duration":0.0036373759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8192,"num_write":362,"num_write_kb":54822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"63'408","reported_seq":500,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:34.396311+0000","last_change":"2024-04-26T10:46:34.396311+0000","last_active":"2024-04-26T10:46:34.396311+0000","last_peered":"2024-04-26T10:46:34.396311+0000","last_clean":"2024-04-26T10:46:34.396311+0000","last_became_active":"2024-04-26T10:45:53.177677+0000","last_became_peered":"2024-04-26T10:45:53.177677+0000","last_unstale":"2024-04-26T10:46:34.396311+0000","last_undegraded":"2024-04-26T10:46:34.396311+0000","last_fullsized":"2024-04-26T10:46:34.396311+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:34.396168+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:34.396168+0000","last_clean_scrub_stamp":"2024-04-26T10:46:34.396168+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:28.312103+0000","scrub_duration":0.002988662,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4688,"num_write":374,"num_write_kb":21766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"63'409","reported_seq":535,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:47.541645+0000","last_change":"2024-04-26T10:46:47.541645+0000","last_active":"2024-04-26T10:46:47.541645+0000","last_peered":"2024-04-26T10:46:47.541645+0000","last_clean":"2024-04-26T10:46:47.541645+0000","last_became_active":"2024-04-26T10:45:54.185826+0000","last_became_peered":"2024-04-26T10:45:54.185826+0000","last_unstale":"2024-04-26T10:46:47.541645+0000","last_undegraded":"2024-04-26T10:46:47.541645+0000","last_fullsized":"2024-04-26T10:46:47.541645+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'409","last_scrub_stamp":"2024-04-26T10:46:47.541492+0000","last_deep_scrub":"63'409","last_deep_scrub_stamp":"2024-04-26T10:46:47.541492+0000","last_clean_scrub_stamp":"2024-04-26T10:46:47.541492+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:05.889065+0000","scrub_duration":0.0023676470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25968,"num_write":366,"num_write_kb":75698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"63'460","reported_seq":575,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:20.325615+0000","last_change":"2024-04-26T10:46:20.325615+0000","last_active":"2024-04-26T10:46:20.325615+0000","last_peered":"2024-04-26T10:46:20.325615+0000","last_clean":"2024-04-26T10:46:20.325615+0000","last_became_active":"2024-04-26T10:45:53.174699+0000","last_became_peered":"2024-04-26T10:45:53.174699+0000","last_unstale":"2024-04-26T10:46:20.325615+0000","last_undegraded":"2024-04-26T10:46:20.325615+0000","last_fullsized":"2024-04-26T10:46:20.325615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'460","last_scrub_stamp":"2024-04-26T10:46:20.325486+0000","last_deep_scrub":"63'460","last_deep_scrub_stamp":"2024-04-26T10:46:20.325486+0000","last_clean_scrub_stamp":"2024-04-26T10:46:20.325486+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:51.733701+0000","scrub_duration":0.0023796759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16269,"num_write":426,"num_write_kb":67839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"63'393","reported_seq":525,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:11.204577+0000","last_change":"2024-04-26T10:47:11.204709+0000","last_active":"2024-04-26T10:47:11.204577+0000","last_peered":"2024-04-26T10:47:11.204577+0000","last_clean":"2024-04-26T10:47:11.204577+0000","last_became_active":"2024-04-26T10:42:26.049014+0000","last_became_peered":"2024-04-26T10:42:26.049014+0000","last_unstale":"2024-04-26T10:47:11.204577+0000","last_undegraded":"2024-04-26T10:47:11.204577+0000","last_fullsized":"2024-04-26T10:47:11.204577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'393","last_scrub_stamp":"2024-04-26T10:47:11.204553+0000","last_deep_scrub":"63'393","last_deep_scrub_stamp":"2024-04-26T10:47:11.204553+0000","last_clean_scrub_stamp":"2024-04-26T10:47:11.204553+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:49.026292+0000","scrub_duration":0.0022247619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":25712,"num_write":362,"num_write_kb":42020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"63'428","reported_seq":567,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:15.921226+0000","last_change":"2024-04-26T10:46:15.921226+0000","last_active":"2024-04-26T10:46:15.921226+0000","last_peered":"2024-04-26T10:46:15.921226+0000","last_clean":"2024-04-26T10:46:15.921226+0000","last_became_active":"2024-04-26T10:45:54.189852+0000","last_became_peered":"2024-04-26T10:45:54.189852+0000","last_unstale":"2024-04-26T10:46:15.921226+0000","last_undegraded":"2024-04-26T10:46:15.921226+0000","last_fullsized":"2024-04-26T10:46:15.921226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'428","last_scrub_stamp":"2024-04-26T10:46:15.921093+0000","last_deep_scrub":"63'428","last_deep_scrub_stamp":"2024-04-26T10:46:15.921093+0000","last_clean_scrub_stamp":"2024-04-26T10:46:15.921093+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:06.246994+0000","scrub_duration":0.0037567920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12316,"num_write":384,"num_write_kb":87656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"63'446","reported_seq":600,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:34.106970+0000","last_change":"2024-04-26T10:46:34.106970+0000","last_active":"2024-04-26T10:46:34.106970+0000","last_peered":"2024-04-26T10:46:34.106970+0000","last_clean":"2024-04-26T10:46:34.106970+0000","last_became_active":"2024-04-26T10:45:54.184063+0000","last_became_peered":"2024-04-26T10:45:54.184063+0000","last_unstale":"2024-04-26T10:46:34.106970+0000","last_undegraded":"2024-04-26T10:46:34.106970+0000","last_fullsized":"2024-04-26T10:46:34.106970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'446","last_scrub_stamp":"2024-04-26T10:46:34.106840+0000","last_deep_scrub":"63'446","last_deep_scrub_stamp":"2024-04-26T10:46:34.106840+0000","last_clean_scrub_stamp":"2024-04-26T10:46:34.106840+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:53.038982+0000","scrub_duration":0.003191504,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":53414,"num_write":401,"num_write_kb":80048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"63'438","reported_seq":563,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:43.456513+0000","last_change":"2024-04-26T10:46:43.456513+0000","last_active":"2024-04-26T10:46:43.456513+0000","last_peered":"2024-04-26T10:46:43.456513+0000","last_clean":"2024-04-26T10:46:43.456513+0000","last_became_active":"2024-04-26T10:45:50.867680+0000","last_became_peered":"2024-04-26T10:45:50.867680+0000","last_unstale":"2024-04-26T10:46:43.456513+0000","last_undegraded":"2024-04-26T10:46:43.456513+0000","last_fullsized":"2024-04-26T10:46:43.456513+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'438","last_scrub_stamp":"2024-04-26T10:46:43.456387+0000","last_deep_scrub":"63'438","last_deep_scrub_stamp":"2024-04-26T10:46:43.456387+0000","last_clean_scrub_stamp":"2024-04-26T10:46:43.456387+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:45.105492+0000","scrub_duration":0.002559675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":19859,"num_write":405,"num_write_kb":51119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":191,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"63'408","reported_seq":875,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:26.338811+0000","last_change":"2024-04-26T10:46:26.338811+0000","last_active":"2024-04-26T10:46:26.338811+0000","last_peered":"2024-04-26T10:46:26.338811+0000","last_clean":"2024-04-26T10:46:26.338811+0000","last_became_active":"2024-04-26T10:45:56.160360+0000","last_became_peered":"2024-04-26T10:45:56.160360+0000","last_unstale":"2024-04-26T10:46:26.338811+0000","last_undegraded":"2024-04-26T10:46:26.338811+0000","last_fullsized":"2024-04-26T10:46:26.338811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:26.338639+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:26.338639+0000","last_clean_scrub_stamp":"2024-04-26T10:46:26.338639+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:34.117967+0000","scrub_duration":0.0027084209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":15372,"num_write":366,"num_write_kb":75855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"63'452","reported_seq":1030,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:35.724265+0000","last_change":"2024-04-26T10:47:35.724379+0000","last_active":"2024-04-26T10:47:35.724265+0000","last_peered":"2024-04-26T10:47:35.724265+0000","last_clean":"2024-04-26T10:47:35.724265+0000","last_became_active":"2024-04-26T10:45:52.173702+0000","last_became_peered":"2024-04-26T10:45:52.173702+0000","last_unstale":"2024-04-26T10:47:35.724265+0000","last_undegraded":"2024-04-26T10:47:35.724265+0000","last_fullsized":"2024-04-26T10:47:35.724265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'452","last_scrub_stamp":"2024-04-26T10:47:35.724244+0000","last_deep_scrub":"63'452","last_deep_scrub_stamp":"2024-04-26T10:47:35.724244+0000","last_clean_scrub_stamp":"2024-04-26T10:47:35.724244+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:08.983320+0000","scrub_duration":0.0023523429999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43729,"num_write":421,"num_write_kb":79804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"63'408","reported_seq":895,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:30.067162+0000","last_change":"2024-04-26T10:46:30.067162+0000","last_active":"2024-04-26T10:46:30.067162+0000","last_peered":"2024-04-26T10:46:30.067162+0000","last_clean":"2024-04-26T10:46:30.067162+0000","last_became_active":"2024-04-26T10:45:57.162147+0000","last_became_peered":"2024-04-26T10:45:57.162147+0000","last_unstale":"2024-04-26T10:46:30.067162+0000","last_undegraded":"2024-04-26T10:46:30.067162+0000","last_fullsized":"2024-04-26T10:46:30.067162+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:30.067019+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:30.067019+0000","last_clean_scrub_stamp":"2024-04-26T10:46:30.067019+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:46.527639+0000","scrub_duration":0.0026815810000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":30320,"num_write":372,"num_write_kb":79936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"63'453","reported_seq":628,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:57.799503+0000","last_change":"2024-04-26T10:46:57.799635+0000","last_active":"2024-04-26T10:46:57.799503+0000","last_peered":"2024-04-26T10:46:57.799503+0000","last_clean":"2024-04-26T10:46:57.799503+0000","last_became_active":"2024-04-26T10:45:54.181881+0000","last_became_peered":"2024-04-26T10:45:54.181881+0000","last_unstale":"2024-04-26T10:46:57.799503+0000","last_undegraded":"2024-04-26T10:46:57.799503+0000","last_fullsized":"2024-04-26T10:46:57.799503+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'453","last_scrub_stamp":"2024-04-26T10:46:57.799480+0000","last_deep_scrub":"63'453","last_deep_scrub_stamp":"2024-04-26T10:46:57.799480+0000","last_clean_scrub_stamp":"2024-04-26T10:46:57.799480+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:42.095942+0000","scrub_duration":0.003413672,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":19864,"num_write":422,"num_write_kb":51638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"63'439","reported_seq":967,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:07.911236+0000","last_change":"2024-04-26T10:46:07.911236+0000","last_active":"2024-04-26T10:46:07.911236+0000","last_peered":"2024-04-26T10:46:07.911236+0000","last_clean":"2024-04-26T10:46:07.911236+0000","last_became_active":"2024-04-26T10:45:48.866159+0000","last_became_peered":"2024-04-26T10:45:48.866159+0000","last_unstale":"2024-04-26T10:46:07.911236+0000","last_undegraded":"2024-04-26T10:46:07.911236+0000","last_fullsized":"2024-04-26T10:46:07.911236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'439","last_scrub_stamp":"2024-04-26T10:46:07.911088+0000","last_deep_scrub":"63'439","last_deep_scrub_stamp":"2024-04-26T10:46:07.911088+0000","last_clean_scrub_stamp":"2024-04-26T10:46:07.911088+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:32.755490+0000","scrub_duration":0.0024222179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8912,"num_write":417,"num_write_kb":46575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"63'513","reported_seq":1171,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:26.001684+0000","last_change":"2024-04-26T10:47:26.001787+0000","last_active":"2024-04-26T10:47:26.001684+0000","last_peered":"2024-04-26T10:47:26.001684+0000","last_clean":"2024-04-26T10:47:26.001684+0000","last_became_active":"2024-04-26T10:45:51.158698+0000","last_became_peered":"2024-04-26T10:45:51.158698+0000","last_unstale":"2024-04-26T10:47:26.001684+0000","last_undegraded":"2024-04-26T10:47:26.001684+0000","last_fullsized":"2024-04-26T10:47:26.001684+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'513","last_scrub_stamp":"2024-04-26T10:47:26.001661+0000","last_deep_scrub":"63'513","last_deep_scrub_stamp":"2024-04-26T10:47:26.001661+0000","last_clean_scrub_stamp":"2024-04-26T10:47:26.001661+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:32.290818+0000","scrub_duration":0.0023258710000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":70751,"num_write":473,"num_write_kb":88902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"63'406","reported_seq":546,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:54.455779+0000","last_change":"2024-04-26T10:46:54.455779+0000","last_active":"2024-04-26T10:46:54.455779+0000","last_peered":"2024-04-26T10:46:54.455779+0000","last_clean":"2024-04-26T10:46:54.455779+0000","last_became_active":"2024-04-26T10:45:56.162419+0000","last_became_peered":"2024-04-26T10:45:56.162419+0000","last_unstale":"2024-04-26T10:46:54.455779+0000","last_undegraded":"2024-04-26T10:46:54.455779+0000","last_fullsized":"2024-04-26T10:46:54.455779+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'406","last_scrub_stamp":"2024-04-26T10:46:54.455655+0000","last_deep_scrub":"63'406","last_deep_scrub_stamp":"2024-04-26T10:46:54.455655+0000","last_clean_scrub_stamp":"2024-04-26T10:46:54.455655+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:48:35.943745+0000","scrub_duration":0.0024701179999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":32121,"num_write":372,"num_write_kb":60163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"63'402","reported_seq":880,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:38.854895+0000","last_change":"2024-04-26T10:46:38.854895+0000","last_active":"2024-04-26T10:46:38.854895+0000","last_peered":"2024-04-26T10:46:38.854895+0000","last_clean":"2024-04-26T10:46:38.854895+0000","last_became_active":"2024-04-26T10:45:57.165064+0000","last_became_peered":"2024-04-26T10:45:57.165064+0000","last_unstale":"2024-04-26T10:46:38.854895+0000","last_undegraded":"2024-04-26T10:46:38.854895+0000","last_fullsized":"2024-04-26T10:46:38.854895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'402","last_scrub_stamp":"2024-04-26T10:46:38.854753+0000","last_deep_scrub":"63'402","last_deep_scrub_stamp":"2024-04-26T10:46:38.854753+0000","last_clean_scrub_stamp":"2024-04-26T10:46:38.854753+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:36.110686+0000","scrub_duration":0.0022249689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":6824,"num_write":378,"num_write_kb":72156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"63'407","reported_seq":901,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:39.933613+0000","last_change":"2024-04-26T10:47:39.933613+0000","last_active":"2024-04-26T10:47:39.933613+0000","last_peered":"2024-04-26T10:47:39.933613+0000","last_clean":"2024-04-26T10:47:39.933613+0000","last_became_active":"2024-04-26T10:45:58.161850+0000","last_became_peered":"2024-04-26T10:45:58.161850+0000","last_unstale":"2024-04-26T10:47:39.933613+0000","last_undegraded":"2024-04-26T10:47:39.933613+0000","last_fullsized":"2024-04-26T10:47:39.933613+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'407","last_scrub_stamp":"2024-04-26T10:47:39.933481+0000","last_deep_scrub":"63'407","last_deep_scrub_stamp":"2024-04-26T10:47:39.933481+0000","last_clean_scrub_stamp":"2024-04-26T10:47:39.933481+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:39.377365+0000","scrub_duration":0.0035767009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":25898,"num_write":372,"num_write_kb":59274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":346,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"63'490","reported_seq":1071,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:51.777219+0000","last_change":"2024-04-26T10:46:51.777320+0000","last_active":"2024-04-26T10:46:51.777219+0000","last_peered":"2024-04-26T10:46:51.777219+0000","last_clean":"2024-04-26T10:46:51.777219+0000","last_became_active":"2024-04-26T10:45:55.178083+0000","last_became_peered":"2024-04-26T10:45:55.178083+0000","last_unstale":"2024-04-26T10:46:51.777219+0000","last_undegraded":"2024-04-26T10:46:51.777219+0000","last_fullsized":"2024-04-26T10:46:51.777219+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'490","last_scrub_stamp":"2024-04-26T10:46:51.777196+0000","last_deep_scrub":"63'490","last_deep_scrub_stamp":"2024-04-26T10:46:51.777196+0000","last_clean_scrub_stamp":"2024-04-26T10:46:51.777196+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:16:31.651731+0000","scrub_duration":0.0022270390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33597,"num_write":449,"num_write_kb":87981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":205,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"63'474","reported_seq":576,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:41.218435+0000","last_change":"2024-04-26T10:46:41.218435+0000","last_active":"2024-04-26T10:46:41.218435+0000","last_peered":"2024-04-26T10:46:41.218435+0000","last_clean":"2024-04-26T10:46:41.218435+0000","last_became_active":"2024-04-26T10:45:54.186011+0000","last_became_peered":"2024-04-26T10:45:54.186011+0000","last_unstale":"2024-04-26T10:46:41.218435+0000","last_undegraded":"2024-04-26T10:46:41.218435+0000","last_fullsized":"2024-04-26T10:46:41.218435+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'474","last_scrub_stamp":"2024-04-26T10:46:41.218267+0000","last_deep_scrub":"63'474","last_deep_scrub_stamp":"2024-04-26T10:46:41.218267+0000","last_clean_scrub_stamp":"2024-04-26T10:46:41.218267+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:14:19.308910+0000","scrub_duration":0.003558748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":30886,"num_write":441,"num_write_kb":118807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"63'443","reported_seq":560,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:37.402510+0000","last_change":"2024-04-26T10:46:37.402510+0000","last_active":"2024-04-26T10:46:37.402510+0000","last_peered":"2024-04-26T10:46:37.402510+0000","last_clean":"2024-04-26T10:46:37.402510+0000","last_became_active":"2024-04-26T10:45:48.861918+0000","last_became_peered":"2024-04-26T10:45:48.861918+0000","last_unstale":"2024-04-26T10:46:37.402510+0000","last_undegraded":"2024-04-26T10:46:37.402510+0000","last_fullsized":"2024-04-26T10:46:37.402510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'443","last_scrub_stamp":"2024-04-26T10:46:37.402390+0000","last_deep_scrub":"63'443","last_deep_scrub_stamp":"2024-04-26T10:46:37.402390+0000","last_clean_scrub_stamp":"2024-04-26T10:46:37.402390+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:31.390744+0000","scrub_duration":0.0023535019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20556,"num_write":413,"num_write_kb":91647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"63'376","reported_seq":491,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:49.818309+0000","last_change":"2024-04-26T10:46:49.818309+0000","last_active":"2024-04-26T10:46:49.818309+0000","last_peered":"2024-04-26T10:46:49.818309+0000","last_clean":"2024-04-26T10:46:49.818309+0000","last_became_active":"2024-04-26T10:42:26.040920+0000","last_became_peered":"2024-04-26T10:42:26.040920+0000","last_unstale":"2024-04-26T10:46:49.818309+0000","last_undegraded":"2024-04-26T10:46:49.818309+0000","last_fullsized":"2024-04-26T10:46:49.818309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'376","last_scrub_stamp":"2024-04-26T10:46:49.818144+0000","last_deep_scrub":"63'376","last_deep_scrub_stamp":"2024-04-26T10:46:49.818144+0000","last_clean_scrub_stamp":"2024-04-26T10:46:49.818144+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:42.631428+0000","scrub_duration":0.002993571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10124,"num_write":344,"num_write_kb":66899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"84'457","reported_seq":550,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:53.637492+0000","last_change":"2024-04-26T10:47:53.637492+0000","last_active":"2024-04-26T10:47:53.637492+0000","last_peered":"2024-04-26T10:47:53.637492+0000","last_clean":"2024-04-26T10:47:53.637492+0000","last_became_active":"2024-04-26T10:45:48.862424+0000","last_became_peered":"2024-04-26T10:45:48.862424+0000","last_unstale":"2024-04-26T10:47:53.637492+0000","last_undegraded":"2024-04-26T10:47:53.637492+0000","last_fullsized":"2024-04-26T10:47:53.637492+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'457","last_scrub_stamp":"2024-04-26T10:47:53.637378+0000","last_deep_scrub":"84'457","last_deep_scrub_stamp":"2024-04-26T10:47:53.637378+0000","last_clean_scrub_stamp":"2024-04-26T10:47:53.637378+0000","objects_scrubbed":4,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:58.972915+0000","scrub_duration":0.016148688000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":8359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"63'403","reported_seq":533,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:10.923239+0000","last_change":"2024-04-26T10:46:10.923239+0000","last_active":"2024-04-26T10:46:10.923239+0000","last_peered":"2024-04-26T10:46:10.923239+0000","last_clean":"2024-04-26T10:46:10.923239+0000","last_became_active":"2024-04-26T10:42:26.040464+0000","last_became_peered":"2024-04-26T10:42:26.040464+0000","last_unstale":"2024-04-26T10:46:10.923239+0000","last_undegraded":"2024-04-26T10:46:10.923239+0000","last_fullsized":"2024-04-26T10:46:10.923239+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'403","last_scrub_stamp":"2024-04-26T10:46:10.923100+0000","last_deep_scrub":"63'403","last_deep_scrub_stamp":"2024-04-26T10:46:10.923100+0000","last_clean_scrub_stamp":"2024-04-26T10:46:10.923100+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:00.804186+0000","scrub_duration":0.0037994579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24588,"num_write":363,"num_write_kb":51190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"62'49","reported_seq":156,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:17.105113+0000","last_change":"2024-04-26T10:47:17.105218+0000","last_active":"2024-04-26T10:47:17.105113+0000","last_peered":"2024-04-26T10:47:17.105113+0000","last_clean":"2024-04-26T10:47:17.105113+0000","last_became_active":"2024-04-26T10:45:45.862029+0000","last_became_peered":"2024-04-26T10:45:45.862029+0000","last_unstale":"2024-04-26T10:47:17.105113+0000","last_undegraded":"2024-04-26T10:47:17.105113+0000","last_fullsized":"2024-04-26T10:47:17.105113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'49","last_scrub_stamp":"2024-04-26T10:47:17.105090+0000","last_deep_scrub":"62'49","last_deep_scrub_stamp":"2024-04-26T10:47:17.105090+0000","last_clean_scrub_stamp":"2024-04-26T10:47:17.105090+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:22.790230+0000","scrub_duration":0.0016239309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"63'407","reported_seq":900,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:23.067400+0000","last_change":"2024-04-26T10:47:23.067513+0000","last_active":"2024-04-26T10:47:23.067400+0000","last_peered":"2024-04-26T10:47:23.067400+0000","last_clean":"2024-04-26T10:47:23.067400+0000","last_became_active":"2024-04-26T10:45:52.169295+0000","last_became_peered":"2024-04-26T10:45:52.169295+0000","last_unstale":"2024-04-26T10:47:23.067400+0000","last_undegraded":"2024-04-26T10:47:23.067400+0000","last_fullsized":"2024-04-26T10:47:23.067400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'407","last_scrub_stamp":"2024-04-26T10:47:23.067376+0000","last_deep_scrub":"63'407","last_deep_scrub_stamp":"2024-04-26T10:47:23.067376+0000","last_clean_scrub_stamp":"2024-04-26T10:47:23.067376+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:45.140990+0000","scrub_duration":0.0024592289999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":7077,"num_write":367,"num_write_kb":42434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"62'66","reported_seq":173,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:11.778529+0000","last_change":"2024-04-26T10:47:11.778687+0000","last_active":"2024-04-26T10:47:11.778529+0000","last_peered":"2024-04-26T10:47:11.778529+0000","last_clean":"2024-04-26T10:47:11.778529+0000","last_became_active":"2024-04-26T10:45:45.874030+0000","last_became_peered":"2024-04-26T10:45:45.874030+0000","last_unstale":"2024-04-26T10:47:11.778529+0000","last_undegraded":"2024-04-26T10:47:11.778529+0000","last_fullsized":"2024-04-26T10:47:11.778529+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'66","last_scrub_stamp":"2024-04-26T10:47:11.778503+0000","last_deep_scrub":"62'66","last_deep_scrub_stamp":"2024-04-26T10:47:11.778503+0000","last_clean_scrub_stamp":"2024-04-26T10:47:11.778503+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:51:30.448994+0000","scrub_duration":0.001798846,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"63'406","reported_seq":911,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:24.024745+0000","last_change":"2024-04-26T10:47:24.024848+0000","last_active":"2024-04-26T10:47:24.024745+0000","last_peered":"2024-04-26T10:47:24.024745+0000","last_clean":"2024-04-26T10:47:24.024745+0000","last_became_active":"2024-04-26T10:45:49.861979+0000","last_became_peered":"2024-04-26T10:45:49.861979+0000","last_unstale":"2024-04-26T10:47:24.024745+0000","last_undegraded":"2024-04-26T10:47:24.024745+0000","last_fullsized":"2024-04-26T10:47:24.024745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'406","last_scrub_stamp":"2024-04-26T10:47:24.024723+0000","last_deep_scrub":"63'406","last_deep_scrub_stamp":"2024-04-26T10:47:24.024723+0000","last_clean_scrub_stamp":"2024-04-26T10:47:24.024723+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:07:41.862917+0000","scrub_duration":0.0024237550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":25977,"num_write":374,"num_write_kb":104172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"84'70","reported_seq":55,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:56.461080+0000","last_change":"2024-04-26T10:46:56.461080+0000","last_active":"2024-04-26T10:46:56.461080+0000","last_peered":"2024-04-26T10:46:56.461080+0000","last_clean":"2024-04-26T10:46:56.461080+0000","last_became_active":"2024-04-26T10:45:45.871120+0000","last_became_peered":"2024-04-26T10:45:45.871120+0000","last_unstale":"2024-04-26T10:46:56.461080+0000","last_undegraded":"2024-04-26T10:46:56.461080+0000","last_fullsized":"2024-04-26T10:46:56.461080+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'70","last_scrub_stamp":"2024-04-26T10:46:56.460924+0000","last_deep_scrub":"84'70","last_deep_scrub_stamp":"2024-04-26T10:46:56.460924+0000","last_clean_scrub_stamp":"2024-04-26T10:46:56.460924+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:06.245761+0000","scrub_duration":0.0046851239999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"84'202","reported_seq":296,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:45.516981+0000","last_change":"2024-04-26T10:46:45.516981+0000","last_active":"2024-04-26T10:46:45.516981+0000","last_peered":"2024-04-26T10:46:45.516981+0000","last_clean":"2024-04-26T10:46:45.516981+0000","last_became_active":"2024-04-26T10:45:48.865878+0000","last_became_peered":"2024-04-26T10:45:48.865878+0000","last_unstale":"2024-04-26T10:46:45.516981+0000","last_undegraded":"2024-04-26T10:46:45.516981+0000","last_fullsized":"2024-04-26T10:46:45.516981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'202","last_scrub_stamp":"2024-04-26T10:46:45.516857+0000","last_deep_scrub":"84'202","last_deep_scrub_stamp":"2024-04-26T10:46:45.516857+0000","last_clean_scrub_stamp":"2024-04-26T10:46:45.516857+0000","objects_scrubbed":2,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:35.343559+0000","scrub_duration":0.011504359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"63'415","reported_seq":921,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:11.914773+0000","last_change":"2024-04-26T10:46:11.914773+0000","last_active":"2024-04-26T10:46:11.914773+0000","last_peered":"2024-04-26T10:46:11.914773+0000","last_clean":"2024-04-26T10:46:11.914773+0000","last_became_active":"2024-04-26T10:45:57.163263+0000","last_became_peered":"2024-04-26T10:45:57.163263+0000","last_unstale":"2024-04-26T10:46:11.914773+0000","last_undegraded":"2024-04-26T10:46:11.914773+0000","last_fullsized":"2024-04-26T10:46:11.914773+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'415","last_scrub_stamp":"2024-04-26T10:46:11.914637+0000","last_deep_scrub":"63'415","last_deep_scrub_stamp":"2024-04-26T10:46:11.914637+0000","last_clean_scrub_stamp":"2024-04-26T10:46:11.914637+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:19.456262+0000","scrub_duration":0.0026733759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":15757,"num_write":380,"num_write_kb":54727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"84'344","reported_seq":463,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:04.860552+0000","last_change":"2024-04-26T10:47:04.860677+0000","last_active":"2024-04-26T10:47:04.860552+0000","last_peered":"2024-04-26T10:47:04.860552+0000","last_clean":"2024-04-26T10:47:04.860552+0000","last_became_active":"2024-04-26T10:45:48.866497+0000","last_became_peered":"2024-04-26T10:45:48.866497+0000","last_unstale":"2024-04-26T10:47:04.860552+0000","last_undegraded":"2024-04-26T10:47:04.860552+0000","last_fullsized":"2024-04-26T10:47:04.860552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'344","last_scrub_stamp":"2024-04-26T10:47:04.860530+0000","last_deep_scrub":"84'344","last_deep_scrub_stamp":"2024-04-26T10:47:04.860530+0000","last_clean_scrub_stamp":"2024-04-26T10:47:04.860530+0000","objects_scrubbed":2,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:42.826483+0000","scrub_duration":0.011514284,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"63'481","reported_seq":683,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:23.694129+0000","last_change":"2024-04-26T10:47:23.694244+0000","last_active":"2024-04-26T10:47:23.694129+0000","last_peered":"2024-04-26T10:47:23.694129+0000","last_clean":"2024-04-26T10:47:23.694129+0000","last_became_active":"2024-04-26T10:45:54.181993+0000","last_became_peered":"2024-04-26T10:45:54.181993+0000","last_unstale":"2024-04-26T10:47:23.694129+0000","last_undegraded":"2024-04-26T10:47:23.694129+0000","last_fullsized":"2024-04-26T10:47:23.694129+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'481","last_scrub_stamp":"2024-04-26T10:47:23.694106+0000","last_deep_scrub":"63'481","last_deep_scrub_stamp":"2024-04-26T10:47:23.694106+0000","last_clean_scrub_stamp":"2024-04-26T10:47:23.694106+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:27.709900+0000","scrub_duration":0.0032272659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":45251,"num_write":451,"num_write_kb":105365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"84'462","reported_seq":556,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:40.432691+0000","last_change":"2024-04-26T10:46:40.432691+0000","last_active":"2024-04-26T10:46:40.432691+0000","last_peered":"2024-04-26T10:46:40.432691+0000","last_clean":"2024-04-26T10:46:40.432691+0000","last_became_active":"2024-04-26T10:45:48.865520+0000","last_became_peered":"2024-04-26T10:45:48.865520+0000","last_unstale":"2024-04-26T10:46:40.432691+0000","last_undegraded":"2024-04-26T10:46:40.432691+0000","last_fullsized":"2024-04-26T10:46:40.432691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'462","last_scrub_stamp":"2024-04-26T10:46:40.432509+0000","last_deep_scrub":"84'462","last_deep_scrub_stamp":"2024-04-26T10:46:40.432509+0000","last_clean_scrub_stamp":"2024-04-26T10:46:40.432509+0000","objects_scrubbed":2,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:15.817808+0000","scrub_duration":0.010610122,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":407,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"63'420","reported_seq":516,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:48:10.700448+0000","last_change":"2024-04-26T10:48:10.700554+0000","last_active":"2024-04-26T10:48:10.700448+0000","last_peered":"2024-04-26T10:48:10.700448+0000","last_clean":"2024-04-26T10:48:10.700448+0000","last_became_active":"2024-04-26T10:45:57.162014+0000","last_became_peered":"2024-04-26T10:45:57.162014+0000","last_unstale":"2024-04-26T10:48:10.700448+0000","last_undegraded":"2024-04-26T10:48:10.700448+0000","last_fullsized":"2024-04-26T10:48:10.700448+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'420","last_scrub_stamp":"2024-04-26T10:48:10.700412+0000","last_deep_scrub":"63'420","last_deep_scrub_stamp":"2024-04-26T10:48:10.700412+0000","last_clean_scrub_stamp":"2024-04-26T10:48:10.700412+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:58.412878+0000","scrub_duration":0.0027975510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13025,"num_write":385,"num_write_kb":38595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"62'67","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:51.506347+0000","last_change":"2024-04-26T10:46:51.506347+0000","last_active":"2024-04-26T10:46:51.506347+0000","last_peered":"2024-04-26T10:46:51.506347+0000","last_clean":"2024-04-26T10:46:51.506347+0000","last_became_active":"2024-04-26T10:45:45.860175+0000","last_became_peered":"2024-04-26T10:45:45.860175+0000","last_unstale":"2024-04-26T10:46:51.506347+0000","last_undegraded":"2024-04-26T10:46:51.506347+0000","last_fullsized":"2024-04-26T10:46:51.506347+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'67","last_scrub_stamp":"2024-04-26T10:46:51.506217+0000","last_deep_scrub":"62'67","last_deep_scrub_stamp":"2024-04-26T10:46:51.506217+0000","last_clean_scrub_stamp":"2024-04-26T10:46:51.506217+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:02.699431+0000","scrub_duration":0.0015865510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"63'452","reported_seq":978,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:37.035134+0000","last_change":"2024-04-26T10:47:37.035134+0000","last_active":"2024-04-26T10:47:37.035134+0000","last_peered":"2024-04-26T10:47:37.035134+0000","last_clean":"2024-04-26T10:47:37.035134+0000","last_became_active":"2024-04-26T10:45:58.164105+0000","last_became_peered":"2024-04-26T10:45:58.164105+0000","last_unstale":"2024-04-26T10:47:37.035134+0000","last_undegraded":"2024-04-26T10:47:37.035134+0000","last_fullsized":"2024-04-26T10:47:37.035134+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'452","last_scrub_stamp":"2024-04-26T10:47:37.034983+0000","last_deep_scrub":"63'452","last_deep_scrub_stamp":"2024-04-26T10:47:37.034983+0000","last_clean_scrub_stamp":"2024-04-26T10:47:37.034983+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:38.528620+0000","scrub_duration":0.002456293,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23217,"num_write":416,"num_write_kb":71418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":388,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'203","reported_seq":293,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:33.990424+0000","last_change":"2024-04-26T10:47:33.990424+0000","last_active":"2024-04-26T10:47:33.990424+0000","last_peered":"2024-04-26T10:47:33.990424+0000","last_clean":"2024-04-26T10:47:33.990424+0000","last_became_active":"2024-04-26T10:45:56.160475+0000","last_became_peered":"2024-04-26T10:45:56.160475+0000","last_unstale":"2024-04-26T10:47:33.990424+0000","last_undegraded":"2024-04-26T10:47:33.990424+0000","last_fullsized":"2024-04-26T10:47:33.990424+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'203","last_scrub_stamp":"2024-04-26T10:47:33.990294+0000","last_deep_scrub":"84'203","last_deep_scrub_stamp":"2024-04-26T10:47:33.990294+0000","last_clean_scrub_stamp":"2024-04-26T10:47:33.990294+0000","objects_scrubbed":3,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:32.037541+0000","scrub_duration":0.015319917000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"63'430","reported_seq":525,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:48:12.765381+0000","last_change":"2024-04-26T10:48:12.765494+0000","last_active":"2024-04-26T10:48:12.765381+0000","last_peered":"2024-04-26T10:48:12.765381+0000","last_clean":"2024-04-26T10:48:12.765381+0000","last_became_active":"2024-04-26T10:45:57.162070+0000","last_became_peered":"2024-04-26T10:45:57.162070+0000","last_unstale":"2024-04-26T10:48:12.765381+0000","last_undegraded":"2024-04-26T10:48:12.765381+0000","last_fullsized":"2024-04-26T10:48:12.765381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'430","last_scrub_stamp":"2024-04-26T10:48:12.765359+0000","last_deep_scrub":"63'430","last_deep_scrub_stamp":"2024-04-26T10:48:12.765359+0000","last_clean_scrub_stamp":"2024-04-26T10:48:12.765359+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:49.487744+0000","scrub_duration":0.0024638759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":24352,"num_write":392,"num_write_kb":21976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"84'234","reported_seq":320,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:15.625011+0000","last_change":"2024-04-26T10:47:15.625011+0000","last_active":"2024-04-26T10:47:15.625011+0000","last_peered":"2024-04-26T10:47:15.625011+0000","last_clean":"2024-04-26T10:47:15.625011+0000","last_became_active":"2024-04-26T10:45:48.862517+0000","last_became_peered":"2024-04-26T10:45:48.862517+0000","last_unstale":"2024-04-26T10:47:15.625011+0000","last_undegraded":"2024-04-26T10:47:15.625011+0000","last_fullsized":"2024-04-26T10:47:15.625011+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'234","last_scrub_stamp":"2024-04-26T10:47:15.624801+0000","last_deep_scrub":"84'234","last_deep_scrub_stamp":"2024-04-26T10:47:15.624801+0000","last_clean_scrub_stamp":"2024-04-26T10:47:15.624801+0000","objects_scrubbed":1,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:37:41.779523+0000","scrub_duration":0.0093436560000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"63'393","reported_seq":491,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:01.534285+0000","last_change":"2024-04-26T10:47:01.534285+0000","last_active":"2024-04-26T10:47:01.534285+0000","last_peered":"2024-04-26T10:47:01.534285+0000","last_clean":"2024-04-26T10:47:01.534285+0000","last_became_active":"2024-04-26T10:45:55.177758+0000","last_became_peered":"2024-04-26T10:45:55.177758+0000","last_unstale":"2024-04-26T10:47:01.534285+0000","last_undegraded":"2024-04-26T10:47:01.534285+0000","last_fullsized":"2024-04-26T10:47:01.534285+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'393","last_scrub_stamp":"2024-04-26T10:47:01.534143+0000","last_deep_scrub":"63'393","last_deep_scrub_stamp":"2024-04-26T10:47:01.534143+0000","last_clean_scrub_stamp":"2024-04-26T10:47:01.534143+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:15.470762+0000","scrub_duration":0.0026004790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":8671,"num_write":368,"num_write_kb":38542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"62'49","reported_seq":156,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:02.831959+0000","last_change":"2024-04-26T10:47:02.832067+0000","last_active":"2024-04-26T10:47:02.831959+0000","last_peered":"2024-04-26T10:47:02.831959+0000","last_clean":"2024-04-26T10:47:02.831959+0000","last_became_active":"2024-04-26T10:45:45.874328+0000","last_became_peered":"2024-04-26T10:45:45.874328+0000","last_unstale":"2024-04-26T10:47:02.831959+0000","last_undegraded":"2024-04-26T10:47:02.831959+0000","last_fullsized":"2024-04-26T10:47:02.831959+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'49","last_scrub_stamp":"2024-04-26T10:47:02.831935+0000","last_deep_scrub":"62'49","last_deep_scrub_stamp":"2024-04-26T10:47:02.831935+0000","last_clean_scrub_stamp":"2024-04-26T10:47:02.831935+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:21.771123+0000","scrub_duration":0.0016852690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"63'368","reported_seq":476,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:49.494481+0000","last_change":"2024-04-26T10:46:49.494481+0000","last_active":"2024-04-26T10:46:49.494481+0000","last_peered":"2024-04-26T10:46:49.494481+0000","last_clean":"2024-04-26T10:46:49.494481+0000","last_became_active":"2024-04-26T10:45:56.163456+0000","last_became_peered":"2024-04-26T10:45:56.163456+0000","last_unstale":"2024-04-26T10:46:49.494481+0000","last_undegraded":"2024-04-26T10:46:49.494481+0000","last_fullsized":"2024-04-26T10:46:49.494481+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'368","last_scrub_stamp":"2024-04-26T10:46:49.494360+0000","last_deep_scrub":"63'368","last_deep_scrub_stamp":"2024-04-26T10:46:49.494360+0000","last_clean_scrub_stamp":"2024-04-26T10:46:49.494360+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:27.081977+0000","scrub_duration":0.0025223229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":19222,"num_write":336,"num_write_kb":58903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"84'620","reported_seq":761,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:14.719236+0000","last_change":"2024-04-26T10:47:14.719342+0000","last_active":"2024-04-26T10:47:14.719236+0000","last_peered":"2024-04-26T10:47:14.719236+0000","last_clean":"2024-04-26T10:47:14.719236+0000","last_became_active":"2024-04-26T10:45:56.161604+0000","last_became_peered":"2024-04-26T10:45:56.161604+0000","last_unstale":"2024-04-26T10:47:14.719236+0000","last_undegraded":"2024-04-26T10:47:14.719236+0000","last_fullsized":"2024-04-26T10:47:14.719236+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'620","last_scrub_stamp":"2024-04-26T10:47:14.719213+0000","last_deep_scrub":"84'620","last_deep_scrub_stamp":"2024-04-26T10:47:14.719213+0000","last_clean_scrub_stamp":"2024-04-26T10:47:14.719213+0000","objects_scrubbed":1,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:29.417733+0000","scrub_duration":0.010567363999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":558,"num_write_kb":4358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"63'383","reported_seq":835,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:38.953783+0000","last_change":"2024-04-26T10:47:38.953783+0000","last_active":"2024-04-26T10:47:38.953783+0000","last_peered":"2024-04-26T10:47:38.953783+0000","last_clean":"2024-04-26T10:47:38.953783+0000","last_became_active":"2024-04-26T10:45:58.162264+0000","last_became_peered":"2024-04-26T10:45:58.162264+0000","last_unstale":"2024-04-26T10:47:38.953783+0000","last_undegraded":"2024-04-26T10:47:38.953783+0000","last_fullsized":"2024-04-26T10:47:38.953783+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'383","last_scrub_stamp":"2024-04-26T10:47:38.953668+0000","last_deep_scrub":"63'383","last_deep_scrub_stamp":"2024-04-26T10:47:38.953668+0000","last_clean_scrub_stamp":"2024-04-26T10:47:38.953668+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:51.290039+0000","scrub_duration":0.002468446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":14260,"num_write":349,"num_write_kb":50367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"84'159","reported_seq":244,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:28.647857+0000","last_change":"2024-04-26T10:47:28.647857+0000","last_active":"2024-04-26T10:47:28.647857+0000","last_peered":"2024-04-26T10:47:28.647857+0000","last_clean":"2024-04-26T10:47:28.647857+0000","last_became_active":"2024-04-26T10:45:45.871155+0000","last_became_peered":"2024-04-26T10:45:45.871155+0000","last_unstale":"2024-04-26T10:47:28.647857+0000","last_undegraded":"2024-04-26T10:47:28.647857+0000","last_fullsized":"2024-04-26T10:47:28.647857+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'159","last_scrub_stamp":"2024-04-26T10:47:28.647724+0000","last_deep_scrub":"84'159","last_deep_scrub_stamp":"2024-04-26T10:47:28.647724+0000","last_clean_scrub_stamp":"2024-04-26T10:47:28.647724+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:46.139695+0000","scrub_duration":0.0043961449999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:42.656296+0000","last_change":"2024-04-26T10:47:42.656296+0000","last_active":"2024-04-26T10:47:42.656296+0000","last_peered":"2024-04-26T10:47:42.656296+0000","last_clean":"2024-04-26T10:47:42.656296+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:47:42.656296+0000","last_undegraded":"2024-04-26T10:47:42.656296+0000","last_fullsized":"2024-04-26T10:47:42.656296+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:47:42.656145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:47:42.656145+0000","last_clean_scrub_stamp":"2024-04-26T10:47:42.656145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:12.355980+0000","scrub_duration":0.0019280339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"84'745","reported_seq":839,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:16.132144+0000","last_change":"2024-04-26T10:47:16.132263+0000","last_active":"2024-04-26T10:47:16.132144+0000","last_peered":"2024-04-26T10:47:16.132144+0000","last_clean":"2024-04-26T10:47:16.132144+0000","last_became_active":"2024-04-26T10:42:25.686009+0000","last_became_peered":"2024-04-26T10:42:25.686009+0000","last_unstale":"2024-04-26T10:47:16.132144+0000","last_undegraded":"2024-04-26T10:47:16.132144+0000","last_fullsized":"2024-04-26T10:47:16.132144+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'745","last_scrub_stamp":"2024-04-26T10:47:16.132120+0000","last_deep_scrub":"84'745","last_deep_scrub_stamp":"2024-04-26T10:47:16.132120+0000","last_clean_scrub_stamp":"2024-04-26T10:47:16.132120+0000","objects_scrubbed":2,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:40:39.935186+0000","scrub_duration":0.015566577,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"63'442","reported_seq":580,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:48.508984+0000","last_change":"2024-04-26T10:46:48.508984+0000","last_active":"2024-04-26T10:46:48.508984+0000","last_peered":"2024-04-26T10:46:48.508984+0000","last_clean":"2024-04-26T10:46:48.508984+0000","last_became_active":"2024-04-26T10:45:55.177751+0000","last_became_peered":"2024-04-26T10:45:55.177751+0000","last_unstale":"2024-04-26T10:46:48.508984+0000","last_undegraded":"2024-04-26T10:46:48.508984+0000","last_fullsized":"2024-04-26T10:46:48.508984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'442","last_scrub_stamp":"2024-04-26T10:46:48.508814+0000","last_deep_scrub":"63'442","last_deep_scrub_stamp":"2024-04-26T10:46:48.508814+0000","last_clean_scrub_stamp":"2024-04-26T10:46:48.508814+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:00.772322+0000","scrub_duration":0.0025059779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":34346,"num_write":406,"num_write_kb":96298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:59.508611+0000","last_change":"2024-04-26T10:46:59.508611+0000","last_active":"2024-04-26T10:46:59.508611+0000","last_peered":"2024-04-26T10:46:59.508611+0000","last_clean":"2024-04-26T10:46:59.508611+0000","last_became_active":"2024-04-26T10:45:45.871741+0000","last_became_peered":"2024-04-26T10:45:45.871741+0000","last_unstale":"2024-04-26T10:46:59.508611+0000","last_undegraded":"2024-04-26T10:46:59.508611+0000","last_fullsized":"2024-04-26T10:46:59.508611+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:46:59.508440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:46:59.508440+0000","last_clean_scrub_stamp":"2024-04-26T10:46:59.508440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:10.498353+0000","scrub_duration":0.0018823100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"84'103","reported_seq":233,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:28.024514+0000","last_change":"2024-04-26T10:47:28.024514+0000","last_active":"2024-04-26T10:47:28.024514+0000","last_peered":"2024-04-26T10:47:28.024514+0000","last_clean":"2024-04-26T10:47:28.024514+0000","last_became_active":"2024-04-26T10:45:56.160328+0000","last_became_peered":"2024-04-26T10:45:56.160328+0000","last_unstale":"2024-04-26T10:47:28.024514+0000","last_undegraded":"2024-04-26T10:47:28.024514+0000","last_fullsized":"2024-04-26T10:47:28.024514+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'103","last_scrub_stamp":"2024-04-26T10:47:28.024363+0000","last_deep_scrub":"84'103","last_deep_scrub_stamp":"2024-04-26T10:47:28.024363+0000","last_clean_scrub_stamp":"2024-04-26T10:47:28.024363+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:38.934942+0000","scrub_duration":0.0055471219999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1467631,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":44,"num_write_kb":1460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2935262,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"63'485","reported_seq":633,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:48:11.719744+0000","last_change":"2024-04-26T10:48:11.719880+0000","last_active":"2024-04-26T10:48:11.719744+0000","last_peered":"2024-04-26T10:48:11.719744+0000","last_clean":"2024-04-26T10:48:11.719744+0000","last_became_active":"2024-04-26T10:45:57.162752+0000","last_became_peered":"2024-04-26T10:45:57.162752+0000","last_unstale":"2024-04-26T10:48:11.719744+0000","last_undegraded":"2024-04-26T10:48:11.719744+0000","last_fullsized":"2024-04-26T10:48:11.719744+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'485","last_scrub_stamp":"2024-04-26T10:48:11.719722+0000","last_deep_scrub":"63'485","last_deep_scrub_stamp":"2024-04-26T10:48:11.719722+0000","last_clean_scrub_stamp":"2024-04-26T10:48:11.719722+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:41.774445+0000","scrub_duration":0.0025320759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":27703,"num_write":454,"num_write_kb":121509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:48.199307+0000","last_change":"2024-04-26T10:46:48.199307+0000","last_active":"2024-04-26T10:46:48.199307+0000","last_peered":"2024-04-26T10:46:48.199307+0000","last_clean":"2024-04-26T10:46:48.199307+0000","last_became_active":"2024-04-26T10:45:53.180675+0000","last_became_peered":"2024-04-26T10:45:53.180675+0000","last_unstale":"2024-04-26T10:46:48.199307+0000","last_undegraded":"2024-04-26T10:46:48.199307+0000","last_fullsized":"2024-04-26T10:46:48.199307+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:46:48.199158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:46:48.199158+0000","last_clean_scrub_stamp":"2024-04-26T10:46:48.199158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:51:28.631493+0000","scrub_duration":0.0016680530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"84'308","reported_seq":428,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:59.784023+0000","last_change":"2024-04-26T10:46:59.784129+0000","last_active":"2024-04-26T10:46:59.784023+0000","last_peered":"2024-04-26T10:46:59.784023+0000","last_clean":"2024-04-26T10:46:59.784023+0000","last_became_active":"2024-04-26T10:45:48.864763+0000","last_became_peered":"2024-04-26T10:45:48.864763+0000","last_unstale":"2024-04-26T10:46:59.784023+0000","last_undegraded":"2024-04-26T10:46:59.784023+0000","last_fullsized":"2024-04-26T10:46:59.784023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'308","last_scrub_stamp":"2024-04-26T10:46:59.784001+0000","last_deep_scrub":"84'308","last_deep_scrub_stamp":"2024-04-26T10:46:59.784001+0000","last_clean_scrub_stamp":"2024-04-26T10:46:59.784001+0000","objects_scrubbed":2,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:33.251239+0000","scrub_duration":0.014317998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"63'336","reported_seq":761,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:38.002814+0000","last_change":"2024-04-26T10:47:38.002814+0000","last_active":"2024-04-26T10:47:38.002814+0000","last_peered":"2024-04-26T10:47:38.002814+0000","last_clean":"2024-04-26T10:47:38.002814+0000","last_became_active":"2024-04-26T10:45:58.162320+0000","last_became_peered":"2024-04-26T10:45:58.162320+0000","last_unstale":"2024-04-26T10:47:38.002814+0000","last_undegraded":"2024-04-26T10:47:38.002814+0000","last_fullsized":"2024-04-26T10:47:38.002814+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'336","last_scrub_stamp":"2024-04-26T10:47:38.002662+0000","last_deep_scrub":"63'336","last_deep_scrub_stamp":"2024-04-26T10:47:38.002662+0000","last_clean_scrub_stamp":"2024-04-26T10:47:38.002662+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:42.263583+0000","scrub_duration":0.0026625630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12035,"num_write":314,"num_write_kb":29928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":306,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:32.654284+0000","last_change":"2024-04-26T10:47:32.654284+0000","last_active":"2024-04-26T10:47:32.654284+0000","last_peered":"2024-04-26T10:47:32.654284+0000","last_clean":"2024-04-26T10:47:32.654284+0000","last_became_active":"2024-04-26T10:45:45.860924+0000","last_became_peered":"2024-04-26T10:45:45.860924+0000","last_unstale":"2024-04-26T10:47:32.654284+0000","last_undegraded":"2024-04-26T10:47:32.654284+0000","last_fullsized":"2024-04-26T10:47:32.654284+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:47:32.654143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:47:32.654143+0000","last_clean_scrub_stamp":"2024-04-26T10:47:32.654143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:20.647001+0000","scrub_duration":0.0015127770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"62'64","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:34.677094+0000","last_change":"2024-04-26T10:47:34.677094+0000","last_active":"2024-04-26T10:47:34.677094+0000","last_peered":"2024-04-26T10:47:34.677094+0000","last_clean":"2024-04-26T10:47:34.677094+0000","last_became_active":"2024-04-26T10:45:45.860752+0000","last_became_peered":"2024-04-26T10:45:45.860752+0000","last_unstale":"2024-04-26T10:47:34.677094+0000","last_undegraded":"2024-04-26T10:47:34.677094+0000","last_fullsized":"2024-04-26T10:47:34.677094+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'64","last_scrub_stamp":"2024-04-26T10:47:34.676937+0000","last_deep_scrub":"62'64","last_deep_scrub_stamp":"2024-04-26T10:47:34.676937+0000","last_clean_scrub_stamp":"2024-04-26T10:47:34.676937+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:05.788359+0000","scrub_duration":0.001549861,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"63'421","reported_seq":526,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:10.204714+0000","last_change":"2024-04-26T10:47:10.204714+0000","last_active":"2024-04-26T10:47:10.204714+0000","last_peered":"2024-04-26T10:47:10.204714+0000","last_clean":"2024-04-26T10:47:10.204714+0000","last_became_active":"2024-04-26T10:45:54.185053+0000","last_became_peered":"2024-04-26T10:45:54.185053+0000","last_unstale":"2024-04-26T10:47:10.204714+0000","last_undegraded":"2024-04-26T10:47:10.204714+0000","last_fullsized":"2024-04-26T10:47:10.204714+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'421","last_scrub_stamp":"2024-04-26T10:47:10.204582+0000","last_deep_scrub":"63'421","last_deep_scrub_stamp":"2024-04-26T10:47:10.204582+0000","last_clean_scrub_stamp":"2024-04-26T10:47:10.204582+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:56.649265+0000","scrub_duration":0.0030152209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":28557,"num_write":385,"num_write_kb":93083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"84'481","reported_seq":567,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:49.689405+0000","last_change":"2024-04-26T10:47:49.689537+0000","last_active":"2024-04-26T10:47:49.689405+0000","last_peered":"2024-04-26T10:47:49.689405+0000","last_clean":"2024-04-26T10:47:49.689405+0000","last_became_active":"2024-04-26T10:45:48.862564+0000","last_became_peered":"2024-04-26T10:45:48.862564+0000","last_unstale":"2024-04-26T10:47:49.689405+0000","last_undegraded":"2024-04-26T10:47:49.689405+0000","last_fullsized":"2024-04-26T10:47:49.689405+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'481","last_scrub_stamp":"2024-04-26T10:47:49.689383+0000","last_deep_scrub":"84'481","last_deep_scrub_stamp":"2024-04-26T10:47:49.689383+0000","last_clean_scrub_stamp":"2024-04-26T10:47:49.689383+0000","objects_scrubbed":1,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:34.876789+0000","scrub_duration":0.0094079750000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":415,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:14.184935+0000","last_change":"2024-04-26T10:47:14.185031+0000","last_active":"2024-04-26T10:47:14.184935+0000","last_peered":"2024-04-26T10:47:14.184935+0000","last_clean":"2024-04-26T10:47:14.184935+0000","last_became_active":"2024-04-26T10:42:21.405336+0000","last_became_peered":"2024-04-26T10:42:21.405336+0000","last_unstale":"2024-04-26T10:47:14.184935+0000","last_undegraded":"2024-04-26T10:47:14.184935+0000","last_fullsized":"2024-04-26T10:47:14.184935+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:47:14.184915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:47:14.184915+0000","last_clean_scrub_stamp":"2024-04-26T10:47:14.184915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:43.653892+0000","scrub_duration":0.0016064040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"63'352","reported_seq":789,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:20.639969+0000","last_change":"2024-04-26T10:47:20.640088+0000","last_active":"2024-04-26T10:47:20.639969+0000","last_peered":"2024-04-26T10:47:20.639969+0000","last_clean":"2024-04-26T10:47:20.639969+0000","last_became_active":"2024-04-26T10:45:53.182454+0000","last_became_peered":"2024-04-26T10:45:53.182454+0000","last_unstale":"2024-04-26T10:47:20.639969+0000","last_undegraded":"2024-04-26T10:47:20.639969+0000","last_fullsized":"2024-04-26T10:47:20.639969+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'352","last_scrub_stamp":"2024-04-26T10:47:20.639947+0000","last_deep_scrub":"63'352","last_deep_scrub_stamp":"2024-04-26T10:47:20.639947+0000","last_clean_scrub_stamp":"2024-04-26T10:47:20.639947+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:15.753783+0000","scrub_duration":0.0025067420000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":1905,"num_write":313,"num_write_kb":25573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"62'59","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:32.065523+0000","last_change":"2024-04-26T10:46:32.065523+0000","last_active":"2024-04-26T10:46:32.065523+0000","last_peered":"2024-04-26T10:46:32.065523+0000","last_clean":"2024-04-26T10:46:32.065523+0000","last_became_active":"2024-04-26T10:45:53.176996+0000","last_became_peered":"2024-04-26T10:45:53.176996+0000","last_unstale":"2024-04-26T10:46:32.065523+0000","last_undegraded":"2024-04-26T10:46:32.065523+0000","last_fullsized":"2024-04-26T10:46:32.065523+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'59","last_scrub_stamp":"2024-04-26T10:46:32.065382+0000","last_deep_scrub":"62'59","last_deep_scrub_stamp":"2024-04-26T10:46:32.065382+0000","last_clean_scrub_stamp":"2024-04-26T10:46:32.065382+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:26.427635+0000","scrub_duration":0.0016833690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":101,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:48:03.652381+0000","last_change":"2024-04-26T10:48:03.652481+0000","last_active":"2024-04-26T10:48:03.652381+0000","last_peered":"2024-04-26T10:48:03.652381+0000","last_clean":"2024-04-26T10:48:03.652381+0000","last_became_active":"2024-04-26T10:45:53.174781+0000","last_became_peered":"2024-04-26T10:45:53.174781+0000","last_unstale":"2024-04-26T10:48:03.652381+0000","last_undegraded":"2024-04-26T10:48:03.652381+0000","last_fullsized":"2024-04-26T10:48:03.652381+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:48:03.652360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:48:03.652360+0000","last_clean_scrub_stamp":"2024-04-26T10:48:03.652360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:24.898673+0000","scrub_duration":0.0017836110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"63'408","reported_seq":920,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:31.846626+0000","last_change":"2024-04-26T10:46:31.846626+0000","last_active":"2024-04-26T10:46:31.846626+0000","last_peered":"2024-04-26T10:46:31.846626+0000","last_clean":"2024-04-26T10:46:31.846626+0000","last_became_active":"2024-04-26T10:45:54.185238+0000","last_became_peered":"2024-04-26T10:45:54.185238+0000","last_unstale":"2024-04-26T10:46:31.846626+0000","last_undegraded":"2024-04-26T10:46:31.846626+0000","last_fullsized":"2024-04-26T10:46:31.846626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'408","last_scrub_stamp":"2024-04-26T10:46:31.846485+0000","last_deep_scrub":"63'408","last_deep_scrub_stamp":"2024-04-26T10:46:31.846485+0000","last_clean_scrub_stamp":"2024-04-26T10:46:31.846485+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:36.109042+0000","scrub_duration":0.0024474840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":19939,"num_write":382,"num_write_kb":63433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"84'56","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:43.249602+0000","last_change":"2024-04-26T10:46:43.249602+0000","last_active":"2024-04-26T10:46:43.249602+0000","last_peered":"2024-04-26T10:46:43.249602+0000","last_clean":"2024-04-26T10:46:43.249602+0000","last_became_active":"2024-04-26T10:45:53.177305+0000","last_became_peered":"2024-04-26T10:45:53.177305+0000","last_unstale":"2024-04-26T10:46:43.249602+0000","last_undegraded":"2024-04-26T10:46:43.249602+0000","last_fullsized":"2024-04-26T10:46:43.249602+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'56","last_scrub_stamp":"2024-04-26T10:46:43.249467+0000","last_deep_scrub":"84'56","last_deep_scrub_stamp":"2024-04-26T10:46:43.249467+0000","last_clean_scrub_stamp":"2024-04-26T10:46:43.249467+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:52.720824+0000","scrub_duration":0.0031266789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:38.180572+0000","last_change":"2024-04-26T10:46:38.180572+0000","last_active":"2024-04-26T10:46:38.180572+0000","last_peered":"2024-04-26T10:46:38.180572+0000","last_clean":"2024-04-26T10:46:38.180572+0000","last_became_active":"2024-04-26T10:45:53.177249+0000","last_became_peered":"2024-04-26T10:45:53.177249+0000","last_unstale":"2024-04-26T10:46:38.180572+0000","last_undegraded":"2024-04-26T10:46:38.180572+0000","last_fullsized":"2024-04-26T10:46:38.180572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:46:38.180438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:46:38.180438+0000","last_clean_scrub_stamp":"2024-04-26T10:46:38.180438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:09.067544+0000","scrub_duration":0.00179721,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"63'418","reported_seq":890,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:04.180286+0000","last_change":"2024-04-26T10:47:04.180286+0000","last_active":"2024-04-26T10:47:04.180286+0000","last_peered":"2024-04-26T10:47:04.180286+0000","last_clean":"2024-04-26T10:47:04.180286+0000","last_became_active":"2024-04-26T10:45:56.160440+0000","last_became_peered":"2024-04-26T10:45:56.160440+0000","last_unstale":"2024-04-26T10:47:04.180286+0000","last_undegraded":"2024-04-26T10:47:04.180286+0000","last_fullsized":"2024-04-26T10:47:04.180286+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'418","last_scrub_stamp":"2024-04-26T10:47:04.180097+0000","last_deep_scrub":"63'418","last_deep_scrub_stamp":"2024-04-26T10:47:04.180097+0000","last_clean_scrub_stamp":"2024-04-26T10:47:04.180097+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:48.800820+0000","scrub_duration":0.0025539730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20110,"num_write":390,"num_write_kb":75171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"84'67","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:20.114217+0000","last_change":"2024-04-26T10:46:20.114217+0000","last_active":"2024-04-26T10:46:20.114217+0000","last_peered":"2024-04-26T10:46:20.114217+0000","last_clean":"2024-04-26T10:46:20.114217+0000","last_became_active":"2024-04-26T10:45:53.175946+0000","last_became_peered":"2024-04-26T10:45:53.175946+0000","last_unstale":"2024-04-26T10:46:20.114217+0000","last_undegraded":"2024-04-26T10:46:20.114217+0000","last_fullsized":"2024-04-26T10:46:20.114217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'67","last_scrub_stamp":"2024-04-26T10:46:20.114082+0000","last_deep_scrub":"84'67","last_deep_scrub_stamp":"2024-04-26T10:46:20.114082+0000","last_clean_scrub_stamp":"2024-04-26T10:46:20.114082+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:16.069289+0000","scrub_duration":0.00304288,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:50.702464+0000","last_change":"2024-04-26T10:47:50.702464+0000","last_active":"2024-04-26T10:47:50.702464+0000","last_peered":"2024-04-26T10:47:50.702464+0000","last_clean":"2024-04-26T10:47:50.702464+0000","last_became_active":"2024-04-26T10:45:45.871923+0000","last_became_peered":"2024-04-26T10:45:45.871923+0000","last_unstale":"2024-04-26T10:47:50.702464+0000","last_undegraded":"2024-04-26T10:47:50.702464+0000","last_fullsized":"2024-04-26T10:47:50.702464+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:47:50.702314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:47:50.702314+0000","last_clean_scrub_stamp":"2024-04-26T10:47:50.702314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:56.454895+0000","scrub_duration":0.001910105,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"63'404","reported_seq":934,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:27.939150+0000","last_change":"2024-04-26T10:46:27.939150+0000","last_active":"2024-04-26T10:46:27.939150+0000","last_peered":"2024-04-26T10:46:27.939150+0000","last_clean":"2024-04-26T10:46:27.939150+0000","last_became_active":"2024-04-26T10:45:54.181795+0000","last_became_peered":"2024-04-26T10:45:54.181795+0000","last_unstale":"2024-04-26T10:46:27.939150+0000","last_undegraded":"2024-04-26T10:46:27.939150+0000","last_fullsized":"2024-04-26T10:46:27.939150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'404","last_scrub_stamp":"2024-04-26T10:46:27.939009+0000","last_deep_scrub":"63'404","last_deep_scrub_stamp":"2024-04-26T10:46:27.939009+0000","last_clean_scrub_stamp":"2024-04-26T10:46:27.939009+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:43.424977+0000","scrub_duration":0.0025994030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":41262,"num_write":371,"num_write_kb":75820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"63'441","reported_seq":577,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:18.633141+0000","last_change":"2024-04-26T10:47:18.633141+0000","last_active":"2024-04-26T10:47:18.633141+0000","last_peered":"2024-04-26T10:47:18.633141+0000","last_clean":"2024-04-26T10:47:18.633141+0000","last_became_active":"2024-04-26T10:45:54.185862+0000","last_became_peered":"2024-04-26T10:45:54.185862+0000","last_unstale":"2024-04-26T10:47:18.633141+0000","last_undegraded":"2024-04-26T10:47:18.633141+0000","last_fullsized":"2024-04-26T10:47:18.633141+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'441","last_scrub_stamp":"2024-04-26T10:47:18.632997+0000","last_deep_scrub":"63'441","last_deep_scrub_stamp":"2024-04-26T10:47:18.632997+0000","last_clean_scrub_stamp":"2024-04-26T10:47:18.632997+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:05.485177+0000","scrub_duration":0.0027604090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31514,"num_write":408,"num_write_kb":107129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"84'437","reported_seq":539,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:48.684853+0000","last_change":"2024-04-26T10:47:48.684853+0000","last_active":"2024-04-26T10:47:48.684853+0000","last_peered":"2024-04-26T10:47:48.684853+0000","last_clean":"2024-04-26T10:47:48.684853+0000","last_became_active":"2024-04-26T10:45:48.865212+0000","last_became_peered":"2024-04-26T10:45:48.865212+0000","last_unstale":"2024-04-26T10:47:48.684853+0000","last_undegraded":"2024-04-26T10:47:48.684853+0000","last_fullsized":"2024-04-26T10:47:48.684853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'437","last_scrub_stamp":"2024-04-26T10:47:48.684672+0000","last_deep_scrub":"84'437","last_deep_scrub_stamp":"2024-04-26T10:47:48.684672+0000","last_clean_scrub_stamp":"2024-04-26T10:47:48.684672+0000","objects_scrubbed":6,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:21.823279+0000","scrub_duration":0.020050841999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9902610,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":9913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9896193,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"63'410","reported_seq":528,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:48:04.660505+0000","last_change":"2024-04-26T10:48:04.660505+0000","last_active":"2024-04-26T10:48:04.660505+0000","last_peered":"2024-04-26T10:48:04.660505+0000","last_clean":"2024-04-26T10:48:04.660505+0000","last_became_active":"2024-04-26T10:45:54.182167+0000","last_became_peered":"2024-04-26T10:45:54.182167+0000","last_unstale":"2024-04-26T10:48:04.660505+0000","last_undegraded":"2024-04-26T10:48:04.660505+0000","last_fullsized":"2024-04-26T10:48:04.660505+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'410","last_scrub_stamp":"2024-04-26T10:48:04.660332+0000","last_deep_scrub":"63'410","last_deep_scrub_stamp":"2024-04-26T10:48:04.660332+0000","last_clean_scrub_stamp":"2024-04-26T10:48:04.660332+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:43.874566+0000","scrub_duration":0.0028846290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12734,"num_write":373,"num_write_kb":34864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"84'86","reported_seq":198,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:03.871072+0000","last_change":"2024-04-26T10:47:03.871072+0000","last_active":"2024-04-26T10:47:03.871072+0000","last_peered":"2024-04-26T10:47:03.871072+0000","last_clean":"2024-04-26T10:47:03.871072+0000","last_became_active":"2024-04-26T10:45:45.874746+0000","last_became_peered":"2024-04-26T10:45:45.874746+0000","last_unstale":"2024-04-26T10:47:03.871072+0000","last_undegraded":"2024-04-26T10:47:03.871072+0000","last_fullsized":"2024-04-26T10:47:03.871072+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'86","last_scrub_stamp":"2024-04-26T10:47:03.870909+0000","last_deep_scrub":"84'86","last_deep_scrub_stamp":"2024-04-26T10:47:03.870909+0000","last_clean_scrub_stamp":"2024-04-26T10:47:03.870909+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:03:47.013205+0000","scrub_duration":0.0039681769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"84'333","reported_seq":433,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:14.252936+0000","last_change":"2024-04-26T10:46:14.252936+0000","last_active":"2024-04-26T10:46:14.252936+0000","last_peered":"2024-04-26T10:46:14.252936+0000","last_clean":"2024-04-26T10:46:14.252936+0000","last_became_active":"2024-04-26T10:45:56.161449+0000","last_became_peered":"2024-04-26T10:45:56.161449+0000","last_unstale":"2024-04-26T10:46:14.252936+0000","last_undegraded":"2024-04-26T10:46:14.252936+0000","last_fullsized":"2024-04-26T10:46:14.252936+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'333","last_scrub_stamp":"2024-04-26T10:46:14.252815+0000","last_deep_scrub":"84'333","last_deep_scrub_stamp":"2024-04-26T10:46:14.252815+0000","last_clean_scrub_stamp":"2024-04-26T10:46:14.252815+0000","objects_scrubbed":1,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:06.020647+0000","scrub_duration":0.0087233659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"63'487","reported_seq":1109,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:22.045006+0000","last_change":"2024-04-26T10:47:22.045108+0000","last_active":"2024-04-26T10:47:22.045006+0000","last_peered":"2024-04-26T10:47:22.045006+0000","last_clean":"2024-04-26T10:47:22.045006+0000","last_became_active":"2024-04-26T10:45:51.159235+0000","last_became_peered":"2024-04-26T10:45:51.159235+0000","last_unstale":"2024-04-26T10:47:22.045006+0000","last_undegraded":"2024-04-26T10:47:22.045006+0000","last_fullsized":"2024-04-26T10:47:22.045006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'487","last_scrub_stamp":"2024-04-26T10:47:22.044982+0000","last_deep_scrub":"63'487","last_deep_scrub_stamp":"2024-04-26T10:47:22.044982+0000","last_clean_scrub_stamp":"2024-04-26T10:47:22.044982+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:17:31.153345+0000","scrub_duration":0.0026463189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":43316,"num_write":468,"num_write_kb":77062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"62'61","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:11.105133+0000","last_change":"2024-04-26T10:46:11.105133+0000","last_active":"2024-04-26T10:46:11.105133+0000","last_peered":"2024-04-26T10:46:11.105133+0000","last_clean":"2024-04-26T10:46:11.105133+0000","last_became_active":"2024-04-26T10:45:53.173851+0000","last_became_peered":"2024-04-26T10:45:53.173851+0000","last_unstale":"2024-04-26T10:46:11.105133+0000","last_undegraded":"2024-04-26T10:46:11.105133+0000","last_fullsized":"2024-04-26T10:46:11.105133+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'61","last_scrub_stamp":"2024-04-26T10:46:11.105005+0000","last_deep_scrub":"62'61","last_deep_scrub_stamp":"2024-04-26T10:46:11.105005+0000","last_clean_scrub_stamp":"2024-04-26T10:46:11.105005+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:57.257799+0000","scrub_duration":0.0016999000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"63'457","reported_seq":549,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:47.224014+0000","last_change":"2024-04-26T10:46:47.224014+0000","last_active":"2024-04-26T10:46:47.224014+0000","last_peered":"2024-04-26T10:46:47.224014+0000","last_clean":"2024-04-26T10:46:47.224014+0000","last_became_active":"2024-04-26T10:45:54.189622+0000","last_became_peered":"2024-04-26T10:45:54.189622+0000","last_unstale":"2024-04-26T10:46:47.224014+0000","last_undegraded":"2024-04-26T10:46:47.224014+0000","last_fullsized":"2024-04-26T10:46:47.224014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'457","last_scrub_stamp":"2024-04-26T10:46:47.223873+0000","last_deep_scrub":"63'457","last_deep_scrub_stamp":"2024-04-26T10:46:47.223873+0000","last_clean_scrub_stamp":"2024-04-26T10:46:47.223873+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:53:33.293955+0000","scrub_duration":0.003282943,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":14848,"num_write":427,"num_write_kb":71903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"63'377","reported_seq":851,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:29.894860+0000","last_change":"2024-04-26T10:46:29.894860+0000","last_active":"2024-04-26T10:46:29.894860+0000","last_peered":"2024-04-26T10:46:29.894860+0000","last_clean":"2024-04-26T10:46:29.894860+0000","last_became_active":"2024-04-26T10:45:49.866707+0000","last_became_peered":"2024-04-26T10:45:49.866707+0000","last_unstale":"2024-04-26T10:46:29.894860+0000","last_undegraded":"2024-04-26T10:46:29.894860+0000","last_fullsized":"2024-04-26T10:46:29.894860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'377","last_scrub_stamp":"2024-04-26T10:46:29.894727+0000","last_deep_scrub":"63'377","last_deep_scrub_stamp":"2024-04-26T10:46:29.894727+0000","last_clean_scrub_stamp":"2024-04-26T10:46:29.894727+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:20.517004+0000","scrub_duration":0.0019921740000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":26932,"num_write":349,"num_write_kb":55611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"84'564","reported_seq":658,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:21.029077+0000","last_change":"2024-04-26T10:47:21.029194+0000","last_active":"2024-04-26T10:47:21.029077+0000","last_peered":"2024-04-26T10:47:21.029077+0000","last_clean":"2024-04-26T10:47:21.029077+0000","last_became_active":"2024-04-26T10:42:25.683467+0000","last_became_peered":"2024-04-26T10:42:25.683467+0000","last_unstale":"2024-04-26T10:47:21.029077+0000","last_undegraded":"2024-04-26T10:47:21.029077+0000","last_fullsized":"2024-04-26T10:47:21.029077+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'564","last_scrub_stamp":"2024-04-26T10:47:21.029056+0000","last_deep_scrub":"84'564","last_deep_scrub_stamp":"2024-04-26T10:47:21.029056+0000","last_clean_scrub_stamp":"2024-04-26T10:47:21.029056+0000","objects_scrubbed":2,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:57.701118+0000","scrub_duration":0.016487087000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":8440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"63'425","reported_seq":891,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:26.996171+0000","last_change":"2024-04-26T10:47:26.996171+0000","last_active":"2024-04-26T10:47:26.996171+0000","last_peered":"2024-04-26T10:47:26.996171+0000","last_clean":"2024-04-26T10:47:26.996171+0000","last_became_active":"2024-04-26T10:45:56.161315+0000","last_became_peered":"2024-04-26T10:45:56.161315+0000","last_unstale":"2024-04-26T10:47:26.996171+0000","last_undegraded":"2024-04-26T10:47:26.996171+0000","last_fullsized":"2024-04-26T10:47:26.996171+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'425","last_scrub_stamp":"2024-04-26T10:47:26.996045+0000","last_deep_scrub":"63'425","last_deep_scrub_stamp":"2024-04-26T10:47:26.996045+0000","last_clean_scrub_stamp":"2024-04-26T10:47:26.996045+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:14.103578+0000","scrub_duration":0.002384251,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":19004,"num_write":390,"num_write_kb":75524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"84'260","reported_seq":345,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:31.083683+0000","last_change":"2024-04-26T10:47:31.083683+0000","last_active":"2024-04-26T10:47:31.083683+0000","last_peered":"2024-04-26T10:47:31.083683+0000","last_clean":"2024-04-26T10:47:31.083683+0000","last_became_active":"2024-04-26T10:45:56.160344+0000","last_became_peered":"2024-04-26T10:45:56.160344+0000","last_unstale":"2024-04-26T10:47:31.083683+0000","last_undegraded":"2024-04-26T10:47:31.083683+0000","last_fullsized":"2024-04-26T10:47:31.083683+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'260","last_scrub_stamp":"2024-04-26T10:47:31.083562+0000","last_deep_scrub":"84'260","last_deep_scrub_stamp":"2024-04-26T10:47:31.083562+0000","last_clean_scrub_stamp":"2024-04-26T10:47:31.083562+0000","objects_scrubbed":1,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:15.212393+0000","scrub_duration":0.0092315850000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"63'418","reported_seq":942,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:41.881058+0000","last_change":"2024-04-26T10:46:41.881058+0000","last_active":"2024-04-26T10:46:41.881058+0000","last_peered":"2024-04-26T10:46:41.881058+0000","last_clean":"2024-04-26T10:46:41.881058+0000","last_became_active":"2024-04-26T10:45:55.178079+0000","last_became_peered":"2024-04-26T10:45:55.178079+0000","last_unstale":"2024-04-26T10:46:41.881058+0000","last_undegraded":"2024-04-26T10:46:41.881058+0000","last_fullsized":"2024-04-26T10:46:41.881058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'418","last_scrub_stamp":"2024-04-26T10:46:41.880550+0000","last_deep_scrub":"63'418","last_deep_scrub_stamp":"2024-04-26T10:46:41.880550+0000","last_clean_scrub_stamp":"2024-04-26T10:46:41.880550+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:06:37.113070+0000","scrub_duration":0.0024544520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":34476,"num_write":379,"num_write_kb":101645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"84'497","reported_seq":591,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:05.841910+0000","last_change":"2024-04-26T10:47:05.841910+0000","last_active":"2024-04-26T10:47:05.841910+0000","last_peered":"2024-04-26T10:47:05.841910+0000","last_clean":"2024-04-26T10:47:05.841910+0000","last_became_active":"2024-04-26T10:42:25.687829+0000","last_became_peered":"2024-04-26T10:42:25.687829+0000","last_unstale":"2024-04-26T10:47:05.841910+0000","last_undegraded":"2024-04-26T10:47:05.841910+0000","last_fullsized":"2024-04-26T10:47:05.841910+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'497","last_scrub_stamp":"2024-04-26T10:47:05.841747+0000","last_deep_scrub":"84'497","last_deep_scrub_stamp":"2024-04-26T10:47:05.841747+0000","last_clean_scrub_stamp":"2024-04-26T10:47:05.841747+0000","objects_scrubbed":3,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:04.414657+0000","scrub_duration":0.021777650999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":426,"num_write_kb":12543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"63'406","reported_seq":599,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:28.675106+0000","last_change":"2024-04-26T10:47:28.675106+0000","last_active":"2024-04-26T10:47:28.675106+0000","last_peered":"2024-04-26T10:47:28.675106+0000","last_clean":"2024-04-26T10:47:28.675106+0000","last_became_active":"2024-04-26T10:45:54.189591+0000","last_became_peered":"2024-04-26T10:45:54.189591+0000","last_unstale":"2024-04-26T10:47:28.675106+0000","last_undegraded":"2024-04-26T10:47:28.675106+0000","last_fullsized":"2024-04-26T10:47:28.675106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'406","last_scrub_stamp":"2024-04-26T10:47:28.674971+0000","last_deep_scrub":"63'406","last_deep_scrub_stamp":"2024-04-26T10:47:28.674971+0000","last_clean_scrub_stamp":"2024-04-26T10:47:28.674971+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:00.503759+0000","scrub_duration":0.0032453080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":45941,"num_write":372,"num_write_kb":80011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"84'62","reported_seq":174,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:06.870273+0000","last_change":"2024-04-26T10:47:06.870273+0000","last_active":"2024-04-26T10:47:06.870273+0000","last_peered":"2024-04-26T10:47:06.870273+0000","last_clean":"2024-04-26T10:47:06.870273+0000","last_became_active":"2024-04-26T10:45:45.874300+0000","last_became_peered":"2024-04-26T10:45:45.874300+0000","last_unstale":"2024-04-26T10:47:06.870273+0000","last_undegraded":"2024-04-26T10:47:06.870273+0000","last_fullsized":"2024-04-26T10:47:06.870273+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'62","last_scrub_stamp":"2024-04-26T10:47:06.870147+0000","last_deep_scrub":"84'62","last_deep_scrub_stamp":"2024-04-26T10:47:06.870147+0000","last_clean_scrub_stamp":"2024-04-26T10:47:06.870147+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:21:46.778599+0000","scrub_duration":0.0095987950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"63'375","reported_seq":836,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:19.295289+0000","last_change":"2024-04-26T10:46:19.295289+0000","last_active":"2024-04-26T10:46:19.295289+0000","last_peered":"2024-04-26T10:46:19.295289+0000","last_clean":"2024-04-26T10:46:19.295289+0000","last_became_active":"2024-04-26T10:45:56.160416+0000","last_became_peered":"2024-04-26T10:45:56.160416+0000","last_unstale":"2024-04-26T10:46:19.295289+0000","last_undegraded":"2024-04-26T10:46:19.295289+0000","last_fullsized":"2024-04-26T10:46:19.295289+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'375","last_scrub_stamp":"2024-04-26T10:46:19.295138+0000","last_deep_scrub":"63'375","last_deep_scrub_stamp":"2024-04-26T10:46:19.295138+0000","last_clean_scrub_stamp":"2024-04-26T10:46:19.295138+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:58.675348+0000","scrub_duration":0.0023697280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16213,"num_write":354,"num_write_kb":54493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":332,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"84'278","reported_seq":383,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:12.320242+0000","last_change":"2024-04-26T10:46:12.320242+0000","last_active":"2024-04-26T10:46:12.320242+0000","last_peered":"2024-04-26T10:46:12.320242+0000","last_clean":"2024-04-26T10:46:12.320242+0000","last_became_active":"2024-04-26T10:45:56.160414+0000","last_became_peered":"2024-04-26T10:45:56.160414+0000","last_unstale":"2024-04-26T10:46:12.320242+0000","last_undegraded":"2024-04-26T10:46:12.320242+0000","last_fullsized":"2024-04-26T10:46:12.320242+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'278","last_scrub_stamp":"2024-04-26T10:46:12.320120+0000","last_deep_scrub":"84'278","last_deep_scrub_stamp":"2024-04-26T10:46:12.320120+0000","last_clean_scrub_stamp":"2024-04-26T10:46:12.320120+0000","objects_scrubbed":2,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:17:48.308771+0000","scrub_duration":0.0082694940000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"63'379","reported_seq":488,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:47:57.638801+0000","last_change":"2024-04-26T10:47:57.638801+0000","last_active":"2024-04-26T10:47:57.638801+0000","last_peered":"2024-04-26T10:47:57.638801+0000","last_clean":"2024-04-26T10:47:57.638801+0000","last_became_active":"2024-04-26T10:45:53.173645+0000","last_became_peered":"2024-04-26T10:45:53.173645+0000","last_unstale":"2024-04-26T10:47:57.638801+0000","last_undegraded":"2024-04-26T10:47:57.638801+0000","last_fullsized":"2024-04-26T10:47:57.638801+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'379","last_scrub_stamp":"2024-04-26T10:47:57.638672+0000","last_deep_scrub":"63'379","last_deep_scrub_stamp":"2024-04-26T10:47:57.638672+0000","last_clean_scrub_stamp":"2024-04-26T10:47:57.638672+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:22.872709+0000","scrub_duration":0.0025599630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":20480,"num_write":343,"num_write_kb":25788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"84'241","reported_seq":364,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:58.793068+0000","last_change":"2024-04-26T10:46:58.793068+0000","last_active":"2024-04-26T10:46:58.793068+0000","last_peered":"2024-04-26T10:46:58.793068+0000","last_clean":"2024-04-26T10:46:58.793068+0000","last_became_active":"2024-04-26T10:45:48.866716+0000","last_became_peered":"2024-04-26T10:45:48.866716+0000","last_unstale":"2024-04-26T10:46:58.793068+0000","last_undegraded":"2024-04-26T10:46:58.793068+0000","last_fullsized":"2024-04-26T10:46:58.793068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'241","last_scrub_stamp":"2024-04-26T10:46:58.792919+0000","last_deep_scrub":"84'241","last_deep_scrub_stamp":"2024-04-26T10:46:58.792919+0000","last_clean_scrub_stamp":"2024-04-26T10:46:58.792919+0000","objects_scrubbed":4,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:35.543499+0000","scrub_duration":0.021440362000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":12393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"63'419","reported_seq":583,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:54.737707+0000","last_change":"2024-04-26T10:46:54.737707+0000","last_active":"2024-04-26T10:46:54.737707+0000","last_peered":"2024-04-26T10:46:54.737707+0000","last_clean":"2024-04-26T10:46:54.737707+0000","last_became_active":"2024-04-26T10:42:26.040504+0000","last_became_peered":"2024-04-26T10:42:26.040504+0000","last_unstale":"2024-04-26T10:46:54.737707+0000","last_undegraded":"2024-04-26T10:46:54.737707+0000","last_fullsized":"2024-04-26T10:46:54.737707+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'419","last_scrub_stamp":"2024-04-26T10:46:54.737548+0000","last_deep_scrub":"63'419","last_deep_scrub_stamp":"2024-04-26T10:46:54.737548+0000","last_clean_scrub_stamp":"2024-04-26T10:46:54.737548+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:36.073071+0000","scrub_duration":0.0037174790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":39582,"num_write":378,"num_write_kb":54867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"84'62","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:09.103560+0000","last_change":"2024-04-26T10:46:09.103560+0000","last_active":"2024-04-26T10:46:09.103560+0000","last_peered":"2024-04-26T10:46:09.103560+0000","last_clean":"2024-04-26T10:46:09.103560+0000","last_became_active":"2024-04-26T10:45:53.178804+0000","last_became_peered":"2024-04-26T10:45:53.178804+0000","last_unstale":"2024-04-26T10:46:09.103560+0000","last_undegraded":"2024-04-26T10:46:09.103560+0000","last_fullsized":"2024-04-26T10:46:09.103560+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'62","last_scrub_stamp":"2024-04-26T10:46:09.103432+0000","last_deep_scrub":"84'62","last_deep_scrub_stamp":"2024-04-26T10:46:09.103432+0000","last_clean_scrub_stamp":"2024-04-26T10:46:09.103432+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:25.007335+0000","scrub_duration":0.00814082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"63'437","reported_seq":536,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:18.251026+0000","last_change":"2024-04-26T10:46:18.251026+0000","last_active":"2024-04-26T10:46:18.251026+0000","last_peered":"2024-04-26T10:46:18.251026+0000","last_clean":"2024-04-26T10:46:18.251026+0000","last_became_active":"2024-04-26T10:45:53.177071+0000","last_became_peered":"2024-04-26T10:45:53.177071+0000","last_unstale":"2024-04-26T10:46:18.251026+0000","last_undegraded":"2024-04-26T10:46:18.251026+0000","last_fullsized":"2024-04-26T10:46:18.251026+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'437","last_scrub_stamp":"2024-04-26T10:46:18.250898+0000","last_deep_scrub":"63'437","last_deep_scrub_stamp":"2024-04-26T10:46:18.250898+0000","last_clean_scrub_stamp":"2024-04-26T10:46:18.250898+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:10.767270+0000","scrub_duration":0.002104093,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":7562,"num_write":400,"num_write_kb":26121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"84'61","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T10:46:25.042141+0000","last_change":"2024-04-26T10:46:25.042141+0000","last_active":"2024-04-26T10:46:25.042141+0000","last_peered":"2024-04-26T10:46:25.042141+0000","last_clean":"2024-04-26T10:46:25.042141+0000","last_became_active":"2024-04-26T10:45:53.173542+0000","last_became_peered":"2024-04-26T10:45:53.173542+0000","last_unstale":"2024-04-26T10:46:25.042141+0000","last_undegraded":"2024-04-26T10:46:25.042141+0000","last_fullsized":"2024-04-26T10:46:25.042141+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'61","last_scrub_stamp":"2024-04-26T10:46:25.041995+0000","last_deep_scrub":"84'61","last_deep_scrub_stamp":"2024-04-26T10:46:25.041995+0000","last_clean_scrub_stamp":"2024-04-26T10:46:25.041995+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:44:18.722171+0000","scrub_duration":0.010280186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":4195468,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2672,"num_read_kb":1454712,"num_write":24538,"num_write_kb":4190103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9206,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26671,"ondisk_log_size":26671,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128811551,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":44,"num_read_kb":1460,"num_write":5770,"num_write_kb":129888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":130273221,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":257691648,"data_stored":257623102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},"log_size":7648,"ondisk_log_size":7648,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738445,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187500,"kb_used_data":80164,"kb_used_omap":1,"kb_used_meta":107326,"kb_avail":94184340,"statfs":{"total":96636764160,"available":96444764160,"internally_reserved":0,"allocated":82087936,"data_stored":81566103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109902278},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:47:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.42799999999999999,"15min":0.433},"min":{"1min":0.34699999999999998,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.58899999999999997,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.433,"15min":0.438},"min":{"1min":0.34799999999999998,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.66300000000000003}]},{"osd":1,"last update":"Fri Apr 26 10:47:51 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45300000000000001,"15min":0.45000000000000001},"min":{"1min":0.36899999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.58999999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.621},{"interface":"front","average":{"1min":0.496,"5min":0.46100000000000002,"15min":0.45500000000000002},"min":{"1min":0.35799999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.63200000000000001,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.55200000000000005}]}]},{"osd":1,"up_from":70,"seq":300647710755,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140112,"kb_used_data":90440,"kb_used_omap":7,"kb_used_meta":49656,"kb_avail":94231728,"statfs":{"total":96636764160,"available":96493289472,"internally_reserved":0,"allocated":92610560,"data_stored":92059263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7181,"internal_metadata":50848755},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.45000000000000001,"15min":0.44700000000000001},"min":{"1min":0.34699999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.56200000000000006,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.44900000000000001,"15min":0.443},"min":{"1min":0.318,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.56399999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.49099999999999999}]},{"osd":2,"last update":"Fri Apr 26 10:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.45400000000000001,"15min":0.44700000000000001},"min":{"1min":0.33500000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.63100000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.46000000000000002},"min":{"1min":0.30499999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.64200000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.52100000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214376,"kb_used_data":84896,"kb_used_omap":1,"kb_used_meta":129470,"kb_avail":94157464,"statfs":{"total":96636764160,"available":96417243136,"internally_reserved":0,"allocated":86933504,"data_stored":86396712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132577734},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.41999999999999998,"15min":0.41199999999999998},"min":{"1min":0.36599999999999999,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.42299999999999999,"15min":0.41299999999999998},"min":{"1min":0.36199999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.57999999999999996}]},{"osd":2,"last update":"Fri Apr 26 10:47:29 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.438,"15min":0.45200000000000001},"min":{"1min":0.38,"5min":0.183,"15min":0.183},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.44400000000000001,"15min":0.46600000000000003},"min":{"1min":0.38,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.69299999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.50600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":85422080,"data_stored":85400264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":91099136,"data_stored":91062815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5587,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81170432,"data_stored":81160023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:48:30.555 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T10:48:30.900 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T10:48:30.900 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T10:48:31.226 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:48:31.226 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T10:42:26.028204+0000","modified":"2024-04-26T10:42:28.033502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4218":{"gid":4218,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6803/4129035646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":4129035646},{"type":"v1","addr":"172.21.15.49:6803","nonce":4129035646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T10:48:31.226 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 5 2024-04-26T10:48:31.239 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T10:48:31.565 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:48:31.565 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T10:42:26.028204+0000","modified":"2024-04-26T10:42:28.033502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4218":{"gid":4218,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.49:6803/4129035646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":4129035646},{"type":"v1","addr":"172.21.15.49:6803","nonce":4129035646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T10:48:31.565 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 5 2024-04-26T10:48:31.578 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:48:31.878 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-04-26T10:48:31.878 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":84,"fsid":"9837de44-a9e8-4979-adc4-611f3ddc44ce","created":"2024-04-26T10:42:11.337159+0000","modified":"2024-04-26T10:45:58.156434+0000","last_up_change":"2024-04-26T10:45:44.834285+0000","last_in_change":"2024-04-26T10:42:12.136647+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:42:19.632084+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:42:19.779089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:42:24.266614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:42:25.014684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eabed31c-c043-43de-a756-e217d5287116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":28839},{"type":"v1","addr":"172.21.15.60:6801","nonce":28839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":28839},{"type":"v1","addr":"172.21.15.60:6803","nonce":28839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":28839},{"type":"v1","addr":"172.21.15.60:6807","nonce":28839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":28839},{"type":"v1","addr":"172.21.15.60:6805","nonce":28839}]},"public_addr":"172.21.15.60:6801/28839","cluster_addr":"172.21.15.60:6803/28839","heartbeat_back_addr":"172.21.15.60:6807/28839","heartbeat_front_addr":"172.21.15.60:6805/28839","state":["exists","up"]},{"osd":1,"uuid":"7013621f-db09-4096-bc24-428bb170edd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":25,"up_from":70,"up_thru":83,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":5359},{"type":"v1","addr":"172.21.15.87:6801","nonce":5359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":5359},{"type":"v1","addr":"172.21.15.87:6803","nonce":5359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":5359},{"type":"v1","addr":"172.21.15.87:6807","nonce":5359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":5359},{"type":"v1","addr":"172.21.15.87:6805","nonce":5359}]},"public_addr":"172.21.15.87:6801/5359","cluster_addr":"172.21.15.87:6803/5359","heartbeat_back_addr":"172.21.15.87:6807/5359","heartbeat_front_addr":"172.21.15.87:6805/5359","state":["exists","up"]},{"osd":2,"uuid":"a1efeadd-cf55-4ed5-9918-36607fd62229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":28733},{"type":"v1","addr":"172.21.15.195:6801","nonce":28733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":28733},{"type":"v1","addr":"172.21.15.195:6803","nonce":28733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":28733},{"type":"v1","addr":"172.21.15.195:6807","nonce":28733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":28733},{"type":"v1","addr":"172.21.15.195:6805","nonce":28733}]},"public_addr":"172.21.15.195:6801/28733","cluster_addr":"172.21.15.195:6803/28733","heartbeat_back_addr":"172.21.15.195:6807/28733","heartbeat_front_addr":"172.21.15.195:6805/28733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.152046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.177399+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:42:17.123066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":0,"to":1}]},{"pgid":"4.6","mappings":[{"from":0,"to":1}]},{"pgid":"4.12","mappings":[{"from":2,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:48:31.893 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T10:48:32.227 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T10:48:32.240 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T10:48:32.264 INFO:tasks.ceph.mds.a.smithi049.stdout:starting mds.a at 2024-04-26T10:48:33.243 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T10:48:34.233 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-04-26T10:48:34.247 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T10:48:35.233 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-04-26T10:48:35.249 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T10:48:35.249 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T10:48:35.250 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:48:35.260 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T10:48:35.260 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T10:48:35.260 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T10:48:35.261 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:48:35.306 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T10:48:35.306 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T10:48:35.307 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:48:35.337 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T10:48:35.338 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T10:48:35.338 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:48:35.381 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T10:48:35.381 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T10:48:35.381 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T10:48:35.381 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:48:35.408 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T10:48:35.409 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T10:48:35.409 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:48:35.474 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T10:48:35.474 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T10:48:35.474 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T10:48:35.474 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:48:35.526 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T10:48:35.527 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T10:48:35.527 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:48:35.578 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T10:48:35.578 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T10:48:35.579 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:48:35.630 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T10:48:35.630 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T10:48:35.630 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2024-04-26T10:48:35.701 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi060.front.sepia.ceph.com 2024-04-26T10:48:35.701 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T10:48:35.850 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi087.front.sepia.ceph.com 2024-04-26T10:48:35.850 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T10:48:35.961 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-26T10:48:35.962 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T10:48:36.241 INFO:tasks.ceph:Archiving mon data... 2024-04-26T10:48:36.242 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674130/data/mon.a.tgz 2024-04-26T10:48:36.243 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2024-04-26T10:48:36.261 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.075YH8v7ic 2024-04-26T10:48:36.262 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.075YH8v7ic 2024-04-26T10:48:36.413 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.075YH8v7ic 2024-04-26T10:48:36.497 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.075YH8v7ic is 409KB 2024-04-26T10:48:36.593 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.075YH8v7ic 2024-04-26T10:48:36.608 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674130/data/mon.b.tgz 2024-04-26T10:48:36.608 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2024-04-26T10:48:36.663 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.ojOeVbO6Gv 2024-04-26T10:48:36.663 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ojOeVbO6Gv 2024-04-26T10:48:36.841 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.ojOeVbO6Gv 2024-04-26T10:48:36.924 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.ojOeVbO6Gv is 561KB 2024-04-26T10:48:37.022 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.ojOeVbO6Gv 2024-04-26T10:48:37.036 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674130/data/mon.c.tgz 2024-04-26T10:48:37.037 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2024-04-26T10:48:37.090 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.GN4DTndvI9 2024-04-26T10:48:37.091 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.GN4DTndvI9 2024-04-26T10:48:37.269 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.GN4DTndvI9 2024-04-26T10:48:37.351 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.GN4DTndvI9 is 561KB 2024-04-26T10:48:37.450 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.GN4DTndvI9 2024-04-26T10:48:37.465 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T10:48:37.465 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T10:48:37.507 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T10:48:37.510 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T10:48:37.512 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T10:48:37.556 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-26T10:48:37.556 DEBUG:teuthology.orchestra.run.smithi049:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T10:48:37.572 DEBUG:teuthology.orchestra.run.smithi060:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T10:48:37.579 DEBUG:teuthology.orchestra.run.smithi087:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T10:48:37.581 DEBUG:teuthology.orchestra.run.smithi195:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T10:48:37.596 INFO:teuthology.orchestra.run.smithi049.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T10:48:37.608 INFO:teuthology.orchestra.run.smithi060.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T10:48:37.612 INFO:teuthology.orchestra.run.smithi195.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T10:48:37.617 INFO:teuthology.orchestra.run.smithi087.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T10:48:37.623 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T10:48:37.624 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674130/remote/smithi049/crash 2024-04-26T10:48:37.625 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T10:48:37.665 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674130/remote/smithi060/crash 2024-04-26T10:48:37.666 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T10:48:37.709 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674130/remote/smithi087/crash 2024-04-26T10:48:37.710 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T10:48:37.750 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674130/remote/smithi195/crash 2024-04-26T10:48:37.751 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T10:48:37.788 INFO:tasks.ceph:Compressing logs... 2024-04-26T10:48:37.788 DEBUG:teuthology.orchestra.run.smithi049:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:48:37.790 DEBUG:teuthology.orchestra.run.smithi060:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:48:37.793 DEBUG:teuthology.orchestra.run.smithi087:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:48:37.795 DEBUG:teuthology.orchestra.run.smithi195:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:48:46.989 INFO:tasks.ceph:Archiving logs... 2024-04-26T10:48:46.989 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674130/remote/smithi049/log 2024-04-26T10:48:46.991 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T10:48:47.308 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674130/remote/smithi060/log 2024-04-26T10:48:47.309 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T10:48:48.298 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674130/remote/smithi087/log 2024-04-26T10:48:48.299 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T10:48:48.476 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674130/remote/smithi195/log 2024-04-26T10:48:48.477 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T10:48:49.036 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T10:48:49.045 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T10:48:49.046 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T10:48:49.049 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T10:48:49.051 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T10:48:49.054 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T10:48:49.187 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T10:48:49.197 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T10:48:49.197 DEBUG:teuthology.orchestra.run.smithi049:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T10:48:49.200 DEBUG:teuthology.orchestra.run.smithi060:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T10:48:49.202 DEBUG:teuthology.orchestra.run.smithi087:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T10:48:49.205 DEBUG:teuthology.orchestra.run.smithi195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T10:48:49.214 INFO:teuthology.orchestra.run.smithi049.stderr:bash: line 1: ntpq: command not found 2024-04-26T10:48:49.217 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-04-26T10:48:49.219 INFO:teuthology.orchestra.run.smithi049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T10:48:49.219 INFO:teuthology.orchestra.run.smithi049.stdout:=============================================================================== 2024-04-26T10:48:49.219 INFO:teuthology.orchestra.run.smithi049.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 56 +875us[ +875us] +/- 42ms 2024-04-26T10:48:49.219 INFO:teuthology.orchestra.run.smithi049.stdout:^* hv02.front.sepia.ceph.com 3 6 377 58 -2018us[-1921us] +/- 59ms 2024-04-26T10:48:49.219 INFO:teuthology.orchestra.run.smithi049.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 58 +1222us[+1318us] +/- 79ms 2024-04-26T10:48:49.220 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:48:49.220 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2024-04-26T10:48:49.220 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: ntpq: command not found 2024-04-26T10:48:49.221 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T10:48:49.221 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-04-26T10:48:49.221 INFO:teuthology.orchestra.run.smithi060.stdout:^* hv01.front.sepia.ceph.com 3 6 377 57 +883us[ +914us] +/- 42ms 2024-04-26T10:48:49.222 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 56 -2010us[-2010us] +/- 59ms 2024-04-26T10:48:49.222 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 57 +1224us[+1224us] +/- 79ms 2024-04-26T10:48:49.222 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:48:49.223 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T10:48:49.223 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-04-26T10:48:49.223 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv01.front.sepia.ceph.com 3 6 177 1 +810us[ +813us] +/- 42ms 2024-04-26T10:48:49.223 INFO:teuthology.orchestra.run.smithi087.stdout:^* hv02.front.sepia.ceph.com 3 6 177 0 -2062us[-2059us] +/- 60ms 2024-04-26T10:48:49.223 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv03.front.sepia.ceph.com 3 6 77 65 +1149us[+1145us] +/- 79ms 2024-04-26T10:48:49.223 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:48:49.225 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T10:48:49.225 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-04-26T10:48:49.225 INFO:teuthology.orchestra.run.smithi195.stdout:^* hv01.front.sepia.ceph.com 3 6 377 57 +897us[ +916us] +/- 42ms 2024-04-26T10:48:49.225 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 57 -2006us[-1988us] +/- 59ms 2024-04-26T10:48:49.225 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 57 +1224us[+1243us] +/- 79ms 2024-04-26T10:48:49.225 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:48:49.226 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T10:48:49.235 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T10:48:49.235 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T10:48:49.256 DEBUG:teuthology.orchestra.run.smithi049:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T10:48:49.332 DEBUG:teuthology.orchestra.run.smithi060:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T10:48:49.405 DEBUG:teuthology.orchestra.run.smithi087:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T10:48:49.544 DEBUG:teuthology.orchestra.run.smithi195:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T10:48:49.616 DEBUG:teuthology.orchestra.run.smithi049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T10:48:49.648 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:48:49.649 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T10:48:49.681 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:48:49.682 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T10:48:49.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:48:49.712 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T10:48:49.740 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:48:49.741 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T10:48:49.751 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T10:48:49.791 INFO:teuthology.task.internal:Duration was 734.234961 seconds 2024-04-26T10:48:49.791 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T10:48:49.824 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T10:48:49.824 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T10:48:49.827 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T10:48:49.829 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T10:48:49.832 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T10:48:49.869 INFO:teuthology.orchestra.run.smithi049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T10:48:49.871 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T10:48:49.871 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T10:48:49.900 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T10:48:50.180 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T10:48:50.180 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi049.front.sepia.ceph.com 2024-04-26T10:48:50.180 DEBUG:teuthology.orchestra.run.smithi049:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T10:48:50.206 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi060.front.sepia.ceph.com 2024-04-26T10:48:50.206 DEBUG:teuthology.orchestra.run.smithi060:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T10:48:50.231 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com 2024-04-26T10:48:50.231 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T10:48:50.262 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi195.front.sepia.ceph.com 2024-04-26T10:48:50.262 DEBUG:teuthology.orchestra.run.smithi195:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T10:48:50.292 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T10:48:50.293 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:48:50.295 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:48:50.298 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:48:50.305 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:48:50.360 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T10:48:50.360 DEBUG:teuthology.orchestra.run.smithi049:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T10:48:50.367 DEBUG:teuthology.orchestra.run.smithi060:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T10:48:50.369 DEBUG:teuthology.orchestra.run.smithi087:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T10:48:50.372 DEBUG:teuthology.orchestra.run.smithi195:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T10:48:50.507 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T10:48:50.520 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T10:48:50.520 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T10:48:50.545 DEBUG:teuthology.orchestra.run.smithi060:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T10:48:50.571 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T10:48:50.595 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T10:48:50.619 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T10:48:50.629 DEBUG:teuthology.orchestra.run.smithi049:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:48:50.632 DEBUG:teuthology.orchestra.run.smithi060:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:48:50.634 DEBUG:teuthology.orchestra.run.smithi087:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:48:50.638 DEBUG:teuthology.orchestra.run.smithi195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:48:50.653 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = core 2024-04-26T10:48:50.655 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = core 2024-04-26T10:48:50.671 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = core 2024-04-26T10:48:50.681 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = core 2024-04-26T10:48:50.705 DEBUG:teuthology.orchestra.run.smithi049:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:48:50.725 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:48:50.726 DEBUG:teuthology.orchestra.run.smithi060:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:48:50.740 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:48:50.740 DEBUG:teuthology.orchestra.run.smithi087:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:48:50.754 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:48:50.755 DEBUG:teuthology.orchestra.run.smithi195:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:48:50.768 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:48:50.769 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T10:48:50.779 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T10:48:50.779 DEBUG:teuthology.misc:Transferring archived files from smithi049:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674130/remote/smithi049 2024-04-26T10:48:50.780 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T10:48:50.815 DEBUG:teuthology.misc:Transferring archived files from smithi060:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674130/remote/smithi060 2024-04-26T10:48:50.815 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T10:48:50.848 DEBUG:teuthology.misc:Transferring archived files from smithi087:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674130/remote/smithi087 2024-04-26T10:48:50.848 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T10:48:50.877 DEBUG:teuthology.misc:Transferring archived files from smithi195:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674130/remote/smithi195 2024-04-26T10:48:50.878 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T10:48:50.910 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T10:48:50.910 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T10:48:50.912 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T10:48:50.915 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T10:48:50.917 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T10:48:50.959 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T10:48:50.972 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T10:48:50.973 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T10:48:51.032 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T10:48:51.033 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T10:48:51.035 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T10:48:51.037 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T10:48:51.039 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T10:48:51.048 INFO:teuthology.orchestra.run.smithi049.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 10:48 /home/ubuntu/cephtest 2024-04-26T10:48:51.050 INFO:teuthology.orchestra.run.smithi060.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 10:48 /home/ubuntu/cephtest 2024-04-26T10:48:51.051 INFO:teuthology.orchestra.run.smithi087.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 10:48 /home/ubuntu/cephtest 2024-04-26T10:48:51.053 INFO:teuthology.orchestra.run.smithi195.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 10:48 /home/ubuntu/cephtest 2024-04-26T10:48:51.054 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T10:48:51.065 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T10:48:51.137 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/centos_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} duration: 734.2349607944489 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-26T10:48:51.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T10:48:51.209 INFO:teuthology.run:pass